SemiAnalysis

MI300X vs H100 vs H200 Benchmark Part 1: Training CUDA Moat Still Alive Our 5-month journey conducting independent analysis & benchmarking of AMD MI300X vs Nvidia H100 + H200 Detailed, open source low-level benchmarks performance vs TCO Comprehensive public recommendations It’s not just immature software, they need to change how they do development User Experience, Usability GEMM + attention InfiniBand vs Spectrum-X vs RoCEv2 Ethernet https://lnkd.in/du4Pqym3

Scaling Laws – O1 Pro Architecture, Reasoning Training Infrastructure, Orion and Claude 3.5 Opus “Failures” AI Lab Synthetic Data Infrastructure, Inference Tokenomics of Test Time Compute, The Data Wall, Evaluation's are Broken, RLAIF, Inference Time Search, Scale Needed More Than Ever https://lnkd.in/d9HfyvPi

Scaling Laws – O1 Pro Architecture, Reasoning Training Infrastructure, Orion and Claude 3.5 Opus “Failures” AI Lab Synthetic Data Infrastructure, Inference Tokenomics of Test Time Compute, The Data Wall, Evaluation's are Broken, RLAIF, Inference Time Search, Scale Needed More Than Ever https://lnkd.in/d9HfyvPi

Intel on the Brink of Death Board Short Circuits, Cultural Rot, Product Focus Is Flawed, x86 Has No Moat, Sell The PC Business, Foundry Must Survive Nvidia's PC CPU Push - 3 Chip Tegra Strategy Sierra Forest, Granite Rapid, Clearwater Forest, Diamond Rapids, Rogue River Forest https://lnkd.in/dCv5Ha4F

$ALAB COO misspoke at the UBS conference yesterday when talking about the company's Trainium2 content. As per our detailed architecture breakdown, there are 2 OSFP XD paddle cards per Trainium2 chip. This equates to 128 AEC paddle cards per Trn2-Ultra super rack (64 AEC cables). https://lnkd.in/eH9kewJw

$ALAB COO misspoke at the UBS conference yesterday when talking about the company's Trainium2 content. As per our detailed architecture breakdown, there are 2 OSFP XD paddle cards per Trainium2 chip. This equates to 128 AEC paddle cards per Trn2-Ultra super rack (64 AEC cables). https://lnkd.in/eH9kewJw

Daniel Nishball, CFA and Jeremie Eliahou Ontiveros will be attending Pacific Telecommunications Council (PTC) 2025 in Honolulu, Hawaii. If you’re attending and would like to discuss AI clusters, datacenters and market trends in digital infrastructure, feel free to reach out to schedule a meeting. We look forward to connecting at the event! #PTC2025 #DataCenters #networking

Daniel Nishball, CFA and Jeremie Eliahou Ontiveros will be attending Pacific Telecommunications Council (PTC) 2025 in Honolulu, Hawaii. If you’re attending and would like to discuss AI clusters, datacenters and market trends in digital infrastructure, feel free to reach out to schedule a meeting. We look forward to connecting at the event! #PTC2025 #DataCenters #networking

Amazon’s AI Self Sufficiency | Trainium2 Architecture & Networking Trn2, Trn2-Ultra, Performance, Software, NeuronLinkv3, EFAv3, TCO, 3D Torus, Networking Costs, Supply Chain Our first post after leaving Substack please try logging into new site lmk if email didn't hit If you need help logging in or have trouble recieving emails, please check out the FAQ. We also have a support team member to help so reach out below. https://lnkd.in/dxk-HW7C https://lnkd.in/d9MgS5EA

Fab Whack-A-Mole: Chinese Companies are Evading U.S. Sanctions Huawei Fab Network, WFE Vendors Cry Wolf, Framework for Future Controls https://lnkd.in/davBfJPV