Graphcore’s Post

WWT tested 800G Ethernet vs. InfiniBand and the results are interesting! Can we finally take advantage of a more ubiquitous feature-rich technology?

Not totally agree with this opinion, but direction and decision is totally based on the end customer side! I was from the Ethernet world(that’s why I achieved 7x CCIE Cisco certification in the past) but right now mainly focusing on InfiniBand for AI network! UEC Doesn’t Want To Kill InfiniBand, But It Wants Ethernet To Beat It InfiniBand has proved very difficult to beat in HPC and, for the moment at least, is the preferred low latency, high bandwidth interconnect for back-end networking in AI training clusters that are a similar kind of supercomputer. But with the changes being implemented by members of the UEC, Ethernet is going to be able to scale much further than InfiniBand ever could and will have some properties that are still missing from InfiniBand.

Vector packet processing by ARM SVE2 can improve performance over 10 times.

🎉 Breaking News! Asterfusion Joins the Ultra Ethernet Consortium (#UEC) to Power the AI-Driven Networking Revolution! Asterfusion, a trailblazer in #ultralowlatencyEthernetswitches from #25G to #400G with a Turnkey #SONiC solution, has proudly joined the #UltraEthernetConsortium (#UEC). Together, we're not just building networks – we're creating the infrastructure backbone for the #AIera! Imagine lightning-fast data transfers, unparalleled scalability, and network efficiency like never before. Our #SONiC-based #RoCEswitches and cutting-edge Ultra Ethernet innovations make it possible. And get this – our upcoming 51.2T/ #800GAIswitches will push the limits of networking performance! Asterfusion's #ultralowlatency Ethernet switches will empower your organization to seamlessly embrace AI-powered applications. Experience enhanced network agility, reduced latency, and improved scalability like never before. Together, we're not just innovating – we're shaping the future of digital transformation. Let's build the AI-powered network of tomorrow, today! #ultralowlatencyswitch #OpenNetworking #AIswitch #ROCEswitch #SONiCswitch #UltraEthernet #UEC Learn more: https://lnkd.in/gbX6dE8B

 InfiniBand networks maximize business performance while minimizing power consumption and hardware requirements, making them increasingly indispensable across various use cases.

🌐 What’s InfiniBand, and how does it differ from Ethernet? InfiniBand is a high-speed networking tech designed for data-intensive environments, like HPC and data centers. Compared to Ethernet: 1️⃣ Higher Bandwidth: InfiniBand can exceed 1 Tbps, far surpassing Ethernet’s typical 400 Gbps. 2️⃣ Lower Latency: With RDMA (Remote Direct Memory Access), InfiniBand cuts delays by letting systems access each other’s memory directly. 3️⃣ Better Scalability: Ideal for large, high-throughput networks. While Ethernet is versatile, InfiniBand’s performance makes it the choice for demanding, high-speed data tasks. 🚀

This is just more AI #hypium until I see a public datasheet and reproducible firmware builds for ultra ethernet MAC and Switch silicon. The first company to release this will own certain critical industry markets that human civilization cannot currently do without. There are industries where reproducibility, maintainability, and security are more important to the bottom line than having the latest greatest microbenchmark that doesn't really matter. Oh, and I'm sure that folks like George Hotz and scientists at DOE national labs can make the hardware with good public documentation run faster than things that require obfuscated encrypted binaries to bring up the link. Also, what did we learn from CVE-2024-3094? Open source is not immune, but at least we have a chance to find and fix the backdoors.

Ultra Ethernet promises to tune Ethernet for the needs of specialized workloads, including HPC and AI, from the lowest hardware to the software stack. This episode of Utilizing Tech features Dr. J Metz, Steering Committee Chair of the Ultra Ethernet Consortium, discussing this new technology with Frederic Van Haren and Stephen Foskett. #UtilizingTech #UtilizingAI

Has Spirent cracked the AI Ethernet network test puzzle? The vendor is using the remote direct memory access over converged Ethernet version 2 protocol.

Ultra Ethernet gains momentum as tech giants join for AI and HPC network innovation. Newcomers to the group include IBM, Nokia, Dell, Baidu, Huawei, Lenovo, Supermicro, and Tencent. In short, it wants to optimize AI and HPC workloads by modernizing remote direct memory access (RDMA) operation over Ethernet. It is pushing to replace the legacy RoCE protocol with Ultra Ethernet Transport, an open protocol specification designed to run over IP and Ethernet - https://lnkd.in/g9Gmk88Z #AI #HPC