A brand new paradigm is reshaping cloud infrastructure: neoclouds. These AI-first next-gen cloud suppliers are constructing GPU-dense platforms designed for the unrelenting scale and efficiency calls for of recent machine studying. Not like conventional cloud suppliers retrofitting current infrastructure, neoclouds are purpose-building AI-native materials from the bottom up—the place each GPU cycle counts and each packet issues.
In these AI-native environments, the community is not a passive conduit. It’s the synchronizing pressure that retains colossal clusters of GPUs operating at full throttle, each second of the day. Reaching this requires extra than simply bandwidth: it calls for deterministic, lossless operation, deep observability, and the agility to evolve as AI workloads and architectures shift.
The Neocloud blueprint: Open, scalable, and AI-optimized with Cisco 8000
That is the place the Cisco 8000 Collection with SONiC steps in—not as a standard swap, however because the clever spine for neoclouds. Designed for a disaggregated, open networking strategy, the Cisco 8000 Collection with SONiC straight addresses the distinctive wants of AI-native clouds in 4 elementary methods:
1. Operational agility via disaggregation
The Cisco 8000 Collection presents a versatile, open platform supreme for neoclouds in search of fast innovation. With absolutely supported Cisco-validated SONiC and key AI options, the platform allows a really disaggregated stack. This permits for impartial {hardware} and software program updates, simple integration of open-source capabilities, and superior AI observability and site visitors engineering. For backend buildouts, the Cisco 8122-64EH-O (64x800G QDD) and 8122-64EHF-O (64x800G OSFP) platforms—each powered by the Cisco Silicon One G200 ASIC—ship high-performance 800G throughput to satisfy the wants of demanding AI and knowledge heart workloads. These platforms mix dependable, purpose-built {hardware} with agile, cloud-native software program, guaranteeing a scalable basis for evolving infrastructure wants.
2. Deterministic, lossless material for distributed coaching
AI clusters depend upon synchronized, high-bandwidth, lossless networks to maintain hundreds of GPUs absolutely utilized. The Cisco 8122 platforms, constructed with G200 ASICs, ship massive, absolutely shared, on-die packet buffer, ultra-low jitter, and adaptive congestion administration—all important for RDMA-based workloads and collective operations. With help for 800G as we speak and 1.6T speeds tomorrow, the material can scale as quick as AI ambition grows.
3. Intelligence in-built: Superior AI networking options
Cisco’s providing is anchored by its superior AI networking options—a wealthy set of instruments designed to offer real-time community insights, workload-aware scheduling, and dynamic congestion isolation. These options allow the material to implement predictive site visitors steering, aligning community conduct with AI workload patterns to maximise cluster effectivity and throughput.
4. Open, programmable, and future-proof
With open NOS like SONiC, the community turns into as programmable because the AI workloads it helps. Operators can quickly deploy new options, combine with GPU schedulers, and lengthen the telemetry pipeline to match evolving wants. Moreover, the Cisco 8122 platforms are UEC-ready, aligning with the rising Extremely Ethernet Consortium 1.0 requirements to make sure your community is ready for future AI calls for.
Scaling the AI supercloud: Out and throughout
Determine 1: Scale out and scale throughout
Scale out: Creating multi-tier backend AI materials with clever material capabilities
As AI workloads scale, it’s essential for the underlying community to advance in each bandwidth and intelligence. Cisco multistage Clos topologies, constructed with Cisco 8122 platforms, ship actually non-blocking materials optimized for large-scale GPU clusters. On the coronary heart of this answer is the great, AI-native networking feature-set designed to maximise efficiency and effectivity for AI clusters.
Key capabilities embody:
- Superior congestion administration:
Precedence Circulation Management (PFC) and Specific Congestion Notification (ECN) work in tandem to make sure the best throughput and minimal latency throughout congestion, retaining clusters synchronized and operating easily. - Adaptive routing and switching (ARS):
Dynamically steers site visitors in keeping with real-time congestion and circulation patterns, maximizing effectivity throughout your complete community material. ARS presents two sub-modes:- Flowlet load balancing: Splits site visitors into micro-bursts (flowlets) and routes every alongside the optimum path, enhancing utilization whereas preserving packet order—important for RDMA-based GPU workloads.
- Packet spraying: Distributes packets throughout all out there paths for max throughput, supreme for AI collective operations that tolerate packet reordering.
- Weighted ECMP:
Visitors is distributed erratically over a number of equal-cost paths in keeping with predefined weights. This ensures higher-capacity or less-congested hyperlinks carry extra site visitors, enhancing general utilization and efficiency in large-scale deployments. - QPID hashing:
Employs superior hashing strategies to evenly unfold site visitors, minimizing circulation collisions and stopping single-path oversubscription. - Packet trimming:
Throughout excessive congestion, non-essential packet payloads are eliminated to alleviate hotspots, whereas essential header info is retained for continued routing with out dropping total packets. - Versatile topology help:
Suitable with a wide range of community architectures—together with rail-only, rail-optimized, and conventional leaf/backbone topologies. The system helps each IPv4 and IPv6 underlays and integrates with IP/BGP and EVPN-based materials, permitting operators to tailor networks to particular AI cluster wants. - Multivendor SmartNIC interoperability:
Designed for seamless integration with a various ecosystem of SmartNICs from a number of distributors, guaranteeing flexibility, funding safety, and future-proof infrastructure. - AI-driven observability with PIE port:
Gives deep, real-time visibility at each per-port and per-flow ranges—together with GPU-to-GPU site visitors and congestion hotspots—utilizing ASIC-level telemetry, in-band INT packet tracing, and SONiC integration. This allows operators to proactively monitor, tune, and troubleshoot networks to optimize AI coaching outcomes.
Collectively, these options create a material that isn’t solely extremely scalable but additionally actually AI-optimized. The Cisco 8122 platforms’ clever networking capabilities allow the community to soak up synchronized site visitors bursts, stop congestion collapse, and preserve each GPU working at peak effectivity—empowering next-generation AI workloads with unmatched efficiency and reliability.
Scale throughout: Federating AI pods globally
As AI infrastructure expands past single knowledge facilities to span areas and continents, scale-across networking turns into essential. Neoclouds must federate distributed GPU clusters whereas sustaining the low-latency, high-bandwidth efficiency that AI workloads demand.
The Cisco 8223, powered by Silicon One P200—the business’s first 51.2T deep-buffer router—addresses this problem head-on. With built-in MACsec safety, 800GE interfaces supporting each OSFP and QSFP-DD optics, and coherent optics functionality, the 8223 delivers the flexibleness and effectivity next-generation distributed AI workloads require.
Native SONiC help allows seamless integration between AI backends and WAN connectivity, permitting operators to construct open, programmable networks that scale globally with out sacrificing the efficiency traits of native clusters.
Accelerating neocloud AI networks with Cisco 8000 Collection
Determine 2: Cisco 8000 Collection for scale out and scale throughout
Within the AI period, networks have advanced from infrastructure value facilities to aggressive differentiators. For neoclouds, networking efficiency straight impacts GPU utilization, coaching effectivity, and finally, buyer success.
By combining the Cisco 8000 Collection platforms, superior AI networking options, and the openness of SONiC, neoclouds can construct infrastructure that scales seamlessly, operates effectively, and adapts as AI workloads evolve. It’s not nearly retaining tempo with AI innovation—it’s about enabling it.
Further assets:
Â
