Broadcom’s 3.5D eXtreme Dimension System in Package (XDSiP™)

Broadcom is making waves in the AI arena with its groundbreaking 3.5D eXtreme Dimension System in Package (XDSiP™) platform technology. This innovative system empowers consumer AI developers to create custom accelerators, referred to as XPUs, tailored to their specific needs.

The 3.5D XDSiP integrates over 6000 mm² of silicon and can accommodate up to 12 high bandwidth memory (HBM) stacks within a single, compact package. This unique configuration is designed to deliver high-efficiency, low-power computing solutions that cater to the demands of AI at scale. With Broadcom’s introduction of the industry's first Face-to-Face (F2F) 3.5D XPU, the company is setting a new standard in performance and integration.

As AI technologies evolve, the computational demands for training generative AI models are escalating dramatically. Large-scale training operations now require massive clusters of XPUs, with deployments ranging from 100,000 to as many as 1 million units. These XPUs necessitate sophisticated integration of compute power, memory, and input/output (I/O) capabilities to ensure peak performance while also minimizing power consumption and overall costs.

Broadcom’s XDSiP technology is poised to be a game-changer, enabling businesses to harness the full potential of artificial intelligence, accelerate innovation, and ultimately drive their solutions forward with both efficiency and agility.