NVIDIA’s next-generation Blackwell architecture servers have begun mass shipments and were publicly showcased at the OCP Summit 2024. Notably, the servers on display expose the chips directly for viewing.
This server is equipped with eight B200 chips, manufactured using a 4NP process and integrating an astonishing 208 billion transistors. It also features 192GB of HBM3E memory, delivering exceptional performance.
However, the power consumption of this server is equally striking, reaching up to 1000W. The total power consumption of the eight B200 chips amounts to a staggering 8000W, consuming 8 kilowatt-hours in just one hour.
Compared to previous-generation servers, NVIDIA has made several critical adjustments to this new server. One significant change is the relocation of the NVLink interconnect control chip, which is no longer positioned at the server’s edge but has been cleverly moved to the center, surrounded by the eight B200 chips. This design helps shorten the distance between GPUs and improves data transfer efficiency.
Additionally, multiple PCIe retimer chips supplied by Astera Labs can be seen in this server. These chips play a key role in data transmission, further optimizing the server’s performance.
According to earlier leaks, NVIDIA claims that thanks to Blackwell’s powerful AI capabilities, just 64 Blackwell GPUs can achieve the AI performance level of 256 Hopper GPUs in certain tests. In the Llama 2 70B test, Blackwell’s performance improved by 2.2 times, while GPT-3 performance doubled.
Disclaimer:
- This channel does not make any representations or warranties regarding the availability, accuracy, timeliness, effectiveness, or completeness of any information posted. It hereby disclaims any liability or consequences arising from the use of the information.
- This channel is non-commercial and non-profit. The re-posted content does not signify endorsement of its views or responsibility for its authenticity. It does not intend to constitute any other guidance. This channel is not liable for any inaccuracies or errors in the re-posted or published information, directly or indirectly.
- Some data, materials, text, images, etc., used in this channel are sourced from the internet, and all reposts are duly credited to their sources. If you discover any work that infringes on your intellectual property rights or personal legal interests, please contact us, and we will promptly modify or remove it.
