SambaNova DataScale

SambaNova DataScale is the only fully integrated hardware-software system that enables organizations to train, fine tune, and deploy the most demanding AI workloads. Achieve world record inference performance with the largest and most challenging models, all with dramatically reduced power requirements compared to other systems.

The DataScale system takes advantage of the unique SambaNova SN40L Reconfigurable Dataflow Unit (RDU)  to deliver exceptional performance in a small footprint. The SN40L is able to deliver this extreme performance thanks to its revolutionary dataflow architecture and large memory footprint.

The industry’s most advanced software stack

SambaNova DataScale features a complete software stack designed to take input from standard machine learning frameworks like PyTorch. Compile, optimize, and execute your models without the need for low level tuning.

The fastest system for inference

The DataScale SN40L delivers the performance, flexibility, scale, and efficiency to power the inference workloads of today and tomorrow. It delivers world record performance and accuracy across Llama 3 8B, 70B, and 405B models. It is the only system that delivers high performance for the 405B model. Other systems either cannot power models that large, or in the case of GPUs, the SN40L is 5x faster.

The most efficient platform

The SambaNova DataScale SN40L is the only platform that can power dozens of models on a single system at the same time, with unrivaled performance and accuracy. The SN40L delivers higher inference speed, with a smaller footprint, and only a fraction of the power consumption compared to other systems.

The most flexible system for fine tuning

Proven by some of the most demanding customer environments in the world, the DataScale SN40L provides outstanding performance for model training, while eliminating the need for low level model tuning. Users can bring their own custom models or Llama 3 checkpoints and securely fine tune them with their private data.