header lang header lang EN
sambanova-logo-black
Products
SambaNova’s AI platform is the technology backbone for the next decade of AI innovation. Customers are turning to SambaNova to quickly deploy state-of-the-art AI and deep learning capabilities that help them outcompete their peers.
SambaNova Suite
The only, enterprise grade full stack platform, purpose built for generative AI
DataScale®
The platform for generative AI development and innovation
Use Cases
Public Sector | AI for Science | Sovereign AI
Technology
RDU: The GPU Alternative
Power the most demanding generative and agentic AI workloads with the most performant & capable processor, purpose-built for AI
Composition of Experts
Easily run your custom models, accelerate discovery, & power the next generation of high performance computing
Developers
SambaNova delivers the only enterprise-grade full stack platform, from chips to models, purpose built for generative AI
SambaNova Cloud
Supercharge your AI-powered applications across Llama 3 8B, 70B, & 405B models.
For free.
Resources
Developer Community
Starter Kits
Research
Technical Documentation
Resources
Find what you need to accelerate your AI journey.
About
Customers are turning to SambaNova to quickly deploy state-of-the-art AI capabilities to gain competitive advantage. Our purpose-built enterprise-scale AI platform is the technology backbone for the next generation of AI computing. We power the foundation models that unlock the valuable business insights trapped in data.
Try It Now »
sambanova-logo-black
header lang header lang EN
Try It Now »
Try It Now »

SambaNova DataScale

The Fastest Hardware Platform for Model Training, Fine Tuning, & Inference

SambaNova DataScale is the only fully integrated hardware-software system that enables organizations to train, fine tune, and deploy the most demanding AI workloads and to achieve world record inference performance with the largest and most challenging models.

SambaChip_SN40L_Composite_R1_600x300

 

Powered by the SambaNova SN40L reconfigurable dataflow unit (RDU), the SambaNova DataScale SN40L delivers unprecedented performance across all model sizes to enable government agencies, research organizations, and enterprises to quickly deploy more and larger models, with greater accuracy, all with a smaller footprint than GPUs.

The fastest inference platform

Delivering world record performance and accuracy, across the latest large and small models.

Designed for scale

With TBs of addressable memory, run all your models and switch between them in microseconds.

Delivering the highest accuracy

Quickly, easily, and securely fine tune models using private data for the highest accuracy.

The DataScale system takes advantage of the unique SambaNova SN40L Reconfigurable Dataflow Unit (RDU)  to deliver exceptional performance in a small footprint. The SN40L is able to deliver this extreme performance thanks to its revolutionary dataflow architecture and large memory footprint.

RDU_Dataflow_Architecture_486x230

Dataflow architecture

The SN40L is purpose-built for AI. Breaking free from the limitations of legacy technologies, the SN40L uses a dataflow architecture and innovative software stack that maps AI algorithms to the processor and dynamically reconfigures the processor for optimal performance. This eliminates the redundancy inherent to GPU architectures, resulting in significantly greater performance on a fraction of the hardware footprint. 

Three tiered memory architecture

Purpose-built to power the largest AI models, the SN40L has a three tiered memory architecture that includes very large memory, high bandwidth memory, and very fast memory. The result is that a single system node can support up to 5 trillion parameters consisting of up to hundreds of separate models. With TBs of addressable memory, the SN40L is ideal for custom and chained models, and can switch between models in microseconds which is orders of magnitude faster than legacy GPUs.

DataFlow_stack-584x424

The industry’s most advanced software stack

SambaNova DataScale features a complete software stack designed to take input from standard machine learning frameworks like PyTorch. Compile, optimize, and execute your models without the need for low level tuning.

The fastest system for inference

The DataScale SN40L delivers the performance, flexibility, scale, and efficiency to power the inference workloads of today and tomorrow. It delivers world record performance and accuracy across Llama 3 8B, 70B, and 405B models. It is the only system that delivers high performance for the 405B model. Other systems either cannot power models that large, or in the case of GPUs, the SN40L is 5x faster.

The most flexible system for fine tuning

Proven by some of the most demanding customer environments in the world, the DataScale SN40L provides outstanding performance for model training, while eliminating the need for low level model tuning. Users can bring their own custom models or Llama 3 checkpoints and securely fine tune them with their private data.

 

DataScale SN30

Purpose built for the most demanding AI and deep learning workloads, the DataScale SN30 is a fully integrated hardware-software system, powered by a dataflow architecture, that enables organizations to train and deploy the most demanding foundation model and AI for Science workloads and achieve world record performance with the largest and most challenging models.
Headquarters:
2200 Geng Road, Unit 100
Palo Alto, CA 94303
(650) 263-1153
Terms & Conditions Privacy Policy
Copyright © 2024 SambaNova Systems, Inc. All rights reserved

Products

Technology

Resources

About

Contact

Customers turn to SambaNova to quickly deploy state-of-the-art AI capabilities to meet the demands of the AI-enabled world. Our purpose-built enterprise-scale AI platform is the technology backbone for the next generation of AI computing. We enable customers to unlock the valuable business insights trapped in their data. Our flagship offering, SambaNova Suite, overcomes the limitations of legacy technology to power the large complex foundation models that enable customers to discover new services and revenue streams, and boost operational efficiency. Headquartered in Palo Alto, California, SambaNova Systems was founded in 2017 by industry luminaries, and hardware and software design experts from Sun/Oracle and Stanford University. Investors include SoftBank Vision Fund 2, funds and accounts managed by BlackRock, Intel Capital, GV, Walden International, Temasek, GIC, Redline Capital, Atlantic Bridge Ventures, Celesta, and several others.
Headquarters:
2200 Geng Road, Unit 100
Palo Alto, CA 94303
(650) 263-1153
Terms & Conditions Privacy Policy
Copyright © 2024 SambaNova
Systems, Inc. All rights reserved