DeepSeek R1-0528 is Live on SambaNova Cloud

DeepSeek R1-0528 is Live on SambaNova Cloud

We're excited to announce that the latest version of the DeepSeek R1 model, DeepSeek R1-0528, is now available on SambaNova Cloud! This cutting-edge, open-source reasoning model outperforms its predecessors and rivals leading proprietary models from OpenAI and Google.

The Power of DeepSeek R1-0528

DeepSeek R1-0528 is a 671B-parameter Mixture-of-Experts (MoE) model that has been refined with the latest advancements in reinforcement learning, reward functions, and sampling strategies. This update also introduces several new features aimed at enhancing the developer experience.

Some of the key updates include:

• Support for JSON output and function calling, making it easier for developers to integrate the model's capabilities into their applications and workflows. This capability will be available within the coming weeks for developers in the Cloud.
• System prompts, which streamline deployment for developers by removing the need for a special token at the start of the output to activate "thinking" mode.

These updates make DeepSeek R1-0528 a significant improvement over the original R1 model and the best open-source model available today as verified by Artificial Analysis. It has now improved its accuracy across a wide range of benchmarks including doubling its score on Humanity’s Last exam to 17.7%. One of the reasons for this improvement is due to the model now uses more tokens per question (23K vs. 12K), reflecting deeper reasoning by utilizing more test-time compute.

Experience the Benefits of DeepSeek R1-0528 on SambaNova Cloud

By leveraging SambaNova Cloud, powered by our 4th generation RDU chips, developers can enjoy:

• Lightning-fast inference speeds: With inference speeds of over 200 tokens per second on SambaNova Cloud, you can build applications and agents that are not only more accurate with this model but also more responsive. 
• Easy integrations: Get started building and using this model in your applications, agents, and coding tools. Try it now in Cline to start building AI apps with MCP. 

Get Started with DeepSeek R1-0528 on SambaNova Cloud Today

Ready to unlock the full potential of AI reasoning? SambaNova Cloud makes it easy to get started in minutes. Simply head to our cloud.sambanova.ai, sign up, and receive $5 in free credits to test out the platform. Get your API key and start building with our OpenAI-compatible APIs.

Here's an example code snippet to get you started:

import os
import openai

client = openai.OpenAI(
    api_key=os.environ.get("SAMBANOVA_API_KEY"),
    base_url="https://api.sambanova.ai/v1",
)

response = client.chat.completions.create(
    model="DeepSeek-R1",
    messages=[
        {"role": "system", "content": "You are a helpful assistant"},
        {"role": "user", "content": "Hello"}
    ],
    temperature=0.1,
    top_p=0.1
)

print(response.choices[0].message.content)

About SambaNova Cloud

SambaNova Cloud is a powerful platform that enables developers to easily integrate the best open-source models with the fastest inference speeds. Powered by our state-of-the-art AI Chip, the SN40L, SambaNova Cloud provides a seamless and efficient way to build AI applications. Get started today and experience the benefits of fast inference speeds, maximum accuracy, and enhanced developer experience.