Developers around the world have been using SambaCloud to create amazing applications using the best open-source models running with fast and efficient inference, thanks to the SambaNova RDU. SambaCloud offers an OpenAI-compatible REST API that makes it extremely easy for developers to start building within minutes.
Today, we are unveiling the SambaNova SDK to make it even simpler to get started building — providing native, type-safe SDKs for both Python and JavaScript/TypeScript making it easy to interact with the SambaNova REST API. You will have access to a range of models on SambaCloud including DeepSeek, Llama and Qwen. Each has its own capabilities, such as text image or audio processing, to support your AI applications.
Here are some of the popular models used by developers today:
Check this link out for the full list.
To get started in Python, you can install the SDK from PyPI with a single command.
Open a terminal window and install the SambaNova SDK.
Before you can call any models, you’ll need:
Then initialize the client:
That’s it — you’re now ready to interact with any of the supported models.
The SambaNova API and SDK support the wide range of tuning parameters offered by every model. Here are some of the parameters used above and how you can best control them.
temperature: What sampling temperature to use, between 0 and 2. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic.
top_p: An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass.
top_k: The top_k parameter is used to limit the number of choices for the next predicted word or token.
Beyond just chat completions, the SDK supports many other methods to make it easier to work with different types of models and modalities. Below is the full list and you can review the linked examples:
The SambaNova Python SDK gives developers a clear, intuitive way to build intelligent systems with top-tier models. If you can import a package and write a few lines of Python, you’re ready to build production-ready AI apps.
Check out this Google Colab Notebook that is publicly available to get started here.
The SambaNova SDK is more than a wrapper, it’s a bridge between cutting-edge AI models and the tools you already use. Whether you’re building a chat app, a retrieval pipeline, or a multimodal agent, the SDK gives you a clean, powerful interface to bring those ideas to life.
Explore the SambaNova SDK docs for full API details. Code examples are also included for:
Github Repository for the SambaNova Python SDK.
Github Repository for the SambaNova TypeScript SDK.
Sign up for the SambaCloud here.
SambaCloud is a powerful platform that enables developers to easily integrate the best open-source models with the fastest inference speeds. Powered by our state-of-the-art AI chip, the SN40L, SambaCloud provides a seamless and efficient way to build AI applications with fast inference. Get started today and experience the benefits of fast inference speeds, maximum accuracy, and an enhanced developer experience, in just three easy steps!