DeepInfra on Hugging Face Inference Providers 🔥
DeepInfra on Hugging Face Inference Providers 🔥 We're thrilled to share that DeepInfra is now a supported Inference Provider on the Hugging Face Hub! DeepInfra joins our growing ecosystem, enhancing the breadth and capabilities of serverless inference directly on the Hub's model pages. Inference Providers are also seamlessly integrated into our client SDKs (for both JS and Python), making it super easy to use a wide variety of models with your preferred providers. DeepInfra is a serverless AI inference platform offering one of the most cost-effective pricing per token in the industry. With a catalog of over 100 models, DeepInfra makes it easy for developers to integrate a wide range of AI capabilities into their applications with minimal setup. DeepInfra supports a broad spectrum of model types - from LLMs to text-to-image, text-to-video, embeddings, and more. As part of this initial integration, DeepInfra is launching support for conversational and text-generation tasks on Hugging Face, enabling access to popular open-weight LLMs such as DeepSeek V4, Kimi-K2.6, GLM-5.1, and many more. Support for additional tasks (text-to-image, text-to-video, embeddings, and more) will roll out soon! Read more about how to use DeepInfra as an Inference Provider in its dedicated documentation page. See the full list of models supported by DeepInfra here. Follow DeepInfra on Hugging Face: https://huggingface.co/DeepInfra. How it works In the website UI - In your user account settings, you are able to: - Set your own API keys for the providers you've signed up with. If no custom key is set, your requests will be routed through HF. - Order providers by preference. This applies to the widget and code snippets in the model pages. - As mentioned, there are two modes when calling Inference Providers: - Custom key (calls go directly to the inference provider, using your own API key of the corresponding inference provider) - Routed by HF (in that case, you don't need a token from the provider, and the charges are applied directly to your HF account rather than the provider's account) - Model pages showcase third-party inference providers (the ones that are compatible with the current model, sorted by user preference) From the client SDKs DeepInfra is available through the Hugging Face SDKs - huggingface_hub (>= 1.11.2) for Python and @huggingface/inference for JavaScript. The following examples show how to use DeepSeek V4 Pro through DeepInfra. Use a Hugging Face token to authenticate - the request will be routed to DeepInfra automatically. From your favorite Agent Harness Hugging Face Inference Providers are integrated in most Agent Harnesses - including Pi, OpenCode, Hermes Agents, OpenClaw, and more. This means you can plug DeepInfra-hosted models straight into your favorite tools without any extra glue code. Browse the full list of integrations here. from Python import os from openai import OpenAI client = OpenAI( base_url="https://router.huggingface.co/v1", api_key=os.environ["HF_TOKEN"], ) completion = client.chat.completions.create( model="deepseek-ai/DeepSeek-V4-Pro:deepinfra", messages=[ { "role": "user", "content": "Write a Python function that returns the nth Fibonacci number using memoization." } ], ) print(completion.choices[0].message) from JS import { OpenAI } from "openai";…

