Models
Open models you can run on your own workers, each one deployable without writing any code.
Introduction
Each entry names a model and what serves it, and the build turns that into the source your app runs. You deploy it as it is, without writing any code.
You run the app on your own workers, and you pay for the hardware it holds rather than per request.
These are not the models the inference API serves. To call a model over an API without running anything yourself, use the inference API instead.
Gemma 4 12B
Google- Text generation
- l40s
- Apache-2.0
The mid-size Gemma, for when the 31B is more model than the work needs.
Gemma 4 31B
Google- Text generation
- rtx-pro-6000
- Apache-2.0
Google's instruction-tuned 31B, served on its own OpenAI-compatible route.
GLM-4.7 Flash
Z.ai- Text generation
- rtx-pro-6000
- MIT
A mixture-of-experts model that activates a fraction of its weights per token, so it answers at the speed of a much smaller one.
GPT-OSS 120B
OpenAI- Text generation
- rtx-pro-6000
- Apache-2.0
The large open model from OpenAI, 65 GB of MXFP4 weights on a single card.
GPT-OSS 20B
OpenAI- Text generation
- l40s
- Apache-2.0
OpenAI's smaller open model, published already quantized, so 21B parameters fit the cheapest card.
Nemotron 3 Nano 30B A3B
NVIDIA- Text generation
- rtx-pro-6000
- NVIDIA Open Model License
A mixture-of-experts model with a hybrid attention and state-space architecture, activating a fraction of its weights per token.
Nemotron 3 Nano 4B
NVIDIA- Text generation
- l40s
- NVIDIA Open Model License
NVIDIA's small model, tuned for the hardware it runs on.
Nemotron 3.5 Lightning 30B A3B
NVIDIA- Text generation
- rtx-pro-6000
- NVIDIA Open Model License
The latency-tuned member of the Nemotron 3.5 line, a mixture of experts over a hybrid attention and state-space backbone.
Qwen3.5 4B
Alibaba- Text generation
- l40s
- Apache-2.0
Small enough to keep a worker warm without the bill that usually implies.
Qwen3.5 9B
Alibaba- Text generation
- l40s
- Apache-2.0
A mid-size model that answers quickly and leaves most of the card for the context.
Qwen3.6 35B A3B
Alibaba- Text generation
- rtx-pro-6000
- Apache-2.0
A mixture-of-experts model that activates a fraction of its weights per token, in FP8.
Qwen3.8 27B
Alibaba- Text generation
- l40s
- Apache-2.0
Alibaba's current flagship open model, in the FP8 weights its authors publish, which halve the memory and let it run on the cheapest card.
SmolLM3 3B
Hugging Face- Text generation
- l40s
- Apache-2.0
A 3B model trained for reasoning and multilingual use, small enough that a worker comes up in seconds.
BGE Base English
BAAI- Embeddings
- l40s
- MIT
Normalized 768-dimension English embeddings, over a 512-token context.
BGE Large English
BAAI- Embeddings
- l40s
- MIT
Normalized 1024-dimension English embeddings, over a 512-token context.
BGE Small English
BAAI- Embeddings
- l40s
- MIT
Normalized 384-dimension embeddings from a list of texts in one request, on the smallest card that fits it.
BGE-M3
BAAI- Embeddings
- l40s
- MIT
Multilingual embeddings across a hundred languages, for retrieval that is not only English.
Qwen3 Embedding 0.6B
Alibaba- Embeddings
- l40s
- Apache-2.0
Current-generation embeddings from a list of texts in one request, on a model small enough to cost almost nothing to keep warm.
Qwen3 Embedding 4B
Alibaba- Embeddings
- l40s
- Apache-2.0
2560-dimension embeddings over a 40k-token context, the middle size of the family.
Qwen3 Embedding 8B
Alibaba- Embeddings
- l40s
- Apache-2.0
4096-dimension embeddings over a 40k-token context, the largest of the family.
Clef 27B
Cloudflare- Decisions
- rtx-pro-6000
- Apache-2.0
Typed decisions over text, JSON and images. Send a state and your questions, and every option of every question comes back scored in one pass, with nothing to parse.
Clef Flash 9B
Cloudflare- Decisions
- l40s
- Apache-2.0
The small, quick Clef. The same typed decisions over text, JSON and images, on a third of the card.
Clef Omni 30B A3B
Cloudflare- Decisions
- rtx-pro-6000
- Apache-2.0
The Clef that also listens. Send a state with recordings and images alongside it, and your questions come back answered with a probability each.
Laya
Convai Innovations- Decisions
- l40s
- Apache-2.0
Typed decisions instead of written answers. Send a state and your questions, and each one comes back answered with a calibrated probability, in English or in a hundred other languages.
Fibo 2.0 dev
Bria- Image generation
- rtx-pro-6000
- Bria Fibo license, non-commercial
Bria's 8.1B image model, which reads a structured caption rather than a sentence, so what the image is made of is a field you set rather than a phrase you hope lands. The same weights also edit, with up to five reference images, a mask, and text rendered from fonts it was trained against. Its weights are gated, so this one needs your own Hugging Face token stored as HF_TOKEN.
Fibo 2.0 Edit Turbo
Bria- Image generation
- rtx-pro-6000
- Bria Fibo license, non-commercial
The distilled Fibo 2.0, which edits in four steps rather than thirty. Same inputs as the full one, up to five reference images and a mask, for a fraction of the time per edit. Its weights are gated, so this one needs your own Hugging Face token stored as HF_TOKEN.
FLUX 3 Image Klein
Black Forest Labs- Image generation
- rtx-pro-6000
- FLUX.3 license
Black Forest Labs' step-distilled FLUX 3, sixteen steps to an image. It expands your prompt into a full scene caption before generating, and returns that caption with the result, so you can see what the image model actually read. A request can name a LoRA adapter to load on top, which is how an adapter trained for FLUX 3 Klein is served. Its weights are gated, so this one needs your own Hugging Face token stored as HF_TOKEN, and that is also the token a private adapter is fetched with.
FLUX.2 dev
Black Forest Labs- Image generation
- rtx-pro-6000
- FLUX non-commercial license
The full FLUX.2, not distilled, so it takes a real schedule rather than four steps. Its 113 GB of bfloat16 weights are quantized to int8 as they load, which is what puts it on one card. Its weights are gated, so this one needs your own Hugging Face token stored as HF_TOKEN.
FLUX.2 Klein 4B
Black Forest Labs- Image generation
- l40s
- Apache-2.0
The small distilled FLUX, four steps to an image, Apache licensed and light enough to leave a worker warm.
FLUX.2 Klein 9B
Black Forest Labs- Image generation
- l40s
- FLUX.2 Klein license
The larger distilled FLUX, still four steps. Its weights are gated, so this one needs your own Hugging Face token stored as HF_TOKEN.
Ideogram 4
Ideogram- Image generation
- l40s
- Ideogram license
Ideogram's open release, in the NF4 weights its authors publish for diffusers. Known for typography, so text inside the image comes out readable. Its weights are gated, so this one needs your own Hugging Face token stored as HF_TOKEN.
MiniMax H3 Image
MiniMax- Image generation
- rtx-pro-6000
- MiniMax H3 Image community license
MiniMax's image model, six steps and no classifier-free guidance, at four megapixels or at the sixteen MiniMax recommends. Your prompt is read verbatim with no chat template, so a long and complete description is what it works best from, and the first 4096 tokens are what it reads. Strongest at photography, dense scenes and rendered text.
P-H3-Image
Pruna AI- Image generation
- rtx-pro-6000
- MiniMax H3 community license
Pruna's image model built on MiniMax H3, eight steps to an 8-megapixel image, no classifier-free guidance. It expands your prompt into the full prompt the model renders best and returns it with the result, so you can read what the image model was actually given. Strongest at photorealism, film and editorial looks, and graphic styles with short quoted text.
Qwen Image 2.1
Alibaba- Image generation
- l40s
- Qwen license
Alibaba's open image model, strong on rendering text inside the image it generates.
Qwen Image 2.1 Turbo
Alibaba- Image generation
- l40s
- Qwen license
The distilled Qwen Image, a few steps instead of a full schedule, for when latency matters more than the last detail.
RMBG 2.0
Bria- Image generation
- l40s
- Bria RMBG license, non-commercial
Bria's background remover, which returns the subject on transparency and the mask on its own. It reads the image at a fixed size and gives the mask back at the size you sent, so the result drops straight onto the original. Its weights are gated, so this one needs your own Hugging Face token stored as HF_TOKEN.
SAM 2.1 Hiera Large
Meta- Image generation
- l40s
- Apache 2.0
Meta's Segment Anything 2.1, run without a prompt so it finds every part of an image on its own. It answers with a label map, one PNG the size of the image where each pixel holds the id of the part it belongs to and the smallest part wins wherever parts overlap, so nothing is hidden by what contains it. Each part also comes back with its own area and bounding box, and with its own mask on request. The point grid and the two quality filters are request parameters, so how finely it divides an image is the caller's decision.
Z-Image Turbo
Alibaba- Image generation
- l40s
- Apache-2.0
A distilled image model that reaches a finished picture in single-digit steps, so a request costs a fraction of a full sampler run.
LTX-2.5
Lightricks- Video generation
- rtx-pro-6000
- LTX-2.5 license
Video with its own audio from one pass, and the model picks the length to suit the prompt. Its weights are gated, so this one needs your own Hugging Face token stored as HF_TOKEN.
MiniMax H3
MiniMax- Video generation
- rtx-pro-6000
- MiniMax license
Video with its own stereo audio from one denoising pass, at 768p. This is H3-Base, the part MiniMax published. The context stage their own workflow runs in front of it is not open, so results here are the base model's rather than what their API returns.
MiniMax Music 3
MiniMax- Audio generation
- l40s
- MiniMax Music 3 community license
A song from a description and its lyrics, sung, in stereo at 44.1 kHz. Leave the lyrics out and the track comes back instrumental.
YuE2 3B
M-A-P- Audio generation
- l40s
- CC BY-NC 4.0
A full song from a style and its lyrics, sung, in stereo at 48 kHz. It writes a score first and hands it back as ABC notation, so an edited score can be sent in to render a revision, or a transcribed melody to cover an existing song.
Qwen2.5-Omni 7B
Alibaba- Speech
- rtx-pro-6000
- Qwen license
A model that listens and answers, in writing or out loud. Send a question, or a recording with a question about it, and ask for the reply to be read aloud.
Qwen3-TTS 0.6B Base
Alibaba- Speech
- l40s
- Apache-2.0
Text read aloud in the voice of a recording you supply. A few seconds of clean speech is enough to copy from.
Qwen3-TTS 0.6B Custom Voice
Alibaba- Speech
- l40s
- Apache-2.0
Text read aloud in one of the voices the model publishes, at a size that starts in seconds.
Qwen3-TTS 1.7B Base
Alibaba- Speech
- l40s
- Apache-2.0
Text read aloud in the voice of a recording you supply, at the larger size for closer copies.
Qwen3-TTS 1.7B Custom Voice
Alibaba- Speech
- l40s
- Apache-2.0
Text read aloud in one of the voices the model publishes, with an optional instruction for how to read it.
Qwen3-TTS 1.7B Voice Design
Alibaba- Speech
- l40s
- Apache-2.0
A voice built from a description rather than picked from a list. Say the age, accent, pace and mood, and the model reads your text in it.
Voxtral Mini 3B
Mistral AI- Speech
- l40s
- Apache-2.0
Speech turned into text. Send a recording and get its transcript, with the language detected or named.
The deployed app
It behaves like any other Serverless app: it scales to zero on its idle TTL, resumes on the next call, and apps scale changes its hardware like anywhere else.
The weights are pinned to one commit. An entry records the revision it was tested against, so the same deploy brings the same weights however long it has been listed.
The server is the one the model's own ecosystem publishes. A text model runs under vLLM on its own OpenAI-compatible route, from the image vLLM's maintainers release, so there is no Runware layer between your request and the server.