Hosted Hugging Face GGUF Models and API Pricing

Models available through Umbra

Start with models serving from the provider network now. The broader catalog stays below for discovery, request planning, and models waiting for capacity.

available = serving at the latest live checkmore models = approved catalog entries without current capacitytok/s live = measured from providers now

try one in playground →

Available and working now 3

These are the first models to try: the coordinator reported active serving capacity at the latest check.

serving now

Qwythos 9B Claude Mythos 5 1M

hf-empero-ai-qwythos-9b-claude-mythos-5-1m-gguf-qwythos-9b-claude-mythos-5-1m-mtp-q4-k-m

qwen35Q4_K_M16 GBdigest pinned

$0.10/M in

$0.30/M out

~13 tok/s live

repo empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUFrev e62b0367license apache-2.0

Serving at last checkAPI details ↗

LFM2.5 230M

hf-liquidai-lfm2.5-230m-gguf-lfm2-5-230m-q4-k-m

lfm2Q4_K_M8 GBdigest pinned

$0.03/M in

$0.10/M out

~34 tok/s live

repo LiquidAI/LFM2.5-230M-GGUFrev fa224d4clicense other

Serving at last checkAPI details ↗

gemma 4 12B coder fable5 composer2.5 v1

hf-yuxinlu1-gemma-4-12b-coder-fable5-composer2.5-v1-gguf-gemma4-coding-q4-k-m

gemma4Q4_K_M9 GBdigest pinned

$0.20/M in

$0.60/M out

~51 tok/s est

repo yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUFrev 1380be17license apache-2.0

Serving at last checkAPI details ↗

More models in the catalog 9

Approved public models with no current serving capacity. Availability can change as providers come online.

Ornith 1.0 35B

hf-deepreinforce-ai-ornith-1.0-35b-gguf-ornith-1-0-35b-q4-k-m

qwen35moeQ4_K_M23 GBdigest pinned

$0.40/M in

$1.20/M out

~17 tok/s est

repo deepreinforce-ai/Ornith-1.0-35B-GGUFrev c2e17030license mit

Temporarily offlineAPI details ↗

Ornith 1.0 9B

hf-deepreinforce-ai-ornith-1.0-9b-gguf-ornith-1-0-9b-q4-k-m

qwen35Q4_K_M8 GBdigest pinned

$0.10/M in

$0.30/M out

~67 tok/s est

repo deepreinforce-ai/Ornith-1.0-9B-GGUFrev 3296bc7alicense mit

Temporarily offlineAPI details ↗

Qwen3.6 35B A3B Uncensored HauhauCS Aggressive

hf-hauhaucs-qwen3.6-35b-a3b-uncensored-hauhaucs-aggressive-qwen3-6-35b-a3b-uncensored-hauhaucs-aggressive-q4-k-m

qwen35moeQ4_K_M23 GBdigest pinned

$0.40/M in

$1.20/M out

~202 tok/s est

repo HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressiverev f12a584flicense apache-2.0

Temporarily offlineAPI details ↗

LFM2.5 230M

hf-liquidai-lfm2.5-230m-gguf-lfm2-5-230m-bf16

lfm2Q4_0_4_48 GBdigest pinned

$0.03/M in

$0.10/M out

~300 tok/s est

repo LiquidAI/LFM2.5-230M-GGUFrev fa224d4clicense other

Temporarily offlineAPI details ↗

LFM2.5 230M

hf-liquidai-lfm2.5-230m-gguf-lfm2-5-230m-q8-0

lfm2Q8_08 GBdigest pinned

$0.03/M in

$0.10/M out

~300 tok/s est

repo LiquidAI/LFM2.5-230M-GGUFrev fa224d4clicense other

Temporarily offlineAPI details ↗

Qwen2.5 0.5B Instruct

hf-qwen-qwen2.5-0.5b-instruct-gguf-qwen2-5-0-5b-instruct-fp16

qwen2F168 GBdigest pinned

$0.03/M in

$0.10/M out

~36 tok/s est

repo Qwen/Qwen2.5-0.5B-Instruct-GGUFrev 9217f5dblicense apache-2.0

Temporarily offlineAPI details ↗

Qwen3 8B

hf-qwen-qwen3-8b-gguf-qwen3-8b-q4-k-m

qwen3Q4_K_M8 GBdigest pinned

$0.10/M in

$0.30/M out

~76 tok/s est

repo Qwen/Qwen3-8B-GGUFrev 7c41481flicense apache-2.0

Temporarily offlineAPI details ↗

TinyLlama 1.1B Chat v1.0

hf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k

llamaQ2_K8 GBdigest pinned

$0.10/M in

$0.30/M out

~300 tok/s est

repo TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUFrev 52e7645blicense apache-2.0

Temporarily offlineAPI details ↗

gemma 3 4b it

hf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m

gemma3Q4_K_M8 GBdigest pinned

$0.10/M in

$0.30/M out

~152 tok/s est

repo unsloth/gemma-3-4b-it-GGUFrev 5a3566e7license gemma

Temporarily offlineAPI details ↗

Continue

related in the console

Try one in the playgroundsend a prompt now Switch to Umbrapick a model id for the snippet Network statswhat the network is serving