unsloth/gemma-3-4b-it-GGUF

gemma 3 4b it Q4_K_M API

Yes. Umbra lists this public Hugging Face GGUF in its hosted API catalog. When an eligible attested provider is online, call it through the OpenAI- or Anthropic-compatible API using the exact model ID below.

Model IDhf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m

OpenAI base URLhttps://api.tryumbra.dev/v1

Catalog pricing$0.10/M input · $0.30/M output

The exact public artifact

These fields form the complete pinned artifact descriptor providers are approved to serve.

Hugging Face repository: unsloth/gemma-3-4b-it-GGUF
GGUF file: gemma-3-4b-it-Q4_K_M.gguf
Revision: 5a3566e716d80f709ed7b79817eaf7733d2a1fce
SHA-256: 04a43a22e8d2003deda5acc262f68ec1005fa76c735a9962a8c77042a74a7d19
Architecture: gemma3
Quantization: Q4_K_M
License: gemma
Minimum unified memory: 8 GB
Context window: 131,072 tokens
Reasoning: Not asserted by the catalog

Call it with the SDK you already use

The API key is the only secret. Never place a real key in a model card, browser page, or repository.

OpenAI Python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.tryumbra.dev/v1",
    api_key="umbra-...",
)

response = client.chat.completions.create(
    model="hf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m",
    messages=[{"role": "user", "content": "Hello"}],
)

print(response.choices[0].message.content)

OpenAI Node.js

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.tryumbra.dev/v1",
  apiKey: "umbra-...",
});

const response = await client.chat.completions.create({
  model: "hf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m",
  messages: [{ role: "user", content: "Hello" }],
});

console.log(response.choices[0].message.content);

Anthropic Python

from anthropic import Anthropic

client = Anthropic(
    base_url="https://api.tryumbra.dev",
    api_key="umbra-...",
    default_headers={"anthropic-version": "2023-06-01"},
)

message = client.messages.create(
    model="hf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m",
    max_tokens=512,
    messages=[{"role": "user", "content": "Hello"}],
)

print(message.content[0].text)

For this model’s Hugging Face card

If you maintain the repository, this short block gives users an honest hosted-API link. Keep it only while the catalog page remains accurate.

Hosted API block

## Hosted API

This GGUF is available through [Umbra](https://tryumbra.dev/models/hf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m/), an OpenAI- and Anthropic-compatible API for public Hugging Face models served from attested Apple Silicon.

- Model ID: `hf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m`
- API details and live availability: https://tryumbra.dev/models/hf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m/

Questions about the gemma 3 4b it API

Is there an API for unsloth/gemma-3-4b-it-GGUF?

Yes. Umbra lists this public Hugging Face GGUF under the model ID hf-unsloth-gemma-3-4b-it-gguf-gemma-3-4b-it-q4-k-m. Calls are accepted while an eligible attested provider is online.

Is the gemma 3 4b it API OpenAI-compatible?

Yes. Use https://api.tryumbra.dev/v1 as the OpenAI base URL. Umbra also exposes an Anthropic-compatible messages endpoint.

Which gemma 3 4b it artifact does Umbra serve?

The catalog pins unsloth/gemma-3-4b-it-GGUF · 5a3566e716d80f709ed7b79817eaf7733d2a1fce · gemma-3-4b-it-Q4_K_M.gguf with GGUF SHA-256 04a43a22e8d2003deda5acc262f68ec1005fa76c735a9962a8c77042a74a7d19.

Does Umbra retain prompts sent to gemma 3 4b it?

No. Prompts and outputs are decrypted in process, held in memory for the request, and never logged or persisted.

How much Apple unified memory is needed to host gemma 3 4b it?

The current catalog memory floor is 8 GB of unified memory.