Early access · Paid API credit is live. New accounts still get free starter credit.
PricingDocsModelsFAQEarnBlogAboutSign in →

TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF

TinyLlama 1.1B Chat v1.0 Q2_K API

Yes. Umbra lists this public Hugging Face GGUF in its hosted API catalog. When an eligible attested provider is online, call it through the OpenAI- or Anthropic-compatible API using the exact model ID below.

Model IDhf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k
OpenAI base URLhttps://api.tryumbra.dev/v1
Catalog pricing$0.10/M input · $0.30/M output

Published artifact provenance

This catalog entry is missing at least one field needed for an exact artifact claim. Verify the repository, revision, filename, and digest before relying on it.

Hugging Face repository
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF
GGUF file
Not published
Revision
52e7645ba7c309695bec7ac98f4f005b139cf465
SHA-256
030a469a63576d59f601ef5608846b7718eaa884dd820e9aa7493efec1788afa
Architecture
llama
Quantization
Q2_K
License
apache-2.0
Minimum unified memory
8 GB
Context window
2,048 tokens
Reasoning
Not asserted by the catalog

Call it with the SDK you already use

The API key is the only secret. Never place a real key in a model card, browser page, or repository.

OpenAI Python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.tryumbra.dev/v1",
    api_key="umbra-...",
)

response = client.chat.completions.create(
    model="hf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k",
    messages=[{"role": "user", "content": "Hello"}],
)

print(response.choices[0].message.content)

OpenAI Node.js

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.tryumbra.dev/v1",
  apiKey: "umbra-...",
});

const response = await client.chat.completions.create({
  model: "hf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k",
  messages: [{ role: "user", content: "Hello" }],
});

console.log(response.choices[0].message.content);

Anthropic Python

from anthropic import Anthropic

client = Anthropic(
    base_url="https://api.tryumbra.dev",
    api_key="umbra-...",
    default_headers={"anthropic-version": "2023-06-01"},
)

message = client.messages.create(
    model="hf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k",
    max_tokens=512,
    messages=[{"role": "user", "content": "Hello"}],
)

print(message.content[0].text)

For this model’s Hugging Face card

If you maintain the repository, this short block gives users an honest hosted-API link. Keep it only while the catalog page remains accurate.

Hosted API block

## Hosted API

This GGUF is available through [Umbra](https://tryumbra.dev/models/hf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k/), an OpenAI- and Anthropic-compatible API for public Hugging Face models served from attested Apple Silicon.

- Model ID: `hf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k`
- API details and live availability: https://tryumbra.dev/models/hf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k/

Questions about the TinyLlama 1.1B Chat v1.0 API

Is there an API for TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF?

Yes. Umbra lists this public Hugging Face GGUF under the model ID hf-thebloke-tinyllama-1.1b-chat-v1.0-gguf-tinyllama-1-1b-chat-v1-0-q2-k. Calls are accepted while an eligible attested provider is online.

Is the TinyLlama 1.1B Chat v1.0 API OpenAI-compatible?

Yes. Use https://api.tryumbra.dev/v1 as the OpenAI base URL. Umbra also exposes an Anthropic-compatible messages endpoint.

Which TinyLlama 1.1B Chat v1.0 artifact does Umbra serve?

Umbra’s catalog record does not yet publish every field needed to identify one exact artifact: repository, immutable revision, GGUF filename, and SHA-256 digest. Review the provenance fields below before use.

Does Umbra retain prompts sent to TinyLlama 1.1B Chat v1.0?

No. Prompts and outputs are decrypted in process, held in memory for the request, and never logged or persisted.

How much Apple unified memory is needed to host TinyLlama 1.1B Chat v1.0?

The current catalog memory floor is 8 GB of unified memory.