gemma-4-31B-it
google/gemma-4-31b-itHugging FaceChatVisionconversationalgemmagemma4googleimage-text-to-textimatrixreasoningtoolsunsloth
Providers
Live endpoints for this model, cheapest first. TTFT is time to first token, measured on streamed requests; response is request to last byte, measured on every request; throughput covers the last day; uptime is measured over the last day and week.
| Provider | Context | Max out | Input | Output | Cache read | TTFT | Response | Throughput | Capacity | Uptime 1d | Uptime 7d | Tools | Reasoning | Health | Data |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Consensus Protocolint890% offUS | 262K | 66K | $0.005 | $0.02 | $0.00125 | 568ms30m | 3.08s30m | 24 tok/s | 4/4 free | 99.4% | 88.0% | Verified | Effort | Healthy | ZDR |
Pricing
USD per million tokens.
| Provider | Input | Output | Cache read |
|---|---|---|---|
| Consensus Protocolint890% off | $0.005 | $0.02 | $0.00125 |
Price history
Input price · USD per million tokens
Output price · USD per million tokens
Performance
Timing percentiles cover the labelled window: the last 30 minutes when it has enough samples, otherwise the last day. TTFT is the seconds to the first token, measured only on streamed requests; response is the seconds from request to last byte, measured on every request, streamed or not. Throughput is output tokens per second over the last day, counted only over streamed generations long enough to have a rate — a buffered answer has no generation phase, and a two-token one times the scheduler rather than the model. Tool calls is the share of the last day of tool requests this endpoint answered with a tool call, published once the day holds twenty of them; under that the cell is blank rather than a rate nothing measured.
| Provider | TTFT p50 | p75 | p90 | p99 | Response p50 | p75 | p90 | p99 | Throughput p50 | p75 | p90 | p99 | Tool calls 1d | Runaways 1d |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Consensus Protocolint8 | 568ms30m | 1.18s | 6.15s | 6.15s | 3.08s30m | 8.63s | 446.0s | 446.0s | 24 tok/s | 25 tok/s | 25 tok/s | 25 tok/s | — | 0.0% |
Time to first token by hour · last 7 days
Hourly median per provider. The line spans hours with no streamed traffic; where samples are sparse, a dot marks each hour actually timed.
Throughput by hour · last 7 days
Hourly median output tokens per second per provider, over generations long enough to have a rate. The line spans hours with no answer long enough to measure; where samples are sparse, a dot marks each hour actually measured.
Rotating benchmark probes
Diagnostic scores from rotating dataset subsets. Percentages cover graded replies only and are not full benchmark results. Each score belongs to the provider’s serving configuration.
| Provider | GSM8K | MMLU | MMMU | aime25 | math500 | mmbench | mmlu-pro |
|---|---|---|---|---|---|---|---|
| Consensus Protocolint8 | 99.5%414 graded | 90.2%579 graded | 61.3%62 graded | 100.0%18 graded | 100.0%350 graded | 89.0%73 graded | 77.0%382 graded |
Benchmark answers are graded mechanically against the vendored dataset reference answers — numeric comparison of the final number for GSM8K, MATH-500 and AIME 2025, the committed multiple-choice letter for MMLU, MMLU-Pro, MMMU and MMBench, cosine ranking of the returned vectors for the Banking77 and SciDocs retrieval triplets, and per-utterance word match for LibriSpeech and FLEURS — never by another model; a reply that ran into the probe’s token cap before it committed to an answer is recorded but not graded.
Uptime
Share of successful requests and probes over the last day and week.
- Consensus Protocolint81d 99.4%7d 88.0%Healthy
Availability by hour · last 7 days
Share of successful requests and probes per hour and provider. The line spans hours with nothing to measure; where samples are sparse, a dot marks each hour actually measured.
Activity
Prompt tokens and completion tokens per UTC day over the last 30 days. Every billed request counts, the platform's own paid probe traffic included.
curl https://api-staging.heimdallm.com/api/v1/chat/completions \ -H "Authorization: Bearer $HEIMDALL_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "model": "google/gemma-4-31b-it", "messages": [{ "role": "user", "content": "Hello" }] }'Set HEIMDALL_API_KEY to a key from your account. See the quickstart for routing suffixes and provider preferences.
About
Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on small models) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages.
- Author
- Family
- google/gemma-4-31b-it
- Weights
- unsloth/gemma-4-31B-it-GGUF
- Parameters
- frequency_penalty (-2–2), max_tokens (1–65536), min_p (0–1), presence_penalty (-2–2), reasoning_effort (none, low, medium, high), repetition_penalty (0–2), response_format (any value), seed (0–2147483647), stop (list), temperature (0–2), tool_choice (any value), tools (any value), top_k (0–200), top_p (0–1)
- Licence
- apache-2.0
- Size
- —
- Tokenizer
- —
- Available until
- —
From the model card
What the repository states about these weights, read from unsloth/gemma-4-31B-it-GGUF on Oct 11, 2026.
- Languages
- —
- Papers
- —
- Datasets
- —
- Revision
- c1ac76eJul 17, 2026
- Downloads
- 394.8K
- Likes
- 608