hiw3c 日报精选
MarkTechPost RSS 全文

Baseten发布Bison-1和Groundhog-1,提升决策模型指数

原文标题 · Baseten Releases Bison-1 and Groundhog-1, Topping Decision Model Index

Baseten发布了bison-1和groundhog-1,基于Gemma 4构建的开源决策模型。bison-1在AA Decision Index v2.1上的得分为76,且这两个模型均支持128k上下文长度和图像输入。Baseten发布bison-1和groundhog-1的帖子最早出现在MarkTechPost上。

来源:MarkTechPost · www.marktechpost.com

正文为英文,可一键机器翻译(仅首次需要等待)

Baseten has released bison-1 and groundhog-1, 2 open-weight decision models built on Google’s Gemma 4. Decision models do not write text. They return calibrated probabilities for yes/no, choice and score questions. The Baseten bison-1 decision model scores 76 on the Artificial Analysis Decision Index v2.1. That ranks #1 of 19. Both models raise context from 16k to 128k tokens and accept images. For routing, triage and guardrail pipelines, that means full policies and histories in one call.

TL;DR

  • Size: bison-1 is 31B dense. groundhog-1 is a 26B MoE with about 4B active. Both take 128k tokens (131,072).
  • Runs on: Baseten Model APIs, plus open BF16 weights on Hugging Face. No inference GPU or quantized builds are listed. BF16 weights alone are about 62 GB (bison-1) and 52 GB (groundhog-1), by our arithmetic.
  • Performance: bison-1 scores 76 on AA Decision Index v2.1, 1 point above Liquid AI’s d1.2-ultra (75).
  • Best: When2Call, 98 (rank #1).
  • Worst: AA-Omniscience-Decision v1.1, 60 (rank #11).
  • Bottom line: Best: top-ranked, best-calibrated decisions (Brier 0.14) over 128k tokens at $0.10 per 1M input tokens. Worst: groundhog-1 has no official index score yet, and every number is self-reported.

What are bison-1 and groundhog-1?

bison-1 is a 31B decision model from Baseten that post-trains Gemma 4 31B to return calibrated probabilities. groundhog-1 is the cheaper sibling. It fine-tunes Gemma 4 26B-A4B, a mixture-of-experts model with about 4B active parameters per token.

Both join Baseten’s existing lineup: mammoth-1 (27B), elephant-1 (9B) and joey-1 (2B). Those 3 sit on Qwen backbones. The new pair is Baseten’s first on what it calls an American backbone.

How does a decision model work?

A request carries 1 state and any number of questions. The state is text, optionally with images. Each question has a type: noul (yes/no), choice (named options) or score (ordered levels).

The model answers every question in a single prefill pass. It returns P(yes), or the chosen option with a probabilities field. No output tokens are generated. Baseten’s earlier launch post lists ticket triage, spam detection, jailbreak guardrails and LLM routing as target tasks.

Requests longer than the trained limit are refused, not truncated. Pipelines that assume silent truncation will need a length check.

Why is bison-1 better calibrated?

Baseten credits two sources: the Gemma base and more “soft labels” in the training mix. Soft labels use probability targets instead of 1 fixed correct answer. The model learns to report uncertainty that tracks how often it is right.

The result is a Brier score of 0.14, the lowest on the index. Baseten puts d1.2-ultra at 0.15. Lower is better.

How does bison-1 score on benchmarks?

On AA Decision Index v2.1, bison-1 scores 76. Liquid AI’s d1.2-ultra scores 75 and mammoth-1 scores 71. The index blends 6 evaluations, led by AA-Paperclip at 30%.

The bison-1 model card breaks out each component:

  • When2Call: 98 (#1)
  • EvalSafe-O*NET-AA: 93 (#1)
  • AA-Symmetry v1.1: 89 (#1)
  • AA-Paperclip: 73 (#2)
  • HLE-MultiChoice v1.1: 51 (#1)
  • AA-Omniscience-Decision v1.1: 60 (#11)

bison-1 ranks first on 4 of 6 components. Knowledge-heavy decisions are its weak spot.

On long context, Baseten reports LongMemEval M (128k) of 84.8 for bison-1 and 77.4 for groundhog-1. LongMemEval S reads 87.1 and 79.3. groundhog-1 has no official index score yet. Baseten expects it to match mammoth-1.

How does it compare with other decision models?

Featurebison-1groundhog-1mammoth-1Liquid d1.2-ultra
Total params31B dense26B MoE27BNot disclosed
Active params31B~4B27BNot disclosed
BackboneGemma 4 31BGemma 4 26B-A4BQwen3.5-27BNot disclosed
Context128k128k16k65,536
InputText, imageText, imageText, imageText, image, audio
LicenseMIT + Apache 2.0MIT + Apache 2.0MITNot disclosed
WeightsOpen (Hugging Face)Open (Hugging Face)Open (Hugging Face)Liquid API (weights not disclosed)
AA Decision Index v2.176Not yet scored7175
Brier score0.14Not disclosedNot disclosed0.15 (per Baseten)
LongMemEval M (128k)84.877.4Not disclosedNot disclosed
Price per 1M input tokens$0.10$0.035$0.10$0.042

How can developers deploy bison-1 and groundhog-1?

Both models are live on Baseten Model APIs. They use the same API as the older decision models, so switching means changing 1 model name. The IDs are decision-models/baseten-bison-latest and decision-models/baseten-groundhog-latest.

Pricing mirrors the older pair. bison-1 costs $0.10 per 1M tokens, like mammoth-1. groundhog-1 costs $0.035, like elephant-1. The bison-1 library page lists that as an input price, since no output tokens are produced.

Open BF16 weights sit on Hugging Face. Baseten lists no inference GPU or quantized builds. Training used 192 B200 GPUs for bison-1 and 128 for groundhog-1.

Key Takeaways

  • bison-1 tops AA Decision Index v2.1 at 76, 1 point over d1.2-ultra.
  • Context jumps 8x to 128k, with image input on both models.
  • groundhog-1 runs about 4B active params at $0.035 per 1M tokens.
  • Soft-label training helps push bison-1’s Brier score to 0.14.


Check out the launch post, the bison-1 and groundhog-1 model cards, and the Baseten docs. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension.

Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.

Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us

The post Baseten Releases Bison-1 and Groundhog-1, Topping Decision Model Index appeared first on MarkTechPost.