ObviousBench

PUBLIC MODEL RELIABILITY · CONFIGURATION DETAIL

Gemma 4 31B IT

Observed settings from the 2026-07-25 public release. This is a configuration readout, not a claim about general model quality or a vendor guarantee.

Open in the cost frontier Open share image
Lowest-cost observed 100% result100%

High · $0.0251

Settings observed4

ordered deepest to lightest

Benchmark sample144

items · 3 answers each

Observed answer pass3 by reasoning settingSettings are ordered from deeper to lighter / no reported reasoning.
Gemma 4 31B IT observed pass³ and full-run cost by setting 100% 95% 90% 70% 100%High$0.0251 99.3%Medium$0.02517 100%Low$0.02704 84.7%None / disabled$0.003025

Point labels show answer pass3 and estimated full-run cost. The table below retains the exact released observations.

RELEASED OBSERVATIONS

All visible settings

Answer pass3 means all three sampled answers were correct. Cost is the estimated public API cost for a full benchmark run.

SettingAnswer pass3Full-run costReasoning evidence
High100%$0.0251Reasoning reported
Medium99.3%$0.02517Reasoning reported
Low100%$0.02704Reasoning reported
None / disabled84.7%$0.003025No reported reasoning

How to read this page

These values are a release-bound observation set, not an estimate of every task or production workflow. Compare the full public field and global Pareto reference before making a cost or reliability decision.

Compare every public configuration on the cost frontier →