ObviousBench

PUBLIC MODEL RELIABILITY · CONFIGURATION DETAIL

Mistral Medium 3.5

Observed settings from the 2026-07-25 public release. This is a configuration readout, not a claim about general model quality or a vendor guarantee.

Highest observed answer pass³51.4%

None / disabled · $0.04017

Settings observed2

ordered deepest to lightest

Benchmark sample144

items · 3 answers each

Observed answer pass3 by reasoning settingSettings are ordered from deeper to lighter / no reported reasoning.
Mistral Medium 3.5 observed pass³ and full-run cost by setting 100% 95% 90% 40% 91%High$2.937 51.4%None / disabled$0.04017

Point labels show answer pass3 and estimated full-run cost. The table below retains the exact released observations.

RELEASED OBSERVATIONS

All visible settings

Answer pass3 means all three sampled answers were correct. Cost is the estimated public API cost for a full benchmark run.

SettingAnswer pass3Full-run costReasoning evidence
High91%$2.937Reasoning reported
None / disabled51.4%$0.04017No reported reasoning

How to read this page

These values are a release-bound observation set, not an estimate of every task or production workflow. Compare the full public field and global Pareto reference before making a cost or reliability decision.

Compare every public configuration on the cost frontier →