How to judge Mistral Large 4 beyond the launch charts

Mistral Large 4’s launch results point toward testing specific jobs. The useful question is whether it finishes the work accurately, affordably and in a form that is easy to check.

That is the focus of ByteForward’s October 6 analysis. It examines published results and access details rather than reporting tests run by ByteForward. Our earlier launch report covers the model’s architecture and release plans.

Read the benchmark behind the score

Mistral’s launch announcement reports 61.7% on DeepSWE 1.1, 59.4% on SWE Atlas QnA and 28.3% on Terminal Bench 4. Software engineering, repository questions and terminal tasks test different parts of a coding workflow. The company also reports a combined Coding Agent Index score of 49.8%.

In its blind human coding evaluation, professional reviewers rated five models on a scale from one to five. Mistral averaged 3.74, behind Claude Opus 5 at 4.22. That comparison cannot establish a result against Opus 5.5.

The video keeps results attached to their tasks and evaluation settings. A useful specialist can still trail on a general index, so its strongest result deserves a closer look.

Separate token rates from the cost of a job

The official model documentation captured on October 6 lists discounted USD prices of $0.68 per million input tokens, $0.07 per million cached input tokens and $2.09 per million output tokens. It also displays the higher rates of $1.36, $0.14 and $4.18 respectively. These are API usage rates.

At the discounted rates, one million uncached input tokens plus one million output tokens comes to $2.77 before other charges or taxes. That calculation describes one token mix. Check the current billing rate before running a large workload, since this dated pricing snapshot does not establish a guaranteed discount period.

For a useful comparison, keep a small record of every attempt. Include unsuccessful runs and the time spent correcting the result. An answer that needs three retries and a manual repair can consume more of a budget than its first response suggests. Compare the total with the quality of the finished work.

Give the preview a job you can check

Mistral’s October 6 announcement offers Studio and API preview access, with downloadable weights promised by the end of October. The announcement does not specify their license.

Start with a repository change that has known tests, or a document question whose answer you can verify. Keep the input and instructions consistent across the models being compared. Check whether a code change passes those tests and whether a document answer cites the right evidence. Record missing details as well as obvious errors.

This makes the decision concrete. A model earns a place in a workflow when its output holds up to the checks that matter for that job. The launch charts can help choose what to try first. The finished work should decide whether to keep using it.

Archival software development photograph by Tirza van Dijk from January 2016 under CC0 1.0.