LFM2.5 2.6B vs Devstral Small 2 24B

LFM2.5 2.6B and Devstral Small 2 24B both score 8 on the intelligence index. The cheapest machine here that runs Devstral Small 2 24B is the Framework Desktop, 32GB, at $1,269. LFM2.5 2.6B runs on the Mac mini M6, 16GB at $899, $370 less. On the Framework Desktop, 32GB, the cheapest machine here that runs both, LFM2.5 2.6B is about 9× quicker: 87 tok/s against 9.7, both estimated from memory bandwidth. At 500k tokens a day the Framework Desktop, 32GB never pays for itself on either.

Run LFM2.5 2.6B on the Mac mini M6, 16GB · or Devstral Small 2 24B on the Framework Desktop, 32GB

Jump to: Side by side on the Framework Desktop, 32GB · How much use it takes to pay for the machine · Machines that run one and not the other · The assumptions behind both columns

Side by side on the Framework Desktop, 32GB

The table above gives each model the cheapest machine that runs it, and those are two different machines, so nothing in it is a like-for-like race. The Strix Halo Framework Desktop, 32GB is the cheapest machine here that runs both, so this is the pair doing the same work on the same hardware.

Run LFM2.5 2.6B on the Framework Desktop, 32GB · or Devstral Small 2 24B

How much use it takes to pay for the machine

Everything above is at 500k tokens a day. Pay-back moves with how much you actually run, so here are both models at the five levels of use the calculator names, on the Framework Desktop, 32GB. Neither pays for it at any of those levels, even with agents running most of the day.

The Framework Desktop, 32GB generates at most 13.5M tokens a day on Devstral Small 2 24B, so that column's figure at 20M tokens a day is for the most it can do, not for the whole of what was asked.

Run LFM2.5 2.6B at 20M tokens a day · or Devstral Small 2 24B

Machines that run one and not the other

LFM2.5 2.6B needs 2.2 GB of memory at 32k of context and Devstral Small 2 24B needs 20 GB. That puts LFM2.5 2.6B on 7 of the 37 machines priced here that Devstral Small 2 24B does not, starting at $899.

1 more, on the LFM2.5 2.6B page.

LFM2.5 2.6B is also head to head with Llama 3.3 70B Instruct above it on the leaderboard. Devstral Small 2 24B is also head to head with Llama 3.1 8B Instruct below it on the leaderboard and Mistral Small 3.2 24B Instruct, the last-generation Mistral nearest it in size. Two more models need much the same memory: GLM-4.7-Flash and Gemma 3 27B it.

The assumptions behind both columns

Both columns use the same usage: 500k tokens a day at 15:1 input to output, 32k of context, $0.17 per kWh, and today's API prices held flat. Speeds marked estimated are worked out from memory bandwidth rather than measured, and pay-back scales with them. Where nobody rents an open model by the token, its API prices are the nearest hosted model's, named beside them. Machines are the 37 here with a published price that are still sold. Change any of it in the calculator.

More head to head: every machine that runs LFM2.5 2.6B · every machine that runs Devstral Small 2 24B · every other match-up · both against the frontier · the quickest pay-back at each level of use