Reported by TechCrunch AI
In October, more than one in four requests on Vercel’s AI model router went to decision models, not LLMs — an enormous share of work for a kind of computerized intelligence that was invented only a month earlier.
Decision models are LLMs that don’t produce output tokens; instead, they’re tuned to use their general intelligence to quickly and cheaply decide between preset options, while registering its level of confidence in the choice. They’re useful in production environments, where fast decisions can be more important than the reasoning provided by a slower and more expensive frontier model.
TypeSafe became a $7.5 billion company after releasing its Jev family of models, which continues to dominate usage (at least where we can see metrics from services like OpenRouter, which handled more than 1.5 billion queries to TypeSafe’s models last week).
More from the original report
However, it’s easy to make a decision model, and dozens were released in the wake of Jev. One Amazon engineer made one in a weekend, and soon every hyperscaler had its own option. On Tuesday, Microsoft CEO Satya Nadella said that his company is rolling out its decision model, Microsoft-Decision-1.1, for wide use on Azure immediately.
The action is happening on both ends of the ecosystem: Sqwish , a U.K.-based AI startup behind a decision model called kettei fat, announced a $3 million pre-seed round today. Co-founders Ushnish Sengupta and Federica Freddi, who met as Cambridge grad students, had been developing small LLMs when Jev arrived on the scene, and they realized their architectures could be repurposed as a powerful decision model.
Data appears to be the key to a successful model in this category — TypeSafe CEO Diogo Almeida told TechCrunch that the hardest part of building Jev was finely calibrating its judgement using statistically-adjusted synthetic data. Sqwish, too, has been working with synthetic data, but its unique offering is built-in post-training tools that use a customer’s own data to improve the model’s judgement.
“What makes us not a commodity, I think, is the fact that we are offering our customers the same power…they can keep uploading their production data, and just…
