Mistral Releases Leanstral 1.5: Apache-2.0 Formal Proof Code Agent Solving 587/672 PutnamBench Problems
Formal verification has long been the territory of academic mathematicians and safety-critical embedded systems engineers — deeply important work, but rarely the domain of general-purpose AI. Mistral is changing that narrative with Leanstral 1.5, a 119B Mixture-of-Experts model released under Apache-2.0 that doesn’t just write code in Lean 4 — it operates as a genuine agentic system, editing files and running bash commands to verify proofs. The benchmarks are remarkable. Leanstral 1.5 solves 587 out of 672 PutnamBench problems (a benchmark of undergraduate competition mathematics problems), achieves an 87% score on FATE-H, and saturates miniF2F — a standard Lean formalization benchmark. More practically, it was deployed against 57 real-world repositories and found 5 previously unknown bugs. ...