Formalisation as a concrete manifestation of mathematical understanding

Filippo A. E. Nuccio, Associate Professor at Université Saint-Étienne

AI use: none. See the full disclosure (“AI disclosure and licensing”) at the end of this post.

Disclaimer I am a maintainer of Mathlib, the main mathematical library of formalised mathematics in Lean, but all ideas expressed below are my own only; in no way are they supposed to represent an official view of the Mathlib community, nor of its governance.

Introduction

As the mathematical community is swamped by large amounts of results found by different LLMs, we’re reading more and more messages around three main pivots, often intertwined: that “mathematics is truly about understanding”; that those who are the most affected by this revolution are PhD students, or young colleagues in general; and that companies like OpenAI and Anthropic are behaving badly, in one way or another. Somewhat unrelated to the above criticisms, we witness an increasing appearance of the words “formalisation” and, often, “Lean”. I believe that the four strands are related, perhaps in an unexpected way.

The overarching theme around which I’m going to develop my text is that understanding mathematics is a beautiful concept, but very hard to define. At which point can we say that we’ve understood it, and what does it really mean? Can we communicate understanding to colleagues or, even better, to students in a structured way? Can we produce a certificate that some understanding happened? Is there a reproducible outcome of this understanding? To what extent is mathematical understanding a scientific production rather than a method? Is this understanding subject to usual scientific scrutiny? Can we verify it?

I am going to argue that the bare-hand formalisation of mathematics is one answer to the above questions. By formalising mathematics, not only we understand it better but we produce scientific output whose content is precisely this understanding. I will organise this argument by relating what brought me to formalising mathematics six years ago, and why I think that this beautiful human endeavour has very much to do with understanding mathematics, and very little with AI.

A small digression: reasons to worry

Let’s pause for a moment, and look back at the first three points I mentioned above, namely: that mathematics is truly about understanding, that we care about the young generation, that these tech companies’ behaviour is bad and purely driven by economic targets. They remind me of another controversy.

I’ve long been an Open Access advocate, and I’m engaged with some organisations actively promoting it, from MathOA to the French Committee for Open Science. In this role, I’ve often argued that simply accusing the “usual three” Elsevier, Springer, Wiley of being the main obstacle to a full development of open access (in mathematics, or in any other science for that matter) is a red herring: it is our community, so the mathematicians, who put so much emphasis on publications lists and journal rankings. We are those who provide tenure, who promote young colleagues, who refer and distribute grants; and we’re the ones who decide to do so according to the list of shining publications in top (privately owned, often) journals: this approach values understanding very little, rather forcing our young, or less young, colleagues to publish as many papers and as quickly as possible in the top journals in order to obtain full recognition of their hard work. Unfortunately, spending PhD or Postdoc time trying to understand is something that our community has for too long valued way less than publishing in good Elsevier, or Springer, or Wiley journals. We took the easier path of declaring that mathematics was about publishing new results, that the problems came from three bad publishers whom we treated as the beasts, and we’ve refused to change our internal functioning model; yet, it was entirely within our hands.

I’ve heard time and again that we should do something to improve both the “publish or perish” stress imposed on ourselves (and, mostly, over our students’ shoulders), and to take back the power that big publishers can exercise upon our community: nonetheless, little has changed in the last fifteen years. I fear that the same might happen when I read about so many calls to “rethink our profession” in the aftermath of each large release of theorems proved by AIs. But unlike the publishing dead-end where we seem irremediably trapped, we’ve got here a practical action that can be taken: embrace formalisation as a full-fledged mathematical discipline tasked with organising what it means to understand an argument.

Understanding mathematics through its formalisation

To describe how this organisation could develop, let me start by spelling out another point leaving me sceptical at the idea that “mathematics is about understanding”, beyond its vagueness: mathematics cannot be about one thing, simply because it has been studied for more than 2.500 years, by hundreds of thousands of people, and a recent text by Gowers explain this perfectly. In the same vein, I will not dare stating what the true, intrinsic value of formalising mathematics is; but I will try to tell why I consider it a beautiful angle from which to regard mathematics, focusing more on understanding rather than on proving new theorems.

I will not provide any detail about it: I will content myself in saying that formalising mathematics in a proof assistant like Lean, Rocq, Isabelle, HOL-Light, Agda, etc., consists in writing definitions and statements in one of those languages, and then providing the code representing the proofs of the statements. Most of the time, neither of the two can be performed simply by following the informal exposition to be found in articles or monographs. Hence, I should rather say that formalising mathematics consists first in reflecting upon how to write definitions, statements and proofs; and, secondly in writing them down. More often than not, this reflection focuses on mathematical objects that have already been defined somewhere, in some form, and on proofs that already exist; but whose form is unsuited for the formalisation. This unsuitability might amount to inappropriate generality, to verbose computations hiding the core of the idea, to repeated argument hindering the identification of a common pattern. Since the production of new mathematical results is not its substance, the discipline has long faced the question of whether it really was part of mathematics.

When we co-founded, together with my friend and colleague Rob Lewis, the Annals of Formalized Mathematics, we wanted to draft the journal’s Aims and Scope and, helped by the two boards, we wrote, among our criteria, “The act of formalizing mathematics is not mechanical: it involves substantial mathematical insight in its own right, and it constitutes the essence of formalized mathematics”; and “Proof auditing, the act of checking that formal statements correspond correctly to their informal counterparts, is a difficult and inherently human part of reviewing formalized mathematics”. For me, these describe well what constitutes the scientific kernel of the formalisation of mathematics: and explains why it provides an excellent vehicle to communicate and to reason about mathematical understanding. By producing bare-hand formalised artefacts and by writing papers describing what we learn and discover through this activity we are turning understanding into something tangible.

Our formalisation activity typically focuses on looking at an established theorem, or a whole theory, and on trying to distil its understanding to the point where we can sanctify this distillation into a file, or within a whole library. This process I find incredibly pleasant and rewarding, especially because very often this distillation is a community effort: the Mathlib library currently (October 2026) contains two and a half millions of lines of code, written by hundreds of contributors, and it is only as valuable as the existence of the whole Mathlib community around it. We craft, in this manner, a concrete, structured, substantial witness of the community understanding of a topic. It goes without saying that almost every mathematical activity is deeply rooted in understanding, and this is by far not a unique feature of formalisation, nor its defining quality; my point is that the scientific outputs of this activity primarily solidify this understanding, instead of conveying it.

The discovery of this formalisation activity brought me tremendous joy: spending time reading beautiful (even if sometimes horribly written) papers and trying to produce new scientific outputs through their understanding was again my main activity, not an ancillary one that I could try to squeeze in between two attempts at proving my small new theorem. With this perspective, I believe that the production of humanly formalised mathematics in a proof assistant is an excellent way to sail some of the stormy waters we’re encountering: it will assist us in understanding the overabundance of results proven by AI and in creating a transmissible, teachable version of this understanding. As a by-product, it will ensure us that the reasoning beneath those mathematical arguments is sound.

Some thoughts on autoformalisation

I just wrote that getting assurance of the soundness of an argument is a by-product of formalisation. Yet, the pattern we’re observing is rather the following: one or several LLMs are prompted to attack a problem, they do so by producing an argument in the form of a written text and, alongside the text, these agents provide lengthy (Lean, say) code certifying the correctness of their argument. This formalisation performed by an LLM to certify that some argument is correct we call “autoformalisation”. Many colleagues or AI-companies consider this verification the main goal, rather than a by-product, of formalising mathematics in a proof assistant and I respect this position.

But, to my eyes, a huge collection of autoformalised mathematics stands in front of a smaller humanly formalised library like Mathlib as the invention of bookbinding compares to the invention of the press. Bound volumes are the way we experience the usefulness of the press, and they carry its impact in the form of printed pages organised handily and, often, harmonically. Nevertheless, most likely, the refined art of bookbinding would not exist hadn’t Gutenberg’s revolution seen the light of the day. Likewise, when a huge proof—perhaps produced by an LLM, or not—is autoformalised, its correctness is guaranteed (I am aware of technical issues about this guarantee, but let me gloss over them) and this we hold dear. But I look at this autoformalisation as one way of experiencing the usefulness and long-lasting pervasiveness of bare-hand formalisation, carrying its impact to the everyday life of (post?)-modern mathematics. The observation that almost all autoformalisation projects, so far, have been spelling out explicitly that they “rely on Mathlib” is perhaps a sign of such pervasiveness.

Conclusion

I wish more and more colleagues will join our formalisation community, enjoying the beauty of understanding mathematics—whomever or whatever shall it come from—through the painstaking and ever-rewarding activity of formalising it by hand, and discussing their formalisation efforts with even more colleagues and students. The outcomes will take the form of scientific productions contributing to frame the meaning that the broader mathematical community imparts to the idea of understanding, and I hope this might heal our terror that there’s no mathematics ahead of us.

AI disclosure and licensing

No form of AI has been used while producing this text. This text is licensed under a CC-BY 4.0 licence.


Received 15 October 2026.

9 responses to “Formalisation as a concrete manifestation of mathematical understanding”

  1. elegantc7df67a5d5 Avatar
    elegantc7df67a5d5

    I agree that formalization by hand can be very rewarding. It also has a lower probability of triggering prover bugs, since the human will not actively look for them or even know how to exploit one.

    LLMs, however, are adversarial, ruthless in accomplishing their goals and know the prover source code. An automated slop proof has a significantly higher exploit probability.

  2. zombiegenerousd64636c5f6 Avatar
    zombiegenerousd64636c5f6

    Your defense of “bare-hand formalisation” is romantic, but it completely ignores the massive shift in academic incentives caused by the AI code flood.

    Take Axiom Math’s 16-million-line automated translation of the Stacks Project. It compiled and passed Lean’s kernel checks almost instantly, compressing what would have taken human mathematicians decades of meticulous “hand-crafting” into days.

    You blame the mathematical community for perpetuating a “publish or perish” culture that devalues deep understanding, yet your solution asks young mathematicians to volunteer for professional obsolescence. Why would a PhD student or postdoc spend years painstakingly hand-coding a niche lemma for Mathlib when an LLM swarm can autonomously generate, verify, and dump a multi-million-line frontier of algebraic geometry overnight?

    When automated scale makes manual production look economically foolish, university departments will never adjust their metrics to reward “slow, manual distillation.” AI companies haven’t just automated the math; they have destroyed the timeline for the cultural shift you are begging academia to make.

    1. Sal Avatar
      Sal

      I agree with you. I also think perhaps my days of being employable as a mathematician are numbered.

    2. Anonymous Avatar
      Anonymous

      If you are already doing the job of university departments and say that you are obsolete, they’ll happily agree! Mathematicians appear to be even better at self-flagellation than software engineers …

      Practically speaking, we don’t know yet if the plagiarism machines can solve every theorem. They haven’t exhausted the millennium problems yet. For example, they stopped at publishing the Exponential Time Hypothesis as an obvious step to P ?= NP in a race to be first between Misanthropic and ClosedAI. If they thought they could manage P ?= NP, would they have published?

      Then, even in the worst case there still need to be people who understand the formalization of the final goal.

      It would be helpful of course if right now a generation of new students boycotted math due to uncertainty and taught the industry a lesson. The industry would be begging for mathematicians in four years.

    3. tchow8 Avatar
      tchow8

      The claim that “university departments will never adjust their metrics to reward slow, manual distillation” is far from a foregone conclusion. Take Axiom Math’s formalization of the Stacks Project, which you mentioned. Even Axiom Math does not claim that their work obviates the need for human review. They have specifically distinguished between “Core” and “Frontier,” with “Core” being explicitly human-reviewed.

      It is certainly true that formalization of any kind has traditionally been regarded as worthless by the vast majority of mathematicians. But many of the values of the mathematical community are being re-thought at this moment in time, and it seems entirely possible that the importance of slow, manual distillation will be recognized by increasing numbers of people, and duly rewarded by hiring and promotion committees.

  3. Sal Avatar
    Sal

    I am beginning the process of learning Coq and Lean because formalising by hand does seem like a good use of my time. I am hesitant about the automformalisation by LLMs though. If an LLM writes the text, then writes the Lean code, even if it correct and true to the natural language result, why should I be interested. We all have our own reasons for participating in mathematics and mine is the journey. I am much more interested in what occurs on the way to the end result, once the end result is found, I more often than not, find myself no longer interested and seek out something new to work on.

  4. John Mitchell Avatar
    John Mitchell

    The link to Timothy Gowers’ blog led me to his essay titled “What sort of maths are LLMs good at?” (1), in which he said the following about A.I. systems:

    “[T]heir training data will not be full of examples of fruitful and less fruitful directions to pursue when trying to solve problems: all they will typically see is tidied up proofs that hide the thought processes of their discoverers.”

    That raises the question of whether mathematicians should publish papers that include their thought processes, and not just “tidied up proofs”, if they want to help A.I. systems become better mathematicians, so that A.I. systems might “learn” from humans about how to “think” about mathematics.

    Note that I’m not advocating for mathematicians to train their electronic replacements, but it seems that some mathematicians do want to have a symbiotic relationship with A.I.

    [1] https://gowers.wordpress.com/2026/08/12/what-sort-of-maths-are-llms-good-at/

  5. An Avatar
    An

    I think your post makes sense in a time before LLMs appeared. Now auto formalization is in my opinion one of the most meaningless things todo and to suggest to anyone.

    • No human can deal with hundreds thousands or millions of lines of formalized math
    • Auto formalizers _always_ have bugs no matter what you do, and LLMs will exploit them and they may also create new ones if you use them for kernel development. Even if there are 1000 different kernels and formal languages, there will be bugs common to all of them.
    • The main reason for auto formalization is void. We need to know if long LLM proofs are correct. Since we anticipate a future where we cannot read them as LLM master math no human can comprehend, and since LLMs can be adversarial and misaligned, it is absolutely necessary that auto formalization would tell us if the LLM proof is sound or not, there is no room for romantic error like humans do (in human readable papers). BUT, and here comes the thing you (on purpose?) do not highlight: autoformalization is NEVER a guarantee of correctness, there are bugs, LLMs can be misaligned, and so on. The Collatz case and other cases where that already happened can repeat, there is no mathematical verification of a verifier.
    • There is no human understanding to be gained from a complex autoformalized theory with millions of lines of codes. The number of people who would enjoy handling such formalizations by bare hand can be counted on a bare hand. I think its dangerous to lobby for this activity just because you got invested in it.

    In a sense it is quite ironic that autoformalization is one of the first things to be made useless by LLMs, but afterall it fits the pattern, like coding which got conquered quickly by LMMs. Its time to accept that certain ways of doing math are gone in the presence of LLMs, and autoformalization is the most obvious of them.

    I think human written math and the classical journals have a good future potential. As long as humans exist and want to have control over their knowledge, we will have people trying to understand things (maybe in new ways in LLM presence) and journals are, as the name says, magazines through which a community communicates human news. By this definition, journals are supposed to serve a community and will be always exclusive, there will be always pressure and stress for people who try to build a career, as competition is the basic law in our universe. We evolved to what we are through competition, there are always two people who want to have the same resource.

  6. Timo Avatar
    Timo

    I don’t see how anything verified by Lean can be considered as a rigorous proof. When one of the steps in the proof is “now run it through some software and use the output” then it would also be necessary to provide a rigorous mathematical proof that the output is correct. Several people already commented that there could be bugs. But even if someone is an optimist and thinks there are no bugs, still I think the formal proof about behavior of the program would be needed (which is probably harder that the problem that it is used to solve).

Comments are moderated. Read our comment policy.

Add to the discussion

New posts by email.

Prefer a feed reader? Subscribe by RSS.

Also on Mathstodon.

Latest comments across the site.

  1. A post that makes sense indeed. The bigger picture goes far beyond the fate of a small community of scientists....