Ir para o conteúdo principal

Determinism isn't just a marketing claim

Five 2025-2026 academic research threads that document, independently of Blueprint Maker, why separating specification from code changes a generator's reliability.

The principle: correctness-by-construction, not correction after the fact

Computer science has long distinguished two families of program generation: one where correctness is proven by the system's own structure (correctness-by-construction), and one where it's statistically estimated over a sample of outputs (probabilistic generation). A recent comparative review formalizes this distinction and places both paradigms on a single axis, from most verifiable to most flexible.

A concrete example of the first family, applied to a domain entirely different from business-app generation: Veritas (2025), a circuit synthesis pipeline where a compact LLM designs a logical specification, which a deterministic translator then turns into Verilog code. Measured result: 100% pass@1, guaranteed by construction rather than by after-the-fact testing.

  • From Provable Correctness to Probabilistic Generation: A Comparative Review of Program Synthesis Paradigms: arxiv.org/pdf/2508.00013
  • Veritas — correctness-by-construction in circuit synthesis: emergentmind.com/topics/llm-synthesized-code

“Compiling” rather than “generating”: an AI that stops before the code

A 2026 paper describes a paradigm called “Compiled AI”: language models produce executable code artifacts during a compilation phase, after which workflows run deterministically, with no further model call. It's an academic reformulation of the principle already at work at Blueprint Maker — an AI designs, a deterministic engine builds — applied here to workflow automation rather than to complete business applications.

  • Compiled AI: Deterministic Code Generation for LLM-Based Workflow Automation (2026): arxiv.org/html/2604.05150

The non-determinism of classic generators: measured, not assumed

The reference study on the topic, published in ACM Transactions on Software Engineering and Methodology, ran ChatGPT against 829 coding problems, with five independent generations per problem, compared on semantic, syntactic and structural similarity. Result: significant variability in the code produced for an identical prompt — and a blind spot in the academic field itself, since only 21.1% of studies on AI code generation account for this risk in their protocol.

This non-determinism isn't just a temperature effect: more recent work identifies additional numerical sources (batching, floating-point rounding) that persist even at zero temperature. Reducing randomness stays possible; eliminating it at the step where a language model writes code line by line does not.

  • An Empirical Study of the Non-determinism of ChatGPT in Code Generation (ACM TOSEM): dl.acm.org/doi/10.1145/3697010
  • Understanding and Mitigating Numerical Sources of Nondeterminism in LLM Inference: arxiv.org/pdf/2506.09501

Formalizing the specification before the code: an active research direction

Several recent works propose preceding code generation with an explicit requirements-formalization step — exactly the role the AppSpec plays at Blueprint Maker. An empirical study protocol on specification-driven code generation was accepted at SANER 2026, a recognized software engineering conference; another work proposes a multi-agent vision for developing and formalizing requirements before generating.

  • Understanding Specification-Driven Code Generation with LLMs (Registered Report, SANER 2026): arxiv.org/html/2601.03878v1
  • Requirements Development and Formalization for Reliable Code Generation: A Multi-Agent Vision (2025): arxiv.org/pdf/2508.18675

What Blueprint Maker takes from this

Blueprint Maker applies the same principle — specification designed by an AI, code produced by a deterministic translator — to a domain different from the ones studied in this research: complete business applications (database, API, interface, dashboard), rather than logic circuits or automation workflows. The mechanism is the same; the application domain differs.

None of this is presented as proof that Blueprint Maker is infallible: the research cites measured gains on specific tasks, not a universal guarantee. What it establishes is that separating specification from code isn't an isolated marketing choice — it's a research direction taken seriously, with published, peer-reviewed results.