Codified collaboration: reinforcement learning with verifiable feedback as a mechanism for human–AI co-creation in generative intelligent design
Chronological data
Date of first publication2026-03-06
Date of publication in PubData 2026-07-10
Language of the resource
English
Abstract
Generative intelligent design systems typically remain static: they generate plausible artifacts but do not adapt through use or internalise expert design knowledge in a principled way. To address this limitation, we propose reinforcement learning from verifiable feedback as a framework for codified human–AI collaboration, in which domain expertise is formalised as algorithmic verifiers that evaluate generated designs against explicit structural and logical rules and convert rule compliance into reinforcement signals. We instantiate RLVF on the engineering task of functional decomposition, where designs are represented as typed function–flow graphs governed by verifiable structural constraints. Using group relative policy optimisation, a Llama-3.1-8B model is trained exclusively from verifier feedback without labelled output data. Across reinforcement learning cycles, correct output formatting improves from 18% to 100%, fully connected functional structures improve from 10% to 100%, and error-free decompositions improve from 4% to 100%, exceeding a supervised fine-tuned baseline trained on 257 labelled examples. Human evaluation shows that RLVF-trained models achieve higher perceived logical coherence than supervised models, while exhibiting reduced structural diversity. These results demonstrate that verifiable feedback can replace human annotation in rule-governed design tasks and enable correctness-grounded generative design systems based on codified expert knowledge.
Keywords
Human–AI Collaboration; Generative Intelligent Design; Reinforcement Learning Fromverifiable Feedback (RLVF); Codified Expertise; Functional Decomposition
