ITcon Vol. 31, pg. 1434-1453, http://www.itcon.org/2026/58

Is vibe coding the future? An empirical assessment of LLM generated codes for construction safety

DOI:10.36680/j.itcon.2026.058
submitted:April 2026
published:November 2026
editor(s):Turk Ž
authors:S M Jamil Uddin, PhD
Department of Construction Management, Colorado State University
https://orcid.org/0000-0002-6829-1487
smj.uddin@colostate.edu
summary:The emergence of vibe coding, a paradigm where non-technical users instruct Large Language Models (LLMs) to generate executable codes via natural language, presents both opportunities and risks for the construction industry. While empowering construction personnel such as the safety managers, foremen, and workers to develop tools and software, the probabilistic nature of LLMs introduces the threat of silent failures, wherein generated code compiles runs without error but executes flawed mathematical safety logic. This study empirically evaluates the reliability, software architecture, and domain-specific safety fidelity of 450 vibe-coded Python scripts generated by three frontier models, Claude 3.5 Haiku, GPT-4o-Mini, and Gemini 2.5 Flash. Utilizing a persona-driven prompt dataset (n=150) and a bifurcated evaluation pipeline comprising isolated dynamic sandboxing and an LLM-as-a-Judge, the research quantifies the limits of zero-shot vibe codes for construction safety. The findings show a statistically significant association of moderate strength between user persona and data hallucination; the generated tools invented missing safety variables more often for the less formal and less specific prompts of the field personas. Furthermore, while the models demonstrated high foundational execution viability (~85%), execution success did not indicate correct logic, and error handling was present in only 16% of scripts. Among successfully executed scripts, the study identified an ~45% overall Silent Failure Rate, with GPT-4o-Mini generating mathematically inaccurate outputs in ~56% of its functional code. The results indicate that the evaluated LLMs, used without safeguards, do not provide the deterministic reliability required for standalone safety engineering. For construction practice, they indicate that ungoverned vibe-coded tools threaten site-level safety decision-making and digital compliance workflows, and that safe adoption requires embedding LLMs within deterministic, pre-validated calculation engines under explicit organizational governance of AI-generated tools.
keywords:vibe code, LLM, AI, construction safety
full text: (PDF file, 0.552 MB)
citation:Uddin, S M J. (2026). Is vibe coding the future? An empirical assessment of LLM generated codes for construction safety. Journal of Information Technology in Construction (ITcon), 31, 1434-1453. https://doi.org/10.36680/j.itcon.2026.058
statistics: