From Code Author to Code Reviewer: A Systematic Review of Practitioner Experience with Generative AI in Software Engineering
Bassey Echeng Isong, Tshipuke Vahangwele, Nosipho Dladlu · Journal of Information Systems and Informatics · 24 Oct 2026
Read original sourceOpen access
Where this sits in the debate
- Will AI actually boost productivity and growth? · its finding: it depends (why studies differ)
- Will AI destroy more jobs than it creates?
Direction of the finding as read from the abstract by an AI model (AI-written).
Abstract
Practitioner use of generative AI in software engineering has progressed faster than the evidence assessing its effects. This review examined 58 empirical studies published from 2024 to early 2026 on GitHub Copilot, ChatGPT, Claude, and Gemini. Using PRISMA-guided selection from five digital libraries, the studies addressed productivity, role shifts, code quality, adoption behaviour, and evidence gaps. Findings were synthesised into the AI Integration Consequence Model, a conceptual four-layer framework linking adoption conditions, role shifts, quality exposure, and organisational consequences. Evidence indicates that developers increasingly move from code production to code review, as more than half of AI-generated code is discarded after evaluation. Generative AI improves efficiency for boilerplate code, documentation, and unit-test scaffolding, but provides limited benefits for architectural decisions and enterprise debugging. A meta-analysis of 47 studies reported a 45.6-point gap between self-reported and objectively measured productivity. AI-generated code also showed exploitable vulnerabilities at estimated rates of 40–50%, varying by task, tool version, programming language, and measurement method. Social influence strongly predicted adoption intent, while concerns about peer judgement encouraged undisclosed use. Experienced engineers generally received an AI Boost, whereas junior engineers faced an AI Drag. Structured mentorship reduced this gap in one 14-month cohort study. Key evidence gaps include cross-cultural adoption, longitudinal skill development, and unreplicated gender disparities.
About this publication
Academic journal. Published in an academic journal — typically peer-reviewed before publication, though indexing alone doesn't guarantee review depth.
- Published
- 2026 (recently)
- Citations
- 0 (OpenAlex)
0 citations recorded by OpenAlex — too few 2026 papers in this collection for a fair comparison.
Related by theme, not necessarily by method or conclusion.
- Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality
SSRN · 2023 - Generative AI at Work
The Quarterly Journal of Economics · 2025 - The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
arXiv · 2023 - The Productivity J-Curve: How Intangibles Complement General Purpose Technologies
American Economic Journal Macroeconomics · 2020
Overview assembled automatically from collected metadata. How this site is built.