AI-Augmented Software Engineering: Revolutionizing or Challenging
Software Quality and Testing?
Abstract
With organizations seeking faster, cheaper, and smarter ways of
delivering higher quality software, many are looking towards generative
artificial intelligence (AI) to drive efficiencies and innovation
throughout the software development lifecycle. However, generative AI
can suffer from several fundamental issues, including a lack of
traceability in concept generation and decision making, the potential
for making incorrect inferences (hallucinations), shortcomings in
response quality, and bias. Quality engineering (QE) has long been
utilized to enable more efficient and effective delivery of higher
quality software. A core aspect of QE is adopting quality models to
support various lifecycle practices, including requirements definition,
quality risk assessments and testing. In this position paper, we
introduce the application of QE to AI systems, consider shortcomings in
existing AI quality models from the International Organization for
Standardization (ISO), and propose extensions to ISO models based on the
results of a survey. We also reflect on skills that IT graduates may
need in the future, to support delivery of better-quality AI.