Twenty Tips for Using Generative AI in Systems Engineering

Abstract

Generative AI (GenAI) is rapidly moving from experimentation to routine use in systems engineering practice. We are already using these tools across virtually all process activities. The potential benefits are substantial, but the risks are equally real including inconsistent outputs, hidden assumptions, unverifiable calculations, weak traceability, context loss across sessions, and avoidable rework caused by poorly framed prompts and informal review habits. Current use is often ad hoc, whereas we need to move to disciplined individual and team processes that are measurable and thus manageable.

This article is dedicated to Dr. Barclay Brown, previous chair of the INCOSE AI Systems Working Group. Barclay recently passed away and was a strong advocate in our community for applying AI in systems engineering with practical engineering discipline. He could have written this article as well, and this contribution aims to carry his spirit forward by offering concrete guidance that engineers can apply immediately while preserving rigor, transparency, and accountability.

A SHORT TRIBUTE TO DR. BARCLAY BROWN

Barclay was very fond of Star Trek references. He would say about GenAI “It's life, Jim, but not as we know it.” He liked to describe GenAI like it was a new kind of being: “Neither human nor sentient; no soul, no goals; but with vast knowledge and information; creativity of a sort; little (or no) judgment; great speed; ‘eager’ to please; and happy to re-do things many times.” Why would we not want to converse with an entity like this?

He would note “Large Language Models (LLMs) have no interests, desires, ambitions, understandings, willingness, emotions, or intentions; and no capacity for these, though they can TALK like they do. But treating AIs like beings is the most productive way to relate to them. They know all about human behavior, so they respond better when addressed in that same way. So have them act in any way that serves you.” This makes them extremely easy to use but also makes it easy to accept what they tell you as correct, complete, verifiable, and immediately usable. Easy to use works for short information summaries, but not for complex systems engineering tasks.

Barclay enjoyed presenting tips on using GenAI in INCOSE and other conferences. In his spirit we have distilled some essential tips for systems engineers using GenAI. Use it but use it right.