SERC Logo

AI4SE & SE4AI Workshop 2023

Sep 27-28, 2023 Washington, DC

Sponsored & organized by U.S. Army DEVCOM Armaments Center (AC) Systems Engineering Directorate and the Systems Engineering Research Center (SERC) in collaboration with the George Washington University

Balancing Opportunity and Risk: The Systems Engineer’s Role in the Rapid Advancement of AI-Based Systems

The 2023 AI4SE/SE4AI Workshop was held in-person on September 27-28 at the George Washington University in Washington, DC. Abstracts were sought from government, industry and academia for presentations and panels to explore the exciting advancements and challenges in the field of artificial intelligence (AI) and systems engineering (SE). All selected abstracts and presentations must be approved for public release.

The rapid development of AI presents both tremendous opportunities and inherent risks. As AI continues to revolutionize various industries, it becomes crucial to strike a delicate balance between seizing the potential benefits and addressing the potential risks. The conference theme, “Balancing Opportunity and Risk: The Systems Engineer’s Role in the Rapid Advancement of AI-Based Systems,” aims to foster discussions and insights on the responsible deployment of AI in systems engineering and how systems engineering can support the development of robust and ethical AI systems.

The conference theme, “Balancing Opportunity and Risk: The Systems Engineer’s Role in the Rapid Advancement of AI-Based Systems,” explores the intricate relationship between artificial intelligence (AI) and systems engineering, encompasses five distinct tracks. The SE4AI track focuses on leveraging systems engineering principles and methodologies to develop robust and efficient AI systems. The AI4SE track delves into the application of AI in systems engineering processes, enabling enhanced decision-making, optimization, validation, and verification. The Human-AI Teaming track examines the collaboration between humans and AI, exploring how to maximize the synergistic potential while addressing ethical and social implications. The Trustworthy AI track highlights the critical aspects of safety, reliability, and ethical considerations in developing and deploying AI systems. Lastly, the Digital Engineering & SE Workforce Development track explores the evolving role of digital engineering and its impact on the systems engineering workforce, fostering skill development and adaptation in an AI-driven landscape. This comprehensive framework ensures a holistic exploration of the opportunities and risks associated with AI in systems engineering, paving the way for responsible and sustainable development.

Topics of Interest

  • Application of AI on SE projects
  • Application of SE on AI projects
  • V&V and T&E of Learning Based Systems
  • Systems Approaches to Reliability and Safety of Learning Based Systems
  • Workforce Development for AI4SE & SE4AI
  • AI/ML Technology Evolution
  • Augmented Intelligence, Cognitive Assistants and Decision Aiding Tools
  • Automation & Human-Machine Teaming in Systems and Missions
  • Digital Engineering Infrastructure and Methods in Support of AI
  • Advances in Explainability, Interpretability, and Transparency
  • Advances to Address Cognitive Bias in AI
  • Testbeds for Learning-Based Systems
  • SE and Data Collection/Curation for AI in Systems
  • Standards of Trust and Evaluation of Trust in SE (Technical, Organizational, Societal)
  • Impact of Large Language Models/Foundation Models on SE

Share

LinkedIn Facebook

Keynote Speakers

Ms. Jennifer Swanson, SES

Deputy Assistant Secretary of the Army for Data, Engineering & Software

View Bio

Dr. Kimberly Sablon

Principal Director, Trusted Artificial Intelligence and Autonomy, OUSD(R&E)

View Bio

Mr. Michael Harasimowicz

Director of Artificial Intelligence Innovations, Lockheed Martin

View Bio

September 27, 2023 | Keynotes and Panels

Keynote

  • Ms. Jennifer Swanson, Deputy Assistant Secretary of the Army for Data, Engineering & Software, Office of the Assistant Secretary of the Army (Acquisition, Logistics and Technology)
  • Dr. Kimberly Sablon, Principal Director, Trusted Artificial Intelligence and Autonomy, Office of the Under Secretary of Defense for Research and Engineering

DEVCOM Armaments Center Perspectives

Dr. Myron Hohil, SSTM for Artificial Intelligence, Sensors & Collaborative Munitions, US Army DEVCOM Armaments Center

Panel: Certification of Learning-Based Systems

  • Moderator: Dr. Zoe Szajnfarber, The George Washington University
  • Dr. Jonathan Barkand, Defense Acquisition University
  • Dr. Tyler Cody, Virginia Tech National Security Institute
  • MAJ Christine Krueger, The George Washington University
  • Dr. Jason Summers, ARiA

Panel: Application of LLMs to Systems Engineering

  • Moderator: Dr. Myron Hohil, US Army DEVCOM Armaments Center
  • Mr. Amir Abrari, SPEC Innovations
  • Mr. John Crissman, CNA Corporation
  • Dr. Carlo Lipizzi, Stevens Institute of Technology

September 27, 2023 | Track 1: Trustworthy AI

Establishing a Measurement Science for Joint Work with Models

Dr. Peter Denno, National Institute of Standards and Technology

Application of Systems Theoretic Process Analysis (STPA) to the Mission Assurance of AI-Enabled Systems

Mr. Robert Crombie, Mr. Daniel Byrne, The Aerospace Corporation

Application of the Traditional Materiel Release Process to the DoD Ethical Principles of Artificial Intelligence, and Roadmap

  • Mr. Benjamin Werner, US Army DEVCOM Armaments Center
  • Mr. Benjamin Schumeg, US Army DEVCOM Armaments Center

Using Artificial Intelligence to Accelerate Deployment of Learning-Based Systems

  • Dr. Jason Gregory, US Army DEVCOM Research Laboratory
  • Dr. Satyandra K. Gupta, University of Southern California

Conformal Prediction for Testing and Evaluation of Intelligent/ML Systems

Mr. Paul Horton, Georgia Tech Research Institute

Evaluating the Explainability and Interpretability of AI Systems

  • Ms. Alaysha Shearn, The George Washington University
  • Dr. David Broniatowski, The George Washington University
  • Dr. Armin Vosoughi, The George Washington University
  • Dr. Valerie Reyna, Cornell University

September 27, 2023 | Track 2: AI4SE

AI-Assisted Generation of SysML Models to Accelerate Agile Digital Engineering

  • Mr. Matthew Jones, Leidos
  • Ms. Erin Crabb, Leidos

Requirement Discovery Using Embedded Knowledge Graph with ChatGPT

  • Dr. Nipa Phojanamongkolkij, NASA Langley Research Center
  • Mr. Braxton VanGundy, NASA Langley Research Center
  • Mr. Ramana Polavarapu, NASA Langley Research Center
  • Mr. Joshua Bonner, NASA Langley Research Center
  • Dr. Barclay Brown, Collins Aerospace

LLM Based SysML Virtual Assistant

  • Mr. Alexander Demagall, Texas A&M University
  • Mr. Gabe Apanza, Texas A&M University
  • Dr. Daniel Selva, Texas A&M University

Melding Minds and Machines: Harnessing AI Capabilities to Further Model-Based Guided Engineering

  • Ms. Melinda Ong, Booz Allen Hamilton
  • Mr. Andrew Gaskins, Booz Allen Hamilton

A Constructed System of Analysis to Enable Automation and Reasoning in Multi-Model Analysis

  • Mr. Daniel Dunbar, Stevens Institute of Technology
  • Dr. Mark Blackburn, Stevens Institute of Technology
  • Dr. Tom Hagedorn, Stevens Institute of Technology

Large Language Model Enabled Generation of Systems Engineering Artifacts

  • Dr. Paul Wach, Virginia Tech
  • Dr. Taylan Topcu, Virginia Tech
  • Mr. Mohammed Husain, Virginia Tech

September 28, 2023 | Keynote and Panel

Keynote

Mr. Michael “Rabbi” Harasimowicz, Director, AI Innovations, Lockheed Martin

SERC Perspectives

  • Dr. Peter Beling, Director, Intelligent Systems Division, Virginia Tech National Security Institute and SERC Research Council Member
  • Dr. Ali Raz, Assistant Professor, George Mason University

Panel: Comparing Ethical and Safety Frameworks for Promoting Trust in AI Systems

  • Moderator: Mr. Andy Lacher, NASA Langley Research Center
  • Dr. David Broniatowski, The George Washington University
  • Mr. Chuck Howell, MITRE
  • Dr. Kim Wasson, Joby Aviation

September 28, 2023 | Track 1: Human/AI Teaming

Is the Machine a Partner or a Tool? A Major Issue of Human-AI Teaming

Dr. Guy Boy, Paris Saclay University (CentraleSupélec) & ESTIA Institute of Technology

What is Human-in-the-Loop, Really?

  • Mr. Aditya Singh, The George Washington University
  • Dr. Zoe Szajnfarber, The George Washington University

Managing the Continuity of Human Biases in AI SE Applications

  • Dr. Steven Conrad, Colorado State University
  • Ms. Heidi Perry, MIT Lincoln Laboratory

Opportunities and Risks of Incorporating LLMs in the Systems Engineering and Design Workflow: A Case Study of Robotic System Design Process

  • Dr. Zoe Szajnfarber, The George Washington University
  • Mr. Oladele (Richard) Adeyeye, The George Washington University
  • Dr. Robert Pless, The George Washington University

The Need to Update Design and Certification Performance Standards for Operator Intervention of Autonomous Systems

  • Dr. Lance Sherry, George Mason University
  • Dr. George Donohue, George Mason University
  • Ms. Jomana Bashata, George Mason University

Mission Engineering in Healthcare and What We Can Apply to the Military

  • Mr. Richard Threlkeld, Missouri University of Science and Technology
  • Dr. Cihan Dagli, Missouri University of Science and Technology

September 28, 2023 | Track 2: SE4AI

Hiring Trained Animals: Generative AI Patterns and Practices for Systems Engineering

Dr. Barclay Brown, Collins Aerospace

Systems’ Perspectives for AI Acceleration in Large Enterprises and Government Agencies

  • Dr. Jyotirmay Gadewadikar, MITRE
  • Mr. Jim Lockett, MITRE
  • Mr. Jeremy Marshall, MITRE

Test and Evaluation (T&E) of Complex AI-Enabled Systems (AIES)

  • Dr. Flo Reeder, MITRE
  • Ms. Elena Charnetzki, MITRE

Systems Engineering Processes to Test AI Right (SEPTAR)

  • Ms. Carol Pomales, MITRE
  • Dr. Flo Reeder, MITRE
  • Dr. Carlos Balhana, MITRE
  • Mr. Jim Lockett, MITRE
  • Ms. Ivy Chen, MITRE

A Systems Engineering Perspective on Safety of AI-based Systems

  • Mr. Reginald Holmes, University of Alabama in Huntsville
  • Dr. Hanumanthrao “Rao” Kannan, University of Alabama in Huntsville

Simulating the Tradespace with Synthetic Data

  • Dr. Cameron Turner, Clemson University
  • Dr. Matthew Castanier, US Army Ground Vehicle Systems Center
  • Dr. David Gorsich, US Army Ground Vehicle Systems Center
  • Dr. Greg Hartman, US Army Ground Vehicle Systems Center

Details

Event

AI4SE & SE4AI Workshop 2023

Start Date
September 27, 2023
End Date
September 28, 2023
Event Link

Venue

George Washington University Science and Engineering Hall

Address
800 22nd Street NW
Washington, DC 20052
Phone
(202) 994-1000
Website
https://sercuarc.org/venue/the-george-washington-university/

Organizer

Systems Engineering Research Center (SERC)

Email
serc@sercuarc.org
Website
http://www.sercuarc.org/