*** This event page remains intact for archival purposes. ***
The fifth annual AI4SE and SE4AI workshop is sponsored and organized by the U.S. Army DEVCOM Armaments Center Systems Engineering Directorate and the Systems Engineering Research Center and will be hosted at the George Mason University Arlington Campus on September 17-18.
For questions, please contact Alan Skontra at askontra@stevens.edu.
Safer AI-Enabled Complex Systems: Responsible Deployment of AI through Systems Engineering
The rapid development and deployment of AI presents both tremendous opportunities and inherent risks. As AI continues to revolutionize various industries, and is embedded in complex systems at various levels, it becomes crucial to strike a delicate balance between seizing the potential benefits and addressing and mitigating potential harms. The conference theme, “Safer AI-Enabled Complex Systems: Responsible Deployment of AI through Systems Engineering,” aims to foster discussions and insights on how systems engineering can support the development of robust and ethical AI systems, and how AI tools can in turn transform the practice of systems engineering.
The SE4AI track focuses on leveraging systems engineering principles and methodologies to develop safe, robust, and efficient AI systems, while extending them in response to the nature of AI enabled systems. The AI4SE track delves into the application of AI in support of systems engineering processes, by enabling enhanced decision-making, optimization, validation, and verification.
Keynote Speakers
As one of the U.S. Navy’s first female fighter pilots and an engineer, Dr. Mary “Missy” Cummings is accustomed to breaking barriers and solving problems. A naval officer and military pilot from 1988-1999, Cummings was one of the U.S. Navy’s first female fighter pilots. She is now the director of Mason’s Autonomy and Robotics Center (MARC) and a professor at George Mason University. She holds faculty appointments in the Mechanical Engineering, Electrical and Computer Engineering, and Computer Science departments. She is an American Institute of Aeronautics and Astronautics (AIAA) Fellow and recently served as the senior safety advisor to the National Highway Traffic Safety Administration. Cummings received her BS in Mathematics from the U.S. Naval Academy in 1988, her MS in Space Systems Engineering from the Naval Postgraduate School in 1994, and her PhD in Systems Engineering from the University of Virginia in 2004.
Mr. Dan Mahanty is the Division Director for Learning at the Civilian Protection Center of Excellence, where he leads the Center’s research and analytic agenda, and drives the exploration of technology solutions for civilian harm mitigation. Prior to his service at the Department of Defense, he served as a Director of Research, Learning and Innovation and US Program Director for seven years at the international non-profit, Center for Civilians in Conflict, where he led research initiatives focused on civilian protection and civilian harm mitigation. He also spent sixteen years at the U.S. Department of State, where he started and led the Office of Security and Human Rights, leading efforts to integrate US leadership on human rights in security policy and practice. He is a non-resident associate at the Center for Strategic and International Studies, and was an adjunct associate professor at Georgetown University and with the Kansas University program at the Command and General Staff College at Ft. Leavenworth. His research on civilian harm mitigation has been cited by the New York Times and Washington Post, and his writing has appeared in Foreign Policy, Defense One, War on the Rocks, and USA Today. He holds a master’s degree from Georgetown University and a bachelor’s degree from George Mason University. He is from Greeley, Colorado and now lives in McLean, Virginia.
Mr. Matthew Rose is the Global Public Sector Industry Principal at Snowflake, where he leads a team serving government and education organizations. He focuses on public sector needs and bringing solutions and technologies into the public sector market. Before joining Snowflake, he led Adobe’s Public Sector Business Development and Strategy. Previously, Matthew served in government, most recently as the DOD’s Chief Design Officer, Joint Artificial Intelligence Center’s Strategy and Policy Directorate Chief; GSA’s Director for Cloud and Infrastructure; and Special Advisor on Technology Protection for the Secretary of Defense. He is a founder of several companies, sits on the Stimson Center and Atlantic Council, and serves in the Army Reserve. Matthew has three graduate degrees and has published extensively on the topics of defense and technology. He resides in Warrenton Virginia with his wife and three children.
Presentation Slides
Refer to the printable agenda for times. Presentations will be available for download after the workshop.
9:00 AM – Keynote
Mr. Matthew Rose, Global Public Sector Industry Principal, Snowflake
9:45 AM – US Army DEVCOM Armaments Center Perspective
Mr. Edward W. Bauer, Director of the Systems Engineering Directorate, US Army DEVCOM Armaments Center
1:05 PM – Plenary Panel: The Need for Socio-technical System Testbeds for AI Enabled Systems
Moderator: Dr. Laura Freeman, Virginia Tech
10:30 AM – Accountability for AI Enabled Systems Used in Critical Decision-making
NASA Langley Research Center
10:50 AM – Navigating Uncertainty: Enhancing AI System Safety through the Integration of Systems Theory, Set Theory and R3+ Concepts
University of Alabama in Huntsville
11:10 AM – What Can Aviation and Pharmaceuticals Teach Us About How to Set Up a System of Assurance for Different Types of AI-Enabled Systems?
George Washington University
11:30 AM – Application of AI to Collision Risk Safety Analysis for the National Airspace System
George Mason University
2:10 PM – Interpretable ML for Requirements Development
United States Military Academy
2:30 PM – Using End-to-End Causal Inference to Assess AI-ML Classifier Health
Carnegie Mellon University Software Engineering Institute
2:50 PM – Enhancing Trust in AI-Powered Situational Awareness Systems for US Army Ground Vehicles: A Holistic Approach to Explainability and Interpretability
Strategic Ai Services (SAS)
3:10 PM – Integrating Responsible AI Principles into Systems Engineering Practices: A Holistic Approach for Safe and Reliable AI-Enabled Systems
MITRE
4:00 PM – Enhancing Testing & Evaluation of AI-Enabled DoD Systems Using MBSE
MITRE Corporation
4:20 PM – Multi-Fidelity Test and Evaluation of AI-Enabled Systems
Purdue University
4:40 PM – Use of Predictive AI/ML Embedded in Lifecycle Systems Engineering to Support Testing of AI/ML Based Weapons Systems
Georgia Tech Research Institute
10:30 AM – Accelerating Insertion of Warfighting Capability using GenAI Based Control Synthesis from Image
Software Engineering Institute at Carnegie Mellon University
10:50 AM – Design of AI-Enabled Multi-Mode Logistics Planning System (M2ALPS) In Support of the Air Force Adaptive Basing Concept-of-Operations
George Mason University
11:10 AM – Use of STPA for Analyzing Information Flows in Distributed Autonomous Systems
Stevens Institute of Technology
11:30 AM – Guiding the Behavior of Complex Networked Systems using Multi-Agent Reinforcement Learning: Governance by Dynamic Balancing of Cooperation and Competition
Northeastern University
2:10 PM – Responsible Use of AI to Improve Sustainability of Future Systems
AFC DEVCOM AvMC RAM Division
2:30 PM – Rapid Intelligent Systems Engineering
Lockheed Martin – Advanced Technology Laboratories
2:50 PM – The Use of Generative GenAI to Unlock Value from Defense ERP Business Systems
PEO-EIS-DIBS-LMP
3:10 PM – Large Language Models in Enhanced Electronic Warfare: Applications, Benefits, Limitations and Future Directions
Stevens Institute of Technology
4:00 PM – Reuse of Digital Engineering Models via Semantic Component Libraries
Systems Engineering Research Center
4:20 PM – MBSE AI Platform for Productivity (MAPPy): Combining AI and Digital Engineering
Booz Allen Hamilton
4:40 PM – Accelerating Semantic Digital Thread User Queries Using LLMs
ManTech
8;45 AM – Keynote
Mr. Daniel Mahanty, Division Director for Learning, Civilian Protection Center of Excellence
9:35 AM – Plenary Panel: Opportunities and Risks for Leveraging Generative AI to Support SE Processes
Moderator: Dr. Peter Beling, Virginia Tech
NO PRESENTATION SLIDES
1:30 PM – Keynote
Dr. Missy Cummings, Professor and Director of Mason Autonomy and Robotics Center, George Mason University
2:15 PM – SERC Perspective: Archimedes Workshop on Trustworthy AI
Dr. Zoe Szajnfarber, Professor, The George Washington University and SERC Chief Scientist
4:45 PM – Trusted AI SE Challenge
Dr. Peter Beling, Virginia Tech
10:55 AM – Towards A Human-AI Collaboration Maturity Model (HAIC-MM) for Small and Medium-Sized Enterprises
Colorado State University
11:15 AM – Understanding the Tradeoffs of Human-AI System Architecting
George Washington University
11:35 AM – Addressing Challenges of Human-AI Teaming Experiments Using Naval AI Systems
Naval Information Warfare Center
11:55 AM – PRODEC: A Method and Platform for Human Systems Integration of Human-AI Teams
FlexTech Chair, CentraleSupélec (Paris Saclay University & ESTIA)
3:00 PM – A SE4AI Framework for the Systems Engineering of Autonomous Systems with a Focus on the Curation of Data across the Lifecycle
The University of Adelaide & Shoal Group
3:20 PM – Model-Based Systems Engineering (MBSE) Approach to Develop an Artificial Intelligence Bill of Material (AIBOM) for AI System Compliance Verification
C5ISR
3:40 PM – System Architecture for Recombinant AI (SARAI)
C5I Center at George Mason University
4:00 PM – Tradeoff Analysis Using an Integrated Data-Driven and Model-Based Approach for the Design of Autonomous Robots
University of Maryland
4:20 PM – A Systems Engineering Methodology for Integrating Autonomy with System of Systems and Conducting Data-Driven Trade Study Analyses
George Mason University
10:55 AM – Say What? Identifying the Impact of Prompt Technique on AI Generation of Systems Engineering Artifacts
Leidos
11:15 AM – LLM Co-pilots for Domain Specific Modeling Languages
Tangram Flex
11:35 AM – Developing Concepts of Operations Using Multi-Step Tool Techniques with Large Language Models
NASA Langley Research Center
11:55 AM – Systems Engineering Language Modeling Assistant
MITRE
3:00 PM – Challenges of Trustworthy Human/AI Teaming in Long-running Relationships
National Institute of Standards and Technology
3:20 PM – Towards a Work Systems View of Human AI Collaboration in Systems Engineering and Design: The Case of Conceptual Design with a ChatGPT Partner
George Washington University
3:40 PM – Theoretical Feasibility of Graph Neural Networks for Augmented Intelligence in Systems Engineering
University of Alabama in Huntsville
4:00 PM – AI Aided Design and Development for Space Systems
University of Southern California Information Sciences Institute
4:20 PM – Using Large Language Models to Accelerate Development of Complex Systems
Virginia Tech National Security Institute
The workshop will take place in person at Van Metre Hall on the George Mason University Arlington Campus (known as Mason Square) at 3351 Fairfax Drive in Arlington, Virginia, 22201. The building is within walking distance of the Virginia Square-GMU Washington Metro stop, which is linked to Metro stops at Dulles and Reagan airports and to Amtrak at Union Station. Parking is available at an hourly rate in nearby campus garages or on public streets. Visit the Mason Square campus access page for additional details and contact information for questions.
JUNE 17, 2024, by 11:59pm ET
Abstract Submission Deadline
JULY 15, 2024
Notification to Authors
SEPTEMBER 17-18, 2024
Workshop Dates
The U.S. Army DEVCOM Armaments Center Systems Engineering Directorate and the Systems Engineering Research Center are pleased to announce a call for abstracts for the fifth annual AI4SE & SE4AI Research and Application Workshop being held on September 17-18, 2024, at the George Mason University Arlington Campus. This highly anticipated event will bring together academia, government, and industry experts to explore the exciting advancements and challenges at the intersection of artificial intelligence (AI) and systems engineering (SE). All selected abstracts and presentations must be approved for public release and delivered in-person at the venue.
As in the past, the conference will be organized around two main themes: SE4AI and AI4SE. We welcome contributions to either theme or any of the subthemes elaborated below:
SE4AI. The SE4AI track focuses on leveraging systems engineering principles and methodologies to develop safe, robust, and efficient AI systems, while extending them in response to the nature of AI enabled systems.
Specific research areas in this track include but are not limited to:
- AI embedded in complex systems of systems (SoS) and/or teams,
- Measures of trust that include a recognition of human and technology interaction, including studies on explainability, interpretability, and related AI-ilities.
- Test and Evaluation (T&E) across the lifecycle,
- System design processes that support AI across the lifecycle, including AI maintenance and sustainment principles and practice.
- Bidirectionality in human-AI collaborative systems.
- Socio-technical System Testbeds to support system characterization and/or training.
- Critical aspects of safety, reliability, and ethical considerations in developing and deploying AI systems.
AI4SE. The AI4SE track delves into the application of AI in support of systems engineering processes, by enabling enhanced decision-making, optimization, validation, and verification.
Specific research areas in this track include but are not limited to:
- Evolving role of digital engineering and its impact on the systems engineering workforce, fostering skill development and adaptation in an AI-driven landscape.
- Large Language Models (LLMs) co-pilots for systems modelers and engineers.
- Cognitive assistants: conversational systems automating many mundane data entry, exploration, and engineering calculation tasks, and many workflows, beyond LLMs.
- AI and visualization to assist in complex project management activities, including managing human teams.
- AI for system design and design space exploration.
- Other AI, data analytic, and visualization approaches to improve SE and PM.
——————————————————————————–
Submission Guidelines:
Title : 200-character limit
Primary Author / Presenter: Full name, title and organization. Please note the person’s email address submitted here will be the main point of contact and receive all notifications pertaining to the abstract and event.
Additional Authors: Any additional authors and/or presenters should be listed with their organization.
Research Area: Indicate the specific research area (bullets) above you are addressing within the broad tracks of SE4AI or AI4SE.
Submission Type: Indicate whether submission is for an individual presentation, panel submission, or practitioner case study. Note that if panel submission is selected, the planned panelists and their organization must be identified.
Abstract Content: Please upload a 1–3-page extended abstract that clearly states the objectives, methodology, expected or achieved outcomes of your research, and explains the relevance of your work to practice. A subset of mature submissions maybe invited to a special issue after the conference.
References: An additional page can be uploaded to contain endnote references, graphics, and URL links to faculty/researcher bios and curriculum vitaes.
Submission Schedule:
Abstract Submission Deadline: June 17, 2024
Notification of Selection: July 15, 2024
Disclosure:
The AI4SE & SE4AI Research and Application Workshop is an unclassified workshop. All abstracts and selected presentations must be approved for public release.
Workshop Technical Committee:
Dr. Peter Beling, Virginia Tech
Dr. Zoe Szajnfarber, George Washington University
Dr. Valerie Sitterle, Georgia Tech Research Institute
Dr. Ali Raz, George Mason University
Mr. Tom McDermott, Stevens Institute of Technology
Mr. Al Stanbury, U.S. Army DEVCOM AC
Dr. Myron Hohil, U.S. Army DEVCOM AC
Dr. Jason Cook, U.S. Army DEVCOM AC
Dr. Ralph Tillinghast, U.S. Army DEVCOM AC
Mr. Benjamin Schumeg, U.S. Army DEVCOM AC
