– Assess degree of mastery of core SE knowledge, skills, abilities (KSAs) – Assessment via examin... more – Assess degree of mastery of core SE knowledge, skills, abilities (KSAs) – Assessment via examination, resume, artifacts produced Enterprise KSA Inventory, Career Progression Models – Record degree of mastery of core and business-domain SE KSAs – Assessment via educational and project experience records Project SE Staffing Capability Models – Assess commitment to provide project-critical skills • Tailorable subset of core SE skills • Extendable for project-specific skills – Assessment via educational and project experience records, interviews
This research assesses the effect of product, project, process, people and risk factors on schedu... more This research assesses the effect of product, project, process, people and risk factors on schedule for software development projects that employ agile methods. Prior research identified these factors as being significant within lean/agile organizations with a history of rapid‐response to new product development needs. This work integrates these factors into CORADMO, the Constructive Rapid Application Development Model, an offshoot of the COCOMO family of effort and schedule estimation models. ❧ CORADMO is based on a system dynamics model of the agile development process, which simulates the flow of development tasks and change items through the process. The five major factors are elaborated into twelve sub‐factors, most having a second‐, third‐ or higher‐order effect on schedule. Each of the factors and sub‐factors is rated along a six‐element Likert scale, which determines a set of weighing multipliers derived from COCOMO, COSYSMO, and other models. These multipliers are applied t...
Alice Squires has nearly 30 years of professional experience and is an industry and research prof... more Alice Squires has nearly 30 years of professional experience and is an industry and research professor in Systems Engineering at Stevens Institute of Technology in the School of Systems and Enterprises. She is a Primary Researcher for the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) and Systems Engineering Experience Accelerator projects. She has served as a Senior Systems Engineer consultant to Lockheed Martin, IBM, and EDO Ceramics, for Advanced Systems Supportability Engineering Technology and Tools (ASSETT), Inc. Alice previously served as a senior engineering manager for General Dynamics (GD), Lockheed Martin (LM) and as a technical lead for IBM. Alice is a lifetime member of Beta Gamma Sigma (Business), Tau Beta Pi (National Engineering), and Eta Kappa Nu (National Electrical Engineering) Honorary Societies and is an International Council on Systems Engineering (INCOSE) Certified Systems Engineering Professional (CSEP) in both base and Acquisition (CSEP-Acq). She is in the process of completing her doctorate dissertation in "Investigating the Relationship Between Online Pedagogy and Student Perceived Learning of Systems Engineering Competencies" and her research interests include systems engineering competency development, systems thinking and systems engineering education. Alice is the Chair of the Systems Engineering Division of ASEE and has a Masters in Business Administration (MBA) and Bachelors of Science in Electrical Engineering (BSEE). Alice received the Stevens Institute of Technology Provost's Online Teaching Excellence Award in 2007.
Public reporting burden for the collection of information is estimated to average 1 hour per resp... more Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number.
2012 IEEE International Systems Conference SysCon 2012, 2012
Effective application of systems engineering in rapid response environments has been difficult, p... more Effective application of systems engineering in rapid response environments has been difficult, particularly those where large, complex brownfield systems or systems of systems exist and are constantly being updated with both short and long term software enhancements. This paper proposes a general case for solving this problem by combining a services approach to systems engineering with a kanban-based scheduling system. It provides the basis for validating the approach with agent-based simulations.
2012 International Conference on Software and System Process (ICSSP), 2012
Systems engineering processes using pull scheduling methods (kanban) are being evaluated with hyb... more Systems engineering processes using pull scheduling methods (kanban) are being evaluated with hybrid modeling and simulation. We are assessing integrated systems and software engineering at the enterprise level, where rapid response software development projects incrementally evolve capabilities of existing systems and/or systems of systems. A kanban-based scheduling system was defined and implemented with connected discrete, continuous and agent-based models. We are simulating the process performance vs. traditional methods of sharing systems engineering services across projects, and whether the overall value of the systems of systems over time is increased.
2012 International Conference on Software and System Process (ICSSP), 2012
Systems engineering is often ineffective in development environments where large, complex, brownf... more Systems engineering is often ineffective in development environments where large, complex, brownfield systems of systems are evolved through parallel development of new capabilities in response to external, time-sensitive requirements. This paper defines a conceptual framework to improve that effectiveness and better integrate the systems engineering and software engineering processes. The framework is based on a services approach to systems engineering and the use of kanban techniques to schedule scarce enterprise systems engineering resources across multiple related systems and software development projects. The framework also addresses the differing value of work items to multiple stakeholders in the scheduling and coordination processes. Models and simulations are being used to capture, refine and validate the framework prior to in vivo experimentation.
Effective application of systems engineering in rapid response environments has been difficult, p... more Effective application of systems engineering in rapid response environments has been difficult, particularly those where large, complex brownfield systems or systems of systems exist and are constantly being updated with both short and long term software enhancements. This paper proposes a general case for solving this problem by combining a services approach to systems engineering with a kanban-based scheduling system. It provides the basis for validating the approach with agent-based simulations.
Abstract: Traditional Systems Engineering (SE) education is not adequate to meet the emerging cha... more Abstract: Traditional Systems Engineering (SE) education is not adequate to meet the emerging challenges posed by ever increasing Systems and Societal demands, the workforce called upon to meet them and the timeframe in which these challenges need to ...
Abstract. It is often difficult to understand the status of capability development in large opera... more Abstract. It is often difficult to understand the status of capability development in large operational systems. Schedules are rarely stable. This is due to factors such as: the size and complexity of capabilities; unexpected changes in priorities; depth of supplier chains; variety and availability of special engineering resources; contract structure; and the inherently complex nature of such operations. Lean approaches use the concepts of work in progress (WIP) and capacity to maximize flow through a process. Under certain circumstances, these concepts can be applied to systems engineering and development processes. This paper describes an example implementation of the concept in a large health care system of systems. To enhance both visibility and flow, the approach utilizes visualization techniques, pull-scheduling processes, and a services approach to systems engineering.
This paper summarizes the results of a DoD Systems Engineering Research Center (SERC) project to ... more This paper summarizes the results of a DoD Systems Engineering Research Center (SERC) project to synthesize analyses of DoD SE effectiveness risk sources into a lean framework and toolset for early identification of SE-related program risks. It includes concepts of operation which enable project sponsors and performers to agree on the nature and use of more effective evidence-based reviews. These enable early detection of missing SE capabilities or personnel competencies with respect to a framework of Goals, Critical Success Factors (CSFs), and Questions determined from leading DoD early-SE CSF analyses. The SE Effectiveness Measurement (EM) tools enable risk-based prioritization of corrective actions, as shortfalls in evidence for each question are early uncertainties, which when combined with the relative system impact of a negative answer to the question, translates into the degree of risk that needs to be managed to avoid system overruns and incomplete deliveries. Introduction; ...
: The mission of the DoD Systems Engineering Research Center (SERC) is to perform research leadin... more : The mission of the DoD Systems Engineering Research Center (SERC) is to perform research leading to transformational SE methods, processes, and tools (MPTs) that enable DoD and Intelligence Community (IC) systems to achieve significantly improved mission successes. An elevator speech for the capabilities delivered by the Department of Defense (DoD) Systems Engineering Research Center (SERC) Systems Engineering (SE) Effectiveness Measurement (EM) task reads as follows: for the DoD, whose Major Defense Acquisition Programs (MDAPs) frequently and significantly overrun their budgets and schedules and deliver incomplete systems, the SERC SE EM framework, operational concepts, and tools will empower MDAP sponsors and performers to collaboratively determine their early SE shortfalls and enable the development of successful systems within their resource constraints. Unlike traditional schedule-based and event-based reviews, the SERC SE EM technology enables sponsors and performers to agre...
Accelerating development schedules is increasingly important in a competitive world. Reduced time... more Accelerating development schedules is increasingly important in a competitive world. Reduced time-to-market is a key response to competitive threats in the commercial sphere, and rapid response in deploying military systems may save lives in a geopolitical environment characterized by rapidly emerging and ever-changing physical threats. Agile/lean development methodologies show promise in providing the desired schedule acceleration, but it can be difficult for planners to determine the effects of these factors on schedule duration, and to make appropriate choices to optimize project performance. The Constructive Rapid Application Development Model (CORADMO) attempts to quantify the effects of key schedule drivers, and thus enable planners to estimate the relative schedule that will result from varying these parameters.
Proceedings of the 2013 International Conference on Software and System Process - ICSSP 2013, 2013
Accelerating development schedules is increasingly important in a competitive world. Reduced time... more Accelerating development schedules is increasingly important in a competitive world. Reduced time-to-market is a key response to competitive threats in the commercial sphere, and rapid response in deploying military systems may save lives in a geopolitical environment characterized by rapidly emerging and everchanging physical threats. Agile/lean development methodologies show promise in providing the desired schedule acceleration, but it can be difficult for planners to determine the effects of these factors on schedule duration, and to make appropriate choices to optimize project performance. The Constructive Rapid Application Development Model (CORADMO) attempts to quantify the effects of key schedule drivers, and thus enable planners to estimate the relative schedule that will result from varying these parameters.
is furnished on an "as-is" basis. Stevens Institute of Technology makes no warranties of any kind... more is furnished on an "as-is" basis. Stevens Institute of Technology makes no warranties of any kind, either expressed or implied, as to any matter including, but not limited to, warranty of fitness for purpose or merchantability, exclusivity, or results obtained from use of the material. Stevens Institute of Technology does not make any warranty of any kind with respect to freedom from patent, trademark, or copyright infringement. This material has been approved for public release and unlimited distribution.
This research project evaluates the use of on-demand (pull or kanban) scheduling approaches in sy... more This research project evaluates the use of on-demand (pull or kanban) scheduling approaches in systems engineering (SE). Such approaches have been seen to be valuable in software system development. In particular, the research focuses on SE where rapid response software development projects incrementally evolve capabilities of existing systems and/or systems of systems. Phase I considered the problem and possible applications of alternative scheduling methods and suggested possible outcomes of on-demand scheduling coupled with a service-oriented approach to SE. It defined a conceptual model and developed initial simulations to capture the model and better understand the impact. Phase II focuses on applying the method to multi-level service-based SE in complex systems of systems. Using the models and simulations from Phase I, Phase II defines a prototype network of kanban-based scheduling systems (KSS) for a target environment based on a large multi-facility hospital system. The definition is simulated to demonstrate its behavior. Follow on work is planned to use the prototype in comparing performance with traditional SE methods. This will enable determination if SE functions are accomplished more effectively and efficiently, whether the overall value of the systems of systems over time is increased, and whether other expected results are fulfilled. 15. SUBJECT TERMS 16. SECURITY CLASSIFICATION OF: 17. LIMITATION OF ABSTRACT Same as Report (SAR) 18. NUMBER OF PAGES 82 19a. NAME OF RESPONSIBLE PERSON
– Assess degree of mastery of core SE knowledge, skills, abilities (KSAs) – Assessment via examin... more – Assess degree of mastery of core SE knowledge, skills, abilities (KSAs) – Assessment via examination, resume, artifacts produced Enterprise KSA Inventory, Career Progression Models – Record degree of mastery of core and business-domain SE KSAs – Assessment via educational and project experience records Project SE Staffing Capability Models – Assess commitment to provide project-critical skills • Tailorable subset of core SE skills • Extendable for project-specific skills – Assessment via educational and project experience records, interviews
This research assesses the effect of product, project, process, people and risk factors on schedu... more This research assesses the effect of product, project, process, people and risk factors on schedule for software development projects that employ agile methods. Prior research identified these factors as being significant within lean/agile organizations with a history of rapid‐response to new product development needs. This work integrates these factors into CORADMO, the Constructive Rapid Application Development Model, an offshoot of the COCOMO family of effort and schedule estimation models. ❧ CORADMO is based on a system dynamics model of the agile development process, which simulates the flow of development tasks and change items through the process. The five major factors are elaborated into twelve sub‐factors, most having a second‐, third‐ or higher‐order effect on schedule. Each of the factors and sub‐factors is rated along a six‐element Likert scale, which determines a set of weighing multipliers derived from COCOMO, COSYSMO, and other models. These multipliers are applied t...
Alice Squires has nearly 30 years of professional experience and is an industry and research prof... more Alice Squires has nearly 30 years of professional experience and is an industry and research professor in Systems Engineering at Stevens Institute of Technology in the School of Systems and Enterprises. She is a Primary Researcher for the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) and Systems Engineering Experience Accelerator projects. She has served as a Senior Systems Engineer consultant to Lockheed Martin, IBM, and EDO Ceramics, for Advanced Systems Supportability Engineering Technology and Tools (ASSETT), Inc. Alice previously served as a senior engineering manager for General Dynamics (GD), Lockheed Martin (LM) and as a technical lead for IBM. Alice is a lifetime member of Beta Gamma Sigma (Business), Tau Beta Pi (National Engineering), and Eta Kappa Nu (National Electrical Engineering) Honorary Societies and is an International Council on Systems Engineering (INCOSE) Certified Systems Engineering Professional (CSEP) in both base and Acquisition (CSEP-Acq). She is in the process of completing her doctorate dissertation in "Investigating the Relationship Between Online Pedagogy and Student Perceived Learning of Systems Engineering Competencies" and her research interests include systems engineering competency development, systems thinking and systems engineering education. Alice is the Chair of the Systems Engineering Division of ASEE and has a Masters in Business Administration (MBA) and Bachelors of Science in Electrical Engineering (BSEE). Alice received the Stevens Institute of Technology Provost's Online Teaching Excellence Award in 2007.
Public reporting burden for the collection of information is estimated to average 1 hour per resp... more Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number.
2012 IEEE International Systems Conference SysCon 2012, 2012
Effective application of systems engineering in rapid response environments has been difficult, p... more Effective application of systems engineering in rapid response environments has been difficult, particularly those where large, complex brownfield systems or systems of systems exist and are constantly being updated with both short and long term software enhancements. This paper proposes a general case for solving this problem by combining a services approach to systems engineering with a kanban-based scheduling system. It provides the basis for validating the approach with agent-based simulations.
2012 International Conference on Software and System Process (ICSSP), 2012
Systems engineering processes using pull scheduling methods (kanban) are being evaluated with hyb... more Systems engineering processes using pull scheduling methods (kanban) are being evaluated with hybrid modeling and simulation. We are assessing integrated systems and software engineering at the enterprise level, where rapid response software development projects incrementally evolve capabilities of existing systems and/or systems of systems. A kanban-based scheduling system was defined and implemented with connected discrete, continuous and agent-based models. We are simulating the process performance vs. traditional methods of sharing systems engineering services across projects, and whether the overall value of the systems of systems over time is increased.
2012 International Conference on Software and System Process (ICSSP), 2012
Systems engineering is often ineffective in development environments where large, complex, brownf... more Systems engineering is often ineffective in development environments where large, complex, brownfield systems of systems are evolved through parallel development of new capabilities in response to external, time-sensitive requirements. This paper defines a conceptual framework to improve that effectiveness and better integrate the systems engineering and software engineering processes. The framework is based on a services approach to systems engineering and the use of kanban techniques to schedule scarce enterprise systems engineering resources across multiple related systems and software development projects. The framework also addresses the differing value of work items to multiple stakeholders in the scheduling and coordination processes. Models and simulations are being used to capture, refine and validate the framework prior to in vivo experimentation.
Effective application of systems engineering in rapid response environments has been difficult, p... more Effective application of systems engineering in rapid response environments has been difficult, particularly those where large, complex brownfield systems or systems of systems exist and are constantly being updated with both short and long term software enhancements. This paper proposes a general case for solving this problem by combining a services approach to systems engineering with a kanban-based scheduling system. It provides the basis for validating the approach with agent-based simulations.
Abstract: Traditional Systems Engineering (SE) education is not adequate to meet the emerging cha... more Abstract: Traditional Systems Engineering (SE) education is not adequate to meet the emerging challenges posed by ever increasing Systems and Societal demands, the workforce called upon to meet them and the timeframe in which these challenges need to ...
Abstract. It is often difficult to understand the status of capability development in large opera... more Abstract. It is often difficult to understand the status of capability development in large operational systems. Schedules are rarely stable. This is due to factors such as: the size and complexity of capabilities; unexpected changes in priorities; depth of supplier chains; variety and availability of special engineering resources; contract structure; and the inherently complex nature of such operations. Lean approaches use the concepts of work in progress (WIP) and capacity to maximize flow through a process. Under certain circumstances, these concepts can be applied to systems engineering and development processes. This paper describes an example implementation of the concept in a large health care system of systems. To enhance both visibility and flow, the approach utilizes visualization techniques, pull-scheduling processes, and a services approach to systems engineering.
This paper summarizes the results of a DoD Systems Engineering Research Center (SERC) project to ... more This paper summarizes the results of a DoD Systems Engineering Research Center (SERC) project to synthesize analyses of DoD SE effectiveness risk sources into a lean framework and toolset for early identification of SE-related program risks. It includes concepts of operation which enable project sponsors and performers to agree on the nature and use of more effective evidence-based reviews. These enable early detection of missing SE capabilities or personnel competencies with respect to a framework of Goals, Critical Success Factors (CSFs), and Questions determined from leading DoD early-SE CSF analyses. The SE Effectiveness Measurement (EM) tools enable risk-based prioritization of corrective actions, as shortfalls in evidence for each question are early uncertainties, which when combined with the relative system impact of a negative answer to the question, translates into the degree of risk that needs to be managed to avoid system overruns and incomplete deliveries. Introduction; ...
: The mission of the DoD Systems Engineering Research Center (SERC) is to perform research leadin... more : The mission of the DoD Systems Engineering Research Center (SERC) is to perform research leading to transformational SE methods, processes, and tools (MPTs) that enable DoD and Intelligence Community (IC) systems to achieve significantly improved mission successes. An elevator speech for the capabilities delivered by the Department of Defense (DoD) Systems Engineering Research Center (SERC) Systems Engineering (SE) Effectiveness Measurement (EM) task reads as follows: for the DoD, whose Major Defense Acquisition Programs (MDAPs) frequently and significantly overrun their budgets and schedules and deliver incomplete systems, the SERC SE EM framework, operational concepts, and tools will empower MDAP sponsors and performers to collaboratively determine their early SE shortfalls and enable the development of successful systems within their resource constraints. Unlike traditional schedule-based and event-based reviews, the SERC SE EM technology enables sponsors and performers to agre...
Accelerating development schedules is increasingly important in a competitive world. Reduced time... more Accelerating development schedules is increasingly important in a competitive world. Reduced time-to-market is a key response to competitive threats in the commercial sphere, and rapid response in deploying military systems may save lives in a geopolitical environment characterized by rapidly emerging and ever-changing physical threats. Agile/lean development methodologies show promise in providing the desired schedule acceleration, but it can be difficult for planners to determine the effects of these factors on schedule duration, and to make appropriate choices to optimize project performance. The Constructive Rapid Application Development Model (CORADMO) attempts to quantify the effects of key schedule drivers, and thus enable planners to estimate the relative schedule that will result from varying these parameters.
Proceedings of the 2013 International Conference on Software and System Process - ICSSP 2013, 2013
Accelerating development schedules is increasingly important in a competitive world. Reduced time... more Accelerating development schedules is increasingly important in a competitive world. Reduced time-to-market is a key response to competitive threats in the commercial sphere, and rapid response in deploying military systems may save lives in a geopolitical environment characterized by rapidly emerging and everchanging physical threats. Agile/lean development methodologies show promise in providing the desired schedule acceleration, but it can be difficult for planners to determine the effects of these factors on schedule duration, and to make appropriate choices to optimize project performance. The Constructive Rapid Application Development Model (CORADMO) attempts to quantify the effects of key schedule drivers, and thus enable planners to estimate the relative schedule that will result from varying these parameters.
is furnished on an "as-is" basis. Stevens Institute of Technology makes no warranties of any kind... more is furnished on an "as-is" basis. Stevens Institute of Technology makes no warranties of any kind, either expressed or implied, as to any matter including, but not limited to, warranty of fitness for purpose or merchantability, exclusivity, or results obtained from use of the material. Stevens Institute of Technology does not make any warranty of any kind with respect to freedom from patent, trademark, or copyright infringement. This material has been approved for public release and unlimited distribution.
This research project evaluates the use of on-demand (pull or kanban) scheduling approaches in sy... more This research project evaluates the use of on-demand (pull or kanban) scheduling approaches in systems engineering (SE). Such approaches have been seen to be valuable in software system development. In particular, the research focuses on SE where rapid response software development projects incrementally evolve capabilities of existing systems and/or systems of systems. Phase I considered the problem and possible applications of alternative scheduling methods and suggested possible outcomes of on-demand scheduling coupled with a service-oriented approach to SE. It defined a conceptual model and developed initial simulations to capture the model and better understand the impact. Phase II focuses on applying the method to multi-level service-based SE in complex systems of systems. Using the models and simulations from Phase I, Phase II defines a prototype network of kanban-based scheduling systems (KSS) for a target environment based on a large multi-facility hospital system. The definition is simulated to demonstrate its behavior. Follow on work is planned to use the prototype in comparing performance with traditional SE methods. This will enable determination if SE functions are accomplished more effectively and efficiently, whether the overall value of the systems of systems over time is increased, and whether other expected results are fulfilled. 15. SUBJECT TERMS 16. SECURITY CLASSIFICATION OF: 17. LIMITATION OF ABSTRACT Same as Report (SAR) 18. NUMBER OF PAGES 82 19a. NAME OF RESPONSIBLE PERSON
Uploads
Papers by Dan Ingold