DoDAF limitations and enhancements for the Capability Test Methodology

ABSTRACT

The Joint Test and Evaluation Methodology (JTEM) joint test & evaluation (JT&E) program is currently developing an enterprise-level Capability Test Methodology (CTM) to deliver high quality joint capability assessments and evaluations across the acquisition life cycle. A key component of the JTEM program approach is the incorporation and refinement of CTM-related Department of Defense Architecture Framework (DoDAF) data models and representations to best support system of systems test evaluation at a joint mission level. To further mature the CTM before applying it to actual test event planning in 2007, the JTEM team has conducted a series of "rock drills", or rehearsals, of each process within the overall methodology during 2006. One of the major process anomaly reports (PARs) coming from these rock drills highlights the need for joint mission system of systems (SoS)-level DoDAF products for test plan development. In order to enhance DoDAF's ability to support capability assessments supporting joint missions, JTEM is developing executable product recommendations and extensions for DoDAF 1.5, as well as a capability evaluation metamodel (CEM) to provide DoDAF schema enhancements. These enhanced DoDAF products will better support the CTM's evaluation approach incorporating measurement at system of systems, task, and mission performance levels.

REFERENCES

• 1: Department of Defense. 2006. "DOD Architecture Framework, Version 1.5 Volume II: Product Descriptions (Final Draft)." Washington, D.C. 16 September.
• 2: DelPorto Lee, L., and Wilczynski, B. 2006. "DoDAF 1.5 Volume 2 Comment Review Slides, DoDAF Working Group Meeting." Alexandria, VA., 6 November.
• 3: Ontology. Dictionary.com. The Free On-line Dictionary of Computing. Denis Howe. http://dictionary.reference.com/browse/ontology (accessed: December 15, 2006).
• 4: Department of Defense. 2005. "Joint Capabilities Integration and Development System. Chairman of the Joint Chiefs of Staff Instruction, CJCSI 3170.01E." Washington, DC, 15 May.

INDEX TERMS

Keywords:
DoDAF, JTEM, capability evaluation metamodel, capability test methodology, test and evaluation