A flexible rule-based framework for pilot performance analysis in air combat simulation systems

Air combat simulation systems (ACSSs) are developed to train fighter pilots (trainees) in a virtual combat environment. In general, an ACSS consists of the following stages: planning the scenario, training, flight analysis, and performance evaluation. In this paper, the details of the framework, which is developed to analyze and evaluate the performance of the trainees, is introduced. First, the evaluation criteria for the pilot performance are defined. Next, a dynamic pilot performance evaluation system is developed that can be controlled and modified by experienced instructor pilots (instructors/trainers) to define the performance criteria details using predefined evaluation parameters. The evaluation of the trainees is conducted at the end of the flight and then a report related to the trainees' performance is generated. Eleven of the performance criteria are within the scope of this paper; however, the proposed system provides an extensible infrastructure to define new criteria and parameters.

Anahtar Kelimeler:

Air combat, performance evaluation, performance criteria

A flexible rule-based framework for pilot performance analysis in air combat simulation systems

Keywords:

Air combat, performance evaluation, performance criteria,

PDF

___

G. Serfoss, “Improving target orientation discrimination performance in air-to-air flight simulation”, PhD Thesis, Arizona State University, 2003.
L. Moody, “F-16-aircrew evaluation criteria, air force instruction 11-2F-16”, Technical Report, United States of America Air Force, 1998.
B.T. Schreiber, W.A. Stock, W. Bennett, “Distributed mission operations within-simulator training effectiveness baseline study: metric development and objectively quantifying the degree of learning”, Technical Report, Lumir Research Institute, 2006.
A.M. Portrey, B. Schreiber, W. Bennett, “The pairwise escape-G metric: a measure for air combat maneuvering performance”, Winter Simulation Conference, pp. 1101–1108, 2005.
R.A. Oberle, “An air combat maneuver conversion model”, Technical Report (CRC 274), Office of Naval Research, 19 J. McGuinness, J.M. Forbes, J.E. Rhoads, “Air combat maneuvering performance measurement system design”, Technical Report (AFHRL-TP-83-56), Williams Air Force Base, Armstrong Laboratory, 1984.
F.H. Brecke, D.C. Miller, “Aircrew performance measurement in the air combat maneuvering domain: a critical review of the literature”, Technical Report (AL-TR-1991-0042), Williams Air Force Base, Armstrong Laboratory, 19
B.T. Schreiber, W.J. Bennett, “Distributed mission operations within-simulator training effectiveness baseline study”, Technical Report AFRL-HE-AZ-TR-2006-0015, Air Force Research Laboratory, 2006.
D. Creanshaw (F-16 Pilot), Air Combat - How to Live and Die in Virtual Sky, CombatSim Com Inc., 1998.
Hasbro Interactive and MicroProse, Falcon 4.0 Flight Simulation Manual, 1998.
E.H. Wood, E.H. Lambert, C.F. Code, “The hydro- and resulting bio-dynamics of + Gz induced losses of consciousness and its history”, Proceedings of the IEEE National Aerospace and Electronics Conference, pp. 18–22, 19 T.G. Sullivan, D.L. Peterson, J.W. Gorman, J.M. McBroom, V.E. Renuart, “Multi-command handbook 11-F16, flying operations: F-16 combat aircraft fundamentals”, Technical Report, United States Air Forces in Europe, 1996. M. Ardema, M. Heymann, N. Rajan, “Analysis of a combat problem: the turret game”, Journal of Optimization Theory and Applications, Vol. 54, pp. 23–42, 1987.
R. Shaw, Fighter Combat: Tactics and Maneuvering, Maryland, Naval Institute Press, 1985.
B.T. Schreiber, W.A. Stock, B. Winston, “Distributed mission operations within-simulator training effectiveness baseline study: metric development and objectively quantifying the degree of learning”, Technical Report AFRLHE-AZ-TR-2006-0015-Vol II, Air Force Research Laboratory Human Effectiveness Directorate War fighter Training Research Division, 2006.
E.G. Gilbert, C.P. Foo, “Computing the distance between general convex objects in three-dimensional space”, IEEE Transactions on Robotics and Automation, Vol. 6, pp. 53–61, 1990. http://www.ogre3d.org/tikiwiki/2D + line + intersection&structure = Cookbook, 2008.
S.T. Breidenbach, A.P. Clavarelli, R. Sievers, “Measurement methods and metrics for aircrew assessment during close-in air-to-air combat”, Technical Report N00019-81-C-0098, Naval Training Systems Center, Final Report, 200
M.D. Hutson, “Visual lookout with advanced avionics”, Technical Report, Air Force Safety Center, Shaw Air Force Base, 2007.
M. Jacques, “An extensible math expression parser with plug-ins”, www.codeproject.com/KB/recipes/MathieuMathParser.aspx, 20 Y. Shub, A. Kushnir, J. Frenkel, “Pilot evaluation system”, Aerospace and Electronics Conference, Vol. 2, pp. 734–741, 1994.
J. Stillion, “The impact of peace operations deployments on USAF fighter crew combat skills”, Technical Report, RAND Corporation, pp. 80–94, 1999.