In order to solve the problems of large error of human judgment in evaluation mode mainly based on video playback, lack of quantitative basis and difficult to realize statistical analysis of training data, design of flight training quality evaluation system for trainer pilots is studied. Based on analysis and interpretation of training subjects in flight training outline and taking flight parameters as core R & D resource, operational framework of flight training quality evaluation system for pilot of training aircraft is built. Flight training over-limit warning, flight data curve analysis, 3D flight trajectory playback, flight training diagnosis report, and evaluation of training effectiveness of specific functions are developed. The results show that a practical and effective assistant tool for pilot training effect test can be provided by the design.