Aiming to the problem and illness in sentry duty of army, designed the management system of sentry duty based on human face recognition technology. Establish the frame chart of sentry duty system by analyzing the system demand and flow. Introduce the function module about human face recognition, handing post over, checking in extra personnel and vehicle, checking on sentry, calling sentry, patrolling and statistical report of the system, and then give out the method of system realization. The result shows this technique can solve the problem of recognizing identity of the person who is on duty and checking on work attendance, it also plays an active role in promoting army information construction.