This study presents a robust face tracking method based on active stereo camera system. This system is a stereo vision system that can hold its gaze point on the face of the visual target during tracking it. When the system fixes its gaze point on the face exactly, the face can be discriminated from the background by binocular disparity. To keep the gaze point of the system on the face of a moving person, a binocular motor control model based on human binocular neural pathways is proposed. This face tracking method based on active stereo camera system can detect the face being tracked in complex scene, even though the face has changed its appearance according to the rotation of itself. The system can be applied for surveillance applications even under complex scene conditions.