FaceTrackNoIR
FaceTracking with just your webcam!
Donate
Manual  

Manual (up to ) v160:

Index:

Options-menu

Keyboard shortcuts

To influence the facetracker while 'in-game', shortkeys can be defined to:

  • Center view;
  • Stop/Start the tracker; From version 1.5 on the Start/stop shortkey has two extra options, which are active when the state is 'stop' :
    • View: When 'Zero' is checked, view will be reset to '0'. With 'Stay' selected, view will freeze in the current position.
    • Engine Tracker: With 'Stop Engine' checked, the tracker will stop face-tracking in 'stop'. This reduces CPU-load significantly. However, to 'start' again takes time. When 'Keep tracking' is checked the tracker-engine will not stop and 'start' will be much faster.
  • Disable a defined set of DOF-axis;
Preferences-dialog

Curve_settings

The user can define the curve, by which actual head-movement (vertical axis) is translated into in-game movement (horizontal axis). The curve can be changed by 'grabbing' a circular handle and dragging it (within the light-blue area). There are two tabs: one for rotations and one for translations.

The curves can be changed while the tracker is running.

Curves-dialog
Tracker-menu

Tracker

FaceTrackNoIR currently only supports one face-tracker (faceAPI from SeeingMachines). Since we are prepared for the future, this tracker is selected using the Tracker Source listbox. When faceAPI is running, some of it's details can be viewed using the Settings button.

 

FTNoIR Server (from version 1.5)

The FTNoIR server was introduced to make it possible to run FaceTrackNoIR on a different PC, so the CPU-load of the 'gaming-PC' can be reduced. To receive headpose-data from the 'face-tracking-PC', the FTNoIR Server must be selected as Tracker Source. When the tracker is not running, the port-number for the PC can be edited via the Settings Dialog.

Protocol-selection

Game protocol

The game-protocol can be selected with the Game-protocol checkbox. Check out the Compatible games section, if you don't know which protocol to use. Some protocols have their own settings. If so, the button will appear (with the protocol icon).

  • To use PPJoy, the PPJoy software must first be installed and a 'virtual joystick' must then be installed as well. More info can be found in the ClientFiles folder of FaceTrackNoIR. (remark: PPJoy was replaced by Vjoy in v170)
  • To use FSUIPC it is necessary to copy the file FSUIPC.dll to the Modules folder of Microsoft Flight Simulator. If the installation-path of FS2002 or FS2004 is non-standard, the actual path must be defined using the Settings dialog of the FSUIPC protocol.
  • To use FaceTrackNoIR with Combat Flight Simulator 3 (and others) the file TIRViews.dll must be placed in the installation folder of FaceTrackNoIR. This file can be downloaded from the NaturalPoint website (it's part of the TrackIR software). The checkbox 'use TIRViews' must also be ticked in the Settings of 'fake TrackIR'.

FTNoIR Client (from version 1.5)

The FTNoIR server was introduced to make it possible to run FaceTrackNoIR on a different PC, so the CPU-load of the 'gaming-PC' can be reduced. To send headpose-data to the 'gaming-PC', the FTNoIR Client must be selected as Protocol. When the tracker is not running, the IP-address and port-number for the remote PC can be edited via the Settings Dialog.

 

It is very likely that it is necessary to change Firewall settings in Windows to make LAN-communication possible for FaceTrackNoIR.

Camera Name

When the tracker is started, or on program startup, the name of the first usable video-input-device is shown by FaceTrackNoIR (Deskshare IP Camera Source in the example below). Unfortunately the non-commercial version of faceAPI (which is used, because it's free...) only uses the first camera it finds.

Smoothing-menu

Smoothing

To process the raw headpose-data, FaceTrackNoIR has two features: smoothing and EWMA-filtering. Both features are meant to stabilize the raw headpose-data and remove spikes and jitter.

The smoothing setting works for all 6 DOF's at once. It adds the values of the last x raw values and divides them by x, thus creating a 'moving average'. Try to keep this value low, because smoothing will logically lead to a slower response.

Filter-menu

Filtering

From version 1.5 on, FaceTrackNoIR has a new EWMA-filter. It was designed to respond quicker to movement and still provide a smooth image, when not moving.

The parameters:

  •  Min. (frames): influences the filters response to quick movements. The higher, the slower.
  •  Max. (frames): influences the filters response to slow movements. Again, the higher, slower.
  •  Curve (pow): influences the filters readiness to respond to changes in speed. Here, the higher the value, the faster it responds.

Invert axis

Finally, it is possible to invert an axis, by checking it's Invert checkbox. Some games interpret the -/+ directions different than faceAPI does...