The HeadTracker

Description

Head tracker via camera face tracking.

Built on top of the Google's MediaPipe face_mesh (python release).

How to use:

• Download and extract the files in HeadTracker.rar and run HeadTracker.exe located inside the folder.
  Optionally you may download the .exe file directly, but be aware the starting time is slightly higher for this more compact version.

• Connect to any plataform that accepts UDP/IP connection using IP:'127.0.0.1' and PORT:50050 .

Interpreting received data:

The HeadTracker application currently sends to the server only the yaw rotation (left--right motion), and the data are json encoded bytes (deppending on the application it needs to be decoded).

Example: reading data in Matlab:

% Open the HeadTracker application 
open('HeadTracker.exe')   

% Connect to the local server
udpr = dsp.UDPReceiver('RemoteIPAddress', '127.0.0.1',...
                       'LocalIPPort',50050); 

% Read data from the head tracker
while true   
    py_output = step(udpr);
    if ~isempty(py_output)
        yaw = str2double(native2unicode(py_output));
    end
end 
 

Another example of the head tracking connection to matlab is posted here.