Skip to content

Releases: davircarvalho/Auralization_Engine

The HeadTracker

28 Apr 13:16
@davircarvalho davircarvalho
1.08.07
4b80e04
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
The HeadTracker Pre-release
Pre-release

Description

Head tracker via camera face tracking.

Built on top of Google's MediaPipe face_mesh (python release).

How to use:

  • Download and extract the files in HeadTracker.rar and run HeadTracker.exe located inside the folder.
    Optionally you may download the .exe file directly, but be aware the starting time is slightly higher for this more compact version.

  • Connect to any plataform that accepts UDP/IP connection using IP:'127.0.0.1' and PORT:50050 .

  • The Auralization app below is already embedded with the head tracker application, not requiring any other files.

Interpreting received data:

The head tracker application currently sends to the server yaw, pitch, and roll information in degrees. The data are JSON encoded bytes (depending on the application it needs to be decoded).

Example: reading data in Matlab:

% Open the HeadTracker application 
open('HeadTracker.exe')   

% Connect to the local server
udpr = dsp.UDPReceiver('RemoteIPAddress', '127.0.0.1',...
                       'LocalIPPort',50050); 

% Read data from the head tracker
while true   
    py_output = step(udpr);
    if ~isempty(py_output)
        data = str2double(split(convertCharsToStrings(char(py_output)), ','));
        disp([' yaw:', num2str(data(1)),...
             ' pitch:', num2str(data(2)),...
             ' roll:', num2str(data(3))])
    end
end

Another example of the head tracking connection to Matlab is posted here.

Assets 3
Loading

The HeadTracker

24 Apr 02:36
@davircarvalho davircarvalho
1.04.23
e2e5881
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
The HeadTracker Pre-release
Pre-release

Description

Head tracker via camera face tracking.

Built on top of the Google's MediaPipe face_mesh (python release).

How to use:

  • Download and extract the files in HeadTracker.rar and run HeadTracker.exe located inside the folder.
    Optionally you may download the .exe file directly, but be aware the starting time is slightly higher for this more compact version.

  • Connect to any plataform that accepts UDP/IP connection using IP:'127.0.0.1' and PORT:50050 .

Interpreting received data:

The HeadTracker application currently sends to the server only the yaw rotation (left--right motion), and the data are json encoded bytes (deppending on the application it needs to be decoded).

Example: reading data in Matlab:

% Open the HeadTracker application 
open('HeadTracker.exe')   

% Connect to the local server
udpr = dsp.UDPReceiver('RemoteIPAddress', '127.0.0.1',...
                       'LocalIPPort',50050); 

% Read data from the head tracker
while true   
    py_output = step(udpr);
    if ~isempty(py_output)
        yaw = str2double(native2unicode(py_output));
    end
end

Another example of the head tracking connection to matlab is posted here.

Assets 4
Loading