Skip to content

Beta release of the hmd-eyes integration remake v1.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@fx-lange fx-lange released this 16 May 14:33

We are pleased to announce the beta release of hmd-eyes v1.0!!

hmd-eyes v1.0 is a going to be a complete overhaul of the current hmd-eyes plugin, with a cleaner and more flexible architecture. We are dropping support for the 2d approach and focus entirely on 3d gaze tracking. Starting with a new gaze demo scene and more robust gaze visualization.

Please refer to the release/beta branch for checking the readme and documentation.

We also created a dedicated channel #hmd-eyes-alpha on our discord server to gather your feedback and post about updates.

Dependencies

  • Unity 2018.3+
  • ProjectSettings/Player/Configuration/Scripting Runtime Verion set to .NET 4.x Equivalent.
  • Due to an issue with MessagePack, the default project setting for ProjectSettings/Player/Configuration/API Compatibility Level is not supported and needs to be set to .NET 4.x

Changelog

v1.0-beta

  • time sync: timestamps are now based on the Pupil Capture/Service clock and synchronized on connection
    • RequestController offers conversion methods between Unity and Pupil timestamps
    • GazeListener/GazeData also support both timestamps (as will other Listeners in the future)
    • switching all timestamps from float to double
  • sub and pub port now accessibly via the RequestController
  • based events on System.Action instead of custom delegates
  • new frame visualizer prefab using a dedicated material to avoid missing shaders
  • documentation updated including references to pupil-docs

v1.0-alpha-2

  • improved and refactored GazeData
    • renamed GazeData.Mode to GazeData.MappingContext
    • added GazeData.GazeDirection and GazeData.GazeDistance
    • deprecated the data field GazeData.GazePoint3d in favor of the equivalent representation of the 3d gaze point as GazeData.GazeDirection and GazeData.GazeDistance (more details)
    • resulting in a simplified GazeVisualizer
    • added detailed inline comments for GazeData
  • added RecordingController to support controlling Pupil Capture recordings
  • ability to change IP&Port by code
  • new demos showcasing:
    • scene management
    • controlling recordings
    • visualizing individual gaze vectors as rays
  • important bugfix for time synchronization with Pupil Software
  • fixed application freeze on quit while trying to connect
  • updated documentation and clearer dependencies

v1.0-alpha-1

  • complete overhaul of the hmd-eyes plugin
    • clean and flexible architecture with three layers (connection, communication, utility components)
    • simplified settings and flexible calibration targets
    • instead of hidden objects due to on start initialization, everything can be pre-setup in the scene
  • focused on 3d gaze tracking (no further support for the 2d approach)
    • much more stable gaze visualization
  • updated dependencies
  • supporting latest Unity 2018.3 and .NET 4.x

Current Limitations

  • no support for screen capture recording
  • no heatmap or spherical video demo
  • no hololens support