Skip to content

FUTURE, blocked by #223: Combine eye tracking, EDA and EEG streams with flight data #238

Open

Description

@jmacd867

FUTURE WORK. DO NOT START. This is blocked until a good working real-time model exists (#223, which needs the batch model from #216, targets from #213 and the data from #228 and #229). Nothing here should be built, designed in detail or used to change the telemetry format before then. It exists only to record what the client said so it is not lost.

Blocked by: #223

Is your feature request related to a problem? Please describe.
The client wants flight data, physiological data and (eventually) demographics combined before clustering is automated. Today inference/ only knows the flight telemetry. The client records three physiological sensors in iMotions: eye tracking, electrodermal activity (EDA) and EEG. They are stored separately from the flight data and the demographics.

Describe the solution you'd like
Nothing to build yet. This issue records the future work and what blocks it, so the telemetry design does not rule it out.

  • Decide how streams recorded at different rates are aligned. As transcribed, the sample rates are: simulator about 90 Hz, EEG 256 Hz, EDA 128 Hz, eye tracking 51 Hz. These are unconfirmed, and the Prepar3D export we have is 1 Hz. iMotions synchronizes the timestamps; the client is not sure a common rate exists for clustering.
  • Decide the join key, probably the timestamp plus pilot_id and flight_id (Record pilot_id and flight_id in the logged CSV #211).
  • Keep physiological features out of the first clustering (flight data alone is the starting point, per the client), and decide later whether they form groups or only interpret them (compare ADR 0001 for pilot metadata).

Describe alternatives you've considered
Run the clustering on the iMotions computer (#223), where all streams are already synchronized, and read the physiological data from there.

Additional context
Open questions for the client:

Notes in docs/client_meeting_notes.md.

Activity

  1. added
    enhancementNew feature or request
    area:mlML / inference work
    needs-infoWaiting on reporter for more information
    on Oct 16, 2026
  2. changed the title [-]Combine eye tracking, EDA and EEG streams with flight data[/-] [+]FUTURE, blocked by #223: Combine eye tracking, EDA and EEG streams with flight data[/+] on Oct 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:mlML / inference workenhancementNew feature or requestneeds-infoWaiting on reporter for more information

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions