Vizon
Give AI the scene—and the point of attention.
Vizon combines eye tracking with an outward-facing camera so an AI agent can interpret what the wearer is asking about. Gaze supplies the point of focus; the scene camera supplies the surrounding context.
Early glasses and compute prototype · the portable SpacemiT design is a subsequent direction
01 / The interaction
What changes when an agent knows where you look?
The wearer looks at an object and asks about it. A calibrated eye-tracking model maps the visual focus into the outward-facing camera view, helping the agent resolve which part of the scene matters.
Custom eye-facing and scene-facing cameras provide distinct inputs.
02 / Research & engineering
What went into it.
Data & annotation
Eye samples were collected and pupils annotated to develop the custom tracking approach.
Model development
The team trained an eye-tracking model and reduced its size for edge processing.
Wearer calibration
A calibration step adapts the gaze mapping to the person using the glasses.
Interaction studies
Earlier explorations paired gaze with EEG-based target confirmation. Related neural-interface work develops this as a complementary input alongside voice and visual focus.
Optics & cameras
The prototype combines birdbath display optics, an eye-facing GC0308 camera and an outward-facing camera.
Portable computing
A separate SpacemiT computing puck is the intended local-model host. Working Qwen voice chat on SpacemiT provides a supporting foundation.
03 / Progress
Built. Tested. Next.
Custom eye-tracking model
Sample collection, pupil annotation, training and model reduction establish the tracking foundation.
Computer-connected prototype
The glasses, eye tracking and calibration have been tested with a computer.
Local voice foundation
Qwen voice chat is working on SpacemiT as separate infrastructure.
Portable integration
Bring eye tracking and the agent onto the carryable computing puck.
The computer-tested glasses and the intended portable system are different stages. Local voice chat is a supporting capability; full portable Vizon integration remains planned.
Continue exploring