NodCursor Capstone
A Research Through Design capstone for a browser-based, privacy-first head-tracking cursor controller that maps head motion and facial gestures to mouse events using MediaPipe.
NodCursor Capstone
A Research Through Design capstone for a browser-based, privacy-first head-tracking cursor controller that maps head motion and facial gestures to mouse events using MediaPipe. Seamlessly integrated across site-wide accessibility features and gamified learning experiences at Open Coding Society.
NodCursor Core Engine
Head tracking, gesture detection, and real-time processing
- ✓ Browser-native head tracking via MediaPipe FaceLandmarker
- ✓ Facial gestures mapped to click, scroll, and drag events
- ✓ Web Worker pipeline for real-time smoothing with minimal latency
- ✓ Exponential smoothing with deadzone and acceleration curve
- ✓ Blink, double-blink, and long-blink gesture detection
About
The NodCursor engine is a lightweight, privacy-first head-tracking system powered by MediaPipe Tasks Vision. It runs entirely in the browser, analyzing facial landmarks to derive cursor position and gesture signals without any server communication. A Web Worker pipeline handles exponential smoothing and acceleration off the main thread, keeping the UI responsive even under heavy gesture load.
Impact
- Fully browser-native, no app or plugin required
- Privacy-first: all inference runs on-device
- Accessible cursor control for motor-impaired users
- Smooth, responsive tracking across varied lighting
Site-Wide Accessibility & Preferences
Calibration, theme customization, TTS, and translation
- ✓ Calibration system mapping head range to viewport coordinates
- ✓ Global site preferences engine (theme, font, language, voice)
- ✓ Text-to-Speech (TTS) integration with voice selection & pitch control
- ✓ Google Translate integration with cookie persistence
- ✓ Tailwind override stylesheet for theme persistence
- ✓ localStorage persistence across browser sessions
About
NodCursor is integrated into the site-wide accessibility framework. Users calibrate their head motion range once, then enjoy persistent preferences across all pages. The preferences engine manages theme customization (colors, fonts, sizes), text-to-speech settings (voice, rate, pitch), and multi-language support via Google Translate. All settings sync to localStorage and can be saved server-side when logged in.
Impact
- Consistent accessibility experience across the entire platform
- User preferences persist across sessions
- Multi-language learners supported with translation
- Text-to-speech enables auditory learners
- Theme customization improves readability for all users
Gamification: Empathy Epic
Five learning stations exploring collaborative software development
- ✓ Five interactive learning stations (Active Listener, Perspective Taker, Supportive Collaborator, Respectful Communicator, Inclusive Thinker)
- ✓ Each station presents a real-world scenario and a quiz with correct + distractor answers
- ✓ Stations use color-coded markers (blue → green on completion, red on failure)
- ✓ Dialogue system with NPC interactions at each station
- ✓ Head tracking enables station navigation via cursor control
About
Empathy Epic is a gamified learning experience that teaches collaborative software development through five interactive stations. Players navigate a digital world using head tracking, approaching each station to engage with scenario-based quizzes. The game emphasizes soft skills like active listening, perspective-taking, and inclusive thinking; essential for professional teamwork. Each quiz shuffles answers and uses visual feedback (color changes) to reinforce learning.
Impact
- Teaches empathy & collaboration through play
- Head tracking makes navigation accessible & engaging
- Scenario-based learning improves retention
- Visual feedback reinforces correct answers
- Bridges accessibility and soft skills development
Gamification: Nod Maze Game
Multi-level head-tracking maze challenge
- ✓ Three progressive difficulty levels with increasingly complex wall patterns
- ✓ Player controls a cyan circle via head tracking (head position → cursor → player movement)
- ✓ Collision detection against static walls
- ✓ Exit zone activation on reaching the goal
- ✓ Lives system (5 lives per run) with game-over and win states
- ✓ HUD displays level, lives remaining, and elapsed time
About
Nod Maze is a head-tracking game that challenges players to navigate a circular avatar through increasingly complex mazes without hitting walls. Movement is driven entirely by head position via the NodCursor system, making it both an engaging game and a practical motor-control exercise. The three-level progression teaches fine motor control, spatial reasoning, and persistence while providing immediate tactile feedback for head tracking calibration.
Impact
- Provides real-time feedback on head tracking accuracy
- Builds muscle memory for head-based cursor control
- Engages motor-impaired learners in physical challenges
- Three-level progression supports mastery learning
- Accessible alternative to mouse-based games