{"$schema":"https://ejfox.com/schema/page-twin@1.json","kind":"blog_post","url":"https://ejfox.com/blog/projects/creative-interfaces","json_url":"https://ejfox.com/blog/projects/creative-interfaces.json","generator":"ejfox.com/json-twin@1","data":{"cacheVersion":"2026-05-13-gear-cards","html":"

These are my attempts to make computers that respond to the way humans actually move and gesture—exploring the design space between human intuition and machine capability. Each project pushes beyond traditional HCI constraints to find new interaction models. Some of these work better than others, but they all represent steps toward interfaces that feel more like extensions of thought than barriers to it.

\n
\n\"Playing\n
Playing Super Mario Bros. through the hand-tracking MIDI controller
\n
\n
\n\"Turning\n
Turning a backyard crow's movements into music
\n
\n

Projects

\n
    \n
  1. hand-midi-controller: Professional hand tracking MIDI controller with TouchDesigner integration. Converts hand movements to MIDI with detailed performance timing breakdowns and memory analysis for creative interface exploration.
    2. \n
  2. handtrack-websockets: Real-time gesture streaming pushing the boundaries of browser-based interaction.
    3. \n
  3. flipper-generative-art: Real-time generative art and animated patterns for Flipper Zero with 10 gradient types, Floyd-Steinberg dithering, and smooth 30 FPS animations. Finding art within the constraints of 64KB RAM.
    4. \n
  4. ps5-tmux is a little tool to make it easier to vibe-code; just move between panes with your PS5 controller and accept changes with the X button, or hit the middle button to enter dictation mode.
    5. \n
","title":"Hand-Tracking & Generative Art","metadata":{"title":"Hand-Tracking & Generative Art","date":"2024-07-01T04:00:00.000Z","modified":"2025-08-13T15:46:54.000Z","tech":["Computer Vision","MIDI","WebGL","Hand Tracking","Generative Art","Interactive Media"],"state":"deployed","aiInvolvement":"ai-assisted","tags":["creativity","interfaces"],"words":186,"images":2,"imageDetails":{"total":2,"cloudinary":2,"withDimensions":0},"links":6,"codeBlocks":0,"headers":{"h2":1},"toc":[{"text":"Projects","slug":"projects","level":"h2","children":[]}],"type":"post"}},"_links":{"self":"https://ejfox.com/blog/projects/creative-interfaces.json","html":"https://ejfox.com/blog/projects/creative-interfaces","index":"/blog.json"}}