Projects
Research, robots, and a few browser experiments. Ordered by how much of my attention they currently have.
01
Robust vision-language-action models
FinishedBachelor thesis: can reinforcement learning improve a VLA policy after fine-tuning?
PyTorchMuJoCoLIBERO
PyTorchMuJoCo
02 Spot Micro · Leika
Active ★ 79A quadruped on an ESP32-CAM, with a learned policy correcting the hand-written gait.
Reinforcement learningMuJoCoC++
Reinforcement learningMuJoCo
03 Hexapod
Active ★ 6A locomotion policy trained in simulation, running on the microcontroller itself.
Reinforcement learningMuJoCoPyTorch
Reinforcement learningMuJoCo
04 Ferrofluid Visualizer
FinishedAn alien friend that dances to your music.
C++ESP32Electromagnets
C++ESP32
05 Bunny OS
Finished ★ 2A desktop operating system UX living inside a browser tab.
SvelteTypeScript
SvelteTypeScript
06 Neural Visualizer
Finished3D interactive visualization of neural network architectures.
SvelteThree.jsTensorFlow.js
SvelteThree.js
07 Tetris AI
Finished ★ 1The battle of the Tetris AIs — deep Q-network against a genetic algorithm.
PythonPyTorchGenetic algorithms
PythonPyTorch
08 Flappy Bird, but everything is a browser window
FinishedThe bird is a window. So are the pipes.
JavaScriptWindow Management API
JavaScriptWindow Management API