deskbot: talk to your robot arm
Talk to your robot arm.deskbot adds ears, eyes, and a brain to your LeRobot SO-101. Hold space, say "grab the marker". Local Whisper hears you, Claude works out what you meant and what's on the desk through your webcam, and your trained ACT policy does the rest. It talks back, too.What's inside Voice to action loop: hold-space push-to-talk, spoken replies, "stop" always halts Claude vision that names what's graspable on your desk, with positions Full offline mode: no API key, keyword parser plus color detection A complete 2D simulator arm, so everything works with zero hardware Companion mode: an animated expressive robot face that uses the same brain One config file, never edit code The complete lerobot workflow as documented scripts: ports, servo IDs, calibration, teleop, recording 50 demos, training ACT, eval Small, readable Python codebase you can modify freely Honest status (why this is early access)Voice, brain, vision, offline mode, and the simulator are tested end to end. The SO-101 hardware driver is written strictly against lerobot's documented CLI, the exact commands every SO-101 owner already runs, but it has not been validated on enough physical arms yet. That is the early-access deal: pay what you want, run it on your rig, send me the output. Fixes ship fast, your setup becomes a tested configuration, and your founder price is locked forever. If it fails on your arm and I can't fix it, full refund.Price goes to $29 at 1.0, once the driver is community-validated.RequirementsPython 3.12+ and uv, macOS or Linux. Anthropic API key for the full brain (offline mode needs none). SO-101 plus a trained policy for real-arm mode; note lerobot itself needs Linux or Apple Silicon. The sim runs anywhere.Safety: robot arms have no collision awareness. Keep the desk clear.
Get it → dgenovese.gumroad.com