Inception Hackathon 2.0 · Track 01, Robotics & Simulation

The imagination, running live

Two results from the paper, executing in your browser rather than described on a page.

Figure A replays real SO-101 teleoperation footage the inverse-dynamics model has never seen, decoding five joint angles out of the pixels as it plays — this runs fully offline. Figure B connects to LingBot World 2 and renders three candidate actions from one real photograph under a fixed noise seed, so the action is the only variable; Claude rules on each imagined outcome and only a surviving action is executed. If nothing survives, the robot refuses out loud.

reactor lingbot-world-2 · claude haiku 4.5 · fish audio · lerobot svla_so101_pickplace · posenet 1.5M params

Figure B · imagination-gated action selection · interactive

The robot imagines three futures inside the world model — then decides, or declines.

1 imagine2 judge3 decideoffline

Ready

The world model renders three candidate actions on a real scene; Claude judges each imagined outcome; only a surviving action is executed.

world model feed

world model offline

Press Connect in the bar above.

PICK UP

future pick up

PUSH

future push

LEAVE

future leave

Figure B. One real photograph is expanded into three candidate futures under a fixed noise seed, so the action is the only variable between them. Claude rules on each imagined transition; the best surviving branch executes, and if nothing survives the robot refuses out loud.