Version your scenes. Replay your evaluations.

Keep a versioned record of the physical setup. Change one condition, compare the result and return to the same test when a new checkpoint is ready.

Place the cup in the trayScene history
Scene: baselineA top-down diagram of a cup left of a tray on a workbench.Work surfaceLighting: baselineTrayDistractor

What changed

The starting arrangement. The cup sits left of the tray, with its handle facing right.

What to learn

Establish the reference condition before changing one variable.

Viewing baseline

Keep the scene with the run.

A scene record connects the objects, target arrangement and station configuration to the task. Every episode can refer back to the condition it started from.

Review the intended setup alongside the observed state. Keep the policy version, recording and result attached so the experiment remains useful after the session ends.

Change one condition at a time.

Create a revision from a baseline scene. Move the target, turn it, introduce clutter, substitute an object or change the lighting setup. Preserve the original condition and name the difference.

Use those revisions to build a test suite that answers a specific question. Compare matched conditions across policies, then examine combinations when you want to test interactions.

See what changed and what happened.

Compare scene versions together with their episodes. Inspect the setup difference, policy checkpoint and outcome, then open the evidence behind the score.

A change in the rubric or station configuration belongs in that comparison too. The record gives the team a common reference when a result improves or regresses.

Restore the setup for another run.

Select a saved condition and re-project its placement guidance. The operator restores the objects, the station checks the scene, and the new episode joins the same evaluation history.

Use replay to investigate a failure, test a fix or compare a checkpoint against the cases your team wants to retain.

Build a regression suite from real failures.

Keep important scenes in a shared test library. Assign them to stations, organize runs and review results with the people responsible for the task.

A failure should become a reusable test case. Scene history makes it possible to find the setup, understand the previous result and run the question again.

See scene history in a demo or read the guide.

Bring Prism to your lab

Tell us about your robot, task and evaluation workflow.