Skip to content

Benchmark user quickstart

  1. Follow installation and run tower smoke in the evaluator environment.
  2. Set up Isaac and the asset download steps.
  3. Serve your policy over the XPolicyLab WebSocket protocol (Isaac runtime transport). Use one runtime process per policy server. The Isaac runtime uses atomic WebSocket inference and checks full-prediction evidence.
  4. Follow evaluate a policy to validate the request and launch.
  5. Keep the resolved configuration, scene and policy identities with results. Use offline scoring for saved recordings.

CPU smoke output is not a task success result. Weight downloads remain unavailable until the owner publishes them; you can supply your own compatible policy.