Rerun Locally

just task::run ai2thor-nav openclaw visual agents=2 steps=200 output_dir=output/openclaw/demo
Game: openclaw-demoScene: —Agents: 2Steps: 12Duration: 557.4sVLM cost: $0.000000End: staleScores: agent steps_executed: 12Provider: openclawModel: openclaw:agent-*Retries: 0Transient errors: 0Failed calls: 0

Provider Health

openclaw ended the run in a healthy state. Stop reason: none.

{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 12,
  "successful_calls": 12,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 36.476,
  "total_call_duration_seconds": 481.104,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}

Click any panel to zoom.

Step — / 11

Latest Agent Decisions

Agent 0Acting this step (step 0).

Chosen action: MoveAhead

Reasoning: Step 0, agent 0 of 2. FPV shows a living room with a sofa, TV, and chairs ahead. The map-v2 overhead shows the room layout with two agents (green triangles). I'm at position (-4.0, 0.9, 1.5) facing y=0 (roughly +Z direction). The room appears open ahead. I should explore forward to see more of the space and coordinate with the other agent. Moving ahead is the safest first action to gather more information about the environment.

Agent 1No decision recorded yet.

Chosen action: —

Reasoning: No reasoning recorded yet.

Metrics Timeline

62011visited_cells

VLM Reasoning Log

Step 0 — agent 0 — MoveAhead

Reasoning: Step 0, agent 0 of 2. FPV shows a living room with a sofa, TV, and chairs ahead. The map-v2 overhead shows the room layout with two agents (green triangles). I'm at position (-4.0, 0.9, 1.5) facing y=0 (roughly +Z direction). The room appears open ahead. I should explore forward to see more of the space and coordinate with the other agent. Moving ahead is the safest first action to gather more information about the environment.

Prompt state
{
  "game": "openclaw-demo",
  "step": 0,
  "remaining_steps": 200,
  "my_agent_id": 0,
  "current_agent": 0,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 1.5
  },
  "rotation": {
    "x": -0.0,
    "y": 0.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 1,
  "successful_calls": 1,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 39.307,
  "total_call_duration_seconds": 39.307,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 1 — agent 1 — MoveAhead

Reasoning: First step in the environment. FPV shows a living room with TV, chairs, coffee table, and couch. I'm positioned near the left wall. The map-v2 shows the room layout with obstacles (furniture) as dark areas. I can see there's open space ahead and to the right. The chase camera confirms the same room layout. Since this is step 1 and I need to explore, I should move forward to get a better view of the room and potentially find an objective or exit. MoveAhead is the most logical first action to begin exploration.

Prompt state
{
  "game": "openclaw-demo",
  "step": 1,
  "remaining_steps": 199,
  "my_agent_id": 1,
  "current_agent": 1,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.5
  },
  "rotation": {
    "x": -0.0,
    "y": 0.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 2,
  "successful_calls": 2,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 76.538,
  "total_call_duration_seconds": 115.845,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 2 — agent 0 — MoveAhead

Reasoning: From the FPV, I'm in a living room facing the back wall with a TV. The map-v2 overhead shows I'm near the left side of the room (green markers indicate agent positions). The chase camera confirms I'm looking toward the TV area. To explore more of the room and move toward the center/open area, I should move forward (MoveAhead) to get past the couch and gain better positioning in the room.

Prompt state
{
  "game": "openclaw-demo",
  "step": 2,
  "remaining_steps": 198,
  "my_agent_id": 0,
  "current_agent": 0,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 1.75
  },
  "rotation": {
    "x": -0.0,
    "y": 0.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 3,
  "successful_calls": 3,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 34.981,
  "total_call_duration_seconds": 150.826,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 3 — agent 1 — RotateRight

Reasoning: From the FPV image, I'm in a living room facing a TV with two chairs, a coffee table, and a couch visible. The map-v2 overhead shows my position (cyan arrow) on the left side of the room, facing upward (north). The chase camera confirms the same view from behind. I'm currently facing the back wall of the room. To explore and navigate the space, I should rotate to get a better sense of the room layout and potential exits. Since I'm facing the back wall, rotating right would let me see more of the room and potentially find doorways or other areas to explore.

Prompt state
{
  "game": "openclaw-demo",
  "step": 3,
  "remaining_steps": 197,
  "my_agent_id": 1,
  "current_agent": 1,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.75
  },
  "rotation": {
    "x": -0.0,
    "y": 0.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 4,
  "successful_calls": 4,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 40.202,
  "total_call_duration_seconds": 191.028,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 4 — agent 0 — MoveAhead

Reasoning: From the FPV view, I'm facing into a living room area with a TV, chairs, and a couch visible. The map-v2 overhead shows my position (green arrow) on the left side of the room, facing right/east toward the center of the space. The chase camera confirms I'm looking into the room. I need to explore the environment to navigate effectively. Since I'm facing into the room and there's open space ahead, moving forward would allow me to explore more of the environment and get a better view of the layout.

Prompt state
{
  "game": "openclaw-demo",
  "step": 4,
  "remaining_steps": 196,
  "my_agent_id": 0,
  "current_agent": 0,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.0
  },
  "rotation": {
    "x": -0.0,
    "y": 0.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 5,
  "successful_calls": 5,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 37.009,
  "total_call_duration_seconds": 228.037,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 5 — agent 1 — MoveAhead

Reasoning: From the FPV image, I can see a living room/dining area with a couch, dining table, chairs, and a lamp. The map-v2 shows I'm in a large room with furniture obstacles. The chase camera confirms the same room layout. I appear to be facing toward the back of the room with windows/doors. I should explore the room by moving forward to see more of the environment and potentially find an exit or objective.

Prompt state
{
  "game": "openclaw-demo",
  "step": 5,
  "remaining_steps": 195,
  "my_agent_id": 1,
  "current_agent": 1,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.75
  },
  "rotation": {
    "x": -0.0,
    "y": 90.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 6,
  "successful_calls": 6,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 42.001,
  "total_call_duration_seconds": 270.038,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 6 — agent 0 — MoveAhead

Reasoning: From the FPV view, I'm facing a living room with a TV, chairs, and couch. The map-v2 overhead shows I'm in a narrow vertical corridor on the left side of the map, with the green arrow pointing upward (north). The dark rectangles are furniture/obstacles. I need to explore the room. Looking at the map, there's open space to my right (east) and ahead. The chase camera confirms I'm near a wall. I should move forward to get into the open area of the room and continue exploring.

Prompt state
{
  "game": "openclaw-demo",
  "step": 6,
  "remaining_steps": 194,
  "my_agent_id": 0,
  "current_agent": 0,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.25
  },
  "rotation": {
    "x": -0.0,
    "y": 0.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 7,
  "successful_calls": 7,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 32.695,
  "total_call_duration_seconds": 302.733,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 7 — agent 1 — MoveAhead

Reasoning: From the FPV view, I'm facing the back of the room with the sofa in front of me. The map-v2 overhead shows I'm at position (-4.0, 2.75) facing east (90°), with a green arrow pointing forward. The chase camera confirms this orientation. I need to explore the room to find the goal. Looking at the map, there appears to be an opening or doorway to the right side of the room. I should move forward to explore more of the space.

Prompt state
{
  "game": "openclaw-demo",
  "step": 7,
  "remaining_steps": 193,
  "my_agent_id": 1,
  "current_agent": 1,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.75
  },
  "rotation": {
    "x": -0.0,
    "y": 90.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 8,
  "successful_calls": 8,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 34.76,
  "total_call_duration_seconds": 337.493,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 8 — agent 0 — MoveAhead

Reasoning: From the FPV and chase camera, I'm in a living room with a sofa, TV, and chairs visible. The map-v2 shows I'm in the upper-left area of the room (green marker), facing downward (arrow pointing down). The room layout shows a large central obstacle (likely the sofa/TV area) and an oval-shaped obstacle below me. I need to explore the room to find the goal. Currently facing south/down on the map. I should move ahead to explore more of the room and see what's around the central furniture area.

Prompt state
{
  "game": "openclaw-demo",
  "step": 8,
  "remaining_steps": 192,
  "my_agent_id": 0,
  "current_agent": 0,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.25
  },
  "rotation": {
    "x": -0.0,
    "y": 0.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 9,
  "successful_calls": 9,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 36.995,
  "total_call_duration_seconds": 374.488,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 9 — agent 1 — MoveRight

Reasoning: From the FPV view, I'm in a living room facing what appears to be a back wall with windows/doors. The chase camera shows the full room layout - I'm near the left side of the room. The map-v2 overhead shows my position (green arrow) on the left side of the room, facing right (east, based on y=90 rotation). The room appears to be a rectangular living/dining space. I've been rotating and moving around this area. To explore more of the space, I should move forward toward the back of the room where the windows/doors are, or move to explore the right side of the room. Since I'm facing the back wall with windows, moving ahead would take me toward that wall. Let me try moving right to explore more of the room's width.

Prompt state
{
  "game": "openclaw-demo",
  "step": 9,
  "remaining_steps": 191,
  "my_agent_id": 1,
  "current_agent": 1,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.75
  },
  "rotation": {
    "x": -0.0,
    "y": 90.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 10,
  "successful_calls": 10,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 36.02,
  "total_call_duration_seconds": 410.508,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 10 — agent 0 — MoveAhead

Reasoning: From the FPV and chase camera, I'm facing a living room with a TV, chairs, and a couch. The map-v2 overhead shows I'm near the left side of the room (green arrow pointing up/north). I appear to be in an open area with space to move forward into the room. To explore the environment, I should move ahead to get deeper into the room and see more of the space.

Prompt state
{
  "game": "openclaw-demo",
  "step": 10,
  "remaining_steps": 190,
  "my_agent_id": 0,
  "current_agent": 0,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.25
  },
  "rotation": {
    "x": -0.0,
    "y": 0.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 11,
  "successful_calls": 11,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 34.12,
  "total_call_duration_seconds": 444.628,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}
Step 11 — agent 1 — MoveAhead

Reasoning: From the FPV view, I'm in a living room facing a sofa and a lit table lamp in the corner. The map-v2 overhead shows I'm near the left side of the room (green triangle), with a clear path ahead. The chase camera confirms the same scene. The goal in this environment is typically to reach the lamp/light source. I'm currently facing roughly toward the lamp. Moving ahead should bring me closer to the target area.

Prompt state
{
  "game": "openclaw-demo",
  "step": 11,
  "remaining_steps": 189,
  "my_agent_id": 1,
  "current_agent": 1,
  "agent_count": 2,
  "position": {
    "x": -4.0,
    "y": 0.9026566743850708,
    "z": 2.75
  },
  "rotation": {
    "x": -0.0,
    "y": 90.0,
    "z": 0.0
  },
  "views": "map-v2+chase",
  "image_labels": [
    "fpv",
    "map_v2",
    "chase"
  ],
  "available_actions": [
    "MoveAhead",
    "MoveBack",
    "MoveLeft",
    "MoveRight",
    "RotateLeft",
    "RotateRight",
    "LookUp",
    "LookDown",
    "Teleport",
    "Done"
  ]
}
Provider status
{
  "provider_name": "openclaw",
  "model": "openclaw:agent-*",
  "healthy": true,
  "total_calls": 12,
  "successful_calls": 12,
  "failed_calls": 0,
  "retry_events": 0,
  "calls_with_retries": 0,
  "transient_errors": 0,
  "consecutive_failures": 0,
  "last_error": "",
  "last_error_kind": "",
  "last_call_duration_seconds": 36.476,
  "total_call_duration_seconds": 481.104,
  "total_retry_delay_seconds": 0.0,
  "max_transient_errors": null,
  "max_calls_with_retries": null,
  "max_consecutive_failures": null,
  "stop_reason": null
}