Evaluator 5128

488

success

yes

2021-04-12 18:49:19+00:00

2021-04-12 18:58:36+00:00

0:09:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

agent_compute-ego0_max	0.011854200425153175
agent_compute-ego0_mean	0.011854200425153175
agent_compute-ego0_median	0.011854200425153175
agent_compute-ego0_min	0.011854200425153175
complete-iteration_max	0.298171969173014
complete-iteration_mean	0.298171969173014
complete-iteration_median	0.298171969173014
complete-iteration_min	0.298171969173014
deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
driven_any_max	4.45712911354354
driven_any_mean	4.45712911354354
driven_any_median	4.45712911354354
driven_any_min	4.45712911354354
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	0.12477523844007037
get_duckie_state_mean	0.12477523844007037
get_duckie_state_median	0.12477523844007037
get_duckie_state_min	0.12477523844007037
get_robot_state_max	0.003838238452651002
get_robot_state_mean	0.003838238452651002
get_robot_state_median	0.003838238452651002
get_robot_state_min	0.003838238452651002
get_state_dump_max	0.02476328217453714
get_state_dump_mean	0.02476328217453714
get_state_dump_median	0.02476328217453714
get_state_dump_min	0.02476328217453714
get_ui_image_max	0.03730758969729538
get_ui_image_mean	0.03730758969729538
get_ui_image_median	0.03730758969729538
get_ui_image_min	0.03730758969729538
in-drivable-lane_max	46.09999999999952
in-drivable-lane_mean	46.09999999999952
in-drivable-lane_median	46.09999999999952
in-drivable-lane_min	46.09999999999952
per-episodes	details {"d60-ego0": {"driven_any": 4.45712911354354, "get_ui_image": 0.03730758969729538, "step_physics": 0.0748627012754959, "survival_time": 46.09999999999952, "driven_lanedir": 0.0, "get_state_dump": 0.02476328217453714, "get_robot_state": 0.003838238452651002, "sim_render-ego0": 0.003712170043978376, "get_duckie_state": 0.12477523844007037, "in-drivable-lane": 46.09999999999952, "deviation-heading": 0.0, "agent_compute-ego0": 0.011854200425153175, "complete-iteration": 0.298171969173014, "set_robot_commands": 0.00223587393631527, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.012764535513368484, "sim_compute_performance-ego0": 0.0019634126454494884}}
set_robot_commands_max	0.00223587393631527
set_robot_commands_mean	0.00223587393631527
set_robot_commands_median	0.00223587393631527
set_robot_commands_min	0.00223587393631527
sim_compute_performance-ego0_max	0.0019634126454494884
sim_compute_performance-ego0_mean	0.0019634126454494884
sim_compute_performance-ego0_median	0.0019634126454494884
sim_compute_performance-ego0_min	0.0019634126454494884
sim_compute_sim_state_max	0.012764535513368484
sim_compute_sim_state_mean	0.012764535513368484
sim_compute_sim_state_median	0.012764535513368484
sim_compute_sim_state_min	0.012764535513368484
sim_render-ego0_max	0.003712170043978376
sim_render-ego0_mean	0.003712170043978376
sim_render-ego0_median	0.003712170043978376
sim_render-ego0_min	0.003712170043978376
simulation-passed	1
step_physics_max	0.0748627012754959
step_physics_mean	0.0748627012754959
step_physics_median	0.0748627012754959
step_physics_min	0.0748627012754959
survival_time_max	46.09999999999952
survival_time_mean	46.09999999999952
survival_time_median	46.09999999999952
survival_time_min	46.09999999999952

No reset possible

66566

14148

Ashley Reid

exercises_braitenberg

489

success

yes

2021-04-12 10:41:12+00:00

2021-04-12 10:49:16+00:00

0:08:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

agent_compute-ego0_max	0.011566649797441986
agent_compute-ego0_mean	0.011566649797441986
agent_compute-ego0_median	0.011566649797441986
agent_compute-ego0_min	0.011566649797441986
complete-iteration_max	0.23644249719554644
complete-iteration_mean	0.23644249719554644
complete-iteration_median	0.23644249719554644
complete-iteration_min	0.23644249719554644
deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
driven_any_max	9.474043812552514
driven_any_mean	9.474043812552514
driven_any_median	9.474043812552514
driven_any_min	9.474043812552514
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	0.08126561319179994
get_duckie_state_mean	0.08126561319179994
get_duckie_state_median	0.08126561319179994
get_duckie_state_min	0.08126561319179994
get_robot_state_max	0.00369690401967045
get_robot_state_mean	0.00369690401967045
get_robot_state_median	0.00369690401967045
get_robot_state_min	0.00369690401967045
get_state_dump_max	0.01779183003151914
get_state_dump_mean	0.01779183003151914
get_state_dump_median	0.01779183003151914
get_state_dump_min	0.01779183003151914
get_ui_image_max	0.030637425206855935
get_ui_image_mean	0.030637425206855935
get_ui_image_median	0.030637425206855935
get_ui_image_min	0.030637425206855935
in-drivable-lane_max	39.49999999999989
in-drivable-lane_mean	39.49999999999989
in-drivable-lane_median	39.49999999999989
in-drivable-lane_min	39.49999999999989
per-episodes	details {"d40-ego0": {"driven_any": 9.474043812552514, "get_ui_image": 0.030637425206855935, "step_physics": 0.07289338473574401, "survival_time": 39.49999999999989, "driven_lanedir": 0.0, "get_state_dump": 0.01779183003151914, "get_robot_state": 0.00369690401967045, "sim_render-ego0": 0.00366544180965303, "get_duckie_state": 0.08126561319179994, "in-drivable-lane": 39.49999999999989, "deviation-heading": 0.0, "agent_compute-ego0": 0.011566649797441986, "complete-iteration": 0.23644249719554644, "set_robot_commands": 0.0022334907811450595, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010682911095215306, "sim_compute_performance-ego0": 0.001926917945389199}}
set_robot_commands_max	0.0022334907811450595
set_robot_commands_mean	0.0022334907811450595
set_robot_commands_median	0.0022334907811450595
set_robot_commands_min	0.0022334907811450595
sim_compute_performance-ego0_max	0.001926917945389199
sim_compute_performance-ego0_mean	0.001926917945389199
sim_compute_performance-ego0_median	0.001926917945389199
sim_compute_performance-ego0_min	0.001926917945389199
sim_compute_sim_state_max	0.010682911095215306
sim_compute_sim_state_mean	0.010682911095215306
sim_compute_sim_state_median	0.010682911095215306
sim_compute_sim_state_min	0.010682911095215306
sim_render-ego0_max	0.00366544180965303
sim_render-ego0_mean	0.00366544180965303
sim_render-ego0_median	0.00366544180965303
sim_render-ego0_min	0.00366544180965303
simulation-passed	1
step_physics_max	0.07289338473574401
step_physics_mean	0.07289338473574401
step_physics_median	0.07289338473574401
step_physics_min	0.07289338473574401
survival_time_max	39.49999999999989
survival_time_mean	39.49999999999989
survival_time_median	39.49999999999989
survival_time_min	39.49999999999989

No reset possible

66537

14142

Andrew Marin

exercises_braitenberg

489

success

yes

2021-04-11 22:07:08+00:00

2021-04-11 22:11:09+00:00

0:04:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

agent_compute-ego0_max	0.011585399884135783
agent_compute-ego0_mean	0.011585399884135783
agent_compute-ego0_median	0.011585399884135783
agent_compute-ego0_min	0.011585399884135783
complete-iteration_max	0.23908737126518695
complete-iteration_mean	0.23908737126518695
complete-iteration_median	0.23908737126518695
complete-iteration_min	0.23908737126518695
deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
driven_any_max	1.0069994536240747
driven_any_mean	1.0069994536240747
driven_any_median	1.0069994536240747
driven_any_min	1.0069994536240747
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	0.08322482449667794
get_duckie_state_mean	0.08322482449667794
get_duckie_state_median	0.08322482449667794
get_duckie_state_min	0.08322482449667794
get_robot_state_max	0.0037869595679916254
get_robot_state_mean	0.0037869595679916254
get_robot_state_median	0.0037869595679916254
get_robot_state_min	0.0037869595679916254
get_state_dump_max	0.018181065551373134
get_state_dump_mean	0.018181065551373134
get_state_dump_median	0.018181065551373134
get_state_dump_min	0.018181065551373134
get_ui_image_max	0.03065555836974072
get_ui_image_mean	0.03065555836974072
get_ui_image_median	0.03065555836974072
get_ui_image_min	0.03065555836974072
in-drivable-lane_max	11.850000000000032
in-drivable-lane_mean	11.850000000000032
in-drivable-lane_median	11.850000000000032
in-drivable-lane_min	11.850000000000032
per-episodes	details {"d40-ego0": {"driven_any": 1.0069994536240747, "get_ui_image": 0.03065555836974072, "step_physics": 0.07281993116651263, "survival_time": 11.850000000000032, "driven_lanedir": 0.0, "get_state_dump": 0.018181065551373134, "get_robot_state": 0.0037869595679916254, "sim_render-ego0": 0.0038031760384054742, "get_duckie_state": 0.08322482449667794, "in-drivable-lane": 11.850000000000032, "deviation-heading": 0.0, "agent_compute-ego0": 0.011585399884135783, "complete-iteration": 0.23908737126518695, "set_robot_commands": 0.002289576690737941, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010657558922006302, "sim_compute_performance-ego0": 0.0020013586813662234}}
set_robot_commands_max	0.002289576690737941
set_robot_commands_mean	0.002289576690737941
set_robot_commands_median	0.002289576690737941
set_robot_commands_min	0.002289576690737941
sim_compute_performance-ego0_max	0.0020013586813662234
sim_compute_performance-ego0_mean	0.0020013586813662234
sim_compute_performance-ego0_median	0.0020013586813662234
sim_compute_performance-ego0_min	0.0020013586813662234
sim_compute_sim_state_max	0.010657558922006302
sim_compute_sim_state_mean	0.010657558922006302
sim_compute_sim_state_median	0.010657558922006302
sim_compute_sim_state_min	0.010657558922006302
sim_render-ego0_max	0.0038031760384054742
sim_render-ego0_mean	0.0038031760384054742
sim_render-ego0_median	0.0038031760384054742
sim_render-ego0_min	0.0038031760384054742
simulation-passed	1
step_physics_max	0.07281993116651263
step_physics_mean	0.07281993116651263
step_physics_median	0.07281993116651263
step_physics_min	0.07281993116651263
survival_time_max	11.850000000000032
survival_time_mean	11.850000000000032
survival_time_median	11.850000000000032
survival_time_min	11.850000000000032

No reset possible

66515

14138

Ashley Reid

exercises_braitenberg

489

success

yes

2021-04-11 20:51:53+00:00

2021-04-11 20:53:41+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

agent_compute-ego0_max	0.011982003847757976
agent_compute-ego0_mean	0.011982003847757976
agent_compute-ego0_median	0.011982003847757976
agent_compute-ego0_min	0.011982003847757976
complete-iteration_max	0.2355247165845788
complete-iteration_mean	0.2355247165845788
complete-iteration_median	0.2355247165845788
complete-iteration_min	0.2355247165845788
deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
driven_any_max	3.300054598842229
driven_any_mean	3.300054598842229
driven_any_median	3.300054598842229
driven_any_min	3.300054598842229
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	0.08318054848822995
get_duckie_state_mean	0.08318054848822995
get_duckie_state_median	0.08318054848822995
get_duckie_state_min	0.08318054848822995
get_robot_state_max	0.003702198249706323
get_robot_state_mean	0.003702198249706323
get_robot_state_median	0.003702198249706323
get_robot_state_min	0.003702198249706323
get_state_dump_max	0.017885113107985344
get_state_dump_mean	0.017885113107985344
get_state_dump_median	0.017885113107985344
get_state_dump_min	0.017885113107985344
get_ui_image_max	0.03028415424236353
get_ui_image_mean	0.03028415424236353
get_ui_image_median	0.03028415424236353
get_ui_image_min	0.03028415424236353
in-drivable-lane_max	6.849999999999984
in-drivable-lane_mean	6.849999999999984
in-drivable-lane_median	6.849999999999984
in-drivable-lane_min	6.849999999999984
per-episodes	details {"d40-ego0": {"driven_any": 3.300054598842229, "get_ui_image": 0.03028415424236353, "step_physics": 0.06910950895668803, "survival_time": 6.849999999999984, "driven_lanedir": 0.0, "get_state_dump": 0.017885113107985344, "get_robot_state": 0.003702198249706323, "sim_render-ego0": 0.003871950550355773, "get_duckie_state": 0.08318054848822995, "in-drivable-lane": 6.849999999999984, "deviation-heading": 0.0, "agent_compute-ego0": 0.011982003847757976, "complete-iteration": 0.2355247165845788, "set_robot_commands": 0.002321549083875573, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.011042055876358696, "sim_compute_performance-ego0": 0.002055204432943593}}
set_robot_commands_max	0.002321549083875573
set_robot_commands_mean	0.002321549083875573
set_robot_commands_median	0.002321549083875573
set_robot_commands_min	0.002321549083875573
sim_compute_performance-ego0_max	0.002055204432943593
sim_compute_performance-ego0_mean	0.002055204432943593
sim_compute_performance-ego0_median	0.002055204432943593
sim_compute_performance-ego0_min	0.002055204432943593
sim_compute_sim_state_max	0.011042055876358696
sim_compute_sim_state_mean	0.011042055876358696
sim_compute_sim_state_median	0.011042055876358696
sim_compute_sim_state_min	0.011042055876358696
sim_render-ego0_max	0.003871950550355773
sim_render-ego0_mean	0.003871950550355773
sim_render-ego0_median	0.003871950550355773
sim_render-ego0_min	0.003871950550355773
simulation-passed	1
step_physics_max	0.06910950895668803
step_physics_mean	0.06910950895668803
step_physics_median	0.06910950895668803
step_physics_min	0.06910950895668803
survival_time_max	6.849999999999984
survival_time_mean	6.849999999999984
survival_time_median	6.849999999999984
survival_time_min	6.849999999999984

No reset possible

66462

14129

Mark Goodall

exercises_braitenberg

489

success

yes

2021-04-11 12:22:28+00:00

2021-04-11 12:31:07+00:00

0:08:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

agent_compute-ego0_max	0.012197613835454106
agent_compute-ego0_mean	0.012197613835454106
agent_compute-ego0_median	0.012197613835454106
agent_compute-ego0_min	0.012197613835454106
complete-iteration_max	0.2444067726860772
complete-iteration_mean	0.2444067726860772
complete-iteration_median	0.2444067726860772
complete-iteration_min	0.2444067726860772
deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
driven_any_max	3.9071918129529744
driven_any_mean	3.9071918129529744
driven_any_median	3.9071918129529744
driven_any_min	3.9071918129529744
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	0.08309537512404067
get_duckie_state_mean	0.08309537512404067
get_duckie_state_median	0.08309537512404067
get_duckie_state_min	0.08309537512404067
get_robot_state_max	0.0039085418254405525
get_robot_state_mean	0.0039085418254405525
get_robot_state_median	0.0039085418254405525
get_robot_state_min	0.0039085418254405525
get_state_dump_max	0.01824095752742794
get_state_dump_mean	0.01824095752742794
get_state_dump_median	0.01824095752742794
get_state_dump_min	0.01824095752742794
get_ui_image_max	0.03222886816756026
get_ui_image_mean	0.03222886816756026
get_ui_image_median	0.03222886816756026
get_ui_image_min	0.03222886816756026
in-drivable-lane_max	49.8999999999993
in-drivable-lane_mean	49.8999999999993
in-drivable-lane_median	49.8999999999993
in-drivable-lane_min	49.8999999999993
per-episodes	details {"d40-ego0": {"driven_any": 3.9071918129529744, "get_ui_image": 0.03222886816756026, "step_physics": 0.0776649993938488, "survival_time": 49.8999999999993, "driven_lanedir": 0.0, "get_state_dump": 0.01824095752742794, "get_robot_state": 0.0039085418254405525, "sim_render-ego0": 0.003781020820319831, "get_duckie_state": 0.08309537512404067, "in-drivable-lane": 49.8999999999993, "deviation-heading": 0.0, "agent_compute-ego0": 0.012197613835454106, "complete-iteration": 0.2444067726860772, "set_robot_commands": 0.0023134358533032544, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008877421523238326, "sim_compute_performance-ego0": 0.001997231005190371}}
set_robot_commands_max	0.0023134358533032544
set_robot_commands_mean	0.0023134358533032544
set_robot_commands_median	0.0023134358533032544
set_robot_commands_min	0.0023134358533032544
sim_compute_performance-ego0_max	0.001997231005190371
sim_compute_performance-ego0_mean	0.001997231005190371
sim_compute_performance-ego0_median	0.001997231005190371
sim_compute_performance-ego0_min	0.001997231005190371
sim_compute_sim_state_max	0.008877421523238326
sim_compute_sim_state_mean	0.008877421523238326
sim_compute_sim_state_median	0.008877421523238326
sim_compute_sim_state_min	0.008877421523238326
sim_render-ego0_max	0.003781020820319831
sim_render-ego0_mean	0.003781020820319831
sim_render-ego0_median	0.003781020820319831
sim_render-ego0_min	0.003781020820319831
simulation-passed	1
step_physics_max	0.0776649993938488
step_physics_mean	0.0776649993938488
step_physics_median	0.0776649993938488
step_physics_min	0.0776649993938488
survival_time_max	49.8999999999993
survival_time_mean	49.8999999999993
survival_time_median	49.8999999999993
survival_time_min	49.8999999999993

No reset possible

66450

14127

Anil Kumar Chavali

exercises_braitenberg

491

failed

yes

2021-04-11 12:06:51+00:00

2021-04-11 12:07:30+00:00

0:00:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 589, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/agent/solution/agent.py", line 111, in on_received_get_commands
              ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
              ||   File "<string>", line 5, in __init__
              ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 68, in __post_init__
              ||     raise ValueError(msg)
              || ValueError: Expected values to be between -1 and 1. Obtained 10.0, 10.0
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

66427

14127

Anil Kumar Chavali

exercises_braitenberg

491

aborted

yes

2021-04-11 11:57:16+00:00

2021-04-11 11:57:55+00:00

0:00:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 589, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/agent/solution/agent.py", line 111, in on_received_get_commands
              ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
              ||   File "<string>", line 5, in __init__
              ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 68, in __post_init__
              ||     raise ValueError(msg)
              || ValueError: Expected values to be between -1 and 1. Obtained 10.0, 10.0
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

66416

14125

Brian Leckie

template-random

370

success

2021-04-11 05:55:28+00:00

2021-04-11 05:57:44+00:00

0:02:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.1500000000000004
in-drivable-lane_median	1.15
driven_lanedir_consec_median	0.2357331065993169
deviation-center-line_median	0.05863921966719952

other stats

agent_compute-ego0_max	0.01205013556913896
agent_compute-ego0_mean	0.01205013556913896
agent_compute-ego0_median	0.01205013556913896
agent_compute-ego0_min	0.01205013556913896
complete-iteration_max	0.13572407310659235
complete-iteration_mean	0.13572407310659235
complete-iteration_median	0.13572407310659235
complete-iteration_min	0.13572407310659235
deviation-center-line_max	0.05863921966719952
deviation-center-line_mean	0.05863921966719952
deviation-center-line_min	0.05863921966719952
deviation-heading_max	0.46108604520141144
deviation-heading_mean	0.46108604520141144
deviation-heading_median	0.46108604520141144
deviation-heading_min	0.46108604520141144
driven_any_max	0.4603380961060899
driven_any_mean	0.4603380961060899
driven_any_median	0.4603380961060899
driven_any_min	0.4603380961060899
driven_lanedir_consec_max	0.2357331065993169
driven_lanedir_consec_mean	0.2357331065993169
driven_lanedir_consec_min	0.2357331065993169
driven_lanedir_max	0.2357331065993169
driven_lanedir_mean	0.2357331065993169
driven_lanedir_median	0.2357331065993169
driven_lanedir_min	0.2357331065993169
get_duckie_state_max	0.004281103610992432
get_duckie_state_mean	0.004281103610992432
get_duckie_state_median	0.004281103610992432
get_duckie_state_min	0.004281103610992432
get_robot_state_max	0.0036468505859375
get_robot_state_mean	0.0036468505859375
get_robot_state_median	0.0036468505859375
get_robot_state_min	0.0036468505859375
get_state_dump_max	0.005573521960865368
get_state_dump_mean	0.005573521960865368
get_state_dump_median	0.005573521960865368
get_state_dump_min	0.005573521960865368
get_ui_image_max	0.026452573862942783
get_ui_image_mean	0.026452573862942783
get_ui_image_median	0.026452573862942783
get_ui_image_min	0.026452573862942783
in-drivable-lane_max	1.15
in-drivable-lane_mean	1.15
in-drivable-lane_min	1.15
per-episodes	details {"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.026452573862942783, "step_physics": 0.07062522931532426, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005573521960865368, "get_robot_state": 0.0036468505859375, "sim_render-ego0": 0.00378694859418002, "get_duckie_state": 0.004281103610992432, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.01205013556913896, "complete-iteration": 0.13572407310659235, "set_robot_commands": 0.002164222977378151, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005053363063118674, "sim_compute_performance-ego0": 0.002007170156999068}}
set_robot_commands_max	0.002164222977378151
set_robot_commands_mean	0.002164222977378151
set_robot_commands_median	0.002164222977378151
set_robot_commands_min	0.002164222977378151
sim_compute_performance-ego0_max	0.002007170156999068
sim_compute_performance-ego0_mean	0.002007170156999068
sim_compute_performance-ego0_median	0.002007170156999068
sim_compute_performance-ego0_min	0.002007170156999068
sim_compute_sim_state_max	0.005053363063118674
sim_compute_sim_state_mean	0.005053363063118674
sim_compute_sim_state_median	0.005053363063118674
sim_compute_sim_state_min	0.005053363063118674
sim_render-ego0_max	0.00378694859418002
sim_render-ego0_mean	0.00378694859418002
sim_render-ego0_median	0.00378694859418002
sim_render-ego0_min	0.00378694859418002
simulation-passed	1
step_physics_max	0.07062522931532426
step_physics_mean	0.07062522931532426
step_physics_median	0.07062522931532426
step_physics_min	0.07062522931532426
survival_time_max	2.1500000000000004
survival_time_mean	2.1500000000000004
survival_time_min	2.1500000000000004

No reset possible

66415

14124

Nahuel Villalba

template-random

370

success

2021-04-11 00:59:37+00:00

2021-04-11 01:02:00+00:00

0:02:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.1500000000000004
in-drivable-lane_median	1.15
driven_lanedir_consec_median	0.2357331065993169
deviation-center-line_median	0.05863921966719952

other stats

agent_compute-ego0_max	0.011670253493569116
agent_compute-ego0_mean	0.011670253493569116
agent_compute-ego0_median	0.011670253493569116
agent_compute-ego0_min	0.011670253493569116
complete-iteration_max	0.13298701698129828
complete-iteration_mean	0.13298701698129828
complete-iteration_median	0.13298701698129828
complete-iteration_min	0.13298701698129828
deviation-center-line_max	0.05863921966719952
deviation-center-line_mean	0.05863921966719952
deviation-center-line_min	0.05863921966719952
deviation-heading_max	0.46108604520141144
deviation-heading_mean	0.46108604520141144
deviation-heading_median	0.46108604520141144
deviation-heading_min	0.46108604520141144
driven_any_max	0.4603380961060899
driven_any_mean	0.4603380961060899
driven_any_median	0.4603380961060899
driven_any_min	0.4603380961060899
driven_lanedir_consec_max	0.2357331065993169
driven_lanedir_consec_mean	0.2357331065993169
driven_lanedir_consec_min	0.2357331065993169
driven_lanedir_max	0.2357331065993169
driven_lanedir_mean	0.2357331065993169
driven_lanedir_median	0.2357331065993169
driven_lanedir_min	0.2357331065993169
get_duckie_state_max	0.004256145520643754
get_duckie_state_mean	0.004256145520643754
get_duckie_state_median	0.004256145520643754
get_duckie_state_min	0.004256145520643754
get_robot_state_max	0.0036551247943531384
get_robot_state_mean	0.0036551247943531384
get_robot_state_median	0.0036551247943531384
get_robot_state_min	0.0036551247943531384
get_state_dump_max	0.005459064787084406
get_state_dump_mean	0.005459064787084406
get_state_dump_median	0.005459064787084406
get_state_dump_min	0.005459064787084406
get_ui_image_max	0.026035525582053444
get_ui_image_mean	0.026035525582053444
get_ui_image_median	0.026035525582053444
get_ui_image_min	0.026035525582053444
in-drivable-lane_max	1.15
in-drivable-lane_mean	1.15
in-drivable-lane_min	1.15
per-episodes	details {"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.026035525582053444, "step_physics": 0.06889538331465288, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005459064787084406, "get_robot_state": 0.0036551247943531384, "sim_render-ego0": 0.003782597455111417, "get_duckie_state": 0.004256145520643754, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011670253493569116, "complete-iteration": 0.13298701698129828, "set_robot_commands": 0.0021675825119018555, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.0049811926755038176, "sim_compute_performance-ego0": 0.002004975622350519}}
set_robot_commands_max	0.0021675825119018555
set_robot_commands_mean	0.0021675825119018555
set_robot_commands_median	0.0021675825119018555
set_robot_commands_min	0.0021675825119018555
sim_compute_performance-ego0_max	0.002004975622350519
sim_compute_performance-ego0_mean	0.002004975622350519
sim_compute_performance-ego0_median	0.002004975622350519
sim_compute_performance-ego0_min	0.002004975622350519
sim_compute_sim_state_max	0.0049811926755038176
sim_compute_sim_state_mean	0.0049811926755038176
sim_compute_sim_state_median	0.0049811926755038176
sim_compute_sim_state_min	0.0049811926755038176
sim_render-ego0_max	0.003782597455111417
sim_render-ego0_mean	0.003782597455111417
sim_render-ego0_median	0.003782597455111417
sim_render-ego0_min	0.003782597455111417
simulation-passed	1
step_physics_max	0.06889538331465288
step_physics_mean	0.06889538331465288
step_physics_median	0.06889538331465288
step_physics_min	0.06889538331465288
survival_time_max	2.1500000000000004
survival_time_mean	2.1500000000000004
survival_time_min	2.1500000000000004

No reset possible

66406

14117

Jacopo Tani

exercises_braitenberg

490

success

yes

2021-04-10 19:09:18+00:00

2021-04-10 19:20:07+00:00

0:10:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

agent_compute-ego0_max	0.01323336231283502
agent_compute-ego0_mean	0.01323336231283502
agent_compute-ego0_median	0.01323336231283502
agent_compute-ego0_min	0.01323336231283502
complete-iteration_max	0.2226674931158639
complete-iteration_mean	0.2226674931158639
complete-iteration_median	0.2226674931158639
complete-iteration_min	0.2226674931158639
deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
driven_any_max	3.4686000000000257
driven_any_mean	3.4686000000000257
driven_any_median	3.4686000000000257
driven_any_min	3.4686000000000257
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	0.0654742772388944
get_duckie_state_mean	0.0654742772388944
get_duckie_state_median	0.0654742772388944
get_duckie_state_min	0.0654742772388944
get_robot_state_max	0.004082819197092882
get_robot_state_mean	0.004082819197092882
get_robot_state_median	0.004082819197092882
get_robot_state_min	0.004082819197092882
get_state_dump_max	0.015320582179343154
get_state_dump_mean	0.015320582179343154
get_state_dump_median	0.015320582179343154
get_state_dump_min	0.015320582179343154
get_ui_image_max	0.02816837206356392
get_ui_image_mean	0.02816837206356392
get_ui_image_median	0.02816837206356392
get_ui_image_min	0.02816837206356392
in-drivable-lane_max	58.84999999999879
in-drivable-lane_mean	58.84999999999879
in-drivable-lane_median	58.84999999999879
in-drivable-lane_min	58.84999999999879
per-episodes	details {"d30-ego0": {"driven_any": 3.4686000000000257, "get_ui_image": 0.02816837206356392, "step_physics": 0.07619843337248461, "survival_time": 58.84999999999879, "driven_lanedir": 0.0, "get_state_dump": 0.015320582179343154, "get_robot_state": 0.004082819197092882, "sim_render-ego0": 0.003972563962175405, "get_duckie_state": 0.0654742772388944, "in-drivable-lane": 58.84999999999879, "deviation-heading": 0.0, "agent_compute-ego0": 0.01323336231283502, "complete-iteration": 0.2226674931158639, "set_robot_commands": 0.002427671275438396, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.011519047319383089, "sim_compute_performance-ego0": 0.0021684173817140746}}
set_robot_commands_max	0.002427671275438396
set_robot_commands_mean	0.002427671275438396
set_robot_commands_median	0.002427671275438396
set_robot_commands_min	0.002427671275438396
sim_compute_performance-ego0_max	0.0021684173817140746
sim_compute_performance-ego0_mean	0.0021684173817140746
sim_compute_performance-ego0_median	0.0021684173817140746
sim_compute_performance-ego0_min	0.0021684173817140746
sim_compute_sim_state_max	0.011519047319383089
sim_compute_sim_state_mean	0.011519047319383089
sim_compute_sim_state_median	0.011519047319383089
sim_compute_sim_state_min	0.011519047319383089
sim_render-ego0_max	0.003972563962175405
sim_render-ego0_mean	0.003972563962175405
sim_render-ego0_median	0.003972563962175405
sim_render-ego0_min	0.003972563962175405
simulation-passed	1
step_physics_max	0.07619843337248461
step_physics_mean	0.07619843337248461
step_physics_median	0.07619843337248461
step_physics_min	0.07619843337248461
survival_time_max	58.84999999999879
survival_time_mean	58.84999999999879
survival_time_median	58.84999999999879
survival_time_min	58.84999999999879

No reset possible

66389

14117

Jacopo Tani

exercises_braitenberg

484

success

yes

2021-04-10 18:35:33+00:00

2021-04-10 18:42:29+00:00

0:06:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

agent_compute-ego0_max	0.013205514812676351
agent_compute-ego0_mean	0.013205514812676351
agent_compute-ego0_median	0.013205514812676351
agent_compute-ego0_min	0.013205514812676351
complete-iteration_max	0.3283119842959588
complete-iteration_mean	0.3283119842959588
complete-iteration_median	0.3283119842959588
complete-iteration_min	0.3283119842959588
deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
driven_any_max	1.3176000000000092
driven_any_mean	1.3176000000000092
driven_any_median	1.3176000000000092
driven_any_min	1.3176000000000092
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	0.1347771047770072
get_duckie_state_mean	0.1347771047770072
get_duckie_state_median	0.1347771047770072
get_duckie_state_min	0.1347771047770072
get_robot_state_max	0.004281897865510555
get_robot_state_mean	0.004281897865510555
get_robot_state_median	0.004281897865510555
get_robot_state_min	0.004281897865510555
get_state_dump_max	0.026340686318155483
get_state_dump_mean	0.026340686318155483
get_state_dump_median	0.026340686318155483
get_state_dump_min	0.026340686318155483
get_ui_image_max	0.03913189015005778
get_ui_image_mean	0.03913189015005778
get_ui_image_median	0.03913189015005778
get_ui_image_min	0.03913189015005778
in-drivable-lane_max	23.000000000000192
in-drivable-lane_mean	23.000000000000192
in-drivable-lane_median	23.000000000000192
in-drivable-lane_min	23.000000000000192
per-episodes	details {"d60-ego0": {"driven_any": 1.3176000000000092, "get_ui_image": 0.03913189015005778, "step_physics": 0.08940568663293007, "survival_time": 23.000000000000192, "driven_lanedir": 0.0, "get_state_dump": 0.026340686318155483, "get_robot_state": 0.004281897865510555, "sim_render-ego0": 0.004158013296230755, "get_duckie_state": 0.1347771047770072, "in-drivable-lane": 23.000000000000192, "deviation-heading": 0.0, "agent_compute-ego0": 0.013205514812676351, "complete-iteration": 0.3283119842959588, "set_robot_commands": 0.002482034120539005, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0121845433613742, "sim_compute_performance-ego0": 0.0022335967893455655}}
set_robot_commands_max	0.002482034120539005
set_robot_commands_mean	0.002482034120539005
set_robot_commands_median	0.002482034120539005
set_robot_commands_min	0.002482034120539005
sim_compute_performance-ego0_max	0.0022335967893455655
sim_compute_performance-ego0_mean	0.0022335967893455655
sim_compute_performance-ego0_median	0.0022335967893455655
sim_compute_performance-ego0_min	0.0022335967893455655
sim_compute_sim_state_max	0.0121845433613742
sim_compute_sim_state_mean	0.0121845433613742
sim_compute_sim_state_median	0.0121845433613742
sim_compute_sim_state_min	0.0121845433613742
sim_render-ego0_max	0.004158013296230755
sim_render-ego0_mean	0.004158013296230755
sim_render-ego0_median	0.004158013296230755
sim_render-ego0_min	0.004158013296230755
simulation-passed	1
step_physics_max	0.08940568663293007
step_physics_mean	0.08940568663293007
step_physics_median	0.08940568663293007
step_physics_min	0.08940568663293007
survival_time_max	23.000000000000192
survival_time_mean	23.000000000000192
survival_time_median	23.000000000000192
survival_time_min	23.000000000000192

No reset possible

66369

13798

Nicholas Kostelnik

template-random

370

aborted

2021-04-10 16:03:54+00:00

2021-04-10 16:04:16+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

66368

13798

Nicholas Kostelnik

template-random

370

aborted