Duckietown Challenges Home Challenges Submissions

Evaluator 5379

ID5379
evaluatorreg05
ownerI don't have one 😀
machinearchimede_2234e2d89799
processreg05_2234e2d89799
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success90 79879
# timeout
# failed3 79868
# error18 80060
# aborted14 79897
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors40
Processor frequency (MHz)2.1 GHz
Free % of processors89%
RAM total (MB)376.6 GB
RAM free (MB)228.1 GB
Disk (MB)74209.1 GB
Disk available (MB)56657.8 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8039216204Luis Hermosotemplate-rosmooc-modconsimsuccessnoreg050:20:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median31.5499999999998
deviation-center-line_median1.0309843165756098
driven_lanedir_consec_median0.2869781684393725
survival_time_median42.54999999999972


other stats
agent_compute-ego0_max0.04043829717017986
agent_compute-ego0_mean0.029183770321979725
agent_compute-ego0_median0.029183770321979725
agent_compute-ego0_min0.017929243473779586
complete-iteration_max0.33853981643915176
complete-iteration_mean0.32657123325126514
complete-iteration_median0.32657123325126514
complete-iteration_min0.31460265006337845
deviation-center-line_max1.1060732015845522
deviation-center-line_mean1.0309843165756098
deviation-center-line_min0.9558954315666676
deviation-heading_max15.24762079050064
deviation-heading_mean15.189107102560047
deviation-heading_median15.189107102560047
deviation-heading_min15.130593414619456
distance-from-start_max3.0097008967699086
distance-from-start_mean2.7275384459404535
distance-from-start_median2.7275384459404535
distance-from-start_min2.445375995110999
driven_any_max5.885090977277459
driven_any_mean5.794301774382051
driven_any_median5.794301774382051
driven_any_min5.703512571486644
driven_lanedir_consec_max0.4236896434608288
driven_lanedir_consec_mean0.2869781684393725
driven_lanedir_consec_min0.1502666934179162
driven_lanedir_max0.4236896434608288
driven_lanedir_mean0.2869781684393725
driven_lanedir_median0.2869781684393725
driven_lanedir_min0.1502666934179162
get_duckie_state_max4.486905203925238e-06
get_duckie_state_mean4.438322687905932e-06
get_duckie_state_median4.438322687905932e-06
get_duckie_state_min4.389740171886626e-06
get_robot_state_max0.010147769110543388
get_robot_state_mean0.009717490646258865
get_robot_state_median0.009717490646258865
get_robot_state_min0.00928721218197434
get_state_dump_max0.01453010489543279
get_state_dump_mean0.013533055179175878
get_state_dump_median0.013533055179175878
get_state_dump_min0.012536005462918965
get_ui_image_max0.07705041876545658
get_ui_image_mean0.07648943348851783
get_ui_image_median0.07648943348851783
get_ui_image_min0.0759284482115791
in-drivable-lane_max32.749999999999744
in-drivable-lane_mean31.5499999999998
in-drivable-lane_min30.349999999999852
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.703512571486644, "get_ui_image": 0.0759284482115791, "step_physics": 0.11554658015569053, "survival_time": 41.949999999999754, "driven_lanedir": 0.4236896434608288, "get_state_dump": 0.012536005462918965, "get_robot_state": 0.010147769110543388, "sim_render-ego0": 0.008696431205386207, "get_duckie_state": 4.389740171886626e-06, "in-drivable-lane": 30.349999999999852, "deviation-heading": 15.130593414619456, "agent_compute-ego0": 0.017929243473779586, "complete-iteration": 0.31460265006337845, "set_robot_commands": 0.006424344437462943, "distance-from-start": 3.0097008967699086, "deviation-center-line": 1.1060732015845522, "driven_lanedir_consec": 0.4236896434608288, "sim_compute_sim_state": 0.06182642522312346, "sim_compute_performance-ego0": 0.005342638492584229}, "LF-full-loop-001-ego0": {"driven_any": 5.885090977277459, "get_ui_image": 0.07705041876545658, "step_physics": 0.1154252964037436, "survival_time": 43.149999999999686, "driven_lanedir": 0.1502666934179162, "get_state_dump": 0.01453010489543279, "get_robot_state": 0.00928721218197434, "sim_render-ego0": 0.008360332085026635, "get_duckie_state": 4.486905203925238e-06, "in-drivable-lane": 32.749999999999744, "deviation-heading": 15.24762079050064, "agent_compute-ego0": 0.04043829717017986, "complete-iteration": 0.33853981643915176, "set_robot_commands": 0.006557412997440055, "distance-from-start": 2.445375995110999, "deviation-center-line": 0.9558954315666676, "driven_lanedir_consec": 0.1502666934179162, "sim_compute_sim_state": 0.06122568608434112, "sim_compute_performance-ego0": 0.005434167881806691}}
set_robot_commands_max0.006557412997440055
set_robot_commands_mean0.0064908787174514995
set_robot_commands_median0.0064908787174514995
set_robot_commands_min0.006424344437462943
sim_compute_performance-ego0_max0.005434167881806691
sim_compute_performance-ego0_mean0.0053884031871954605
sim_compute_performance-ego0_median0.0053884031871954605
sim_compute_performance-ego0_min0.005342638492584229
sim_compute_sim_state_max0.06182642522312346
sim_compute_sim_state_mean0.06152605565373229
sim_compute_sim_state_median0.06152605565373229
sim_compute_sim_state_min0.06122568608434112
sim_render-ego0_max0.008696431205386207
sim_render-ego0_mean0.008528381645206421
sim_render-ego0_median0.008528381645206421
sim_render-ego0_min0.008360332085026635
simulation-passed1
step_physics_max0.11554658015569053
step_physics_mean0.11548593827971708
step_physics_median0.11548593827971708
step_physics_min0.1154252964037436
survival_time_max43.149999999999686
survival_time_mean42.54999999999972
survival_time_min41.949999999999754
No reset possible
8038916203Shuhao Liangexercises_braitenbergmooc-BV1sim-2of5successnoreg050:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.133092279933654


other stats
agent_compute-ego0_max0.027145664215087892
agent_compute-ego0_mean0.027145664215087892
agent_compute-ego0_median0.027145664215087892
agent_compute-ego0_min0.027145664215087892
complete-iteration_max0.5372951173782349
complete-iteration_mean0.5372951173782349
complete-iteration_median0.5372951173782349
complete-iteration_min0.5372951173782349
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.133092279933654
distance-from-start_median2.133092279933654
distance-from-start_min2.133092279933654
driven_any_max2.144395165746346
driven_any_mean2.144395165746346
driven_any_median2.144395165746346
driven_any_min2.144395165746346
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.2758510637283325
get_duckie_state_mean0.2758510637283325
get_duckie_state_median0.2758510637283325
get_duckie_state_min0.2758510637283325
get_robot_state_max0.011425232887268068
get_robot_state_mean0.011425232887268068
get_robot_state_median0.011425232887268068
get_robot_state_min0.011425232887268068
get_state_dump_max0.04522429084777832
get_state_dump_mean0.04522429084777832
get_state_dump_median0.04522429084777832
get_state_dump_min0.04522429084777832
get_ui_image_max0.02758651971817017
get_ui_image_mean0.02758651971817017
get_ui_image_median0.02758651971817017
get_ui_image_min0.02758651971817017
in-drivable-lane_max24.95000000000022
in-drivable-lane_mean24.95000000000022
in-drivable-lane_median24.95000000000022
in-drivable-lane_min24.95000000000022
per-episodes
details{"d45-ego0": {"driven_any": 2.144395165746346, "get_ui_image": 0.02758651971817017, "step_physics": 0.10382418060302734, "survival_time": 24.95000000000022, "driven_lanedir": 0.0, "get_state_dump": 0.04522429084777832, "get_robot_state": 0.011425232887268068, "sim_render-ego0": 0.009047842979431151, "get_duckie_state": 0.2758510637283325, "in-drivable-lane": 24.95000000000022, "deviation-heading": 0.0, "agent_compute-ego0": 0.027145664215087892, "complete-iteration": 0.5372951173782349, "set_robot_commands": 0.007146344184875488, "distance-from-start": 2.133092279933654, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02393995428085327, "sim_compute_performance-ego0": 0.005852968692779541}}
set_robot_commands_max0.007146344184875488
set_robot_commands_mean0.007146344184875488
set_robot_commands_median0.007146344184875488
set_robot_commands_min0.007146344184875488
sim_compute_performance-ego0_max0.005852968692779541
sim_compute_performance-ego0_mean0.005852968692779541
sim_compute_performance-ego0_median0.005852968692779541
sim_compute_performance-ego0_min0.005852968692779541
sim_compute_sim_state_max0.02393995428085327
sim_compute_sim_state_mean0.02393995428085327
sim_compute_sim_state_median0.02393995428085327
sim_compute_sim_state_min0.02393995428085327
sim_render-ego0_max0.009047842979431151
sim_render-ego0_mean0.009047842979431151
sim_render-ego0_median0.009047842979431151
sim_render-ego0_min0.009047842979431151
simulation-passed1
step_physics_max0.10382418060302734
step_physics_mean0.10382418060302734
step_physics_median0.10382418060302734
step_physics_min0.10382418060302734
survival_time_max24.95000000000022
survival_time_mean24.95000000000022
survival_time_median24.95000000000022
survival_time_min24.95000000000022
No reset possible
8038716198Luis Hermosotemplate-rosmooc-modconsimfailednoreg050:16:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 1202 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8037416195Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-3of5successnoreg050:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.4856355826772236


other stats
agent_compute-ego0_max0.03273334238264296
agent_compute-ego0_mean0.03273334238264296
agent_compute-ego0_median0.03273334238264296
agent_compute-ego0_min0.03273334238264296
complete-iteration_max0.6360546350479126
complete-iteration_mean0.6360546350479126
complete-iteration_median0.6360546350479126
complete-iteration_min0.6360546350479126
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.4856355826772236
distance-from-start_median2.4856355826772236
distance-from-start_min2.4856355826772236
driven_any_max2.803197516563184
driven_any_mean2.803197516563184
driven_any_median2.803197516563184
driven_any_min2.803197516563184
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.3497511718008253
get_duckie_state_mean0.3497511718008253
get_duckie_state_median0.3497511718008253
get_duckie_state_min0.3497511718008253
get_robot_state_max0.013020492924584282
get_robot_state_mean0.013020492924584282
get_robot_state_median0.013020492924584282
get_robot_state_min0.013020492924584282
get_state_dump_max0.052531786759694415
get_state_dump_mean0.052531786759694415
get_state_dump_median0.052531786759694415
get_state_dump_min0.052531786759694415
get_ui_image_max0.031138425403171115
get_ui_image_mean0.031138425403171115
get_ui_image_median0.031138425403171115
get_ui_image_min0.031138425403171115
in-drivable-lane_max8.949999999999992
in-drivable-lane_mean8.949999999999992
in-drivable-lane_median8.949999999999992
in-drivable-lane_min8.949999999999992
per-episodes
details{"d50-ego0": {"driven_any": 2.803197516563184, "get_ui_image": 0.031138425403171115, "step_physics": 0.1059211770693461, "survival_time": 8.949999999999992, "driven_lanedir": 0.0, "get_state_dump": 0.052531786759694415, "get_robot_state": 0.013020492924584282, "sim_render-ego0": 0.011353928512997095, "get_duckie_state": 0.3497511718008253, "in-drivable-lane": 8.949999999999992, "deviation-heading": 0.0, "agent_compute-ego0": 0.03273334238264296, "complete-iteration": 0.6360546350479126, "set_robot_commands": 0.009685870011647542, "distance-from-start": 2.4856355826772236, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023591932985517712, "sim_compute_performance-ego0": 0.006079779730902778}}
set_robot_commands_max0.009685870011647542
set_robot_commands_mean0.009685870011647542
set_robot_commands_median0.009685870011647542
set_robot_commands_min0.009685870011647542
sim_compute_performance-ego0_max0.006079779730902778
sim_compute_performance-ego0_mean0.006079779730902778
sim_compute_performance-ego0_median0.006079779730902778
sim_compute_performance-ego0_min0.006079779730902778
sim_compute_sim_state_max0.023591932985517712
sim_compute_sim_state_mean0.023591932985517712
sim_compute_sim_state_median0.023591932985517712
sim_compute_sim_state_min0.023591932985517712
sim_render-ego0_max0.011353928512997095
sim_render-ego0_mean0.011353928512997095
sim_render-ego0_median0.011353928512997095
sim_render-ego0_min0.011353928512997095
simulation-passed1
step_physics_max0.1059211770693461
step_physics_mean0.1059211770693461
step_physics_median0.1059211770693461
step_physics_min0.1059211770693461
survival_time_max8.949999999999992
survival_time_mean8.949999999999992
survival_time_median8.949999999999992
survival_time_min8.949999999999992
No reset possible
8036916195Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-3of5successnoreg050:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.149973259803132


other stats
agent_compute-ego0_max0.04034958528668693
agent_compute-ego0_mean0.04034958528668693
agent_compute-ego0_median0.04034958528668693
agent_compute-ego0_min0.04034958528668693
complete-iteration_max0.5778480460134785
complete-iteration_mean0.5778480460134785
complete-iteration_median0.5778480460134785
complete-iteration_min0.5778480460134785
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.149973259803132
distance-from-start_median1.149973259803132
distance-from-start_min1.149973259803132
driven_any_max1.271766882851186
driven_any_mean1.271766882851186
driven_any_median1.271766882851186
driven_any_min1.271766882851186
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.3070340049400758
get_duckie_state_mean0.3070340049400758
get_duckie_state_median0.3070340049400758
get_duckie_state_min0.3070340049400758
get_robot_state_max0.011563496643237851
get_robot_state_mean0.011563496643237851
get_robot_state_median0.011563496643237851
get_robot_state_min0.011563496643237851
get_state_dump_max0.04816940661226766
get_state_dump_mean0.04816940661226766
get_state_dump_median0.04816940661226766
get_state_dump_min0.04816940661226766
get_ui_image_max0.030148792802617792
get_ui_image_mean0.030148792802617792
get_ui_image_median0.030148792802617792
get_ui_image_min0.030148792802617792
in-drivable-lane_max4.399999999999992
in-drivable-lane_mean4.399999999999992
in-drivable-lane_median4.399999999999992
in-drivable-lane_min4.399999999999992
per-episodes
details{"d50-ego0": {"driven_any": 1.271766882851186, "get_ui_image": 0.030148792802617792, "step_physics": 0.09608309992243734, "survival_time": 4.399999999999992, "driven_lanedir": 0.0, "get_state_dump": 0.04816940661226766, "get_robot_state": 0.011563496643237851, "sim_render-ego0": 0.00899734122029851, "get_duckie_state": 0.3070340049400758, "in-drivable-lane": 4.399999999999992, "deviation-heading": 0.0, "agent_compute-ego0": 0.04034958528668693, "complete-iteration": 0.5778480460134785, "set_robot_commands": 0.006087458535526576, "distance-from-start": 1.149973259803132, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02255841051594595, "sim_compute_performance-ego0": 0.006610141711288623}}
set_robot_commands_max0.006087458535526576
set_robot_commands_mean0.006087458535526576
set_robot_commands_median0.006087458535526576
set_robot_commands_min0.006087458535526576
sim_compute_performance-ego0_max0.006610141711288623
sim_compute_performance-ego0_mean0.006610141711288623
sim_compute_performance-ego0_median0.006610141711288623
sim_compute_performance-ego0_min0.006610141711288623
sim_compute_sim_state_max0.02255841051594595
sim_compute_sim_state_mean0.02255841051594595
sim_compute_sim_state_median0.02255841051594595
sim_compute_sim_state_min0.02255841051594595
sim_render-ego0_max0.00899734122029851
sim_render-ego0_mean0.00899734122029851
sim_render-ego0_median0.00899734122029851
sim_render-ego0_min0.00899734122029851
simulation-passed1
step_physics_max0.09608309992243734
step_physics_mean0.09608309992243734
step_physics_median0.09608309992243734
step_physics_min0.09608309992243734
survival_time_max4.399999999999992
survival_time_mean4.399999999999992
survival_time_median4.399999999999992
survival_time_min4.399999999999992
No reset possible
8033416192Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-2of5abortednoreg050:06:39
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8032416020Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-teststep1successnoreg050:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.02
false_positive_rate0.06


other stats
nsamples200
No reset possible
8032116015Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.12


other stats
nsamples200
No reset possible
8031716076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.49
false_positive_rate0.45


other stats
nsamples200
No reset possible
8031116076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.51
false_positive_rate0.48


other stats
nsamples200
No reset possible
8029916076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.5
false_positive_rate0.54


other stats
nsamples200
No reset possible
8029216025Ethan Frankcollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.075
false_positive_rate0.02


other stats
nsamples400
No reset possible
8027016025Ethan Frankcollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.075
false_positive_rate0.02


other stats
nsamples400
No reset possible
8022116191Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-1of5abortednoreg050:12:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.6245184476504715


other stats
agent_compute-ego0_max0.026909710346967323
agent_compute-ego0_mean0.026909710346967323
agent_compute-ego0_median0.026909710346967323
agent_compute-ego0_min0.026909710346967323
complete-iteration_max0.6341875031076628
complete-iteration_mean0.6341875031076628
complete-iteration_median0.6341875031076628
complete-iteration_min0.6341875031076628
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.6245184476504715
distance-from-start_median4.6245184476504715
distance-from-start_min4.6245184476504715
driven_any_max4.848092213558579
driven_any_mean4.848092213558579
driven_any_median4.848092213558579
driven_any_min4.848092213558579
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.371267998698114
get_duckie_state_mean0.371267998698114
get_duckie_state_median0.371267998698114
get_duckie_state_min0.371267998698114
get_robot_state_max0.012069918986024528
get_robot_state_mean0.012069918986024528
get_robot_state_median0.012069918986024528
get_robot_state_min0.012069918986024528
get_state_dump_max0.055697729190190635
get_state_dump_mean0.055697729190190635
get_state_dump_median0.055697729190190635
get_state_dump_min0.055697729190190635
get_ui_image_max0.027719743635462615
get_ui_image_mean0.027719743635462615
get_ui_image_median0.027719743635462615
get_ui_image_min0.027719743635462615
in-drivable-lane_max34.75000000000016
in-drivable-lane_mean34.75000000000016
in-drivable-lane_median34.75000000000016
in-drivable-lane_min34.75000000000016
per-episodes
details{"d60-ego0": {"driven_any": 4.848092213558579, "get_ui_image": 0.027719743635462615, "step_physics": 0.09657510772518728, "survival_time": 34.75000000000016, "driven_lanedir": 0.0, "get_state_dump": 0.055697729190190635, "get_robot_state": 0.012069918986024528, "sim_render-ego0": 0.009783521465871524, "get_duckie_state": 0.371267998698114, "in-drivable-lane": 34.75000000000016, "deviation-heading": 0.0, "agent_compute-ego0": 0.026909710346967323, "complete-iteration": 0.6341875031076628, "set_robot_commands": 0.00660281962361829, "distance-from-start": 4.6245184476504715, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021043431484836273, "sim_compute_performance-ego0": 0.006286805731126632}}
set_robot_commands_max0.00660281962361829
set_robot_commands_mean0.00660281962361829
set_robot_commands_median0.00660281962361829
set_robot_commands_min0.00660281962361829
sim_compute_performance-ego0_max0.006286805731126632
sim_compute_performance-ego0_mean0.006286805731126632
sim_compute_performance-ego0_median0.006286805731126632
sim_compute_performance-ego0_min0.006286805731126632
sim_compute_sim_state_max0.021043431484836273
sim_compute_sim_state_mean0.021043431484836273
sim_compute_sim_state_median0.021043431484836273
sim_compute_sim_state_min0.021043431484836273
sim_render-ego0_max0.009783521465871524
sim_render-ego0_mean0.009783521465871524
sim_render-ego0_median0.009783521465871524
sim_render-ego0_min0.009783521465871524
simulation-passed1
step_physics_max0.09657510772518728
step_physics_mean0.09657510772518728
step_physics_median0.09657510772518728
step_physics_min0.09657510772518728
survival_time_max34.75000000000016
survival_time_mean34.75000000000016
survival_time_median34.75000000000016
survival_time_min34.75000000000016
No reset possible
8022016191Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-4of5abortednoreg050:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.7666348988984022


other stats
agent_compute-ego0_max0.02526134883656221
agent_compute-ego0_mean0.02526134883656221
agent_compute-ego0_median0.02526134883656221
agent_compute-ego0_min0.02526134883656221
complete-iteration_max0.47002558147206025
complete-iteration_mean0.47002558147206025
complete-iteration_median0.47002558147206025
complete-iteration_min0.47002558147206025
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.7666348988984022
distance-from-start_median0.7666348988984022
distance-from-start_min0.7666348988984022
driven_any_max0.7801938339070253
driven_any_mean0.7801938339070253
driven_any_median0.7801938339070253
driven_any_min0.7801938339070253
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.23246971859651452
get_duckie_state_mean0.23246971859651452
get_duckie_state_median0.23246971859651452
get_duckie_state_min0.23246971859651452
get_robot_state_max0.010896231146419749
get_robot_state_mean0.010896231146419749
get_robot_state_median0.010896231146419749
get_robot_state_min0.010896231146419749
get_state_dump_max0.03945831972009996
get_state_dump_mean0.03945831972009996
get_state_dump_median0.03945831972009996
get_state_dump_min0.03945831972009996
get_ui_image_max0.02452398468466366
get_ui_image_mean0.02452398468466366
get_ui_image_median0.02452398468466366
get_ui_image_min0.02452398468466366
in-drivable-lane_max4.199999999999993
in-drivable-lane_mean4.199999999999993
in-drivable-lane_median4.199999999999993
in-drivable-lane_min4.199999999999993
per-episodes
details{"d40-ego0": {"driven_any": 0.7801938339070253, "get_ui_image": 0.02452398468466366, "step_physics": 0.09520591848036822, "survival_time": 4.199999999999993, "driven_lanedir": 0.0, "get_state_dump": 0.03945831972009996, "get_robot_state": 0.010896231146419749, "sim_render-ego0": 0.009043982449699853, "get_duckie_state": 0.23246971859651452, "in-drivable-lane": 4.199999999999993, "deviation-heading": 0.0, "agent_compute-ego0": 0.02526134883656221, "complete-iteration": 0.47002558147206025, "set_robot_commands": 0.006279151579912971, "distance-from-start": 0.7666348988984022, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021089767007266773, "sim_compute_performance-ego0": 0.005548513636869543}}
set_robot_commands_max0.006279151579912971
set_robot_commands_mean0.006279151579912971
set_robot_commands_median0.006279151579912971
set_robot_commands_min0.006279151579912971
sim_compute_performance-ego0_max0.005548513636869543
sim_compute_performance-ego0_mean0.005548513636869543
sim_compute_performance-ego0_median0.005548513636869543
sim_compute_performance-ego0_min0.005548513636869543
sim_compute_sim_state_max0.021089767007266773
sim_compute_sim_state_mean0.021089767007266773
sim_compute_sim_state_median0.021089767007266773
sim_compute_sim_state_min0.021089767007266773
sim_render-ego0_max0.009043982449699853
sim_render-ego0_mean0.009043982449699853
sim_render-ego0_median0.009043982449699853
sim_render-ego0_min0.009043982449699853
simulation-passed1
step_physics_max0.09520591848036822
step_physics_mean0.09520591848036822
step_physics_median0.09520591848036822
step_physics_min0.09520591848036822
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_median4.199999999999993
survival_time_min4.199999999999993
No reset possible
8021916191Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-4of5abortednoreg050:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8724682603268078


other stats
agent_compute-ego0_max0.02475065318020907
agent_compute-ego0_mean0.02475065318020907
agent_compute-ego0_median0.02475065318020907
agent_compute-ego0_min0.02475065318020907
complete-iteration_max0.454638899456371
complete-iteration_mean0.454638899456371
complete-iteration_median0.454638899456371
complete-iteration_min0.454638899456371
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8724682603268078
distance-from-start_median0.8724682603268078
distance-from-start_min0.8724682603268078
driven_any_max0.9338808649538556
driven_any_mean0.9338808649538556
driven_any_median0.9338808649538556
driven_any_min0.9338808649538556
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.2190433848987926
get_duckie_state_mean0.2190433848987926
get_duckie_state_median0.2190433848987926
get_duckie_state_min0.2190433848987926
get_robot_state_max0.010209681771018287
get_robot_state_mean0.010209681771018287
get_robot_state_median0.010209681771018287
get_robot_state_min0.010209681771018287
get_state_dump_max0.03949650200930509
get_state_dump_mean0.03949650200930509
get_state_dump_median0.03949650200930509
get_state_dump_min0.03949650200930509
get_ui_image_max0.02411203601143577
get_ui_image_mean0.02411203601143577
get_ui_image_median0.02411203601143577
get_ui_image_min0.02411203601143577
in-drivable-lane_max5.449999999999989
in-drivable-lane_mean5.449999999999989
in-drivable-lane_median5.449999999999989
in-drivable-lane_min5.449999999999989
per-episodes
details{"d40-ego0": {"driven_any": 0.9338808649538556, "get_ui_image": 0.02411203601143577, "step_physics": 0.09512970664284448, "survival_time": 5.449999999999989, "driven_lanedir": 0.0, "get_state_dump": 0.03949650200930509, "get_robot_state": 0.010209681771018287, "sim_render-ego0": 0.00855334455316717, "get_duckie_state": 0.2190433848987926, "in-drivable-lane": 5.449999999999989, "deviation-heading": 0.0, "agent_compute-ego0": 0.02475065318020907, "complete-iteration": 0.454638899456371, "set_robot_commands": 0.005756219950589267, "distance-from-start": 0.8724682603268078, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021888149868358263, "sim_compute_performance-ego0": 0.0054347623478282585}}
set_robot_commands_max0.005756219950589267
set_robot_commands_mean0.005756219950589267
set_robot_commands_median0.005756219950589267
set_robot_commands_min0.005756219950589267
sim_compute_performance-ego0_max0.0054347623478282585
sim_compute_performance-ego0_mean0.0054347623478282585
sim_compute_performance-ego0_median0.0054347623478282585
sim_compute_performance-ego0_min0.0054347623478282585
sim_compute_sim_state_max0.021888149868358263
sim_compute_sim_state_mean0.021888149868358263
sim_compute_sim_state_median0.021888149868358263
sim_compute_sim_state_min0.021888149868358263
sim_render-ego0_max0.00855334455316717
sim_render-ego0_mean0.00855334455316717
sim_render-ego0_median0.00855334455316717
sim_render-ego0_min0.00855334455316717
simulation-passed1
step_physics_max0.09512970664284448
step_physics_mean0.09512970664284448
step_physics_median0.09512970664284448
step_physics_min0.09512970664284448
survival_time_max5.449999999999989
survival_time_mean5.449999999999989
survival_time_median5.449999999999989
survival_time_min5.449999999999989
No reset possible
8021616092Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.38
false_positive_rate0.02


other stats
nsamples200
No reset possible
8021516092Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.38
false_positive_rate0.02


other stats
nsamples200
No reset possible
8021316092Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.38
false_positive_rate0.02


other stats
nsamples200
No reset possible
8021016092Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.38
false_positive_rate0.02


other stats
nsamples200
No reset possible
8020916092Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.38
false_positive_rate0.02


other stats
nsamples200
No reset possible
8020616089Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate1.0
false_positive_rate0.0


other stats
nsamples400
No reset possible
8020416089Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate1.0
false_positive_rate0.0


other stats
nsamples400
No reset possible
8019616082Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8019216111Ryan Arya Pratamacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8018316190Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-0of5successnoreg050:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.9742592795545258


other stats
agent_compute-ego0_max0.025010467392124543
agent_compute-ego0_mean0.025010467392124543
agent_compute-ego0_median0.025010467392124543
agent_compute-ego0_min0.025010467392124543
complete-iteration_max0.3936086697121189
complete-iteration_mean0.3936086697121189
complete-iteration_median0.3936086697121189
complete-iteration_min0.3936086697121189
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.9742592795545258
distance-from-start_median0.9742592795545258
distance-from-start_min0.9742592795545258
driven_any_max1.2274675442598335
driven_any_mean1.2274675442598335
driven_any_median1.2274675442598335
driven_any_min1.2274675442598335
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1678030784815958
get_duckie_state_mean0.1678030784815958
get_duckie_state_median0.1678030784815958
get_duckie_state_min0.1678030784815958
get_robot_state_max0.010679907178225582
get_robot_state_mean0.010679907178225582
get_robot_state_median0.010679907178225582
get_robot_state_min0.010679907178225582
get_state_dump_max0.03369989868712752
get_state_dump_mean0.03369989868712752
get_state_dump_median0.03369989868712752
get_state_dump_min0.03369989868712752
get_ui_image_max0.02315289761922131
get_ui_image_mean0.02315289761922131
get_ui_image_median0.02315289761922131
get_ui_image_min0.02315289761922131
in-drivable-lane_max14.550000000000072
in-drivable-lane_mean14.550000000000072
in-drivable-lane_median14.550000000000072
in-drivable-lane_min14.550000000000072
per-episodes
details{"d30-ego0": {"driven_any": 1.2274675442598335, "get_ui_image": 0.02315289761922131, "step_physics": 0.09060233749755442, "survival_time": 14.550000000000072, "driven_lanedir": 0.0, "get_state_dump": 0.03369989868712752, "get_robot_state": 0.010679907178225582, "sim_render-ego0": 0.008488065575900143, "get_duckie_state": 0.1678030784815958, "in-drivable-lane": 14.550000000000072, "deviation-heading": 0.0, "agent_compute-ego0": 0.025010467392124543, "complete-iteration": 0.3936086697121189, "set_robot_commands": 0.005789281570748107, "distance-from-start": 0.9742592795545258, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02279552694869368, "sim_compute_performance-ego0": 0.00533567634347367}}
set_robot_commands_max0.005789281570748107
set_robot_commands_mean0.005789281570748107
set_robot_commands_median0.005789281570748107
set_robot_commands_min0.005789281570748107
sim_compute_performance-ego0_max0.00533567634347367
sim_compute_performance-ego0_mean0.00533567634347367
sim_compute_performance-ego0_median0.00533567634347367
sim_compute_performance-ego0_min0.00533567634347367
sim_compute_sim_state_max0.02279552694869368
sim_compute_sim_state_mean0.02279552694869368
sim_compute_sim_state_median0.02279552694869368
sim_compute_sim_state_min0.02279552694869368
sim_render-ego0_max0.008488065575900143
sim_render-ego0_mean0.008488065575900143
sim_render-ego0_median0.008488065575900143
sim_render-ego0_min0.008488065575900143
simulation-passed1
step_physics_max0.09060233749755442
step_physics_mean0.09060233749755442
step_physics_median0.09060233749755442
step_physics_min0.09060233749755442
survival_time_max14.550000000000072
survival_time_mean14.550000000000072
survival_time_median14.550000000000072
survival_time_min14.550000000000072
No reset possible
8018216190Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-4of5successnoreg050:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.7695011752666209


other stats
agent_compute-ego0_max0.02967246414459858
agent_compute-ego0_mean0.02967246414459858
agent_compute-ego0_median0.02967246414459858
agent_compute-ego0_min0.02967246414459858
complete-iteration_max0.46689792023491616
complete-iteration_mean0.46689792023491616
complete-iteration_median0.46689792023491616
complete-iteration_min0.46689792023491616
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.7695011752666209
distance-from-start_median0.7695011752666209
distance-from-start_min0.7695011752666209
driven_any_max0.7842023162739694
driven_any_mean0.7842023162739694
driven_any_median0.7842023162739694
driven_any_min0.7842023162739694
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.22247894891758557
get_duckie_state_mean0.22247894891758557
get_duckie_state_median0.22247894891758557
get_duckie_state_min0.22247894891758557
get_robot_state_max0.010137535862086974
get_robot_state_mean0.010137535862086974
get_robot_state_median0.010137535862086974
get_robot_state_min0.010137535862086974
get_state_dump_max0.04056018160790512
get_state_dump_mean0.04056018160790512
get_state_dump_median0.04056018160790512
get_state_dump_min0.04056018160790512
get_ui_image_max0.02589080874452886
get_ui_image_mean0.02589080874452886
get_ui_image_median0.02589080874452886
get_ui_image_min0.02589080874452886
in-drivable-lane_max9.650000000000002
in-drivable-lane_mean9.650000000000002
in-drivable-lane_median9.650000000000002
in-drivable-lane_min9.650000000000002
per-episodes
details{"d40-ego0": {"driven_any": 0.7842023162739694, "get_ui_image": 0.02589080874452886, "step_physics": 0.09445745060124348, "survival_time": 9.650000000000002, "driven_lanedir": 0.0, "get_state_dump": 0.04056018160790512, "get_robot_state": 0.010137535862086974, "sim_render-ego0": 0.008616873898457006, "get_duckie_state": 0.22247894891758557, "in-drivable-lane": 9.650000000000002, "deviation-heading": 0.0, "agent_compute-ego0": 0.02967246414459858, "complete-iteration": 0.46689792023491616, "set_robot_commands": 0.006410649142314478, "distance-from-start": 0.7695011752666209, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023097316014398003, "sim_compute_performance-ego0": 0.005344180716681727}}
set_robot_commands_max0.006410649142314478
set_robot_commands_mean0.006410649142314478
set_robot_commands_median0.006410649142314478
set_robot_commands_min0.006410649142314478
sim_compute_performance-ego0_max0.005344180716681727
sim_compute_performance-ego0_mean0.005344180716681727
sim_compute_performance-ego0_median0.005344180716681727
sim_compute_performance-ego0_min0.005344180716681727
sim_compute_sim_state_max0.023097316014398003
sim_compute_sim_state_mean0.023097316014398003
sim_compute_sim_state_median0.023097316014398003
sim_compute_sim_state_min0.023097316014398003
sim_render-ego0_max0.008616873898457006
sim_render-ego0_mean0.008616873898457006
sim_render-ego0_median0.008616873898457006
sim_render-ego0_min0.008616873898457006
simulation-passed1
step_physics_max0.09445745060124348
step_physics_mean0.09445745060124348
step_physics_median0.09445745060124348
step_physics_min0.09445745060124348
survival_time_max9.650000000000002
survival_time_mean9.650000000000002
survival_time_median9.650000000000002
survival_time_min9.650000000000002
No reset possible
8018016118Sampsa Rantacollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.03
false_positive_rate0.04


other stats
nsamples400
No reset possible
8017816110Ryan Arya Pratamacollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8017616110Ryan Arya Pratamacollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8017416137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.4
false_positive_rate0.49


other stats
nsamples200
No reset possible
8017216137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.51
false_positive_rate0.48


other stats
nsamples200
No reset possible
8017016137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.47
false_positive_rate0.48


other stats
nsamples200
No reset possible
8016816137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.55
false_positive_rate0.49


other stats
nsamples200
No reset possible
8016616161Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8016416161Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8016216161Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8016016161Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8015816161Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8015616136Andrey Naydenkocollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.49
false_positive_rate0.475


other stats
nsamples400
No reset possible
8015416136Andrey Naydenkocollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.475
false_positive_rate0.505


other stats
nsamples400
No reset possible
8015316136Andrey Naydenkocollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.545
false_positive_rate0.42


other stats
nsamples400
No reset possible
8015116136Andrey Naydenkocollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.48
false_positive_rate0.495


other stats
nsamples400
No reset possible
8014916149Sampsa RantaChallenge acceptedmooc-collision-check-valistep1successnoreg050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8014716149Sampsa RantaChallenge acceptedmooc-collision-check-valistep1successnoreg050:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8014416149Sampsa RantaChallenge acceptedmooc-collision-check-valistep1successnoreg050:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8014316160Awni Altabaacollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8014216169Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.23


other stats
nsamples200
No reset possible
8014116169Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.23


other stats
nsamples200
No reset possible
8014016169Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.23


other stats
nsamples200
No reset possible
8013916169Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.23


other stats
nsamples200
No reset possible
8013816169Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.23


other stats
nsamples200
No reset possible
8013616189Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-4of5successnoreg050:10:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.519945288184018


other stats
agent_compute-ego0_max0.02489633476070989
agent_compute-ego0_mean0.02489633476070989
agent_compute-ego0_median0.02489633476070989
agent_compute-ego0_min0.02489633476070989
complete-iteration_max0.4658981210664622
complete-iteration_mean0.4658981210664622
complete-iteration_median0.4658981210664622
complete-iteration_min0.4658981210664622
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.519945288184018
distance-from-start_median4.519945288184018
distance-from-start_min4.519945288184018
driven_any_max4.758624950957825
driven_any_mean4.758624950957825
driven_any_median4.758624950957825
driven_any_min4.758624950957825
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.22971266774988883
get_duckie_state_mean0.22971266774988883
get_duckie_state_median0.22971266774988883
get_duckie_state_min0.22971266774988883
get_robot_state_max0.011369896064458094
get_robot_state_mean0.011369896064458094
get_robot_state_median0.011369896064458094
get_robot_state_min0.011369896064458094
get_state_dump_max0.04014060519928848
get_state_dump_mean0.04014060519928848
get_state_dump_median0.04014060519928848
get_state_dump_min0.04014060519928848
get_ui_image_max0.02396938014709804
get_ui_image_mean0.02396938014709804
get_ui_image_median0.02396938014709804
get_ui_image_min0.02396938014709804
in-drivable-lane_max36.80000000000005
in-drivable-lane_mean36.80000000000005
in-drivable-lane_median36.80000000000005
in-drivable-lane_min36.80000000000005
per-episodes
details{"d40-ego0": {"driven_any": 4.758624950957825, "get_ui_image": 0.02396938014709804, "step_physics": 0.09173803090078698, "survival_time": 36.80000000000005, "driven_lanedir": 0.0, "get_state_dump": 0.04014060519928848, "get_robot_state": 0.011369896064458094, "sim_render-ego0": 0.008344715615302284, "get_duckie_state": 0.22971266774988883, "in-drivable-lane": 36.80000000000005, "deviation-heading": 0.0, "agent_compute-ego0": 0.02489633476070989, "complete-iteration": 0.4658981210664622, "set_robot_commands": 0.006138376820847655, "distance-from-start": 4.519945288184018, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02402939207680028, "sim_compute_performance-ego0": 0.005327109565890143}}
set_robot_commands_max0.006138376820847655
set_robot_commands_mean0.006138376820847655
set_robot_commands_median0.006138376820847655
set_robot_commands_min0.006138376820847655
sim_compute_performance-ego0_max0.005327109565890143
sim_compute_performance-ego0_mean0.005327109565890143
sim_compute_performance-ego0_median0.005327109565890143
sim_compute_performance-ego0_min0.005327109565890143
sim_compute_sim_state_max0.02402939207680028
sim_compute_sim_state_mean0.02402939207680028
sim_compute_sim_state_median0.02402939207680028
sim_compute_sim_state_min0.02402939207680028
sim_render-ego0_max0.008344715615302284
sim_render-ego0_mean0.008344715615302284
sim_render-ego0_median0.008344715615302284
sim_render-ego0_min0.008344715615302284
simulation-passed1
step_physics_max0.09173803090078698
step_physics_mean0.09173803090078698
step_physics_median0.09173803090078698
step_physics_min0.09173803090078698
survival_time_max36.80000000000005
survival_time_mean36.80000000000005
survival_time_median36.80000000000005
survival_time_min36.80000000000005
No reset possible
8013316189Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-2of5successnoreg050:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.3157111798594794


other stats
agent_compute-ego0_max0.025577186561021648
agent_compute-ego0_mean0.025577186561021648
agent_compute-ego0_median0.025577186561021648
agent_compute-ego0_min0.025577186561021648
complete-iteration_max0.49460074158965567
complete-iteration_mean0.49460074158965567
complete-iteration_median0.49460074158965567
complete-iteration_min0.49460074158965567
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.3157111798594794
distance-from-start_median1.3157111798594794
distance-from-start_min1.3157111798594794
driven_any_max1.730840759382018
driven_any_mean1.730840759382018
driven_any_median1.730840759382018
driven_any_min1.730840759382018
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.25286339931800716
get_duckie_state_mean0.25286339931800716
get_duckie_state_median0.25286339931800716
get_duckie_state_min0.25286339931800716
get_robot_state_max0.01088343291986184
get_robot_state_mean0.01088343291986184
get_robot_state_median0.01088343291986184
get_robot_state_min0.01088343291986184
get_state_dump_max0.04305842274525126
get_state_dump_mean0.04305842274525126
get_state_dump_median0.04305842274525126
get_state_dump_min0.04305842274525126
get_ui_image_max0.02456269694156334
get_ui_image_mean0.02456269694156334
get_ui_image_median0.02456269694156334
get_ui_image_min0.02456269694156334
in-drivable-lane_max12.150000000000038
in-drivable-lane_mean12.150000000000038
in-drivable-lane_median12.150000000000038
in-drivable-lane_min12.150000000000038
per-episodes
details{"d45-ego0": {"driven_any": 1.730840759382018, "get_ui_image": 0.02456269694156334, "step_physics": 0.09517762113790044, "survival_time": 12.150000000000038, "driven_lanedir": 0.0, "get_state_dump": 0.04305842274525126, "get_robot_state": 0.01088343291986184, "sim_render-ego0": 0.008340647963226819, "get_duckie_state": 0.25286339931800716, "in-drivable-lane": 12.150000000000038, "deviation-heading": 0.0, "agent_compute-ego0": 0.025577186561021648, "complete-iteration": 0.49460074158965567, "set_robot_commands": 0.0059144848682841315, "distance-from-start": 1.3157111798594794, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022514320787836297, "sim_compute_performance-ego0": 0.005474508785810627}}
set_robot_commands_max0.0059144848682841315
set_robot_commands_mean0.0059144848682841315
set_robot_commands_median0.0059144848682841315
set_robot_commands_min0.0059144848682841315
sim_compute_performance-ego0_max0.005474508785810627
sim_compute_performance-ego0_mean0.005474508785810627
sim_compute_performance-ego0_median0.005474508785810627
sim_compute_performance-ego0_min0.005474508785810627
sim_compute_sim_state_max0.022514320787836297
sim_compute_sim_state_mean0.022514320787836297
sim_compute_sim_state_median0.022514320787836297
sim_compute_sim_state_min0.022514320787836297
sim_render-ego0_max0.008340647963226819
sim_render-ego0_mean0.008340647963226819
sim_render-ego0_median0.008340647963226819
sim_render-ego0_min0.008340647963226819
simulation-passed1
step_physics_max0.09517762113790044
step_physics_mean0.09517762113790044
step_physics_median0.09517762113790044
step_physics_min0.09517762113790044
survival_time_max12.150000000000038
survival_time_mean12.150000000000038
survival_time_median12.150000000000038
survival_time_min12.150000000000038
No reset possible
8013216176Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8013116176Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8013016176Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8012916185Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.29


other stats
nsamples200
No reset possible
8012816185Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.29


other stats
nsamples200
No reset possible
8012716185Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.29


other stats
nsamples200
No reset possible
8012616185Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnoreg050:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.29


other stats
nsamples200
No reset possible
8012416187Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-4of5successnoreg050:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.940646788699015


other stats
agent_compute-ego0_max0.025312177101429953
agent_compute-ego0_mean0.025312177101429953
agent_compute-ego0_median0.025312177101429953
agent_compute-ego0_min0.025312177101429953
complete-iteration_max0.4754857628130606
complete-iteration_mean0.4754857628130606
complete-iteration_median0.4754857628130606
complete-iteration_min0.4754857628130606
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.940646788699015
distance-from-start_median1.940646788699015
distance-from-start_min1.940646788699015
driven_any_max2.433213426054175
driven_any_mean2.433213426054175
driven_any_median2.433213426054175
driven_any_min2.433213426054175
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.23382259643129016
get_duckie_state_mean0.23382259643129016
get_duckie_state_median0.23382259643129016
get_duckie_state_min0.23382259643129016
get_robot_state_max0.011973469042471038
get_robot_state_mean0.011973469042471038
get_robot_state_median0.011973469042471038
get_robot_state_min0.011973469042471038
get_state_dump_max0.04123780348781864
get_state_dump_mean0.04123780348781864
get_state_dump_median0.04123780348781864
get_state_dump_min0.04123780348781864
get_ui_image_max0.024355730785320755
get_ui_image_mean0.024355730785320755
get_ui_image_median0.024355730785320755
get_ui_image_min0.024355730785320755
in-drivable-lane_max11.60000000000003
in-drivable-lane_mean11.60000000000003
in-drivable-lane_median11.60000000000003
in-drivable-lane_min11.60000000000003
per-episodes
details{"d40-ego0": {"driven_any": 2.433213426054175, "get_ui_image": 0.024355730785320755, "step_physics": 0.09317224117819332, "survival_time": 11.60000000000003, "driven_lanedir": 0.0, "get_state_dump": 0.04123780348781864, "get_robot_state": 0.011973469042471038, "sim_render-ego0": 0.01001915911236546, "get_duckie_state": 0.23382259643129016, "in-drivable-lane": 11.60000000000003, "deviation-heading": 0.0, "agent_compute-ego0": 0.025312177101429953, "complete-iteration": 0.4754857628130606, "set_robot_commands": 0.006206571800002724, "distance-from-start": 1.940646788699015, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023739130200234604, "sim_compute_performance-ego0": 0.005414341652342178}}
set_robot_commands_max0.006206571800002724
set_robot_commands_mean0.006206571800002724
set_robot_commands_median0.006206571800002724
set_robot_commands_min0.006206571800002724
sim_compute_performance-ego0_max0.005414341652342178
sim_compute_performance-ego0_mean0.005414341652342178
sim_compute_performance-ego0_median0.005414341652342178
sim_compute_performance-ego0_min0.005414341652342178
sim_compute_sim_state_max0.023739130200234604
sim_compute_sim_state_mean0.023739130200234604
sim_compute_sim_state_median0.023739130200234604
sim_compute_sim_state_min0.023739130200234604
sim_render-ego0_max0.01001915911236546
sim_render-ego0_mean0.01001915911236546
sim_render-ego0_median0.01001915911236546
sim_render-ego0_min0.01001915911236546
simulation-passed1
step_physics_max0.09317224117819332
step_physics_mean0.09317224117819332
step_physics_median0.09317224117819332
step_physics_min0.09317224117819332
survival_time_max11.60000000000003
survival_time_mean11.60000000000003
survival_time_median11.60000000000003
survival_time_min11.60000000000003
No reset possible
8012216188Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-4of5successnoreg050:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.891143683855511


other stats
agent_compute-ego0_max0.02612659237052821
agent_compute-ego0_mean0.02612659237052821
agent_compute-ego0_median0.02612659237052821
agent_compute-ego0_min0.02612659237052821
complete-iteration_max0.4669448677497574
complete-iteration_mean0.4669448677497574
complete-iteration_median0.4669448677497574
complete-iteration_min0.4669448677497574
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.891143683855511
distance-from-start_median2.891143683855511
distance-from-start_min2.891143683855511
driven_any_max4.060270844334766
driven_any_mean4.060270844334766
driven_any_median4.060270844334766
driven_any_min4.060270844334766
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.2331998468954352
get_duckie_state_mean0.2331998468954352
get_duckie_state_median0.2331998468954352
get_duckie_state_min0.2331998468954352
get_robot_state_max0.011157889909382109
get_robot_state_mean0.011157889909382109
get_robot_state_median0.011157889909382109
get_robot_state_min0.011157889909382109
get_state_dump_max0.03941606147379815
get_state_dump_mean0.03941606147379815
get_state_dump_median0.03941606147379815
get_state_dump_min0.03941606147379815
get_ui_image_max0.024292455745648735
get_ui_image_mean0.024292455745648735
get_ui_image_median0.024292455745648735
get_ui_image_min0.024292455745648735
in-drivable-lane_max19.700000000000145
in-drivable-lane_mean19.700000000000145
in-drivable-lane_median19.700000000000145
in-drivable-lane_min19.700000000000145
per-episodes
details{"d40-ego0": {"driven_any": 4.060270844334766, "get_ui_image": 0.024292455745648735, "step_physics": 0.09137880771974974, "survival_time": 19.700000000000145, "driven_lanedir": 0.0, "get_state_dump": 0.03941606147379815, "get_robot_state": 0.011157889909382109, "sim_render-ego0": 0.008568873586533944, "get_duckie_state": 0.2331998468954352, "in-drivable-lane": 19.700000000000145, "deviation-heading": 0.0, "agent_compute-ego0": 0.02612659237052821, "complete-iteration": 0.4669448677497574, "set_robot_commands": 0.00635249825972545, "distance-from-start": 2.891143683855511, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.020867113523845432, "sim_compute_performance-ego0": 0.005355761926385421}}
set_robot_commands_max0.00635249825972545
set_robot_commands_mean0.00635249825972545
set_robot_commands_median0.00635249825972545
set_robot_commands_min0.00635249825972545
sim_compute_performance-ego0_max0.005355761926385421
sim_compute_performance-ego0_mean0.005355761926385421
sim_compute_performance-ego0_median0.005355761926385421
sim_compute_performance-ego0_min0.005355761926385421
sim_compute_sim_state_max0.020867113523845432
sim_compute_sim_state_mean0.020867113523845432
sim_compute_sim_state_median0.020867113523845432
sim_compute_sim_state_min0.020867113523845432
sim_render-ego0_max0.008568873586533944
sim_render-ego0_mean0.008568873586533944
sim_render-ego0_median0.008568873586533944
sim_render-ego0_min0.008568873586533944
simulation-passed1
step_physics_max0.09137880771974974
step_physics_mean0.09137880771974974
step_physics_median0.09137880771974974
step_physics_min0.09137880771974974
survival_time_max19.700000000000145
survival_time_mean19.700000000000145
survival_time_median19.700000000000145
survival_time_min19.700000000000145
No reset possible
8012016188Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-0of5successnoreg050:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.7006992391282063


other stats
agent_compute-ego0_max0.02492640609528693
agent_compute-ego0_mean0.02492640609528693
agent_compute-ego0_median0.02492640609528693
agent_compute-ego0_min0.02492640609528693
complete-iteration_max0.41821337343922566
complete-iteration_mean0.41821337343922566
complete-iteration_median0.41821337343922566
complete-iteration_min0.41821337343922566
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.7006992391282063
distance-from-start_median2.7006992391282063
distance-from-start_min2.7006992391282063
driven_any_max3.976370088904668
driven_any_mean3.976370088904668
driven_any_median3.976370088904668
driven_any_min3.976370088904668
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.18034705278933216
get_duckie_state_mean0.18034705278933216
get_duckie_state_median0.18034705278933216
get_duckie_state_min0.18034705278933216
get_robot_state_max0.012678604604141958
get_robot_state_mean0.012678604604141958
get_robot_state_median0.012678604604141958
get_robot_state_min0.012678604604141958
get_state_dump_max0.03469907606544601
get_state_dump_mean0.03469907606544601
get_state_dump_median0.03469907606544601
get_state_dump_min0.03469907606544601
get_ui_image_max0.02539102878411168
get_ui_image_mean0.02539102878411168
get_ui_image_median0.02539102878411168
get_ui_image_min0.02539102878411168
in-drivable-lane_max17.90000000000012
in-drivable-lane_mean17.90000000000012
in-drivable-lane_median17.90000000000012
in-drivable-lane_min17.90000000000012
per-episodes
details{"d30-ego0": {"driven_any": 3.976370088904668, "get_ui_image": 0.02539102878411168, "step_physics": 0.09774693805195164, "survival_time": 17.90000000000012, "driven_lanedir": 0.0, "get_state_dump": 0.03469907606544601, "get_robot_state": 0.012678604604141958, "sim_render-ego0": 0.008885572215640777, "get_duckie_state": 0.18034705278933216, "in-drivable-lane": 17.90000000000012, "deviation-heading": 0.0, "agent_compute-ego0": 0.02492640609528693, "complete-iteration": 0.41821337343922566, "set_robot_commands": 0.006376721400736435, "distance-from-start": 2.7006992391282063, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021015246930560692, "sim_compute_performance-ego0": 0.005905263603231701}}
set_robot_commands_max0.006376721400736435
set_robot_commands_mean0.006376721400736435
set_robot_commands_median0.006376721400736435
set_robot_commands_min0.006376721400736435
sim_compute_performance-ego0_max0.005905263603231701
sim_compute_performance-ego0_mean0.005905263603231701
sim_compute_performance-ego0_median0.005905263603231701
sim_compute_performance-ego0_min0.005905263603231701
sim_compute_sim_state_max0.021015246930560692
sim_compute_sim_state_mean0.021015246930560692
sim_compute_sim_state_median0.021015246930560692
sim_compute_sim_state_min0.021015246930560692
sim_render-ego0_max0.008885572215640777
sim_render-ego0_mean0.008885572215640777
sim_render-ego0_median0.008885572215640777
sim_render-ego0_min0.008885572215640777
simulation-passed1
step_physics_max0.09774693805195164
step_physics_mean0.09774693805195164
step_physics_median0.09774693805195164
step_physics_min0.09774693805195164
survival_time_max17.90000000000012
survival_time_mean17.90000000000012
survival_time_median17.90000000000012
survival_time_min17.90000000000012
No reset possible
8011716187Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-0of5successnoreg050:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.2909222268592928


other stats
agent_compute-ego0_max0.024475472747899924
agent_compute-ego0_mean0.024475472747899924
agent_compute-ego0_median0.024475472747899924
agent_compute-ego0_min0.024475472747899924
complete-iteration_max0.4124362833181005
complete-iteration_mean0.4124362833181005
complete-iteration_median0.4124362833181005
complete-iteration_min0.4124362833181005
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.2909222268592928
distance-from-start_median1.2909222268592928
distance-from-start_min1.2909222268592928
driven_any_max1.728890133090502
driven_any_mean1.728890133090502
driven_any_median1.728890133090502
driven_any_min1.728890133090502
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1759245608262955
get_duckie_state_mean0.1759245608262955
get_duckie_state_median0.1759245608262955
get_duckie_state_min0.1759245608262955
get_robot_state_max0.011619110775601332
get_robot_state_mean0.011619110775601332
get_robot_state_median0.011619110775601332
get_robot_state_min0.011619110775601332
get_state_dump_max0.034003043630320556
get_state_dump_mean0.034003043630320556
get_state_dump_median0.034003043630320556
get_state_dump_min0.034003043630320556
get_ui_image_max0.024308298803438808
get_ui_image_mean0.024308298803438808
get_ui_image_median0.024308298803438808
get_ui_image_min0.024308298803438808
in-drivable-lane_max7.79999999999998
in-drivable-lane_mean7.79999999999998
in-drivable-lane_median7.79999999999998
in-drivable-lane_min7.79999999999998
per-episodes
details{"d30-ego0": {"driven_any": 1.728890133090502, "get_ui_image": 0.024308298803438808, "step_physics": 0.09842948852830632, "survival_time": 7.79999999999998, "driven_lanedir": 0.0, "get_state_dump": 0.034003043630320556, "get_robot_state": 0.011619110775601332, "sim_render-ego0": 0.008846343702571407, "get_duckie_state": 0.1759245608262955, "in-drivable-lane": 7.79999999999998, "deviation-heading": 0.0, "agent_compute-ego0": 0.024475472747899924, "complete-iteration": 0.4124362833181005, "set_robot_commands": 0.006285436593802872, "distance-from-start": 1.2909222268592928, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022734733144189143, "sim_compute_performance-ego0": 0.005557280437202211}}
set_robot_commands_max0.006285436593802872
set_robot_commands_mean0.006285436593802872
set_robot_commands_median0.006285436593802872
set_robot_commands_min0.006285436593802872
sim_compute_performance-ego0_max0.005557280437202211
sim_compute_performance-ego0_mean0.005557280437202211
sim_compute_performance-ego0_median0.005557280437202211
sim_compute_performance-ego0_min0.005557280437202211
sim_compute_sim_state_max0.022734733144189143
sim_compute_sim_state_mean0.022734733144189143
sim_compute_sim_state_median0.022734733144189143
sim_compute_sim_state_min0.022734733144189143
sim_render-ego0_max0.008846343702571407
sim_render-ego0_mean0.008846343702571407
sim_render-ego0_median0.008846343702571407
sim_render-ego0_min0.008846343702571407
simulation-passed1
step_physics_max0.09842948852830632
step_physics_mean0.09842948852830632
step_physics_median0.09842948852830632
step_physics_min0.09842948852830632
survival_time_max7.79999999999998
survival_time_mean7.79999999999998
survival_time_median7.79999999999998
survival_time_min7.79999999999998
No reset possible
8011616187Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-2of5successnoreg050:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.2548838853414723


other stats
agent_compute-ego0_max0.02689193567463771
agent_compute-ego0_mean0.02689193567463771
agent_compute-ego0_median0.02689193567463771
agent_compute-ego0_min0.02689193567463771
complete-iteration_max0.5145644536290144
complete-iteration_mean0.5145644536290144
complete-iteration_median0.5145644536290144
complete-iteration_min0.5145644536290144
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.2548838853414723
distance-from-start_median1.2548838853414723
distance-from-start_min1.2548838853414723
driven_any_max2.0064012961119935
driven_any_mean2.0064012961119935
driven_any_median2.0064012961119935
driven_any_min2.0064012961119935
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.26591879222059495
get_duckie_state_mean0.26591879222059495
get_duckie_state_median0.26591879222059495
get_duckie_state_min0.26591879222059495
get_robot_state_max0.010769601930608405
get_robot_state_mean0.010769601930608405
get_robot_state_median0.010769601930608405
get_robot_state_min0.010769601930608405
get_state_dump_max0.0468003502781527
get_state_dump_mean0.0468003502781527
get_state_dump_median0.0468003502781527
get_state_dump_min0.0468003502781527
get_ui_image_max0.02645803733193195
get_ui_image_mean0.02645803733193195
get_ui_image_median0.02645803733193195
get_ui_image_min0.02645803733193195
in-drivable-lane_max9.6
in-drivable-lane_mean9.6
in-drivable-lane_median9.6
in-drivable-lane_min9.6
per-episodes
details{"d45-ego0": {"driven_any": 2.0064012961119935, "get_ui_image": 0.02645803733193195, "step_physics": 0.09395768481832711, "survival_time": 9.6, "driven_lanedir": 0.0, "get_state_dump": 0.0468003502781527, "get_robot_state": 0.010769601930608405, "sim_render-ego0": 0.008935728221359648, "get_duckie_state": 0.26591879222059495, "in-drivable-lane": 9.6, "deviation-heading": 0.0, "agent_compute-ego0": 0.02689193567463771, "complete-iteration": 0.5145644536290144, "set_robot_commands": 0.00588721438393074, "distance-from-start": 1.2548838853414723, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022432938758573384, "sim_compute_performance-ego0": 0.006270154152509462}}
set_robot_commands_max0.00588721438393074
set_robot_commands_mean0.00588721438393074
set_robot_commands_median0.00588721438393074
set_robot_commands_min0.00588721438393074
sim_compute_performance-ego0_max0.006270154152509462
sim_compute_performance-ego0_mean0.006270154152509462
sim_compute_performance-ego0_median0.006270154152509462
sim_compute_performance-ego0_min0.006270154152509462
sim_compute_sim_state_max0.022432938758573384
sim_compute_sim_state_mean0.022432938758573384
sim_compute_sim_state_median0.022432938758573384
sim_compute_sim_state_min0.022432938758573384
sim_render-ego0_max0.008935728221359648
sim_render-ego0_mean0.008935728221359648
sim_render-ego0_median0.008935728221359648
sim_render-ego0_min0.008935728221359648
simulation-passed1
step_physics_max0.09395768481832711
step_physics_mean0.09395768481832711
step_physics_median0.09395768481832711
step_physics_min0.09395768481832711
survival_time_max9.6
survival_time_mean9.6
survival_time_median9.6
survival_time_min9.6
No reset possible
8011516187Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-2of5successnoreg050:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.2239363514863255


other stats
agent_compute-ego0_max0.02777407823070403
agent_compute-ego0_mean0.02777407823070403
agent_compute-ego0_median0.02777407823070403
agent_compute-ego0_min0.02777407823070403
complete-iteration_max0.46587872120641893
complete-iteration_mean0.46587872120641893
complete-iteration_median0.46587872120641893
complete-iteration_min0.46587872120641893
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.2239363514863255
distance-from-start_median1.2239363514863255
distance-from-start_min1.2239363514863255
driven_any_max1.2433329950465128
driven_any_mean1.2433329950465128
driven_any_median1.2433329950465128
driven_any_min1.2433329950465128
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.23210858529613865
get_duckie_state_mean0.23210858529613865
get_duckie_state_median0.23210858529613865
get_duckie_state_min0.23210858529613865
get_robot_state_max0.00818368504124303
get_robot_state_mean0.00818368504124303
get_robot_state_median0.00818368504124303
get_robot_state_min0.00818368504124303
get_state_dump_max0.041625888116898074
get_state_dump_mean0.041625888116898074
get_state_dump_median0.041625888116898074
get_state_dump_min0.041625888116898074
get_ui_image_max0.023845728366605697
get_ui_image_mean0.023845728366605697
get_ui_image_median0.023845728366605697
get_ui_image_min0.023845728366605697
in-drivable-lane_max6.149999999999986
in-drivable-lane_mean6.149999999999986
in-drivable-lane_median6.149999999999986
in-drivable-lane_min6.149999999999986
per-episodes
details{"d45-ego0": {"driven_any": 1.2433329950465128, "get_ui_image": 0.023845728366605697, "step_physics": 0.09262809253508043, "survival_time": 6.149999999999986, "driven_lanedir": 0.0, "get_state_dump": 0.041625888116898074, "get_robot_state": 0.00818368504124303, "sim_render-ego0": 0.007778744543752362, "get_duckie_state": 0.23210858529613865, "in-drivable-lane": 6.149999999999986, "deviation-heading": 0.0, "agent_compute-ego0": 0.02777407823070403, "complete-iteration": 0.46587872120641893, "set_robot_commands": 0.005223356908367526, "distance-from-start": 1.2239363514863255, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021348866724198865, "sim_compute_performance-ego0": 0.0051122788460023945}}
set_robot_commands_max0.005223356908367526
set_robot_commands_mean0.005223356908367526
set_robot_commands_median0.005223356908367526
set_robot_commands_min0.005223356908367526
sim_compute_performance-ego0_max0.0051122788460023945
sim_compute_performance-ego0_mean0.0051122788460023945
sim_compute_performance-ego0_median0.0051122788460023945
sim_compute_performance-ego0_min0.0051122788460023945
sim_compute_sim_state_max0.021348866724198865
sim_compute_sim_state_mean0.021348866724198865
sim_compute_sim_state_median0.021348866724198865
sim_compute_sim_state_min0.021348866724198865
sim_render-ego0_max0.007778744543752362
sim_render-ego0_mean0.007778744543752362
sim_render-ego0_median0.007778744543752362
sim_render-ego0_min0.007778744543752362
simulation-passed1
step_physics_max0.09262809253508043
step_physics_mean0.09262809253508043
step_physics_median0.09262809253508043
step_physics_min0.09262809253508043
survival_time_max6.149999999999986
survival_time_mean6.149999999999986
survival_time_median6.149999999999986
survival_time_min6.149999999999986
No reset possible
8011416175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8011316175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8011216175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8011116184Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.275


other stats
nsamples400
No reset possible
8011016184Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.275


other stats
nsamples400
No reset possible
8010916184Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.275


other stats
nsamples400
No reset possible
8010816184Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.275


other stats
nsamples400
No reset possible
8010716168Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.22


other stats
nsamples400
No reset possible
8010616168Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1abortednoreg050:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8010516168Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1abortednoreg050:00:43
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8010416168Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1abortednoreg050:00:30
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8010316168Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:40
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.22


other stats
nsamples400
No reset possible
8010116175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:43
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8009916175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:40
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8009716175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:39
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8009516175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:41
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8009316175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:41
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8009116175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:40
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8008916175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1abortednoreg050:00:29
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8008716175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1abortednoreg050:00:40
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8008516175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:42
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8008316175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:42
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8008116160Awni Altabaacollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:42
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8007916160Awni Altabaacollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:43
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8007716160Awni Altabaacollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:42
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8007516160Awni Altabaacollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:40
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8007316160Awni Altabaacollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:40
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8007116175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1abortednoreg050:00:30
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8006916175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1abortednoreg050:00:29
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8006616175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:39
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8006416175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:42
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8006216175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:40
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8006016175Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1errornoreg050:00:53
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 154, in planning_checker_main
    plot_geometry(ax, s0, body, color, 10, text=f'{i}')
TypeError: plot_geometry() got an unexpected keyword argument 'text'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples400
No reset possible
8004316179Vegard Hafsundexercises_braitenbergmooc-BV1sim-2of5successnoreg050:15:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.204056856815341


other stats
agent_compute-ego0_max0.024619730810324352
agent_compute-ego0_mean0.024619730810324352
agent_compute-ego0_median0.024619730810324352
agent_compute-ego0_min0.024619730810324352
complete-iteration_max0.5301402193804582
complete-iteration_mean0.5301402193804582
complete-iteration_median0.5301402193804582
complete-iteration_min0.5301402193804582
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.204056856815341
distance-from-start_median4.204056856815341
distance-from-start_min4.204056856815341
driven_any_max4.822274686667879
driven_any_mean4.822274686667879
driven_any_median4.822274686667879
driven_any_min4.822274686667879
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.2701638688643773
get_duckie_state_mean0.2701638688643773
get_duckie_state_median0.2701638688643773
get_duckie_state_min0.2701638688643773
get_robot_state_max0.01211596851547559
get_robot_state_mean0.01211596851547559
get_robot_state_median0.01211596851547559
get_robot_state_min0.01211596851547559
get_state_dump_max0.0480445755024751
get_state_dump_mean0.0480445755024751
get_state_dump_median0.0480445755024751
get_state_dump_min0.0480445755024751
get_ui_image_max0.027846910804510117
get_ui_image_mean0.027846910804510117
get_ui_image_median0.027846910804510117
get_ui_image_min0.027846910804510117
in-drivable-lane_max47.94999999999941
in-drivable-lane_mean47.94999999999941
in-drivable-lane_median47.94999999999941
in-drivable-lane_min47.94999999999941
per-episodes
details{"d45-ego0": {"driven_any": 4.822274686667879, "get_ui_image": 0.027846910804510117, "step_physics": 0.10473907589912416, "survival_time": 47.94999999999941, "driven_lanedir": 0.0, "get_state_dump": 0.0480445755024751, "get_robot_state": 0.01211596851547559, "sim_render-ego0": 0.008947645127773286, "get_duckie_state": 0.2701638688643773, "in-drivable-lane": 47.94999999999941, "deviation-heading": 0.0, "agent_compute-ego0": 0.024619730810324352, "complete-iteration": 0.5301402193804582, "set_robot_commands": 0.006072649359703064, "distance-from-start": 4.204056856815341, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021556042631467185, "sim_compute_performance-ego0": 0.0057783010105292}}
set_robot_commands_max0.006072649359703064
set_robot_commands_mean0.006072649359703064
set_robot_commands_median0.006072649359703064
set_robot_commands_min0.006072649359703064
sim_compute_performance-ego0_max0.0057783010105292
sim_compute_performance-ego0_mean0.0057783010105292
sim_compute_performance-ego0_median0.0057783010105292
sim_compute_performance-ego0_min0.0057783010105292
sim_compute_sim_state_max0.021556042631467185
sim_compute_sim_state_mean0.021556042631467185
sim_compute_sim_state_median0.021556042631467185
sim_compute_sim_state_min0.021556042631467185
sim_render-ego0_max0.008947645127773286
sim_render-ego0_mean0.008947645127773286
sim_render-ego0_median0.008947645127773286
sim_render-ego0_min0.008947645127773286
simulation-passed1
step_physics_max0.10473907589912416
step_physics_mean0.10473907589912416
step_physics_median0.10473907589912416
step_physics_min0.10473907589912416
survival_time_max47.94999999999941
survival_time_mean47.94999999999941
survival_time_median47.94999999999941
survival_time_min47.94999999999941
No reset possible
8004116179Vegard Hafsundexercises_braitenbergmooc-BV1sim-4of5successnoreg050:14:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.702837904628135


other stats
agent_compute-ego0_max0.024816443324655095
agent_compute-ego0_mean0.024816443324655095
agent_compute-ego0_median0.024816443324655095
agent_compute-ego0_min0.024816443324655095
complete-iteration_max0.4879239642495557
complete-iteration_mean0.4879239642495557
complete-iteration_median0.4879239642495557
complete-iteration_min0.4879239642495557
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.702837904628135
distance-from-start_median4.702837904628135
distance-from-start_min4.702837904628135
driven_any_max5.345573122695909
driven_any_mean5.345573122695909
driven_any_median5.345573122695909
driven_any_min5.345573122695909
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.24001182065277243
get_duckie_state_mean0.24001182065277243
get_duckie_state_median0.24001182065277243
get_duckie_state_min0.24001182065277243
get_robot_state_max0.011699069259513138
get_robot_state_mean0.011699069259513138
get_robot_state_median0.011699069259513138
get_robot_state_min0.011699069259513138
get_state_dump_max0.04109989634493025
get_state_dump_mean0.04109989634493025
get_state_dump_median0.04109989634493025
get_state_dump_min0.04109989634493025
get_ui_image_max0.026994027077076217
get_ui_image_mean0.026994027077076217
get_ui_image_median0.026994027077076217
get_ui_image_min0.026994027077076217
in-drivable-lane_max52.59999999999915
in-drivable-lane_mean52.59999999999915
in-drivable-lane_median52.59999999999915
in-drivable-lane_min52.59999999999915
per-episodes
details{"d40-ego0": {"driven_any": 5.345573122695909, "get_ui_image": 0.026994027077076217, "step_physics": 0.10144357871465871, "survival_time": 52.59999999999915, "driven_lanedir": 0.0, "get_state_dump": 0.04109989634493025, "get_robot_state": 0.011699069259513138, "sim_render-ego0": 0.008874967680131381, "get_duckie_state": 0.24001182065277243, "in-drivable-lane": 52.59999999999915, "deviation-heading": 0.0, "agent_compute-ego0": 0.024816443324655095, "complete-iteration": 0.4879239642495557, "set_robot_commands": 0.00618556354120586, "distance-from-start": 4.702837904628135, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.020815012461779123, "sim_compute_performance-ego0": 0.005741104893987788}}
set_robot_commands_max0.00618556354120586
set_robot_commands_mean0.00618556354120586
set_robot_commands_median0.00618556354120586
set_robot_commands_min0.00618556354120586
sim_compute_performance-ego0_max0.005741104893987788
sim_compute_performance-ego0_mean0.005741104893987788
sim_compute_performance-ego0_median0.005741104893987788
sim_compute_performance-ego0_min0.005741104893987788
sim_compute_sim_state_max0.020815012461779123
sim_compute_sim_state_mean0.020815012461779123
sim_compute_sim_state_median0.020815012461779123
sim_compute_sim_state_min0.020815012461779123
sim_render-ego0_max0.008874967680131381
sim_render-ego0_mean0.008874967680131381
sim_render-ego0_median0.008874967680131381
sim_render-ego0_min0.008874967680131381
simulation-passed1
step_physics_max0.10144357871465871
step_physics_mean0.10144357871465871
step_physics_median0.10144357871465871
step_physics_min0.10144357871465871
survival_time_max52.59999999999915
survival_time_mean52.59999999999915
survival_time_median52.59999999999915
survival_time_min52.59999999999915
No reset possible
8003916179Vegard Hafsundexercises_braitenbergmooc-BV1sim-0of5successnoreg050:14:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.454472686786358


other stats
agent_compute-ego0_max0.02513995721923074
agent_compute-ego0_mean0.02513995721923074
agent_compute-ego0_median0.02513995721923074
agent_compute-ego0_min0.02513995721923074
complete-iteration_max0.4169854595928411
complete-iteration_mean0.4169854595928411
complete-iteration_median0.4169854595928411
complete-iteration_min0.4169854595928411
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.454472686786358
distance-from-start_median5.454472686786358
distance-from-start_min5.454472686786358
driven_any_max5.569058875476591
driven_any_mean5.569058875476591
driven_any_median5.569058875476591
driven_any_min5.569058875476591
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1776501126554511
get_duckie_state_mean0.1776501126554511
get_duckie_state_median0.1776501126554511
get_duckie_state_min0.1776501126554511
get_robot_state_max0.011900889799853707
get_robot_state_mean0.011900889799853707
get_robot_state_median0.011900889799853707
get_robot_state_min0.011900889799853707
get_state_dump_max0.03543250158836856
get_state_dump_mean0.03543250158836856
get_state_dump_median0.03543250158836856
get_state_dump_min0.03543250158836856
get_ui_image_max0.02613812511407056
get_ui_image_mean0.02613812511407056
get_ui_image_median0.02613812511407056
get_ui_image_min0.02613812511407056
in-drivable-lane_max56.59999999999892
in-drivable-lane_mean56.59999999999892
in-drivable-lane_median56.59999999999892
in-drivable-lane_min56.59999999999892
per-episodes
details{"d30-ego0": {"driven_any": 5.569058875476591, "get_ui_image": 0.02613812511407056, "step_physics": 0.09861076372656692, "survival_time": 56.59999999999892, "driven_lanedir": 0.0, "get_state_dump": 0.03543250158836856, "get_robot_state": 0.011900889799853707, "sim_render-ego0": 0.008840386255168326, "get_duckie_state": 0.1776501126554511, "in-drivable-lane": 56.59999999999892, "deviation-heading": 0.0, "agent_compute-ego0": 0.02513995721923074, "complete-iteration": 0.4169854595928411, "set_robot_commands": 0.006210191420296705, "distance-from-start": 5.454472686786358, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.020936361163039176, "sim_compute_performance-ego0": 0.005847909654649295}}
set_robot_commands_max0.006210191420296705
set_robot_commands_mean0.006210191420296705
set_robot_commands_median0.006210191420296705
set_robot_commands_min0.006210191420296705
sim_compute_performance-ego0_max0.005847909654649295
sim_compute_performance-ego0_mean0.005847909654649295
sim_compute_performance-ego0_median0.005847909654649295
sim_compute_performance-ego0_min0.005847909654649295
sim_compute_sim_state_max0.020936361163039176
sim_compute_sim_state_mean0.020936361163039176
sim_compute_sim_state_median0.020936361163039176
sim_compute_sim_state_min0.020936361163039176
sim_render-ego0_max0.008840386255168326
sim_render-ego0_mean0.008840386255168326
sim_render-ego0_median0.008840386255168326
sim_render-ego0_min0.008840386255168326
simulation-passed1
step_physics_max0.09861076372656692
step_physics_mean0.09861076372656692
step_physics_median0.09861076372656692
step_physics_min0.09861076372656692
survival_time_max56.59999999999892
survival_time_mean56.59999999999892
survival_time_median56.59999999999892
survival_time_min56.59999999999892
No reset possible
8003816178Andreas Zieglerobjdet exercisemooc-objdetsimsuccessnoreg050:22:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median35.69999999999938
driven_lanedir_consec_median4.614504973460464


other stats
agent_compute-ego0_max0.04181570375491737
agent_compute-ego0_mean0.04053277122742894
agent_compute-ego0_median0.04053277122742894
agent_compute-ego0_min0.03924983869994051
complete-iteration_max0.3649748000971582
complete-iteration_mean0.35678216694942044
complete-iteration_median0.35678216694942044
complete-iteration_min0.34858953380168267
deviation-center-line_max0.3897409915923899
deviation-center-line_mean0.3293319039344703
deviation-center-line_median0.3293319039344703
deviation-center-line_min0.26892281627655074
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.346610655784918
distance-from-start_mean4.614255688190701
distance-from-start_median4.614255688190701
distance-from-start_min2.881900720596483
driven_any_max6.346610655784918
driven_any_mean4.614255688190701
driven_any_median4.614255688190701
driven_any_min2.881900720596483
driven_lanedir_consec_max6.347090958669271
driven_lanedir_consec_mean4.614504973460464
driven_lanedir_consec_min2.8819189882516576
driven_lanedir_max6.347090958669271
driven_lanedir_mean4.614504973460464
driven_lanedir_median4.614504973460464
driven_lanedir_min2.8819189882516576
get_duckie_state_max0.06129650172345545
get_duckie_state_mean0.05724803338483712
get_duckie_state_median0.05724803338483712
get_duckie_state_min0.0531995650462188
get_robot_state_max0.011794869250600084
get_robot_state_mean0.010539535459209524
get_robot_state_median0.010539535459209524
get_robot_state_min0.00928420166781896
get_state_dump_max0.022738661595327867
get_state_dump_mean0.02210055728980026
get_state_dump_median0.02210055728980026
get_state_dump_min0.021462452984272653
get_ui_image_max0.05099916200058149
get_ui_image_mean0.04970434009832707
get_ui_image_median0.04970434009832707
get_ui_image_min0.04840951819607264
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.346610655784918, "get_ui_image": 0.05099916200058149, "step_physics": 0.09776986806616994, "survival_time": 59.99999999999873, "driven_lanedir": 6.347090958669271, "get_state_dump": 0.022738661595327867, "get_robot_state": 0.011794869250600084, "sim_render-ego0": 0.00927636426851017, "get_duckie_state": 0.06129650172345545, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.04181570375491737, "complete-iteration": 0.3649748000971582, "set_robot_commands": 0.00767173695623825, "distance-from-start": 6.346610655784918, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 6.347090958669271, "sim_compute_sim_state": 0.05547840946619954, "sim_compute_performance-ego0": 0.005875579324193442}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.881900720596483, "get_ui_image": 0.04840951819607264, "step_physics": 0.09699651768113848, "survival_time": 11.400000000000029, "driven_lanedir": 2.8819189882516576, "get_state_dump": 0.021462452984272653, "get_robot_state": 0.00928420166781896, "sim_render-ego0": 0.008308817726035306, "get_duckie_state": 0.0531995650462188, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.03924983869994051, "complete-iteration": 0.34858953380168267, "set_robot_commands": 0.006377628276441815, "distance-from-start": 2.881900720596483, "deviation-center-line": 0.26892281627655074, "driven_lanedir_consec": 2.8819189882516576, "sim_compute_sim_state": 0.05951409360727369, "sim_compute_performance-ego0": 0.005532108540097699}}
set_robot_commands_max0.00767173695623825
set_robot_commands_mean0.007024682616340033
set_robot_commands_median0.007024682616340033
set_robot_commands_min0.006377628276441815
sim_compute_performance-ego0_max0.005875579324193442
sim_compute_performance-ego0_mean0.005703843932145571
sim_compute_performance-ego0_median0.005703843932145571
sim_compute_performance-ego0_min0.005532108540097699
sim_compute_sim_state_max0.05951409360727369
sim_compute_sim_state_mean0.05749625153673661
sim_compute_sim_state_median0.05749625153673661
sim_compute_sim_state_min0.05547840946619954
sim_render-ego0_max0.00927636426851017
sim_render-ego0_mean0.008792590997272738
sim_render-ego0_median0.008792590997272738
sim_render-ego0_min0.008308817726035306
simulation-passed1
step_physics_max0.09776986806616994
step_physics_mean0.0973831928736542
step_physics_median0.0973831928736542
step_physics_min0.09699651768113848
survival_time_max59.99999999999873
survival_time_mean35.69999999999938
survival_time_min11.400000000000029
No reset possible
8003616177Vegard Hafsundexercises_braitenbergmooc-BV1sim-4of5successnoreg050:15:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.7070541150208


other stats
agent_compute-ego0_max0.02537788905952642
agent_compute-ego0_mean0.02537788905952642
agent_compute-ego0_median0.02537788905952642
agent_compute-ego0_min0.02537788905952642
complete-iteration_max0.47976814908818455
complete-iteration_mean0.47976814908818455
complete-iteration_median0.47976814908818455
complete-iteration_min0.47976814908818455
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.7070541150208
distance-from-start_median4.7070541150208
distance-from-start_min4.7070541150208
driven_any_max5.349015588649706
driven_any_mean5.349015588649706
driven_any_median5.349015588649706
driven_any_min5.349015588649706
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.2385824111200148
get_duckie_state_mean0.2385824111200148
get_duckie_state_median0.2385824111200148
get_duckie_state_min0.2385824111200148
get_robot_state_max0.01144455528802166
get_robot_state_mean0.01144455528802166
get_robot_state_median0.01144455528802166
get_robot_state_min0.01144455528802166
get_state_dump_max0.0404957788492742
get_state_dump_mean0.0404957788492742
get_state_dump_median0.0404957788492742
get_state_dump_min0.0404957788492742
get_ui_image_max0.02498741823989029
get_ui_image_mean0.02498741823989029
get_ui_image_median0.02498741823989029
get_ui_image_min0.02498741823989029
in-drivable-lane_max52.649999999999146
in-drivable-lane_mean52.649999999999146
in-drivable-lane_median52.649999999999146
in-drivable-lane_min52.649999999999146
per-episodes
details{"d40-ego0": {"driven_any": 5.349015588649706, "get_ui_image": 0.02498741823989029, "step_physics": 0.09772378737831476, "survival_time": 52.649999999999146, "driven_lanedir": 0.0, "get_state_dump": 0.0404957788492742, "get_robot_state": 0.01144455528802166, "sim_render-ego0": 0.008765866453326405, "get_duckie_state": 0.2385824111200148, "in-drivable-lane": 52.649999999999146, "deviation-heading": 0.0, "agent_compute-ego0": 0.02537788905952642, "complete-iteration": 0.47976814908818455, "set_robot_commands": 0.006381232326804347, "distance-from-start": 4.7070541150208, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02011214804604112, "sim_compute_performance-ego0": 0.005657496443283399}}
set_robot_commands_max0.006381232326804347
set_robot_commands_mean0.006381232326804347
set_robot_commands_median0.006381232326804347
set_robot_commands_min0.006381232326804347
sim_compute_performance-ego0_max0.005657496443283399
sim_compute_performance-ego0_mean0.005657496443283399
sim_compute_performance-ego0_median0.005657496443283399
sim_compute_performance-ego0_min0.005657496443283399
sim_compute_sim_state_max0.02011214804604112
sim_compute_sim_state_mean0.02011214804604112
sim_compute_sim_state_median0.02011214804604112
sim_compute_sim_state_min0.02011214804604112
sim_render-ego0_max0.008765866453326405
sim_render-ego0_mean0.008765866453326405
sim_render-ego0_median0.008765866453326405
sim_render-ego0_min0.008765866453326405
simulation-passed1
step_physics_max0.09772378737831476
step_physics_mean0.09772378737831476
step_physics_median0.09772378737831476
step_physics_min0.09772378737831476
survival_time_max52.649999999999146
survival_time_mean52.649999999999146
survival_time_median52.649999999999146
survival_time_min52.649999999999146
No reset possible
8003416177Vegard Hafsundexercises_braitenbergmooc-BV1sim-2of5successnoreg050:14:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.208580786096498


other stats
agent_compute-ego0_max0.02735441068131611
agent_compute-ego0_mean0.02735441068131611
agent_compute-ego0_median0.02735441068131611
agent_compute-ego0_min0.02735441068131611
complete-iteration_max0.5168124982324055
complete-iteration_mean0.5168124982324055
complete-iteration_median0.5168124982324055
complete-iteration_min0.5168124982324055
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.208580786096498
distance-from-start_median4.208580786096498
distance-from-start_min4.208580786096498
driven_any_max4.819773912866246
driven_any_mean4.819773912866246
driven_any_median4.819773912866246
driven_any_min4.819773912866246
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.2665504117499195
get_duckie_state_mean0.2665504117499195
get_duckie_state_median0.2665504117499195
get_duckie_state_min0.2665504117499195
get_robot_state_max0.011605676113636502
get_robot_state_mean0.011605676113636502
get_robot_state_median0.011605676113636502
get_robot_state_min0.011605676113636502
get_state_dump_max0.04530820462725849
get_state_dump_mean0.04530820462725849
get_state_dump_median0.04530820462725849
get_state_dump_min0.04530820462725849
get_ui_image_max0.02515349078104592
get_ui_image_mean0.02515349078104592
get_ui_image_median0.02515349078104592
get_ui_image_min0.02515349078104592
in-drivable-lane_max48.39999999999939
in-drivable-lane_mean48.39999999999939
in-drivable-lane_median48.39999999999939
in-drivable-lane_min48.39999999999939
per-episodes
details{"d45-ego0": {"driven_any": 4.819773912866246, "get_ui_image": 0.02515349078104592, "step_physics": 0.09965581200071164, "survival_time": 48.39999999999939, "driven_lanedir": 0.0, "get_state_dump": 0.04530820462725849, "get_robot_state": 0.011605676113636502, "sim_render-ego0": 0.008821361451203116, "get_duckie_state": 0.2665504117499195, "in-drivable-lane": 48.39999999999939, "deviation-heading": 0.0, "agent_compute-ego0": 0.02735441068131611, "complete-iteration": 0.5168124982324055, "set_robot_commands": 0.006182252561098774, "distance-from-start": 4.208580786096498, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02009442913027863, "sim_compute_performance-ego0": 0.005803266915005427}}
set_robot_commands_max0.006182252561098774
set_robot_commands_mean0.006182252561098774
set_robot_commands_median0.006182252561098774
set_robot_commands_min0.006182252561098774
sim_compute_performance-ego0_max0.005803266915005427
sim_compute_performance-ego0_mean0.005803266915005427
sim_compute_performance-ego0_median0.005803266915005427
sim_compute_performance-ego0_min0.005803266915005427
sim_compute_sim_state_max0.02009442913027863
sim_compute_sim_state_mean0.02009442913027863
sim_compute_sim_state_median0.02009442913027863
sim_compute_sim_state_min0.02009442913027863
sim_render-ego0_max0.008821361451203116
sim_render-ego0_mean0.008821361451203116
sim_render-ego0_median0.008821361451203116
sim_render-ego0_min0.008821361451203116
simulation-passed1
step_physics_max0.09965581200071164
step_physics_mean0.09965581200071164
step_physics_median0.09965581200071164
step_physics_min0.09965581200071164
survival_time_max48.39999999999939
survival_time_mean48.39999999999939
survival_time_median48.39999999999939
survival_time_min48.39999999999939
No reset possible
8001716170Vivek Jagannathexercises_braitenbergmooc-BV1sim-4of5successnoreg050:16:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.016459421027991


other stats
agent_compute-ego0_max0.026655662598410734
agent_compute-ego0_mean0.026655662598410734
agent_compute-ego0_median0.026655662598410734
agent_compute-ego0_min0.026655662598410734
complete-iteration_max0.4841264343017812
complete-iteration_mean0.4841264343017812
complete-iteration_median0.4841264343017812
complete-iteration_min0.4841264343017812
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.016459421027991
distance-from-start_median4.016459421027991
distance-from-start_min4.016459421027991
driven_any_max4.989520540113039
driven_any_mean4.989520540113039
driven_any_median4.989520540113039
driven_any_min4.989520540113039
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.23659983396733408
get_duckie_state_mean0.23659983396733408
get_duckie_state_median0.23659983396733408
get_duckie_state_min0.23659983396733408
get_robot_state_max0.0122805381573273
get_robot_state_mean0.0122805381573273
get_robot_state_median0.0122805381573273
get_robot_state_min0.0122805381573273
get_state_dump_max0.042226860285415065
get_state_dump_mean0.042226860285415065
get_state_dump_median0.042226860285415065
get_state_dump_min0.042226860285415065
get_ui_image_max0.025355601656264153
get_ui_image_mean0.025355601656264153
get_ui_image_median0.025355601656264153
get_ui_image_min0.025355601656264153
in-drivable-lane_max58.59999999999881
in-drivable-lane_mean58.59999999999881
in-drivable-lane_median58.59999999999881
in-drivable-lane_min58.59999999999881
per-episodes
details{"d40-ego0": {"driven_any": 4.989520540113039, "get_ui_image": 0.025355601656264153, "step_physics": 0.09619154060181652, "survival_time": 58.59999999999881, "driven_lanedir": 0.0, "get_state_dump": 0.042226860285415065, "get_robot_state": 0.0122805381573273, "sim_render-ego0": 0.008539623210090708, "get_duckie_state": 0.23659983396733408, "in-drivable-lane": 58.59999999999881, "deviation-heading": 0.0, "agent_compute-ego0": 0.026655662598410734, "complete-iteration": 0.4841264343017812, "set_robot_commands": 0.006104545113578985, "distance-from-start": 4.016459421027991, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.024354383870260593, "sim_compute_performance-ego0": 0.00557226659086964}}
set_robot_commands_max0.006104545113578985
set_robot_commands_mean0.006104545113578985
set_robot_commands_median0.006104545113578985
set_robot_commands_min0.006104545113578985
sim_compute_performance-ego0_max0.00557226659086964
sim_compute_performance-ego0_mean0.00557226659086964
sim_compute_performance-ego0_median0.00557226659086964
sim_compute_performance-ego0_min0.00557226659086964
sim_compute_sim_state_max0.024354383870260593
sim_compute_sim_state_mean0.024354383870260593
sim_compute_sim_state_median0.024354383870260593
sim_compute_sim_state_min0.024354383870260593
sim_render-ego0_max0.008539623210090708
sim_render-ego0_mean0.008539623210090708
sim_render-ego0_median0.008539623210090708
sim_render-ego0_min0.008539623210090708
simulation-passed1
step_physics_max0.09619154060181652
step_physics_mean0.09619154060181652
step_physics_median0.09619154060181652
step_physics_min0.09619154060181652
survival_time_max58.59999999999881
survival_time_mean58.59999999999881
survival_time_median58.59999999999881
survival_time_min58.59999999999881
No reset possible
8001516170Vivek Jagannathexercises_braitenbergmooc-BV1sim-1of5successnoreg050:18:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.962592908376103


other stats
agent_compute-ego0_max0.028872561171423193
agent_compute-ego0_mean0.028872561171423193
agent_compute-ego0_median0.028872561171423193
agent_compute-ego0_min0.028872561171423193
complete-iteration_max0.5921404964855045
complete-iteration_mean0.5921404964855045
complete-iteration_median0.5921404964855045
complete-iteration_min0.5921404964855045
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.962592908376103
distance-from-start_median4.962592908376103
distance-from-start_min4.962592908376103
driven_any_max5.053095914376597
driven_any_mean5.053095914376597
driven_any_median5.053095914376597
driven_any_min5.053095914376597
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.34052017305824267
get_duckie_state_mean0.34052017305824267
get_duckie_state_median0.34052017305824267
get_duckie_state_min0.34052017305824267
get_robot_state_max0.011421989504064483
get_robot_state_mean0.011421989504064483
get_robot_state_median0.011421989504064483
get_robot_state_min0.011421989504064483
get_state_dump_max0.05200901662959308
get_state_dump_mean0.05200901662959308
get_state_dump_median0.05200901662959308
get_state_dump_min0.05200901662959308
get_ui_image_max0.026464232969365016
get_ui_image_mean0.026464232969365016
get_ui_image_median0.026464232969365016
get_ui_image_min0.026464232969365016
in-drivable-lane_max58.84999999999879
in-drivable-lane_mean58.84999999999879
in-drivable-lane_median58.84999999999879
in-drivable-lane_min58.84999999999879
per-episodes
details{"d60-ego0": {"driven_any": 5.053095914376597, "get_ui_image": 0.026464232969365016, "step_physics": 0.09346392381373408, "survival_time": 58.84999999999879, "driven_lanedir": 0.0, "get_state_dump": 0.05200901662959308, "get_robot_state": 0.011421989504064483, "sim_render-ego0": 0.008569427783298979, "get_duckie_state": 0.34052017305824267, "in-drivable-lane": 58.84999999999879, "deviation-heading": 0.0, "agent_compute-ego0": 0.028872561171423193, "complete-iteration": 0.5921404964855045, "set_robot_commands": 0.005831144459178776, "distance-from-start": 4.962592908376103, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01934526731688624, "sim_compute_performance-ego0": 0.005402630577670293}}
set_robot_commands_max0.005831144459178776
set_robot_commands_mean0.005831144459178776
set_robot_commands_median0.005831144459178776
set_robot_commands_min0.005831144459178776
sim_compute_performance-ego0_max0.005402630577670293
sim_compute_performance-ego0_mean0.005402630577670293
sim_compute_performance-ego0_median0.005402630577670293
sim_compute_performance-ego0_min0.005402630577670293
sim_compute_sim_state_max0.01934526731688624
sim_compute_sim_state_mean0.01934526731688624
sim_compute_sim_state_median0.01934526731688624
sim_compute_sim_state_min0.01934526731688624
sim_render-ego0_max0.008569427783298979
sim_render-ego0_mean0.008569427783298979
sim_render-ego0_median0.008569427783298979
sim_render-ego0_min0.008569427783298979
simulation-passed1
step_physics_max0.09346392381373408
step_physics_mean0.09346392381373408
step_physics_median0.09346392381373408
step_physics_min0.09346392381373408
survival_time_max58.84999999999879
survival_time_mean58.84999999999879
survival_time_median58.84999999999879
survival_time_min58.84999999999879
No reset possible
8000516168Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1successnoreg050:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.26


other stats
nsamples400
No reset possible
7999416162Aadi Nath Mishratemplate-rosmooc-modconsimfailednoreg050:03:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7999316161Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.04


other stats
nsamples200
No reset possible
7997416155Fryderyk Rógexercises_braitenbergmooc-BV1sim-1of5successnoreg050:18:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.420596393675499


other stats
agent_compute-ego0_max0.025552929489936163
agent_compute-ego0_mean0.025552929489936163
agent_compute-ego0_median0.025552929489936163
agent_compute-ego0_min0.025552929489936163
complete-iteration_max0.5909455330743083
complete-iteration_mean0.5909455330743083
complete-iteration_median0.5909455330743083
complete-iteration_min0.5909455330743083
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.420596393675499
distance-from-start_median4.420596393675499
distance-from-start_min4.420596393675499
driven_any_max4.603262417261062
driven_any_mean4.603262417261062
driven_any_median4.603262417261062
driven_any_min4.603262417261062
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.3438213389680149
get_duckie_state_mean0.3438213389680149
get_duckie_state_median0.3438213389680149
get_duckie_state_min0.3438213389680149
get_robot_state_max0.011450439170437192
get_robot_state_mean0.011450439170437192
get_robot_state_median0.011450439170437192
get_robot_state_min0.011450439170437192
get_state_dump_max0.05146147369048081
get_state_dump_mean0.05146147369048081
get_state_dump_median0.05146147369048081
get_state_dump_min0.05146147369048081
get_ui_image_max0.026303445568291173
get_ui_image_mean0.026303445568291173
get_ui_image_median0.026303445568291173
get_ui_image_min0.026303445568291173
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 4.603262417261062, "get_ui_image": 0.026303445568291173, "step_physics": 0.09233227697240622, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.05146147369048081, "get_robot_state": 0.011450439170437192, "sim_render-ego0": 0.00845596911408919, "get_duckie_state": 0.3438213389680149, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.025552929489936163, "complete-iteration": 0.5909455330743083, "set_robot_commands": 0.005939150730040945, "distance-from-start": 4.420596393675499, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.019950279288248256, "sim_compute_performance-ego0": 0.005440173399239952}}
set_robot_commands_max0.005939150730040945
set_robot_commands_mean0.005939150730040945
set_robot_commands_median0.005939150730040945
set_robot_commands_min0.005939150730040945
sim_compute_performance-ego0_max0.005440173399239952
sim_compute_performance-ego0_mean0.005440173399239952
sim_compute_performance-ego0_median0.005440173399239952
sim_compute_performance-ego0_min0.005440173399239952
sim_compute_sim_state_max0.019950279288248256
sim_compute_sim_state_mean0.019950279288248256
sim_compute_sim_state_median0.019950279288248256
sim_compute_sim_state_min0.019950279288248256
sim_render-ego0_max0.00845596911408919
sim_render-ego0_mean0.00845596911408919
sim_render-ego0_median0.00845596911408919
sim_render-ego0_min0.00845596911408919
simulation-passed1
step_physics_max0.09233227697240622
step_physics_mean0.09233227697240622
step_physics_median0.09233227697240622
step_physics_min0.09233227697240622
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7997316155Fryderyk Rógexercises_braitenbergmooc-BV1sim-4of5successnoreg050:16:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.8309454164541448


other stats
agent_compute-ego0_max0.025829584771250805
agent_compute-ego0_mean0.025829584771250805
agent_compute-ego0_median0.025829584771250805
agent_compute-ego0_min0.025829584771250805
complete-iteration_max0.4622961867361839
complete-iteration_mean0.4622961867361839
complete-iteration_median0.4622961867361839
complete-iteration_min0.4622961867361839
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.8309454164541448
distance-from-start_median3.8309454164541448
distance-from-start_min3.8309454164541448
driven_any_max4.274626541771899
driven_any_mean4.274626541771899
driven_any_median4.274626541771899
driven_any_min4.274626541771899
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.22785209557297423
get_duckie_state_mean0.22785209557297423
get_duckie_state_median0.22785209557297423
get_duckie_state_min0.22785209557297423
get_robot_state_max0.011394367130670222
get_robot_state_mean0.011394367130670222
get_robot_state_median0.011394367130670222
get_robot_state_min0.011394367130670222
get_state_dump_max0.03958698573656424
get_state_dump_mean0.03958698573656424
get_state_dump_median0.03958698573656424
get_state_dump_min0.03958698573656424
get_ui_image_max0.024027506973622343
get_ui_image_mean0.024027506973622343
get_ui_image_median0.024027506973622343
get_ui_image_min0.024027506973622343
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 4.274626541771899, "get_ui_image": 0.024027506973622343, "step_physics": 0.09237364408475572, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.03958698573656424, "get_robot_state": 0.011394367130670222, "sim_render-ego0": 0.008417595633856958, "get_duckie_state": 0.22785209557297423, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.025829584771250805, "complete-iteration": 0.4622961867361839, "set_robot_commands": 0.0060686775290102486, "distance-from-start": 3.8309454164541448, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021014999291184146, "sim_compute_performance-ego0": 0.0054938781271369926}}
set_robot_commands_max0.0060686775290102486
set_robot_commands_mean0.0060686775290102486
set_robot_commands_median0.0060686775290102486
set_robot_commands_min0.0060686775290102486
sim_compute_performance-ego0_max0.0054938781271369926
sim_compute_performance-ego0_mean0.0054938781271369926
sim_compute_performance-ego0_median0.0054938781271369926
sim_compute_performance-ego0_min0.0054938781271369926
sim_compute_sim_state_max0.021014999291184146
sim_compute_sim_state_mean0.021014999291184146
sim_compute_sim_state_median0.021014999291184146
sim_compute_sim_state_min0.021014999291184146
sim_render-ego0_max0.008417595633856958
sim_render-ego0_mean0.008417595633856958
sim_render-ego0_median0.008417595633856958
sim_render-ego0_min0.008417595633856958
simulation-passed1
step_physics_max0.09237364408475572
step_physics_mean0.09237364408475572
step_physics_median0.09237364408475572
step_physics_min0.09237364408475572
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7997016154Alejandro Gómezexercises_braitenbergmooc-BV1sim-3of5successnoreg050:15:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.814367698633133


other stats
agent_compute-ego0_max0.02645251787415426
agent_compute-ego0_mean0.02645251787415426
agent_compute-ego0_median0.02645251787415426
agent_compute-ego0_min0.02645251787415426
complete-iteration_max0.5442134745946122
complete-iteration_mean0.5442134745946122
complete-iteration_median0.5442134745946122
complete-iteration_min0.5442134745946122
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.814367698633133
distance-from-start_median4.814367698633133
distance-from-start_min4.814367698633133
driven_any_max4.973250340360325
driven_any_mean4.973250340360325
driven_any_median4.973250340360325
driven_any_min4.973250340360325
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.2970317075630903
get_duckie_state_mean0.2970317075630903
get_duckie_state_median0.2970317075630903
get_duckie_state_min0.2970317075630903
get_robot_state_max0.011544998015773912
get_robot_state_mean0.011544998015773912
get_robot_state_median0.011544998015773912
get_robot_state_min0.011544998015773912
get_state_dump_max0.04606605601812184
get_state_dump_mean0.04606605601812184
get_state_dump_median0.04606605601812184
get_state_dump_min0.04606605601812184
get_ui_image_max0.02625305566003628
get_ui_image_mean0.02625305566003628
get_ui_image_median0.02625305566003628
get_ui_image_min0.02625305566003628
in-drivable-lane_max52.24999999999917
in-drivable-lane_mean52.24999999999917
in-drivable-lane_median52.24999999999917
in-drivable-lane_min52.24999999999917
per-episodes
details{"d50-ego0": {"driven_any": 4.973250340360325, "get_ui_image": 0.02625305566003628, "step_physics": 0.0954855835460568, "survival_time": 52.24999999999917, "driven_lanedir": 0.0, "get_state_dump": 0.04606605601812184, "get_robot_state": 0.011544998015773912, "sim_render-ego0": 0.00884599485087349, "get_duckie_state": 0.2970317075630903, "in-drivable-lane": 52.24999999999917, "deviation-heading": 0.0, "agent_compute-ego0": 0.02645251787415426, "complete-iteration": 0.5442134745946122, "set_robot_commands": 0.006494337240550987, "distance-from-start": 4.814367698633133, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.020113155901090137, "sim_compute_performance-ego0": 0.00569832940402496}}
set_robot_commands_max0.006494337240550987
set_robot_commands_mean0.006494337240550987
set_robot_commands_median0.006494337240550987
set_robot_commands_min0.006494337240550987
sim_compute_performance-ego0_max0.00569832940402496
sim_compute_performance-ego0_mean0.00569832940402496
sim_compute_performance-ego0_median0.00569832940402496
sim_compute_performance-ego0_min0.00569832940402496
sim_compute_sim_state_max0.020113155901090137
sim_compute_sim_state_mean0.020113155901090137
sim_compute_sim_state_median0.020113155901090137
sim_compute_sim_state_min0.020113155901090137
sim_render-ego0_max0.00884599485087349
sim_render-ego0_mean0.00884599485087349
sim_render-ego0_median0.00884599485087349
sim_render-ego0_min0.00884599485087349
simulation-passed1
step_physics_max0.0954855835460568
step_physics_mean0.0954855835460568
step_physics_median0.0954855835460568
step_physics_min0.0954855835460568
survival_time_max52.24999999999917
survival_time_mean52.24999999999917
survival_time_median52.24999999999917
survival_time_min52.24999999999917
No reset possible
7996716154Alejandro Gómezexercises_braitenbergmooc-BV1sim-2of5successnoreg050:14:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.225967912180343


other stats
agent_compute-ego0_max0.02570440513747079
agent_compute-ego0_mean0.02570440513747079
agent_compute-ego0_median0.02570440513747079
agent_compute-ego0_min0.02570440513747079
complete-iteration_max0.5133008333314367
complete-iteration_mean0.5133008333314367
complete-iteration_median0.5133008333314367
complete-iteration_min0.5133008333314367
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.225967912180343
distance-from-start_median4.225967912180343
distance-from-start_min4.225967912180343
driven_any_max4.693989745891221
driven_any_mean4.693989745891221
driven_any_median4.693989745891221
driven_any_min4.693989745891221
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.2697409749531946
get_duckie_state_mean0.2697409749531946
get_duckie_state_median0.2697409749531946
get_duckie_state_min0.2697409749531946
get_robot_state_max0.011687028307874664
get_robot_state_mean0.011687028307874664
get_robot_state_median0.011687028307874664
get_robot_state_min0.011687028307874664
get_state_dump_max0.04372725591940038
get_state_dump_mean0.04372725591940038
get_state_dump_median0.04372725591940038
get_state_dump_min0.04372725591940038
get_ui_image_max0.02565305999347142
get_ui_image_mean0.02565305999347142
get_ui_image_median0.02565305999347142
get_ui_image_min0.02565305999347142
in-drivable-lane_max47.54999999999944
in-drivable-lane_mean47.54999999999944
in-drivable-lane_median47.54999999999944
in-drivable-lane_min47.54999999999944
per-episodes
details{"d45-ego0": {"driven_any": 4.693989745891221, "get_ui_image": 0.02565305999347142, "step_physics": 0.0949652986366208, "survival_time": 47.54999999999944, "driven_lanedir": 0.0, "get_state_dump": 0.04372725591940038, "get_robot_state": 0.011687028307874664, "sim_render-ego0": 0.00873610151915991, "get_duckie_state": 0.2697409749531946, "in-drivable-lane": 47.54999999999944, "deviation-heading": 0.0, "agent_compute-ego0": 0.02570440513747079, "complete-iteration": 0.5133008333314367, "set_robot_commands": 0.006246813455549609, "distance-from-start": 4.225967912180343, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02082185835397544, "sim_compute_performance-ego0": 0.0057848604286418245}}
set_robot_commands_max0.006246813455549609
set_robot_commands_mean0.006246813455549609
set_robot_commands_median0.006246813455549609
set_robot_commands_min0.006246813455549609
sim_compute_performance-ego0_max0.0057848604286418245
sim_compute_performance-ego0_mean0.0057848604286418245
sim_compute_performance-ego0_median0.0057848604286418245
sim_compute_performance-ego0_min0.0057848604286418245
sim_compute_sim_state_max0.02082185835397544
sim_compute_sim_state_mean0.02082185835397544
sim_compute_sim_state_median0.02082185835397544
sim_compute_sim_state_min0.02082185835397544
sim_render-ego0_max0.00873610151915991
sim_render-ego0_mean0.00873610151915991
sim_render-ego0_median0.00873610151915991
sim_render-ego0_min0.00873610151915991
simulation-passed1
step_physics_max0.0949652986366208
step_physics_mean0.0949652986366208
step_physics_median0.0949652986366208
step_physics_min0.0949652986366208
survival_time_max47.54999999999944
survival_time_mean47.54999999999944
survival_time_median47.54999999999944
survival_time_min47.54999999999944
No reset possible
7995816149Sampsa RantaChallenge acceptedmooc-collision-check-valistep1successnoreg050:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples400
No reset possible
7995116147Sampsa Rantacollision-check-exercisemooc-collision-check-valistep1successnoreg050:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.01
false_positive_rate0.025


other stats
nsamples400
No reset possible
7990816145Thomas Steinletemplate-rosmooc-modconsimsuccessnoreg050:13:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median16.425000000000004
deviation-center-line_median0.9537602607110908
driven_lanedir_consec_median1.386299950424524
survival_time_median26.37500000000001


other stats
agent_compute-ego0_max0.040115707012003725
agent_compute-ego0_mean0.029397933079843706
agent_compute-ego0_median0.029397933079843706
agent_compute-ego0_min0.018680159147683676
complete-iteration_max0.33217687307749894
complete-iteration_mean0.3268335692822877
complete-iteration_median0.3268335692822877
complete-iteration_min0.3214902654870764
deviation-center-line_max1.9075205214221815
deviation-center-line_mean0.9537602607110908
deviation-center-line_min0.0
deviation-heading_max1.5734829387244185
deviation-heading_mean0.7867414693622092
deviation-heading_median0.7867414693622092
deviation-heading_min0.0
distance-from-start_max5.2135198165592485
distance-from-start_mean3.5317430324271597
distance-from-start_median3.5317430324271597
distance-from-start_min1.849966248295071
driven_any_max5.214535307615131
driven_any_mean3.5338923692961823
driven_any_median3.5338923692961823
driven_any_min1.8532494309772336
driven_lanedir_consec_max2.772599900849048
driven_lanedir_consec_mean1.386299950424524
driven_lanedir_consec_min0.0
driven_lanedir_max2.772599900849048
driven_lanedir_mean1.386299950424524
driven_lanedir_median1.386299950424524
driven_lanedir_min0.0
get_duckie_state_max3.611169210294398e-06
get_duckie_state_mean3.4322495471083137e-06
get_duckie_state_median3.4322495471083137e-06
get_duckie_state_min3.25332988392223e-06
get_robot_state_max0.011207577779695586
get_robot_state_mean0.01074980304027457
get_robot_state_median0.01074980304027457
get_robot_state_min0.010292028300853556
get_state_dump_max0.013565458570207868
get_state_dump_mean0.01341857544636477
get_state_dump_median0.01341857544636477
get_state_dump_min0.013271692322521674
get_ui_image_max0.0761883508037607
get_ui_image_mean0.07498355523143571
get_ui_image_median0.07498355523143571
get_ui_image_min0.07377875965911072
in-drivable-lane_max18.54999999999994
in-drivable-lane_mean16.425000000000004
in-drivable-lane_min14.300000000000068
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.214535307615131, "get_ui_image": 0.07377875965911072, "step_physics": 0.1207408552045946, "survival_time": 38.44999999999995, "driven_lanedir": 2.772599900849048, "get_state_dump": 0.013565458570207868, "get_robot_state": 0.011207577779695586, "sim_render-ego0": 0.009099508880020736, "get_duckie_state": 3.25332988392223e-06, "in-drivable-lane": 18.54999999999994, "deviation-heading": 1.5734829387244185, "agent_compute-ego0": 0.018680159147683676, "complete-iteration": 0.3214902654870764, "set_robot_commands": 0.007212152419152198, "distance-from-start": 5.2135198165592485, "deviation-center-line": 1.9075205214221815, "driven_lanedir_consec": 2.772599900849048, "sim_compute_sim_state": 0.061064052891421625, "sim_compute_performance-ego0": 0.005910370566628196}, "LF-full-loop-001-ego0": {"driven_any": 1.8532494309772336, "get_ui_image": 0.0761883508037607, "step_physics": 0.11617541562389412, "survival_time": 14.300000000000068, "driven_lanedir": 0.0, "get_state_dump": 0.013271692322521674, "get_robot_state": 0.010292028300853556, "sim_render-ego0": 0.008434243318511218, "get_duckie_state": 3.611169210294398e-06, "in-drivable-lane": 14.300000000000068, "deviation-heading": 0.0, "agent_compute-ego0": 0.040115707012003725, "complete-iteration": 0.33217687307749894, "set_robot_commands": 0.007016906339532407, "distance-from-start": 1.849966248295071, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.05475560131804037, "sim_compute_performance-ego0": 0.005687151221032758}}
set_robot_commands_max0.007212152419152198
set_robot_commands_mean0.007114529379342302
set_robot_commands_median0.007114529379342302
set_robot_commands_min0.007016906339532407
sim_compute_performance-ego0_max0.005910370566628196
sim_compute_performance-ego0_mean0.005798760893830477
sim_compute_performance-ego0_median0.005798760893830477
sim_compute_performance-ego0_min0.005687151221032758
sim_compute_sim_state_max0.061064052891421625
sim_compute_sim_state_mean0.057909827104731
sim_compute_sim_state_median0.057909827104731
sim_compute_sim_state_min0.05475560131804037
sim_render-ego0_max0.009099508880020736
sim_render-ego0_mean0.008766876099265977
sim_render-ego0_median0.008766876099265977
sim_render-ego0_min0.008434243318511218
simulation-passed1
step_physics_max0.1207408552045946
step_physics_mean0.11845813541424435
step_physics_median0.11845813541424435
step_physics_min0.11617541562389412
survival_time_max38.44999999999995
survival_time_mean26.37500000000001
survival_time_min14.300000000000068
No reset possible
7990013798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesreg050:00:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7989813798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesreg050:00:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7989713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesreg050:00:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7988616132Richard Belangerobjdet exercisemooc-objdetsimsuccessnoreg050:28:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median4.655005166189455


other stats
agent_compute-ego0_max0.04145380043169541
agent_compute-ego0_mean0.04121118332325271
agent_compute-ego0_median0.04121118332325271
agent_compute-ego0_min0.04096856621481001
complete-iteration_max0.36865711152603187
complete-iteration_mean0.3646324653609607
complete-iteration_median0.3646324653609607
complete-iteration_min0.3606078191958895
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.584206738472394
distance-from-start_mean4.654786784649158
distance-from-start_median4.654786784649158
distance-from-start_min2.725366830825921
driven_any_max6.584206738472394
driven_any_mean4.654786784649158
driven_any_median4.654786784649158
driven_any_min2.725366830825921
driven_lanedir_consec_max6.584396881256062
driven_lanedir_consec_mean4.655005166189455
driven_lanedir_consec_min2.725613451122849
driven_lanedir_max6.584396881256062
driven_lanedir_mean4.655005166189455
driven_lanedir_median4.655005166189455
driven_lanedir_min2.725613451122849
get_duckie_state_max0.05891020986857164
get_duckie_state_mean0.057786108055877056
get_duckie_state_median0.057786108055877056
get_duckie_state_min0.05666200624318246
get_robot_state_max0.011175105613435337
get_robot_state_mean0.010932055341512537
get_robot_state_median0.010932055341512537
get_robot_state_min0.010689005069589736
get_state_dump_max0.02152544910167278
get_state_dump_mean0.021178735582953585
get_state_dump_median0.021178735582953585
get_state_dump_min0.02083202206423439
get_ui_image_max0.05152619033927822
get_ui_image_mean0.05025125482894301
get_ui_image_median0.05025125482894301
get_ui_image_min0.04897631931860778
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.584206738472394, "get_ui_image": 0.05152619033927822, "step_physics": 0.10566814753733308, "survival_time": 59.99999999999873, "driven_lanedir": 6.584396881256062, "get_state_dump": 0.02152544910167278, "get_robot_state": 0.011175105613435337, "sim_render-ego0": 0.009334764909386933, "get_duckie_state": 0.05891020986857164, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.04145380043169541, "complete-iteration": 0.36865711152603187, "set_robot_commands": 0.007240916171935476, "distance-from-start": 6.584206738472394, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 6.584396881256062, "sim_compute_sim_state": 0.055582128496193865, "sim_compute_performance-ego0": 0.005997835051308663}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.725366830825921, "get_ui_image": 0.04897631931860778, "step_physics": 0.0972164399816432, "survival_time": 59.99999999999873, "driven_lanedir": 2.725613451122849, "get_state_dump": 0.02083202206423439, "get_robot_state": 0.010689005069589736, "sim_render-ego0": 0.008283039215303876, "get_duckie_state": 0.05666200624318246, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.04096856621481001, "complete-iteration": 0.3606078191958895, "set_robot_commands": 0.006971810084397747, "distance-from-start": 2.725366830825921, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.725613451122849, "sim_compute_sim_state": 0.06427545035312217, "sim_compute_performance-ego0": 0.00549928790623699}}
set_robot_commands_max0.007240916171935476
set_robot_commands_mean0.007106363128166612
set_robot_commands_median0.007106363128166612
set_robot_commands_min0.006971810084397747
sim_compute_performance-ego0_max0.005997835051308663
sim_compute_performance-ego0_mean0.005748561478772826
sim_compute_performance-ego0_median0.005748561478772826
sim_compute_performance-ego0_min0.00549928790623699
sim_compute_sim_state_max0.06427545035312217
sim_compute_sim_state_mean0.05992878942465801
sim_compute_sim_state_median0.05992878942465801
sim_compute_sim_state_min0.055582128496193865
sim_render-ego0_max0.009334764909386933
sim_render-ego0_mean0.008808902062345404
sim_render-ego0_median0.008808902062345404
sim_render-ego0_min0.008283039215303876
simulation-passed1
step_physics_max0.10566814753733308
step_physics_mean0.10144229375948816
step_physics_median0.10144229375948816
step_physics_min0.0972164399816432
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7988416137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successnoreg050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.5
false_positive_rate0.5


other stats
nsamples200
No reset possible
7987916137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successnoreg050:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.5
false_positive_rate0.49


other stats
nsamples200
No reset possible
7986816144Thomas Steinletemplate-rosmooc-modconsimfailednoreg050:15:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 842 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible