AI Driving Olympics Home Challenges Submissions Jobs

Submission 2384

Submission2384
Competingyes
Challengeaido2-LF-sim-validation
UserAndrea Censi
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23016
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessing50
User priority

23016

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230162384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes-0:06:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13345567761525645
survival_time_median1.4500000000000006
deviation-center-line_median0.07994867355059224
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20640527407328288
agent_compute-ego_mean0.1858920439042135
agent_compute-ego_median0.18367331027984615
agent_compute-ego_min0.1754624679170806
deviation-center-line_max0.09414146261203196
deviation-center-line_mean0.07965280017659804
deviation-center-line_min0.06429098237112439
deviation-heading_max1.040571163828749
deviation-heading_mean0.8224223998869524
deviation-heading_median0.8075766753179461
deviation-heading_min0.5452065286724291
driven_any_max0.22865938272464795
driven_any_mean0.1895107621062161
driven_any_median0.1939187946716417
driven_any_min0.12385415773979284
driven_lanedir_consec_max0.15130782181678004
driven_lanedir_consec_mean0.12257042208901904
driven_lanedir_consec_min0.0921415187824457
driven_lanedir_max0.15130782181678004
driven_lanedir_mean0.12257042208901904
driven_lanedir_median0.13345567761525645
driven_lanedir_min0.0921415187824457
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.020000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22865938272464795, "sim_physics": 0.14211754645070723, "survival_time": 1.5500000000000007, "driven_lanedir": 0.13345567761525645, "sim_render-ego": 0.06898718495522776, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18595345558658724, "deviation-heading": 0.9186906071993328, "set_robot_commands": 0.09925514651883031, "deviation-center-line": 0.0877966996808764, "driven_lanedir_consec": 0.13345567761525645, "sim_compute_sim_state": 0.041593213235178304, "sim_compute_performance-ego": 0.07702749006209834, "sim_compute_robot_state-ego": 0.08907461166381836}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1939187946716417, "sim_physics": 0.12360713399689773, "survival_time": 1.4500000000000006, "driven_lanedir": 0.13350899521061765, "sim_render-ego": 0.0654771245759109, "in-drivable-lane": 0, "agent_compute-ego": 0.1754624679170806, "deviation-heading": 0.8075766753179461, "set_robot_commands": 0.09932811506863298, "deviation-center-line": 0.06429098237112439, "driven_lanedir_consec": 0.13350899521061765, "sim_compute_sim_state": 0.04154490602427516, "sim_compute_performance-ego": 0.07495494546561406, "sim_compute_robot_state-ego": 0.07884983358712032}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12385415773979284, "sim_physics": 0.13712034225463868, "survival_time": 1.0000000000000002, "driven_lanedir": 0.0921415187824457, "sim_render-ego": 0.06819539070129395, "in-drivable-lane": 0, "agent_compute-ego": 0.18367331027984615, "deviation-heading": 0.5452065286724291, "set_robot_commands": 0.10622103214263916, "deviation-center-line": 0.09414146261203196, "driven_lanedir_consec": 0.0921415187824457, "sim_compute_sim_state": 0.04230225086212158, "sim_compute_performance-ego": 0.07826724052429199, "sim_compute_robot_state-ego": 0.07937324047088623}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18470139300616736, "sim_physics": 0.14238509425410517, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1024380970199954, "sim_render-ego": 0.06310428513420953, "in-drivable-lane": 0, "agent_compute-ego": 0.17796571166427047, "deviation-heading": 1.040571163828749, "set_robot_commands": 0.10401185353597003, "deviation-center-line": 0.07994867355059224, "driven_lanedir_consec": 0.1024380970199954, "sim_compute_sim_state": 0.04191563747547291, "sim_compute_performance-ego": 0.06937212414211696, "sim_compute_robot_state-ego": 0.08047486234594274}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2164200823888306, "sim_physics": 0.15296494166056315, "survival_time": 1.5000000000000009, "driven_lanedir": 0.15130782181678004, "sim_render-ego": 0.07161684036254883, "in-drivable-lane": 0, "agent_compute-ego": 0.20640527407328288, "deviation-heading": 0.800067024416305, "set_robot_commands": 0.11073330243428547, "deviation-center-line": 0.07208618266836517, "driven_lanedir_consec": 0.15130782181678004, "sim_compute_sim_state": 0.04479451974232992, "sim_compute_performance-ego": 0.08233864307403564, "sim_compute_robot_state-ego": 0.09976640542348228}}
set_robot_commands_max0.11073330243428547
set_robot_commands_mean0.1039098899400716
set_robot_commands_median0.10401185353597003
set_robot_commands_min0.09925514651883031
sim_compute_performance-ego_max0.08233864307403564
sim_compute_performance-ego_mean0.0763920886536314
sim_compute_performance-ego_median0.07702749006209834
sim_compute_performance-ego_min0.06937212414211696
sim_compute_robot_state-ego_max0.09976640542348228
sim_compute_robot_state-ego_mean0.08550779069824999
sim_compute_robot_state-ego_median0.08047486234594274
sim_compute_robot_state-ego_min0.07884983358712032
sim_compute_sim_state_max0.04479451974232992
sim_compute_sim_state_mean0.04243010546787558
sim_compute_sim_state_median0.04191563747547291
sim_compute_sim_state_min0.04154490602427516
sim_physics_max0.15296494166056315
sim_physics_mean0.1396390117233824
sim_physics_median0.14211754645070723
sim_physics_min0.12360713399689773
sim_render-ego_max0.07161684036254883
sim_render-ego_mean0.0674761651458382
sim_render-ego_median0.06819539070129395
sim_render-ego_min0.06310428513420953
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3700000000000006
survival_time_min1.0000000000000002
213472384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:06:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10819530882768236
survival_time_median1.6000000000000008
deviation-center-line_median0.05922702809365912
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.1807289645075798
agent_compute-ego_mean0.15337581640203873
agent_compute-ego_median0.1636189152212704
agent_compute-ego_min0.10521822422742844
deviation-center-line_max0.09403575193783437
deviation-center-line_mean0.06714068704926472
deviation-center-line_min0.04906170112640911
deviation-heading_max0.8690968390119935
deviation-heading_mean0.7463615728771433
deviation-heading_median0.7929429632796323
deviation-heading_min0.4907376685908688
driven_any_max0.22874006228350552
driven_any_mean0.19337465572922444
driven_any_median0.19710829083883305
driven_any_min0.1348177337597236
driven_lanedir_consec_max0.13746937776659784
driven_lanedir_consec_mean0.10720633411939776
driven_lanedir_consec_min0.06721588230301867
driven_lanedir_max0.13746937776659784
driven_lanedir_mean0.10720633411939776
driven_lanedir_median0.10819530882768236
driven_lanedir_min0.06721588230301867
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.2100000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21388544608638288, "sim_physics": 0.07598353922367096, "survival_time": 1.6000000000000008, "driven_lanedir": 0.10455158890929804, "sim_render-ego": 0.04002079367637634, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10521822422742844, "deviation-heading": 0.8690968390119935, "set_robot_commands": 0.05673227459192276, "deviation-center-line": 0.07847283630326592, "driven_lanedir_consec": 0.10455158890929804, "sim_compute_sim_state": 0.026819884777069092, "sim_compute_performance-ego": 0.04281674325466156, "sim_compute_robot_state-ego": 0.04464627802371979}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1923217456776772, "sim_physics": 0.10606812608653102, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11859951279039184, "sim_render-ego": 0.0548144373400458, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14792246654115873, "deviation-heading": 0.7929429632796323, "set_robot_commands": 0.09893019446011247, "deviation-center-line": 0.0549061177851551, "driven_lanedir_consec": 0.11859951279039184, "sim_compute_sim_state": 0.03651993850181843, "sim_compute_performance-ego": 0.06385905989285173, "sim_compute_robot_state-ego": 0.06708922057316222}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1348177337597236, "sim_physics": 0.11491893529891968, "survival_time": 1.0000000000000002, "driven_lanedir": 0.10819530882768236, "sim_render-ego": 0.06287870407104493, "in-drivable-lane": 0, "agent_compute-ego": 0.16939051151275636, "deviation-heading": 0.4907376685908688, "set_robot_commands": 0.0959615468978882, "deviation-center-line": 0.09403575193783437, "driven_lanedir_consec": 0.10819530882768236, "sim_compute_sim_state": 0.038530361652374265, "sim_compute_performance-ego": 0.0722898006439209, "sim_compute_robot_state-ego": 0.08377233743667603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19710829083883305, "sim_physics": 0.1378018856048584, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06721588230301867, "sim_render-ego": 0.06650807708501816, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1807289645075798, "deviation-heading": 0.815989813982461, "set_robot_commands": 0.09433075785636902, "deviation-center-line": 0.04906170112640911, "driven_lanedir_consec": 0.06721588230301867, "sim_compute_sim_state": 0.03669603168964386, "sim_compute_performance-ego": 0.06901966780424118, "sim_compute_robot_state-ego": 0.07231990993022919}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22874006228350552, "sim_physics": 0.1181779609006994, "survival_time": 1.7000000000000008, "driven_lanedir": 0.13746937776659784, "sim_render-ego": 0.0620187100242166, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1636189152212704, "deviation-heading": 0.763040579520761, "set_robot_commands": 0.09023671991684858, "deviation-center-line": 0.05922702809365912, "driven_lanedir_consec": 0.13746937776659784, "sim_compute_sim_state": 0.03716794182272518, "sim_compute_performance-ego": 0.07090971049140482, "sim_compute_robot_state-ego": 0.07354385712567497}}
set_robot_commands_max0.09893019446011247
set_robot_commands_mean0.08723829874462821
set_robot_commands_median0.09433075785636902
set_robot_commands_min0.05673227459192276
sim_compute_performance-ego_max0.0722898006439209
sim_compute_performance-ego_mean0.06377899641741605
sim_compute_performance-ego_median0.06901966780424118
sim_compute_performance-ego_min0.04281674325466156
sim_compute_robot_state-ego_max0.08377233743667603
sim_compute_robot_state-ego_mean0.06827432061789243
sim_compute_robot_state-ego_median0.07231990993022919
sim_compute_robot_state-ego_min0.04464627802371979
sim_compute_sim_state_max0.038530361652374265
sim_compute_sim_state_mean0.03514683168872616
sim_compute_sim_state_median0.03669603168964386
sim_compute_sim_state_min0.026819884777069092
sim_physics_max0.1378018856048584
sim_physics_mean0.11059008942293588
sim_physics_median0.11491893529891968
sim_physics_min0.07598353922367096
sim_render-ego_max0.06650807708501816
sim_render-ego_mean0.05724814443934037
sim_render-ego_median0.0620187100242166
sim_render-ego_min0.04002079367637634
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4700000000000006
survival_time_min1.0000000000000002
206352384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:05:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06187868441499644
survival_time_median1.6000000000000008
deviation-center-line_median0.04272335268548906
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.1599857423688982
agent_compute-ego_mean0.1465922218720952
agent_compute-ego_median0.15594843300906094
agent_compute-ego_min0.10666988835190282
deviation-center-line_max0.15989698687950604
deviation-center-line_mean0.0694399715661356
deviation-center-line_min0.02830496247853142
deviation-heading_max2.7898097399820316
deviation-heading_mean1.0886061102394886
deviation-heading_median0.6708352408298317
deviation-heading_min0.6256329683124823
driven_any_max0.9211311549505682
driven_any_mean0.3147551487979646
driven_any_median0.18601816950027103
driven_any_min0.08509403059536731
driven_lanedir_consec_max0.3362060906184938
driven_lanedir_consec_mean0.11687476229950512
driven_lanedir_consec_min0.030874925413984844
driven_lanedir_max0.3362060906184938
driven_lanedir_mean0.11687476229950512
driven_lanedir_median0.06187868441499644
driven_lanedir_min0.030874925413984844
in-drivable-lane_max3.249999999999992
in-drivable-lane_mean0.9699999999999986
in-drivable-lane_min0.15000000000000002
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9211311549505682, "sim_physics": 0.1052431726789141, "survival_time": 7.149999999999983, "driven_lanedir": 0.3362060906184938, "sim_render-ego": 0.06023404481527689, "in-drivable-lane": 3.249999999999992, "agent_compute-ego": 0.1599857423688982, "deviation-heading": 2.7898097399820316, "set_robot_commands": 0.08801350060042802, "deviation-center-line": 0.15989698687950604, "driven_lanedir_consec": 0.3362060906184938, "sim_compute_sim_state": 0.03771155197303612, "sim_compute_performance-ego": 0.06585636839166388, "sim_compute_robot_state-ego": 0.06956742526767971}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1736070255686064, "sim_physics": 0.0818688948949178, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06187868441499644, "sim_render-ego": 0.05637882550557454, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.15309805075327557, "deviation-heading": 0.6256329683124823, "set_robot_commands": 0.0809350570042928, "deviation-center-line": 0.02830496247853142, "driven_lanedir_consec": 0.06187868441499644, "sim_compute_sim_state": 0.0356783390045166, "sim_compute_performance-ego": 0.06553929646809896, "sim_compute_robot_state-ego": 0.06976948579152426}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08509403059536731, "sim_physics": 0.07833255421031605, "survival_time": 1.1000000000000003, "driven_lanedir": 0.030874925413984844, "sim_render-ego": 0.05873346328735352, "in-drivable-lane": 0.15000000000000002, "agent_compute-ego": 0.15594843300906094, "deviation-heading": 0.6708352408298317, "set_robot_commands": 0.08527033979242499, "deviation-center-line": 0.07537505040059012, "driven_lanedir_consec": 0.030874925413984844, "sim_compute_sim_state": 0.035703420639038086, "sim_compute_performance-ego": 0.07527151974764737, "sim_compute_robot_state-ego": 0.06382575902071866}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18601816950027103, "sim_physics": 0.0947389230132103, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05875577280594513, "sim_render-ego": 0.05932379513978958, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1572589948773384, "deviation-heading": 0.7209316647681425, "set_robot_commands": 0.08863284438848495, "deviation-center-line": 0.04089950538656141, "driven_lanedir_consec": 0.05875577280594513, "sim_compute_sim_state": 0.03542858362197876, "sim_compute_performance-ego": 0.059450216591358185, "sim_compute_robot_state-ego": 0.06262357532978058}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20792536337501005, "sim_physics": 0.07027998115077164, "survival_time": 1.6500000000000008, "driven_lanedir": 0.0966583382441053, "sim_render-ego": 0.04250970753756436, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.10666988835190282, "deviation-heading": 0.6358209373049564, "set_robot_commands": 0.06150085998303963, "deviation-center-line": 0.04272335268548906, "driven_lanedir_consec": 0.0966583382441053, "sim_compute_sim_state": 0.0259063821850401, "sim_compute_performance-ego": 0.04712531060883493, "sim_compute_robot_state-ego": 0.04742583361538974}}
set_robot_commands_max0.08863284438848495
set_robot_commands_mean0.08087052035373407
set_robot_commands_median0.08527033979242499
set_robot_commands_min0.06150085998303963
sim_compute_performance-ego_max0.07527151974764737
sim_compute_performance-ego_mean0.06264854236152066
sim_compute_performance-ego_median0.06553929646809896
sim_compute_performance-ego_min0.04712531060883493
sim_compute_robot_state-ego_max0.06976948579152426
sim_compute_robot_state-ego_mean0.06264241580501859
sim_compute_robot_state-ego_median0.06382575902071866
sim_compute_robot_state-ego_min0.04742583361538974
sim_compute_sim_state_max0.03771155197303612
sim_compute_sim_state_mean0.034085655484721936
sim_compute_sim_state_median0.0356783390045166
sim_compute_sim_state_min0.0259063821850401
sim_physics_max0.1052431726789141
sim_physics_mean0.08609270518962597
sim_physics_median0.0818688948949178
sim_physics_min0.07027998115077164
sim_render-ego_max0.06023404481527689
sim_render-ego_mean0.05543596725711177
sim_render-ego_median0.05873346328735352
sim_render-ego_min0.04250970753756436
simulation-passed1
survival_time_max7.149999999999983
survival_time_mean2.599999999999997
survival_time_min1.1000000000000003
206072384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationhost-errorno-0:04:41
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20607-757590', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20607-757590', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20607-757590', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
200252384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerrorno-0:02:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
196582384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:03:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08904933221086164
survival_time_median1.3500000000000003
deviation-center-line_median0.04013566571024201
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.19176740999575015
agent_compute-ego_mean0.15916432173796963
agent_compute-ego_median0.1489968044417245
agent_compute-ego_min0.14446348696947098
deviation-center-line_max0.05621684693435621
deviation-center-line_mean0.04177310409712117
deviation-center-line_min0.03256366167458567
deviation-heading_max0.732755310104608
deviation-heading_mean0.6773120628443443
deviation-heading_median0.6700087299649555
deviation-heading_min0.624996203475719
driven_any_max0.17593516946550708
driven_any_mean0.16198145443021916
driven_any_median0.16523958685684323
driven_any_min0.14605182895814797
driven_lanedir_consec_max0.1082337598066907
driven_lanedir_consec_mean0.08866252923843795
driven_lanedir_consec_min0.07437473258424321
driven_lanedir_max0.1082337598066907
driven_lanedir_mean0.08866252923843795
driven_lanedir_median0.08904933221086164
driven_lanedir_min0.07437473258424321
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.18000000000000016
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16826806747566164, "sim_physics": 0.022366319383893697, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0919898580177474, "sim_render-ego": 0.05874077762876238, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1489968044417245, "deviation-heading": 0.6700087299649555, "set_robot_commands": 0.08594789675303868, "deviation-center-line": 0.04013566571024201, "driven_lanedir_consec": 0.0919898580177474, "sim_compute_sim_state": 0.03597476652690342, "sim_compute_performance-ego": 0.062199882098606656, "sim_compute_robot_state-ego": 0.06458385501589094}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17593516946550708, "sim_physics": 0.01912625879049301, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07966496357264685, "sim_render-ego": 0.04925265908241272, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.14446348696947098, "deviation-heading": 0.624996203475719, "set_robot_commands": 0.07633549720048904, "deviation-center-line": 0.03256366167458567, "driven_lanedir_consec": 0.07966496357264685, "sim_compute_sim_state": 0.03164944052696228, "sim_compute_performance-ego": 0.057289302349090576, "sim_compute_robot_state-ego": 0.059224799275398254}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16523958685684323, "sim_physics": 0.02319790698863842, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1082337598066907, "sim_render-ego": 0.060658269458346896, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.19176740999575015, "deviation-heading": 0.732755310104608, "set_robot_commands": 0.09347917415477612, "deviation-center-line": 0.05621684693435621, "driven_lanedir_consec": 0.1082337598066907, "sim_compute_sim_state": 0.03728819776464392, "sim_compute_performance-ego": 0.0671521822611491, "sim_compute_robot_state-ego": 0.06652650126704464}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14605182895814797, "sim_physics": 0.023015141487121586, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07437473258424321, "sim_render-ego": 0.05421595390026386, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1467104691725511, "deviation-heading": 0.6596789354067415, "set_robot_commands": 0.08255056234506461, "deviation-center-line": 0.03468384399192496, "driven_lanedir_consec": 0.07437473258424321, "sim_compute_sim_state": 0.034123356525714583, "sim_compute_performance-ego": 0.060413012137779824, "sim_compute_robot_state-ego": 0.06062133495624249}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15441261939493592, "sim_physics": 0.023129100799560542, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08904933221086164, "sim_render-ego": 0.053166685104370115, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16388343811035155, "deviation-heading": 0.6991211352696978, "set_robot_commands": 0.08453210830688476, "deviation-center-line": 0.045265502174496965, "driven_lanedir_consec": 0.08904933221086164, "sim_compute_sim_state": 0.033094625473022464, "sim_compute_performance-ego": 0.06370179176330566, "sim_compute_robot_state-ego": 0.05932127952575684}}
set_robot_commands_max0.09347917415477612
set_robot_commands_mean0.08456904775205062
set_robot_commands_median0.08453210830688476
set_robot_commands_min0.07633549720048904
sim_compute_performance-ego_max0.0671521822611491
sim_compute_performance-ego_mean0.062151234121986365
sim_compute_performance-ego_median0.062199882098606656
sim_compute_performance-ego_min0.057289302349090576
sim_compute_robot_state-ego_max0.06652650126704464
sim_compute_robot_state-ego_mean0.06205555400806663
sim_compute_robot_state-ego_median0.06062133495624249
sim_compute_robot_state-ego_min0.059224799275398254
sim_compute_sim_state_max0.03728819776464392
sim_compute_sim_state_mean0.03442607736344934
sim_compute_sim_state_median0.034123356525714583
sim_compute_sim_state_min0.03164944052696228
sim_physics_max0.02319790698863842
sim_physics_mean0.02216694548994145
sim_physics_median0.023015141487121586
sim_physics_min0.01912625879049301
sim_render-ego_max0.060658269458346896
sim_render-ego_mean0.0552068690348312
sim_render-ego_median0.05421595390026386
sim_render-ego_min0.04925265908241272
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3800000000000003
survival_time_min1.2500000000000004
189072384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:04:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09168411810457444
survival_time_median1.4000000000000006
deviation-center-line_median0.03738462622611095
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.2618074246815273
agent_compute-ego_mean0.23965671825809637
agent_compute-ego_median0.22907150643212457
agent_compute-ego_min0.2245689971106393
deviation-center-line_max0.04543008975077391
deviation-center-line_mean0.03683944555026227
deviation-center-line_min0.0257094706357947
deviation-heading_max0.6842052506949267
deviation-heading_mean0.6448628777701277
deviation-heading_median0.6406996668380651
deviation-heading_min0.6137629919574086
driven_any_max0.208993278749454
driven_any_mean0.16892466870312145
driven_any_median0.16210268435820271
driven_any_min0.14946320112132128
driven_lanedir_consec_max0.11287440353545895
driven_lanedir_consec_mean0.08678324154576308
driven_lanedir_consec_min0.04966684745878158
driven_lanedir_max0.11287440353545895
driven_lanedir_mean0.08678324154576308
driven_lanedir_median0.09168411810457444
driven_lanedir_min0.04966684745878158
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.29000000000000026
in-drivable-lane_min0.15000000000000013
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16210268435820271, "sim_physics": 0.017290805067334856, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09168411810457444, "sim_render-ego": 0.06107690504619053, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.2618074246815273, "deviation-heading": 0.6276650742372778, "set_robot_commands": 0.07684681245258876, "deviation-center-line": 0.03589796187071441, "driven_lanedir_consec": 0.09168411810457444, "sim_compute_sim_state": 0.040510518210274835, "sim_compute_performance-ego": 0.06327951805932182, "sim_compute_robot_state-ego": 0.06334137916564941}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14946320112132128, "sim_physics": 0.015819509824117024, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04966684745878158, "sim_render-ego": 0.06079301834106445, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.22870473861694335, "deviation-heading": 0.6137629919574086, "set_robot_commands": 0.08008301258087158, "deviation-center-line": 0.0257094706357947, "driven_lanedir_consec": 0.04966684745878158, "sim_compute_sim_state": 0.036480498313903806, "sim_compute_performance-ego": 0.060522905985514325, "sim_compute_robot_state-ego": 0.05921659469604492}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15679024614579956, "sim_physics": 0.015977433749607632, "survival_time": 1.4000000000000006, "driven_lanedir": 0.08129691342031897, "sim_render-ego": 0.05663019418716431, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.2245689971106393, "deviation-heading": 0.6406996668380651, "set_robot_commands": 0.07622144903455462, "deviation-center-line": 0.03738462622611095, "driven_lanedir_consec": 0.08129691342031897, "sim_compute_sim_state": 0.03723009995051792, "sim_compute_performance-ego": 0.059169811861855645, "sim_compute_robot_state-ego": 0.058279948575156074}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.208993278749454, "sim_physics": 0.015404883553000057, "survival_time": 1.7000000000000008, "driven_lanedir": 0.11287440353545895, "sim_render-ego": 0.059829782037174, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.25413092444924745, "deviation-heading": 0.6842052506949267, "set_robot_commands": 0.07447428563061882, "deviation-center-line": 0.04543008975077391, "driven_lanedir_consec": 0.11287440353545895, "sim_compute_sim_state": 0.037393289453843064, "sim_compute_performance-ego": 0.0597079641678754, "sim_compute_robot_state-ego": 0.06173517423517564}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1672739331408297, "sim_physics": 0.016069786889212474, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09839392520968147, "sim_render-ego": 0.06096327304840088, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.22907150643212457, "deviation-heading": 0.6579814051229604, "set_robot_commands": 0.08315916572298322, "deviation-center-line": 0.0397750792679174, "driven_lanedir_consec": 0.09839392520968147, "sim_compute_sim_state": 0.03885937588555472, "sim_compute_performance-ego": 0.06160180057798113, "sim_compute_robot_state-ego": 0.05986851453781128}}
set_robot_commands_max0.08315916572298322
set_robot_commands_mean0.07815694508432339
set_robot_commands_median0.07684681245258876
set_robot_commands_min0.07447428563061882
sim_compute_performance-ego_max0.06327951805932182
sim_compute_performance-ego_mean0.06085640013050967
sim_compute_performance-ego_median0.060522905985514325
sim_compute_performance-ego_min0.059169811861855645
sim_compute_robot_state-ego_max0.06334137916564941
sim_compute_robot_state-ego_mean0.06048832224196747
sim_compute_robot_state-ego_median0.05986851453781128
sim_compute_robot_state-ego_min0.058279948575156074
sim_compute_sim_state_max0.040510518210274835
sim_compute_sim_state_mean0.03809475636281887
sim_compute_sim_state_median0.037393289453843064
sim_compute_sim_state_min0.036480498313903806
sim_physics_max0.017290805067334856
sim_physics_mean0.016112483816654408
sim_physics_median0.015977433749607632
sim_physics_min0.015404883553000057
sim_render-ego_max0.06107690504619053
sim_render-ego_mean0.059858634531998835
sim_render-ego_median0.06079301834106445
sim_render-ego_min0.05663019418716431
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4800000000000006
survival_time_min1.4000000000000006
185382384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:04:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08591362261545621
survival_time_median1.3500000000000003
deviation-center-line_median0.04228235621958391
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.26378082275390624
agent_compute-ego_mean0.21248565502220867
agent_compute-ego_median0.2002367228269577
agent_compute-ego_min0.1661463245268791
deviation-center-line_max0.05284330342917561
deviation-center-line_mean0.04342279184007208
deviation-center-line_min0.03364127815137936
deviation-heading_max0.7271839207131114
deviation-heading_mean0.6742184736384935
deviation-heading_median0.6652048015110592
deviation-heading_min0.622369155753405
driven_any_max0.1622786637906895
driven_any_mean0.1574612775061195
driven_any_median0.1573190128697238
driven_any_min0.15214363403990147
driven_lanedir_consec_max0.09758511407507207
driven_lanedir_consec_mean0.08440683267634859
driven_lanedir_consec_min0.07493124017735431
driven_lanedir_max0.09758511407507207
driven_lanedir_mean0.08440683267634859
driven_lanedir_median0.08591362261545621
driven_lanedir_min0.07493124017735431
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.2400000000000002
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1622786637906895, "sim_physics": 0.018357999863163117, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07644555623533567, "sim_render-ego": 0.06725732741817352, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1661463245268791, "deviation-heading": 0.622369155753405, "set_robot_commands": 0.07822325152735557, "deviation-center-line": 0.03364127815137936, "driven_lanedir_consec": 0.07644555623533567, "sim_compute_sim_state": 0.04125268228592411, "sim_compute_performance-ego": 0.06216579098855295, "sim_compute_robot_state-ego": 0.06654837054591026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15214363403990147, "sim_physics": 0.015515356063842774, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08715863027852466, "sim_render-ego": 0.05911397933959961, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17931326866149902, "deviation-heading": 0.7271839207131114, "set_robot_commands": 0.07356452941894531, "deviation-center-line": 0.05284330342917561, "driven_lanedir_consec": 0.08715863027852466, "sim_compute_sim_state": 0.04057144165039062, "sim_compute_performance-ego": 0.06011554718017578, "sim_compute_robot_state-ego": 0.06346545219421387}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15987418235648682, "sim_physics": 0.015846602618694305, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07493124017735431, "sim_render-ego": 0.06609972566366196, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2002367228269577, "deviation-heading": 0.6652048015110592, "set_robot_commands": 0.07605556398630142, "deviation-center-line": 0.03707094101643475, "driven_lanedir_consec": 0.07493124017735431, "sim_compute_sim_state": 0.04222404956817627, "sim_compute_performance-ego": 0.06740090996026993, "sim_compute_robot_state-ego": 0.06518090516328812}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1573190128697238, "sim_physics": 0.01717057228088379, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09758511407507207, "sim_render-ego": 0.06182302474975586, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.26378082275390624, "deviation-heading": 0.6989190018925228, "set_robot_commands": 0.07338825225830078, "deviation-center-line": 0.0512760803837868, "driven_lanedir_consec": 0.09758511407507207, "sim_compute_sim_state": 0.03591335296630859, "sim_compute_performance-ego": 0.06346601486206055, "sim_compute_robot_state-ego": 0.06596061706542969}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15569089447379597, "sim_physics": 0.017033073637220595, "survival_time": 1.3500000000000003, "driven_lanedir": 0.08591362261545621, "sim_render-ego": 0.06009581353929308, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.2529511363418014, "deviation-heading": 0.6574154883223693, "set_robot_commands": 0.07503829178986726, "deviation-center-line": 0.04228235621958391, "driven_lanedir_consec": 0.08591362261545621, "sim_compute_sim_state": 0.038694143295288086, "sim_compute_performance-ego": 0.05990589989556207, "sim_compute_robot_state-ego": 0.058747565304791485}}
set_robot_commands_max0.07822325152735557
set_robot_commands_mean0.07525397779615407
set_robot_commands_median0.07503829178986726
set_robot_commands_min0.07338825225830078
sim_compute_performance-ego_max0.06740090996026993
sim_compute_performance-ego_mean0.06261083257732425
sim_compute_performance-ego_median0.06216579098855295
sim_compute_performance-ego_min0.05990589989556207
sim_compute_robot_state-ego_max0.06654837054591026
sim_compute_robot_state-ego_mean0.06398058205472669
sim_compute_robot_state-ego_median0.06518090516328812
sim_compute_robot_state-ego_min0.058747565304791485
sim_compute_sim_state_max0.04222404956817627
sim_compute_sim_state_mean0.039731133953217534
sim_compute_sim_state_median0.04057144165039062
sim_compute_sim_state_min0.03591335296630859
sim_physics_max0.018357999863163117
sim_physics_mean0.016784720892760917
sim_physics_median0.017033073637220595
sim_physics_min0.015515356063842774
sim_render-ego_max0.06725732741817352
sim_render-ego_mean0.06287797414209681
sim_render-ego_median0.06182302474975586
sim_render-ego_min0.05911397933959961
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.4000000000000006
survival_time_min1.2500000000000004
179112384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:07:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0492338063782265
survival_time_median0.5499999999999999
deviation-center-line_median0.008666570500436094
in-drivable-lane_median0.24999999999999992


other stats
agent_compute-ego_max0.3391496484929865
agent_compute-ego_mean0.30667300708366163
agent_compute-ego_median0.30240962505340574
agent_compute-ego_min0.26703247626622517
deviation-center-line_max0.5453592060884018
deviation-center-line_mean0.11584705633390092
deviation-center-line_min0.007023294218670619
deviation-heading_max4.135092071581598
deviation-heading_mean1.0025039592406149
deviation-heading_median0.22800643232596268
deviation-heading_min0.1886830151231741
driven_any_max4.247743214356652
driven_any_mean0.9751329964324784
driven_any_median0.1615960989391667
driven_any_min0.1481606627381193
driven_lanedir_consec_max0.6043996458447838
driven_lanedir_consec_mean0.1575806829848777
driven_lanedir_consec_min0.03558865171397052
driven_lanedir_max0.7000782083656432
driven_lanedir_mean0.1767163954890496
driven_lanedir_median0.0492338063782265
driven_lanedir_min0.03558865171397052
in-drivable-lane_max10.150000000000066
in-drivable-lane_mean2.210000000000013
in-drivable-lane_min0.19999999999999996
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15203267853100777, "sim_physics": 0.012575531005859376, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03558865171397052, "sim_render-ego": 0.05971088409423828, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.2970879077911377, "deviation-heading": 0.23319607184213745, "set_robot_commands": 0.0715179204940796, "deviation-center-line": 0.007023294218670619, "driven_lanedir_consec": 0.03558865171397052, "sim_compute_sim_state": 0.03711724281311035, "sim_compute_performance-ego": 0.05807993412017822, "sim_compute_robot_state-ego": 0.058942008018493655}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.247743214356652, "sim_physics": 0.013455992539723714, "survival_time": 14.950000000000076, "driven_lanedir": 0.7000782083656432, "sim_render-ego": 0.0631823190053304, "in-drivable-lane": 10.150000000000066, "agent_compute-ego": 0.26703247626622517, "deviation-heading": 4.135092071581598, "set_robot_commands": 0.0747950553894043, "deviation-center-line": 0.5453592060884018, "driven_lanedir_consec": 0.6043996458447838, "sim_compute_sim_state": 0.03965145905812582, "sim_compute_performance-ego": 0.06362176736195882, "sim_compute_robot_state-ego": 0.06533938487370809}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1615960989391667, "sim_physics": 0.01267829808321866, "survival_time": 0.5499999999999999, "driven_lanedir": 0.05594447193150165, "sim_render-ego": 0.05707127397710627, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.327685377814553, "deviation-heading": 0.1886830151231741, "set_robot_commands": 0.06978329745205966, "deviation-center-line": 0.00834379090339981, "driven_lanedir_consec": 0.05594447193150165, "sim_compute_sim_state": 0.0380808873610063, "sim_compute_performance-ego": 0.06418160958723589, "sim_compute_robot_state-ego": 0.06614691560918634}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16613232759744684, "sim_physics": 0.014735395258123224, "survival_time": 0.5499999999999999, "driven_lanedir": 0.0492338063782265, "sim_render-ego": 0.05734983357516202, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.3391496484929865, "deviation-heading": 0.22754220533020353, "set_robot_commands": 0.08634042739868164, "deviation-center-line": 0.009842419958596228, "driven_lanedir_consec": 0.0492338063782265, "sim_compute_sim_state": 0.0362312143499201, "sim_compute_performance-ego": 0.06079552390358665, "sim_compute_robot_state-ego": 0.06385064125061035}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1481606627381193, "sim_physics": 0.013873791694641114, "survival_time": 0.49999999999999994, "driven_lanedir": 0.042736839055906195, "sim_render-ego": 0.05416793823242187, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.30240962505340574, "deviation-heading": 0.22800643232596268, "set_robot_commands": 0.07355947494506836, "deviation-center-line": 0.008666570500436094, "driven_lanedir_consec": 0.042736839055906195, "sim_compute_sim_state": 0.03773066997528076, "sim_compute_performance-ego": 0.05715610980987549, "sim_compute_robot_state-ego": 0.05976319313049317}}
set_robot_commands_max0.08634042739868164
set_robot_commands_mean0.07519923513585872
set_robot_commands_median0.07355947494506836
set_robot_commands_min0.06978329745205966
sim_compute_performance-ego_max0.06418160958723589
sim_compute_performance-ego_mean0.060766988956567014
sim_compute_performance-ego_median0.06079552390358665
sim_compute_performance-ego_min0.05715610980987549
sim_compute_robot_state-ego_max0.06614691560918634
sim_compute_robot_state-ego_mean0.06280842857649832
sim_compute_robot_state-ego_median0.06385064125061035
sim_compute_robot_state-ego_min0.058942008018493655
sim_compute_sim_state_max0.03965145905812582
sim_compute_sim_state_mean0.03776229471148866
sim_compute_sim_state_median0.03773066997528076
sim_compute_sim_state_min0.0362312143499201
sim_physics_max0.014735395258123224
sim_physics_mean0.013463801716313218
sim_physics_median0.013455992539723714
sim_physics_min0.012575531005859376
sim_render-ego_max0.0631823190053304
sim_render-ego_mean0.05829644977685176
sim_render-ego_median0.05734983357516202
sim_render-ego_min0.05416793823242187
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean3.4100000000000157
survival_time_min0.49999999999999994
177622384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:03:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.14309226177090295
survival_time_median0.49999999999999994
deviation-center-line_median0.027862586541583537
in-drivable-lane_median0


other stats
agent_compute-ego_max0.26486873626708984
agent_compute-ego_mean0.2061633619515583
agent_compute-ego_median0.1837653848859999
agent_compute-ego_min0.17895808815956116
deviation-center-line_max0.033666244321213824
deviation-center-line_mean0.02733984480463978
deviation-center-line_min0.020362555680976925
deviation-heading_max0.30523569334079226
deviation-heading_mean0.2892535224118652
deviation-heading_median0.2886156722464982
deviation-heading_min0.27742968937929924
driven_any_max0.25393352658124
driven_any_mean0.2022970198642439
driven_any_median0.19263245250636615
driven_any_min0.16811844494479136
driven_lanedir_consec_max0.1986093982658419
driven_lanedir_consec_mean0.14246188286513373
driven_lanedir_consec_min0.09131517826521118
driven_lanedir_max0.1986093982658419
driven_lanedir_mean0.14246188286513373
driven_lanedir_median0.14309226177090295
driven_lanedir_min0.09131517826521118
in-drivable-lane_max0.04999999999999999
in-drivable-lane_mean0.009999999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19263245250636615, "sim_physics": 0.015108108520507812, "survival_time": 0.49999999999999994, "driven_lanedir": 0.14831274574430608, "sim_render-ego": 0.06502938270568848, "in-drivable-lane": 0, "agent_compute-ego": 0.18122222423553463, "deviation-heading": 0.2949958526912856, "set_robot_commands": 0.07434394359588622, "deviation-center-line": 0.033666244321213824, "driven_lanedir_consec": 0.14831274574430608, "sim_compute_sim_state": 0.03979334831237793, "sim_compute_performance-ego": 0.057992053031921384, "sim_compute_robot_state-ego": 0.058678936958312986}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16811844494479136, "sim_physics": 0.012345701456069946, "survival_time": 0.4, "driven_lanedir": 0.09131517826521118, "sim_render-ego": 0.050351858139038086, "in-drivable-lane": 0, "agent_compute-ego": 0.17895808815956116, "deviation-heading": 0.30523569334079226, "set_robot_commands": 0.07979455590248108, "deviation-center-line": 0.023234084254213146, "driven_lanedir_consec": 0.09131517826521118, "sim_compute_sim_state": 0.03350076079368591, "sim_compute_performance-ego": 0.05305415391921997, "sim_compute_robot_state-ego": 0.06244853138923645}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.18820195087927616, "sim_physics": 0.0119885073767768, "survival_time": 0.45, "driven_lanedir": 0.13097983027940652, "sim_render-ego": 0.058970133463541664, "in-drivable-lane": 0, "agent_compute-ego": 0.1837653848859999, "deviation-heading": 0.2886156722464982, "set_robot_commands": 0.07636706034342448, "deviation-center-line": 0.027862586541583537, "driven_lanedir_consec": 0.13097983027940652, "sim_compute_sim_state": 0.04275872972276476, "sim_compute_performance-ego": 0.06199402279324002, "sim_compute_robot_state-ego": 0.06300759315490723}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.25393352658124, "sim_physics": 0.012245373292402788, "survival_time": 0.5499999999999999, "driven_lanedir": 0.1986093982658419, "sim_render-ego": 0.05465171553871848, "in-drivable-lane": 0, "agent_compute-ego": 0.26486873626708984, "deviation-heading": 0.27999070440145085, "set_robot_commands": 0.07261451807889072, "deviation-center-line": 0.03157375322521147, "driven_lanedir_consec": 0.1986093982658419, "sim_compute_sim_state": 0.03516977483575994, "sim_compute_performance-ego": 0.057831374081698333, "sim_compute_robot_state-ego": 0.0621727163141424}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2085987244095457, "sim_physics": 0.013647296211936256, "survival_time": 0.5499999999999999, "driven_lanedir": 0.14309226177090295, "sim_render-ego": 0.06258392333984375, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.22200237620960583, "deviation-heading": 0.27742968937929924, "set_robot_commands": 0.0778360366821289, "deviation-center-line": 0.020362555680976925, "driven_lanedir_consec": 0.14309226177090295, "sim_compute_sim_state": 0.041250423951582474, "sim_compute_performance-ego": 0.06540075215426358, "sim_compute_robot_state-ego": 0.06796468387950551}}
set_robot_commands_max0.07979455590248108
set_robot_commands_mean0.07619122292056228
set_robot_commands_median0.07636706034342448
set_robot_commands_min0.07261451807889072
sim_compute_performance-ego_max0.06540075215426358
sim_compute_performance-ego_mean0.05925447119606866
sim_compute_performance-ego_median0.057992053031921384
sim_compute_performance-ego_min0.05305415391921997
sim_compute_robot_state-ego_max0.06796468387950551
sim_compute_robot_state-ego_mean0.06285449233922091
sim_compute_robot_state-ego_median0.06244853138923645
sim_compute_robot_state-ego_min0.058678936958312986
sim_compute_sim_state_max0.04275872972276476
sim_compute_sim_state_mean0.038494607523234206
sim_compute_sim_state_median0.03979334831237793
sim_compute_sim_state_min0.03350076079368591
sim_physics_max0.015108108520507812
sim_physics_mean0.01306699737153872
sim_physics_median0.012345701456069946
sim_physics_min0.0119885073767768
sim_render-ego_max0.06502938270568848
sim_render-ego_mean0.05831740263736609
sim_render-ego_median0.058970133463541664
sim_render-ego_min0.050351858139038086
simulation-passed1
survival_time_max0.5499999999999999
survival_time_mean0.48999999999999994
survival_time_min0.4
175662384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:03:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06827346217896346
survival_time_median0.49999999999999994
deviation-center-line_median0.009500218743329774
in-drivable-lane_median0.19999999999999996


other stats
agent_compute-ego_max0.22631104787190756
agent_compute-ego_mean0.20471026102701825
agent_compute-ego_median0.21764953136444093
agent_compute-ego_min0.16676905155181884
deviation-center-line_max0.013795833178615487
deviation-center-line_mean0.010207102944378942
deviation-center-line_min0.008650642668958316
deviation-heading_max0.2263600585831548
deviation-heading_mean0.20912932769450193
deviation-heading_median0.2115131753551608
deviation-heading_min0.1940939023214228
driven_any_max0.17301347449321022
driven_any_mean0.1653330094028725
driven_any_median0.16806535041271312
driven_any_min0.15594992193497675
driven_lanedir_consec_max0.08518884240781377
driven_lanedir_consec_mean0.06681416126707977
driven_lanedir_consec_min0.05329073985858912
driven_lanedir_max0.08518884240781377
driven_lanedir_mean0.06681416126707977
driven_lanedir_median0.06827346217896346
driven_lanedir_min0.05329073985858912
in-drivable-lane_max0.19999999999999996
in-drivable-lane_mean0.17999999999999994
in-drivable-lane_min0.14999999999999997
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17014180631424294, "sim_physics": 0.014520978927612303, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06999983811956012, "sim_render-ego": 0.06594688892364502, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.18768503665924072, "deviation-heading": 0.1974597303744625, "set_robot_commands": 0.08263778686523438, "deviation-center-line": 0.009500218743329774, "driven_lanedir_consec": 0.06999983811956012, "sim_compute_sim_state": 0.04279780387878418, "sim_compute_performance-ego": 0.0710226058959961, "sim_compute_robot_state-ego": 0.06788544654846192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15949449385921952, "sim_physics": 0.01287076473236084, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06827346217896346, "sim_render-ego": 0.06893129348754883, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.21764953136444093, "deviation-heading": 0.1940939023214228, "set_robot_commands": 0.0822690486907959, "deviation-center-line": 0.009110194604717353, "driven_lanedir_consec": 0.06827346217896346, "sim_compute_sim_state": 0.03524124622344971, "sim_compute_performance-ego": 0.06362400054931641, "sim_compute_robot_state-ego": 0.06197965145111084}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17301347449321022, "sim_physics": 0.013411879539489746, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05329073985858912, "sim_render-ego": 0.06702301502227784, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.16676905155181884, "deviation-heading": 0.2115131753551608, "set_robot_commands": 0.07852721214294434, "deviation-center-line": 0.008650642668958316, "driven_lanedir_consec": 0.05329073985858912, "sim_compute_sim_state": 0.042772650718688965, "sim_compute_performance-ego": 0.06611435413360596, "sim_compute_robot_state-ego": 0.06635541915893554}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15594992193497675, "sim_physics": 0.012058125601874458, "survival_time": 0.45, "driven_lanedir": 0.0573179237704724, "sim_render-ego": 0.06721700562371148, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.22631104787190756, "deviation-heading": 0.21621977183830865, "set_robot_commands": 0.08227904637654622, "deviation-center-line": 0.009978625526273786, "driven_lanedir_consec": 0.0573179237704724, "sim_compute_sim_state": 0.04060045878092448, "sim_compute_performance-ego": 0.06493679682413737, "sim_compute_robot_state-ego": 0.060314575831095375}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16806535041271312, "sim_physics": 0.013385963439941409, "survival_time": 0.49999999999999994, "driven_lanedir": 0.08518884240781377, "sim_render-ego": 0.06559736728668213, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.2251366376876831, "deviation-heading": 0.2263600585831548, "set_robot_commands": 0.07763357162475586, "deviation-center-line": 0.013795833178615487, "driven_lanedir_consec": 0.08518884240781377, "sim_compute_sim_state": 0.041727113723754886, "sim_compute_performance-ego": 0.06521744728088379, "sim_compute_robot_state-ego": 0.0640596628189087}}
set_robot_commands_max0.08263778686523438
set_robot_commands_mean0.08066933314005534
set_robot_commands_median0.0822690486907959
set_robot_commands_min0.07763357162475586
sim_compute_performance-ego_max0.0710226058959961
sim_compute_performance-ego_mean0.06618304093678792
sim_compute_performance-ego_median0.06521744728088379
sim_compute_performance-ego_min0.06362400054931641
sim_compute_robot_state-ego_max0.06788544654846192
sim_compute_robot_state-ego_mean0.06411895116170248
sim_compute_robot_state-ego_median0.0640596628189087
sim_compute_robot_state-ego_min0.060314575831095375
sim_compute_sim_state_max0.04279780387878418
sim_compute_sim_state_mean0.04062785466512044
sim_compute_sim_state_median0.041727113723754886
sim_compute_sim_state_min0.03524124622344971
sim_physics_max0.014520978927612303
sim_physics_mean0.01324954244825575
sim_physics_median0.013385963439941409
sim_physics_min0.012058125601874458
sim_render-ego_max0.06893129348754883
sim_render-ego_mean0.06694311406877305
sim_render-ego_median0.06702301502227784
sim_render-ego_min0.06559736728668213
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.48999999999999994
survival_time_min0.45
175622384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationhost-errorno-0:01:19
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job17562-6653', 'pull']:

   >  Command '['docker-compose', '-p', 'job17562-6653', 'pull']' returned non-zero exit status 1.

stdout | 

stderr | Pulling evaluator      ...
stderr | Pulling scenario_maker ...
stderr | Pulling simulator      ...
stderr | Pulling solution       ...
stderr | 
stderr | ERROR: for simulator  write /var/lib/docker/tmp/GetImageBlob507463442: no space left on device
stderr | 
stderr | ERROR: for solution  write /var/lib/docker/tmp/GetImageBlob229330070: no space left on device
stderr | 
stderr | ERROR: for evaluator  failed to register layer: Error processing tar file(exit status 1): write /usr/local/lib/python3.7/site-packages/plotly/validators/layout/image/_x.py: no space left on device
stderr | 
stderr | ERROR: for scenario_maker  failed to register layer: Error processing tar file(exit status 1): write /usr/local/lib/python3.7/site-packages/plotly/validators/layout/image/_x.py: no space left on device
stderr | failed to register layer: Error processing tar file(exit status 1): write /usr/local/lib/python3.7/site-packages/plotly/validators/layout/image/_x.py: no space left on device
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.