AI Driving Olympics Home Challenges Submissions Jobs

Submission 3397

Submission3397
Competingyes
Challengeaido2-LF-sim-testing
Userjp18813100494
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22342
Next
User labelRL-TH-shi
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223423397jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationerroryes-0:56:47
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
220333397jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationsuccessno-0:58:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.587521570318358
survival_time_median14.950000000000076
deviation-center-line_median0.7858888668943199
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.20324397563934327
agent_compute-ego_mean0.16530282933351317
agent_compute-ego_median0.17682173490524292
agent_compute-ego_min0.13467177267997496
deviation-center-line_max1.241547377665953
deviation-center-line_mean0.7216313266428078
deviation-center-line_min0.10707862518563668
deviation-heading_max7.071985149105531
deviation-heading_mean3.1022584801767477
deviation-heading_median2.75021711739316
deviation-heading_min0.37045205877278664
driven_any_max4.151453746463873
driven_any_mean2.6165489101195054
driven_any_median2.6880721214847387
driven_any_min0.5843345886026792
driven_lanedir_consec_max4.088309075320682
driven_lanedir_consec_mean2.4390666010485744
driven_lanedir_consec_min0.5591027685134207
driven_lanedir_max4.088309075320682
driven_lanedir_mean2.4452862570059968
driven_lanedir_median2.587521570318358
driven_lanedir_min0.5591027685134207
in-drivable-lane_max4.249999999999996
in-drivable-lane_mean0.9300000000000028
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9344828058048589, "sim_physics": 0.11131460405886172, "survival_time": 12.800000000000049, "driven_lanedir": 1.5355003204817352, "sim_render-ego": 0.06264701392501593, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.17762088682502508, "deviation-heading": 6.25083347122875, "set_robot_commands": 0.09609784837812184, "deviation-center-line": 0.6888779437771526, "driven_lanedir_consec": 1.4534666729068475, "sim_compute_sim_state": 0.039312949404120445, "sim_compute_performance-ego": 0.06888494919985533, "sim_compute_robot_state-ego": 0.07583011873066425}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.8092564987058544, "sim_physics": 0.1182784636815389, "survival_time": 14.950000000000076, "driven_lanedir": 3.6810027659603217, "sim_render-ego": 0.06777841806411743, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.18963438669840496, "deviation-heading": 2.3879231605595654, "set_robot_commands": 0.10462818066279092, "deviation-center-line": 0.9136621314215104, "driven_lanedir_consec": 3.6810027659603217, "sim_compute_sim_state": 0.04216038703918457, "sim_compute_performance-ego": 0.07421852032343547, "sim_compute_robot_state-ego": 0.08137588818868001}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3665190430801657, "sim_physics": 0.12655502973600877, "survival_time": 4.299999999999993, "driven_lanedir": 1.225907898577684, "sim_render-ego": 0.06747301234755405, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.18220063974690992, "deviation-heading": 0.8414081094995131, "set_robot_commands": 0.1005427504694739, "deviation-center-line": 0.27263607478505886, "driven_lanedir_consec": 1.225907898577684, "sim_compute_sim_state": 0.0425046820973241, "sim_compute_performance-ego": 0.07684738968693933, "sim_compute_robot_state-ego": 0.07794213017752004}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6065162562211617, "sim_physics": 0.11716188585138046, "survival_time": 8.649999999999988, "driven_lanedir": 1.293494260500215, "sim_render-ego": 0.06353557316554075, "in-drivable-lane": 4.249999999999996, "agent_compute-ego": 0.1776367860033333, "deviation-heading": 0.6384326421088591, "set_robot_commands": 0.10047345492192086, "deviation-center-line": 0.20658495908403005, "driven_lanedir_consec": 1.293494260500215, "sim_compute_sim_state": 0.04196304668580866, "sim_compute_performance-ego": 0.07417442481641824, "sim_compute_robot_state-ego": 0.07744612032278425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2445397250015944, "sim_physics": 0.12339991092681885, "survival_time": 14.950000000000076, "driven_lanedir": 2.023882936274182, "sim_render-ego": 0.06714134693145751, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.20324397563934327, "deviation-heading": 7.071985149105531, "set_robot_commands": 0.10379162470499674, "deviation-center-line": 0.5655973315416546, "driven_lanedir_consec": 2.012621744487736, "sim_compute_sim_state": 0.04231700976689656, "sim_compute_performance-ego": 0.07637276967366537, "sim_compute_robot_state-ego": 0.08705077489217122}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.334409222996135, "sim_physics": 0.12125200907389325, "survival_time": 14.950000000000076, "driven_lanedir": 3.1642083661373364, "sim_render-ego": 0.06406582355499267, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.17682173490524292, "deviation-heading": 2.75021711739316, "set_robot_commands": 0.1015057905515035, "deviation-center-line": 1.1213341589204266, "driven_lanedir_consec": 3.1642083661373364, "sim_compute_sim_state": 0.04122875372568766, "sim_compute_performance-ego": 0.07504116376241048, "sim_compute_robot_state-ego": 0.07898723045984904}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.694164930908004, "sim_physics": 0.1249418330192566, "survival_time": 14.950000000000076, "driven_lanedir": 2.6114921016154424, "sim_render-ego": 0.06605112314224243, "in-drivable-lane": 0, "agent_compute-ego": 0.17983638525009157, "deviation-heading": 3.5068225382075555, "set_robot_commands": 0.09980441570281982, "deviation-center-line": 0.7858888668943199, "driven_lanedir_consec": 2.6114921016154424, "sim_compute_sim_state": 0.0410329786936442, "sim_compute_performance-ego": 0.07419214884440105, "sim_compute_robot_state-ego": 0.07704314947128296}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.951876372918241, "sim_physics": 0.13369003772735596, "survival_time": 14.950000000000076, "driven_lanedir": 1.554409332231617, "sim_render-ego": 0.06786174376805623, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.1961675516764323, "deviation-heading": 6.369645564010951, "set_robot_commands": 0.10377514123916626, "deviation-center-line": 1.241547377665953, "driven_lanedir_consec": 1.554409332231617, "sim_compute_sim_state": 0.04287583669026693, "sim_compute_performance-ego": 0.07647014061609904, "sim_compute_robot_state-ego": 0.08670267422993978}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.477551190932583, "sim_physics": 0.08610780316014444, "survival_time": 7.7499999999999805, "driven_lanedir": 2.3808848392157773, "sim_render-ego": 0.049021905468356226, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.13467177267997496, "deviation-heading": 1.0794932338361498, "set_robot_commands": 0.07227320363444667, "deviation-center-line": 0.2779474707495926, "driven_lanedir_consec": 2.3808848392157773, "sim_compute_sim_state": 0.03254764926049017, "sim_compute_performance-ego": 0.05629054038755355, "sim_compute_robot_state-ego": 0.05766635402556389}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.022470387250509, "sim_physics": 0.08712589104970296, "survival_time": 14.950000000000076, "driven_lanedir": 2.793280605876886, "sim_render-ego": 0.05039700428644816, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.13798319657643637, "deviation-heading": 2.5403815151300173, "set_robot_commands": 0.07448871850967408, "deviation-center-line": 0.865388818540996, "driven_lanedir_consec": 2.793280605876886, "sim_compute_sim_state": 0.03257162094116211, "sim_compute_performance-ego": 0.05529180367787679, "sim_compute_robot_state-ego": 0.05834012667338053}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 3.303075846021778, "sim_physics": 0.08993508736292521, "survival_time": 14.950000000000076, "driven_lanedir": 3.216499281760903, "sim_render-ego": 0.04930716991424561, "in-drivable-lane": 0, "agent_compute-ego": 0.13820693095525105, "deviation-heading": 3.1344515495985688, "set_robot_commands": 0.07384857575098673, "deviation-center-line": 0.9566655512758564, "driven_lanedir_consec": 3.216499281760903, "sim_compute_sim_state": 0.03268439531326294, "sim_compute_performance-ego": 0.05534936189651489, "sim_compute_robot_state-ego": 0.0578100848197937}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.6880721214847387, "sim_physics": 0.08934972047805786, "survival_time": 14.950000000000076, "driven_lanedir": 2.587521570318358, "sim_render-ego": 0.04913323720296224, "in-drivable-lane": 0, "agent_compute-ego": 0.1355832576751709, "deviation-heading": 3.597466743327468, "set_robot_commands": 0.07294434785842896, "deviation-center-line": 1.2239309985719986, "driven_lanedir_consec": 2.587521570318358, "sim_compute_sim_state": 0.03222354729970296, "sim_compute_performance-ego": 0.05430604616800944, "sim_compute_robot_state-ego": 0.056517442067464195}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.5843345886026792, "sim_physics": 0.10335205495357512, "survival_time": 1.6000000000000008, "driven_lanedir": 0.5591027685134207, "sim_render-ego": 0.05995167791843414, "in-drivable-lane": 0, "agent_compute-ego": 0.17618288099765778, "deviation-heading": 0.37045205877278664, "set_robot_commands": 0.09302157163619997, "deviation-center-line": 0.10707862518563668, "driven_lanedir_consec": 0.5591027685134207, "sim_compute_sim_state": 0.0395565927028656, "sim_compute_performance-ego": 0.06707625091075897, "sim_compute_robot_state-ego": 0.07065895199775696}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.151453746463873, "sim_physics": 0.08283527771631877, "survival_time": 14.950000000000076, "driven_lanedir": 4.088309075320682, "sim_render-ego": 0.04862961133321126, "in-drivable-lane": 0, "agent_compute-ego": 0.13476049820582073, "deviation-heading": 2.437757169176842, "set_robot_commands": 0.07353519598642985, "deviation-center-line": 0.6460706317975551, "driven_lanedir_consec": 4.088309075320682, "sim_compute_sim_state": 0.03170078674952189, "sim_compute_performance-ego": 0.05359811226526896, "sim_compute_robot_state-ego": 0.0571161683400472}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.079510915400405, "sim_physics": 0.08897622426350911, "survival_time": 14.950000000000076, "driven_lanedir": 3.963797732305389, "sim_render-ego": 0.05015342950820923, "in-drivable-lane": 0, "agent_compute-ego": 0.13899155616760253, "deviation-heading": 3.556607180695506, "set_robot_commands": 0.07602832158406575, "deviation-center-line": 0.9512589594303776, "driven_lanedir_consec": 3.963797732305389, "sim_compute_sim_state": 0.032166968981424966, "sim_compute_performance-ego": 0.05577219724655151, "sim_compute_robot_state-ego": 0.05901548385620117}}
set_robot_commands_max0.10462818066279092
set_robot_commands_mean0.08978394277273506
set_robot_commands_median0.09609784837812184
set_robot_commands_min0.07227320363444667
sim_compute_performance-ego_max0.07684738968693933
sim_compute_performance-ego_mean0.06625905463171723
sim_compute_performance-ego_median0.06888494919985533
sim_compute_performance-ego_min0.05359811226526896
sim_compute_robot_state-ego_max0.08705077489217122
sim_compute_robot_state-ego_mean0.07063351321687329
sim_compute_robot_state-ego_median0.07583011873066425
sim_compute_robot_state-ego_min0.056517442067464195
sim_compute_sim_state_max0.04287583669026693
sim_compute_sim_state_mean0.03778981369009092
sim_compute_sim_state_median0.0395565927028656
sim_compute_sim_state_min0.03170078674952189
sim_physics_max0.13369003772735596
sim_physics_mean0.10695172220395652
sim_physics_median0.11131460405886172
sim_physics_min0.08283527771631877
sim_render-ego_max0.06786174376805623
sim_render-ego_mean0.05887653936872293
sim_render-ego_median0.06264701392501593
sim_render-ego_min0.04862961133321126
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.306666666666718
survival_time_min1.6000000000000008
220293397jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationhost-errorno-0:19:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22029-657143', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22029-657143', 'down']:

   >  Command '['docker-compose', '-p', 'job22029-657143', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.