AI Driving Olympics Home Challenges Submissions Jobs

Submission 3376

Submission3376
Competingyes
Challengeaido2-LF-sim-validation
Userbghost
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22366
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
User priority50

22366

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223663376bghostchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessyes-0:08:00(hidden)
driven_lanedir_consec_median0.545165115501308
survival_time_median4.249999999999993
deviation-center-line_median0.38220807726615064
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08602378338198119
agent_compute-ego_mean0.08444005559893572
agent_compute-ego_median0.08459410746453216
agent_compute-ego_min0.08170116742451985
deviation-center-line_max0.6851726515373695
deviation-center-line_mean0.43483601788323983
deviation-center-line_min0.32812209250206315
deviation-heading_max2.644249537418989
deviation-heading_mean1.8032179358826348
deviation-heading_median2.2836391339999964
deviation-heading_min0.4328152896223945
driven_any_max1.4007867773463258
driven_any_mean0.8769486392470303
driven_any_median0.6292841690703669
driven_any_min0.5490562233972381
driven_lanedir_consec_max1.3101922324176147
driven_lanedir_consec_mean0.737467426850699
driven_lanedir_consec_min0.2095361797399924
driven_lanedir_max1.3101922324176147
driven_lanedir_mean0.7688003075055441
driven_lanedir_median0.545165115501308
driven_lanedir_min0.36620058301421854
in-drivable-lane_max0.6499999999999997
in-drivable-lane_mean0.1399999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5735455841291189, "sim_physics": 0.05626076686231396, "survival_time": 3.949999999999994, "driven_lanedir": 0.5275753452264782, "sim_render-ego": 0.05725091922132275, "in-drivable-lane": 0, "agent_compute-ego": 0.08602378338198119, "deviation-heading": 1.220950559604005, "set_robot_commands": 0.07776016826871075, "deviation-center-line": 0.32812209250206315, "driven_lanedir_consec": 0.5275753452264782, "sim_compute_sim_state": 0.03706966472577445, "sim_compute_performance-ego": 0.06159652637529977, "sim_compute_robot_state-ego": 0.05983318558222131}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6292841690703669, "sim_physics": 0.05953246284933651, "survival_time": 4.249999999999993, "driven_lanedir": 0.36620058301421854, "sim_render-ego": 0.05788141138413373, "in-drivable-lane": 0.6499999999999997, "agent_compute-ego": 0.08449185595792882, "deviation-heading": 2.2836391339999964, "set_robot_commands": 0.0743758425993078, "deviation-center-line": 0.3498189410046031, "driven_lanedir_consec": 0.2095361797399924, "sim_compute_sim_state": 0.03943952392129337, "sim_compute_performance-ego": 0.06395197195165297, "sim_compute_robot_state-ego": 0.061574453466078816}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5490562233972381, "sim_physics": 0.05810348828633626, "survival_time": 3.7499999999999942, "driven_lanedir": 0.545165115501308, "sim_render-ego": 0.05880359649658203, "in-drivable-lane": 0, "agent_compute-ego": 0.08170116742451985, "deviation-heading": 0.4328152896223945, "set_robot_commands": 0.07538330713907877, "deviation-center-line": 0.42885832710601296, "driven_lanedir_consec": 0.545165115501308, "sim_compute_sim_state": 0.04051821708679199, "sim_compute_performance-ego": 0.06022099177042643, "sim_compute_robot_state-ego": 0.06186931292215983}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4007867773463258, "sim_physics": 0.056259584690325826, "survival_time": 9.049999999999994, "driven_lanedir": 1.3101922324176147, "sim_render-ego": 0.05843242229019081, "in-drivable-lane": 0, "agent_compute-ego": 0.08459410746453216, "deviation-heading": 2.644249537418989, "set_robot_commands": 0.07613424701585296, "deviation-center-line": 0.6851726515373695, "driven_lanedir_consec": 1.3101922324176147, "sim_compute_sim_state": 0.03878309845265763, "sim_compute_performance-ego": 0.060235966635013814, "sim_compute_robot_state-ego": 0.0593089082623055}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2320704422921007, "sim_physics": 0.057517729699611664, "survival_time": 7.99999999999998, "driven_lanedir": 1.0948682613681011, "sim_render-ego": 0.05754288583993912, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08538936376571656, "deviation-heading": 2.434435158767788, "set_robot_commands": 0.07667535245418548, "deviation-center-line": 0.38220807726615064, "driven_lanedir_consec": 1.0948682613681011, "sim_compute_sim_state": 0.039118365943431856, "sim_compute_performance-ego": 0.061587533354759215, "sim_compute_robot_state-ego": 0.06220138967037201}}
set_robot_commands_max0.07776016826871075
set_robot_commands_mean0.07606578349542716
set_robot_commands_median0.07613424701585296
set_robot_commands_min0.0743758425993078
sim_compute_performance-ego_max0.06395197195165297
sim_compute_performance-ego_mean0.06151859801743045
sim_compute_performance-ego_median0.061587533354759215
sim_compute_performance-ego_min0.06022099177042643
sim_compute_robot_state-ego_max0.06220138967037201
sim_compute_robot_state-ego_mean0.0609574499806275
sim_compute_robot_state-ego_median0.061574453466078816
sim_compute_robot_state-ego_min0.0593089082623055
sim_compute_sim_state_max0.04051821708679199
sim_compute_sim_state_mean0.03898577402598986
sim_compute_sim_state_median0.039118365943431856
sim_compute_sim_state_min0.03706966472577445
sim_physics_max0.05953246284933651
sim_physics_mean0.05753480647758484
sim_physics_median0.057517729699611664
sim_physics_min0.056259584690325826
sim_render-ego_max0.05880359649658203
sim_render-ego_mean0.05798224704643369
sim_render-ego_median0.05788141138413373
sim_render-ego_min0.05725091922132275
simulation-passed1
survival_time_max9.049999999999994
survival_time_mean5.799999999999991
survival_time_min3.7499999999999942
219893376bghostchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessno-0:14:46(hidden)
driven_lanedir_consec_median0.8850620976712323
survival_time_median8.74999999999999
deviation-center-line_median0.5801347658846865
in-drivable-lane_median0.350000000000005


other stats
agent_compute-ego_max0.10582107305526732
agent_compute-ego_mean0.0998134376776076
agent_compute-ego_median0.10337171819474962
agent_compute-ego_min0.08162595716755042
deviation-center-line_max0.8691432064647118
deviation-center-line_mean0.5734454061309832
deviation-center-line_min0.382067516529864
deviation-heading_max5.511722239428853
deviation-heading_mean2.6990788069296294
deviation-heading_median2.521342525257346
deviation-heading_min0.43867019752844166
driven_any_max2.341210737784756
driven_any_mean1.2529634691325398
driven_any_median1.352560298483635
driven_any_min0.5249471893485225
driven_lanedir_consec_max1.282307192572876
driven_lanedir_consec_mean0.8204858258130041
driven_lanedir_consec_min0.206617526870352
driven_lanedir_max1.9584338323510757
driven_lanedir_mean1.0730679722863714
driven_lanedir_median1.2073969342935131
driven_lanedir_min0.39615652455734535
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.35000000000000026
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.341210737784756, "sim_physics": 0.13323268572489422, "survival_time": 14.950000000000076, "driven_lanedir": 1.9584338323510757, "sim_render-ego": 0.07075203418731689, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.10499951680501302, "deviation-heading": 5.511722239428853, "set_robot_commands": 0.11147429863611856, "deviation-center-line": 0.8691432064647118, "driven_lanedir_consec": 0.8850620976712323, "sim_compute_sim_state": 0.04309683084487915, "sim_compute_performance-ego": 0.08021319309870402, "sim_compute_robot_state-ego": 0.08822489420572917}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6694352983340317, "sim_physics": 0.13623911804623073, "survival_time": 4.499999999999992, "driven_lanedir": 0.39615652455734535, "sim_render-ego": 0.07436807685428196, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.10337171819474962, "deviation-heading": 2.62346941858947, "set_robot_commands": 0.11081885231865776, "deviation-center-line": 0.382067516529864, "driven_lanedir_consec": 0.206617526870352, "sim_compute_sim_state": 0.042230995496114095, "sim_compute_performance-ego": 0.07637743420071072, "sim_compute_robot_state-ego": 0.08481619358062745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5249471893485225, "sim_physics": 0.12194689114888509, "survival_time": 3.599999999999995, "driven_lanedir": 0.521045377657047, "sim_render-ego": 0.07050479451815288, "in-drivable-lane": 0, "agent_compute-ego": 0.10582107305526732, "deviation-heading": 0.43867019752844166, "set_robot_commands": 0.11828153000937568, "deviation-center-line": 0.3926689527350763, "driven_lanedir_consec": 0.521045377657047, "sim_compute_sim_state": 0.04445351163546244, "sim_compute_performance-ego": 0.0778284039762285, "sim_compute_robot_state-ego": 0.08789035015636021}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.352560298483635, "sim_physics": 0.14260964802333287, "survival_time": 8.74999999999999, "driven_lanedir": 1.2073969342935131, "sim_render-ego": 0.0687145219530378, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.10324892316545758, "deviation-heading": 2.4001896538440355, "set_robot_commands": 0.11233472006661552, "deviation-center-line": 0.6432125890405775, "driven_lanedir_consec": 1.2073969342935131, "sim_compute_sim_state": 0.04225152969360352, "sim_compute_performance-ego": 0.0777679089137486, "sim_compute_robot_state-ego": 0.08637692315237863}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3766638217117544, "sim_physics": 0.09386302246136612, "survival_time": 8.899999999999991, "driven_lanedir": 1.282307192572876, "sim_render-ego": 0.053587162092830355, "in-drivable-lane": 0, "agent_compute-ego": 0.08162595716755042, "deviation-heading": 2.521342525257346, "set_robot_commands": 0.08868288458063361, "deviation-center-line": 0.5801347658846865, "driven_lanedir_consec": 1.282307192572876, "sim_compute_sim_state": 0.03386532322744305, "sim_compute_performance-ego": 0.0587799535708481, "sim_compute_robot_state-ego": 0.06220325727141305}}
set_robot_commands_max0.11828153000937568
set_robot_commands_mean0.1083184571222802
set_robot_commands_median0.11147429863611856
set_robot_commands_min0.08868288458063361
sim_compute_performance-ego_max0.08021319309870402
sim_compute_performance-ego_mean0.07419337875204798
sim_compute_performance-ego_median0.0777679089137486
sim_compute_performance-ego_min0.0587799535708481
sim_compute_robot_state-ego_max0.08822489420572917
sim_compute_robot_state-ego_mean0.0819023236733017
sim_compute_robot_state-ego_median0.08637692315237863
sim_compute_robot_state-ego_min0.06220325727141305
sim_compute_sim_state_max0.04445351163546244
sim_compute_sim_state_mean0.041179638179500454
sim_compute_sim_state_median0.04225152969360352
sim_compute_sim_state_min0.03386532322744305
sim_physics_max0.14260964802333287
sim_physics_mean0.1255782730809418
sim_physics_median0.13323268572489422
sim_physics_min0.09386302246136612
sim_render-ego_max0.07436807685428196
sim_render-ego_mean0.06758531792112397
sim_render-ego_median0.07050479451815288
sim_render-ego_min0.053587162092830355
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.14000000000001
survival_time_min3.599999999999995
219883376bghostchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessno-0:07:37(hidden)
driven_lanedir_consec_median1.0999974081549406
survival_time_median7.94999999999998
deviation-center-line_median0.4636024032578443
in-drivable-lane_median0.30000000000000426


other stats
agent_compute-ego_max0.05386954247951507
agent_compute-ego_mean0.053061551476588975
agent_compute-ego_median0.05292630737478083
agent_compute-ego_min0.05253244945838016
deviation-center-line_max0.8806668824903146
deviation-center-line_mean0.5510181937862011
deviation-center-line_min0.3453832142297992
deviation-heading_max5.0615127742139325
deviation-heading_mean2.60676286913447
deviation-heading_median2.481851441345405
deviation-heading_min0.5709311703588489
driven_any_max2.3411533017430974
driven_any_mean1.2288482972275658
driven_any_median1.2240044676966393
driven_any_min0.5892284233478767
driven_lanedir_consec_max1.2179768128330544
driven_lanedir_consec_mean0.8496682456025259
driven_lanedir_consec_min0.21070249865609705
driven_lanedir_max1.3629275037955328
driven_lanedir_mean0.9244154187407828
driven_lanedir_median1.0999974081549406
driven_lanedir_min0.3587294229445502
in-drivable-lane_max4.200000000000001
in-drivable-lane_mean1.030000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3411533017430974, "sim_physics": 0.03991844415664673, "survival_time": 14.950000000000076, "driven_lanedir": 1.3629275037955328, "sim_render-ego": 0.03389791488647461, "in-drivable-lane": 4.200000000000001, "agent_compute-ego": 0.05291959683100383, "deviation-heading": 5.0615127742139325, "set_robot_commands": 0.052494850953420005, "deviation-center-line": 0.8806668824903146, "driven_lanedir_consec": 1.1372185623926994, "sim_compute_sim_state": 0.021322381496429444, "sim_compute_performance-ego": 0.03706813891728719, "sim_compute_robot_state-ego": 0.03827229102452596}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6292597443570077, "sim_physics": 0.04019383823170381, "survival_time": 4.249999999999993, "driven_lanedir": 0.3587294229445502, "sim_render-ego": 0.03381828700794893, "in-drivable-lane": 0.6499999999999997, "agent_compute-ego": 0.053059861239265, "deviation-heading": 2.305667469272767, "set_robot_commands": 0.05152304873746984, "deviation-center-line": 0.3453832142297992, "driven_lanedir_consec": 0.21070249865609705, "sim_compute_sim_state": 0.021500811857335708, "sim_compute_performance-ego": 0.03697052843430463, "sim_compute_robot_state-ego": 0.03794831668629366}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5892284233478767, "sim_physics": 0.03912104666233063, "survival_time": 3.999999999999994, "driven_lanedir": 0.5824459459758375, "sim_render-ego": 0.03362565040588379, "in-drivable-lane": 0, "agent_compute-ego": 0.05386954247951507, "deviation-heading": 0.5709311703588489, "set_robot_commands": 0.052143269777297975, "deviation-center-line": 0.4285700982939006, "driven_lanedir_consec": 0.5824459459758375, "sim_compute_sim_state": 0.02119922637939453, "sim_compute_performance-ego": 0.037234410643577576, "sim_compute_robot_state-ego": 0.0379274308681488}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3605955489932082, "sim_physics": 0.04089944606477564, "survival_time": 8.79999999999999, "driven_lanedir": 1.2179768128330544, "sim_render-ego": 0.03355961496179754, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.05292630737478083, "deviation-heading": 2.481851441345405, "set_robot_commands": 0.052272334694862366, "deviation-center-line": 0.6368683706591467, "driven_lanedir_consec": 1.2179768128330544, "sim_compute_sim_state": 0.021132474595850163, "sim_compute_performance-ego": 0.03683774308724837, "sim_compute_robot_state-ego": 0.03791849586096677}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2240044676966393, "sim_physics": 0.039421823789488594, "survival_time": 7.94999999999998, "driven_lanedir": 1.0999974081549406, "sim_render-ego": 0.033671401581674254, "in-drivable-lane": 0, "agent_compute-ego": 0.05253244945838016, "deviation-heading": 2.6138514904813963, "set_robot_commands": 0.05126056431224511, "deviation-center-line": 0.4636024032578443, "driven_lanedir_consec": 1.0999974081549406, "sim_compute_sim_state": 0.020968750587799265, "sim_compute_performance-ego": 0.03673989068037309, "sim_compute_robot_state-ego": 0.03856913998441877}}
set_robot_commands_max0.052494850953420005
set_robot_commands_mean0.05193881369505906
set_robot_commands_median0.052143269777297975
set_robot_commands_min0.05126056431224511
sim_compute_performance-ego_max0.037234410643577576
sim_compute_performance-ego_mean0.03697014235255817
sim_compute_performance-ego_median0.03697052843430463
sim_compute_performance-ego_min0.03673989068037309
sim_compute_robot_state-ego_max0.03856913998441877
sim_compute_robot_state-ego_mean0.03812713488487079
sim_compute_robot_state-ego_median0.03794831668629366
sim_compute_robot_state-ego_min0.03791849586096677
sim_compute_sim_state_max0.021500811857335708
sim_compute_sim_state_mean0.02122472898336182
sim_compute_sim_state_median0.02119922637939453
sim_compute_sim_state_min0.020968750587799265
sim_physics_max0.04089944606477564
sim_physics_mean0.03991091978098908
sim_physics_median0.03991844415664673
sim_physics_min0.03912104666233063
sim_render-ego_max0.03389791488647461
sim_render-ego_mean0.03371457376875582
sim_render-ego_median0.033671401581674254
sim_render-ego_min0.03355961496179754
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.990000000000007
survival_time_min3.999999999999994
219753376bghostchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationhost-errorno-0:04:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1066, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job21975-675463', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 535, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1071, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job21975-675463', 'down']:

   >  Command '['docker-compose', '-p', 'job21975-675463', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)