Duckietown Challenges Home Challenges Submissions

Submission 3363

Submission3363
Competingyes
Challengeaido2-LF-sim-testing
UserAmaury Camus 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22374
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22374step1-simulationsuccessyes0:16:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17625309983078313
agent_compute-ego_mean0.15459522755965524
agent_compute-ego_median0.15913964252845914
agent_compute-ego_min0.11782347679138185
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10983236630757648, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059388447690893104, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14248813081670691, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08965456485748291, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037076989809672035, "sim_compute_performance-ego": 0.06754017759252477, "sim_compute_robot_state-ego": 0.07998771137661403}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10508386761534448, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.059158442067165, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1466529416102989, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09053615027782964, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03900088048448749, "sim_compute_performance-ego": 0.06624575222239774, "sim_compute_robot_state-ego": 0.07221005944644704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.08880361388711368, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0493316650390625, "in-drivable-lane": 0, "agent_compute-ego": 0.1291334208320169, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07567940038793228, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03082150571486529, "sim_compute_performance-ego": 0.06274975047392004, "sim_compute_robot_state-ego": 0.06573097846087288}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07724232673645019, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.048953218460083006, "in-drivable-lane": 0, "agent_compute-ego": 0.11782347679138185, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08277896881103515, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.029877471923828124, "sim_compute_performance-ego": 0.05374107360839843, "sim_compute_robot_state-ego": 0.05405324935913086}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10078196284137196, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0524642799474016, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13160768038109888, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08093705961975871, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.033087911485116694, "sim_compute_performance-ego": 0.05503167985360834, "sim_compute_robot_state-ego": 0.06110450587695158}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1323069747613401, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.08080041651823083, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.17625309983078313, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10486830497274592, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04270637278654137, "sim_compute_performance-ego": 0.07426549950424506, "sim_compute_robot_state-ego": 0.0872695591984963}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12183875271252224, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.0678783016545432, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1536087989807129, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.08759051987103053, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.09751888683864048, "sim_compute_performance-ego": 0.08345099432127816, "sim_compute_robot_state-ego": 0.07750268919127327}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.14024296261015393, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06504759334382557, "in-drivable-lane": 0, "agent_compute-ego": 0.15718892642429896, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10432834852309454, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04183324178059896, "sim_compute_performance-ego": 0.07316789172944568, "sim_compute_robot_state-ego": 0.08615052132379442}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.13296533439118982, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0676324286703336, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.16495981458890235, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.10585327875816215, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04138175107664981, "sim_compute_performance-ego": 0.0708601111072605, "sim_compute_robot_state-ego": 0.07635310948905298}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12120715921575372, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06971504471518776, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1628161083568226, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10491611740805884, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04113696705211293, "sim_compute_performance-ego": 0.07315218665383079, "sim_compute_robot_state-ego": 0.0805058089169589}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.1356029293753884, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06802021683036506, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17218447660470937, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.112020443012188, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04333586197394829, "sim_compute_performance-ego": 0.08476135637853052, "sim_compute_robot_state-ego": 0.08814864344411082}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.15191222088677542, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.07176744086401803, "in-drivable-lane": 0, "agent_compute-ego": 0.17163033144814627, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10452603442328316, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.0447989957673209, "sim_compute_performance-ego": 0.08191582134791783, "sim_compute_robot_state-ego": 0.09024468490055627}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11540967810387703, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06473155115164962, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15913964252845914, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.0994402333801868, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04328115313660865, "sim_compute_performance-ego": 0.06938658508599974, "sim_compute_robot_state-ego": 0.07348286404329188}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12501410201743798, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.0639389091067844, "in-drivable-lane": 0, "agent_compute-ego": 0.16648387025903771, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10176829938535337, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04093382093641493, "sim_compute_performance-ego": 0.06913186885692456, "sim_compute_robot_state-ego": 0.07721867384733977}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12180633872163062, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06943307203405044, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16695769394145293, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.104967851264804, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04252606513453465, "sim_compute_performance-ego": 0.07723571973688462, "sim_compute_robot_state-ego": 0.08720116054310519}}
set_robot_commands_max0.112020443012188
set_robot_commands_mean0.09665770499686306
set_robot_commands_median0.10176829938535337
set_robot_commands_min0.07567940038793228
sim_compute_performance-ego_max0.08476135637853052
sim_compute_performance-ego_mean0.07084243123154448
sim_compute_performance-ego_median0.0708601111072605
sim_compute_performance-ego_min0.05374107360839843
sim_compute_robot_state-ego_max0.09024468490055627
sim_compute_robot_state-ego_mean0.07714428129453307
sim_compute_robot_state-ego_median0.07750268919127327
sim_compute_robot_state-ego_min0.05405324935913086
sim_compute_sim_state_max0.09751888683864048
sim_compute_sim_state_mean0.04328785839342271
sim_compute_sim_state_median0.04138175107664981
sim_compute_sim_state_min0.029877471923828124
sim_physics_max0.15191222088677542
sim_physics_mean0.11867003934559509
sim_physics_median0.12180633872163062
sim_physics_min0.07724232673645019
sim_render-ego_max0.08080041651823083
sim_render-ego_mean0.06388406853957292
sim_render-ego_median0.06504759334382557
sim_render-ego_min0.048953218460083006
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
21985step1-simulationsuccessno0:12:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21978step1-simulationhost-errorno0:04:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1066, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job21978-729294', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 535, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1071, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job21978-729294', 'down']:

   >  Command '['docker-compose', '-p', 'job21978-729294', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21960step1-simulationtimeoutno1:05:29
I can see how the jo [...]
I can see how the job 21960 is timeout because passed 3928 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21950step1-simulationtimeoutno1:05:48
I can see how the jo [...]
I can see how the job 21950 is timeout because passed 3948 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible