AI Driving Olympics Home Challenges Submissions Jobs

Submission 3433

Submission3433
Competingyes
Challengeaido2-LFVI-sim-testing
UserMYF
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22299
Next
User labeltest
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
222993433MYFtestaido2-LFVI-sim-testingstep1-simulationerroryes-1:04:36
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up. 
(hidden)
220903433MYFtestaido2-LFVI-sim-testingstep1-simulationsuccessno-0:47:25(hidden)
driven_lanedir_consec_median2.380952168122775
survival_time_median14.950000000000076
deviation-center-line_median0.5236211756535298
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0995970195698961
agent_compute-ego_mean0.0901793034944722
agent_compute-ego_median0.08861889759699504
agent_compute-ego_min0.08770268027846878
deviation-center-line_max1.154820330733474
deviation-center-line_mean0.5782503409301508
deviation-center-line_min0.2550406494984671
deviation-heading_max2.9694777459865396
deviation-heading_mean1.974340852012291
deviation-heading_median1.912292406049886
deviation-heading_min0.9828827117209384
driven_any_max3.1527524506998703
driven_any_mean2.327436863713633
driven_any_median2.8711786248391062
driven_any_min1.0024565782772623
driven_lanedir_consec_max3.083869224604061
driven_lanedir_consec_mean2.088531868387055
driven_lanedir_consec_min0.660519167380301
driven_lanedir_max3.114209837541649
driven_lanedir_mean2.2322601447826314
driven_lanedir_median2.8138180723723427
driven_lanedir_min0.7557637918953874
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.17333333333333306
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.240371053172813, "sim_physics": 0.09802182061331612, "survival_time": 10.500000000000014, "driven_lanedir": 2.149499567757712, "sim_render-ego": 0.03561379568917411, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.08967145738147554, "deviation-heading": 1.440845905256981, "set_robot_commands": 0.05547690391540527, "deviation-center-line": 0.4946831088600297, "driven_lanedir_consec": 1.8387083249864336, "sim_compute_sim_state": 0.02243070261819022, "sim_compute_performance-ego": 0.03844067823319208, "sim_compute_robot_state-ego": 0.040512624241056894, "sim_compute_robot_state-npc0": 0.03986577874138242, "sim_compute_robot_state-npc1": 0.04207973707289923, "sim_compute_robot_state-npc2": 0.03898803279513405, "sim_compute_robot_state-npc3": 0.03906693799155099}, "udem1-1-0": {"driven_any": 3.092934927839302, "sim_physics": 0.09888200441996256, "survival_time": 14.950000000000076, "driven_lanedir": 3.0548479905450727, "sim_render-ego": 0.03561094045639038, "in-drivable-lane": 0, "agent_compute-ego": 0.09056649128595988, "deviation-heading": 2.0534064472477276, "set_robot_commands": 0.05523680051167806, "deviation-center-line": 0.901145957333716, "driven_lanedir_consec": 3.0548479905450727, "sim_compute_sim_state": 0.022210830847422283, "sim_compute_performance-ego": 0.03821453253428141, "sim_compute_robot_state-ego": 0.0403014341990153, "sim_compute_robot_state-npc0": 0.03983574946721395, "sim_compute_robot_state-npc1": 0.038927071889241535, "sim_compute_robot_state-npc2": 0.03877820332845052, "sim_compute_robot_state-npc3": 0.03920056104660034}, "udem1-2-0": {"driven_any": 2.8711786248391062, "sim_physics": 0.10637378772099812, "survival_time": 14.950000000000076, "driven_lanedir": 2.8138180723723427, "sim_render-ego": 0.03575517813364665, "in-drivable-lane": 0, "agent_compute-ego": 0.08980258782704671, "deviation-heading": 2.382805257148462, "set_robot_commands": 0.05500438769658406, "deviation-center-line": 1.154820330733474, "driven_lanedir_consec": 2.5609903819992903, "sim_compute_sim_state": 0.023369294007619223, "sim_compute_performance-ego": 0.03829869031906128, "sim_compute_robot_state-ego": 0.04055174668629964, "sim_compute_robot_state-npc0": 0.03992296934127808, "sim_compute_robot_state-npc1": 0.03908819278081258, "sim_compute_robot_state-npc2": 0.03880767265955607, "sim_compute_robot_state-npc3": 0.038994262218475344}, "udem1-3-0": {"driven_any": 2.270419374998568, "sim_physics": 0.10037904085168516, "survival_time": 10.350000000000012, "driven_lanedir": 2.2515950896484083, "sim_render-ego": 0.03569345773706114, "in-drivable-lane": 0, "agent_compute-ego": 0.08907268473491577, "deviation-heading": 1.0583481383580546, "set_robot_commands": 0.0544776881950489, "deviation-center-line": 0.5236211756535298, "driven_lanedir_consec": 2.25159452317069, "sim_compute_sim_state": 0.022147698102941836, "sim_compute_performance-ego": 0.03798618984683124, "sim_compute_robot_state-ego": 0.0402213168029048, "sim_compute_robot_state-npc0": 0.03973057074247351, "sim_compute_robot_state-npc1": 0.03919343211224689, "sim_compute_robot_state-npc2": 0.03894845529454918, "sim_compute_robot_state-npc3": 0.03884588693075134}, "udem1-4-0": {"driven_any": 3.1527524506998703, "sim_physics": 0.10942269961039224, "survival_time": 14.950000000000076, "driven_lanedir": 3.114209837541649, "sim_render-ego": 0.03906134128570557, "in-drivable-lane": 0, "agent_compute-ego": 0.0989601151148478, "deviation-heading": 1.887822685417012, "set_robot_commands": 0.06635253111521403, "deviation-center-line": 0.6582435191619892, "driven_lanedir_consec": 2.8353374235971343, "sim_compute_sim_state": 0.026550400257110595, "sim_compute_performance-ego": 0.04259337345759074, "sim_compute_robot_state-ego": 0.045017571449279786, "sim_compute_robot_state-npc0": 0.045464824040730795, "sim_compute_robot_state-npc1": 0.04369309743245443, "sim_compute_robot_state-npc2": 0.043529720306396485, "sim_compute_robot_state-npc3": 0.043389573097229}, "udem1-5-0": {"driven_any": 2.882462726887722, "sim_physics": 0.09707317272822062, "survival_time": 14.950000000000076, "driven_lanedir": 2.8224994363756237, "sim_render-ego": 0.0351332950592041, "in-drivable-lane": 0, "agent_compute-ego": 0.0880877693494161, "deviation-heading": 2.669294969788933, "set_robot_commands": 0.05423311471939087, "deviation-center-line": 0.7519857516802999, "driven_lanedir_consec": 2.8224994363756237, "sim_compute_sim_state": 0.021836820443471273, "sim_compute_performance-ego": 0.03894213517506917, "sim_compute_robot_state-ego": 0.041036101977030434, "sim_compute_robot_state-npc0": 0.04072727123896281, "sim_compute_robot_state-npc1": 0.03854512055714925, "sim_compute_robot_state-npc2": 0.03835942268371582, "sim_compute_robot_state-npc3": 0.03957566499710083}, "udem1-6-0": {"driven_any": 2.936204716966355, "sim_physics": 0.10082290649414062, "survival_time": 14.950000000000076, "driven_lanedir": 2.8567118585485187, "sim_render-ego": 0.03530797481536865, "in-drivable-lane": 0, "agent_compute-ego": 0.08855985959370931, "deviation-heading": 2.9694777459865396, "set_robot_commands": 0.05411269982655843, "deviation-center-line": 0.6535929048654749, "driven_lanedir_consec": 2.8567118585485187, "sim_compute_sim_state": 0.022074119249979655, "sim_compute_performance-ego": 0.03846281131108602, "sim_compute_robot_state-ego": 0.039747158686319985, "sim_compute_robot_state-npc0": 0.03905854304631551, "sim_compute_robot_state-npc1": 0.03831639687220256, "sim_compute_robot_state-npc2": 0.03810856103897095, "sim_compute_robot_state-npc3": 0.03819056034088135}, "udem1-7-0": {"driven_any": 1.0024565782772623, "sim_physics": 0.10157936532920768, "survival_time": 5.349999999999989, "driven_lanedir": 0.7557637918953874, "sim_render-ego": 0.03496999161265721, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0890260611739114, "deviation-heading": 1.1807152703486892, "set_robot_commands": 0.05386756513720361, "deviation-center-line": 0.2550406494984671, "driven_lanedir_consec": 0.7538400575644675, "sim_compute_sim_state": 0.02182772449243849, "sim_compute_performance-ego": 0.03776947582993552, "sim_compute_robot_state-ego": 0.039561855458767614, "sim_compute_robot_state-npc0": 0.03891503922293119, "sim_compute_robot_state-npc1": 0.038248899941132446, "sim_compute_robot_state-npc2": 0.03795500336406387, "sim_compute_robot_state-npc3": 0.03826589005015721}, "udem1-8-0": {"driven_any": 1.0163995625527795, "sim_physics": 0.11142075173208647, "survival_time": 5.349999999999989, "driven_lanedir": 0.808970036320147, "sim_render-ego": 0.0410735406608225, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0995970195698961, "deviation-heading": 0.9828827117209384, "set_robot_commands": 0.05956129938642555, "deviation-center-line": 0.29261399309203007, "driven_lanedir_consec": 0.808970036320147, "sim_compute_sim_state": 0.024342704042096003, "sim_compute_performance-ego": 0.04208075888803072, "sim_compute_robot_state-ego": 0.04483981667277969, "sim_compute_robot_state-npc0": 0.04432051872538629, "sim_compute_robot_state-npc1": 0.04315147221645462, "sim_compute_robot_state-npc2": 0.042700997022824864, "sim_compute_robot_state-npc3": 0.04296075072243949}, "udem1-9-0": {"driven_any": 3.123217374932316, "sim_physics": 0.10204720973968506, "survival_time": 14.950000000000076, "driven_lanedir": 3.083869224604061, "sim_render-ego": 0.03518986145655314, "in-drivable-lane": 0, "agent_compute-ego": 0.08832642793655396, "deviation-heading": 1.912292406049886, "set_robot_commands": 0.05404259363810222, "deviation-center-line": 0.4762216258777846, "driven_lanedir_consec": 3.083869224604061, "sim_compute_sim_state": 0.021861926714579264, "sim_compute_performance-ego": 0.038148127396901446, "sim_compute_robot_state-ego": 0.04128033479054769, "sim_compute_robot_state-npc0": 0.03937533140182495, "sim_compute_robot_state-npc1": 0.03851803859074911, "sim_compute_robot_state-npc2": 0.03827200253804525, "sim_compute_robot_state-npc3": 0.03837492068608602}, "udem1-10-0": {"driven_any": 1.0187829101087047, "sim_physics": 0.0958952066060659, "survival_time": 5.549999999999988, "driven_lanedir": 0.7843429517185186, "sim_render-ego": 0.03510416520608438, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08770268027846878, "deviation-heading": 2.305144688711028, "set_robot_commands": 0.05381023991215336, "deviation-center-line": 0.336924107260783, "driven_lanedir_consec": 0.660519167380301, "sim_compute_sim_state": 0.021795012929418062, "sim_compute_performance-ego": 0.037361765767002966, "sim_compute_robot_state-ego": 0.03946022300032882, "sim_compute_robot_state-npc0": 0.03936542906202711, "sim_compute_robot_state-npc1": 0.03818749737095188, "sim_compute_robot_state-npc2": 0.03812432289123535, "sim_compute_robot_state-npc3": 0.0381870699358416}, "udem1-11-0": {"driven_any": 1.0047566543844073, "sim_physics": 0.09465112357304016, "survival_time": 5.799999999999987, "driven_lanedir": 0.8170117698691378, "sim_render-ego": 0.035254766201150825, "in-drivable-lane": 0, "agent_compute-ego": 0.08845897789659171, "deviation-heading": 2.70562354788343, "set_robot_commands": 0.05404833267474997, "deviation-center-line": 0.350882684772936, "driven_lanedir_consec": 0.7776400670935913, "sim_compute_sim_state": 0.021868467330932617, "sim_compute_performance-ego": 0.037751360186215104, "sim_compute_robot_state-ego": 0.03966609362898202, "sim_compute_robot_state-npc0": 0.039318524557968665, "sim_compute_robot_state-npc1": 0.03842341077738795, "sim_compute_robot_state-npc2": 0.038293390438474455, "sim_compute_robot_state-npc3": 0.03881382942199707}, "udem1-12-0": {"driven_any": 2.304999440284051, "sim_physics": 0.09910789422229328, "survival_time": 11.300000000000026, "driven_lanedir": 2.275843861361749, "sim_render-ego": 0.03495107920823899, "in-drivable-lane": 0, "agent_compute-ego": 0.0880774523304627, "deviation-heading": 1.5655018398662306, "set_robot_commands": 0.05394975274010042, "deviation-center-line": 0.5278082226078129, "driven_lanedir_consec": 1.851539788960113, "sim_compute_sim_state": 0.02191698023703246, "sim_compute_performance-ego": 0.03751845908375968, "sim_compute_robot_state-ego": 0.03996720989193536, "sim_compute_robot_state-npc0": 0.04026236576316631, "sim_compute_robot_state-npc1": 0.038438141873452514, "sim_compute_robot_state-npc2": 0.03829038670632691, "sim_compute_robot_state-npc3": 0.03837337747084356}, "udem1-13-0": {"driven_any": 2.890289332675841, "sim_physics": 0.1022566318511963, "survival_time": 14.950000000000076, "driven_lanedir": 2.8256573979840813, "sim_render-ego": 0.035198480288187665, "in-drivable-lane": 0, "agent_compute-ego": 0.08861889759699504, "deviation-heading": 2.7018724813970656, "set_robot_commands": 0.05512592474619547, "deviation-center-line": 0.7816569879998447, "driven_lanedir_consec": 2.380952168122775, "sim_compute_sim_state": 0.02199109713236491, "sim_compute_performance-ego": 0.03767343521118164, "sim_compute_robot_state-ego": 0.03984455108642578, "sim_compute_robot_state-npc0": 0.0394006888071696, "sim_compute_robot_state-npc1": 0.03877603610356649, "sim_compute_robot_state-npc2": 0.03836854696273804, "sim_compute_robot_state-npc3": 0.03862320184707642}, "udem1-14-0": {"driven_any": 3.104327227085389, "sim_physics": 0.0967270851135254, "survival_time": 14.950000000000076, "driven_lanedir": 3.069261285197062, "sim_render-ego": 0.03511828740437826, "in-drivable-lane": 0, "agent_compute-ego": 0.08816107034683228, "deviation-heading": 1.7990786850033869, "set_robot_commands": 0.054218320846557616, "deviation-center-line": 0.5145140945540897, "driven_lanedir_consec": 2.7899575765375952, "sim_compute_sim_state": 0.02181348880132039, "sim_compute_performance-ego": 0.03763524611790975, "sim_compute_robot_state-ego": 0.039886111418406166, "sim_compute_robot_state-npc0": 0.03930625518163045, "sim_compute_robot_state-npc1": 0.038610954284667966, "sim_compute_robot_state-npc2": 0.03822677214940389, "sim_compute_robot_state-npc3": 0.03840856790542602}}
set_robot_commands_max0.06635253111521403
set_robot_commands_mean0.05556787700409119
set_robot_commands_median0.05423311471939087
set_robot_commands_min0.05381023991215336
sim_compute_performance-ego_max0.04259337345759074
sim_compute_performance-ego_mean0.03859180262386992
sim_compute_performance-ego_median0.038148127396901446
sim_compute_performance-ego_min0.037361765767002966
sim_compute_robot_state-ego_max0.045017571449279786
sim_compute_robot_state-ego_mean0.040792943332672
sim_compute_robot_state-ego_median0.0402213168029048
sim_compute_robot_state-ego_min0.03946022300032882
sim_compute_robot_state-npc0_max0.045464824040730795
sim_compute_robot_state-npc0_mean0.04032465728936411
sim_compute_robot_state-npc0_median0.03973057074247351
sim_compute_robot_state-npc0_min0.03891503922293119
sim_compute_robot_state-npc1_max0.04369309743245443
sim_compute_robot_state-npc1_mean0.03947983332502463
sim_compute_robot_state-npc1_median0.038610954284667966
sim_compute_robot_state-npc1_min0.03818749737095188
sim_compute_robot_state-npc2_max0.043529720306396485
sim_compute_robot_state-npc2_mean0.03905009934532571
sim_compute_robot_state-npc2_median0.03835942268371582
sim_compute_robot_state-npc2_min0.03795500336406387
sim_compute_robot_state-npc3_max0.043389573097229
sim_compute_robot_state-npc3_mean0.039284736977497105
sim_compute_robot_state-npc3_median0.03881382942199707
sim_compute_robot_state-npc3_min0.0381870699358416
sim_compute_sim_state_max0.026550400257110595
sim_compute_sim_state_mean0.022535817813794486
sim_compute_sim_state_median0.02199109713236491
sim_compute_sim_state_min0.021795012929418062
sim_physics_max0.11142075173208647
sim_physics_mean0.10097738004038773
sim_physics_median0.10037904085168516
sim_physics_min0.09465112357304016
sim_render-ego_max0.0410735406608225
sim_render-ego_mean0.035935743680974894
sim_render-ego_median0.035254766201150825
sim_render-ego_min0.03495107920823899
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.586666666666709
survival_time_min5.349999999999989
220893433MYFtestaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:07:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22089-687555', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22089-687555', 'down']:

   >  Command '['docker-compose', '-p', 'job22089-687555', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)