AI Driving Olympics Home Challenges Submissions Jobs

Submission 3557

Submission3557
Competingyes
Challengeaido2-LFVI-sim-validation
UserAmaurX
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 23080
Next
User labelRunning the real lane following -- without challenge container
Admin priority50
User priority50

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230803557AmaurXRunning the real lane following -- without challenge containeraido2-LFVI-sim-validationstep1-simulationerroryes-0:05:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230773557AmaurXRunning the real lane following -- without challenge containeraido2-LFVI-sim-validationstep1-simulationerroryes-0:06:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230763557AmaurXRunning the real lane following -- without challenge containeraido2-LFVI-sim-validationstep1-simulationhost-erroryes-0:01:37
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job23076-272500', 'pull']:

   >  Command '['docker-compose', '-p', 'job23076-272500', 'pull']' returned non-zero exit status 1.

stdout | 

stderr | Pulling evaluator      ...
stderr | Pulling scenario_maker ...
stderr | Pulling simulator      ...
stderr | Pulling solution       ...
stderr | 
stderr | Pulling solution       ... done
stderr | 
stderr | Pulling evaluator      ... done
stderr | 
stderr | Pulling simulator      ... done
stderr | 
stderr | ERROR: for scenario_maker  Cannot overwrite digest sha256:8369815d5db108b9489a87d0538f031bdad156deb7203369ad788716fa63c83b
stderr | Cannot overwrite digest sha256:8369815d5db108b9489a87d0538f031bdad156deb7203369ad788716fa63c83b
stderr | 
(hidden)
230683557AmaurXRunning the real lane following -- without challenge containeraido2-LFVI-sim-validationstep1-simulationsuccessyes-0:09:18(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.14715656780061268
agent_compute-ego_mean0.14492003612115514
agent_compute-ego_median0.14459246893723807
agent_compute-ego_min0.14305755156504957
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.11744651311560522, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05983368354507639, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14305755156504957, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07661494725867163, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03513438188577, "sim_compute_performance-ego": 0.061862812766545934, "sim_compute_robot_state-ego": 0.06180636188651942, "sim_compute_robot_state-npc0": 0.07121579254729839, "sim_compute_robot_state-npc1": 0.06708768651455263, "sim_compute_robot_state-npc2": 0.061958521227293374, "sim_compute_robot_state-npc3": 0.06152258341825461}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.11382023777280537, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05857819318771362, "in-drivable-lane": 0, "agent_compute-ego": 0.14567347083772933, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.07782154423849923, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.037311596529824395, "sim_compute_performance-ego": 0.06296251501355853, "sim_compute_robot_state-ego": 0.06598969868251256, "sim_compute_robot_state-npc0": 0.07185779299054827, "sim_compute_robot_state-npc1": 0.0658043622970581, "sim_compute_robot_state-npc2": 0.06426382916314262, "sim_compute_robot_state-npc3": 0.0662604570388794}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.10943813694333568, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06144214370875683, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14412012146514597, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07913507767093991, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03565713271354009, "sim_compute_performance-ego": 0.06299767910855487, "sim_compute_robot_state-ego": 0.06127034807668149, "sim_compute_robot_state-npc0": 0.0724676720146994, "sim_compute_robot_state-npc1": 0.06669593320309537, "sim_compute_robot_state-npc2": 0.06505409722189301, "sim_compute_robot_state-npc3": 0.06526166721455103}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1267020454009374, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06387503445148468, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14459246893723807, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0763234297434489, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03875369826952616, "sim_compute_performance-ego": 0.06410800417264302, "sim_compute_robot_state-ego": 0.06130813558896383, "sim_compute_robot_state-npc0": 0.07245897750059764, "sim_compute_robot_state-npc1": 0.07292252779006958, "sim_compute_robot_state-npc2": 0.06618690987428029, "sim_compute_robot_state-npc3": 0.06601602832476298}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.11792423611595518, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06062830062139602, "in-drivable-lane": 0, "agent_compute-ego": 0.14715656780061268, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08067293394179571, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.033675738743373325, "sim_compute_performance-ego": 0.0627567313966297, "sim_compute_robot_state-ego": 0.06232202620733352, "sim_compute_robot_state-npc0": 0.06774042901538667, "sim_compute_robot_state-npc1": 0.06270891144162133, "sim_compute_robot_state-npc2": 0.06833948407854352, "sim_compute_robot_state-npc3": 0.06107610747927711}}
set_robot_commands_max0.08067293394179571
set_robot_commands_mean0.07811358657067108
set_robot_commands_median0.07782154423849923
set_robot_commands_min0.0763234297434489
sim_compute_performance-ego_max0.06410800417264302
sim_compute_performance-ego_mean0.0629375484915864
sim_compute_performance-ego_median0.06296251501355853
sim_compute_performance-ego_min0.061862812766545934
sim_compute_robot_state-ego_max0.06598969868251256
sim_compute_robot_state-ego_mean0.06253931408840216
sim_compute_robot_state-ego_median0.06180636188651942
sim_compute_robot_state-ego_min0.06127034807668149
sim_compute_robot_state-npc0_max0.0724676720146994
sim_compute_robot_state-npc0_mean0.07114813281370608
sim_compute_robot_state-npc0_median0.07185779299054827
sim_compute_robot_state-npc0_min0.06774042901538667
sim_compute_robot_state-npc1_max0.07292252779006958
sim_compute_robot_state-npc1_mean0.0670438842492794
sim_compute_robot_state-npc1_median0.06669593320309537
sim_compute_robot_state-npc1_min0.06270891144162133
sim_compute_robot_state-npc2_max0.06833948407854352
sim_compute_robot_state-npc2_mean0.06516056831303056
sim_compute_robot_state-npc2_median0.06505409722189301
sim_compute_robot_state-npc2_min0.061958521227293374
sim_compute_robot_state-npc3_max0.0662604570388794
sim_compute_robot_state-npc3_mean0.06402736869514503
sim_compute_robot_state-npc3_median0.06526166721455103
sim_compute_robot_state-npc3_min0.06107610747927711
sim_compute_sim_state_max0.03875369826952616
sim_compute_sim_state_mean0.036106509628406794
sim_compute_sim_state_median0.03565713271354009
sim_compute_sim_state_min0.033675738743373325
sim_physics_max0.1267020454009374
sim_physics_mean0.11706623386972775
sim_physics_median0.11744651311560522
sim_physics_min0.10943813694333568
sim_render-ego_max0.06387503445148468
sim_render-ego_mean0.06087147110288551
sim_render-ego_median0.06062830062139602
sim_render-ego_min0.05857819318771362
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005