AI Driving Olympics Home Challenges Submissions Jobs

Submission 3347

Submission3347
Competingyes
Challengeaido2-LFV-sim-testing
UserJBRRussia
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22382
Next
User labelJetBrains Research
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223823347JBRRussiaJetBrains Researchaido2-LFV-sim-testingstep1-simulationerroryes-0:05:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
219163347JBRRussiaJetBrains Researchaido2-LFV-sim-testingstep1-simulationsuccessno-0:56:13(hidden)
driven_lanedir_consec_median2.5018829386263537
survival_time_median14.950000000000076
deviation-center-line_median1.109123650541186
in-drivable-lane_median0.9500000000000136


other stats
agent_compute-ego_max0.13579525073369345
agent_compute-ego_mean0.09171537412763228
agent_compute-ego_median0.06261357545852661
agent_compute-ego_min0.05245465732245856
deviation-center-line_max1.3171915308434985
deviation-center-line_mean1.0394484471218215
deviation-center-line_min0.23465359483055895
deviation-heading_max3.2894998237338733
deviation-heading_mean2.153569280244606
deviation-heading_median2.179416652759577
deviation-heading_min0.38334638160903545
driven_any_max2.891670024268534
driven_any_mean2.399534157916546
driven_any_median2.6206540811933356
driven_any_min0.3584723564231656
driven_lanedir_consec_max2.797801343606216
driven_lanedir_consec_mean2.23374864371674
driven_lanedir_consec_min0.35310074879629694
driven_lanedir_max2.797801343606216
driven_lanedir_mean2.23374864371674
driven_lanedir_median2.5018829386263537
driven_lanedir_min0.35310074879629694
in-drivable-lane_max2.600000000000037
in-drivable-lane_mean0.8900000000000106
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.539117016809044, "sim_physics": 0.09348508437474568, "survival_time": 14.950000000000076, "driven_lanedir": 2.3467116701170716, "sim_render-ego": 0.036595629851023354, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.05405745267868042, "deviation-heading": 2.608749172149957, "set_robot_commands": 0.06804514726003011, "deviation-center-line": 1.01120254957571, "driven_lanedir_consec": 2.3467116701170716, "sim_compute_sim_state": 0.02262753168741862, "sim_compute_performance-ego": 0.03950123230616251, "sim_compute_robot_state-ego": 0.0419959553082784, "sim_compute_robot_state-npc0": 0.04228177467981974, "sim_compute_robot_state-npc1": 0.040026251475016275, "sim_compute_robot_state-npc2": 0.04004010836283366, "sim_compute_robot_state-npc3": 0.039762918949127195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.83368486735831, "sim_physics": 0.09183181206385296, "survival_time": 14.950000000000076, "driven_lanedir": 2.5801867002295853, "sim_render-ego": 0.036032599608103434, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.053196028868357344, "deviation-heading": 2.179416652759577, "set_robot_commands": 0.06981865723927816, "deviation-center-line": 1.2334385007162123, "driven_lanedir_consec": 2.5801867002295853, "sim_compute_sim_state": 0.02282800277074178, "sim_compute_performance-ego": 0.03906227827072144, "sim_compute_robot_state-ego": 0.04154286781946818, "sim_compute_robot_state-npc0": 0.04173473040262858, "sim_compute_robot_state-npc1": 0.03983864466349284, "sim_compute_robot_state-npc2": 0.040851574738820395, "sim_compute_robot_state-npc3": 0.039887676239013674}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.6206540811933356, "sim_physics": 0.09158321539560954, "survival_time": 14.950000000000076, "driven_lanedir": 2.5917370395300434, "sim_render-ego": 0.03621167580286662, "in-drivable-lane": 0, "agent_compute-ego": 0.054025994141896565, "deviation-heading": 1.9708065538684347, "set_robot_commands": 0.06921907663345336, "deviation-center-line": 1.0295191829373436, "driven_lanedir_consec": 2.5917370395300434, "sim_compute_sim_state": 0.022783405780792236, "sim_compute_performance-ego": 0.03939202308654785, "sim_compute_robot_state-ego": 0.042702980041503906, "sim_compute_robot_state-npc0": 0.04184712171554565, "sim_compute_robot_state-npc1": 0.04029223918914795, "sim_compute_robot_state-npc2": 0.0404458475112915, "sim_compute_robot_state-npc3": 0.03980016311009725}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0185166382263924, "sim_physics": 0.09765920396578516, "survival_time": 5.899999999999987, "driven_lanedir": 0.9808241139198288, "sim_render-ego": 0.03661746695890265, "in-drivable-lane": 0, "agent_compute-ego": 0.0537999908802873, "deviation-heading": 1.0973789266953666, "set_robot_commands": 0.06991722422131037, "deviation-center-line": 0.47526275012889785, "driven_lanedir_consec": 0.9808241139198288, "sim_compute_sim_state": 0.02276689723386603, "sim_compute_performance-ego": 0.039328280141798115, "sim_compute_robot_state-ego": 0.041736495696892174, "sim_compute_robot_state-npc0": 0.04170886540817002, "sim_compute_robot_state-npc1": 0.043585494413214215, "sim_compute_robot_state-npc2": 0.040118740776837886, "sim_compute_robot_state-npc3": 0.03978013588210283}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.345880313644866, "sim_physics": 0.08600109525387653, "survival_time": 13.350000000000056, "driven_lanedir": 2.1820890135504816, "sim_render-ego": 0.036057529378026615, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.05245465732245856, "deviation-heading": 2.0442401590856636, "set_robot_commands": 0.06737910674305891, "deviation-center-line": 1.0055816252624508, "driven_lanedir_consec": 2.1820890135504816, "sim_compute_sim_state": 0.022695159197746593, "sim_compute_performance-ego": 0.038875603943728326, "sim_compute_robot_state-ego": 0.04172806525498294, "sim_compute_robot_state-npc0": 0.04164495003803839, "sim_compute_robot_state-npc1": 0.04103851139768679, "sim_compute_robot_state-npc2": 0.03976831543311645, "sim_compute_robot_state-npc3": 0.03958354817794057}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.578594449967396, "sim_physics": 0.09370814641316733, "survival_time": 14.950000000000076, "driven_lanedir": 2.5018829386263537, "sim_render-ego": 0.03701469739278158, "in-drivable-lane": 0, "agent_compute-ego": 0.0531943678855896, "deviation-heading": 2.9373156354547074, "set_robot_commands": 0.07097854614257812, "deviation-center-line": 1.3129962712511796, "driven_lanedir_consec": 2.5018829386263537, "sim_compute_sim_state": 0.02264898459116618, "sim_compute_performance-ego": 0.03902589718500773, "sim_compute_robot_state-ego": 0.04164507786432902, "sim_compute_robot_state-npc0": 0.04196256558100382, "sim_compute_robot_state-npc1": 0.04016757965087891, "sim_compute_robot_state-npc2": 0.040066537062327066, "sim_compute_robot_state-npc3": 0.039567193190256755}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.5306254875619603, "sim_physics": 0.09474448124567668, "survival_time": 14.950000000000076, "driven_lanedir": 2.150171774145237, "sim_render-ego": 0.036347765922546384, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.05299423853556315, "deviation-heading": 2.837648527070206, "set_robot_commands": 0.0678271222114563, "deviation-center-line": 1.1039693913960409, "driven_lanedir_consec": 2.150171774145237, "sim_compute_sim_state": 0.02265778462092082, "sim_compute_performance-ego": 0.0401654593149821, "sim_compute_robot_state-ego": 0.04159162044525146, "sim_compute_robot_state-npc0": 0.04207646131515503, "sim_compute_robot_state-npc1": 0.03994756539662679, "sim_compute_robot_state-npc2": 0.039793262481689455, "sim_compute_robot_state-npc3": 0.03973853588104248}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.779931245228635, "sim_physics": 0.08675656239191691, "survival_time": 14.950000000000076, "driven_lanedir": 2.4327135272375244, "sim_render-ego": 0.03620169957478841, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.06261357545852661, "deviation-heading": 2.271276599593209, "set_robot_commands": 0.06668259620666504, "deviation-center-line": 1.162639664874482, "driven_lanedir_consec": 2.4327135272375244, "sim_compute_sim_state": 0.022845858732859298, "sim_compute_performance-ego": 0.039005388418833414, "sim_compute_robot_state-ego": 0.04170609712600708, "sim_compute_robot_state-npc0": 0.04146124283472697, "sim_compute_robot_state-npc1": 0.04047438542048137, "sim_compute_robot_state-npc2": 0.039676104386647544, "sim_compute_robot_state-npc3": 0.039711280663808184}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.691909380656996, "sim_physics": 0.09742075284322103, "survival_time": 14.950000000000076, "driven_lanedir": 2.5848638390460317, "sim_render-ego": 0.03611896991729736, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.13579525073369345, "deviation-heading": 2.6111470410684268, "set_robot_commands": 0.05509305079778035, "deviation-center-line": 1.109123650541186, "driven_lanedir_consec": 2.5848638390460317, "sim_compute_sim_state": 0.022583060264587403, "sim_compute_performance-ego": 0.03983063062032064, "sim_compute_robot_state-ego": 0.04174484968185425, "sim_compute_robot_state-npc0": 0.04120313962300619, "sim_compute_robot_state-npc1": 0.04043505271275838, "sim_compute_robot_state-npc2": 0.04001245657602946, "sim_compute_robot_state-npc3": 0.04011681318283081}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.891670024268534, "sim_physics": 0.0905006464322408, "survival_time": 14.950000000000076, "driven_lanedir": 2.6075578875523058, "sim_render-ego": 0.035871572494506836, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.13306247234344482, "deviation-heading": 1.4509919648873273, "set_robot_commands": 0.0565929651260376, "deviation-center-line": 1.293583966730593, "driven_lanedir_consec": 2.6075578875523058, "sim_compute_sim_state": 0.022712581157684326, "sim_compute_performance-ego": 0.03954344113667806, "sim_compute_robot_state-ego": 0.04167037566502889, "sim_compute_robot_state-npc0": 0.04160115321477254, "sim_compute_robot_state-npc1": 0.04036651134490967, "sim_compute_robot_state-npc2": 0.040039321581522624, "sim_compute_robot_state-npc3": 0.04013758182525635}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.508025058748701, "sim_physics": 0.09009256601333618, "survival_time": 14.950000000000076, "driven_lanedir": 2.162868686808208, "sim_render-ego": 0.036487775643666585, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.13403133471806844, "deviation-heading": 3.2894998237338733, "set_robot_commands": 0.056231482823689775, "deviation-center-line": 1.219274110365697, "driven_lanedir_consec": 2.162868686808208, "sim_compute_sim_state": 0.022794748942057293, "sim_compute_performance-ego": 0.0404994797706604, "sim_compute_robot_state-ego": 0.04141329447428385, "sim_compute_robot_state-npc0": 0.04122111002604167, "sim_compute_robot_state-npc1": 0.03994937260945638, "sim_compute_robot_state-npc2": 0.040065810680389405, "sim_compute_robot_state-npc3": 0.03986523866653442}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.3584723564231656, "sim_physics": 0.08590967953205109, "survival_time": 2.3999999999999995, "driven_lanedir": 0.35310074879629694, "sim_render-ego": 0.03643361230691274, "in-drivable-lane": 0, "agent_compute-ego": 0.132408673564593, "deviation-heading": 0.38334638160903545, "set_robot_commands": 0.054964145024617515, "deviation-center-line": 0.23465359483055895, "driven_lanedir_consec": 0.35310074879629694, "sim_compute_sim_state": 0.02280577023824056, "sim_compute_performance-ego": 0.03954386214415232, "sim_compute_robot_state-ego": 0.04156642158826193, "sim_compute_robot_state-npc0": 0.0417231023311615, "sim_compute_robot_state-npc1": 0.04022923608620962, "sim_compute_robot_state-npc2": 0.04034519692262014, "sim_compute_robot_state-npc3": 0.03971010446548462}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.844464924955288, "sim_physics": 0.08858758449554444, "survival_time": 14.950000000000076, "driven_lanedir": 2.797801343606216, "sim_render-ego": 0.036843833128611246, "in-drivable-lane": 0, "agent_compute-ego": 0.1345440379778544, "deviation-heading": 2.1349777295946497, "set_robot_commands": 0.05543451627095541, "deviation-center-line": 1.1123415759189803, "driven_lanedir_consec": 2.797801343606216, "sim_compute_sim_state": 0.023137399355570475, "sim_compute_performance-ego": 0.039940132300059, "sim_compute_robot_state-ego": 0.041774582862854, "sim_compute_robot_state-npc0": 0.042445685068766274, "sim_compute_robot_state-npc1": 0.041409126122792565, "sim_compute_robot_state-npc2": 0.040598238309224446, "sim_compute_robot_state-npc3": 0.04028565486272176}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.663564481477922, "sim_physics": 0.09015828529993691, "survival_time": 14.950000000000076, "driven_lanedir": 2.6262713374112296, "sim_render-ego": 0.03659181197484334, "in-drivable-lane": 0, "agent_compute-ego": 0.13524166663487752, "deviation-heading": 1.9609326215700544, "set_robot_commands": 0.05491440057754517, "deviation-center-line": 0.9709483414544888, "driven_lanedir_consec": 2.6262713374112296, "sim_compute_sim_state": 0.02283639430999756, "sim_compute_performance-ego": 0.04131608327229818, "sim_compute_robot_state-ego": 0.04195708274841309, "sim_compute_robot_state-npc0": 0.042018872102101645, "sim_compute_robot_state-npc1": 0.04063657204310099, "sim_compute_robot_state-npc2": 0.04049076318740845, "sim_compute_robot_state-npc3": 0.040452895164489744}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.7879020422276435, "sim_physics": 0.09127273082733156, "survival_time": 14.950000000000076, "driven_lanedir": 2.607449035174686, "sim_render-ego": 0.03606430689493815, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.13431087017059326, "deviation-heading": 2.5258114145286, "set_robot_commands": 0.05761168162027995, "deviation-center-line": 1.3171915308434985, "driven_lanedir_consec": 2.607449035174686, "sim_compute_sim_state": 0.02253241856892904, "sim_compute_performance-ego": 0.03951253334681193, "sim_compute_robot_state-ego": 0.04157005627950033, "sim_compute_robot_state-npc0": 0.04095591545104981, "sim_compute_robot_state-npc1": 0.039915151596069336, "sim_compute_robot_state-npc2": 0.03989189942677816, "sim_compute_robot_state-npc3": 0.03994509299596151}}
set_robot_commands_max0.07097854614257812
set_robot_commands_mean0.06271398125991574
set_robot_commands_median0.06668259620666504
set_robot_commands_min0.05491440057754517
sim_compute_performance-ego_max0.04131608327229818
sim_compute_performance-ego_mean0.03963615501725081
sim_compute_performance-ego_median0.03951253334681193
sim_compute_performance-ego_min0.038875603943728326
sim_compute_robot_state-ego_max0.042702980041503906
sim_compute_robot_state-ego_mean0.04175638819046063
sim_compute_robot_state-ego_median0.04170609712600708
sim_compute_robot_state-ego_min0.04141329447428385
sim_compute_robot_state-npc0_max0.042445685068766274
sim_compute_robot_state-npc0_mean0.041725779319465854
sim_compute_robot_state-npc0_median0.0417231023311615
sim_compute_robot_state-npc0_min0.04095591545104981
sim_compute_robot_state-npc1_max0.043585494413214215
sim_compute_robot_state-npc1_mean0.04055411294145613
sim_compute_robot_state-npc1_median0.04029223918914795
sim_compute_robot_state-npc1_min0.03983864466349284
sim_compute_robot_state-npc2_max0.040851574738820395
sim_compute_robot_state-npc2_mean0.04014694516250244
sim_compute_robot_state-npc2_median0.040065810680389405
sim_compute_robot_state-npc2_min0.039676104386647544
sim_compute_robot_state-npc3_max0.040452895164489744
sim_compute_robot_state-npc3_mean0.03988965555044454
sim_compute_robot_state-npc3_median0.03980016311009725
sim_compute_robot_state-npc3_min0.039567193190256755
sim_compute_sim_state_max0.023137399355570475
sim_compute_sim_state_mean0.022750399830171877
sim_compute_sim_state_median0.02276689723386603
sim_compute_sim_state_min0.02253241856892904
sim_physics_max0.09765920396578516
sim_physics_mean0.09131412310321951
sim_physics_median0.09127273082733156
sim_physics_min0.08590967953205109
sim_render-ego_max0.03701469739278158
sim_render-ego_mean0.03636606312332101
sim_render-ego_median0.036347765922546384
sim_render-ego_min0.035871572494506836
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.403333333333396
survival_time_min2.3999999999999995
219133347JBRRussiaJetBrains Researchaido2-LFV-sim-testingstep1-simulationhost-errorno-0:50:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3347/step1-simulation-ip-172-31-38-104-5376-job21913/logs/challenges-runner/stdout.html'
(hidden)