AI Driving Olympics Home Challenges Submissions Jobs

Submission 3353

Submission3353
Competingyes
Challengeaido2-LFV-sim-testing
UserMYF
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22379
Next
User labeltest
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223793353MYFtestaido2-LFV-sim-testingstep1-simulationerroryes-0:14:26
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
219233353MYFtestaido2-LFV-sim-testingstep1-simulationsuccessno-0:42:33(hidden)
driven_lanedir_consec_median2.57416760465345
survival_time_median13.100000000000051
deviation-center-line_median0.4795837561836091
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09426415920257568
agent_compute-ego_mean0.0925199244224921
agent_compute-ego_median0.09247880299886067
agent_compute-ego_min0.0912354598611088
deviation-center-line_max1.059103768311453
deviation-center-line_mean0.5330486848023112
deviation-center-line_min0.21878770952411455
deviation-heading_max3.525150739177256
deviation-heading_mean1.858759301244596
deviation-heading_median1.9576596595368891
deviation-heading_min0.7115916052211718
driven_any_max3.111028856000527
driven_any_mean2.038461425684416
driven_any_median2.793776749154716
driven_any_min0.5254545550160427
driven_lanedir_consec_max3.076192919129867
driven_lanedir_consec_mean1.944918141784537
driven_lanedir_consec_min0.4813675204845296
driven_lanedir_max3.076192919129867
driven_lanedir_mean1.944918141784537
driven_lanedir_median2.57416760465345
driven_lanedir_min0.4813675204845296
in-drivable-lane_max1.050000000000015
in-drivable-lane_mean0.22000000000000164
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5579967122962197, "sim_physics": 0.10054920083385405, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5362204582186902, "sim_render-ego": 0.03670798317860749, "in-drivable-lane": 0, "agent_compute-ego": 0.0932210946487168, "deviation-heading": 0.7230954101375587, "set_robot_commands": 0.055990368632946985, "deviation-center-line": 0.21878770952411455, "driven_lanedir_consec": 0.5362204582186902, "sim_compute_sim_state": 0.022607645746004785, "sim_compute_performance-ego": 0.03901341405965514, "sim_compute_robot_state-ego": 0.0417167534262447, "sim_compute_robot_state-npc0": 0.04098817049446753, "sim_compute_robot_state-npc1": 0.04008247488636082, "sim_compute_robot_state-npc2": 0.03992880805064056, "sim_compute_robot_state-npc3": 0.03988977610054663}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.111028856000527, "sim_physics": 0.09546915451685588, "survival_time": 14.950000000000076, "driven_lanedir": 3.076192919129867, "sim_render-ego": 0.03633246103922526, "in-drivable-lane": 0, "agent_compute-ego": 0.09247196356455484, "deviation-heading": 1.9576596595368891, "set_robot_commands": 0.05655972719192505, "deviation-center-line": 0.808753660048207, "driven_lanedir_consec": 3.076192919129867, "sim_compute_sim_state": 0.022823288440704345, "sim_compute_performance-ego": 0.03933812697728475, "sim_compute_robot_state-ego": 0.04175350268681844, "sim_compute_robot_state-npc0": 0.04106300115585327, "sim_compute_robot_state-npc1": 0.04027830521265666, "sim_compute_robot_state-npc2": 0.03974238952000936, "sim_compute_robot_state-npc3": 0.039635377724965414}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.10259113813053, "sim_physics": 0.09334883916945684, "survival_time": 5.249999999999989, "driven_lanedir": 1.0873383876362102, "sim_render-ego": 0.03664747646876744, "in-drivable-lane": 0, "agent_compute-ego": 0.09170457295009068, "deviation-heading": 0.7115916052211718, "set_robot_commands": 0.05543870698838007, "deviation-center-line": 0.32706910969091485, "driven_lanedir_consec": 1.0873383876362102, "sim_compute_sim_state": 0.02287928717476981, "sim_compute_performance-ego": 0.039221484320504325, "sim_compute_robot_state-ego": 0.041571991784232, "sim_compute_robot_state-npc0": 0.040987646012079146, "sim_compute_robot_state-npc1": 0.0397549379439581, "sim_compute_robot_state-npc2": 0.0396658079964774, "sim_compute_robot_state-npc3": 0.039637490681239534}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1289860824444455, "sim_physics": 0.09378117712858682, "survival_time": 5.349999999999989, "driven_lanedir": 1.1060522970612805, "sim_render-ego": 0.03641311030521571, "in-drivable-lane": 0, "agent_compute-ego": 0.0939927680470119, "deviation-heading": 0.8122228059480999, "set_robot_commands": 0.055875800480352386, "deviation-center-line": 0.2956262600288367, "driven_lanedir_consec": 1.1060522970612805, "sim_compute_sim_state": 0.02323582907703435, "sim_compute_performance-ego": 0.03936747524225823, "sim_compute_robot_state-ego": 0.04172977554463895, "sim_compute_robot_state-npc0": 0.04133167222281483, "sim_compute_robot_state-npc1": 0.040481400266986024, "sim_compute_robot_state-npc2": 0.040369468314625394, "sim_compute_robot_state-npc3": 0.03976149202507233}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.851347516508506, "sim_physics": 0.08378587166468303, "survival_time": 9.6, "driven_lanedir": 1.6027959402355272, "sim_render-ego": 0.036184498419364296, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.09189100190997124, "deviation-heading": 1.6133179515287897, "set_robot_commands": 0.056664422154426575, "deviation-center-line": 0.4795837561836091, "driven_lanedir_consec": 1.6027959402355272, "sim_compute_sim_state": 0.023015784720579784, "sim_compute_performance-ego": 0.03914984439810117, "sim_compute_robot_state-ego": 0.04144884025057157, "sim_compute_robot_state-npc0": 0.0409107506275177, "sim_compute_robot_state-npc1": 0.04000304266810417, "sim_compute_robot_state-npc2": 0.039664462208747864, "sim_compute_robot_state-npc3": 0.03978478411833445}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0776237924477423, "sim_physics": 0.08830017176541415, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9895342580832172, "sim_render-ego": 0.03673955960707231, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09195692105726762, "deviation-heading": 0.9940146560093256, "set_robot_commands": 0.057061535661870784, "deviation-center-line": 0.3428943357127203, "driven_lanedir_consec": 0.9895342580832172, "sim_compute_sim_state": 0.022652409293434837, "sim_compute_performance-ego": 0.03913775574077259, "sim_compute_robot_state-ego": 0.041346255215731535, "sim_compute_robot_state-npc0": 0.04114778908816251, "sim_compute_robot_state-npc1": 0.039736359769647775, "sim_compute_robot_state-npc2": 0.039786698601462625, "sim_compute_robot_state-npc3": 0.03966302871704101}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.8414775319243484, "sim_physics": 0.09052671670913696, "survival_time": 14.950000000000076, "driven_lanedir": 2.795399672482862, "sim_render-ego": 0.036608780225118, "in-drivable-lane": 0, "agent_compute-ego": 0.09426415920257568, "deviation-heading": 2.252262604981998, "set_robot_commands": 0.05581378698348999, "deviation-center-line": 0.5891125866981072, "driven_lanedir_consec": 2.795399672482862, "sim_compute_sim_state": 0.02276226838429769, "sim_compute_performance-ego": 0.03906535943349203, "sim_compute_robot_state-ego": 0.04126808245976766, "sim_compute_robot_state-npc0": 0.04079168081283569, "sim_compute_robot_state-npc1": 0.04062102476755778, "sim_compute_robot_state-npc2": 0.03959442377090454, "sim_compute_robot_state-npc3": 0.039867177804311114}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.8017569866090746, "sim_physics": 0.09017577027916011, "survival_time": 13.300000000000054, "driven_lanedir": 2.57416760465345, "sim_render-ego": 0.03811391224538473, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.092708963200562, "deviation-heading": 2.38015135583649, "set_robot_commands": 0.05632229407030837, "deviation-center-line": 0.5881285856218341, "driven_lanedir_consec": 2.57416760465345, "sim_compute_sim_state": 0.022970347476184816, "sim_compute_performance-ego": 0.03979093418981796, "sim_compute_robot_state-ego": 0.04172709382566294, "sim_compute_robot_state-npc0": 0.04140139612040125, "sim_compute_robot_state-npc1": 0.04021085742720984, "sim_compute_robot_state-npc2": 0.0403726423593392, "sim_compute_robot_state-npc3": 0.04000379447650192}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.929709524909851, "sim_physics": 0.0985369356473287, "survival_time": 14.950000000000076, "driven_lanedir": 2.814048182972654, "sim_render-ego": 0.0364825701713562, "in-drivable-lane": 0, "agent_compute-ego": 0.09284500678380332, "deviation-heading": 3.525150739177256, "set_robot_commands": 0.05637880166371664, "deviation-center-line": 0.9279061528370056, "driven_lanedir_consec": 2.814048182972654, "sim_compute_sim_state": 0.02288838307062785, "sim_compute_performance-ego": 0.03943959633509318, "sim_compute_robot_state-ego": 0.04138147989908854, "sim_compute_robot_state-npc0": 0.04096012910207113, "sim_compute_robot_state-npc1": 0.039805467128753665, "sim_compute_robot_state-npc2": 0.03987889766693115, "sim_compute_robot_state-npc3": 0.039669482707977294}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.793776749154716, "sim_physics": 0.09428142136289872, "survival_time": 13.100000000000051, "driven_lanedir": 2.6742317135710563, "sim_render-ego": 0.03619972895119936, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.09164827015563733, "deviation-heading": 2.365448406152338, "set_robot_commands": 0.05572979413826047, "deviation-center-line": 0.6495834308660879, "driven_lanedir_consec": 2.6742317135710563, "sim_compute_sim_state": 0.02286205400947396, "sim_compute_performance-ego": 0.03894915016552874, "sim_compute_robot_state-ego": 0.04126793191633152, "sim_compute_robot_state-npc0": 0.040852824240240435, "sim_compute_robot_state-npc1": 0.03999413242776885, "sim_compute_robot_state-npc2": 0.03958163461612381, "sim_compute_robot_state-npc3": 0.03975827730338992}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.8009394604230633, "sim_physics": 0.0901082436243693, "survival_time": 14.950000000000076, "driven_lanedir": 2.7430584187677765, "sim_render-ego": 0.0364675768216451, "in-drivable-lane": 0, "agent_compute-ego": 0.09265875577926636, "deviation-heading": 2.693844020138569, "set_robot_commands": 0.055343449115753174, "deviation-center-line": 0.6802874480951538, "driven_lanedir_consec": 2.7430584187677765, "sim_compute_sim_state": 0.022944425741831465, "sim_compute_performance-ego": 0.03923181931177775, "sim_compute_robot_state-ego": 0.04120957136154175, "sim_compute_robot_state-npc0": 0.0408998966217041, "sim_compute_robot_state-npc1": 0.040033578872680664, "sim_compute_robot_state-npc2": 0.03968730529149373, "sim_compute_robot_state-npc3": 0.03954227844874064}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0404857247106216, "sim_physics": 0.08486330913285077, "survival_time": 5.899999999999987, "driven_lanedir": 0.8238069266492873, "sim_render-ego": 0.03573649414515091, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.0912354598611088, "deviation-heading": 1.4360793606870097, "set_robot_commands": 0.058360546322192175, "deviation-center-line": 0.340942542225096, "driven_lanedir_consec": 0.8238069266492873, "sim_compute_sim_state": 0.02308752981282897, "sim_compute_performance-ego": 0.039044976234436035, "sim_compute_robot_state-ego": 0.04139793929407152, "sim_compute_robot_state-npc0": 0.04591548644890219, "sim_compute_robot_state-npc1": 0.03994828361575886, "sim_compute_robot_state-npc2": 0.04016871775610972, "sim_compute_robot_state-npc3": 0.03954483896999036}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.5254545550160427, "sim_physics": 0.10233536599174378, "survival_time": 3.149999999999997, "driven_lanedir": 0.4813675204845296, "sim_render-ego": 0.03635956370641315, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.09264581165616474, "deviation-heading": 0.9604657875587174, "set_robot_commands": 0.055677796167040626, "deviation-center-line": 0.2409813945500072, "driven_lanedir_consec": 0.4813675204845296, "sim_compute_sim_state": 0.02282516918485127, "sim_compute_performance-ego": 0.039065273981245735, "sim_compute_robot_state-ego": 0.04143305051894415, "sim_compute_robot_state-npc0": 0.04073841988094269, "sim_compute_robot_state-npc1": 0.040096737089611235, "sim_compute_robot_state-npc2": 0.04029557818458194, "sim_compute_robot_state-npc3": 0.03931043261573428}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.981026946021316, "sim_physics": 0.09029695749282836, "survival_time": 14.950000000000076, "driven_lanedir": 2.8805007322675253, "sim_render-ego": 0.036612123648325605, "in-drivable-lane": 0, "agent_compute-ego": 0.09247880299886067, "deviation-heading": 3.20215165851837, "set_robot_commands": 0.05600699424743652, "deviation-center-line": 1.059103768311453, "driven_lanedir_consec": 2.8805007322675253, "sim_compute_sim_state": 0.02257347504297892, "sim_compute_performance-ego": 0.03927194039026896, "sim_compute_robot_state-ego": 0.041469775040944415, "sim_compute_robot_state-npc0": 0.04083489100138346, "sim_compute_robot_state-npc1": 0.03966626882553101, "sim_compute_robot_state-npc2": 0.03976341803868612, "sim_compute_robot_state-npc3": 0.03978372017542521}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.032719808669233, "sim_physics": 0.09623352924982707, "survival_time": 14.950000000000076, "driven_lanedir": 2.9890570945541213, "sim_render-ego": 0.0364319101969401, "in-drivable-lane": 0, "agent_compute-ego": 0.09207531452178956, "deviation-heading": 2.253933497236358, "set_robot_commands": 0.05546858310699463, "deviation-center-line": 0.44696953164151865, "driven_lanedir_consec": 2.9890570945541213, "sim_compute_sim_state": 0.02286589066187541, "sim_compute_performance-ego": 0.04011486609776815, "sim_compute_robot_state-ego": 0.04148960510889689, "sim_compute_robot_state-npc0": 0.04100425720214844, "sim_compute_robot_state-npc1": 0.040081835587819414, "sim_compute_robot_state-npc2": 0.039664398034413656, "sim_compute_robot_state-npc3": 0.03979611237843832}}
set_robot_commands_max0.058360546322192175
set_robot_commands_mean0.056179507128339634
set_robot_commands_median0.055990368632946985
set_robot_commands_min0.055343449115753174
sim_compute_performance-ego_max0.04011486609776815
sim_compute_performance-ego_mean0.03928013445853365
sim_compute_performance-ego_median0.039221484320504325
sim_compute_performance-ego_min0.03894915016552874
sim_compute_robot_state-ego_max0.04175350268681844
sim_compute_robot_state-ego_mean0.04148077655556577
sim_compute_robot_state-ego_median0.04144884025057157
sim_compute_robot_state-ego_min0.04120957136154175
sim_compute_robot_state-npc0_max0.04591548644890219
sim_compute_robot_state-npc0_mean0.04132186740210163
sim_compute_robot_state-npc0_median0.040987646012079146
sim_compute_robot_state-npc0_min0.04073841988094269
sim_compute_robot_state-npc1_max0.04062102476755778
sim_compute_robot_state-npc1_mean0.04005298043269366
sim_compute_robot_state-npc1_median0.040033578872680664
sim_compute_robot_state-npc1_min0.03966626882553101
sim_compute_robot_state-npc2_max0.0403726423593392
sim_compute_robot_state-npc2_mean0.03987764336070313
sim_compute_robot_state-npc2_median0.03976341803868612
sim_compute_robot_state-npc2_min0.03958163461612381
sim_compute_robot_state-npc3_max0.04000379447650192
sim_compute_robot_state-npc3_mean0.03970987094984722
sim_compute_robot_state-npc3_median0.03975827730338992
sim_compute_robot_state-npc3_min0.03931043261573428
sim_compute_sim_state_max0.02323582907703435
sim_compute_sim_state_mean0.02286625252249855
sim_compute_sim_state_median0.02286589066187541
sim_compute_sim_state_min0.02257347504297892
sim_physics_max0.10233536599174378
sim_physics_mean0.0928395109712663
sim_physics_median0.09334883916945684
sim_physics_min0.08378587166468303
sim_render-ego_max0.03811391224538473
sim_render-ego_mean0.03653584994198571
sim_render-ego_median0.0364675768216451
sim_render-ego_min0.03573649414515091
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.253333333333368
survival_time_min2.9499999999999975
219223353MYFtestaido2-LFV-sim-testingstep1-simulationhost-errorno-0:21:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3353/step1-simulation-ip-172-31-40-253-32059-job21922/logs/challenges-runner/stdout.html'
(hidden)