AI Driving Olympics Home Challenges Submissions Jobs

Submission 3094

Submission3094
Competingyes
Challengeaido2-LF-sim-testing
Userawoo424
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22624
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
226243094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessyes-0:43:19(hidden)
driven_lanedir_consec_median0.6523061495015456
survival_time_median12.650000000000045
deviation-center-line_median0.5946778587674307
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2097931990256676
agent_compute-ego_mean0.20644512680270757
agent_compute-ego_median0.2065522559483846
agent_compute-ego_min0.1996800148928607
deviation-center-line_max1.2178051376751096
deviation-center-line_mean0.6855564791566023
deviation-center-line_min0.283627348787723
deviation-heading_max3.674963758747008
deviation-heading_mean1.7399018713307062
deviation-heading_median1.7044193777552517
deviation-heading_min0.16965746995812037
driven_any_max1.2200010592902049
driven_any_mean0.8829100381869169
driven_any_median0.9955491007854684
driven_any_min0.18224935172653897
driven_lanedir_consec_max1.2173039017028584
driven_lanedir_consec_mean0.7599456838536602
driven_lanedir_consec_min0.17013176657597873
driven_lanedir_max1.2173039017028584
driven_lanedir_mean0.7599456838536602
driven_lanedir_median0.6523061495015456
driven_lanedir_min0.17013176657597873
in-drivable-lane_max4.350000000000062
in-drivable-lane_mean1.1166666666666825
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0207705991977636, "sim_physics": 0.060925042256712914, "survival_time": 12.800000000000049, "driven_lanedir": 0.6636396340244062, "sim_render-ego": 0.06293089222162962, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.20959973987191916, "deviation-heading": 3.674963758747008, "set_robot_commands": 0.07905749324709177, "deviation-center-line": 0.5688470948069573, "driven_lanedir_consec": 0.6636396340244062, "sim_compute_sim_state": 0.04256367404013872, "sim_compute_performance-ego": 0.06595547590404749, "sim_compute_robot_state-ego": 0.06587300263345242}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9940609238534442, "sim_physics": 0.06068859982678271, "survival_time": 12.700000000000044, "driven_lanedir": 0.8072101738551097, "sim_render-ego": 0.06460009972880205, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.2088010104622428, "deviation-heading": 2.832547427697435, "set_robot_commands": 0.0791890790143351, "deviation-center-line": 0.7868030205809607, "driven_lanedir_consec": 0.8072101738551097, "sim_compute_sim_state": 0.04369183694283793, "sim_compute_performance-ego": 0.06784666241623286, "sim_compute_robot_state-ego": 0.06708754798558754}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.18224935172653897, "sim_physics": 0.06312138945968063, "survival_time": 2.6999999999999984, "driven_lanedir": 0.17013176657597873, "sim_render-ego": 0.06377567185295953, "in-drivable-lane": 0, "agent_compute-ego": 0.1996800148928607, "deviation-heading": 0.9343774825348196, "set_robot_commands": 0.07428594430287679, "deviation-center-line": 0.283627348787723, "driven_lanedir_consec": 0.17013176657597873, "sim_compute_sim_state": 0.04189200754518862, "sim_compute_performance-ego": 0.06702888453448261, "sim_compute_robot_state-ego": 0.0680124009097064}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.503508393358682, "sim_physics": 0.06032766012045054, "survival_time": 6.499999999999985, "driven_lanedir": 0.48552056760986906, "sim_render-ego": 0.06464732793661264, "in-drivable-lane": 0, "agent_compute-ego": 0.2097931990256676, "deviation-heading": 1.7044193777552517, "set_robot_commands": 0.07768769631019005, "deviation-center-line": 0.5044204827108707, "driven_lanedir_consec": 0.48552056760986906, "sim_compute_sim_state": 0.04251192716451792, "sim_compute_performance-ego": 0.06677268285017747, "sim_compute_robot_state-ego": 0.06551454617426945}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2027774654668777, "sim_physics": 0.058070662021636965, "survival_time": 14.950000000000076, "driven_lanedir": 1.1780269912531711, "sim_render-ego": 0.06402987877527873, "in-drivable-lane": 0, "agent_compute-ego": 0.20880224148432416, "deviation-heading": 1.7990953498767968, "set_robot_commands": 0.07803671280543009, "deviation-center-line": 0.7303747391200331, "driven_lanedir_consec": 1.1780269912531711, "sim_compute_sim_state": 0.04256214459737142, "sim_compute_performance-ego": 0.06556555112202962, "sim_compute_robot_state-ego": 0.06373808622360229}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4810428279701421, "sim_physics": 0.059297856830415274, "survival_time": 6.299999999999986, "driven_lanedir": 0.4578663053041683, "sim_render-ego": 0.06080844288780576, "in-drivable-lane": 0, "agent_compute-ego": 0.20775327796027773, "deviation-heading": 1.939095142563667, "set_robot_commands": 0.07615298884255546, "deviation-center-line": 0.49332729135590886, "driven_lanedir_consec": 0.4578663053041683, "sim_compute_sim_state": 0.04116091084858728, "sim_compute_performance-ego": 0.06211618771628728, "sim_compute_robot_state-ego": 0.06372166815258208}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9955491007854684, "sim_physics": 0.0564838435810074, "survival_time": 12.650000000000045, "driven_lanedir": 0.6159985806729336, "sim_render-ego": 0.06093152615392632, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.20571921182715375, "deviation-heading": 1.850254300868432, "set_robot_commands": 0.07690573115593831, "deviation-center-line": 0.5013964133210531, "driven_lanedir_consec": 0.6159985806729336, "sim_compute_sim_state": 0.04183679324364945, "sim_compute_performance-ego": 0.06366274196639833, "sim_compute_robot_state-ego": 0.06351657818428612}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.2889931353427513, "sim_physics": 0.05804152488708496, "survival_time": 3.999999999999994, "driven_lanedir": 0.28121171271941936, "sim_render-ego": 0.06196720898151398, "in-drivable-lane": 0, "agent_compute-ego": 0.20721740424633023, "deviation-heading": 0.9204387374489202, "set_robot_commands": 0.07813375294208527, "deviation-center-line": 0.43020454534709474, "driven_lanedir_consec": 0.28121171271941936, "sim_compute_sim_state": 0.04136331975460053, "sim_compute_performance-ego": 0.06418056488037109, "sim_compute_robot_state-ego": 0.0626752346754074}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.205281109718533, "sim_physics": 0.05669652144114176, "survival_time": 14.950000000000076, "driven_lanedir": 1.2028575181014998, "sim_render-ego": 0.0605112608273824, "in-drivable-lane": 0, "agent_compute-ego": 0.2046729294459025, "deviation-heading": 0.7095458329423281, "set_robot_commands": 0.07750153462092081, "deviation-center-line": 0.9600869493681972, "driven_lanedir_consec": 1.2028575181014998, "sim_compute_sim_state": 0.040570794741312664, "sim_compute_performance-ego": 0.06248031218846639, "sim_compute_robot_state-ego": 0.06337752978006998}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9976492401276388, "sim_physics": 0.05829899624524364, "survival_time": 12.550000000000043, "driven_lanedir": 0.6480670198840939, "sim_render-ego": 0.06274747563548297, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.2052507713971385, "deviation-heading": 3.015507728112178, "set_robot_commands": 0.07819761128064645, "deviation-center-line": 0.680559448578591, "driven_lanedir_consec": 0.6480670198840939, "sim_compute_sim_state": 0.04153908581372751, "sim_compute_performance-ego": 0.06423665042892396, "sim_compute_robot_state-ego": 0.06277924514861696}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.2064159917481403, "sim_physics": 0.05864277998606364, "survival_time": 14.950000000000076, "driven_lanedir": 1.1814130224728343, "sim_render-ego": 0.0631562320391337, "in-drivable-lane": 0, "agent_compute-ego": 0.2065522559483846, "deviation-heading": 1.274610115556399, "set_robot_commands": 0.0770912233988444, "deviation-center-line": 1.0532448941856924, "driven_lanedir_consec": 1.1814130224728343, "sim_compute_sim_state": 0.04192339897155762, "sim_compute_performance-ego": 0.06404273509979248, "sim_compute_robot_state-ego": 0.06364928722381592}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.9939432764337164, "sim_physics": 0.0589441801271131, "survival_time": 12.40000000000004, "driven_lanedir": 0.6523061495015456, "sim_render-ego": 0.06263766173393495, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.20811323773476384, "deviation-heading": 2.9028019703638512, "set_robot_commands": 0.076598277976436, "deviation-center-line": 0.5946778587674307, "driven_lanedir_consec": 0.6523061495015456, "sim_compute_sim_state": 0.04113972187042236, "sim_compute_performance-ego": 0.06308013489169459, "sim_compute_robot_state-ego": 0.06322244578792204}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7509928569294946, "sim_physics": 0.05663307466005024, "survival_time": 9.5, "driven_lanedir": 0.6373657134532887, "sim_render-ego": 0.06260005298413729, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.2055214718768471, "deviation-heading": 1.6756527884125696, "set_robot_commands": 0.07768540507868717, "deviation-center-line": 0.4723512987738168, "driven_lanedir_consec": 0.6373657134532887, "sim_compute_sim_state": 0.04237830011468185, "sim_compute_performance-ego": 0.06364208899046245, "sim_compute_robot_state-ego": 0.06366227551510459}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.2200010592902049, "sim_physics": 0.05908202966054281, "survival_time": 14.950000000000076, "driven_lanedir": 1.2173039017028584, "sim_render-ego": 0.06492081244786581, "in-drivable-lane": 0, "agent_compute-ego": 0.20646447579065955, "deviation-heading": 0.695560587122821, "set_robot_commands": 0.07788645346959432, "deviation-center-line": 1.0056206639695962, "driven_lanedir_consec": 1.2173039017028584, "sim_compute_sim_state": 0.04315885861714681, "sim_compute_performance-ego": 0.06637797832489013, "sim_compute_robot_state-ego": 0.06490856409072876}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.200415240854356, "sim_physics": 0.05722566843032837, "survival_time": 14.950000000000076, "driven_lanedir": 1.2002662006737288, "sim_render-ego": 0.06445024251937866, "in-drivable-lane": 0, "agent_compute-ego": 0.20273566007614136, "deviation-heading": 0.16965746995812037, "set_robot_commands": 0.0768631911277771, "deviation-center-line": 1.2178051376751096, "driven_lanedir_consec": 1.2002662006737288, "sim_compute_sim_state": 0.04255724271138509, "sim_compute_performance-ego": 0.06641220410664876, "sim_compute_robot_state-ego": 0.06387273867925009}}
set_robot_commands_max0.0791890790143351
set_robot_commands_mean0.07741820637156059
set_robot_commands_median0.07768540507868717
set_robot_commands_min0.07428594430287679
sim_compute_performance-ego_max0.06784666241623286
sim_compute_performance-ego_mean0.06489339036139369
sim_compute_performance-ego_median0.06423665042892396
sim_compute_performance-ego_min0.06211618771628728
sim_compute_robot_state-ego_max0.0680124009097064
sim_compute_robot_state-ego_mean0.06437407674429348
sim_compute_robot_state-ego_median0.06372166815258208
sim_compute_robot_state-ego_min0.0626752346754074
sim_compute_sim_state_max0.04369183694283793
sim_compute_sim_state_mean0.04205666779847504
sim_compute_sim_state_median0.04192339897155762
sim_compute_sim_state_min0.040570794741312664
sim_physics_max0.06312138945968063
sim_physics_mean0.058831988635617
sim_physics_median0.05864277998606364
sim_physics_min0.0564838435810074
sim_render-ego_max0.06492081244786581
sim_render-ego_mean0.06298098578172297
sim_render-ego_median0.06293089222162962
sim_render-ego_min0.0605112608273824
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.12333333333337
survival_time_min2.6999999999999984
208633094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno-0:57:33(hidden)
driven_lanedir_consec_median0.652255150972466
survival_time_median12.700000000000044
deviation-center-line_median0.5943657288271308
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2320159429640282
agent_compute-ego_mean0.21135994987175735
agent_compute-ego_median0.2072378178541573
agent_compute-ego_min0.19647876898447672
deviation-center-line_max1.2181863263529389
deviation-center-line_mean0.6892383378628318
deviation-center-line_min0.39643612401470296
deviation-heading_max3.729066692860827
deviation-heading_mean1.7391871930770029
deviation-heading_median1.8018560795984804
deviation-heading_min0.17215996026845026
driven_any_max1.2199806443789412
driven_any_mean0.8859284972630836
driven_any_median0.9969059772208292
driven_any_min0.2748826817340306
driven_lanedir_consec_max1.217271625895482
driven_lanedir_consec_mean0.7629735122232281
driven_lanedir_consec_min0.26697291786930677
driven_lanedir_max1.217271625895482
driven_lanedir_mean0.7629735122232281
driven_lanedir_median0.652255150972466
driven_lanedir_min0.26697291786930677
in-drivable-lane_max4.4000000000000625
in-drivable-lane_mean1.120000000000016
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0201669667648516, "sim_physics": 0.1184430867433548, "survival_time": 12.800000000000049, "driven_lanedir": 0.6627720815820519, "sim_render-ego": 0.0651656948029995, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.2288930658251047, "deviation-heading": 3.729066692860827, "set_robot_commands": 0.10320324171334504, "deviation-center-line": 0.5792094112502033, "driven_lanedir_consec": 0.6627720815820519, "sim_compute_sim_state": 0.039981553331017494, "sim_compute_performance-ego": 0.07258726470172405, "sim_compute_robot_state-ego": 0.07866801414638758}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9941770199714104, "sim_physics": 0.11479715474947232, "survival_time": 12.700000000000044, "driven_lanedir": 0.8074185113640052, "sim_render-ego": 0.06307201310405582, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.2320159429640282, "deviation-heading": 2.827465464835728, "set_robot_commands": 0.09936835634426808, "deviation-center-line": 0.7844092783452012, "driven_lanedir_consec": 0.8074185113640052, "sim_compute_sim_state": 0.03957696036091001, "sim_compute_performance-ego": 0.06951928044867328, "sim_compute_robot_state-ego": 0.07784934306707908}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2748826817340306, "sim_physics": 0.10753151257832844, "survival_time": 3.7499999999999942, "driven_lanedir": 0.2681315282026988, "sim_render-ego": 0.060503390630086265, "in-drivable-lane": 0, "agent_compute-ego": 0.20063360214233397, "deviation-heading": 0.824721480245467, "set_robot_commands": 0.0921766757965088, "deviation-center-line": 0.41208278787592406, "driven_lanedir_consec": 0.2681315282026988, "sim_compute_sim_state": 0.03598797162373861, "sim_compute_performance-ego": 0.0647342300415039, "sim_compute_robot_state-ego": 0.06912945111592611}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4685728698403183, "sim_physics": 0.10374456397758045, "survival_time": 6.0499999999999865, "driven_lanedir": 0.44779928188363494, "sim_render-ego": 0.0580448513188638, "in-drivable-lane": 0, "agent_compute-ego": 0.19841904876645933, "deviation-heading": 1.8018560795984804, "set_robot_commands": 0.09040370657424296, "deviation-center-line": 0.45016597316138546, "driven_lanedir_consec": 0.44779928188363494, "sim_compute_sim_state": 0.03735212058075203, "sim_compute_performance-ego": 0.0656654677115196, "sim_compute_robot_state-ego": 0.06904468457560894}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2024656934674065, "sim_physics": 0.11652849912643432, "survival_time": 14.950000000000076, "driven_lanedir": 1.177550943827185, "sim_render-ego": 0.06258933464686076, "in-drivable-lane": 0, "agent_compute-ego": 0.2271674370765686, "deviation-heading": 1.8107245511094463, "set_robot_commands": 0.09731629133224488, "deviation-center-line": 0.7387680017097676, "driven_lanedir_consec": 1.177550943827185, "sim_compute_sim_state": 0.03917797883351644, "sim_compute_performance-ego": 0.07058555444081624, "sim_compute_robot_state-ego": 0.07755951166152954}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4809549524743351, "sim_physics": 0.11657123717050703, "survival_time": 6.299999999999986, "driven_lanedir": 0.4577779763941332, "sim_render-ego": 0.05678807743011959, "in-drivable-lane": 0, "agent_compute-ego": 0.19867401085202657, "deviation-heading": 1.939313216933653, "set_robot_commands": 0.09143074921199254, "deviation-center-line": 0.49326262669181176, "driven_lanedir_consec": 0.4577779763941332, "sim_compute_sim_state": 0.038215192537459114, "sim_compute_performance-ego": 0.0651724414219932, "sim_compute_robot_state-ego": 0.06635513002910311}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.998269077074832, "sim_physics": 0.11948437108768252, "survival_time": 12.700000000000044, "driven_lanedir": 0.615917012450867, "sim_render-ego": 0.06314179653257836, "in-drivable-lane": 4.4000000000000625, "agent_compute-ego": 0.22863367598826492, "deviation-heading": 1.8538379616604452, "set_robot_commands": 0.09883517918624277, "deviation-center-line": 0.5019883499777812, "driven_lanedir_consec": 0.615917012450867, "sim_compute_sim_state": 0.040591695177273485, "sim_compute_performance-ego": 0.07164035162587803, "sim_compute_robot_state-ego": 0.07745359826275683}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.2749736369825207, "sim_physics": 0.10338249524434408, "survival_time": 3.7499999999999942, "driven_lanedir": 0.26697291786930677, "sim_render-ego": 0.058799765904744464, "in-drivable-lane": 0, "agent_compute-ego": 0.202016814549764, "deviation-heading": 0.8975090875142229, "set_robot_commands": 0.09088573137919108, "deviation-center-line": 0.39643612401470296, "driven_lanedir_consec": 0.26697291786930677, "sim_compute_sim_state": 0.0364789358774821, "sim_compute_performance-ego": 0.06382635116577148, "sim_compute_robot_state-ego": 0.07043227513631185}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.205281109718533, "sim_physics": 0.12100523789723716, "survival_time": 14.950000000000076, "driven_lanedir": 1.2028575181014998, "sim_render-ego": 0.06413018862406412, "in-drivable-lane": 0, "agent_compute-ego": 0.2307079823811849, "deviation-heading": 0.7095458329423281, "set_robot_commands": 0.09809263388315836, "deviation-center-line": 0.9600869493681972, "driven_lanedir_consec": 1.2028575181014998, "sim_compute_sim_state": 0.039794812202453615, "sim_compute_performance-ego": 0.07149607181549072, "sim_compute_robot_state-ego": 0.07917014042536417}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9969059772208292, "sim_physics": 0.11099631947825156, "survival_time": 12.550000000000043, "driven_lanedir": 0.6467338351540284, "sim_render-ego": 0.060813433620559264, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.20732438611794277, "deviation-heading": 2.955391341360599, "set_robot_commands": 0.09175865013760874, "deviation-center-line": 0.670951210760338, "driven_lanedir_consec": 0.6467338351540284, "sim_compute_sim_state": 0.03833502982242174, "sim_compute_performance-ego": 0.06691440073142489, "sim_compute_robot_state-ego": 0.07056484184417117}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.2065131329376906, "sim_physics": 0.1073916761080424, "survival_time": 14.950000000000076, "driven_lanedir": 1.181511992560742, "sim_render-ego": 0.05711821635564168, "in-drivable-lane": 0, "agent_compute-ego": 0.19712116479873656, "deviation-heading": 1.2734616012296878, "set_robot_commands": 0.08727649768193563, "deviation-center-line": 1.052830292075256, "driven_lanedir_consec": 1.181511992560742, "sim_compute_sim_state": 0.03614063342412313, "sim_compute_performance-ego": 0.06259420474370321, "sim_compute_robot_state-ego": 0.06924530824025472}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.9935781905505376, "sim_physics": 0.10640755776436098, "survival_time": 12.40000000000004, "driven_lanedir": 0.652255150972466, "sim_render-ego": 0.059939111432721535, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.2007487666222357, "deviation-heading": 2.900605902152334, "set_robot_commands": 0.08920814914088096, "deviation-center-line": 0.5943657288271308, "driven_lanedir_consec": 0.652255150972466, "sim_compute_sim_state": 0.03718135337675771, "sim_compute_performance-ego": 0.06420587243572358, "sim_compute_robot_state-ego": 0.06835123415916197}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7528689410570975, "sim_physics": 0.1099923755485974, "survival_time": 9.55, "driven_lanedir": 0.6404451449597168, "sim_render-ego": 0.060958481583919824, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.2072378178541573, "deviation-heading": 1.6950173132973425, "set_robot_commands": 0.09223665991378704, "deviation-center-line": 0.4787678830209627, "driven_lanedir_consec": 0.6404451449597168, "sim_compute_sim_state": 0.03924020422690826, "sim_compute_performance-ego": 0.06608385939872702, "sim_compute_robot_state-ego": 0.07318432418463743}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.2199806443789412, "sim_physics": 0.09899160782496134, "survival_time": 14.950000000000076, "driven_lanedir": 1.217271625895482, "sim_render-ego": 0.05874826192855835, "in-drivable-lane": 0, "agent_compute-ego": 0.19647876898447672, "deviation-heading": 0.6971314101460321, "set_robot_commands": 0.08844446897506714, "deviation-center-line": 1.0070641245108762, "driven_lanedir_consec": 1.217271625895482, "sim_compute_sim_state": 0.03724103848139445, "sim_compute_performance-ego": 0.0651290202140808, "sim_compute_robot_state-ego": 0.06884069840113322}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.199336564772919, "sim_physics": 0.10606984376907348, "survival_time": 14.950000000000076, "driven_lanedir": 1.1991871621306025, "sim_render-ego": 0.060599629084269205, "in-drivable-lane": 0, "agent_compute-ego": 0.21432676315307617, "deviation-heading": 0.17215996026845026, "set_robot_commands": 0.09620875835418702, "deviation-center-line": 1.2181863263529389, "driven_lanedir_consec": 1.1991871621306025, "sim_compute_sim_state": 0.03831042846043905, "sim_compute_performance-ego": 0.06761361360549926, "sim_compute_robot_state-ego": 0.07320789734522502}}
set_robot_commands_max0.10320324171334504
set_robot_commands_mean0.09378971664164408
set_robot_commands_median0.0921766757965088
set_robot_commands_min0.08727649768193563
sim_compute_performance-ego_max0.07258726470172405
sim_compute_performance-ego_mean0.06718453230016862
sim_compute_performance-ego_median0.06608385939872702
sim_compute_performance-ego_min0.06259420474370321
sim_compute_robot_state-ego_max0.07917014042536417
sim_compute_robot_state-ego_mean0.07260376350631007
sim_compute_robot_state-ego_median0.07056484184417117
sim_compute_robot_state-ego_min0.06635513002910311
sim_compute_sim_state_max0.040591695177273485
sim_compute_sim_state_mean0.03824039388777649
sim_compute_sim_state_median0.03831042846043905
sim_compute_sim_state_min0.03598797162373861
sim_physics_max0.12100523789723716
sim_physics_mean0.1107558359378819
sim_physics_median0.1099923755485974
sim_physics_min0.09899160782496134
sim_render-ego_max0.0651656948029995
sim_render-ego_mean0.06069414980000284
sim_render-ego_median0.060599629084269205
sim_render-ego_min0.05678807743011959
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.15333333333337
survival_time_min3.7499999999999942
208283094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno-0:35:44
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3094/step1-simulation-ip-172-31-42-167-7357-job20828/logs/challenges-runner/stdout.log'
(hidden)
207963094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno-0:39:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3094/step1-simulation-ip-172-31-38-104-5197-job20796/logs/challenges-runner/stdout.log'
(hidden)
207383094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationtimeoutno-1:05:25
I can see how the jo [...]
I can see how the job 20738 is timeout because passed 3925 seconds and the timeout is 3600.0.
(hidden)
207203094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno-0:03:50
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 996, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20720-484599', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 579, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 905, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 591, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1004, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20720-484599', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20720-484599', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
206973094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno-0:11:37(hidden)
driven_lanedir_consec_median0.6623258525741951
survival_time_median12.750000000000046
deviation-center-line_median0.570013205605356
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1263930294662714
agent_compute-ego_mean0.12215432164319256
agent_compute-ego_median0.121129669061228
agent_compute-ego_min0.12053230323043523
deviation-center-line_max0.91610365578435
deviation-center-line_mean0.61675723592108
deviation-center-line_min0.4112521295316036
deviation-heading_max3.698830880493315
deviation-heading_mean2.2819670812794475
deviation-heading_median1.8184946880931996
deviation-heading_min0.8317415439989438
driven_any_max1.201342183410811
driven_any_mean0.7905989102615821
driven_any_median0.9963128238208814
driven_any_min0.2749027968856813
driven_lanedir_consec_max1.1767726289173273
driven_lanedir_consec_mean0.6761964806753962
driven_lanedir_consec_min0.2680589470773551
driven_lanedir_max1.1767726289173273
driven_lanedir_mean0.6761964806753962
driven_lanedir_median0.6623258525741951
driven_lanedir_min0.2680589470773551
in-drivable-lane_max3.250000000000046
in-drivable-lane_mean0.8900000000000127
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0213085429747646, "sim_physics": 0.05918267369270325, "survival_time": 12.800000000000049, "driven_lanedir": 0.6623258525741951, "sim_render-ego": 0.03482775669544935, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.1263930294662714, "deviation-heading": 3.698830880493315, "set_robot_commands": 0.0545216565951705, "deviation-center-line": 0.570013205605356, "driven_lanedir_consec": 0.6623258525741951, "sim_compute_sim_state": 0.022783621214330196, "sim_compute_performance-ego": 0.0389002226293087, "sim_compute_robot_state-ego": 0.040369133464992046}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9963128238208814, "sim_physics": 0.059159339642992206, "survival_time": 12.750000000000046, "driven_lanedir": 0.836119104911883, "sim_render-ego": 0.035024344687368356, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.12053230323043523, "deviation-heading": 3.243681256514505, "set_robot_commands": 0.054845639771106194, "deviation-center-line": 0.91610365578435, "driven_lanedir_consec": 0.836119104911883, "sim_compute_sim_state": 0.022789815827911977, "sim_compute_performance-ego": 0.038376874549716125, "sim_compute_robot_state-ego": 0.04013007575390386}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2749027968856813, "sim_physics": 0.04594159444173177, "survival_time": 3.7499999999999942, "driven_lanedir": 0.2680589470773551, "sim_render-ego": 0.03483156204223633, "in-drivable-lane": 0, "agent_compute-ego": 0.12100945472717284, "deviation-heading": 0.8317415439989438, "set_robot_commands": 0.053811508814493814, "deviation-center-line": 0.4112521295316036, "driven_lanedir_consec": 0.2680589470773551, "sim_compute_sim_state": 0.022666826248168945, "sim_compute_performance-ego": 0.03890888532002767, "sim_compute_robot_state-ego": 0.040386349360148115}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.05637833451022621, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.035831607690378395, "in-drivable-lane": 0, "agent_compute-ego": 0.121129669061228, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.05435441522037282, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.02270036785542464, "sim_compute_performance-ego": 0.03860706842246176, "sim_compute_robot_state-ego": 0.04060171632205739}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.201342183410811, "sim_physics": 0.06184904972712199, "survival_time": 14.950000000000076, "driven_lanedir": 1.1767726289173273, "sim_render-ego": 0.035224892298380536, "in-drivable-lane": 0, "agent_compute-ego": 0.1217071517308553, "deviation-heading": 1.8184946880931996, "set_robot_commands": 0.05447614908218384, "deviation-center-line": 0.7449179319340268, "driven_lanedir_consec": 1.1767726289173273, "sim_compute_sim_state": 0.02280704418818156, "sim_compute_performance-ego": 0.038997705777486166, "sim_compute_robot_state-ego": 0.040524617830912275}}
set_robot_commands_max0.054845639771106194
set_robot_commands_mean0.05440187389666543
set_robot_commands_median0.05447614908218384
set_robot_commands_min0.053811508814493814
sim_compute_performance-ego_max0.038997705777486166
sim_compute_performance-ego_mean0.03875815133980008
sim_compute_performance-ego_median0.0389002226293087
sim_compute_performance-ego_min0.038376874549716125
sim_compute_robot_state-ego_max0.04060171632205739
sim_compute_robot_state-ego_mean0.04040237854640273
sim_compute_robot_state-ego_median0.040386349360148115
sim_compute_robot_state-ego_min0.04013007575390386
sim_compute_sim_state_max0.02280704418818156
sim_compute_sim_state_mean0.02274953506680346
sim_compute_sim_state_median0.022783621214330196
sim_compute_sim_state_min0.022666826248168945
sim_physics_max0.06184904972712199
sim_physics_mean0.056502198402955096
sim_physics_median0.059159339642992206
sim_physics_min0.04594159444173177
sim_render-ego_max0.035831607690378395
sim_render-ego_mean0.0351480326827626
sim_render-ego_median0.035024344687368356
sim_render-ego_min0.03482775669544935
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.040000000000031
survival_time_min3.7499999999999942
206943094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno-0:08:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20694-761615', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20694-761615', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20694-761615', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)