AI Driving Olympics Home Challenges Submissions Jobs

Submission 2907

Submission2907
Competingyes
Challengeaido2-LFVI-sim-testing
UserJulian Zilly
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22789
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
227892907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessyes-0:31:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.466627654289285
survival_time_median6.099999999999986
deviation-center-line_median0.33341663981606123
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1145672897497813
agent_compute-ego_mean0.11280293562696216
agent_compute-ego_median0.11285812714520622
agent_compute-ego_min0.1089727467504041
deviation-center-line_max1.0678270161928525
deviation-center-line_mean0.3924833225550088
deviation-center-line_min0.16662188238079648
deviation-heading_max3.00376928154286
deviation-heading_mean1.182722648012555
deviation-heading_median0.8526023258587172
deviation-heading_min0.3980684508158633
driven_any_max2.553475024767484
driven_any_mean1.0539409492023473
driven_any_median1.0073534337261636
driven_any_min0.3609526397352217
driven_lanedir_consec_max2.3199839675073
driven_lanedir_consec_mean0.7711579392535753
driven_lanedir_consec_min0.3359040954329422
driven_lanedir_max2.320009778733091
driven_lanedir_mean0.7846552677152641
driven_lanedir_median0.6115512044452298
driven_lanedir_min0.3359040954329422
in-drivable-lane_max6.899999999999996
in-drivable-lane_mean1.2566666666666677
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.391700043905229, "sim_physics": 0.07472640635019326, "survival_time": 8.299999999999983, "driven_lanedir": 1.3851647080326188, "sim_render-ego": 0.0320512013263013, "in-drivable-lane": 0, "agent_compute-ego": 0.11344962953084922, "deviation-heading": 0.7900143744696351, "set_robot_commands": 0.05085933208465576, "deviation-center-line": 0.531419937088551, "driven_lanedir_consec": 1.384801018742178, "sim_compute_sim_state": 0.02019425903458193, "sim_compute_performance-ego": 0.03522699281393764, "sim_compute_robot_state-ego": 0.03668254111186568, "sim_compute_robot_state-npc0": 0.037042319056499434, "sim_compute_robot_state-npc1": 0.036260652254862955, "sim_compute_robot_state-npc2": 0.035822931542453994, "sim_compute_robot_state-npc3": 0.03556485492062856}, "udem1-1-0": {"driven_any": 0.4483038438306956, "sim_physics": 0.07672588167519405, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226836157735168, "sim_render-ego": 0.032529978916562834, "in-drivable-lane": 0, "agent_compute-ego": 0.1089727467504041, "deviation-heading": 0.9834096544692096, "set_robot_commands": 0.051750832590563546, "deviation-center-line": 0.2083887780063803, "driven_lanedir_consec": 0.4226836157735168, "sim_compute_sim_state": 0.01996939757774616, "sim_compute_performance-ego": 0.0342238319331202, "sim_compute_robot_state-ego": 0.036735357909367, "sim_compute_robot_state-npc0": 0.036544059884959255, "sim_compute_robot_state-npc1": 0.036746131962743296, "sim_compute_robot_state-npc2": 0.035865578158148406, "sim_compute_robot_state-npc3": 0.035821347401059904}, "udem1-2-0": {"driven_any": 2.1691284131233446, "sim_physics": 0.07492982079001034, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728103279359904, "sim_render-ego": 0.032491230497173236, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.11285812714520622, "deviation-heading": 0.8643309130348766, "set_robot_commands": 0.050339698791503906, "deviation-center-line": 0.6335547372660157, "driven_lanedir_consec": 1.7727850975910913, "sim_compute_sim_state": 0.02034455467672909, "sim_compute_performance-ego": 0.03525847360199573, "sim_compute_robot_state-ego": 0.03692989162370271, "sim_compute_robot_state-npc0": 0.035881539887072995, "sim_compute_robot_state-npc1": 0.03620606684217266, "sim_compute_robot_state-npc2": 0.03559434928146063, "sim_compute_robot_state-npc3": 0.03572536543303845}, "udem1-3-0": {"driven_any": 2.553475024767484, "sim_physics": 0.07631842692693075, "survival_time": 14.950000000000076, "driven_lanedir": 2.320009778733091, "sim_render-ego": 0.032252218723297116, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.1128422753016154, "deviation-heading": 0.8526023258587172, "set_robot_commands": 0.049665621916453045, "deviation-center-line": 1.0678270161928525, "driven_lanedir_consec": 2.3199839675073, "sim_compute_sim_state": 0.02014336347579956, "sim_compute_performance-ego": 0.03529156843821208, "sim_compute_robot_state-ego": 0.037095634937286376, "sim_compute_robot_state-npc0": 0.03570375521977742, "sim_compute_robot_state-npc1": 0.03610529104868571, "sim_compute_robot_state-npc2": 0.035761168797810876, "sim_compute_robot_state-npc3": 0.03622866948445638}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.07703253201075963, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.0313941021354831, "in-drivable-lane": 0, "agent_compute-ego": 0.1122927714367302, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.04979231406231316, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.02075913974217006, "sim_compute_performance-ego": 0.0344166950303681, "sim_compute_robot_state-ego": 0.0367360309678681, "sim_compute_robot_state-npc0": 0.036418204404869856, "sim_compute_robot_state-npc1": 0.03638648500247878, "sim_compute_robot_state-npc2": 0.03645906642991669, "sim_compute_robot_state-npc3": 0.03611574854169573}, "udem1-5-0": {"driven_any": 1.042294034462269, "sim_physics": 0.07612440131959461, "survival_time": 6.299999999999986, "driven_lanedir": 0.3977853477095068, "sim_render-ego": 0.032426256982107014, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.11339807321154882, "deviation-heading": 2.060706771196367, "set_robot_commands": 0.0514897864962381, "deviation-center-line": 0.33341663981606123, "driven_lanedir_consec": 0.3977853477095068, "sim_compute_sim_state": 0.0203024565227448, "sim_compute_performance-ego": 0.03575714239998469, "sim_compute_robot_state-ego": 0.03699760777609689, "sim_compute_robot_state-npc0": 0.03603220553625198, "sim_compute_robot_state-npc1": 0.03633174063667419, "sim_compute_robot_state-npc2": 0.0357469225686694, "sim_compute_robot_state-npc3": 0.03591345983838278}, "udem1-6-0": {"driven_any": 0.8064449781297804, "sim_physics": 0.08537807368268871, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035057918243635, "sim_render-ego": 0.032685725375859426, "in-drivable-lane": 0, "agent_compute-ego": 0.11433415220241354, "deviation-heading": 0.4192648649548546, "set_robot_commands": 0.04979162023525045, "deviation-center-line": 0.4521049008644824, "driven_lanedir_consec": 0.8035057918243635, "sim_compute_sim_state": 0.019968651761912336, "sim_compute_performance-ego": 0.0350173001337533, "sim_compute_robot_state-ego": 0.03725468751155969, "sim_compute_robot_state-npc0": 0.03576721567096132, "sim_compute_robot_state-npc1": 0.03590624982660467, "sim_compute_robot_state-npc2": 0.03526998770357383, "sim_compute_robot_state-npc3": 0.03538241049255988}, "udem1-7-0": {"driven_any": 1.0073534337261636, "sim_physics": 0.08103795716019928, "survival_time": 6.099999999999986, "driven_lanedir": 0.8835123128772164, "sim_render-ego": 0.032775183193019176, "in-drivable-lane": 0, "agent_compute-ego": 0.11410353809106544, "deviation-heading": 2.2471929051607855, "set_robot_commands": 0.050079926115567566, "deviation-center-line": 0.3798478400382373, "driven_lanedir_consec": 0.8699557215089209, "sim_compute_sim_state": 0.02000480010861256, "sim_compute_performance-ego": 0.03539958938223417, "sim_compute_robot_state-ego": 0.03694274386421579, "sim_compute_robot_state-npc0": 0.035558735738035106, "sim_compute_robot_state-npc1": 0.03653781922137151, "sim_compute_robot_state-npc2": 0.035670589228145415, "sim_compute_robot_state-npc3": 0.035717876231084106}, "udem1-8-0": {"driven_any": 1.0248237349996017, "sim_physics": 0.07631153445090016, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115512044452298, "sim_render-ego": 0.03288006974804786, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.11227964778100293, "deviation-heading": 2.0843969428116633, "set_robot_commands": 0.05090678122735793, "deviation-center-line": 0.4228099488267053, "driven_lanedir_consec": 0.6115512044452298, "sim_compute_sim_state": 0.020218643449967908, "sim_compute_performance-ego": 0.0359232694871964, "sim_compute_robot_state-ego": 0.03716015046642673, "sim_compute_robot_state-npc0": 0.03560947410521969, "sim_compute_robot_state-npc1": 0.03608220046566379, "sim_compute_robot_state-npc2": 0.03563206618832004, "sim_compute_robot_state-npc3": 0.03557609550414547}, "udem1-9-0": {"driven_any": 0.44830384366262993, "sim_physics": 0.08678409559973355, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4319199663087821, "sim_render-ego": 0.032657199892504464, "in-drivable-lane": 0, "agent_compute-ego": 0.11270154344624486, "deviation-heading": 0.7843859210886422, "set_robot_commands": 0.04949124517111943, "deviation-center-line": 0.19267161522996132, "driven_lanedir_consec": 0.4319199663087821, "sim_compute_sim_state": 0.020164699390016753, "sim_compute_performance-ego": 0.03502658317829001, "sim_compute_robot_state-ego": 0.03722565338529389, "sim_compute_robot_state-npc0": 0.03597389007436818, "sim_compute_robot_state-npc1": 0.036136195577424146, "sim_compute_robot_state-npc2": 0.035704781269205024, "sim_compute_robot_state-npc3": 0.03587900359055091}, "udem1-10-0": {"driven_any": 0.3609526397352217, "sim_physics": 0.07937508821487427, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3414443288920854, "sim_render-ego": 0.03244545559088389, "in-drivable-lane": 0, "agent_compute-ego": 0.1145672897497813, "deviation-heading": 0.7915362159748539, "set_robot_commands": 0.04971388975779215, "deviation-center-line": 0.16662188238079648, "driven_lanedir_consec": 0.3414443288920854, "sim_compute_sim_state": 0.019728243350982663, "sim_compute_performance-ego": 0.035220980644226074, "sim_compute_robot_state-ego": 0.03813609480857849, "sim_compute_robot_state-npc0": 0.03553371628125509, "sim_compute_robot_state-npc1": 0.03562937180201212, "sim_compute_robot_state-npc2": 0.03530546526114146, "sim_compute_robot_state-npc3": 0.0352599173784256}, "udem1-11-0": {"driven_any": 0.4046281574961264, "sim_physics": 0.07699596656943267, "survival_time": 2.6499999999999986, "driven_lanedir": 0.40003643479537576, "sim_render-ego": 0.03253709145312039, "in-drivable-lane": 0, "agent_compute-ego": 0.11096872473662754, "deviation-heading": 0.3980684508158633, "set_robot_commands": 0.05006668702611383, "deviation-center-line": 0.2708859521467339, "driven_lanedir_consec": 0.40003643479537576, "sim_compute_sim_state": 0.020104664676594285, "sim_compute_performance-ego": 0.03569423027758328, "sim_compute_robot_state-ego": 0.03685567963798091, "sim_compute_robot_state-npc0": 0.036649546533260705, "sim_compute_robot_state-npc1": 0.035206466350915296, "sim_compute_robot_state-npc2": 0.03696849211206976, "sim_compute_robot_state-npc3": 0.035574859043337265}, "udem1-12-0": {"driven_any": 1.5489327489516758, "sim_physics": 0.07977798451548038, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.03216033396513566, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.11212264454883078, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.05000009096187094, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.020557235116543976, "sim_compute_performance-ego": 0.03532131340192712, "sim_compute_robot_state-ego": 0.03672677667244621, "sim_compute_robot_state-npc0": 0.03568084214044654, "sim_compute_robot_state-npc1": 0.03599237099937771, "sim_compute_robot_state-npc2": 0.03542442166286966, "sim_compute_robot_state-npc3": 0.03605055809020996}, "udem1-13-0": {"driven_any": 0.9898831334126, "sim_physics": 0.0766534686088562, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517705220330678, "sim_render-ego": 0.03249402046203613, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.11407612760861714, "deviation-heading": 1.323248045391386, "set_robot_commands": 0.050547532240549725, "deviation-center-line": 0.3285033071320674, "driven_lanedir_consec": 0.6517705220330678, "sim_compute_sim_state": 0.02088234623273214, "sim_compute_performance-ego": 0.03519213596979777, "sim_compute_robot_state-ego": 0.03679651816685994, "sim_compute_robot_state-npc0": 0.036435035864512126, "sim_compute_robot_state-npc1": 0.03674241105715434, "sim_compute_robot_state-npc2": 0.03615872859954834, "sim_compute_robot_state-npc3": 0.03597831726074219}, "udem1-14-0": {"driven_any": 1.2432024907546595, "sim_physics": 0.08267429851045545, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551162589851884, "sim_render-ego": 0.032208700308063686, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.11307674286349507, "deviation-heading": 3.00376928154286, "set_robot_commands": 0.04945273047325595, "deviation-center-line": 0.4491548536824948, "driven_lanedir_consec": 0.466627654289285, "sim_compute_sim_state": 0.020314541439082, "sim_compute_performance-ego": 0.03505162904726579, "sim_compute_robot_state-ego": 0.036812140637596184, "sim_compute_robot_state-npc0": 0.035848046309195906, "sim_compute_robot_state-npc1": 0.03563666983738842, "sim_compute_robot_state-npc2": 0.03561194791089768, "sim_compute_robot_state-npc3": 0.03557354011791664}}
set_robot_commands_max0.051750832590563546
set_robot_commands_mean0.050263205943373704
set_robot_commands_median0.05006668702611383
set_robot_commands_min0.04945273047325595
sim_compute_performance-ego_max0.0359232694871964
sim_compute_performance-ego_mean0.035201449049326164
sim_compute_performance-ego_median0.03522699281393764
sim_compute_performance-ego_min0.0342238319331202
sim_compute_robot_state-ego_max0.03813609480857849
sim_compute_robot_state-ego_mean0.037005833965142974
sim_compute_robot_state-ego_median0.03692989162370271
sim_compute_robot_state-ego_min0.03668254111186568
sim_compute_robot_state-npc0_max0.037042319056499434
sim_compute_robot_state-npc0_mean0.036045239113779035
sim_compute_robot_state-npc0_median0.035881539887072995
sim_compute_robot_state-npc0_min0.03553371628125509
sim_compute_robot_state-npc1_max0.036746131962743296
sim_compute_robot_state-npc1_mean0.03612707485903531
sim_compute_robot_state-npc1_median0.036136195577424146
sim_compute_robot_state-npc1_min0.035206466350915296
sim_compute_robot_state-npc2_max0.03696849211206976
sim_compute_robot_state-npc2_mean0.03579976644761542
sim_compute_robot_state-npc2_median0.035704781269205024
sim_compute_robot_state-npc2_min0.03526998770357383
sim_compute_robot_state-npc3_max0.03622866948445638
sim_compute_robot_state-npc3_mean0.03575746822188226
sim_compute_robot_state-npc3_median0.03572536543303845
sim_compute_robot_state-npc3_min0.0352599173784256
sim_compute_sim_state_max0.02088234623273214
sim_compute_sim_state_mean0.020243799770414416
sim_compute_sim_state_median0.02019425903458193
sim_compute_sim_state_min0.019728243350982663
sim_physics_max0.08678409559973355
sim_physics_mean0.07872306242568688
sim_physics_median0.07699596656943267
sim_physics_min0.07472640635019326
sim_render-ego_max0.03288006974804786
sim_render-ego_mean0.03239925123797302
sim_render-ego_median0.032491230497173236
sim_render-ego_min0.0313941021354831
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.366666666666666
survival_time_min2.3999999999999995
227232907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-erroryes-0:57:46
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1360, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 39, in copy_to_cache
    msg = 'Copying %s to cache %s' % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-ip-172-31-40-253-12257-job22723/tmp/tmpx34sisis/episodes/udem1-5-0/drawing.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227162907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessyes-0:48:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4666277151948612
survival_time_median6.099999999999986
deviation-center-line_median0.33341532886591296
in-drivable-lane_median0


other stats
agent_compute-ego_max0.24081028329915016
agent_compute-ego_mean0.21500585768339991
agent_compute-ego_median0.2153776197329811
agent_compute-ego_min0.18366585671901703
deviation-center-line_max1.0680309819943516
deviation-center-line_mean0.3913121338092333
deviation-center-line_min0.16662188238079648
deviation-heading_max3.0037699632472425
deviation-heading_mean1.182427425260287
deviation-heading_median0.8527152034102187
deviation-heading_min0.3980684508158633
driven_any_max2.5534750247741376
driven_any_mean1.0516115757409483
driven_any_median1.0073534337246877
driven_any_min0.3609526397352217
driven_lanedir_consec_max2.3199836050434404
driven_lanedir_consec_mean0.768818678491447
driven_lanedir_consec_min0.3359040954329422
driven_lanedir_max2.320009231072208
driven_lanedir_mean0.7823190645837699
driven_lanedir_median0.6115511519355601
driven_lanedir_min0.3359040954329422
in-drivable-lane_max6.899999999999996
in-drivable-lane_mean1.2566666666666677
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.3567594419471278, "sim_physics": 0.16086294768769063, "survival_time": 8.09999999999998, "driven_lanedir": 1.350113977643261, "sim_render-ego": 0.056208638497340827, "in-drivable-lane": 0, "agent_compute-ego": 0.20737828737423744, "deviation-heading": 0.7854059946495453, "set_robot_commands": 0.08446863845542625, "deviation-center-line": 0.5135734996132552, "driven_lanedir_consec": 1.349704181184413, "sim_compute_sim_state": 0.03384544378445472, "sim_compute_performance-ego": 0.06262452661255259, "sim_compute_robot_state-ego": 0.06392931496655499, "sim_compute_robot_state-npc0": 0.06024970243006577, "sim_compute_robot_state-npc1": 0.0603605611824695, "sim_compute_robot_state-npc2": 0.059421405380154835, "sim_compute_robot_state-npc3": 0.05943729406521644}, "udem1-1-0": {"driven_any": 0.4483038438343857, "sim_physics": 0.1944651521485427, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226843204952568, "sim_render-ego": 0.06312317272712445, "in-drivable-lane": 0, "agent_compute-ego": 0.24081028329915016, "deviation-heading": 0.9833905711787422, "set_robot_commands": 0.09462197895707757, "deviation-center-line": 0.20838323969703185, "driven_lanedir_consec": 0.4226843204952568, "sim_compute_sim_state": 0.04031549239980763, "sim_compute_performance-ego": 0.07303933028517098, "sim_compute_robot_state-ego": 0.07257994701122415, "sim_compute_robot_state-npc0": 0.07271349019017713, "sim_compute_robot_state-npc1": 0.06892230181858458, "sim_compute_robot_state-npc2": 0.06693886477371742, "sim_compute_robot_state-npc3": 0.06809870127973885}, "udem1-2-0": {"driven_any": 2.169128413136148, "sim_physics": 0.1784298775242824, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728095571844806, "sim_render-ego": 0.058147586560716814, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.21870157952402153, "deviation-heading": 0.8644122890492316, "set_robot_commands": 0.086009666966457, "deviation-center-line": 0.6336040432427312, "driven_lanedir_consec": 1.7727843554142828, "sim_compute_sim_state": 0.03547094475989248, "sim_compute_performance-ego": 0.06281317916570925, "sim_compute_robot_state-ego": 0.06827142752853094, "sim_compute_robot_state-npc0": 0.06443559235217525, "sim_compute_robot_state-npc1": 0.06371428265291101, "sim_compute_robot_state-npc2": 0.06348480523801317, "sim_compute_robot_state-npc3": 0.0618650380302878}, "udem1-3-0": {"driven_any": 2.5534750247741376, "sim_physics": 0.18150043567021687, "survival_time": 14.950000000000076, "driven_lanedir": 2.320009231072208, "sim_render-ego": 0.05951105117797851, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.2267906594276428, "deviation-heading": 0.8527152034102187, "set_robot_commands": 0.09161422491073608, "deviation-center-line": 1.0680309819943516, "driven_lanedir_consec": 2.3199836050434404, "sim_compute_sim_state": 0.03810274600982666, "sim_compute_performance-ego": 0.06795958598454793, "sim_compute_robot_state-ego": 0.07215615272521973, "sim_compute_robot_state-npc0": 0.06867355902989705, "sim_compute_robot_state-npc1": 0.06742413759231568, "sim_compute_robot_state-npc2": 0.06603851159413655, "sim_compute_robot_state-npc3": 0.06712712208429972}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.17604111651985013, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.058815776085367005, "in-drivable-lane": 0, "agent_compute-ego": 0.2147966161066172, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.0863172959308235, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.03720334597996303, "sim_compute_performance-ego": 0.06364175738120566, "sim_compute_robot_state-ego": 0.07049610663433464, "sim_compute_robot_state-npc0": 0.06291585552449129, "sim_compute_robot_state-npc1": 0.06324453743136658, "sim_compute_robot_state-npc2": 0.06394011633736747, "sim_compute_robot_state-npc3": 0.06501986055958028}, "udem1-5-0": {"driven_any": 1.0422940344693128, "sim_physics": 0.1616687850346641, "survival_time": 6.299999999999986, "driven_lanedir": 0.3977931184447061, "sim_render-ego": 0.05222206645541721, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.20187060416690888, "deviation-heading": 2.0606697069733593, "set_robot_commands": 0.08063065816485693, "deviation-center-line": 0.33341532886591296, "driven_lanedir_consec": 0.3977931184447061, "sim_compute_sim_state": 0.03366036642165411, "sim_compute_performance-ego": 0.057754720960344584, "sim_compute_robot_state-ego": 0.060668583900209454, "sim_compute_robot_state-npc0": 0.058301064703199595, "sim_compute_robot_state-npc1": 0.059340352103823706, "sim_compute_robot_state-npc2": 0.05916883642711337, "sim_compute_robot_state-npc3": 0.058577155310010155}, "udem1-6-0": {"driven_any": 0.806444978131922, "sim_physics": 0.1632484474567452, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035043721169954, "sim_render-ego": 0.05046743575972741, "in-drivable-lane": 0, "agent_compute-ego": 0.18410092170792397, "deviation-heading": 0.4193380514366821, "set_robot_commands": 0.0706047241133873, "deviation-center-line": 0.4521438668866459, "driven_lanedir_consec": 0.8035043721169954, "sim_compute_sim_state": 0.031309816572401256, "sim_compute_performance-ego": 0.052710058713200114, "sim_compute_robot_state-ego": 0.05662678949760668, "sim_compute_robot_state-npc0": 0.05571620151250049, "sim_compute_robot_state-npc1": 0.05392583692916716, "sim_compute_robot_state-npc2": 0.053246657053629555, "sim_compute_robot_state-npc3": 0.05397228279499093}, "udem1-7-0": {"driven_any": 1.0073534337246877, "sim_physics": 0.1753149736123007, "survival_time": 6.099999999999986, "driven_lanedir": 0.8835141035321403, "sim_render-ego": 0.053683177369539856, "in-drivable-lane": 0, "agent_compute-ego": 0.2090711359117852, "deviation-heading": 2.247171448785188, "set_robot_commands": 0.08345583032389156, "deviation-center-line": 0.37984219953095794, "driven_lanedir_consec": 0.8699571327515463, "sim_compute_sim_state": 0.036032934657862926, "sim_compute_performance-ego": 0.061541078520602865, "sim_compute_robot_state-ego": 0.06372736711971096, "sim_compute_robot_state-npc0": 0.06175728313258437, "sim_compute_robot_state-npc1": 0.06167042841676806, "sim_compute_robot_state-npc2": 0.06099127941444272, "sim_compute_robot_state-npc3": 0.06194405477555072}, "udem1-8-0": {"driven_any": 1.0248237349996272, "sim_physics": 0.16847854660403344, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115511519355601, "sim_render-ego": 0.05821573734283447, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.22646634617159445, "deviation-heading": 2.0843979982694227, "set_robot_commands": 0.08865055537992908, "deviation-center-line": 0.422810088980332, "driven_lanedir_consec": 0.6115511519355601, "sim_compute_sim_state": 0.03695705436891125, "sim_compute_performance-ego": 0.06465587885149064, "sim_compute_robot_state-ego": 0.07038880548169536, "sim_compute_robot_state-npc0": 0.0662179377771193, "sim_compute_robot_state-npc1": 0.06768460619834162, "sim_compute_robot_state-npc2": 0.066291747554656, "sim_compute_robot_state-npc3": 0.06592234680729528}, "udem1-9-0": {"driven_any": 0.4483038436627429, "sim_physics": 0.21281704820435624, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4319199677822532, "sim_render-ego": 0.059479051622851144, "in-drivable-lane": 0, "agent_compute-ego": 0.2302473947919648, "deviation-heading": 0.7843852312230172, "set_robot_commands": 0.09298109186106716, "deviation-center-line": 0.19267159047164883, "driven_lanedir_consec": 0.4319199677822532, "sim_compute_sim_state": 0.03792332780772242, "sim_compute_performance-ego": 0.06692788107641812, "sim_compute_robot_state-ego": 0.07169935621064284, "sim_compute_robot_state-npc0": 0.0633230209350586, "sim_compute_robot_state-npc1": 0.06601200843679494, "sim_compute_robot_state-npc2": 0.06796681469884412, "sim_compute_robot_state-npc3": 0.06888561824272418}, "udem1-10-0": {"driven_any": 0.3609526397352217, "sim_physics": 0.13652426501115164, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3414443288920854, "sim_render-ego": 0.05012953778107961, "in-drivable-lane": 0, "agent_compute-ego": 0.18366585671901703, "deviation-heading": 0.7915362159748539, "set_robot_commands": 0.07276544471581776, "deviation-center-line": 0.16662188238079648, "driven_lanedir_consec": 0.3414443288920854, "sim_compute_sim_state": 0.02814263602097829, "sim_compute_performance-ego": 0.05132330457369486, "sim_compute_robot_state-ego": 0.05397580067316691, "sim_compute_robot_state-npc0": 0.05324078599611918, "sim_compute_robot_state-npc1": 0.0516338050365448, "sim_compute_robot_state-npc2": 0.05148957669734955, "sim_compute_robot_state-npc3": 0.05064860979715983}, "udem1-11-0": {"driven_any": 0.4046281574961264, "sim_physics": 0.17425620780800874, "survival_time": 2.6499999999999986, "driven_lanedir": 0.40003643479537576, "sim_render-ego": 0.059543209255866286, "in-drivable-lane": 0, "agent_compute-ego": 0.2275342851314905, "deviation-heading": 0.3980684508158633, "set_robot_commands": 0.09360101537884406, "deviation-center-line": 0.2708859521467339, "driven_lanedir_consec": 0.40003643479537576, "sim_compute_sim_state": 0.04588238698131633, "sim_compute_performance-ego": 0.06477773864314242, "sim_compute_robot_state-ego": 0.07112785105435353, "sim_compute_robot_state-npc0": 0.06320575048338692, "sim_compute_robot_state-npc1": 0.06361128249258366, "sim_compute_robot_state-npc2": 0.06380772140790832, "sim_compute_robot_state-npc3": 0.06412427830246259}, "udem1-12-0": {"driven_any": 1.5489327489523863, "sim_physics": 0.18279394636983456, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.05661508700122004, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.2153776197329811, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.08781885582467784, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.03592445539391559, "sim_compute_performance-ego": 0.06084367373715276, "sim_compute_robot_state-ego": 0.06565342778744905, "sim_compute_robot_state-npc0": 0.06527293894601904, "sim_compute_robot_state-npc1": 0.06513830501100291, "sim_compute_robot_state-npc2": 0.06659146236336749, "sim_compute_robot_state-npc3": 0.06259006391400876}, "udem1-13-0": {"driven_any": 0.9898831334165998, "sim_physics": 0.1600898047288259, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517710759380049, "sim_render-ego": 0.05402262409528096, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.21399815479914347, "deviation-heading": 1.32323720047233, "set_robot_commands": 0.08393151760101318, "deviation-center-line": 0.3285019922645743, "driven_lanedir_consec": 0.6517710759380049, "sim_compute_sim_state": 0.03379512031873067, "sim_compute_performance-ego": 0.06050180594126384, "sim_compute_robot_state-ego": 0.06370269854863485, "sim_compute_robot_state-npc0": 0.06445305148760477, "sim_compute_robot_state-npc1": 0.061798487106959024, "sim_compute_robot_state-npc2": 0.0630123237768809, "sim_compute_robot_state-npc3": 0.058296746015548705}, "udem1-14-0": {"driven_any": 1.243202490756078, "sim_physics": 0.19875283369281949, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551159115412959, "sim_render-ego": 0.059761714615277794, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.22427812038652048, "deviation-heading": 3.0037699632472425, "set_robot_commands": 0.08876893344341509, "deviation-center-line": 0.44915491140973257, "driven_lanedir_consec": 0.4666277151948612, "sim_compute_sim_state": 0.0367012071929522, "sim_compute_performance-ego": 0.0669086379492843, "sim_compute_robot_state-ego": 0.07077355192811698, "sim_compute_robot_state-npc0": 0.06753436190969991, "sim_compute_robot_state-npc1": 0.06654394072974289, "sim_compute_robot_state-npc2": 0.06632584853460324, "sim_compute_robot_state-npc3": 0.06508081871391143}}
set_robot_commands_max0.09462197895707757
set_robot_commands_mean0.08574936213516135
set_robot_commands_median0.0863172959308235
set_robot_commands_min0.0706047241133873
sim_compute_performance-ego_max0.07303933028517098
sim_compute_performance-ego_mean0.06253487722638539
sim_compute_performance-ego_median0.06281317916570925
sim_compute_performance-ego_min0.05132330457369486
sim_compute_robot_state-ego_max0.07257994701122415
sim_compute_robot_state-ego_mean0.06638514540449673
sim_compute_robot_state-ego_median0.06827142752853094
sim_compute_robot_state-ego_min0.05397580067316691
sim_compute_robot_state-npc0_max0.07271349019017713
sim_compute_robot_state-npc0_mean0.06320070642733991
sim_compute_robot_state-npc0_median0.0633230209350586
sim_compute_robot_state-npc0_min0.05324078599611918
sim_compute_robot_state-npc1_max0.06892230181858458
sim_compute_robot_state-npc1_mean0.06273499154262509
sim_compute_robot_state-npc1_median0.06361128249258366
sim_compute_robot_state-npc1_min0.0516338050365448
sim_compute_robot_state-npc2_max0.06796681469884412
sim_compute_robot_state-npc2_mean0.06258106475014566
sim_compute_robot_state-npc2_median0.06380772140790832
sim_compute_robot_state-npc2_min0.05148957669734955
sim_compute_robot_state-npc3_max0.06888561824272418
sim_compute_robot_state-npc3_mean0.06210599937951904
sim_compute_robot_state-npc3_median0.06259006391400876
sim_compute_robot_state-npc3_min0.05064860979715983
sim_compute_sim_state_max0.04588238698131633
sim_compute_sim_state_mean0.03608448524469265
sim_compute_sim_state_median0.036032934657862926
sim_compute_sim_state_min0.02814263602097829
sim_physics_max0.21281704820435624
sim_physics_mean0.1750162925382215
sim_physics_median0.1753149736123007
sim_physics_min0.13652426501115164
sim_render-ego_max0.06312317272712445
sim_render-ego_mean0.05666305775650816
sim_render-ego_median0.058147586560716814
sim_render-ego_min0.05012953778107961
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.353333333333333
survival_time_min2.3999999999999995
217722907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:44:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4666269502423068
survival_time_median6.099999999999986
deviation-center-line_median0.33341590063390014
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2332026720046997
agent_compute-ego_mean0.22548801939288515
agent_compute-ego_median0.22603827509386787
agent_compute-ego_min0.21506397762606225
deviation-center-line_max1.0679130278046758
deviation-center-line_mean0.3923610326373621
deviation-center-line_min0.16662190840161906
deviation-heading_max3.003768058214024
deviation-heading_mean1.182529432628333
deviation-heading_median0.8525854399247893
deviation-heading_min0.3980684508158633
driven_any_max2.5534750247737485
driven_any_mean1.0539409492176937
driven_any_median1.0073534337308443
driven_any_min0.36095263973492153
driven_lanedir_consec_max2.319984468853249
driven_lanedir_consec_mean0.7711628587484045
driven_lanedir_consec_min0.3359040954329422
driven_lanedir_max2.3200100948820164
driven_lanedir_mean0.7846602193899738
driven_lanedir_median0.6115526452439853
driven_lanedir_min0.3359040954329422
in-drivable-lane_max6.899999999999996
in-drivable-lane_mean1.2566666666666677
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.391700044085196, "sim_physics": 0.1147857775171119, "survival_time": 8.299999999999983, "driven_lanedir": 1.3852200396538432, "sim_render-ego": 0.06977572785802634, "in-drivable-lane": 0, "agent_compute-ego": 0.22041325109550752, "deviation-heading": 0.7871984365278527, "set_robot_commands": 0.07960175606141608, "deviation-center-line": 0.5295497692124723, "driven_lanedir_consec": 1.3848598327858417, "sim_compute_sim_state": 0.04383776704949069, "sim_compute_performance-ego": 0.07109864935817489, "sim_compute_robot_state-ego": 0.06332206869699869, "sim_compute_robot_state-npc0": 0.07825300205184753, "sim_compute_robot_state-npc1": 0.07570443239556737, "sim_compute_robot_state-npc2": 0.07541631790528815, "sim_compute_robot_state-npc3": 0.07536013155098421}, "udem1-1-0": {"driven_any": 0.4483038438327672, "sim_physics": 0.11749627261326231, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226835633267805, "sim_render-ego": 0.07235707085708092, "in-drivable-lane": 0, "agent_compute-ego": 0.22779569954707704, "deviation-heading": 0.9834040620486516, "set_robot_commands": 0.08088085980250917, "deviation-center-line": 0.20838806019963907, "driven_lanedir_consec": 0.4226835633267805, "sim_compute_sim_state": 0.04384183061533961, "sim_compute_performance-ego": 0.06956415340818208, "sim_compute_robot_state-ego": 0.06522277716932626, "sim_compute_robot_state-npc0": 0.081058905042451, "sim_compute_robot_state-npc1": 0.07895347578772183, "sim_compute_robot_state-npc2": 0.0793771743774414, "sim_compute_robot_state-npc3": 0.07843646509894009}, "udem1-2-0": {"driven_any": 2.1691284131378556, "sim_physics": 0.1149759900336172, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728091353929467, "sim_render-ego": 0.07248095437592152, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.22378219810186648, "deviation-heading": 0.8643955126282414, "set_robot_commands": 0.0817386786142985, "deviation-center-line": 0.6335156899837494, "driven_lanedir_consec": 1.7727837451824469, "sim_compute_sim_state": 0.04406288651859059, "sim_compute_performance-ego": 0.07179901459637811, "sim_compute_robot_state-ego": 0.0633270123425652, "sim_compute_robot_state-npc0": 0.08040808789870318, "sim_compute_robot_state-npc1": 0.07859315217710008, "sim_compute_robot_state-npc2": 0.07757917198480345, "sim_compute_robot_state-npc3": 0.07774945707882151}, "udem1-3-0": {"driven_any": 2.5534750247737485, "sim_physics": 0.11562159856160482, "survival_time": 14.950000000000076, "driven_lanedir": 2.3200100948820164, "sim_render-ego": 0.07243511041005453, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.2252928590774536, "deviation-heading": 0.8525854399247893, "set_robot_commands": 0.08060557285944621, "deviation-center-line": 1.0679130278046758, "driven_lanedir_consec": 2.319984468853249, "sim_compute_sim_state": 0.04312152067820231, "sim_compute_performance-ego": 0.07162284135818481, "sim_compute_robot_state-ego": 0.06422837495803833, "sim_compute_robot_state-npc0": 0.08012700875600179, "sim_compute_robot_state-npc1": 0.07727335214614868, "sim_compute_robot_state-npc2": 0.07620002428690592, "sim_compute_robot_state-npc3": 0.07678587516148885}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.11889326815702478, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.07432402883257185, "in-drivable-lane": 0, "agent_compute-ego": 0.2224806863434461, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.08170583296795281, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.046260760754955055, "sim_compute_performance-ego": 0.07253265380859375, "sim_compute_robot_state-ego": 0.06464050740611796, "sim_compute_robot_state-npc0": 0.08194449483131876, "sim_compute_robot_state-npc1": 0.07916092872619629, "sim_compute_robot_state-npc2": 0.07852484255420919, "sim_compute_robot_state-npc3": 0.07864547748954928}, "udem1-5-0": {"driven_any": 1.042294034490687, "sim_physics": 0.11944627383398632, "survival_time": 6.299999999999986, "driven_lanedir": 0.39779706482551247, "sim_render-ego": 0.07264669925447494, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.2233674204538739, "deviation-heading": 2.0606429705217173, "set_robot_commands": 0.08008402869814918, "deviation-center-line": 0.33341590063390014, "driven_lanedir_consec": 0.39779706482551247, "sim_compute_sim_state": 0.04514757413712759, "sim_compute_performance-ego": 0.07083878819904631, "sim_compute_robot_state-ego": 0.06478762815869044, "sim_compute_robot_state-npc0": 0.08114280208708748, "sim_compute_robot_state-npc1": 0.07898024717966716, "sim_compute_robot_state-npc2": 0.07796703255365765, "sim_compute_robot_state-npc3": 0.07837494782039098}, "udem1-6-0": {"driven_any": 0.8064449781316255, "sim_physics": 0.1359429768841676, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035055748262347, "sim_render-ego": 0.07081226869062944, "in-drivable-lane": 0, "agent_compute-ego": 0.2273523590781472, "deviation-heading": 0.4192351949688124, "set_robot_commands": 0.08193845700735998, "deviation-center-line": 0.4520906533312668, "driven_lanedir_consec": 0.8035055748262347, "sim_compute_sim_state": 0.042752969144570704, "sim_compute_performance-ego": 0.0708412305273191, "sim_compute_robot_state-ego": 0.06637554939347085, "sim_compute_robot_state-npc0": 0.07917320848715426, "sim_compute_robot_state-npc1": 0.0768284701337718, "sim_compute_robot_state-npc2": 0.075664358909684, "sim_compute_robot_state-npc3": 0.07471602854102549}, "udem1-7-0": {"driven_any": 1.0073534337308443, "sim_physics": 0.1239598246871448, "survival_time": 6.099999999999986, "driven_lanedir": 0.883517191297529, "sim_render-ego": 0.0673723533505299, "in-drivable-lane": 0, "agent_compute-ego": 0.21556347120003624, "deviation-heading": 2.2471680168864356, "set_robot_commands": 0.07904776197965027, "deviation-center-line": 0.3798506882650407, "driven_lanedir_consec": 0.8699574532463521, "sim_compute_sim_state": 0.04007099495559442, "sim_compute_performance-ego": 0.06818938059884994, "sim_compute_robot_state-ego": 0.06413931533938548, "sim_compute_robot_state-npc0": 0.07637807189441118, "sim_compute_robot_state-npc1": 0.07341305545118988, "sim_compute_robot_state-npc2": 0.07285133737032531, "sim_compute_robot_state-npc3": 0.07134263437302386}, "udem1-8-0": {"driven_any": 1.0248237350000784, "sim_physics": 0.11313364005857898, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115526452439853, "sim_render-ego": 0.07033678600865026, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.21506397762606225, "deviation-heading": 2.084397775025452, "set_robot_commands": 0.0810943438160804, "deviation-center-line": 0.42280990484235936, "driven_lanedir_consec": 0.6115526452439853, "sim_compute_sim_state": 0.041668380460431496, "sim_compute_performance-ego": 0.07106065365575975, "sim_compute_robot_state-ego": 0.06493493818467663, "sim_compute_robot_state-npc0": 0.0788811868236911, "sim_compute_robot_state-npc1": 0.07400191214776808, "sim_compute_robot_state-npc2": 0.07241039314577656, "sim_compute_robot_state-npc3": 0.07354275641902801}, "udem1-9-0": {"driven_any": 0.4483038436562341, "sim_physics": 0.13386409447110934, "survival_time": 2.8999999999999977, "driven_lanedir": 0.431917613323179, "sim_render-ego": 0.07273703196953082, "in-drivable-lane": 0, "agent_compute-ego": 0.22603827509386787, "deviation-heading": 0.7844271196846065, "set_robot_commands": 0.07924839957007046, "deviation-center-line": 0.19268007232489137, "driven_lanedir_consec": 0.431917613323179, "sim_compute_sim_state": 0.04407386944211762, "sim_compute_performance-ego": 0.07045079510787437, "sim_compute_robot_state-ego": 0.06381302044309418, "sim_compute_robot_state-npc0": 0.07997310983723607, "sim_compute_robot_state-npc1": 0.07847610424304831, "sim_compute_robot_state-npc2": 0.07766496724095838, "sim_compute_robot_state-npc3": 0.07730540735968228}, "udem1-10-0": {"driven_any": 0.36095263973492153, "sim_physics": 0.12498583396275838, "survival_time": 2.3999999999999995, "driven_lanedir": 0.34144445563129455, "sim_render-ego": 0.07564129928747813, "in-drivable-lane": 0, "agent_compute-ego": 0.23301068941752115, "deviation-heading": 0.7915363221691162, "set_robot_commands": 0.08061845103899638, "deviation-center-line": 0.16662190840161906, "driven_lanedir_consec": 0.34144445563129455, "sim_compute_sim_state": 0.04509009917577108, "sim_compute_performance-ego": 0.07320012152194977, "sim_compute_robot_state-ego": 0.06863981485366821, "sim_compute_robot_state-npc0": 0.08172302941481273, "sim_compute_robot_state-npc1": 0.07981107135613759, "sim_compute_robot_state-npc2": 0.07885985573132832, "sim_compute_robot_state-npc3": 0.07945683101812999}, "udem1-11-0": {"driven_any": 0.4046281574961264, "sim_physics": 0.12765163295673873, "survival_time": 2.6499999999999986, "driven_lanedir": 0.40003643479537576, "sim_render-ego": 0.07288175708842727, "in-drivable-lane": 0, "agent_compute-ego": 0.23055187261329507, "deviation-heading": 0.3980684508158633, "set_robot_commands": 0.08087503685141509, "deviation-center-line": 0.2708859521467339, "driven_lanedir_consec": 0.40003643479537576, "sim_compute_sim_state": 0.044425235604340176, "sim_compute_performance-ego": 0.07382478354112157, "sim_compute_robot_state-ego": 0.0669019897029085, "sim_compute_robot_state-npc0": 0.08159271276222085, "sim_compute_robot_state-npc1": 0.07610906744902989, "sim_compute_robot_state-npc2": 0.07586006398470897, "sim_compute_robot_state-npc3": 0.0762444352203945}, "udem1-12-0": {"driven_any": 1.5489327489520783, "sim_physics": 0.1271062169385993, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.07407949022624803, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.23050794005393985, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.08266960537951926, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.04619036161381265, "sim_compute_performance-ego": 0.07379338533981987, "sim_compute_robot_state-ego": 0.06492105515106865, "sim_compute_robot_state-npc0": 0.08224126437435979, "sim_compute_robot_state-npc1": 0.07926603244698566, "sim_compute_robot_state-npc2": 0.07937411769576695, "sim_compute_robot_state-npc3": 0.08042222131853519}, "udem1-13-0": {"driven_any": 0.9898831334126992, "sim_physics": 0.1158503274122874, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517746615605837, "sim_render-ego": 0.07104014158248902, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.2332026720046997, "deviation-heading": 1.3232010765908244, "set_robot_commands": 0.08042551477750143, "deviation-center-line": 0.3284969116075729, "driven_lanedir_consec": 0.6517746615605837, "sim_compute_sim_state": 0.04429958860079448, "sim_compute_performance-ego": 0.07061562736829122, "sim_compute_robot_state-ego": 0.06410362521807353, "sim_compute_robot_state-npc0": 0.07958753903706868, "sim_compute_robot_state-npc1": 0.07869648536046346, "sim_compute_robot_state-npc2": 0.07659818728764851, "sim_compute_robot_state-npc3": 0.07778331240018209}, "udem1-14-0": {"driven_any": 1.243202490752819, "sim_physics": 0.13306546371255146, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551163987073993, "sim_render-ego": 0.0732827298593201, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.2278969191864833, "deviation-heading": 3.003768058214024, "set_robot_commands": 0.08048347178721588, "deviation-center-line": 0.449154521152717, "driven_lanedir_consec": 0.4666269502423068, "sim_compute_sim_state": 0.04512102491903625, "sim_compute_performance-ego": 0.07098010082372883, "sim_compute_robot_state-ego": 0.0643128708705006, "sim_compute_robot_state-npc0": 0.08011892177914613, "sim_compute_robot_state-npc1": 0.07874697646838706, "sim_compute_robot_state-npc2": 0.07750773269858137, "sim_compute_robot_state-npc3": 0.078113421497729}}
set_robot_commands_max0.08266960537951926
set_robot_commands_mean0.08073451808077207
set_robot_commands_median0.08061845103899638
set_robot_commands_min0.07904776197965027
sim_compute_performance-ego_max0.07382478354112157
sim_compute_performance-ego_mean0.0713608119475516
sim_compute_performance-ego_median0.07106065365575975
sim_compute_performance-ego_min0.06818938059884994
sim_compute_robot_state-ego_max0.06863981485366821
sim_compute_robot_state-ego_mean0.06491136985923891
sim_compute_robot_state-ego_median0.06464050740611796
sim_compute_robot_state-ego_min0.06332206869699869
sim_compute_robot_state-npc0_max0.08224126437435979
sim_compute_robot_state-npc0_mean0.08017355633850068
sim_compute_robot_state-npc0_median0.08012700875600179
sim_compute_robot_state-npc0_min0.07637807189441118
sim_compute_robot_state-npc1_max0.07981107135613759
sim_compute_robot_state-npc1_mean0.07760098423127887
sim_compute_robot_state-npc1_median0.07859315217710008
sim_compute_robot_state-npc1_min0.07341305545118988
sim_compute_robot_state-npc2_max0.0793771743774414
sim_compute_robot_state-npc2_mean0.07679037184847229
sim_compute_robot_state-npc2_median0.07750773269858137
sim_compute_robot_state-npc2_min0.07241039314577656
sim_compute_robot_state-npc3_max0.08042222131853519
sim_compute_robot_state-npc3_mean0.076951960156527
sim_compute_robot_state-npc3_median0.07774945707882151
sim_compute_robot_state-npc3_min0.07134263437302386
sim_compute_sim_state_max0.046260760754955055
sim_compute_sim_state_mean0.04399765757801165
sim_compute_sim_state_median0.04407386944211762
sim_compute_sim_state_min0.04007099495559442
sim_physics_max0.1359429768841676
sim_physics_mean0.1224519461200362
sim_physics_median0.11944627383398632
sim_physics_min0.11313364005857898
sim_render-ego_max0.07564129928747813
sim_render-ego_mean0.07214689664342887
sim_render-ego_median0.07248095437592152
sim_render-ego_min0.0673723533505299
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.366666666666666
survival_time_min2.3999999999999995
217502907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1201, in upload
    aws_object.load()
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 491, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1032, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1211, in upload
    aws_object.upload_file(realfile, ExtraArgs={'ContentType': mime_type})
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 280, in object_upload_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 131, in upload_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 279, in upload_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 722, in _main
    Body=body, **extra_args)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 642, in _make_api_call
    request_signer=self._request_signer, context=request_context)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 360, in emit_until_response
    return self._emitter.emit_until_response(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 243, in emit_until_response
    responses = self._emit(event_name, kwargs, stop_on_response=True)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/handlers.py", line 212, in conditionally_calculate_md5
    calculate_md5(params, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/handlers.py", line 190, in calculate_md5
    binary_md5 = _calculate_md5_from_file(body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/handlers.py", line 203, in _calculate_md5_from_file
    for chunk in iter(lambda: fileobj.read(1024 * 1024), b''):
  File "/usr/local/lib/python3.6/dist-packages/botocore/handlers.py", line 203, in <lambda>
    for chunk in iter(lambda: fileobj.read(1024 * 1024), b''):
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 86, in read
    return self._fileobj.read(amount)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 327, in read
    self._open_if_needed()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 318, in _open_if_needed
    self._fileobj = self._open_function(self._filename, self._mode)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 244, in open
    return open(filename, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-ip-172-31-40-253-32125-job21750/tmp/tmpvrlykxmg/episodes/udem1-8-0/drawing.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217372907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:30:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-ip-172-31-25-98-2062-job21737/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216772907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:09
I can see how the jo [...]
I can see how the job 21677 is timeout because passed 3909 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216632907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:27:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 484, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-ip-172-31-40-253-32059-job21663/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209622907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:58:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4666269195057299
survival_time_median6.099999999999986
deviation-center-line_median0.33342045979934726
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2664610950314269
agent_compute-ego_mean0.2476612981830721
agent_compute-ego_median0.24815997014562768
agent_compute-ego_min0.23170781295571552
deviation-center-line_max1.0679252017096004
deviation-center-line_mean0.3924914804475109
deviation-center-line_min0.16662188238079648
deviation-heading_max3.003760940366442
deviation-heading_mean1.1827375892216667
deviation-heading_median0.8526165284633079
deviation-heading_min0.3980745231922676
driven_any_max2.5534750247780256
driven_any_mean1.0539409492055236
driven_any_median1.0073534337255925
driven_any_min0.3609526397352217
driven_lanedir_consec_max2.319986201404549
driven_lanedir_consec_mean0.7711578039542435
driven_lanedir_consec_min0.3359040954329422
driven_lanedir_max2.320011827433317
driven_lanedir_mean0.7846553049466682
driven_lanedir_median0.6115510331777083
driven_lanedir_min0.3359040954329422
in-drivable-lane_max6.899999999999996
in-drivable-lane_mean1.2566666666666677
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.3917000438981204, "sim_physics": 0.20319811981844615, "survival_time": 8.299999999999983, "driven_lanedir": 1.385164263676098, "sim_render-ego": 0.0649482141058129, "in-drivable-lane": 0, "agent_compute-ego": 0.24815997014562768, "deviation-heading": 0.7900800801587916, "set_robot_commands": 0.10079308877508324, "deviation-center-line": 0.5314409393909165, "driven_lanedir_consec": 1.3847999119740728, "sim_compute_sim_state": 0.04068264042038515, "sim_compute_performance-ego": 0.07108707025826695, "sim_compute_robot_state-ego": 0.08195674850280027, "sim_compute_robot_state-npc0": 0.07276905444731195, "sim_compute_robot_state-npc1": 0.07276600527476115, "sim_compute_robot_state-npc2": 0.07284060300114643, "sim_compute_robot_state-npc3": 0.07119336042059474}, "udem1-1-0": {"driven_any": 0.4483038438315837, "sim_physics": 0.2262823581695557, "survival_time": 2.8999999999999977, "driven_lanedir": 0.42268219757764713, "sim_render-ego": 0.06666525890087259, "in-drivable-lane": 0, "agent_compute-ego": 0.26337349003758925, "deviation-heading": 0.9834275270262504, "set_robot_commands": 0.10552911922849458, "deviation-center-line": 0.20839337138315597, "driven_lanedir_consec": 0.42268219757764713, "sim_compute_sim_state": 0.04328347896707469, "sim_compute_performance-ego": 0.0735543390800213, "sim_compute_robot_state-ego": 0.08681420211134286, "sim_compute_robot_state-npc0": 0.07641861356537917, "sim_compute_robot_state-npc1": 0.07194787469403498, "sim_compute_robot_state-npc2": 0.07428174183286469, "sim_compute_robot_state-npc3": 0.07615955944718986}, "udem1-2-0": {"driven_any": 2.1691284131378556, "sim_physics": 0.20375274302912696, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728091353929467, "sim_render-ego": 0.06660434965993844, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.24912126391541725, "deviation-heading": 0.8643955126282414, "set_robot_commands": 0.09888327074985878, "deviation-center-line": 0.6335156899837494, "driven_lanedir_consec": 1.7727837451824469, "sim_compute_sim_state": 0.0416808895036286, "sim_compute_performance-ego": 0.07379641065410539, "sim_compute_robot_state-ego": 0.07987124405655206, "sim_compute_robot_state-npc0": 0.0727443629620122, "sim_compute_robot_state-npc1": 0.07327769971361348, "sim_compute_robot_state-npc2": 0.07358566732967602, "sim_compute_robot_state-npc3": 0.07321768180996764}, "udem1-3-0": {"driven_any": 2.5534750247780256, "sim_physics": 0.211795224348704, "survival_time": 14.950000000000076, "driven_lanedir": 2.320011827433317, "sim_render-ego": 0.0657030741373698, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.255876784324646, "deviation-heading": 0.8526165284633079, "set_robot_commands": 0.10092665036519367, "deviation-center-line": 1.0679252017096004, "driven_lanedir_consec": 2.319986201404549, "sim_compute_sim_state": 0.041560147603352866, "sim_compute_performance-ego": 0.07169158856074015, "sim_compute_robot_state-ego": 0.07893640915552776, "sim_compute_robot_state-npc0": 0.07227652072906494, "sim_compute_robot_state-npc1": 0.07427234172821046, "sim_compute_robot_state-npc2": 0.07416579246520996, "sim_compute_robot_state-npc3": 0.07408375342686971}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.21861985751560756, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.06851492609296526, "in-drivable-lane": 0, "agent_compute-ego": 0.2664610950314269, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.10369286731797822, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.04198435861237195, "sim_compute_performance-ego": 0.07391172039265535, "sim_compute_robot_state-ego": 0.0804389155640894, "sim_compute_robot_state-npc0": 0.0731201950384646, "sim_compute_robot_state-npc1": 0.07232730242670798, "sim_compute_robot_state-npc2": 0.07326476914542061, "sim_compute_robot_state-npc3": 0.07350131443568639}, "udem1-5-0": {"driven_any": 1.042294034481285, "sim_physics": 0.2122189544496082, "survival_time": 6.299999999999986, "driven_lanedir": 0.397789206115704, "sim_render-ego": 0.06676763390737867, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.2512595937365577, "deviation-heading": 2.0607034254461456, "set_robot_commands": 0.09970244717976404, "deviation-center-line": 0.33342045979934726, "driven_lanedir_consec": 0.397789206115704, "sim_compute_sim_state": 0.046148669152032765, "sim_compute_performance-ego": 0.07228826151953803, "sim_compute_robot_state-ego": 0.07735534130580841, "sim_compute_robot_state-npc0": 0.07403504848480225, "sim_compute_robot_state-npc1": 0.07155121129656596, "sim_compute_robot_state-npc2": 0.07242349215916224, "sim_compute_robot_state-npc3": 0.07452310077727788}, "udem1-6-0": {"driven_any": 0.8064449781322619, "sim_physics": 0.23848541336830217, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035054895550815, "sim_render-ego": 0.06833069733899048, "in-drivable-lane": 0, "agent_compute-ego": 0.24244421178644351, "deviation-heading": 0.4193176749368592, "set_robot_commands": 0.0984559396300653, "deviation-center-line": 0.452136787656477, "driven_lanedir_consec": 0.8035054895550815, "sim_compute_sim_state": 0.04126566829103412, "sim_compute_performance-ego": 0.0736178725656837, "sim_compute_robot_state-ego": 0.08153633637861772, "sim_compute_robot_state-npc0": 0.07091114737770775, "sim_compute_robot_state-npc1": 0.07305030148438733, "sim_compute_robot_state-npc2": 0.07324241387723672, "sim_compute_robot_state-npc3": 0.07381963248204704}, "udem1-7-0": {"driven_any": 1.0073534337255925, "sim_physics": 0.2220058069854486, "survival_time": 6.099999999999986, "driven_lanedir": 0.8835113000614128, "sim_render-ego": 0.06432184039569291, "in-drivable-lane": 0, "agent_compute-ego": 0.24268319176845865, "deviation-heading": 2.2471885996035605, "set_robot_commands": 0.09873952826515572, "deviation-center-line": 0.3798457091493637, "driven_lanedir_consec": 0.8699546836324721, "sim_compute_sim_state": 0.04020705183998483, "sim_compute_performance-ego": 0.07049650051554696, "sim_compute_robot_state-ego": 0.07790095298016658, "sim_compute_robot_state-npc0": 0.0712605284862831, "sim_compute_robot_state-npc1": 0.07332914774535132, "sim_compute_robot_state-npc2": 0.07277577236050466, "sim_compute_robot_state-npc3": 0.07229507946577228}, "udem1-8-0": {"driven_any": 1.0248237349998126, "sim_physics": 0.2108490813163019, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115510331777083, "sim_render-ego": 0.0635644139782075, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.2504970200600163, "deviation-heading": 2.0843956771066994, "set_robot_commands": 0.0970152251182064, "deviation-center-line": 0.4228098836080403, "driven_lanedir_consec": 0.6115510331777083, "sim_compute_sim_state": 0.04190304971510364, "sim_compute_performance-ego": 0.07359238401536018, "sim_compute_robot_state-ego": 0.07860740154020247, "sim_compute_robot_state-npc0": 0.07188071743134529, "sim_compute_robot_state-npc1": 0.07221336518564532, "sim_compute_robot_state-npc2": 0.07403638093702254, "sim_compute_robot_state-npc3": 0.07327828099650721}, "udem1-9-0": {"driven_any": 0.44830384366262993, "sim_physics": 0.22951715568016315, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4319199663087821, "sim_render-ego": 0.06359829573795714, "in-drivable-lane": 0, "agent_compute-ego": 0.23641832943620353, "deviation-heading": 0.7843859210886422, "set_robot_commands": 0.10100656542284736, "deviation-center-line": 0.19267161522996132, "driven_lanedir_consec": 0.4319199663087821, "sim_compute_sim_state": 0.04214499736654347, "sim_compute_performance-ego": 0.06651525250796614, "sim_compute_robot_state-ego": 0.07412050099208436, "sim_compute_robot_state-npc0": 0.068514634822977, "sim_compute_robot_state-npc1": 0.07178177504703917, "sim_compute_robot_state-npc2": 0.07192412738142342, "sim_compute_robot_state-npc3": 0.07036251446296429}, "udem1-10-0": {"driven_any": 0.3609526397352217, "sim_physics": 0.21680237352848053, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3414443288920854, "sim_render-ego": 0.06613697111606598, "in-drivable-lane": 0, "agent_compute-ego": 0.23588005701700843, "deviation-heading": 0.7915362159748539, "set_robot_commands": 0.09978727499643962, "deviation-center-line": 0.16662188238079648, "driven_lanedir_consec": 0.3414443288920854, "sim_compute_sim_state": 0.04128952821095785, "sim_compute_performance-ego": 0.06889443099498749, "sim_compute_robot_state-ego": 0.07565723856290181, "sim_compute_robot_state-npc0": 0.07212011019388835, "sim_compute_robot_state-npc1": 0.07020476460456848, "sim_compute_robot_state-npc2": 0.06799956162770589, "sim_compute_robot_state-npc3": 0.07193236549695332}, "udem1-11-0": {"driven_any": 0.4046281574967708, "sim_physics": 0.2219523843729271, "survival_time": 2.6499999999999986, "driven_lanedir": 0.4000362944855031, "sim_render-ego": 0.06349181229213499, "in-drivable-lane": 0, "agent_compute-ego": 0.24611249959693765, "deviation-heading": 0.3980745231922676, "set_robot_commands": 0.09613722675251513, "deviation-center-line": 0.27088748121436834, "driven_lanedir_consec": 0.4000362944855031, "sim_compute_sim_state": 0.03942187327258992, "sim_compute_performance-ego": 0.07309705356381974, "sim_compute_robot_state-ego": 0.07988157362308142, "sim_compute_robot_state-npc0": 0.07052051346257047, "sim_compute_robot_state-npc1": 0.07032692657326753, "sim_compute_robot_state-npc2": 0.0698834905084574, "sim_compute_robot_state-npc3": 0.0707642267335136}, "udem1-12-0": {"driven_any": 1.5489327489550275, "sim_physics": 0.21554925389911817, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.06420541198357292, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.2395973335141721, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.09682963594146396, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.03998715074166008, "sim_compute_performance-ego": 0.07047670431759047, "sim_compute_robot_state-ego": 0.07516669320023578, "sim_compute_robot_state-npc0": 0.07087914192158243, "sim_compute_robot_state-npc1": 0.07238663797793181, "sim_compute_robot_state-npc2": 0.07266815201095912, "sim_compute_robot_state-npc3": 0.07028865943784299}, "udem1-13-0": {"driven_any": 0.989883133415772, "sim_physics": 0.21148428320884705, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517686641189435, "sim_render-ego": 0.06544825633366903, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.25532681941986085, "deviation-heading": 1.3232681589143314, "set_robot_commands": 0.10036274592081704, "deviation-center-line": 0.3285066985483987, "driven_lanedir_consec": 0.6517686641189435, "sim_compute_sim_state": 0.04126901825269063, "sim_compute_performance-ego": 0.07473060091336568, "sim_compute_robot_state-ego": 0.07908727129300436, "sim_compute_robot_state-npc0": 0.07370544870694479, "sim_compute_robot_state-npc1": 0.07317793766657511, "sim_compute_robot_state-npc2": 0.07114562193552652, "sim_compute_robot_state-npc3": 0.07152669628461202}, "udem1-14-0": {"driven_any": 1.243202490755171, "sim_physics": 0.21376929027122135, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551174500218688, "sim_render-ego": 0.06389356619559679, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.23170781295571552, "deviation-heading": 3.003760940366442, "set_robot_commands": 0.09440724481672248, "deviation-center-line": 0.4491540570046963, "driven_lanedir_consec": 0.4666269195057299, "sim_compute_sim_state": 0.03976655646458568, "sim_compute_performance-ego": 0.07022167692248453, "sim_compute_robot_state-ego": 0.0751761942101805, "sim_compute_robot_state-npc0": 0.06841154546545655, "sim_compute_robot_state-npc1": 0.07164380374370806, "sim_compute_robot_state-npc2": 0.07043905546201155, "sim_compute_robot_state-npc3": 0.07106217441942868}}
set_robot_commands_max0.10552911922849458
set_robot_commands_mean0.09948458869870704
set_robot_commands_median0.09970244717976404
set_robot_commands_min0.09440724481672248
sim_compute_performance-ego_max0.07473060091336568
sim_compute_performance-ego_mean0.07186479111880881
sim_compute_performance-ego_median0.07228826151953803
sim_compute_performance-ego_min0.06651525250796614
sim_compute_robot_state-ego_max0.08681420211134286
sim_compute_robot_state-ego_mean0.0788338015651064
sim_compute_robot_state-ego_median0.07893640915552776
sim_compute_robot_state-ego_min0.07412050099208436
sim_compute_robot_state-npc0_max0.07641861356537917
sim_compute_robot_state-npc0_mean0.07197117220638606
sim_compute_robot_state-npc0_median0.07212011019388835
sim_compute_robot_state-npc0_min0.06841154546545655
sim_compute_robot_state-npc1_max0.07427234172821046
sim_compute_robot_state-npc1_mean0.07228380634415789
sim_compute_robot_state-npc1_median0.07232730242670798
sim_compute_robot_state-npc1_min0.07020476460456848
sim_compute_robot_state-npc2_max0.07428174183286469
sim_compute_robot_state-npc2_mean0.07231177613562186
sim_compute_robot_state-npc2_median0.07277577236050466
sim_compute_robot_state-npc2_min0.06799956162770589
sim_compute_robot_state-npc3_max0.07615955944718986
sim_compute_robot_state-npc3_mean0.07253389333981518
sim_compute_robot_state-npc3_median0.07229507946577228
sim_compute_robot_state-npc3_min0.07028865943784299
sim_compute_sim_state_max0.046148669152032765
sim_compute_sim_state_mean0.04150633856093308
sim_compute_sim_state_median0.04128952821095785
sim_compute_sim_state_min0.03942187327258992
sim_physics_max0.23848541336830217
sim_physics_mean0.21708548666412392
sim_physics_median0.21554925389911817
sim_physics_min0.20319811981844615
sim_render-ego_max0.06851492609296526
sim_render-ego_mean0.0654796481450817
sim_render-ego_median0.06544825633366903
sim_render-ego_min0.06349181229213499
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.366666666666666
survival_time_min2.3999999999999995
209442907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:20:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-ip-172-31-25-98-2062-job20944/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202702907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:24:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3935483196426444
survival_time_median8.349999999999984
deviation-center-line_median0.5319314045213592
in-drivable-lane_median0


other stats
agent_compute-ego_max0.28810887993452794
agent_compute-ego_mean0.23703320917070583
agent_compute-ego_median0.2311811033884684
agent_compute-ego_min0.19590728759765624
deviation-center-line_max1.089013276901404
deviation-center-line_mean0.5315124114826804
deviation-center-line_min0.1829676816078264
deviation-heading_max0.9829718785711904
deviation-heading_mean0.8286973801164391
deviation-heading_median0.8466877216275525
deviation-heading_min0.6643836524907397
driven_any_max2.5533671935689743
driven_any_mean1.389845221202196
driven_any_median1.4003273617491212
driven_any_min0.3783149598878067
driven_lanedir_consec_max2.294813131089062
driven_lanedir_consec_mean1.2481922666886047
driven_lanedir_consec_min0.36500236206727954
driven_lanedir_max2.29484233855185
driven_lanedir_mean1.2482735826147096
driven_lanedir_median1.3938954635608076
driven_lanedir_min0.36500236206727954
in-drivable-lane_max2.250000000000032
in-drivable-lane_mean0.7400000000000105
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4003273617491212, "sim_physics": 0.21468650366731745, "survival_time": 8.349999999999984, "driven_lanedir": 1.3938954635608076, "sim_render-ego": 0.06715622776282762, "in-drivable-lane": 0, "agent_compute-ego": 0.28810887993452794, "deviation-heading": 0.786989947500488, "set_robot_commands": 0.13301449907040166, "deviation-center-line": 0.5319314045213592, "driven_lanedir_consec": 1.3935483196426444, "sim_compute_sim_state": 0.04210104485471806, "sim_compute_performance-ego": 0.07972024871917542, "sim_compute_robot_state-ego": 0.08244256202332274, "sim_compute_robot_state-npc0": 0.07403660677150338, "sim_compute_robot_state-npc1": 0.0736078116708173, "sim_compute_robot_state-npc2": 0.07341389456195031, "sim_compute_robot_state-npc3": 0.07763123512268066}, "udem1-1-0": {"driven_any": 0.4481960084795964, "sim_physics": 0.17050946992019128, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226073390807623, "sim_render-ego": 0.06062748514372727, "in-drivable-lane": 0, "agent_compute-ego": 0.21864735258036647, "deviation-heading": 0.9829718785711904, "set_robot_commands": 0.0955142646000303, "deviation-center-line": 0.20822502421497932, "driven_lanedir_consec": 0.4226073390807623, "sim_compute_sim_state": 0.03767829105771821, "sim_compute_performance-ego": 0.06707748051347404, "sim_compute_robot_state-ego": 0.07189721485664105, "sim_compute_robot_state-npc0": 0.06927385823480015, "sim_compute_robot_state-npc1": 0.07014765410587706, "sim_compute_robot_state-npc2": 0.06697002772627206, "sim_compute_robot_state-npc3": 0.06592323040140086}, "udem1-2-0": {"driven_any": 2.169020582325481, "sim_physics": 0.18318534364887312, "survival_time": 12.750000000000046, "driven_lanedir": 1.7650204098128477, "sim_render-ego": 0.05992717462427476, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.2513214223525103, "deviation-heading": 0.8624537003922248, "set_robot_commands": 0.09336328786962172, "deviation-center-line": 0.6454246701678333, "driven_lanedir_consec": 1.764990181563276, "sim_compute_sim_state": 0.03757199119119083, "sim_compute_performance-ego": 0.06382770444832596, "sim_compute_robot_state-ego": 0.06940328280131022, "sim_compute_robot_state-npc0": 0.06789968901989507, "sim_compute_robot_state-npc1": 0.066836851718379, "sim_compute_robot_state-npc2": 0.06555170545391008, "sim_compute_robot_state-npc3": 0.06641572409985112}, "udem1-3-0": {"driven_any": 2.5533671935689743, "sim_physics": 0.1949417432149251, "survival_time": 14.950000000000076, "driven_lanedir": 2.29484233855185, "sim_render-ego": 0.06125612497329712, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.2311811033884684, "deviation-heading": 0.8466877216275525, "set_robot_commands": 0.09215030034383138, "deviation-center-line": 1.089013276901404, "driven_lanedir_consec": 2.294813131089062, "sim_compute_sim_state": 0.03772512038548787, "sim_compute_performance-ego": 0.06754132270812989, "sim_compute_robot_state-ego": 0.07296149253845215, "sim_compute_robot_state-npc0": 0.06726473251978557, "sim_compute_robot_state-npc1": 0.06883942365646362, "sim_compute_robot_state-npc2": 0.06706049124399821, "sim_compute_robot_state-npc3": 0.06607783158620198}, "udem1-4-0": {"driven_any": 0.3783149598878067, "sim_physics": 0.1428041934967041, "survival_time": 2.499999999999999, "driven_lanedir": 0.36500236206727954, "sim_render-ego": 0.053736095428466794, "in-drivable-lane": 0, "agent_compute-ego": 0.19590728759765624, "deviation-heading": 0.6643836524907397, "set_robot_commands": 0.08305534839630127, "deviation-center-line": 0.1829676816078264, "driven_lanedir_consec": 0.36500236206727954, "sim_compute_sim_state": 0.03607606887817383, "sim_compute_performance-ego": 0.05989656448364258, "sim_compute_robot_state-ego": 0.06263020038604736, "sim_compute_robot_state-npc0": 0.0584454345703125, "sim_compute_robot_state-npc1": 0.05910097122192383, "sim_compute_robot_state-npc2": 0.059918761253356934, "sim_compute_robot_state-npc3": 0.06120214939117432}}
set_robot_commands_max0.13301449907040166
set_robot_commands_mean0.09941954005603726
set_robot_commands_median0.09336328786962172
set_robot_commands_min0.08305534839630127
sim_compute_performance-ego_max0.07972024871917542
sim_compute_performance-ego_mean0.06761266417454957
sim_compute_performance-ego_median0.06707748051347404
sim_compute_performance-ego_min0.05989656448364258
sim_compute_robot_state-ego_max0.08244256202332274
sim_compute_robot_state-ego_mean0.0718669505211547
sim_compute_robot_state-ego_median0.07189721485664105
sim_compute_robot_state-ego_min0.06263020038604736
sim_compute_robot_state-npc0_max0.07403660677150338
sim_compute_robot_state-npc0_mean0.06738406422325934
sim_compute_robot_state-npc0_median0.06789968901989507
sim_compute_robot_state-npc0_min0.0584454345703125
sim_compute_robot_state-npc1_max0.0736078116708173
sim_compute_robot_state-npc1_mean0.06770654247469216
sim_compute_robot_state-npc1_median0.06883942365646362
sim_compute_robot_state-npc1_min0.05910097122192383
sim_compute_robot_state-npc2_max0.07341389456195031
sim_compute_robot_state-npc2_mean0.06658297604789752
sim_compute_robot_state-npc2_median0.06697002772627206
sim_compute_robot_state-npc2_min0.059918761253356934
sim_compute_robot_state-npc3_max0.07763123512268066
sim_compute_robot_state-npc3_mean0.06745003412026178
sim_compute_robot_state-npc3_median0.06607783158620198
sim_compute_robot_state-npc3_min0.06120214939117432
sim_compute_sim_state_max0.04210104485471806
sim_compute_sim_state_mean0.03823050327345776
sim_compute_sim_state_median0.03767829105771821
sim_compute_sim_state_min0.03607606887817383
sim_physics_max0.21468650366731745
sim_physics_mean0.18122545078960223
sim_physics_median0.18318534364887312
sim_physics_min0.1428041934967041
sim_render-ego_max0.06715622776282762
sim_render-ego_mean0.06054062158651872
sim_render-ego_median0.06062748514372727
sim_render-ego_min0.053736095428466794
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.29000000000002
survival_time_min2.499999999999999
202572907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:14:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20257-204107', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20257-204107', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20257-204107', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
200612907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:17:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3935235228150438
survival_time_median8.349999999999984
deviation-center-line_median0.532584747249235
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19466336727142333
agent_compute-ego_mean0.1845494587038054
agent_compute-ego_median0.18601566347582588
agent_compute-ego_min0.17376606067021688
deviation-center-line_max1.0926561022224814
deviation-center-line_mean0.5330307166595671
deviation-center-line_min0.1829676816078264
deviation-heading_max0.982962904582818
deviation-heading_mean0.8300818928985108
deviation-heading_median0.8497664605806897
deviation-heading_min0.6643836524907397
driven_any_max2.5533671935123077
driven_any_mean1.3898452211799102
driven_any_median1.4003273616565732
driven_any_min0.3783149598878067
driven_lanedir_consec_max2.2947836186459902
driven_lanedir_consec_mean1.2481774211187848
driven_lanedir_consec_min0.36500236206727954
driven_lanedir_max2.2948136156936503
driven_lanedir_mean1.2482595945843264
driven_lanedir_median1.3938733172402218
driven_lanedir_min0.36500236206727954
in-drivable-lane_max2.250000000000032
in-drivable-lane_mean0.7400000000000105
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4003273616565732, "sim_physics": 0.10530953207415734, "survival_time": 8.349999999999984, "driven_lanedir": 1.3938733172402218, "sim_render-ego": 0.0611341927579777, "in-drivable-lane": 0, "agent_compute-ego": 0.19262546265196656, "deviation-heading": 0.7881985014433806, "set_robot_commands": 0.07816180925883219, "deviation-center-line": 0.532584747249235, "driven_lanedir_consec": 1.3935235228150438, "sim_compute_sim_state": 0.03629195904303454, "sim_compute_performance-ego": 0.06270049860377512, "sim_compute_robot_state-ego": 0.06075540131437565, "sim_compute_robot_state-npc0": 0.07045211620673449, "sim_compute_robot_state-npc1": 0.06546957193020575, "sim_compute_robot_state-npc2": 0.06400136033931893, "sim_compute_robot_state-npc3": 0.06442963434550576}, "udem1-1-0": {"driven_any": 0.4481960084807194, "sim_physics": 0.0957751726282054, "survival_time": 2.8999999999999977, "driven_lanedir": 0.42260832602765186, "sim_render-ego": 0.05867804329970787, "in-drivable-lane": 0, "agent_compute-ego": 0.18601566347582588, "deviation-heading": 0.982962904582818, "set_robot_commands": 0.07664346283879774, "deviation-center-line": 0.20822374703391688, "driven_lanedir_consec": 0.42260832602765186, "sim_compute_sim_state": 0.03434097355809705, "sim_compute_performance-ego": 0.06020947982525003, "sim_compute_robot_state-ego": 0.060079282727734794, "sim_compute_robot_state-npc0": 0.06614522687320051, "sim_compute_robot_state-npc1": 0.06093887625069454, "sim_compute_robot_state-npc2": 0.06008547338946112, "sim_compute_robot_state-npc3": 0.059813117158824}, "udem1-2-0": {"driven_any": 2.169020582362143, "sim_physics": 0.1068028403263466, "survival_time": 12.750000000000046, "driven_lanedir": 1.7650003518928292, "sim_render-ego": 0.05375693078134574, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.17567673944959453, "deviation-heading": 0.8650979453949253, "set_robot_commands": 0.07476814961900898, "deviation-center-line": 0.6487213051843762, "driven_lanedir_consec": 1.7649692760379576, "sim_compute_sim_state": 0.03261387581918754, "sim_compute_performance-ego": 0.056865996940463195, "sim_compute_robot_state-ego": 0.057914382336186426, "sim_compute_robot_state-npc0": 0.06388567756204044, "sim_compute_robot_state-npc1": 0.06065423254873238, "sim_compute_robot_state-npc2": 0.058497983334111235, "sim_compute_robot_state-npc3": 0.05817364524392521}, "udem1-3-0": {"driven_any": 2.5533671935123077, "sim_physics": 0.11486276070276896, "survival_time": 14.950000000000076, "driven_lanedir": 2.2948136156936503, "sim_render-ego": 0.05306158542633057, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.17376606067021688, "deviation-heading": 0.8497664605806897, "set_robot_commands": 0.0737524422009786, "deviation-center-line": 1.0926561022224814, "driven_lanedir_consec": 2.2947836186459902, "sim_compute_sim_state": 0.0323017414410909, "sim_compute_performance-ego": 0.05764521757761638, "sim_compute_robot_state-ego": 0.05775403340657552, "sim_compute_robot_state-npc0": 0.06288119157155354, "sim_compute_robot_state-npc1": 0.057975890636444094, "sim_compute_robot_state-npc2": 0.057344985802968346, "sim_compute_robot_state-npc3": 0.05754843711853028}, "udem1-4-0": {"driven_any": 0.3783149598878067, "sim_physics": 0.10428412437438964, "survival_time": 2.499999999999999, "driven_lanedir": 0.36500236206727954, "sim_render-ego": 0.06156817436218262, "in-drivable-lane": 0, "agent_compute-ego": 0.19466336727142333, "deviation-heading": 0.6643836524907397, "set_robot_commands": 0.07643141269683838, "deviation-center-line": 0.1829676816078264, "driven_lanedir_consec": 0.36500236206727954, "sim_compute_sim_state": 0.03728843688964844, "sim_compute_performance-ego": 0.06340924739837646, "sim_compute_robot_state-ego": 0.06463944911956787, "sim_compute_robot_state-npc0": 0.0729574728012085, "sim_compute_robot_state-npc1": 0.06969345092773438, "sim_compute_robot_state-npc2": 0.06959816455841064, "sim_compute_robot_state-npc3": 0.06646714687347412}}
set_robot_commands_max0.07816180925883219
set_robot_commands_mean0.07595145532289119
set_robot_commands_median0.07643141269683838
set_robot_commands_min0.0737524422009786
sim_compute_performance-ego_max0.06340924739837646
sim_compute_performance-ego_mean0.060166088069096235
sim_compute_performance-ego_median0.06020947982525003
sim_compute_performance-ego_min0.056865996940463195
sim_compute_robot_state-ego_max0.06463944911956787
sim_compute_robot_state-ego_mean0.06022850978088805
sim_compute_robot_state-ego_median0.060079282727734794
sim_compute_robot_state-ego_min0.05775403340657552
sim_compute_robot_state-npc0_max0.0729574728012085
sim_compute_robot_state-npc0_mean0.0672643370029475
sim_compute_robot_state-npc0_median0.06614522687320051
sim_compute_robot_state-npc0_min0.06288119157155354
sim_compute_robot_state-npc1_max0.06969345092773438
sim_compute_robot_state-npc1_mean0.06294640445876223
sim_compute_robot_state-npc1_median0.06093887625069454
sim_compute_robot_state-npc1_min0.057975890636444094
sim_compute_robot_state-npc2_max0.06959816455841064
sim_compute_robot_state-npc2_mean0.06190559348485405
sim_compute_robot_state-npc2_median0.06008547338946112
sim_compute_robot_state-npc2_min0.057344985802968346
sim_compute_robot_state-npc3_max0.06646714687347412
sim_compute_robot_state-npc3_mean0.06128639614805187
sim_compute_robot_state-npc3_median0.059813117158824
sim_compute_robot_state-npc3_min0.05754843711853028
sim_compute_sim_state_max0.03728843688964844
sim_compute_sim_state_mean0.0345673973502117
sim_compute_sim_state_median0.03434097355809705
sim_compute_sim_state_min0.0323017414410909
sim_physics_max0.11486276070276896
sim_physics_mean0.10540688602117358
sim_physics_median0.10530953207415734
sim_physics_min0.0957751726282054
sim_render-ego_max0.06156817436218262
sim_render-ego_mean0.05763978532550891
sim_render-ego_median0.05867804329970787
sim_render-ego_min0.05306158542633057
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.29000000000002
survival_time_min2.499999999999999
200362907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:01:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20036-415179', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20036-415179', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20036-415179', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
198122907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:21:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3657481511859062
survival_time_median8.14999999999998
deviation-center-line_median0.5178532019846503
in-drivable-lane_median0


other stats
agent_compute-ego_max0.23122706281857228
agent_compute-ego_mean0.2244337284701169
agent_compute-ego_median0.2232519920667013
agent_compute-ego_min0.2146448021286104
deviation-center-line_max1.0242612694838515
deviation-center-line_mean0.5096593806438563
deviation-center-line_min0.1815526271000825
deviation-heading_max0.9674399631512608
deviation-heading_mean0.8238858024519191
deviation-heading_median0.8365673366477469
deviation-heading_min0.652446569096452
driven_any_max2.560662071793361
driven_any_mean1.3849108674230155
driven_any_median1.3726816424954706
driven_any_min0.3768745879918225
driven_lanedir_consec_max2.334869913840255
driven_lanedir_consec_mean1.254310834511854
driven_lanedir_consec_min0.3635532519031195
driven_lanedir_max2.334890533701104
driven_lanedir_mean1.254395821241331
driven_lanedir_median1.3661324625614164
driven_lanedir_min0.3635532519031195
in-drivable-lane_max2.10000000000003
in-drivable-lane_mean0.6700000000000095
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.3726816424954706, "sim_physics": 0.03895895027675512, "survival_time": 8.14999999999998, "driven_lanedir": 1.3661324625614164, "sim_render-ego": 0.05635785763980421, "in-drivable-lane": 0, "agent_compute-ego": 0.2146448021286104, "deviation-heading": 0.7816631421766453, "set_robot_commands": 0.08892458933262737, "deviation-center-line": 0.5178532019846503, "driven_lanedir_consec": 1.3657481511859062, "sim_compute_sim_state": 0.036888545276197185, "sim_compute_performance-ego": 0.06153873870709191, "sim_compute_robot_state-ego": 0.06633593407145306, "sim_compute_robot_state-npc0": 0.063327451425096, "sim_compute_robot_state-npc1": 0.06308432883280186, "sim_compute_robot_state-npc2": 0.06321366871792845, "sim_compute_robot_state-npc3": 0.06290936616300805}, "udem1-1-0": {"driven_any": 0.4467557255407116, "sim_physics": 0.04655099333378307, "survival_time": 2.849999999999998, "driven_lanedir": 0.4211752092136716, "sim_render-ego": 0.061390387384515056, "in-drivable-lane": 0, "agent_compute-ego": 0.2222591575823332, "deviation-heading": 0.9674399631512608, "set_robot_commands": 0.09260055056789464, "deviation-center-line": 0.20389877857690455, "driven_lanedir_consec": 0.4211752092136716, "sim_compute_sim_state": 0.038025646878961934, "sim_compute_performance-ego": 0.06816473760102924, "sim_compute_robot_state-ego": 0.07216779809249074, "sim_compute_robot_state-npc0": 0.06522871318616365, "sim_compute_robot_state-npc1": 0.06545306506909822, "sim_compute_robot_state-npc2": 0.06485025924548768, "sim_compute_robot_state-npc3": 0.06523562732495759}, "udem1-2-0": {"driven_any": 2.167580309293714, "sim_physics": 0.04202029930325005, "survival_time": 12.700000000000044, "driven_lanedir": 1.786227648827344, "sim_render-ego": 0.061475147412517875, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.23122706281857228, "deviation-heading": 0.8813120011874904, "set_robot_commands": 0.0956243783470214, "deviation-center-line": 0.6207310260737929, "driven_lanedir_consec": 1.7862076464163166, "sim_compute_sim_state": 0.0398214398406622, "sim_compute_performance-ego": 0.0667864027924425, "sim_compute_robot_state-ego": 0.07224338824354758, "sim_compute_robot_state-npc0": 0.06924859745295968, "sim_compute_robot_state-npc1": 0.06739056298113245, "sim_compute_robot_state-npc2": 0.06779248789539487, "sim_compute_robot_state-npc3": 0.06800875513572392}, "udem1-3-0": {"driven_any": 2.560662071793361, "sim_physics": 0.04152500867843628, "survival_time": 14.950000000000076, "driven_lanedir": 2.334890533701104, "sim_render-ego": 0.060413526693979896, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.2232519920667013, "deviation-heading": 0.8365673366477469, "set_robot_commands": 0.0936980438232422, "deviation-center-line": 1.0242612694838515, "driven_lanedir_consec": 2.334869913840255, "sim_compute_sim_state": 0.038380480607350664, "sim_compute_performance-ego": 0.06629988590876261, "sim_compute_robot_state-ego": 0.06952337503433227, "sim_compute_robot_state-npc0": 0.0672299567858378, "sim_compute_robot_state-npc1": 0.06758277893066406, "sim_compute_robot_state-npc2": 0.06802114009857178, "sim_compute_robot_state-npc3": 0.06916581233342489}, "udem1-4-0": {"driven_any": 0.3768745879918225, "sim_physics": 0.042881342829490195, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3635532519031195, "sim_render-ego": 0.06235292493080606, "in-drivable-lane": 0, "agent_compute-ego": 0.23078562775436712, "deviation-heading": 0.652446569096452, "set_robot_commands": 0.09671393219305544, "deviation-center-line": 0.1815526271000825, "driven_lanedir_consec": 0.3635532519031195, "sim_compute_sim_state": 0.03800110427700743, "sim_compute_performance-ego": 0.06889706241841219, "sim_compute_robot_state-ego": 0.06991883686610631, "sim_compute_robot_state-npc0": 0.06787790084371761, "sim_compute_robot_state-npc1": 0.06872049156500369, "sim_compute_robot_state-npc2": 0.06764856649904835, "sim_compute_robot_state-npc3": 0.06771560104525819}}
set_robot_commands_max0.09671393219305544
set_robot_commands_mean0.0935122988527682
set_robot_commands_median0.0936980438232422
set_robot_commands_min0.08892458933262737
sim_compute_performance-ego_max0.06889706241841219
sim_compute_performance-ego_mean0.0663373654855477
sim_compute_performance-ego_median0.0667864027924425
sim_compute_performance-ego_min0.06153873870709191
sim_compute_robot_state-ego_max0.07224338824354758
sim_compute_robot_state-ego_mean0.07003786646158598
sim_compute_robot_state-ego_median0.06991883686610631
sim_compute_robot_state-ego_min0.06633593407145306
sim_compute_robot_state-npc0_max0.06924859745295968
sim_compute_robot_state-npc0_mean0.06658252393875494
sim_compute_robot_state-npc0_median0.0672299567858378
sim_compute_robot_state-npc0_min0.063327451425096
sim_compute_robot_state-npc1_max0.06872049156500369
sim_compute_robot_state-npc1_mean0.06644624547574006
sim_compute_robot_state-npc1_median0.06739056298113245
sim_compute_robot_state-npc1_min0.06308432883280186
sim_compute_robot_state-npc2_max0.06802114009857178
sim_compute_robot_state-npc2_mean0.06630522449128624
sim_compute_robot_state-npc2_median0.06764856649904835
sim_compute_robot_state-npc2_min0.06321366871792845
sim_compute_robot_state-npc3_max0.06916581233342489
sim_compute_robot_state-npc3_mean0.06660703240047453
sim_compute_robot_state-npc3_median0.06771560104525819
sim_compute_robot_state-npc3_min0.06290936616300805
sim_compute_sim_state_max0.0398214398406622
sim_compute_sim_state_mean0.03822344337603588
sim_compute_sim_state_median0.038025646878961934
sim_compute_sim_state_min0.036888545276197185
sim_physics_max0.04655099333378307
sim_physics_mean0.04238731888434294
sim_physics_median0.04202029930325005
sim_physics_min0.03895895027675512
sim_render-ego_max0.06235292493080606
sim_render-ego_mean0.06039796881232462
sim_render-ego_median0.061390387384515056
sim_render-ego_min0.05635785763980421
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.220000000000022
survival_time_min2.4499999999999993
197422907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:15:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3745342426838212
survival_time_median8.199999999999982
deviation-center-line_median0.5215655214406835
in-drivable-lane_median0


other stats
agent_compute-ego_max0.197071911995871
agent_compute-ego_mean0.1872450268896159
agent_compute-ego_median0.1889086116955975
agent_compute-ego_min0.17915741284688314
deviation-center-line_max1.0243712505239329
deviation-center-line_mean0.5104937828661258
deviation-center-line_min0.181552173414958
deviation-heading_max0.9674238141748316
deviation-heading_mean0.8240707405707675
deviation-heading_median0.8364369420819541
deviation-heading_min0.6524393281816242
driven_any_max2.560662071787198
driven_any_mean1.3866578975264614
driven_any_median1.3814167929586016
driven_any_min0.3768745879914847
driven_lanedir_consec_max2.334870794711395
driven_lanedir_consec_mean1.2560670952644155
driven_lanedir_consec_min0.3635537664685682
driven_lanedir_max2.3348916013987537
driven_lanedir_mean1.2561498736032586
driven_lanedir_median1.37490769676153
driven_lanedir_min0.3635537664685682
in-drivable-lane_max2.10000000000003
in-drivable-lane_mean0.6700000000000095
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.3814167929586016, "sim_physics": 0.02642942783309192, "survival_time": 8.199999999999982, "driven_lanedir": 1.37490769676153, "sim_render-ego": 0.053558153350178786, "in-drivable-lane": 0, "agent_compute-ego": 0.1892877715389903, "deviation-heading": 0.7821830618564979, "set_robot_commands": 0.07516294572411514, "deviation-center-line": 0.5215655214406835, "driven_lanedir_consec": 1.3745342426838212, "sim_compute_sim_state": 0.03203106798776766, "sim_compute_performance-ego": 0.05746353690217181, "sim_compute_robot_state-ego": 0.059042647117521704, "sim_compute_robot_state-npc0": 0.06531312407516851, "sim_compute_robot_state-npc1": 0.060880716254071494, "sim_compute_robot_state-npc2": 0.05851406440502259, "sim_compute_robot_state-npc3": 0.05830408160279437}, "udem1-1-0": {"driven_any": 0.44675572554277954, "sim_physics": 0.026271493811356395, "survival_time": 2.849999999999998, "driven_lanedir": 0.4211752412866385, "sim_render-ego": 0.057119147819385194, "in-drivable-lane": 0, "agent_compute-ego": 0.197071911995871, "deviation-heading": 0.9674238141748316, "set_robot_commands": 0.0761692816751045, "deviation-center-line": 0.20389742719410403, "driven_lanedir_consec": 0.4211752412866385, "sim_compute_sim_state": 0.03321528853031627, "sim_compute_performance-ego": 0.05944132386592396, "sim_compute_robot_state-ego": 0.06032143559372216, "sim_compute_robot_state-npc0": 0.07056250906827156, "sim_compute_robot_state-npc1": 0.06293211066932008, "sim_compute_robot_state-npc2": 0.061218805480421634, "sim_compute_robot_state-npc3": 0.06190406230458042}, "udem1-2-0": {"driven_any": 2.167580309352243, "sim_physics": 0.024971914103650673, "survival_time": 12.700000000000044, "driven_lanedir": 1.7862210621008026, "sim_render-ego": 0.05589656660875936, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.1889086116955975, "deviation-heading": 0.8818705565589293, "set_robot_commands": 0.07643724989703321, "deviation-center-line": 0.6210825417569507, "driven_lanedir_consec": 1.7862014311716543, "sim_compute_sim_state": 0.03232281696139358, "sim_compute_performance-ego": 0.058375532232870266, "sim_compute_robot_state-ego": 0.05905527862038199, "sim_compute_robot_state-npc0": 0.06447514023367815, "sim_compute_robot_state-npc1": 0.059401974903316945, "sim_compute_robot_state-npc2": 0.0580345157563217, "sim_compute_robot_state-npc3": 0.05901036112327275}, "udem1-3-0": {"driven_any": 2.560662071787198, "sim_physics": 0.024300905068715413, "survival_time": 14.950000000000076, "driven_lanedir": 2.3348916013987537, "sim_render-ego": 0.05249558687210083, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.17915741284688314, "deviation-heading": 0.8364369420819541, "set_robot_commands": 0.07424239873886108, "deviation-center-line": 1.0243712505239329, "driven_lanedir_consec": 2.334870794711395, "sim_compute_sim_state": 0.031618553002675374, "sim_compute_performance-ego": 0.056251644293467205, "sim_compute_robot_state-ego": 0.05720424890518189, "sim_compute_robot_state-npc0": 0.06132374445597331, "sim_compute_robot_state-npc1": 0.057348792552948, "sim_compute_robot_state-npc2": 0.05646773497263591, "sim_compute_robot_state-npc3": 0.05656026204427083}, "udem1-4-0": {"driven_any": 0.3768745879914847, "sim_physics": 0.024826113058596243, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3635537664685682, "sim_render-ego": 0.051329603000563016, "in-drivable-lane": 0, "agent_compute-ego": 0.1817994263707375, "deviation-heading": 0.6524393281816242, "set_robot_commands": 0.07486146810103436, "deviation-center-line": 0.181552173414958, "driven_lanedir_consec": 0.3635537664685682, "sim_compute_sim_state": 0.03078548275694555, "sim_compute_performance-ego": 0.05765050771285077, "sim_compute_robot_state-ego": 0.05741124250450913, "sim_compute_robot_state-npc0": 0.061607355974158465, "sim_compute_robot_state-npc1": 0.057997066147473395, "sim_compute_robot_state-npc2": 0.05595621770741988, "sim_compute_robot_state-npc3": 0.05528037888663156}}
set_robot_commands_max0.07643724989703321
set_robot_commands_mean0.07537466882722965
set_robot_commands_median0.07516294572411514
set_robot_commands_min0.07424239873886108
sim_compute_performance-ego_max0.05944132386592396
sim_compute_performance-ego_mean0.0578365090014568
sim_compute_performance-ego_median0.05765050771285077
sim_compute_performance-ego_min0.056251644293467205
sim_compute_robot_state-ego_max0.06032143559372216
sim_compute_robot_state-ego_mean0.05860697054826338
sim_compute_robot_state-ego_median0.059042647117521704
sim_compute_robot_state-ego_min0.05720424890518189
sim_compute_robot_state-npc0_max0.07056250906827156
sim_compute_robot_state-npc0_mean0.06465637476145
sim_compute_robot_state-npc0_median0.06447514023367815
sim_compute_robot_state-npc0_min0.06132374445597331
sim_compute_robot_state-npc1_max0.06293211066932008
sim_compute_robot_state-npc1_mean0.05971213210542599
sim_compute_robot_state-npc1_median0.059401974903316945
sim_compute_robot_state-npc1_min0.057348792552948
sim_compute_robot_state-npc2_max0.061218805480421634
sim_compute_robot_state-npc2_mean0.05803826766436435
sim_compute_robot_state-npc2_median0.0580345157563217
sim_compute_robot_state-npc2_min0.05595621770741988
sim_compute_robot_state-npc3_max0.06190406230458042
sim_compute_robot_state-npc3_mean0.05821182919230998
sim_compute_robot_state-npc3_median0.05830408160279437
sim_compute_robot_state-npc3_min0.05528037888663156
sim_compute_sim_state_max0.03321528853031627
sim_compute_sim_state_mean0.031994641847819694
sim_compute_sim_state_median0.03203106798776766
sim_compute_sim_state_min0.03078548275694555
sim_physics_max0.02642942783309192
sim_physics_mean0.02535997077508213
sim_physics_median0.024971914103650673
sim_physics_min0.024300905068715413
sim_render-ego_max0.057119147819385194
sim_render-ego_mean0.05407981153019743
sim_render-ego_median0.053558153350178786
sim_render-ego_min0.051329603000563016
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.230000000000022
survival_time_min2.4499999999999993
192682907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:19:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8271285355821008
survival_time_median12.650000000000045
deviation-center-line_median0.19415037283705935
in-drivable-lane_median1.40000000000002


other stats
agent_compute-ego_max0.18420249011676773
agent_compute-ego_mean0.18154391587005317
agent_compute-ego_median0.1811644361895535
agent_compute-ego_min0.17979050954182943
deviation-center-line_max0.3673530652081116
deviation-center-line_mean0.2042033724682011
deviation-center-line_min0.09248480198365128
deviation-heading_max1.2473630654780736
deviation-heading_mean0.8328095506708519
deviation-heading_median0.7341499130314633
deviation-heading_min0.6083993837505045
driven_any_max2.5606620723018914
driven_any_mean1.771004492913502
driven_any_median2.1588451631372982
driven_any_min0.9883350327659728
driven_lanedir_consec_max2.4115921603965047
driven_lanedir_consec_mean1.5098983566576445
driven_lanedir_consec_min0.6580949768877806
driven_lanedir_max2.4115921603965047
driven_lanedir_mean1.5098986034849895
driven_lanedir_median1.8271285355821008
driven_lanedir_min0.6580949768877806
in-drivable-lane_max1.649999999999994
in-drivable-lane_mean1.2600000000000078
in-drivable-lane_min0.4500000000000064
per-episodes
details{"udem1-0-0": {"driven_any": 2.158845163531688, "sim_physics": 0.030450263042223785, "survival_time": 12.650000000000045, "driven_lanedir": 1.8968456952980517, "sim_render-ego": 0.05449961390891094, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.18420249011676773, "deviation-heading": 0.6210023778086736, "set_robot_commands": 0.07328620918183458, "deviation-center-line": 0.247295363166418, "driven_lanedir_consec": 1.8968444611613255, "sim_compute_sim_state": 0.03379277466785295, "sim_compute_performance-ego": 0.058801307979779754, "sim_compute_robot_state-ego": 0.05968937383810051, "sim_compute_robot_state-npc0": 0.06382059202835022, "sim_compute_robot_state-npc1": 0.06100315915737227, "sim_compute_robot_state-npc2": 0.05890438679178713, "sim_compute_robot_state-npc3": 0.059349834683384346}, "udem1-1-0": {"driven_any": 0.9883350328306594, "sim_physics": 0.02941198308928674, "survival_time": 5.949999999999987, "driven_lanedir": 0.6580949768877806, "sim_render-ego": 0.05118460414790306, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.18191902577376165, "deviation-heading": 0.7341499130314633, "set_robot_commands": 0.07187373898610347, "deviation-center-line": 0.09248480198365128, "driven_lanedir_consec": 0.6580949768877806, "sim_compute_sim_state": 0.031657629654187114, "sim_compute_performance-ego": 0.05571670492156213, "sim_compute_robot_state-ego": 0.05679369974537056, "sim_compute_robot_state-npc0": 0.05988147479145467, "sim_compute_robot_state-npc1": 0.05633171265866576, "sim_compute_robot_state-npc2": 0.05647125163999926, "sim_compute_robot_state-npc3": 0.0578608372632195}, "udem1-2-0": {"driven_any": 2.1588451631372982, "sim_physics": 0.02939631816426756, "survival_time": 12.650000000000045, "driven_lanedir": 1.8271285355821008, "sim_render-ego": 0.05334153665384285, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.1811644361895535, "deviation-heading": 0.9531330132855452, "set_robot_commands": 0.0729786539266232, "deviation-center-line": 0.19415037283705935, "driven_lanedir_consec": 1.8271285355821008, "sim_compute_sim_state": 0.03173994358349223, "sim_compute_performance-ego": 0.05815190948516484, "sim_compute_robot_state-ego": 0.05902650516494932, "sim_compute_robot_state-npc0": 0.06093463219201612, "sim_compute_robot_state-npc1": 0.058229321076464745, "sim_compute_robot_state-npc2": 0.05731259221615999, "sim_compute_robot_state-npc3": 0.0567782594281223}, "udem1-3-0": {"driven_any": 2.5606620723018914, "sim_physics": 0.02874726136525472, "survival_time": 14.950000000000076, "driven_lanedir": 2.4115921603965047, "sim_render-ego": 0.051884806156158446, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.17979050954182943, "deviation-heading": 1.2473630654780736, "set_robot_commands": 0.07127940893173218, "deviation-center-line": 0.3673530652081116, "driven_lanedir_consec": 2.4115921603965047, "sim_compute_sim_state": 0.03236267884572347, "sim_compute_performance-ego": 0.0569170864423116, "sim_compute_robot_state-ego": 0.0586840017636617, "sim_compute_robot_state-npc0": 0.06096553087234497, "sim_compute_robot_state-npc1": 0.05726840655008952, "sim_compute_robot_state-npc2": 0.05618820826212565, "sim_compute_robot_state-npc3": 0.05730130354563395}, "udem1-4-0": {"driven_any": 0.9883350327659728, "sim_physics": 0.029288566413045933, "survival_time": 5.949999999999987, "driven_lanedir": 0.7558316492605099, "sim_render-ego": 0.05127328383822401, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.1806431177283535, "deviation-heading": 0.6083993837505045, "set_robot_commands": 0.07181806724612452, "deviation-center-line": 0.11973325914576528, "driven_lanedir_consec": 0.7558316492605099, "sim_compute_sim_state": 0.03234309108317399, "sim_compute_performance-ego": 0.05667567052761046, "sim_compute_robot_state-ego": 0.057523126361750755, "sim_compute_robot_state-npc0": 0.06243920526584657, "sim_compute_robot_state-npc1": 0.058365765739889705, "sim_compute_robot_state-npc2": 0.056214036059980634, "sim_compute_robot_state-npc3": 0.05645536374645073}}
set_robot_commands_max0.07328620918183458
set_robot_commands_mean0.07224721565448358
set_robot_commands_median0.07187373898610347
set_robot_commands_min0.07127940893173218
sim_compute_performance-ego_max0.058801307979779754
sim_compute_performance-ego_mean0.05725253587128576
sim_compute_performance-ego_median0.0569170864423116
sim_compute_performance-ego_min0.05571670492156213
sim_compute_robot_state-ego_max0.05968937383810051
sim_compute_robot_state-ego_mean0.058343341374766565
sim_compute_robot_state-ego_median0.0586840017636617
sim_compute_robot_state-ego_min0.05679369974537056
sim_compute_robot_state-npc0_max0.06382059202835022
sim_compute_robot_state-npc0_mean0.061608287030002505
sim_compute_robot_state-npc0_median0.06096553087234497
sim_compute_robot_state-npc0_min0.05988147479145467
sim_compute_robot_state-npc1_max0.06100315915737227
sim_compute_robot_state-npc1_mean0.058239673036496395
sim_compute_robot_state-npc1_median0.058229321076464745
sim_compute_robot_state-npc1_min0.05633171265866576
sim_compute_robot_state-npc2_max0.05890438679178713
sim_compute_robot_state-npc2_mean0.057018094994010525
sim_compute_robot_state-npc2_median0.05647125163999926
sim_compute_robot_state-npc2_min0.05618820826212565
sim_compute_robot_state-npc3_max0.059349834683384346
sim_compute_robot_state-npc3_mean0.057549119733362165
sim_compute_robot_state-npc3_median0.05730130354563395
sim_compute_robot_state-npc3_min0.05645536374645073
sim_compute_sim_state_max0.03379277466785295
sim_compute_sim_state_mean0.032379223566885953
sim_compute_sim_state_median0.03234309108317399
sim_compute_sim_state_min0.031657629654187114
sim_physics_max0.030450263042223785
sim_physics_mean0.02945887841481575
sim_physics_median0.02939631816426756
sim_physics_min0.02874726136525472
sim_render-ego_max0.05449961390891094
sim_render-ego_mean0.052436768941007864
sim_render-ego_median0.051884806156158446
sim_render-ego_min0.05118460414790306
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.430000000000028
survival_time_min5.949999999999987
190412907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerrorno-0:21:06
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190352907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-1:25:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-nutonomy-P50-6318-job19035/tmp/tmpf0pr3qn3/attempts/udem1-4-0.attempt4/log.gs2.cbor']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190272907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerrorno-0:21:13
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.