AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 845

evaluator845
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7194
versiond-c:4.0.19;d-c-r:4.0.30;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success28
# timeout
# failed
# error16
# aborted
# host-error15
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.8 GB
Disk (MB)96.9 GB
Disk available (MB)53.9 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable0
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
215543220AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessno8450:17:57(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.11889606217543285
agent_compute-ego_mean0.09569274116425076
agent_compute-ego_median0.08783868686881607
agent_compute-ego_min0.0868136057486901
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1376649186580996, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.046490445921692665, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11137564574615864, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0716216352921498, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.02805747865121576, "sim_compute_performance-ego": 0.04907510552225234, "sim_compute_robot_state-ego": 0.051408284827123715, "sim_compute_robot_state-npc0": 0.051249709310410896, "sim_compute_robot_state-npc1": 0.05182195011573502, "sim_compute_robot_state-npc2": 0.05150762992569163, "sim_compute_robot_state-npc3": 0.0510152985778036}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.13530401672635758, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.04592233044760568, "in-drivable-lane": 0, "agent_compute-ego": 0.107248774596623, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06794045652662005, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.0265069774218968, "sim_compute_performance-ego": 0.04905926329748971, "sim_compute_robot_state-ego": 0.05196744203567505, "sim_compute_robot_state-npc0": 0.05144391741071429, "sim_compute_robot_state-npc1": 0.057449936866760254, "sim_compute_robot_state-npc2": 0.04774745873042515, "sim_compute_robot_state-npc3": 0.046428024768829346}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1342087879921626, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04701360915471049, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1181353527365379, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07394248305015194, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.029090251737427943, "sim_compute_performance-ego": 0.053631062646514, "sim_compute_robot_state-ego": 0.0510743381907639, "sim_compute_robot_state-npc0": 0.05572871328557579, "sim_compute_robot_state-npc1": 0.05360590601430356, "sim_compute_robot_state-npc2": 0.05031938460266706, "sim_compute_robot_state-npc3": 0.05138029635531231}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1448084612687429, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.043710788091023765, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11889606217543285, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07274247705936432, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.027300457159678142, "sim_compute_performance-ego": 0.04700277745723725, "sim_compute_robot_state-ego": 0.047461628913879395, "sim_compute_robot_state-npc0": 0.05205709238847097, "sim_compute_robot_state-npc1": 0.05002166827519735, "sim_compute_robot_state-npc2": 0.048275391260782875, "sim_compute_robot_state-npc3": 0.048860410849253334}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.13150192442394437, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04178074428013393, "in-drivable-lane": 0, "agent_compute-ego": 0.10217055820283436, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.05969617480323428, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.02708269300914946, "sim_compute_performance-ego": 0.04631932576497396, "sim_compute_robot_state-ego": 0.04687632833208357, "sim_compute_robot_state-npc0": 0.04739763623192197, "sim_compute_robot_state-npc1": 0.046098368508475165, "sim_compute_robot_state-npc2": 0.05282719930013021, "sim_compute_robot_state-npc3": 0.04644722030276344}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.10388206007951747, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.03592484297152765, "in-drivable-lane": 2, "agent_compute-ego": 0.08783868686881607, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.05478526732164943, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.023762518774249595, "sim_compute_performance-ego": 0.03868859542344145, "sim_compute_robot_state-ego": 0.04114995031299705, "sim_compute_robot_state-npc0": 0.040367374877015985, "sim_compute_robot_state-npc1": 0.039742842405856016, "sim_compute_robot_state-npc2": 0.03958014956491436, "sim_compute_robot_state-npc3": 0.03971273742036191}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.11132204879834814, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.04215276588514013, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0875901550922579, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.054743880207098805, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02236592885359977, "sim_compute_performance-ego": 0.04072859680768356, "sim_compute_robot_state-ego": 0.04030356129396309, "sim_compute_robot_state-npc0": 0.04002613697237181, "sim_compute_robot_state-npc1": 0.039002418518066406, "sim_compute_robot_state-npc2": 0.03885218009208013, "sim_compute_robot_state-npc3": 0.03880670001205889}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.11398381233215332, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.03642405986785888, "in-drivable-lane": 0, "agent_compute-ego": 0.09191505908966063, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.05392534255981445, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.022822132110595705, "sim_compute_performance-ego": 0.03824660301208496, "sim_compute_robot_state-ego": 0.04036633968353272, "sim_compute_robot_state-npc0": 0.03990102767944336, "sim_compute_robot_state-npc1": 0.03974318504333496, "sim_compute_robot_state-npc2": 0.03917370796203613, "sim_compute_robot_state-npc3": 0.039241485595703125}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.10321545142393844, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03579159424855159, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08724980629407443, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.054338615674238935, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.022460804535792425, "sim_compute_performance-ego": 0.04138764968285194, "sim_compute_robot_state-ego": 0.04020752815099863, "sim_compute_robot_state-npc0": 0.04000105766149667, "sim_compute_robot_state-npc1": 0.03894506050990178, "sim_compute_robot_state-npc2": 0.038894364467033975, "sim_compute_robot_state-npc3": 0.03920409771112295}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.11915843303386982, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03616258731255165, "in-drivable-lane": 0, "agent_compute-ego": 0.08810020410097562, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.05430450806250939, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.02221673268538255, "sim_compute_performance-ego": 0.03860158186692458, "sim_compute_robot_state-ego": 0.04107754047100361, "sim_compute_robot_state-npc0": 0.03975388636955848, "sim_compute_robot_state-npc1": 0.03899177221151499, "sim_compute_robot_state-npc2": 0.03894628928257869, "sim_compute_robot_state-npc3": 0.03884713466350849}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.1080343398180875, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.03618157993663441, "in-drivable-lane": 0, "agent_compute-ego": 0.0869559266350486, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.05382627790624445, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.022132450884038753, "sim_compute_performance-ego": 0.039835485545071686, "sim_compute_robot_state-ego": 0.04047378626736728, "sim_compute_robot_state-npc0": 0.03993794051083652, "sim_compute_robot_state-npc1": 0.038779833100058815, "sim_compute_robot_state-npc2": 0.03846245462244207, "sim_compute_robot_state-npc3": 0.03857508572665128}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.09894132614135742, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.03547544479370117, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08710754871368408, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.05374613761901856, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.022300586700439457, "sim_compute_performance-ego": 0.038331708908081054, "sim_compute_robot_state-ego": 0.040228967666625974, "sim_compute_robot_state-npc0": 0.04044147968292236, "sim_compute_robot_state-npc1": 0.0392544412612915, "sim_compute_robot_state-npc2": 0.03890676975250244, "sim_compute_robot_state-npc3": 0.0387905216217041}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.10438625863257876, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.03546393171269843, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08696058455933915, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.054314897415485786, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.022295959452365306, "sim_compute_performance-ego": 0.0379666343648383, "sim_compute_robot_state-ego": 0.040279824683006775, "sim_compute_robot_state-npc0": 0.03964665849158104, "sim_compute_robot_state-npc1": 0.03895927743708834, "sim_compute_robot_state-npc2": 0.03885722413976142, "sim_compute_robot_state-npc3": 0.03924124545239387}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10048696169486412, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.035392545736753024, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0868136057486901, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.05384903687697191, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.022197530819819525, "sim_compute_performance-ego": 0.038967325137211725, "sim_compute_robot_state-ego": 0.040309594227717474, "sim_compute_robot_state-npc0": 0.0405206955396212, "sim_compute_robot_state-npc1": 0.03914334223820613, "sim_compute_robot_state-npc2": 0.03875061181875376, "sim_compute_robot_state-npc3": 0.03891458878150353}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.10115135510762532, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.035282614117576966, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.0870331469036284, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.05382852327255976, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02224156970069522, "sim_compute_performance-ego": 0.03798954827444894, "sim_compute_robot_state-ego": 0.040123573939005536, "sim_compute_robot_state-npc0": 0.03958408037821451, "sim_compute_robot_state-npc1": 0.038920749936785015, "sim_compute_robot_state-npc2": 0.03914700689769927, "sim_compute_robot_state-npc3": 0.039073971339634486}}
set_robot_commands_max0.07394248305015194
set_robot_commands_mean0.059173714243140794
set_robot_commands_median0.054338615674238935
set_robot_commands_min0.05374613761901856
sim_compute_performance-ego_max0.053631062646514
sim_compute_performance-ego_mean0.04238875091407369
sim_compute_performance-ego_median0.039835485545071686
sim_compute_performance-ego_min0.0379666343648383
sim_compute_robot_state-ego_max0.05196744203567505
sim_compute_robot_state-ego_mean0.043553912599716256
sim_compute_robot_state-ego_median0.04047378626736728
sim_compute_robot_state-ego_min0.040123573939005536
sim_compute_robot_state-npc0_max0.05572871328557579
sim_compute_robot_state-npc0_mean0.04387049378601039
sim_compute_robot_state-npc0_median0.040367374877015985
sim_compute_robot_state-npc0_min0.03958408037821451
sim_compute_robot_state-npc1_max0.057449936866760254
sim_compute_robot_state-npc1_mean0.04336538349617169
sim_compute_robot_state-npc1_median0.0392544412612915
sim_compute_robot_state-npc1_min0.038779833100058815
sim_compute_robot_state-npc2_max0.05282719930013021
sim_compute_robot_state-npc2_mean0.04268318816129994
sim_compute_robot_state-npc2_median0.03914700689769927
sim_compute_robot_state-npc2_min0.03846245462244207
sim_compute_robot_state-npc3_max0.05138029635531231
sim_compute_robot_state-npc3_mean0.042302587945240305
sim_compute_robot_state-npc3_median0.03924124545239387
sim_compute_robot_state-npc3_min0.03857508572665128
sim_compute_sim_state_max0.029090251737427943
sim_compute_sim_state_mean0.02418893816642309
sim_compute_sim_state_median0.022460804535792425
sim_compute_sim_state_min0.022132450884038753
sim_physics_max0.1448084612687429
sim_physics_mean0.11653667707544316
sim_physics_median0.11132204879834814
sim_physics_min0.09894132614135742
sim_render-ego_max0.04701360915471049
sim_render-ego_mean0.03927799229854402
sim_render-ego_median0.03618157993663441
sim_render-ego_min0.035282614117576966
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
214683164awoo424Roasted duckaido2-LF-sim-validationstep1-simulationsuccessno8450:10:04(hidden)
driven_lanedir_consec_median0.3469843068996177
survival_time_median5.249999999999989
deviation-center-line_median0.3073183948696125
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.1273355029878162
agent_compute-ego_mean0.12503875004991652
agent_compute-ego_median0.12459038654963175
agent_compute-ego_min0.12394006628739208
deviation-center-line_max0.8508939147056557
deviation-center-line_mean0.41815376444419866
deviation-center-line_min0.28047991410230216
deviation-heading_max2.0789451327606305
deviation-heading_mean1.7677784742023193
deviation-heading_median1.8787843619783744
deviation-heading_min1.0799516136348926
driven_any_max1.092829462872696
driven_any_mean0.5611117310162739
driven_any_median0.3912360782722368
driven_any_min0.19319242538978615
driven_lanedir_consec_max1.0747418735491343
driven_lanedir_consec_mean0.5020634950065043
driven_lanedir_consec_min0.1771457454437826
driven_lanedir_max1.0747418735491343
driven_lanedir_mean0.5020634950065043
driven_lanedir_median0.3469843068996177
driven_lanedir_min0.1771457454437826
in-drivable-lane_max1.550000000000022
in-drivable-lane_mean0.3700000000000042
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.092829462872696, "sim_physics": 0.05941671848297119, "survival_time": 14.950000000000076, "driven_lanedir": 1.0747418735491343, "sim_render-ego": 0.037487085660298666, "in-drivable-lane": 0, "agent_compute-ego": 0.12459038654963175, "deviation-heading": 2.0789451327606305, "set_robot_commands": 0.0555642302831014, "deviation-center-line": 0.8508939147056557, "driven_lanedir_consec": 1.0747418735491343, "sim_compute_sim_state": 0.0243882950146993, "sim_compute_performance-ego": 0.03978006521860759, "sim_compute_robot_state-ego": 0.04103028217951456}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8257154880953131, "sim_physics": 0.05661429933539019, "survival_time": 10.650000000000016, "driven_lanedir": 0.6669629561151792, "sim_render-ego": 0.04042156649307466, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.12433633334200148, "deviation-heading": 1.8787843619783744, "set_robot_commands": 0.05549490507779547, "deviation-center-line": 0.361621453791084, "driven_lanedir_consec": 0.6669629561151792, "sim_compute_sim_state": 0.02356605910359414, "sim_compute_performance-ego": 0.04027161575818845, "sim_compute_robot_state-ego": 0.04232074621137879}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19319242538978615, "sim_physics": 0.05769525076213636, "survival_time": 2.849999999999998, "driven_lanedir": 0.1771457454437826, "sim_render-ego": 0.035763648518344814, "in-drivable-lane": 0, "agent_compute-ego": 0.12394006628739208, "deviation-heading": 1.0799516136348926, "set_robot_commands": 0.055745743868643775, "deviation-center-line": 0.3073183948696125, "driven_lanedir_consec": 0.1771457454437826, "sim_compute_sim_state": 0.02383069406475937, "sim_compute_performance-ego": 0.04034789821557831, "sim_compute_robot_state-ego": 0.040463991332472415}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.30258520045133747, "sim_physics": 0.060721653479116934, "survival_time": 4.049999999999994, "driven_lanedir": 0.24448259302480757, "sim_render-ego": 0.036864392551375025, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.12499146108274106, "deviation-heading": 1.995238934450004, "set_robot_commands": 0.055282551565288024, "deviation-center-line": 0.28047991410230216, "driven_lanedir_consec": 0.24448259302480757, "sim_compute_sim_state": 0.02360075785789961, "sim_compute_performance-ego": 0.04094513551688489, "sim_compute_robot_state-ego": 0.041194771542961216}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3912360782722368, "sim_physics": 0.05727074032738095, "survival_time": 5.249999999999989, "driven_lanedir": 0.3469843068996177, "sim_render-ego": 0.03698038827805292, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1273355029878162, "deviation-heading": 1.8059723281876945, "set_robot_commands": 0.05782610575358073, "deviation-center-line": 0.29045514475233897, "driven_lanedir_consec": 0.3469843068996177, "sim_compute_sim_state": 0.02385658763703846, "sim_compute_performance-ego": 0.040279293060302736, "sim_compute_robot_state-ego": 0.04362854957580566}}
set_robot_commands_max0.05782610575358073
set_robot_commands_mean0.05598270730968188
set_robot_commands_median0.0555642302831014
set_robot_commands_min0.055282551565288024
sim_compute_performance-ego_max0.04094513551688489
sim_compute_performance-ego_mean0.0403248015539124
sim_compute_performance-ego_median0.040279293060302736
sim_compute_performance-ego_min0.03978006521860759
sim_compute_robot_state-ego_max0.04362854957580566
sim_compute_robot_state-ego_mean0.04172766816842653
sim_compute_robot_state-ego_median0.041194771542961216
sim_compute_robot_state-ego_min0.040463991332472415
sim_compute_sim_state_max0.0243882950146993
sim_compute_sim_state_mean0.02384847873559818
sim_compute_sim_state_median0.02383069406475937
sim_compute_sim_state_min0.02356605910359414
sim_physics_max0.060721653479116934
sim_physics_mean0.05834373247739912
sim_physics_median0.05769525076213636
sim_physics_min0.05661429933539019
sim_render-ego_max0.04042156649307466
sim_render-ego_mean0.037503416300229214
sim_render-ego_median0.03698038827805292
sim_render-ego_min0.035763648518344814
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.550000000000014
survival_time_min2.849999999999998
214623160aklebanPython templateaido2-AMOD-service_qualitystep1-simulationsuccessyes8450:03:06(hidden)
other stats
passedtrue
214453148JBRRussiachallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno8450:22:30(hidden)
driven_lanedir_consec_median0.9914518035561424
survival_time_median7.199999999999982
deviation-center-line_median0.5482174238357636
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.06154879279758619
agent_compute-ego_mean0.05866214724490917
agent_compute-ego_median0.058969167868296306
agent_compute-ego_min0.05473165273666382
deviation-center-line_max1.1549293248363104
deviation-center-line_mean0.6560872343499965
deviation-center-line_min0.27566649158998696
deviation-heading_max5.22185776945057
deviation-heading_mean2.3124316949010417
deviation-heading_median1.621570465411234
deviation-heading_min0.4978438120666323
driven_any_max2.3489924079737317
driven_any_mean1.2679604101163109
driven_any_median1.1035277340316625
driven_any_min0.3642178234482664
driven_lanedir_consec_max1.9639129987932065
driven_lanedir_consec_mean0.9569362144302236
driven_lanedir_consec_min0.2938457271940503
driven_lanedir_max2.1132242040932425
driven_lanedir_mean1.0820033214890112
driven_lanedir_median1.043575427009693
driven_lanedir_min0.35626751354370434
in-drivable-lane_max2.8500000000000405
in-drivable-lane_mean0.5633333333333372
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.341401142888106, "sim_physics": 0.06445955673853557, "survival_time": 14.950000000000076, "driven_lanedir": 1.910409896713289, "sim_render-ego": 0.03793974955876668, "in-drivable-lane": 1.100000000000005, "agent_compute-ego": 0.058969167868296306, "deviation-heading": 5.22185776945057, "set_robot_commands": 0.05665533542633057, "deviation-center-line": 1.1549293248363104, "driven_lanedir_consec": 0.9914518035561424, "sim_compute_sim_state": 0.02473978996276855, "sim_compute_performance-ego": 0.04130259116490682, "sim_compute_robot_state-ego": 0.04279916365941366}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6614334363496972, "sim_physics": 0.06691499506489615, "survival_time": 4.449999999999992, "driven_lanedir": 0.4640934824743561, "sim_render-ego": 0.03850770532415154, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.0595972484417176, "deviation-heading": 2.1621026545427737, "set_robot_commands": 0.055251266179459815, "deviation-center-line": 0.3875508947793393, "driven_lanedir_consec": 0.2938457271940503, "sim_compute_sim_state": 0.024468660354614254, "sim_compute_performance-ego": 0.04134774475954891, "sim_compute_robot_state-ego": 0.04301087775926912}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3642178234482664, "sim_physics": 0.06487685441970825, "survival_time": 2.5999999999999988, "driven_lanedir": 0.35626751354370434, "sim_render-ego": 0.037158007805164046, "in-drivable-lane": 0, "agent_compute-ego": 0.05843996543150682, "deviation-heading": 0.4978438120666323, "set_robot_commands": 0.05569258561501136, "deviation-center-line": 0.27566649158998696, "driven_lanedir_consec": 0.35626751354370434, "sim_compute_sim_state": 0.024899941224318285, "sim_compute_performance-ego": 0.0424469388448275, "sim_compute_robot_state-ego": 0.04224674976789034}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1035277340316625, "sim_physics": 0.06722839507791731, "survival_time": 7.199999999999982, "driven_lanedir": 1.043575427009693, "sim_render-ego": 0.037779261668523155, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05660428603490194, "deviation-heading": 1.5274060299708705, "set_robot_commands": 0.05580153730180529, "deviation-center-line": 0.634358446664162, "driven_lanedir_consec": 1.043575427009693, "sim_compute_sim_state": 0.02463195224603017, "sim_compute_performance-ego": 0.041647871335347496, "sim_compute_robot_state-ego": 0.043010744783613414}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2963448385328344, "sim_physics": 0.06186861509368533, "survival_time": 8.399999999999984, "driven_lanedir": 1.1268758095828502, "sim_render-ego": 0.03802173478262765, "in-drivable-lane": 0.4000000000000048, "agent_compute-ego": 0.060507457880746754, "deviation-heading": 2.4791529897198132, "set_robot_commands": 0.05557915852183387, "deviation-center-line": 0.46184479555842567, "driven_lanedir_consec": 1.1268758095828502, "sim_compute_sim_state": 0.025056095350356328, "sim_compute_performance-ego": 0.041422506173451744, "sim_compute_robot_state-ego": 0.04387692326591128}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348852620013533, "sim_physics": 0.0639325992266337, "survival_time": 14.950000000000076, "driven_lanedir": 1.7431548850278498, "sim_render-ego": 0.03774898131688436, "in-drivable-lane": 2.4000000000000075, "agent_compute-ego": 0.058240938981374106, "deviation-heading": 4.788984007078123, "set_robot_commands": 0.05512742837270101, "deviation-center-line": 1.033990625937084, "driven_lanedir_consec": 1.2058766617957308, "sim_compute_sim_state": 0.024862957795461015, "sim_compute_performance-ego": 0.04153526782989502, "sim_compute_robot_state-ego": 0.043649100462595625}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7579564038770219, "sim_physics": 0.060833765728638904, "survival_time": 5.04999999999999, "driven_lanedir": 0.6949633516763912, "sim_render-ego": 0.03755519177654002, "in-drivable-lane": 0, "agent_compute-ego": 0.05965355599280631, "deviation-heading": 1.5306961654978168, "set_robot_commands": 0.05488526230991477, "deviation-center-line": 0.3096478467765337, "driven_lanedir_consec": 0.6949633516763912, "sim_compute_sim_state": 0.02439521326877103, "sim_compute_performance-ego": 0.04096208232464177, "sim_compute_robot_state-ego": 0.04255768096092904}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5374374128862014, "sim_physics": 0.06334417757361827, "survival_time": 9.900000000000006, "driven_lanedir": 1.359438187508489, "sim_render-ego": 0.037913763161861534, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0603054328398271, "deviation-heading": 2.5980013889217637, "set_robot_commands": 0.05467716371170198, "deviation-center-line": 0.9298986577524728, "driven_lanedir_consec": 1.359438187508489, "sim_compute_sim_state": 0.025032558826485064, "sim_compute_performance-ego": 0.04248077821249914, "sim_compute_robot_state-ego": 0.04282891148268574}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4249683891755474, "sim_physics": 0.060494465672451515, "survival_time": 9.199999999999996, "driven_lanedir": 1.3956472004325238, "sim_render-ego": 0.037342764761136925, "in-drivable-lane": 0, "agent_compute-ego": 0.05576889022536899, "deviation-heading": 1.621570465411234, "set_robot_commands": 0.05504650136698847, "deviation-center-line": 0.9126230182500316, "driven_lanedir_consec": 1.3956472004325238, "sim_compute_sim_state": 0.02457206145576809, "sim_compute_performance-ego": 0.0410524308681488, "sim_compute_robot_state-ego": 0.04270218377527983}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5008166923158887, "sim_physics": 0.0618967284326968, "survival_time": 3.4499999999999957, "driven_lanedir": 0.4458441241922335, "sim_render-ego": 0.03788173025932865, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06154879279758619, "deviation-heading": 0.7591340945096213, "set_robot_commands": 0.05439400327378425, "deviation-center-line": 0.29795337218661855, "driven_lanedir_consec": 0.4458441241922335, "sim_compute_sim_state": 0.02485956316408904, "sim_compute_performance-ego": 0.040931411411451256, "sim_compute_robot_state-ego": 0.042496774507605514}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7338793017752316, "sim_physics": 0.06467451611343696, "survival_time": 4.899999999999991, "driven_lanedir": 0.7261903220114927, "sim_render-ego": 0.03753080416698845, "in-drivable-lane": 0, "agent_compute-ego": 0.06019243415521116, "deviation-heading": 0.5849673074380232, "set_robot_commands": 0.061560689186563294, "deviation-center-line": 0.5482174238357636, "driven_lanedir_consec": 0.7261903220114927, "sim_compute_sim_state": 0.024547095201453383, "sim_compute_performance-ego": 0.04084647188381273, "sim_compute_robot_state-ego": 0.04291250267807318}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5008191431794814, "sim_physics": 0.06412624967271004, "survival_time": 3.4499999999999957, "driven_lanedir": 0.44722153824804034, "sim_render-ego": 0.03775756946508435, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06090278556381447, "deviation-heading": 0.7920243769762986, "set_robot_commands": 0.055588632390119026, "deviation-center-line": 0.29627888798551183, "driven_lanedir_consec": 0.44722153824804034, "sim_compute_sim_state": 0.02430491516555565, "sim_compute_performance-ego": 0.040826966797096145, "sim_compute_robot_state-ego": 0.04262080399886421}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.3489924079737317, "sim_physics": 0.0606184728940328, "survival_time": 14.950000000000076, "driven_lanedir": 2.1132242040932425, "sim_render-ego": 0.037612547079722086, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.05731197198232015, "deviation-heading": 4.796992706882113, "set_robot_commands": 0.054840238094329835, "deviation-center-line": 1.106000759837224, "driven_lanedir_consec": 1.9639129987932065, "sim_compute_sim_state": 0.024397624333699543, "sim_compute_performance-ego": 0.04205873727798462, "sim_compute_robot_state-ego": 0.04268139123916626}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7499498946440516, "sim_physics": 0.061876151561737064, "survival_time": 4.99999999999999, "driven_lanedir": 0.736007772718966, "sim_render-ego": 0.037626523971557614, "in-drivable-lane": 0, "agent_compute-ego": 0.05473165273666382, "deviation-heading": 0.8542178431466543, "set_robot_commands": 0.05538791179656982, "deviation-center-line": 0.4484620184176361, "driven_lanedir_consec": 0.736007772718966, "sim_compute_sim_state": 0.024517600536346437, "sim_compute_performance-ego": 0.04120627641677856, "sim_compute_robot_state-ego": 0.042646360397338864}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.348808910653408, "sim_physics": 0.06421884934107462, "survival_time": 14.950000000000076, "driven_lanedir": 1.6671361071020454, "sim_render-ego": 0.03776227871576945, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.05715762774149577, "deviation-heading": 4.471523811903315, "set_robot_commands": 0.0556183115641276, "deviation-center-line": 1.043885950842846, "driven_lanedir_consec": 1.566924778189836, "sim_compute_sim_state": 0.024765522480010987, "sim_compute_performance-ego": 0.04098934014638265, "sim_compute_robot_state-ego": 0.04246569474538167}}
set_robot_commands_max0.061560689186563294
set_robot_commands_mean0.05574040167408272
set_robot_commands_median0.05538791179656982
set_robot_commands_min0.05439400327378425
sim_compute_performance-ego_max0.04248077821249914
sim_compute_performance-ego_mean0.041403827696451546
sim_compute_performance-ego_median0.04130259116490682
sim_compute_performance-ego_min0.040826966797096145
sim_compute_robot_state-ego_max0.04387692326591128
sim_compute_robot_state-ego_mean0.04283372423226785
sim_compute_robot_state-ego_median0.04270218377527983
sim_compute_robot_state-ego_min0.04224674976789034
sim_compute_sim_state_max0.025056095350356328
sim_compute_sim_state_mean0.02467010342438186
sim_compute_sim_state_median0.02463195224603017
sim_compute_sim_state_min0.02430491516555565
sim_physics_max0.06722839507791731
sim_physics_mean0.0634242928407849
sim_physics_median0.0639325992266337
sim_physics_min0.060494465672451515
sim_render-ego_max0.03850770532415154
sim_render-ego_mean0.03774257425427377
sim_render-ego_median0.03775756946508435
sim_render-ego_min0.037158007805164046
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.22666666666668
survival_time_min2.5999999999999988
214353145AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessno8450:18:34(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.11971490822949456
agent_compute-ego_mean0.09815898108472054
agent_compute-ego_median0.09195340156555176
agent_compute-ego_min0.08757725587257972
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.13716640653489512, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.049434037148198, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11042831215677382, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.06784438181527053, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.0282882346382624, "sim_compute_performance-ego": 0.04825026174134846, "sim_compute_robot_state-ego": 0.05489301983314224, "sim_compute_robot_state-npc0": 0.050183389760270904, "sim_compute_robot_state-npc1": 0.05031887790824793, "sim_compute_robot_state-npc2": 0.04935928839671461, "sim_compute_robot_state-npc3": 0.04906127724466445}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1385188102722168, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.042606311185019355, "in-drivable-lane": 0, "agent_compute-ego": 0.10849771329334804, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06800764799118042, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.028542748519352505, "sim_compute_performance-ego": 0.044943502971104214, "sim_compute_robot_state-ego": 0.04970212493624006, "sim_compute_robot_state-npc0": 0.04953763314655849, "sim_compute_robot_state-npc1": 0.04815731729779925, "sim_compute_robot_state-npc2": 0.04793615000588553, "sim_compute_robot_state-npc3": 0.048108109406062534}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.14176954112006623, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04769153270906615, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11971490822949456, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07282648966150376, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.031014572069482896, "sim_compute_performance-ego": 0.05034355052466531, "sim_compute_robot_state-ego": 0.052476429244846974, "sim_compute_robot_state-npc0": 0.05616254482454466, "sim_compute_robot_state-npc1": 0.054611449102753576, "sim_compute_robot_state-npc2": 0.05428511425129418, "sim_compute_robot_state-npc3": 0.053967739771870735}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.14928274850050607, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.047462448477745056, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11722981929779051, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07265906035900116, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03250265618165334, "sim_compute_performance-ego": 0.05518214901288351, "sim_compute_robot_state-ego": 0.05518616239229838, "sim_compute_robot_state-npc0": 0.053940470019976296, "sim_compute_robot_state-npc1": 0.054489120841026306, "sim_compute_robot_state-npc2": 0.05384333928426107, "sim_compute_robot_state-npc3": 0.05585878590742747}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1471715995243617, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04498370488484701, "in-drivable-lane": 0, "agent_compute-ego": 0.11081417401631671, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.06951508067903064, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03211193992978051, "sim_compute_performance-ego": 0.048916532879783994, "sim_compute_robot_state-ego": 0.05034615879967099, "sim_compute_robot_state-npc0": 0.048187914348783945, "sim_compute_robot_state-npc1": 0.050111884162539526, "sim_compute_robot_state-npc2": 0.056607019333612354, "sim_compute_robot_state-npc3": 0.053315741675240655}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.11579566944145156, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.03919615145928845, "in-drivable-lane": 2, "agent_compute-ego": 0.09662273544037414, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.05854253283517803, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.025399495027736276, "sim_compute_performance-ego": 0.04209602949861995, "sim_compute_robot_state-ego": 0.04317239373030063, "sim_compute_robot_state-npc0": 0.044149483035424514, "sim_compute_robot_state-npc1": 0.043637858179514995, "sim_compute_robot_state-npc2": 0.043894092479865705, "sim_compute_robot_state-npc3": 0.0430588907824305}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.11358720122031796, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.0373881765939657, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08918102505137619, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.05960192958128105, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02383641594821967, "sim_compute_performance-ego": 0.04021765884843845, "sim_compute_robot_state-ego": 0.04148388371884244, "sim_compute_robot_state-npc0": 0.04156775613432949, "sim_compute_robot_state-npc1": 0.04079631925786583, "sim_compute_robot_state-npc2": 0.04060621863429986, "sim_compute_robot_state-npc3": 0.041048360102384995}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.12102121829986572, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.03718843460083008, "in-drivable-lane": 0, "agent_compute-ego": 0.08922771453857421, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.055349264144897464, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.02369203567504883, "sim_compute_performance-ego": 0.03977834701538086, "sim_compute_robot_state-ego": 0.0471280574798584, "sim_compute_robot_state-npc0": 0.04121835708618164, "sim_compute_robot_state-npc1": 0.040769615173339845, "sim_compute_robot_state-npc2": 0.04189007759094238, "sim_compute_robot_state-npc3": 0.04087158203125}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.10525366893181434, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03752008768228384, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0897532793191763, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.05545299328290499, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.02386924853691688, "sim_compute_performance-ego": 0.040302203251765326, "sim_compute_robot_state-ego": 0.04553395968217116, "sim_compute_robot_state-npc0": 0.0411489330805265, "sim_compute_robot_state-npc1": 0.040959408650031455, "sim_compute_robot_state-npc2": 0.04083969501348642, "sim_compute_robot_state-npc3": 0.04099723008962778}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.12932024552271917, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03963512640732985, "in-drivable-lane": 0, "agent_compute-ego": 0.09599724182715784, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.0557262714092548, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.024259172953092135, "sim_compute_performance-ego": 0.03999800865466778, "sim_compute_robot_state-ego": 0.04136202885554387, "sim_compute_robot_state-npc0": 0.04116739676548885, "sim_compute_robot_state-npc1": 0.04088598031264085, "sim_compute_robot_state-npc2": 0.04072228761819693, "sim_compute_robot_state-npc3": 0.04085811284872202}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.11604588682001288, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.03785796598954634, "in-drivable-lane": 0, "agent_compute-ego": 0.08914517272602428, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.05484531142494895, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.02391176873987371, "sim_compute_performance-ego": 0.04005954482338645, "sim_compute_robot_state-ego": 0.04129953817887739, "sim_compute_robot_state-npc0": 0.0410001819783991, "sim_compute_robot_state-npc1": 0.04079794883728027, "sim_compute_robot_state-npc2": 0.04049401933496648, "sim_compute_robot_state-npc3": 0.041112661361694336}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.10475720882415772, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.037283315658569335, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.09195340156555176, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.05580208778381348, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.024075517654418944, "sim_compute_performance-ego": 0.03999893188476562, "sim_compute_robot_state-ego": 0.0414771318435669, "sim_compute_robot_state-npc0": 0.04137904167175293, "sim_compute_robot_state-npc1": 0.041015911102294925, "sim_compute_robot_state-npc2": 0.04076975822448731, "sim_compute_robot_state-npc3": 0.05052807807922363}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.1098555123552363, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.03742308819547613, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08825405861469025, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.05569633270831818, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.024011010819293084, "sim_compute_performance-ego": 0.0407095361263194, "sim_compute_robot_state-ego": 0.04143683200186871, "sim_compute_robot_state-npc0": 0.04115035432450315, "sim_compute_robot_state-npc1": 0.04096870219453852, "sim_compute_robot_state-npc2": 0.04064765382320323, "sim_compute_robot_state-npc3": 0.0409841740385015}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10726426197932316, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.03704586854347816, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.08757725587257972, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.05510913408719576, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.02370785749875582, "sim_compute_performance-ego": 0.039516875377068154, "sim_compute_robot_state-ego": 0.04114452233681312, "sim_compute_robot_state-npc0": 0.04122254481682411, "sim_compute_robot_state-npc1": 0.04182015932523287, "sim_compute_robot_state-npc2": 0.04019270951931293, "sim_compute_robot_state-npc3": 0.040635342781360335}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.10714112463451568, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03743889899480911, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.08798790432157971, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.054805814652215866, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02387214842296782, "sim_compute_performance-ego": 0.039737126940772645, "sim_compute_robot_state-ego": 0.04123052869524275, "sim_compute_robot_state-npc0": 0.04150993937537784, "sim_compute_robot_state-npc1": 0.041583801451183504, "sim_compute_robot_state-npc2": 0.040452371324811665, "sim_compute_robot_state-npc3": 0.0406380744207473}}
set_robot_commands_max0.07282648966150376
set_robot_commands_mean0.06078562216106634
set_robot_commands_median0.05580208778381348
set_robot_commands_min0.054805814652215866
sim_compute_performance-ego_max0.05518214901288351
sim_compute_performance-ego_mean0.04333668397006469
sim_compute_performance-ego_median0.040302203251765326
sim_compute_performance-ego_min0.039516875377068154
sim_compute_robot_state-ego_max0.05518616239229838
sim_compute_robot_state-ego_mean0.04585818478195228
sim_compute_robot_state-ego_median0.04317239373030063
sim_compute_robot_state-ego_min0.04114452233681312
sim_compute_robot_state-npc0_max0.05616254482454466
sim_compute_robot_state-npc0_mean0.04490172935792948
sim_compute_robot_state-npc0_median0.04150993937537784
sim_compute_robot_state-npc0_min0.0410001819783991
sim_compute_robot_state-npc1_max0.054611449102753576
sim_compute_robot_state-npc1_mean0.04472829025308597
sim_compute_robot_state-npc1_median0.041583801451183504
sim_compute_robot_state-npc1_min0.040769615173339845
sim_compute_robot_state-npc2_max0.056607019333612354
sim_compute_robot_state-npc2_mean0.044835986322356046
sim_compute_robot_state-npc2_median0.04083969501348642
sim_compute_robot_state-npc2_min0.04019270951931293
sim_compute_robot_state-npc3_max0.05585878590742747
sim_compute_robot_state-npc3_mean0.04540294403608056
sim_compute_robot_state-npc3_median0.041112661361694336
sim_compute_robot_state-npc3_min0.040635342781360335
sim_compute_sim_state_max0.03250265618165334
sim_compute_sim_state_mean0.026206321507656987
sim_compute_sim_state_median0.024075517654418944
sim_compute_sim_state_min0.02369203567504883
sim_physics_max0.14928274850050607
sim_physics_mean0.12293007359876404
sim_physics_median0.11604588682001288
sim_physics_min0.10475720882415772
sim_render-ego_max0.049434037148198
sim_render-ego_mean0.040677009902030166
sim_render-ego_median0.03785796598954634
sim_render-ego_min0.03704586854347816
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
214333134AmaurXPredictorLastaido2-PREDstep1-simulationsuccessyes8450:00:32(hidden)
error_L10.1053066938706594
error_L20.017717307653598375


214233125RamiNaim[0.35;0.75]aido2-LF-sim-validationstep1-simulationsuccessno8450:08:21(hidden)
driven_lanedir_consec_median1.6382908517619432
survival_time_median8.449999999999985
deviation-center-line_median0.7020216560985275
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.08101122796872241
agent_compute-ego_mean0.0790298765949238
agent_compute-ego_median0.08066507345120583
agent_compute-ego_min0.07583670117961827
deviation-center-line_max1.2921377241268523
deviation-center-line_mean0.692052188588834
deviation-center-line_min0.29412523591806844
deviation-heading_max4.313266459456157
deviation-heading_mean1.757179783008871
deviation-heading_median1.3658461538318751
deviation-heading_min0.30887069722993316
driven_any_max3.5746669592804254
driven_any_mean1.884824617175888
driven_any_median1.984995159214791
driven_any_min0.7376871652879832
driven_lanedir_consec_max2.8135482799771823
driven_lanedir_consec_mean1.587722210748803
driven_lanedir_consec_min0.734468095924476
driven_lanedir_max2.8135482799771823
driven_lanedir_mean1.587722210748803
driven_lanedir_median1.6382908517619432
driven_lanedir_min0.734468095924476
in-drivable-lane_max2.10000000000003
in-drivable-lane_mean0.8500000000000073
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0711695681860216, "sim_physics": 0.0645474579374669, "survival_time": 8.84999999999999, "driven_lanedir": 1.6382908517619432, "sim_render-ego": 0.03832734506682488, "in-drivable-lane": 1.3500000000000094, "agent_compute-ego": 0.08101122796872241, "deviation-heading": 1.740696182229741, "set_robot_commands": 0.056248713347871425, "deviation-center-line": 0.7020216560985275, "driven_lanedir_consec": 1.6382908517619432, "sim_compute_sim_state": 0.02506750316943153, "sim_compute_performance-ego": 0.04151254993374065, "sim_compute_robot_state-ego": 0.042759919570664225}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.055604233910218, "sim_physics": 0.059761129399781586, "survival_time": 4.6499999999999915, "driven_lanedir": 0.8124942431886749, "sim_render-ego": 0.039442508451400266, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07695396997595347, "deviation-heading": 1.057219422296649, "set_robot_commands": 0.056086832477200414, "deviation-center-line": 0.29412523591806844, "driven_lanedir_consec": 0.8124942431886749, "sim_compute_sim_state": 0.024654583264422672, "sim_compute_performance-ego": 0.04113680316555885, "sim_compute_robot_state-ego": 0.04341783062104256}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7376871652879832, "sim_physics": 0.061543325879680574, "survival_time": 3.349999999999996, "driven_lanedir": 0.734468095924476, "sim_render-ego": 0.03810662653908801, "in-drivable-lane": 0, "agent_compute-ego": 0.07583670117961827, "deviation-heading": 0.30887069722993316, "set_robot_commands": 0.056801361824149514, "deviation-center-line": 0.3781987713890312, "driven_lanedir_consec": 0.734468095924476, "sim_compute_sim_state": 0.025115347620266588, "sim_compute_performance-ego": 0.04177557888315685, "sim_compute_robot_state-ego": 0.0432794841367807}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.5746669592804254, "sim_physics": 0.0647878352801005, "survival_time": 14.950000000000076, "driven_lanedir": 2.8135482799771823, "sim_render-ego": 0.0379798690478007, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.08068241039911905, "deviation-heading": 4.313266459456157, "set_robot_commands": 0.05626055717468262, "deviation-center-line": 1.2921377241268523, "driven_lanedir_consec": 2.8135482799771823, "sim_compute_sim_state": 0.02481385707855225, "sim_compute_performance-ego": 0.04135525465011597, "sim_compute_robot_state-ego": 0.0425331711769104}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.984995159214791, "sim_physics": 0.06149942917231272, "survival_time": 8.449999999999985, "driven_lanedir": 1.939809582891738, "sim_render-ego": 0.03816461845262517, "in-drivable-lane": 0, "agent_compute-ego": 0.08066507345120583, "deviation-heading": 1.3658461538318751, "set_robot_commands": 0.055588699656830734, "deviation-center-line": 0.7937775554116906, "driven_lanedir_consec": 1.939809582891738, "sim_compute_sim_state": 0.025090757911727272, "sim_compute_performance-ego": 0.04139789462794919, "sim_compute_robot_state-ego": 0.04296076227221968}}
set_robot_commands_max0.056801361824149514
set_robot_commands_mean0.05619723289614694
set_robot_commands_median0.056248713347871425
set_robot_commands_min0.055588699656830734
sim_compute_performance-ego_max0.04177557888315685
sim_compute_performance-ego_mean0.041435616252104304
sim_compute_performance-ego_median0.04139789462794919
sim_compute_performance-ego_min0.04113680316555885
sim_compute_robot_state-ego_max0.04341783062104256
sim_compute_robot_state-ego_mean0.04299023355552352
sim_compute_robot_state-ego_median0.04296076227221968
sim_compute_robot_state-ego_min0.0425331711769104
sim_compute_sim_state_max0.025115347620266588
sim_compute_sim_state_mean0.024948409808880054
sim_compute_sim_state_median0.02506750316943153
sim_compute_sim_state_min0.024654583264422672
sim_physics_max0.0647878352801005
sim_physics_mean0.06242783553386846
sim_physics_median0.061543325879680574
sim_physics_min0.059761129399781586
sim_render-ego_max0.039442508451400266
sim_render-ego_mean0.03840419351154781
sim_render-ego_median0.03816461845262517
sim_render-ego_min0.0379798690478007
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.050000000000008
survival_time_min3.349999999999996
214213123RamiNaim[1;0.6]aido2-LF-sim-validationstep1-simulationsuccessno8450:11:27(hidden)
driven_lanedir_consec_median2.2971398688438205
survival_time_median14.950000000000076
deviation-center-line_median1.1289689758008865
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08119676828384399
agent_compute-ego_mean0.07893367324645388
agent_compute-ego_median0.07868190134985972
agent_compute-ego_min0.07632166862487794
deviation-center-line_max1.2949626659874092
deviation-center-line_mean0.9900846509881448
deviation-center-line_min0.20106101588658865
deviation-heading_max2.2295920528984157
deviation-heading_mean1.733705473844407
deviation-heading_median1.712046308821216
deviation-heading_min0.980636829679724
driven_any_max2.349162072670132
driven_any_mean1.879913989190915
driven_any_median2.3414919915972088
driven_any_min0.4204689020510484
driven_lanedir_consec_max2.32206871678619
driven_lanedir_consec_mean1.7969747825970674
driven_lanedir_consec_min0.3958672443061859
driven_lanedir_max2.32206871678619
driven_lanedir_mean1.7969747825970674
driven_lanedir_median2.2971398688438205
driven_lanedir_min0.3958672443061859
in-drivable-lane_max1.450000000000018
in-drivable-lane_mean0.2900000000000036
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3414919915972088, "sim_physics": 0.05834760983784994, "survival_time": 14.950000000000076, "driven_lanedir": 2.2997161357760287, "sim_render-ego": 0.037949021657307944, "in-drivable-lane": 0, "agent_compute-ego": 0.08031742970148723, "deviation-heading": 2.2295920528984157, "set_robot_commands": 0.05686974684397379, "deviation-center-line": 1.2638245341358152, "driven_lanedir_consec": 2.2997161357760287, "sim_compute_sim_state": 0.024550413290659587, "sim_compute_performance-ego": 0.040843342940012614, "sim_compute_robot_state-ego": 0.04269713719685873}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.349162072670132, "sim_physics": 0.059401676654815674, "survival_time": 14.950000000000076, "driven_lanedir": 2.2971398688438205, "sim_render-ego": 0.03730950673421224, "in-drivable-lane": 0, "agent_compute-ego": 0.07632166862487794, "deviation-heading": 2.1528379003660305, "set_robot_commands": 0.057263902028401696, "deviation-center-line": 1.2949626659874092, "driven_lanedir_consec": 2.2971398688438205, "sim_compute_sim_state": 0.02466272036234538, "sim_compute_performance-ego": 0.04097137451171875, "sim_compute_robot_state-ego": 0.04277988354365031}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9393124185136716, "sim_physics": 0.06160917109058749, "survival_time": 12.40000000000004, "driven_lanedir": 1.6700819472731117, "sim_render-ego": 0.03704632770630621, "in-drivable-lane": 1.450000000000018, "agent_compute-ego": 0.07815059827220056, "deviation-heading": 1.712046308821216, "set_robot_commands": 0.05981907921452676, "deviation-center-line": 1.1289689758008865, "driven_lanedir_consec": 1.6700819472731117, "sim_compute_sim_state": 0.024828074439879385, "sim_compute_performance-ego": 0.040704193615144296, "sim_compute_robot_state-ego": 0.04289096017037669}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4204689020510484, "sim_physics": 0.0642391786736957, "survival_time": 2.9499999999999975, "driven_lanedir": 0.3958672443061859, "sim_render-ego": 0.03792144080339852, "in-drivable-lane": 0, "agent_compute-ego": 0.07868190134985972, "deviation-heading": 0.980636829679724, "set_robot_commands": 0.05740311186192399, "deviation-center-line": 0.20106101588658865, "driven_lanedir_consec": 0.3958672443061859, "sim_compute_sim_state": 0.02496391231730833, "sim_compute_performance-ego": 0.04098071486262952, "sim_compute_robot_state-ego": 0.042814234555777854}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491345611225145, "sim_physics": 0.06322062174479166, "survival_time": 14.950000000000076, "driven_lanedir": 2.32206871678619, "sim_render-ego": 0.03741543134053548, "in-drivable-lane": 0, "agent_compute-ego": 0.08119676828384399, "deviation-heading": 1.593414277456649, "set_robot_commands": 0.056598188877105715, "deviation-center-line": 1.0616060631300237, "driven_lanedir_consec": 2.32206871678619, "sim_compute_sim_state": 0.02468753735224406, "sim_compute_performance-ego": 0.041606345971425374, "sim_compute_robot_state-ego": 0.04342292467753092}}
set_robot_commands_max0.05981907921452676
set_robot_commands_mean0.05759080576518638
set_robot_commands_median0.057263902028401696
set_robot_commands_min0.056598188877105715
sim_compute_performance-ego_max0.041606345971425374
sim_compute_performance-ego_mean0.04102119438018611
sim_compute_performance-ego_median0.04097137451171875
sim_compute_performance-ego_min0.040704193615144296
sim_compute_robot_state-ego_max0.04342292467753092
sim_compute_robot_state-ego_mean0.042921028028838897
sim_compute_robot_state-ego_median0.042814234555777854
sim_compute_robot_state-ego_min0.04269713719685873
sim_compute_sim_state_max0.02496391231730833
sim_compute_sim_state_mean0.02473853155248735
sim_compute_sim_state_median0.02468753735224406
sim_compute_sim_state_min0.024550413290659587
sim_physics_max0.0642391786736957
sim_physics_mean0.06136365160034809
sim_physics_median0.06160917109058749
sim_physics_min0.05834760983784994
sim_render-ego_max0.037949021657307944
sim_render-ego_mean0.03752834564835208
sim_render-ego_median0.03741543134053548
sim_render-ego_min0.03704632770630621
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.040000000000054
survival_time_min2.9499999999999975
213872377Liam Paullminimal_agent_python2 (Python 2)aido2-LFV-sim-testingstep1-simulationsuccessno8450:25:54(hidden)
driven_lanedir_consec_median0.4295977528045558
survival_time_median3.7499999999999942
deviation-center-line_median0.16525966154163726
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.0770364387615307
agent_compute-ego_mean0.057509734431385746
agent_compute-ego_median0.06015277562076098
agent_compute-ego_min0.038903943953975555
deviation-center-line_max0.44830395948846297
deviation-center-line_mean0.17891237550140934
deviation-center-line_min0.10012774388669717
deviation-heading_max1.272726254754917
deviation-heading_mean0.5883512828498624
deviation-heading_median0.5156622477370731
deviation-heading_min0.2495279988048577
driven_any_max2.0298273185719493
driven_any_mean1.0098349503422042
driven_any_median1.0248273191286312
driven_any_min0.3648701917101209
driven_lanedir_consec_max1.211071354427033
driven_lanedir_consec_mean0.6125599618319294
driven_lanedir_consec_min0.32721267753615213
driven_lanedir_max1.211071354427033
driven_lanedir_mean0.6125599618319294
driven_lanedir_median0.4295977528045558
driven_lanedir_min0.32721267753615213
in-drivable-lane_max4.249999999999985
in-drivable-lane_mean1.2033333333333296
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.16649406576809817, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.05887701086802025, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06015277562076098, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.08578889990506107, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.04021970213276066, "sim_compute_performance-ego": 0.06489077006300835, "sim_compute_robot_state-ego": 0.06835901573912738, "sim_compute_robot_state-npc0": 0.06363469933810299, "sim_compute_robot_state-npc1": 0.06378420411723934, "sim_compute_robot_state-npc2": 0.06696074302882364, "sim_compute_robot_state-npc3": 0.06793180230545671}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.23679212621740392, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.06895084638853331, "in-drivable-lane": 0, "agent_compute-ego": 0.0770364387615307, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.1064649723671578, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.04126825848141232, "sim_compute_performance-ego": 0.07771018389109019, "sim_compute_robot_state-ego": 0.08650564503025364, "sim_compute_robot_state-npc0": 0.07694942886764938, "sim_compute_robot_state-npc1": 0.07480725082191261, "sim_compute_robot_state-npc2": 0.07218692753766034, "sim_compute_robot_state-npc3": 0.07242778185251597}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.16807234500135695, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.060538098216056824, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06337783166340419, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.09137873351573944, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.0391198992729187, "sim_compute_performance-ego": 0.06647387359823499, "sim_compute_robot_state-ego": 0.07062806614807673, "sim_compute_robot_state-npc0": 0.06840919171060834, "sim_compute_robot_state-npc1": 0.06996676751545497, "sim_compute_robot_state-npc2": 0.06781424794878278, "sim_compute_robot_state-npc3": 0.06890262024743217}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.17962517482893808, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.06221624783107212, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06374616282326835, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.09468493929931096, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03873231794152941, "sim_compute_performance-ego": 0.06920555446829114, "sim_compute_robot_state-ego": 0.07623445349080223, "sim_compute_robot_state-npc0": 0.0739156688962664, "sim_compute_robot_state-npc1": 0.06972860012735639, "sim_compute_robot_state-npc2": 0.06869923642703465, "sim_compute_robot_state-npc3": 0.06818052700587682}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.1689397320151329, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.060450479388237, "in-drivable-lane": 0, "agent_compute-ego": 0.062499985098838806, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.08713975548744202, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.042455583810806274, "sim_compute_performance-ego": 0.06498999148607254, "sim_compute_robot_state-ego": 0.062368281185626984, "sim_compute_robot_state-npc0": 0.06633366644382477, "sim_compute_robot_state-npc1": 0.06776758283376694, "sim_compute_robot_state-npc2": 0.07079368829727173, "sim_compute_robot_state-npc3": 0.06837848573923111}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0548273189057833, "sim_physics": 0.15785466231308976, "survival_time": 3.8499999999999943, "driven_lanedir": 0.3963714216744775, "sim_render-ego": 0.06120649251070889, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.059113326010765965, "deviation-heading": 1.272726254754917, "set_robot_commands": 0.08587037742911995, "deviation-center-line": 0.20372147663934215, "driven_lanedir_consec": 0.3963714216744775, "sim_compute_sim_state": 0.03646212119560737, "sim_compute_performance-ego": 0.06724703157102907, "sim_compute_robot_state-ego": 0.07246013740440468, "sim_compute_robot_state-npc0": 0.06561597601159827, "sim_compute_robot_state-npc1": 0.06377976900571353, "sim_compute_robot_state-npc2": 0.06519649864791276, "sim_compute_robot_state-npc3": 0.06624502949900442}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9948273195001682, "sim_physics": 0.1759440245693677, "survival_time": 3.649999999999995, "driven_lanedir": 0.6530046235032079, "sim_render-ego": 0.06675443910572627, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06760218045482896, "deviation-heading": 0.8187446392859457, "set_robot_commands": 0.10006716479993846, "deviation-center-line": 0.19436286934102945, "driven_lanedir_consec": 0.6530046235032079, "sim_compute_sim_state": 0.03984018547894203, "sim_compute_performance-ego": 0.07263155506081777, "sim_compute_robot_state-ego": 0.07814266910291698, "sim_compute_robot_state-npc0": 0.07245215977707954, "sim_compute_robot_state-npc1": 0.06997476538566694, "sim_compute_robot_state-npc2": 0.07173074108280547, "sim_compute_robot_state-npc3": 0.07201003048517933}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.0298273185719493, "sim_physics": 0.1697346996253645, "survival_time": 7.099999999999983, "driven_lanedir": 0.741234184731216, "sim_render-ego": 0.0614470125923694, "in-drivable-lane": 4.249999999999985, "agent_compute-ego": 0.06256751779099586, "deviation-heading": 0.5416787058937298, "set_robot_commands": 0.08989927970187765, "deviation-center-line": 0.21649269357451997, "driven_lanedir_consec": 0.741234184731216, "sim_compute_sim_state": 0.03759887688596484, "sim_compute_performance-ego": 0.0697653226449456, "sim_compute_robot_state-ego": 0.07168232890921579, "sim_compute_robot_state-npc0": 0.06804483709201006, "sim_compute_robot_state-npc1": 0.06828062299271705, "sim_compute_robot_state-npc2": 0.06685630536415207, "sim_compute_robot_state-npc3": 0.06936427405182745}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0248273191286528, "sim_physics": 0.15509300549825034, "survival_time": 3.7499999999999942, "driven_lanedir": 0.38223306402252977, "sim_render-ego": 0.059717384974161784, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.060655765533447266, "deviation-heading": 0.41826512024881946, "set_robot_commands": 0.08871235847473144, "deviation-center-line": 0.14440586530294292, "driven_lanedir_consec": 0.38223306402252977, "sim_compute_sim_state": 0.03715688705444336, "sim_compute_performance-ego": 0.06764202117919922, "sim_compute_robot_state-ego": 0.07043839772542318, "sim_compute_robot_state-npc0": 0.06637500445048014, "sim_compute_robot_state-npc1": 0.06592111905415853, "sim_compute_robot_state-npc2": 0.06395225842793782, "sim_compute_robot_state-npc3": 0.06513011614481608}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4548365617710395, "sim_physics": 0.15775196616714066, "survival_time": 1.850000000000001, "driven_lanedir": 0.43889108545437505, "sim_render-ego": 0.05418775532696698, "in-drivable-lane": 0, "agent_compute-ego": 0.05582450531624459, "deviation-heading": 0.491310634741224, "set_robot_commands": 0.08836135348758183, "deviation-center-line": 0.11665316537398888, "driven_lanedir_consec": 0.43889108545437505, "sim_compute_sim_state": 0.03641741340224807, "sim_compute_performance-ego": 0.060322787310626055, "sim_compute_robot_state-ego": 0.06488250397347115, "sim_compute_robot_state-npc0": 0.06132100723885201, "sim_compute_robot_state-npc1": 0.05859699764767209, "sim_compute_robot_state-npc2": 0.060778559865178286, "sim_compute_robot_state-npc3": 0.06698071634447253}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3648701917101209, "sim_physics": 0.1362826362732918, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552145550754965, "sim_render-ego": 0.04010696564951251, "in-drivable-lane": 0, "agent_compute-ego": 0.038903943953975555, "deviation-heading": 0.5070424162880827, "set_robot_commands": 0.05669767625870243, "deviation-center-line": 0.10012774388669717, "driven_lanedir_consec": 0.34552145550754965, "sim_compute_sim_state": 0.023669865823561145, "sim_compute_performance-ego": 0.04327195690524194, "sim_compute_robot_state-ego": 0.04535386639256631, "sim_compute_robot_state-npc0": 0.04452142407817225, "sim_compute_robot_state-npc1": 0.043201161969092586, "sim_compute_robot_state-npc2": 0.04280662536621094, "sim_compute_robot_state-npc3": 0.042487082942839594}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4098472254790875, "sim_physics": 0.11677187330582564, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054410153244894, "sim_render-ego": 0.04550180014441995, "in-drivable-lane": 0, "agent_compute-ego": 0.0450287706711713, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.06455503491794362, "deviation-center-line": 0.16731811540993266, "driven_lanedir_consec": 0.4054410153244894, "sim_compute_sim_state": 0.028836762203889733, "sim_compute_performance-ego": 0.05008278874789968, "sim_compute_robot_state-ego": 0.051323343725765455, "sim_compute_robot_state-npc0": 0.05475797372705797, "sim_compute_robot_state-npc1": 0.050678463543162626, "sim_compute_robot_state-npc2": 0.05079302367042093, "sim_compute_robot_state-npc3": 0.048697710037231445}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0248273191286312, "sim_physics": 0.10872913678487142, "survival_time": 3.7499999999999942, "driven_lanedir": 0.32721267753615213, "sim_render-ego": 0.04585237185160319, "in-drivable-lane": 2.299999999999994, "agent_compute-ego": 0.04779837290445964, "deviation-heading": 0.3112188917063982, "set_robot_commands": 0.07089273452758789, "deviation-center-line": 0.16525966154163726, "driven_lanedir_consec": 0.32721267753615213, "sim_compute_sim_state": 0.028102874755859375, "sim_compute_performance-ego": 0.05056543986002604, "sim_compute_robot_state-ego": 0.052594785690307615, "sim_compute_robot_state-npc0": 0.05062897364298503, "sim_compute_robot_state-npc1": 0.04972068468729655, "sim_compute_robot_state-npc2": 0.04938918431599935, "sim_compute_robot_state-npc3": 0.04939777374267578}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.1272956963096346, "survival_time": 5.599999999999988, "driven_lanedir": 1.211071354427033, "sim_render-ego": 0.047364620225770135, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.04930051735469273, "deviation-heading": 1.0143384205991224, "set_robot_commands": 0.07179833522864751, "deviation-center-line": 0.44830395948846297, "driven_lanedir_consec": 1.211071354427033, "sim_compute_sim_state": 0.031587722046034675, "sim_compute_performance-ego": 0.05250939513955798, "sim_compute_robot_state-ego": 0.05553274069513593, "sim_compute_robot_state-npc0": 0.05424720474651882, "sim_compute_robot_state-npc1": 0.055529924375670295, "sim_compute_robot_state-npc2": 0.05436215230396816, "sim_compute_robot_state-npc3": 0.055834985205105374}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2198273185919868, "sim_physics": 0.13473643768917432, "survival_time": 4.399999999999992, "driven_lanedir": 0.41711373203649504, "sim_render-ego": 0.0487761145288294, "in-drivable-lane": 2.5999999999999917, "agent_compute-ego": 0.04903792251240124, "deviation-heading": 0.5811284097850438, "set_robot_commands": 0.0743157836523923, "deviation-center-line": 0.13226882250813252, "driven_lanedir_consec": 0.41711373203649504, "sim_compute_sim_state": 0.03076248819177801, "sim_compute_performance-ego": 0.05375073172829368, "sim_compute_robot_state-ego": 0.054853246970610184, "sim_compute_robot_state-npc0": 0.05443701689893549, "sim_compute_robot_state-npc1": 0.05450993234461004, "sim_compute_robot_state-npc2": 0.054886630990288475, "sim_compute_robot_state-npc3": 0.054612021554600106}}
set_robot_commands_max0.1064649723671578
set_robot_commands_mean0.08377515993688228
set_robot_commands_median0.08713975548744202
set_robot_commands_min0.05669767625870243
sim_compute_performance-ego_max0.07771018389109019
sim_compute_performance-ego_mean0.06207062691028895
sim_compute_performance-ego_median0.06498999148607254
sim_compute_performance-ego_min0.04327195690524194
sim_compute_robot_state-ego_max0.08650564503025364
sim_compute_robot_state-ego_mean0.06542396547891362
sim_compute_robot_state-ego_median0.06835901573912738
sim_compute_robot_state-ego_min0.04535386639256631
sim_compute_robot_state-npc0_max0.07694942886764938
sim_compute_robot_state-npc0_mean0.0627762821946761
sim_compute_robot_state-npc0_median0.06561597601159827
sim_compute_robot_state-npc0_min0.04452142407817225
sim_compute_robot_state-npc1_max0.07480725082191261
sim_compute_robot_state-npc1_mean0.06174985642809937
sim_compute_robot_state-npc1_median0.06378420411723934
sim_compute_robot_state-npc1_min0.043201161969092586
sim_compute_robot_state-npc2_max0.07218692753766034
sim_compute_robot_state-npc2_mean0.0618137882182965
sim_compute_robot_state-npc2_median0.06519649864791276
sim_compute_robot_state-npc2_min0.04280662536621094
sim_compute_robot_state-npc3_max0.07242778185251597
sim_compute_robot_state-npc3_mean0.062438730477217645
sim_compute_robot_state-npc3_median0.06698071634447253
sim_compute_robot_state-npc3_min0.042487082942839594
sim_compute_sim_state_max0.042455583810806274
sim_compute_sim_state_mean0.035482063911850395
sim_compute_sim_state_median0.03715688705444336
sim_compute_sim_state_min0.023669865823561145
sim_physics_max0.23679212621740392
sim_physics_mean0.15734117215779608
sim_physics_median0.15785466231308976
sim_physics_min0.10872913678487142
sim_render-ego_max0.06895084638853331
sim_render-ego_mean0.056129842640132536
sim_render-ego_median0.059717384974161784
sim_render-ego_min0.04010696564951251
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean3.6999999999999944
survival_time_min1.5500000000000007
213702410jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationhost-errorno8450:40:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2410/step1-simulation-ip-172-31-42-167-7194-job21370/logs/challenges-runner/stdout.log'
(hidden)
213542372Liam Paullminimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationsuccessno8450:18:42(hidden)
driven_lanedir_consec_median0.6591401084474304
survival_time_median6.949999999999983
deviation-center-line_median0.33899838427143014
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.16334175074704782
agent_compute-ego_mean0.1531661443859877
agent_compute-ego_median0.15143044032747782
agent_compute-ego_min0.14548684544033474
deviation-center-line_max0.4843179558881834
deviation-center-line_mean0.3389764450725529
deviation-center-line_min0.22729035014002288
deviation-heading_max1.1492236283129806
deviation-heading_mean0.9399487053044556
deviation-heading_median1.0007157377877205
deviation-heading_min0.7390440083021812
driven_any_max1.6381859911990262
driven_any_mean1.0096556470575024
driven_any_median0.9900915586687412
driven_any_min0.4167848967141688
driven_lanedir_consec_max1.2206700211390982
driven_lanedir_consec_mean0.7159598687953472
driven_lanedir_consec_min0.3888322247827789
driven_lanedir_max1.2206700211390982
driven_lanedir_mean0.7159598687953472
driven_lanedir_median0.6591401084474304
driven_lanedir_min0.3888322247827789
in-drivable-lane_max4.85000000000004
in-drivable-lane_mean1.8200000000000132
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.16879531462415517, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06284096429673888, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14985681780808263, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.09273525450727065, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03969837778763805, "sim_compute_performance-ego": 0.06883625332400095, "sim_compute_robot_state-ego": 0.07231411316411958, "sim_compute_robot_state-npc0": 0.06708491791924126, "sim_compute_robot_state-npc1": 0.06885383455015773, "sim_compute_robot_state-npc2": 0.06955294471850498, "sim_compute_robot_state-npc3": 0.06883644543105749}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.19120670878697957, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06221492706783234, "in-drivable-lane": 0, "agent_compute-ego": 0.1557148676069956, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.1043312738812159, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.038951260702950616, "sim_compute_performance-ego": 0.06894722438993908, "sim_compute_robot_state-ego": 0.07711257631816561, "sim_compute_robot_state-npc0": 0.07211254513452924, "sim_compute_robot_state-npc1": 0.07108051057845827, "sim_compute_robot_state-npc2": 0.06835432279677618, "sim_compute_robot_state-npc3": 0.0688586878398108}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.16389915042453343, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06016917016771105, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.14548684544033474, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.0897428396013048, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.039468620088365346, "sim_compute_performance-ego": 0.0663769170973036, "sim_compute_robot_state-ego": 0.07147844420539008, "sim_compute_robot_state-npc0": 0.06718135621812608, "sim_compute_robot_state-npc1": 0.06743768056233725, "sim_compute_robot_state-npc2": 0.06856954468621149, "sim_compute_robot_state-npc3": 0.06940330081515841}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.18594599539233791, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.07084216170596637, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.16334175074704782, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.10361051559448242, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.04625309117928079, "sim_compute_performance-ego": 0.07459154436665197, "sim_compute_robot_state-ego": 0.08002159342787782, "sim_compute_robot_state-npc0": 0.07440110725191881, "sim_compute_robot_state-npc1": 0.07625402283558648, "sim_compute_robot_state-npc2": 0.07309662361848189, "sim_compute_robot_state-npc3": 0.07347185930348761}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.17143021689520943, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.062442325410388765, "in-drivable-lane": 0, "agent_compute-ego": 0.15143044032747782, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.0964384192512149, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.04136535856458875, "sim_compute_performance-ego": 0.06929383580646818, "sim_compute_robot_state-ego": 0.07206692014421735, "sim_compute_robot_state-npc0": 0.06975732152424162, "sim_compute_robot_state-npc1": 0.07680866831824892, "sim_compute_robot_state-npc2": 0.07132001907106429, "sim_compute_robot_state-npc3": 0.07485889253162202}}
set_robot_commands_max0.1043312738812159
set_robot_commands_mean0.09737166056709771
set_robot_commands_median0.0964384192512149
set_robot_commands_min0.0897428396013048
sim_compute_performance-ego_max0.07459154436665197
sim_compute_performance-ego_mean0.06960915499687277
sim_compute_performance-ego_median0.06894722438993908
sim_compute_performance-ego_min0.0663769170973036
sim_compute_robot_state-ego_max0.08002159342787782
sim_compute_robot_state-ego_mean0.07459872945195409
sim_compute_robot_state-ego_median0.07231411316411958
sim_compute_robot_state-ego_min0.07147844420539008
sim_compute_robot_state-npc0_max0.07440110725191881
sim_compute_robot_state-npc0_mean0.07010744960961142
sim_compute_robot_state-npc0_median0.06975732152424162
sim_compute_robot_state-npc0_min0.06708491791924126
sim_compute_robot_state-npc1_max0.07680866831824892
sim_compute_robot_state-npc1_mean0.07208694336895774
sim_compute_robot_state-npc1_median0.07108051057845827
sim_compute_robot_state-npc1_min0.06743768056233725
sim_compute_robot_state-npc2_max0.07309662361848189
sim_compute_robot_state-npc2_mean0.07017869097820775
sim_compute_robot_state-npc2_median0.06955294471850498
sim_compute_robot_state-npc2_min0.06835432279677618
sim_compute_robot_state-npc3_max0.07485889253162202
sim_compute_robot_state-npc3_mean0.07108583718422727
sim_compute_robot_state-npc3_median0.06940330081515841
sim_compute_robot_state-npc3_min0.06883644543105749
sim_compute_sim_state_max0.04625309117928079
sim_compute_sim_state_mean0.04114734166456471
sim_compute_sim_state_median0.03969837778763805
sim_compute_sim_state_min0.038951260702950616
sim_physics_max0.19120670878697957
sim_physics_mean0.1762554772246431
sim_physics_median0.17143021689520943
sim_physics_min0.16389915042453343
sim_render-ego_max0.07084216170596637
sim_render-ego_mean0.06370190972972747
sim_render-ego_median0.062442325410388765
sim_render-ego_min0.06016917016771105
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean7.070000000000005
survival_time_min3.149999999999997
213532376Liam Paullminimal_agent_python2 (Python 2)aido2-LF-sim-validationstep1-simulationhost-errorno8450:03:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2376/step1-simulation-ip-172-31-42-167-7194-job21353/logs/challenges-runner/stdout.log'
(hidden)
213492380Liam Paullminimal_agent_python2 (Python 2)aido2-LFVI-sim-validationstep1-simulationsuccessno8450:13:29(hidden)
driven_lanedir_consec_median1.5588337849539742
survival_time_median5.549999999999988
deviation-center-line_median0.3652019984091639
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06471269839518778
agent_compute-ego_mean0.06144619421436387
agent_compute-ego_median0.06222010907078289
agent_compute-ego_min0.0558452308177948
deviation-center-line_max0.5183621890690367
deviation-center-line_mean0.3091633025512927
deviation-center-line_min0.10686438692139356
deviation-heading_max0.6191860504142408
deviation-heading_mean0.5051792851842161
deviation-heading_median0.4989824923438323
deviation-heading_min0.42218734391092383
driven_any_max2.764827318571964
driven_any_mean1.4658358085690737
driven_any_median1.5648273185720385
driven_any_min0.37986052535838966
driven_lanedir_consec_max1.9044523873117627
driven_lanedir_consec_mean1.19641611532087
driven_lanedir_consec_min0.3667130323691865
driven_lanedir_max1.9045033171069223
driven_lanedir_mean1.1964799961413226
driven_lanedir_median1.5590414710313567
driven_lanedir_min0.3667130323691865
in-drivable-lane_max2.8500000000000165
in-drivable-lane_mean0.8600000000000023
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.18071518932376895, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.05921107369500238, "in-drivable-lane": 0, "agent_compute-ego": 0.06217160525622669, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.08618471214363167, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.03753895158166284, "sim_compute_performance-ego": 0.06536160288630305, "sim_compute_robot_state-ego": 0.06756667618278984, "sim_compute_robot_state-npc0": 0.0656323647713876, "sim_compute_robot_state-npc1": 0.06315599905477988, "sim_compute_robot_state-npc2": 0.06509226077311747, "sim_compute_robot_state-npc3": 0.06546846810761872}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.20963553480199865, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.06384692965327082, "in-drivable-lane": 0, "agent_compute-ego": 0.06471269839518778, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.0965916788255846, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.03890859114157187, "sim_compute_performance-ego": 0.07050439473744985, "sim_compute_robot_state-ego": 0.07407306336067818, "sim_compute_robot_state-npc0": 0.07136980907337086, "sim_compute_robot_state-npc1": 0.06676873645266972, "sim_compute_robot_state-npc2": 0.06941238609520164, "sim_compute_robot_state-npc3": 0.07007823119292388}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.18084095487531449, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.05853480850623933, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.062281327531827205, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.08714286538938813, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.03743465846737489, "sim_compute_performance-ego": 0.06431402907466256, "sim_compute_robot_state-ego": 0.06753133780119434, "sim_compute_robot_state-npc0": 0.0653064108842256, "sim_compute_robot_state-npc1": 0.06585549518762045, "sim_compute_robot_state-npc2": 0.06621513303541979, "sim_compute_robot_state-npc3": 0.0634803566711628}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.18674403585064472, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.061289877167546934, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.06222010907078289, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.09248244824833896, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.03905662441752968, "sim_compute_performance-ego": 0.07107392405964318, "sim_compute_robot_state-ego": 0.07169770320672639, "sim_compute_robot_state-npc0": 0.06804532405593633, "sim_compute_robot_state-npc1": 0.06878719904035797, "sim_compute_robot_state-npc2": 0.07083426845011287, "sim_compute_robot_state-npc3": 0.06799374076084316}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.16892769187688828, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.05516951531171799, "in-drivable-lane": 0, "agent_compute-ego": 0.0558452308177948, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.08487004786729813, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.03571736812591553, "sim_compute_performance-ego": 0.06588759273290634, "sim_compute_robot_state-ego": 0.06986677646636963, "sim_compute_robot_state-npc0": 0.06356775015592575, "sim_compute_robot_state-npc1": 0.05963244289159775, "sim_compute_robot_state-npc2": 0.05885729938745499, "sim_compute_robot_state-npc3": 0.06087023764848709}}
set_robot_commands_max0.0965916788255846
set_robot_commands_mean0.0894543504948483
set_robot_commands_median0.08714286538938813
set_robot_commands_min0.08487004786729813
sim_compute_performance-ego_max0.07107392405964318
sim_compute_performance-ego_mean0.067428308698193
sim_compute_performance-ego_median0.06588759273290634
sim_compute_performance-ego_min0.06431402907466256
sim_compute_robot_state-ego_max0.07407306336067818
sim_compute_robot_state-ego_mean0.07014711140355168
sim_compute_robot_state-ego_median0.06986677646636963
sim_compute_robot_state-ego_min0.06753133780119434
sim_compute_robot_state-npc0_max0.07136980907337086
sim_compute_robot_state-npc0_mean0.06678433178816923
sim_compute_robot_state-npc0_median0.0656323647713876
sim_compute_robot_state-npc0_min0.06356775015592575
sim_compute_robot_state-npc1_max0.06878719904035797
sim_compute_robot_state-npc1_mean0.06483997452540516
sim_compute_robot_state-npc1_median0.06585549518762045
sim_compute_robot_state-npc1_min0.05963244289159775
sim_compute_robot_state-npc2_max0.07083426845011287
sim_compute_robot_state-npc2_mean0.06608226954826135
sim_compute_robot_state-npc2_median0.06621513303541979
sim_compute_robot_state-npc2_min0.05885729938745499
sim_compute_robot_state-npc3_max0.07007823119292388
sim_compute_robot_state-npc3_mean0.06557820687620712
sim_compute_robot_state-npc3_median0.06546846810761872
sim_compute_robot_state-npc3_min0.06087023764848709
sim_compute_sim_state_max0.03905662441752968
sim_compute_sim_state_mean0.03773123874681096
sim_compute_sim_state_median0.03753895158166284
sim_compute_sim_state_min0.03571736812591553
sim_physics_max0.20963553480199865
sim_physics_mean0.185372681345723
sim_physics_median0.18084095487531449
sim_physics_min0.16892769187688828
sim_render-ego_max0.06384692965327082
sim_render-ego_mean0.05961044086675549
sim_render-ego_median0.05921107369500238
sim_render-ego_min0.05516951531171799
simulation-passed1
survival_time_max9.55
survival_time_mean5.219999999999994
survival_time_min1.6000000000000008
213472384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno8450:06:16(hidden)
driven_lanedir_consec_median0.10819530882768236
survival_time_median1.6000000000000008
deviation-center-line_median0.05922702809365912
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.1807289645075798
agent_compute-ego_mean0.15337581640203873
agent_compute-ego_median0.1636189152212704
agent_compute-ego_min0.10521822422742844
deviation-center-line_max0.09403575193783437
deviation-center-line_mean0.06714068704926472
deviation-center-line_min0.04906170112640911
deviation-heading_max0.8690968390119935
deviation-heading_mean0.7463615728771433
deviation-heading_median0.7929429632796323
deviation-heading_min0.4907376685908688
driven_any_max0.22874006228350552
driven_any_mean0.19337465572922444
driven_any_median0.19710829083883305
driven_any_min0.1348177337597236
driven_lanedir_consec_max0.13746937776659784
driven_lanedir_consec_mean0.10720633411939776
driven_lanedir_consec_min0.06721588230301867
driven_lanedir_max0.13746937776659784
driven_lanedir_mean0.10720633411939776
driven_lanedir_median0.10819530882768236
driven_lanedir_min0.06721588230301867
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.2100000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21388544608638288, "sim_physics": 0.07598353922367096, "survival_time": 1.6000000000000008, "driven_lanedir": 0.10455158890929804, "sim_render-ego": 0.04002079367637634, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10521822422742844, "deviation-heading": 0.8690968390119935, "set_robot_commands": 0.05673227459192276, "deviation-center-line": 0.07847283630326592, "driven_lanedir_consec": 0.10455158890929804, "sim_compute_sim_state": 0.026819884777069092, "sim_compute_performance-ego": 0.04281674325466156, "sim_compute_robot_state-ego": 0.04464627802371979}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1923217456776772, "sim_physics": 0.10606812608653102, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11859951279039184, "sim_render-ego": 0.0548144373400458, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14792246654115873, "deviation-heading": 0.7929429632796323, "set_robot_commands": 0.09893019446011247, "deviation-center-line": 0.0549061177851551, "driven_lanedir_consec": 0.11859951279039184, "sim_compute_sim_state": 0.03651993850181843, "sim_compute_performance-ego": 0.06385905989285173, "sim_compute_robot_state-ego": 0.06708922057316222}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1348177337597236, "sim_physics": 0.11491893529891968, "survival_time": 1.0000000000000002, "driven_lanedir": 0.10819530882768236, "sim_render-ego": 0.06287870407104493, "in-drivable-lane": 0, "agent_compute-ego": 0.16939051151275636, "deviation-heading": 0.4907376685908688, "set_robot_commands": 0.0959615468978882, "deviation-center-line": 0.09403575193783437, "driven_lanedir_consec": 0.10819530882768236, "sim_compute_sim_state": 0.038530361652374265, "sim_compute_performance-ego": 0.0722898006439209, "sim_compute_robot_state-ego": 0.08377233743667603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19710829083883305, "sim_physics": 0.1378018856048584, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06721588230301867, "sim_render-ego": 0.06650807708501816, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1807289645075798, "deviation-heading": 0.815989813982461, "set_robot_commands": 0.09433075785636902, "deviation-center-line": 0.04906170112640911, "driven_lanedir_consec": 0.06721588230301867, "sim_compute_sim_state": 0.03669603168964386, "sim_compute_performance-ego": 0.06901966780424118, "sim_compute_robot_state-ego": 0.07231990993022919}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22874006228350552, "sim_physics": 0.1181779609006994, "survival_time": 1.7000000000000008, "driven_lanedir": 0.13746937776659784, "sim_render-ego": 0.0620187100242166, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1636189152212704, "deviation-heading": 0.763040579520761, "set_robot_commands": 0.09023671991684858, "deviation-center-line": 0.05922702809365912, "driven_lanedir_consec": 0.13746937776659784, "sim_compute_sim_state": 0.03716794182272518, "sim_compute_performance-ego": 0.07090971049140482, "sim_compute_robot_state-ego": 0.07354385712567497}}
set_robot_commands_max0.09893019446011247
set_robot_commands_mean0.08723829874462821
set_robot_commands_median0.09433075785636902
set_robot_commands_min0.05673227459192276
sim_compute_performance-ego_max0.0722898006439209
sim_compute_performance-ego_mean0.06377899641741605
sim_compute_performance-ego_median0.06901966780424118
sim_compute_performance-ego_min0.04281674325466156
sim_compute_robot_state-ego_max0.08377233743667603
sim_compute_robot_state-ego_mean0.06827432061789243
sim_compute_robot_state-ego_median0.07231990993022919
sim_compute_robot_state-ego_min0.04464627802371979
sim_compute_sim_state_max0.038530361652374265
sim_compute_sim_state_mean0.03514683168872616
sim_compute_sim_state_median0.03669603168964386
sim_compute_sim_state_min0.026819884777069092
sim_physics_max0.1378018856048584
sim_physics_mean0.11059008942293588
sim_physics_median0.11491893529891968
sim_physics_min0.07598353922367096
sim_render-ego_max0.06650807708501816
sim_render-ego_mean0.05724814443934037
sim_render-ego_median0.0620187100242166
sim_render-ego_min0.04002079367637634
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4700000000000006
survival_time_min1.0000000000000002
213422411jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationsuccessno8450:34:52(hidden)
driven_lanedir_consec_median-1.339793520141566
survival_time_median14.950000000000076
deviation-center-line_median1.002134440312669
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.16462040185928345
agent_compute-ego_mean0.16129616260528565
agent_compute-ego_median0.1621641254425049
agent_compute-ego_min0.156118221282959
deviation-center-line_max1.5296442653166566
deviation-center-line_mean0.925371790854924
deviation-center-line_min0.28261955257418875
deviation-heading_max8.558153948461722
deviation-heading_mean7.098260242116498
deviation-heading_median7.090641611385013
deviation-heading_min5.695926383403844
driven_any_max4.378506444052824
driven_any_mean4.378506444052815
driven_any_median4.378506444052811
driven_any_min4.378506444052806
driven_lanedir_consec_max-1.2728379671211965
driven_lanedir_consec_mean-1.3313530019797526
driven_lanedir_consec_min-1.3670015115194478
driven_lanedir_max-1.3662544443440128
driven_lanedir_mean-2.078199826147362
driven_lanedir_median-2.260637650975249
driven_lanedir_min-2.7107548643537447
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.620000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.17342706600824992, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.059780759811401366, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16462040185928345, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.09255687157313028, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.03721405665079753, "sim_compute_performance-ego": 0.06655309279759725, "sim_compute_robot_state-ego": 0.07162491957346598, "sim_compute_robot_state-npc0": 0.06899194876352946, "sim_compute_robot_state-npc1": 0.06781177282333374, "sim_compute_robot_state-npc2": 0.06634271383285523, "sim_compute_robot_state-npc3": 0.0662276554107666}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.1611344281832377, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.06108293851216634, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15900124152501424, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.08820298353830973, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.037884811560312905, "sim_compute_performance-ego": 0.0654678726196289, "sim_compute_robot_state-ego": 0.06960159142812093, "sim_compute_robot_state-npc0": 0.06726158380508424, "sim_compute_robot_state-npc1": 0.06470503012339274, "sim_compute_robot_state-npc2": 0.06466460784276326, "sim_compute_robot_state-npc3": 0.0655835207303365}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.16026698430379233, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.06055567979812622, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.1621641254425049, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.09016114870707194, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.03794880469640096, "sim_compute_performance-ego": 0.0654520575205485, "sim_compute_robot_state-ego": 0.06834216197331747, "sim_compute_robot_state-npc0": 0.06698128779729208, "sim_compute_robot_state-npc1": 0.06732444683710734, "sim_compute_robot_state-npc2": 0.06641126235326131, "sim_compute_robot_state-npc3": 0.06525995333989461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.1630751919746399, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.05758194208145142, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.156118221282959, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.08977429072062175, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.037322386900583905, "sim_compute_performance-ego": 0.06344714164733886, "sim_compute_robot_state-ego": 0.06764498710632325, "sim_compute_robot_state-npc0": 0.06387508233388264, "sim_compute_robot_state-npc1": 0.0630655312538147, "sim_compute_robot_state-npc2": 0.06364034414291382, "sim_compute_robot_state-npc3": 0.06530395984649658}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.17417713403701782, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.06176662762959798, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.16457682291666667, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.090955118338267, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.038988606929779054, "sim_compute_performance-ego": 0.06730377991994221, "sim_compute_robot_state-ego": 0.07174989779790243, "sim_compute_robot_state-npc0": 0.0673455532391866, "sim_compute_robot_state-npc1": 0.0667368205388387, "sim_compute_robot_state-npc2": 0.06679120699564615, "sim_compute_robot_state-npc3": 0.06860694408416748}}
set_robot_commands_max0.09255687157313028
set_robot_commands_mean0.09033008257548016
set_robot_commands_median0.09016114870707194
set_robot_commands_min0.08820298353830973
sim_compute_performance-ego_max0.06730377991994221
sim_compute_performance-ego_mean0.06564478890101114
sim_compute_performance-ego_median0.0654678726196289
sim_compute_performance-ego_min0.06344714164733886
sim_compute_robot_state-ego_max0.07174989779790243
sim_compute_robot_state-ego_mean0.069792711575826
sim_compute_robot_state-ego_median0.06960159142812093
sim_compute_robot_state-ego_min0.06764498710632325
sim_compute_robot_state-npc0_max0.06899194876352946
sim_compute_robot_state-npc0_mean0.066891091187795
sim_compute_robot_state-npc0_median0.06726158380508424
sim_compute_robot_state-npc0_min0.06387508233388264
sim_compute_robot_state-npc1_max0.06781177282333374
sim_compute_robot_state-npc1_mean0.06592872031529744
sim_compute_robot_state-npc1_median0.0667368205388387
sim_compute_robot_state-npc1_min0.0630655312538147
sim_compute_robot_state-npc2_max0.06679120699564615
sim_compute_robot_state-npc2_mean0.06557002703348795
sim_compute_robot_state-npc2_median0.06634271383285523
sim_compute_robot_state-npc2_min0.06364034414291382
sim_compute_robot_state-npc3_max0.06860694408416748
sim_compute_robot_state-npc3_mean0.06619640668233236
sim_compute_robot_state-npc3_median0.0655835207303365
sim_compute_robot_state-npc3_min0.06525995333989461
sim_compute_sim_state_max0.038988606929779054
sim_compute_sim_state_mean0.03787173334757486
sim_compute_sim_state_median0.037884811560312905
sim_compute_sim_state_min0.03721405665079753
sim_physics_max0.17417713403701782
sim_physics_mean0.16641616090138753
sim_physics_median0.1630751919746399
sim_physics_min0.16026698430379233
sim_render-ego_max0.06176662762959798
sim_render-ego_mean0.06015358956654867
sim_render-ego_median0.06055567979812622
sim_render-ego_min0.05758194208145142
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
213212446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno8450:50:51
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-42-167-7194-job21321/logs/challenges-runner/stdout.log'
(hidden)
213132400Liam Paullrandom_agentaido2-LFVI-sim-validationstep1-simulationsuccessno8450:08:21(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1302542894789316
agent_compute-ego_mean0.11660028831756612
agent_compute-ego_median0.12021942380108412
agent_compute-ego_min0.09487939732415336
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1588129785996449, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.049340079102335094, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.12021942380108412, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07979129839547072, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.033801887608781646, "sim_compute_performance-ego": 0.0558710732037508, "sim_compute_robot_state-ego": 0.06128282788433606, "sim_compute_robot_state-npc0": 0.057296001458469824, "sim_compute_robot_state-npc1": 0.054948728295821175, "sim_compute_robot_state-npc2": 0.054698262033583245, "sim_compute_robot_state-npc3": 0.055357320399224}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1464350734438215, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.046173308576856344, "in-drivable-lane": 0, "agent_compute-ego": 0.09487939732415336, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06881364754268102, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.027605967862265452, "sim_compute_performance-ego": 0.048577376774379184, "sim_compute_robot_state-ego": 0.052081167697906494, "sim_compute_robot_state-npc0": 0.049755292279379706, "sim_compute_robot_state-npc1": 0.05076453515461513, "sim_compute_robot_state-npc2": 0.049133547714778354, "sim_compute_robot_state-npc3": 0.04772907495498657}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18615830523296467, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06056837202275841, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1302542894789316, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0901185470877342, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03912347265817587, "sim_compute_performance-ego": 0.06630023937780881, "sim_compute_robot_state-ego": 0.07068185204441108, "sim_compute_robot_state-npc0": 0.06817645934021589, "sim_compute_robot_state-npc1": 0.0666817438255236, "sim_compute_robot_state-npc2": 0.06497423857161143, "sim_compute_robot_state-npc3": 0.06797909736633301}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1943499594926834, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.059941500425338745, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1287700136502584, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08822759985923767, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03849738836288452, "sim_compute_performance-ego": 0.0719939370950063, "sim_compute_robot_state-ego": 0.07065819203853607, "sim_compute_robot_state-npc0": 0.06545456747214, "sim_compute_robot_state-npc1": 0.06438595056533813, "sim_compute_robot_state-npc2": 0.06582966446876526, "sim_compute_robot_state-npc3": 0.06218347450097402}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.13758291516985213, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.049181154796055386, "in-drivable-lane": 0, "agent_compute-ego": 0.10887831733340309, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07291969798860096, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03542275655837286, "sim_compute_performance-ego": 0.05255780901227679, "sim_compute_robot_state-ego": 0.055953411828903926, "sim_compute_robot_state-npc0": 0.05809270767938523, "sim_compute_robot_state-npc1": 0.05818368139721099, "sim_compute_robot_state-npc2": 0.05693150701976958, "sim_compute_robot_state-npc3": 0.055544433139619376}}
set_robot_commands_max0.0901185470877342
set_robot_commands_mean0.07997415817474492
set_robot_commands_median0.07979129839547072
set_robot_commands_min0.06881364754268102
sim_compute_performance-ego_max0.0719939370950063
sim_compute_performance-ego_mean0.059060087092644376
sim_compute_performance-ego_median0.0558710732037508
sim_compute_performance-ego_min0.048577376774379184
sim_compute_robot_state-ego_max0.07068185204441108
sim_compute_robot_state-ego_mean0.06213149029881872
sim_compute_robot_state-ego_median0.06128282788433606
sim_compute_robot_state-ego_min0.052081167697906494
sim_compute_robot_state-npc0_max0.06817645934021589
sim_compute_robot_state-npc0_mean0.05975500564591814
sim_compute_robot_state-npc0_median0.05809270767938523
sim_compute_robot_state-npc0_min0.049755292279379706
sim_compute_robot_state-npc1_max0.0666817438255236
sim_compute_robot_state-npc1_mean0.058992927847701805
sim_compute_robot_state-npc1_median0.05818368139721099
sim_compute_robot_state-npc1_min0.05076453515461513
sim_compute_robot_state-npc2_max0.06582966446876526
sim_compute_robot_state-npc2_mean0.05831344396170157
sim_compute_robot_state-npc2_median0.05693150701976958
sim_compute_robot_state-npc2_min0.049133547714778354
sim_compute_robot_state-npc3_max0.06797909736633301
sim_compute_robot_state-npc3_mean0.0577586800722274
sim_compute_robot_state-npc3_median0.055544433139619376
sim_compute_robot_state-npc3_min0.04772907495498657
sim_compute_sim_state_max0.03912347265817587
sim_compute_sim_state_mean0.03489029461009607
sim_compute_sim_state_median0.03542275655837286
sim_compute_sim_state_min0.027605967862265452
sim_physics_max0.1943499594926834
sim_physics_mean0.16466784638779333
sim_physics_median0.1588129785996449
sim_physics_min0.13758291516985213
sim_render-ego_max0.06056837202275841
sim_render-ego_mean0.05304088298466879
sim_render-ego_median0.049340079102335094
sim_render-ego_min0.046173308576856344
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
212892884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno8450:54:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-42-167-7194-job21289/logs/challenges-runner/stdout.log'
(hidden)
212722428Andrea Censirandom_agentaido2-LF-sim-testingstep1-simulationerrorno8450:01:18
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
(hidden)
212632450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno8450:29:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-42-167-7194-job21263/logs/challenges-runner/stdout.log'
(hidden)
212602455Liam Paullchallenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerrorno8450:00:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212572460Liam Paullchallenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerrorno8450:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212552463Liam Paullchallenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrorno8450:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212542464Liam Paullchallenge-aido_LF-template-rosaido2-LFVI-sim-validationstep1-simulationerrorno8450:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212412491Liam Paullchallenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationsuccessno8450:09:51(hidden)
driven_lanedir_consec_median0.09136919124345688
survival_time_median1.2500000000000004
deviation-center-line_median0.06545245854791194
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.22332460880279545
agent_compute-ego_mean0.15640031908619725
agent_compute-ego_median0.15742312868436178
agent_compute-ego_min0.1144687952818694
deviation-center-line_max0.10840780468821248
deviation-center-line_mean0.06809506728405552
deviation-center-line_min0.034630630716341176
deviation-heading_max0.8369208796118853
deviation-heading_mean0.6832672849361467
deviation-heading_median0.6925794912374205
deviation-heading_min0.4381772110080602
driven_any_max0.24892701166553136
driven_any_mean0.15879097221389246
driven_any_median0.15156440425209397
driven_any_min0.09301240539794464
driven_lanedir_consec_max0.13277221933000427
driven_lanedir_consec_mean0.08477739407219821
driven_lanedir_consec_min0.05302267162001428
driven_lanedir_max0.13277221933000427
driven_lanedir_mean0.08477739407219821
driven_lanedir_median0.09136919124345688
driven_lanedir_min0.05302267162001428
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.18000000000000016
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.24892701166553136, "sim_physics": 0.103815813322325, "survival_time": 1.850000000000001, "driven_lanedir": 0.1144742580975735, "sim_render-ego": 0.05708205377733385, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15285337293470228, "deviation-heading": 0.7855845518450804, "set_robot_commands": 0.08575407234398094, "deviation-center-line": 0.07107921395323845, "driven_lanedir_consec": 0.1144742580975735, "sim_compute_sim_state": 0.03487904007370408, "sim_compute_performance-ego": 0.062287027771408494, "sim_compute_robot_state-ego": 0.07148390202908902}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18152560806415943, "sim_physics": 0.08352940082550049, "survival_time": 1.5000000000000009, "driven_lanedir": 0.09478886083070726, "sim_render-ego": 0.04708913167317708, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.12549749215443928, "deviation-heading": 0.668212148489838, "set_robot_commands": 0.06753989060719807, "deviation-center-line": 0.03817153449876099, "driven_lanedir_consec": 0.09478886083070726, "sim_compute_sim_state": 0.03018719355265299, "sim_compute_performance-ego": 0.06622920036315919, "sim_compute_robot_state-ego": 0.051372687021891274}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09301240539794464, "sim_physics": 0.08738971948623657, "survival_time": 1.0000000000000002, "driven_lanedir": 0.05326494738046872, "sim_render-ego": 0.04955867528915405, "in-drivable-lane": 0, "agent_compute-ego": 0.14430102109909057, "deviation-heading": 0.6701689134963467, "set_robot_commands": 0.07950725555419921, "deviation-center-line": 0.08878660030357849, "driven_lanedir_consec": 0.05326494738046872, "sim_compute_sim_state": 0.03318552970886231, "sim_compute_performance-ego": 0.05744156837463379, "sim_compute_robot_state-ego": 0.06689628362655639}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21560270370100468, "sim_physics": 0.09924918232542096, "survival_time": 1.6500000000000008, "driven_lanedir": 0.09642939042336972, "sim_render-ego": 0.08094845396099669, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16076024373372397, "deviation-heading": 0.7904097084737016, "set_robot_commands": 0.08884352626222553, "deviation-center-line": 0.051737972112990874, "driven_lanedir_consec": 0.09642939042336972, "sim_compute_sim_state": 0.03658510699416652, "sim_compute_performance-ego": 0.06045202052954472, "sim_compute_robot_state-ego": 0.0638229124473803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1946663949293179, "sim_physics": 0.08311780542135239, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09136919124345688, "sim_render-ego": 0.04279047995805741, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.11974359303712843, "deviation-heading": 0.696886244298025, "set_robot_commands": 0.05816921591758728, "deviation-center-line": 0.04495795745114882, "driven_lanedir_consec": 0.09136919124345688, "sim_compute_sim_state": 0.027214713394641876, "sim_compute_performance-ego": 0.046264439821243286, "sim_compute_robot_state-ego": 0.047980427742004395}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.21799181148518368, "sim_physics": 0.13661358573219992, "survival_time": 1.6500000000000008, "driven_lanedir": 0.070485519012502, "sim_render-ego": 0.06861155683344061, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.18600028211420233, "deviation-heading": 0.8317106468127028, "set_robot_commands": 0.09746241569519044, "deviation-center-line": 0.0558300950975517, "driven_lanedir_consec": 0.070485519012502, "sim_compute_sim_state": 0.043385679071599785, "sim_compute_performance-ego": 0.08311214591517593, "sim_compute_robot_state-ego": 0.08884510126980869}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.13661907957528455, "sim_physics": 0.08704123497009278, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09720548927707372, "sim_render-ego": 0.04151127815246582, "in-drivable-lane": 0, "agent_compute-ego": 0.12238978385925292, "deviation-heading": 0.6352420878876517, "set_robot_commands": 0.06952095985412597, "deviation-center-line": 0.09285814098641049, "driven_lanedir_consec": 0.09720548927707372, "sim_compute_sim_state": 0.028201751708984375, "sim_compute_performance-ego": 0.04453848838806152, "sim_compute_robot_state-ego": 0.04689370155334473}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.09321625556208228, "sim_physics": 0.1407714605331421, "survival_time": 1.0000000000000002, "driven_lanedir": 0.053470402902319414, "sim_render-ego": 0.08261804580688477, "in-drivable-lane": 0, "agent_compute-ego": 0.22332460880279545, "deviation-heading": 0.6791305667933317, "set_robot_commands": 0.11154395341873168, "deviation-center-line": 0.08481681671320729, "driven_lanedir_consec": 0.053470402902319414, "sim_compute_sim_state": 0.0467875599861145, "sim_compute_performance-ego": 0.08200461864471435, "sim_compute_robot_state-ego": 0.0901975393295288}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.15156440425209397, "sim_physics": 0.07786479702702274, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06774544783969061, "sim_render-ego": 0.04201493439850984, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1144687952818694, "deviation-heading": 0.6942859901126176, "set_robot_commands": 0.06607227855258518, "deviation-center-line": 0.034630630716341176, "driven_lanedir_consec": 0.06774544783969061, "sim_compute_sim_state": 0.02740213606092665, "sim_compute_performance-ego": 0.04582560503924334, "sim_compute_robot_state-ego": 0.055143621232774526}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.12971680848651423, "sim_physics": 0.11495998772707852, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09311699692050812, "sim_render-ego": 0.05996069041165439, "in-drivable-lane": 0, "agent_compute-ego": 0.15760260278528387, "deviation-heading": 0.5476421158115766, "set_robot_commands": 0.08151183345101097, "deviation-center-line": 0.07648713935087165, "driven_lanedir_consec": 0.09311699692050812, "sim_compute_sim_state": 0.03509836847131902, "sim_compute_performance-ego": 0.060934012586420234, "sim_compute_robot_state-ego": 0.06227714365178889}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16308678819709677, "sim_physics": 0.11389999389648438, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13277221933000427, "sim_render-ego": 0.056048831939697265, "in-drivable-lane": 0, "agent_compute-ego": 0.15431689262390136, "deviation-heading": 0.4936257490245566, "set_robot_commands": 0.09097792625427246, "deviation-center-line": 0.10784342660356418, "driven_lanedir_consec": 0.13277221933000427, "sim_compute_sim_state": 0.034494390487670896, "sim_compute_performance-ego": 0.061201982498168946, "sim_compute_robot_state-ego": 0.06035331726074219}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11601358192280134, "sim_physics": 0.12390124279519786, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05302267162001428, "sim_render-ego": 0.05895782553631326, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1690538033195164, "deviation-heading": 0.6925794912374205, "set_robot_commands": 0.09702671092489493, "deviation-center-line": 0.05623632930597032, "driven_lanedir_consec": 0.05302267162001428, "sim_compute_sim_state": 0.03808836314989173, "sim_compute_performance-ego": 0.06608535932457965, "sim_compute_robot_state-ego": 0.06551654442496922}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.17861121484688067, "sim_physics": 0.11518290213176184, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09075784695523326, "sim_render-ego": 0.06285200800214495, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1799895167350769, "deviation-heading": 0.8369208796118853, "set_robot_commands": 0.10091409512928554, "deviation-center-line": 0.06545245854791194, "driven_lanedir_consec": 0.09075784695523326, "sim_compute_sim_state": 0.03619083336421421, "sim_compute_performance-ego": 0.06886724063328334, "sim_compute_robot_state-ego": 0.07325811897005353}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.13680501498574038, "sim_physics": 0.1098530391852061, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0651397665087714, "sim_render-ego": 0.05454071362813314, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15742312868436178, "deviation-heading": 0.7884329691394065, "set_robot_commands": 0.08054398496945699, "deviation-center-line": 0.044129888931074, "driven_lanedir_consec": 0.0651397665087714, "sim_compute_sim_state": 0.03774347901344299, "sim_compute_performance-ego": 0.06704298655192058, "sim_compute_robot_state-ego": 0.06978394587834676}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12450550013675064, "sim_physics": 0.10203765739094128, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09761790274128002, "sim_render-ego": 0.06283571503379128, "in-drivable-lane": 0, "agent_compute-ego": 0.1782796491276134, "deviation-heading": 0.4381772110080602, "set_robot_commands": 0.0978942567651922, "deviation-center-line": 0.10840780468821248, "driven_lanedir_consec": 0.09761790274128002, "sim_compute_sim_state": 0.03940852121873335, "sim_compute_performance-ego": 0.06950465115633878, "sim_compute_robot_state-ego": 0.07257769324562767}}
set_robot_commands_max0.11154395341873168
set_robot_commands_mean0.08488549171332917
set_robot_commands_median0.08575407234398094
set_robot_commands_min0.05816921591758728
sim_compute_performance-ego_max0.08311214591517593
sim_compute_performance-ego_mean0.06278608983985975
sim_compute_performance-ego_median0.062287027771408494
sim_compute_performance-ego_min0.04453848838806152
sim_compute_robot_state-ego_max0.0901975393295288
sim_compute_robot_state-ego_mean0.0657601959789271
sim_compute_robot_state-ego_median0.06551654442496922
sim_compute_robot_state-ego_min0.04689370155334473
sim_compute_sim_state_max0.0467875599861145
sim_compute_sim_state_mean0.035256844417128355
sim_compute_sim_state_median0.03509836847131902
sim_compute_sim_state_min0.027214713394641876
sim_physics_max0.1407714605331421
sim_physics_mean0.10528185485133086
sim_physics_median0.103815813322325
sim_physics_min0.07786479702702274
sim_render-ego_max0.08261804580688477
sim_render-ego_mean0.05782802629345029
sim_render-ego_median0.05708205377733385
sim_render-ego_min0.04151127815246582
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.3366666666666671
survival_time_min1.0000000000000002
212362492Liam Paullchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessno8450:04:59(hidden)
driven_lanedir_consec_median0.08894063925673246
survival_time_median1.5000000000000009
deviation-center-line_median0.04991482380675351
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.1806117296218872
agent_compute-ego_mean0.1655048635403618
agent_compute-ego_median0.16418138043633823
agent_compute-ego_min0.15411489009857177
deviation-center-line_max0.08815886202707515
deviation-center-line_mean0.056926391433218225
deviation-center-line_min0.04373275321710265
deviation-heading_max0.7795006368093428
deviation-heading_mean0.663002000280312
deviation-heading_median0.6705768119375406
deviation-heading_min0.5158413722372513
driven_any_max0.2173731741292939
driven_any_mean0.18665227752146593
driven_any_median0.19390672638172804
driven_any_min0.11916948924631889
driven_lanedir_consec_max0.11778380419287338
driven_lanedir_consec_mean0.09116302842752402
driven_lanedir_consec_min0.05905850043264316
driven_lanedir_max0.11778380419287338
driven_lanedir_mean0.09116302842752402
driven_lanedir_median0.08894063925673246
driven_lanedir_min0.05905850043264316
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.29000000000000026
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2173731741292939, "sim_physics": 0.12315622498007382, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07613382933837265, "sim_render-ego": 0.06360792412477381, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1806117296218872, "deviation-heading": 0.6611856573234065, "set_robot_commands": 0.09807705177980312, "deviation-center-line": 0.057542085208123914, "driven_lanedir_consec": 0.07613382933837265, "sim_compute_sim_state": 0.04104178793290082, "sim_compute_performance-ego": 0.06924310151268454, "sim_compute_robot_state-ego": 0.0793308230007396}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19390672638172804, "sim_physics": 0.10502165761487238, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11389836891699844, "sim_render-ego": 0.05720635940288675, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.16418138043633823, "deviation-heading": 0.6879055230940186, "set_robot_commands": 0.0938858410407757, "deviation-center-line": 0.04373275321710265, "driven_lanedir_consec": 0.11389836891699844, "sim_compute_sim_state": 0.03837948832018622, "sim_compute_performance-ego": 0.06585763240682668, "sim_compute_robot_state-ego": 0.07017013122295511}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11916948924631889, "sim_physics": 0.10663676261901855, "survival_time": 0.9500000000000004, "driven_lanedir": 0.08894063925673246, "sim_render-ego": 0.05624607989662572, "in-drivable-lane": 0, "agent_compute-ego": 0.15416939635025828, "deviation-heading": 0.5158413722372513, "set_robot_commands": 0.0921387797907779, "deviation-center-line": 0.08815886202707515, "driven_lanedir_consec": 0.08894063925673246, "sim_compute_sim_state": 0.04125876175729852, "sim_compute_performance-ego": 0.06381748851976897, "sim_compute_robot_state-ego": 0.06991012472855418}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1929585123916514, "sim_physics": 0.1133077621459961, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05905850043264316, "sim_render-ego": 0.058344459533691405, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.15411489009857177, "deviation-heading": 0.7795006368093428, "set_robot_commands": 0.08405192693074544, "deviation-center-line": 0.04528343290703592, "driven_lanedir_consec": 0.05905850043264316, "sim_compute_sim_state": 0.0362124760945638, "sim_compute_performance-ego": 0.060858265558878584, "sim_compute_robot_state-ego": 0.06752686500549317}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20985348545833743, "sim_physics": 0.1296504928219703, "survival_time": 1.5500000000000007, "driven_lanedir": 0.11778380419287338, "sim_render-ego": 0.06214711743016397, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17444692119475333, "deviation-heading": 0.6705768119375406, "set_robot_commands": 0.0908898691977224, "deviation-center-line": 0.04991482380675351, "driven_lanedir_consec": 0.11778380419287338, "sim_compute_sim_state": 0.03754217393936649, "sim_compute_performance-ego": 0.06786394888354887, "sim_compute_robot_state-ego": 0.07798829386311193}}
set_robot_commands_max0.09807705177980312
set_robot_commands_mean0.09180869374796492
set_robot_commands_median0.0921387797907779
set_robot_commands_min0.08405192693074544
sim_compute_performance-ego_max0.06924310151268454
sim_compute_performance-ego_mean0.06552808737634153
sim_compute_performance-ego_median0.06585763240682668
sim_compute_performance-ego_min0.060858265558878584
sim_compute_robot_state-ego_max0.0793308230007396
sim_compute_robot_state-ego_mean0.0729852475641708
sim_compute_robot_state-ego_median0.07017013122295511
sim_compute_robot_state-ego_min0.06752686500549317
sim_compute_sim_state_max0.04125876175729852
sim_compute_sim_state_mean0.03888693760886317
sim_compute_sim_state_median0.03837948832018622
sim_compute_sim_state_min0.0362124760945638
sim_physics_max0.1296504928219703
sim_physics_mean0.11555458003638625
sim_physics_median0.1133077621459961
sim_physics_min0.10502165761487238
sim_render-ego_max0.06360792412477381
sim_render-ego_mean0.05951038807762833
sim_render-ego_median0.058344459533691405
sim_render-ego_min0.05624607989662572
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4300000000000006
survival_time_min0.9500000000000004
212332504RamiNaimchallenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerrorno8450:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212292510RamiNaimchallenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerrorno8450:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212232512RamiNaimchallenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrorno8450:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212202520Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrorno8450:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212052537Liam Paullbaseline-IL-sim-tensorflowaido2-LFVI-sim-validationstep1-simulationerrorno8450:05:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
211692707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno8450:57:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2707/step1-simulation-ip-172-31-42-167-7194-job21169/logs/challenges-runner/stdout.log'
(hidden)
211522574AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerrorno8450:02:12
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
211233074Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationhost-errorno8450:53:52
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3074/step1-simulation-ip-172-31-42-167-7194-job21123/logs/challenges-runner/stdout.log'
(hidden)
211142641zamatorychallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessno8450:05:37(hidden)
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.07142785839412523
agent_compute-ego_mean0.0674982227046008
agent_compute-ego_median0.06605472347953102
agent_compute-ego_min0.06496120989322662
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11283720043343558, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05973514033035493, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06927918716215752, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09211865948959136, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03973288267431125, "sim_compute_performance-ego": 0.0677986010699205, "sim_compute_robot_state-ego": 0.07260569048599458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11089439392089843, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.061729522546132405, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06576813459396362, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09436575174331666, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.040313196182250974, "sim_compute_performance-ego": 0.07223219871520996, "sim_compute_robot_state-ego": 0.07747091054916382}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11681672659787264, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.05665001002225009, "in-drivable-lane": 0, "agent_compute-ego": 0.06605472347953102, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09548687934875488, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.039603677662936126, "sim_compute_performance-ego": 0.06536361304196445, "sim_compute_robot_state-ego": 0.07557025822726163}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.10565471152464548, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06278826793034871, "in-drivable-lane": 0, "agent_compute-ego": 0.06496120989322662, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0856667309999466, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03641915321350098, "sim_compute_performance-ego": 0.06533794105052948, "sim_compute_robot_state-ego": 0.06791747609774272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.11234492322672968, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06014040760371996, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07142785839412523, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09934082238570505, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.038412804188935654, "sim_compute_performance-ego": 0.07057675589685855, "sim_compute_robot_state-ego": 0.07528383317201034}}
set_robot_commands_max0.09934082238570505
set_robot_commands_mean0.09339576879346292
set_robot_commands_median0.09436575174331666
set_robot_commands_min0.0856667309999466
sim_compute_performance-ego_max0.07223219871520996
sim_compute_performance-ego_mean0.06826182195489658
sim_compute_performance-ego_median0.0677986010699205
sim_compute_performance-ego_min0.06533794105052948
sim_compute_robot_state-ego_max0.07747091054916382
sim_compute_robot_state-ego_mean0.0737696337064346
sim_compute_robot_state-ego_median0.07528383317201034
sim_compute_robot_state-ego_min0.06791747609774272
sim_compute_sim_state_max0.040313196182250974
sim_compute_sim_state_mean0.03889634278438699
sim_compute_sim_state_median0.039603677662936126
sim_compute_sim_state_min0.03641915321350098
sim_physics_max0.11681672659787264
sim_physics_mean0.11170959114071637
sim_physics_median0.11234492322672968
sim_physics_min0.10565471152464548
sim_render-ego_max0.06278826793034871
sim_render-ego_mean0.060208669686561224
sim_render-ego_median0.06014040760371996
sim_render-ego_min0.05665001002225009
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
210872770Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno8450:57:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-42-167-7194-job21087/logs/challenges-runner/stdout.log'
(hidden)
210132864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno8450:59:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-42-167-7194-job21013/logs/challenges-runner/stdout.log'
(hidden)
209932814Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationhost-errorno8450:16:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 486, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1024, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1181, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 39, in copy_to_cache
    msg = 'Copying %s to cache %s' % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2814/step1-simulation-ip-172-31-42-167-7194-job20993/tmp/tmpx3zywuo2/episodes/ETHZ_autolab_technical_track-6-0/drawing.html'
(hidden)
209882823Liam Paullchallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno8450:08:56(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1647277729851859
agent_compute-ego_mean0.1581295410580818
agent_compute-ego_median0.15800137873049136
agent_compute-ego_min0.14852274894714357
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16276461989791305, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06159547523215965, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15800137873049136, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10077059268951416, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0401618171621252, "sim_compute_performance-ego": 0.07139444792712177, "sim_compute_robot_state-ego": 0.07510447060620343, "sim_compute_robot_state-npc0": 0.07020055364679408, "sim_compute_robot_state-npc1": 0.07108915293658222, "sim_compute_robot_state-npc2": 0.06862039919252749, "sim_compute_robot_state-npc3": 0.07214004022103769}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1988169860839844, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06441498756408691, "in-drivable-lane": 0, "agent_compute-ego": 0.14852274894714357, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09658520698547364, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03989990234375, "sim_compute_performance-ego": 0.07115654945373535, "sim_compute_robot_state-ego": 0.07548545837402344, "sim_compute_robot_state-npc0": 0.07108907699584961, "sim_compute_robot_state-npc1": 0.07199681282043457, "sim_compute_robot_state-npc2": 0.0678072452545166, "sim_compute_robot_state-npc3": 0.06878486633300782}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18645850608223363, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0651839061787254, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15641108939522191, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09612292992441278, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.039554097150501455, "sim_compute_performance-ego": 0.07143299203169973, "sim_compute_robot_state-ego": 0.07369480634990491, "sim_compute_robot_state-npc0": 0.07104967142406263, "sim_compute_robot_state-npc1": 0.07142457522844013, "sim_compute_robot_state-npc2": 0.07008715366062365, "sim_compute_robot_state-npc3": 0.06798209955817774}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.21603376050538656, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06590033482901658, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16298471523236624, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10003293013270896, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04109033753600302, "sim_compute_performance-ego": 0.07422502734993078, "sim_compute_robot_state-ego": 0.08359972434707835, "sim_compute_robot_state-npc0": 0.07467775405207767, "sim_compute_robot_state-npc1": 0.0726069619383993, "sim_compute_robot_state-npc2": 0.07091570805899705, "sim_compute_robot_state-npc3": 0.07112905345385588}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.2067180701664516, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06897997004645211, "in-drivable-lane": 0, "agent_compute-ego": 0.1647277729851859, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10631983620779854, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04329866170883179, "sim_compute_performance-ego": 0.08016084773199898, "sim_compute_robot_state-ego": 0.08978383030210223, "sim_compute_robot_state-npc0": 0.07944731201444354, "sim_compute_robot_state-npc1": 0.07865578787667411, "sim_compute_robot_state-npc2": 0.07867454630987984, "sim_compute_robot_state-npc3": 0.07827100583485194}}
set_robot_commands_max0.10631983620779854
set_robot_commands_mean0.09996629918798162
set_robot_commands_median0.10003293013270896
set_robot_commands_min0.09612292992441278
sim_compute_performance-ego_max0.08016084773199898
sim_compute_performance-ego_mean0.07367397289889734
sim_compute_performance-ego_median0.07143299203169973
sim_compute_performance-ego_min0.07115654945373535
sim_compute_robot_state-ego_max0.08978383030210223
sim_compute_robot_state-ego_mean0.07953365799586247
sim_compute_robot_state-ego_median0.07548545837402344
sim_compute_robot_state-ego_min0.07369480634990491
sim_compute_robot_state-npc0_max0.07944731201444354
sim_compute_robot_state-npc0_mean0.07329287362664551
sim_compute_robot_state-npc0_median0.07108907699584961
sim_compute_robot_state-npc0_min0.07020055364679408
sim_compute_robot_state-npc1_max0.07865578787667411
sim_compute_robot_state-npc1_mean0.07315465816010605
sim_compute_robot_state-npc1_median0.07199681282043457
sim_compute_robot_state-npc1_min0.07108915293658222
sim_compute_robot_state-npc2_max0.07867454630987984
sim_compute_robot_state-npc2_mean0.07122101049530892
sim_compute_robot_state-npc2_median0.07008715366062365
sim_compute_robot_state-npc2_min0.0678072452545166
sim_compute_robot_state-npc3_max0.07827100583485194
sim_compute_robot_state-npc3_mean0.07166141308018621
sim_compute_robot_state-npc3_median0.07112905345385588
sim_compute_robot_state-npc3_min0.06798209955817774
sim_compute_sim_state_max0.04329866170883179
sim_compute_sim_state_mean0.040800963180242296
sim_compute_sim_state_median0.0401618171621252
sim_compute_sim_state_min0.039554097150501455
sim_physics_max0.21603376050538656
sim_physics_mean0.19415838854719383
sim_physics_median0.1988169860839844
sim_physics_min0.16276461989791305
sim_render-ego_max0.06897997004645211
sim_render-ego_mean0.06521493477008813
sim_render-ego_median0.0651839061787254
sim_render-ego_min0.06159547523215965
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
209872832AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrorno8450:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
209832835AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrorno8450:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
209812840AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrorno8450:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
209792844AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrorno8450:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
209732857AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessno8450:10:25(hidden)
driven_lanedir_consec_median0.4430532861735075
survival_time_median7.049999999999983
deviation-center-line_median0.20873036418961904
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.11424389122225714
agent_compute-ego_mean0.1019383098907178
agent_compute-ego_median0.09952219816354604
agent_compute-ego_min0.09163950764855672
deviation-center-line_max0.4406719765006902
deviation-center-line_mean0.2389268041098079
deviation-center-line_min0.1197182906674316
deviation-heading_max2.0405002394588827
deviation-heading_mean1.6794211129018712
deviation-heading_median1.6898654544228242
deviation-heading_min1.051443625514617
driven_any_max0.5800977204512235
driven_any_mean0.4095623290163637
driven_any_median0.539700175382884
driven_any_min0.145941590384182
driven_lanedir_consec_max0.4807143964063374
driven_lanedir_consec_mean0.336827421987887
driven_lanedir_consec_min0.11998715093122447
driven_lanedir_max0.4807143964063374
driven_lanedir_mean0.336827421987887
driven_lanedir_median0.4430532861735075
driven_lanedir_min0.11998715093122447
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3899999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5800977204512235, "sim_physics": 0.12562400259469686, "survival_time": 7.599999999999981, "driven_lanedir": 0.471157144399132, "sim_render-ego": 0.06570419982859962, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.10857231366006952, "deviation-heading": 2.0405002394588827, "set_robot_commands": 0.10646736778711018, "deviation-center-line": 0.4406719765006902, "driven_lanedir_consec": 0.471157144399132, "sim_compute_sim_state": 0.04145510573136179, "sim_compute_performance-ego": 0.0740889404949389, "sim_compute_robot_state-ego": 0.08323616573685094}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23432920698788115, "sim_physics": 0.11734150373018704, "survival_time": 3.2499999999999964, "driven_lanedir": 0.16922513202923373, "sim_render-ego": 0.06126067821796124, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09952219816354604, "deviation-heading": 1.575960017562641, "set_robot_commands": 0.09768353608938364, "deviation-center-line": 0.1197182906674316, "driven_lanedir_consec": 0.16922513202923373, "sim_compute_sim_state": 0.04137854209313026, "sim_compute_performance-ego": 0.06573031132037822, "sim_compute_robot_state-ego": 0.07341010387127216}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.145941590384182, "sim_physics": 0.10797257756077966, "survival_time": 2.1500000000000004, "driven_lanedir": 0.11998715093122447, "sim_render-ego": 0.058402455130288765, "in-drivable-lane": 0, "agent_compute-ego": 0.09163950764855672, "deviation-heading": 1.051443625514617, "set_robot_commands": 0.09354704479838528, "deviation-center-line": 0.20873036418961904, "driven_lanedir_consec": 0.11998715093122447, "sim_compute_sim_state": 0.0376201119533805, "sim_compute_performance-ego": 0.06827331698218057, "sim_compute_robot_state-ego": 0.07088540875634482}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5477429518756478, "sim_physics": 0.10882659391923384, "survival_time": 7.149999999999983, "driven_lanedir": 0.4807143964063374, "sim_render-ego": 0.05581569838357139, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09571363875915954, "deviation-heading": 2.039336227550392, "set_robot_commands": 0.08734535337328077, "deviation-center-line": 0.22455249635290225, "driven_lanedir_consec": 0.4807143964063374, "sim_compute_sim_state": 0.035767678614262936, "sim_compute_performance-ego": 0.06328660291391652, "sim_compute_robot_state-ego": 0.06796782833712918}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.539700175382884, "sim_physics": 0.13188868549698635, "survival_time": 7.049999999999983, "driven_lanedir": 0.4430532861735075, "sim_render-ego": 0.06847099716781724, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11424389122225714, "deviation-heading": 1.6898654544228242, "set_robot_commands": 0.10856026284238124, "deviation-center-line": 0.2009608928383967, "driven_lanedir_consec": 0.4430532861735075, "sim_compute_sim_state": 0.045470599587082015, "sim_compute_performance-ego": 0.080280657355667, "sim_compute_robot_state-ego": 0.08913160046787126}}
set_robot_commands_max0.10856026284238124
set_robot_commands_mean0.09872071297810822
set_robot_commands_median0.09768353608938364
set_robot_commands_min0.08734535337328077
sim_compute_performance-ego_max0.080280657355667
sim_compute_performance-ego_mean0.07033196581341625
sim_compute_performance-ego_median0.06827331698218057
sim_compute_performance-ego_min0.06328660291391652
sim_compute_robot_state-ego_max0.08913160046787126
sim_compute_robot_state-ego_mean0.07692622143389367
sim_compute_robot_state-ego_median0.07341010387127216
sim_compute_robot_state-ego_min0.06796782833712918
sim_compute_sim_state_max0.045470599587082015
sim_compute_sim_state_mean0.0403384075958435
sim_compute_sim_state_median0.04137854209313026
sim_compute_sim_state_min0.035767678614262936
sim_physics_max0.13188868549698635
sim_physics_mean0.11833067266037674
sim_physics_median0.11734150373018704
sim_physics_min0.10797257756077966
sim_render-ego_max0.06847099716781724
sim_render-ego_mean0.06193080574564765
sim_render-ego_median0.06126067821796124
sim_render-ego_min0.05581569838357139
simulation-passed1
survival_time_max7.599999999999981
survival_time_mean5.439999999999989
survival_time_min2.1500000000000004
209592861AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessno8450:18:01(hidden)
driven_lanedir_consec_median0.4442836953793563
survival_time_median6.5999999999999845
deviation-center-line_median0.23011717945840268
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.12275256315867106
agent_compute-ego_mean0.10480534467338098
agent_compute-ego_median0.10146036292567398
agent_compute-ego_min0.09774773567914964
deviation-center-line_max0.2677965905311012
deviation-center-line_mean0.2240018824772453
deviation-center-line_min0.1676578222570646
deviation-heading_max1.9590729116640704
deviation-heading_mean1.718855273685324
deviation-heading_median1.759743530959963
deviation-heading_min1.4542236037360072
driven_any_max1.1707030898390385
driven_any_mean0.5517917304513403
driven_any_median0.5035446157600671
driven_any_min0.21826570258829023
driven_lanedir_consec_max0.49543157849784336
driven_lanedir_consec_mean0.363214735545378
driven_lanedir_consec_min0.18106093948028257
driven_lanedir_max0.49543157849784336
driven_lanedir_mean0.363214735545378
driven_lanedir_median0.4442836953793563
driven_lanedir_min0.18106093948028257
in-drivable-lane_max7.9000000000000945
in-drivable-lane_mean1.7800000000000178
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1707030898390385, "sim_physics": 0.15399993658065797, "survival_time": 14.950000000000076, "driven_lanedir": 0.49543157849784336, "sim_render-ego": 0.05325824419657389, "in-drivable-lane": 7.9000000000000945, "agent_compute-ego": 0.12275256315867106, "deviation-heading": 1.637814574719438, "set_robot_commands": 0.0816234024365743, "deviation-center-line": 0.2677965905311012, "driven_lanedir_consec": 0.49543157849784336, "sim_compute_sim_state": 0.03412662744522095, "sim_compute_performance-ego": 0.059219028949737545, "sim_compute_robot_state-ego": 0.06724810202916463, "sim_compute_robot_state-npc0": 0.06217306137084961, "sim_compute_robot_state-npc1": 0.0603417444229126, "sim_compute_robot_state-npc2": 0.06085826794306437, "sim_compute_robot_state-npc3": 0.06146678924560547}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.35888276677719, "sim_physics": 0.17299936215082803, "survival_time": 4.799999999999991, "driven_lanedir": 0.24748331544262123, "sim_render-ego": 0.0627503792444865, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09774773567914964, "deviation-heading": 1.759743530959963, "set_robot_commands": 0.0982886254787445, "deviation-center-line": 0.2070233828025143, "driven_lanedir_consec": 0.24748331544262123, "sim_compute_sim_state": 0.03909137099981308, "sim_compute_performance-ego": 0.06644412875175476, "sim_compute_robot_state-ego": 0.07793417821327846, "sim_compute_robot_state-npc0": 0.0721106082201004, "sim_compute_robot_state-npc1": 0.07072754700978597, "sim_compute_robot_state-npc2": 0.0694346899787585, "sim_compute_robot_state-npc3": 0.06805821011463802}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5075624772921158, "sim_physics": 0.18783265307433625, "survival_time": 6.649999999999984, "driven_lanedir": 0.4478141489267866, "sim_render-ego": 0.062262959946367075, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10391545654239512, "deviation-heading": 1.7834217473471417, "set_robot_commands": 0.10066343967179608, "deviation-center-line": 0.24741443733714355, "driven_lanedir_consec": 0.4478141489267866, "sim_compute_sim_state": 0.03942739156852091, "sim_compute_performance-ego": 0.07062899797482598, "sim_compute_robot_state-ego": 0.07568726145235219, "sim_compute_robot_state-npc0": 0.0719773375002065, "sim_compute_robot_state-npc1": 0.07020208889380433, "sim_compute_robot_state-npc2": 0.07261384519419276, "sim_compute_robot_state-npc3": 0.07338236686878634}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5035446157600671, "sim_physics": 0.1844956116242842, "survival_time": 6.5999999999999845, "driven_lanedir": 0.4442836953793563, "sim_render-ego": 0.06146908528877027, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.10146036292567398, "deviation-heading": 1.9590729116640704, "set_robot_commands": 0.09928793979413582, "deviation-center-line": 0.23011717945840268, "driven_lanedir_consec": 0.4442836953793563, "sim_compute_sim_state": 0.04002102757945205, "sim_compute_performance-ego": 0.0695431087956284, "sim_compute_robot_state-ego": 0.07357061992992055, "sim_compute_robot_state-npc0": 0.06915734392223936, "sim_compute_robot_state-npc1": 0.07379083561174797, "sim_compute_robot_state-npc2": 0.0708716529788393, "sim_compute_robot_state-npc3": 0.07259641452269121}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21826570258829023, "sim_physics": 0.17394244084592725, "survival_time": 3.049999999999997, "driven_lanedir": 0.18106093948028257, "sim_render-ego": 0.06939181734303959, "in-drivable-lane": 0, "agent_compute-ego": 0.09815060506101514, "deviation-heading": 1.4542236037360072, "set_robot_commands": 0.0966396918062304, "deviation-center-line": 0.1676578222570646, "driven_lanedir_consec": 0.18106093948028257, "sim_compute_sim_state": 0.03979993648216373, "sim_compute_performance-ego": 0.0699092833722224, "sim_compute_robot_state-ego": 0.07434421289162557, "sim_compute_robot_state-npc0": 0.07001878003605076, "sim_compute_robot_state-npc1": 0.06707228598047475, "sim_compute_robot_state-npc2": 0.07076052368664351, "sim_compute_robot_state-npc3": 0.07029433328597272}}
set_robot_commands_max0.10066343967179608
set_robot_commands_mean0.0953006198374962
set_robot_commands_median0.0982886254787445
set_robot_commands_min0.0816234024365743
sim_compute_performance-ego_max0.07062899797482598
sim_compute_performance-ego_mean0.06714890956883382
sim_compute_performance-ego_median0.0695431087956284
sim_compute_performance-ego_min0.059219028949737545
sim_compute_robot_state-ego_max0.07793417821327846
sim_compute_robot_state-ego_mean0.07375687490326828
sim_compute_robot_state-ego_median0.07434421289162557
sim_compute_robot_state-ego_min0.06724810202916463
sim_compute_robot_state-npc0_max0.0721106082201004
sim_compute_robot_state-npc0_mean0.06908742620988934
sim_compute_robot_state-npc0_median0.07001878003605076
sim_compute_robot_state-npc0_min0.06217306137084961
sim_compute_robot_state-npc1_max0.07379083561174797
sim_compute_robot_state-npc1_mean0.06842690038374513
sim_compute_robot_state-npc1_median0.07020208889380433
sim_compute_robot_state-npc1_min0.0603417444229126
sim_compute_robot_state-npc2_max0.07261384519419276
sim_compute_robot_state-npc2_mean0.0689077959562997
sim_compute_robot_state-npc2_median0.07076052368664351
sim_compute_robot_state-npc2_min0.06085826794306437
sim_compute_robot_state-npc3_max0.07338236686878634
sim_compute_robot_state-npc3_mean0.06915962280753876
sim_compute_robot_state-npc3_median0.07029433328597272
sim_compute_robot_state-npc3_min0.06146678924560547
sim_compute_sim_state_max0.04002102757945205
sim_compute_sim_state_mean0.03849327081503415
sim_compute_sim_state_median0.03942739156852091
sim_compute_sim_state_min0.03412662744522095
sim_physics_max0.18783265307433625
sim_physics_mean0.17465400085520671
sim_physics_median0.17394244084592725
sim_physics_min0.15399993658065797
sim_render-ego_max0.06939181734303959
sim_render-ego_mean0.06182649720384746
sim_render-ego_median0.062262959946367075
sim_render-ego_min0.05325824419657389
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.210000000000006
survival_time_min3.049999999999997
209512880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errorno8450:04:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2880/step1-simulation-ip-172-31-42-167-7194-job20951/logs/challenges-runner/stdout.log'
(hidden)
209462893almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno8450:12:03(hidden)
driven_lanedir_consec_median0.3004612044380359
survival_time_median4.899999999999991
deviation-center-line_median0.24770995818777833
in-drivable-lane_median1.20000000000001


other stats
agent_compute-ego_max0.18701149929653516
agent_compute-ego_mean0.17924790828734913
agent_compute-ego_median0.17968229371674208
agent_compute-ego_min0.1731323993812173
deviation-center-line_max0.612632943547377
deviation-center-line_mean0.3088841726088521
deviation-center-line_min0.16005125397873246
deviation-heading_max6.254828250705772
deviation-heading_mean2.609587082899453
deviation-heading_median2.1702556178769954
deviation-heading_min0.7256424864991055
driven_any_max1.4334994795858234
driven_any_mean0.8240885074796152
driven_any_median0.6288276408666593
driven_any_min0.5249644395511194
driven_lanedir_consec_max0.6665759722376454
driven_lanedir_consec_mean0.3782246515968707
driven_lanedir_consec_min0.16483096550581067
driven_lanedir_max0.9172567432880294
driven_lanedir_mean0.4821405191643383
driven_lanedir_median0.368195617900545
driven_lanedir_min0.20756098713738247
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean1.319999999999998
in-drivable-lane_min0.6499999999999977
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9939066272326912, "sim_physics": 0.1148185871415219, "survival_time": 5.899999999999987, "driven_lanedir": 0.6665759722376454, "sim_render-ego": 0.062989111674034, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1731323993812173, "deviation-heading": 0.9018486313612406, "set_robot_commands": 0.0941966044700752, "deviation-center-line": 0.22111729086582177, "driven_lanedir_consec": 0.6665759722376454, "sim_compute_sim_state": 0.04150183322065967, "sim_compute_performance-ego": 0.06945890693341271, "sim_compute_robot_state-ego": 0.07632306672758975}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6288276408666593, "sim_physics": 0.13297929569166533, "survival_time": 4.899999999999991, "driven_lanedir": 0.368195617900545, "sim_render-ego": 0.06354881062799571, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.17968229371674208, "deviation-heading": 2.1702556178769954, "set_robot_commands": 0.09778579400510204, "deviation-center-line": 0.30290941646455094, "driven_lanedir_consec": 0.3004612044380359, "sim_compute_sim_state": 0.04110242882553412, "sim_compute_performance-ego": 0.07298643734990334, "sim_compute_robot_state-ego": 0.0815934672647593}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5392443501617825, "sim_physics": 0.12483399293639444, "survival_time": 4.399999999999992, "driven_lanedir": 0.25111327525808935, "sim_render-ego": 0.06701323119076816, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.18701149929653516, "deviation-heading": 2.9953604280541524, "set_robot_commands": 0.1016078618439761, "deviation-center-line": 0.24770995818777833, "driven_lanedir_consec": 0.16483096550581067, "sim_compute_sim_state": 0.04181681166995655, "sim_compute_performance-ego": 0.07316941835663536, "sim_compute_robot_state-ego": 0.08204723217270592}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4334994795858234, "sim_physics": 0.12172752949926588, "survival_time": 10.800000000000018, "driven_lanedir": 0.9172567432880294, "sim_render-ego": 0.06299183434910244, "in-drivable-lane": 1.20000000000001, "agent_compute-ego": 0.1830467504483682, "deviation-heading": 6.254828250705772, "set_robot_commands": 0.09845449416725724, "deviation-center-line": 0.612632943547377, "driven_lanedir_consec": 0.5516941286654791, "sim_compute_sim_state": 0.03969017885349415, "sim_compute_performance-ego": 0.06922387193750452, "sim_compute_robot_state-ego": 0.07590696767524437}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5249644395511194, "sim_physics": 0.11535192147279397, "survival_time": 3.899999999999994, "driven_lanedir": 0.20756098713738247, "sim_render-ego": 0.06417710964496319, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.17336659859388304, "deviation-heading": 0.7256424864991055, "set_robot_commands": 0.09479076128739578, "deviation-center-line": 0.16005125397873246, "driven_lanedir_consec": 0.20756098713738247, "sim_compute_sim_state": 0.039432381972288474, "sim_compute_performance-ego": 0.0711813890016996, "sim_compute_robot_state-ego": 0.07557138724204822}}
set_robot_commands_max0.1016078618439761
set_robot_commands_mean0.09736710315476128
set_robot_commands_median0.09778579400510204
set_robot_commands_min0.0941966044700752
sim_compute_performance-ego_max0.07316941835663536
sim_compute_performance-ego_mean0.0712040047158311
sim_compute_performance-ego_median0.0711813890016996
sim_compute_performance-ego_min0.06922387193750452
sim_compute_robot_state-ego_max0.08204723217270592
sim_compute_robot_state-ego_mean0.0782884242164695
sim_compute_robot_state-ego_median0.07632306672758975
sim_compute_robot_state-ego_min0.07557138724204822
sim_compute_sim_state_max0.04181681166995655
sim_compute_sim_state_mean0.04070872690838659
sim_compute_sim_state_median0.04110242882553412
sim_compute_sim_state_min0.039432381972288474
sim_physics_max0.13297929569166533
sim_physics_mean0.1219422653483283
sim_physics_median0.12172752949926588
sim_physics_min0.1148185871415219
sim_render-ego_max0.06701323119076816
sim_render-ego_mean0.06414401949737271
sim_render-ego_median0.06354881062799571
sim_render-ego_min0.062989111674034
simulation-passed1
survival_time_max10.800000000000018
survival_time_mean5.979999999999997
survival_time_min3.899999999999994
209422909ASHWINRAMchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessno8450:05:45(hidden)
driven_lanedir_consec_median0.431749818466148
survival_time_median1.2500000000000004
deviation-center-line_median0.07785372543404256
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2686178962389628
agent_compute-ego_mean0.25173895889730435
agent_compute-ego_median0.2489522661481585
agent_compute-ego_min0.234267920255661
deviation-center-line_max0.16850282219718765
deviation-center-line_mean0.09510082986524487
deviation-center-line_min0.05525180113567536
deviation-heading_max0.345995052331256
deviation-heading_mean0.24800759250466264
deviation-heading_median0.20410713107808
deviation-heading_min0.16290079358306278
driven_any_max1.5833783776226673
driven_any_mean0.7153951164384857
driven_any_median0.4884229675397246
driven_any_min0.28273013447102285
driven_lanedir_consec_max1.2398695287041943
driven_lanedir_consec_mean0.5567471842447391
driven_lanedir_consec_min0.27491964178588946
driven_lanedir_max1.2398695287041943
driven_lanedir_mean0.5567471842447391
driven_lanedir_median0.431749818466148
driven_lanedir_min0.27491964178588946
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.24999999999999972
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7526511681720554, "sim_physics": 0.12815493856157575, "survival_time": 1.7500000000000009, "driven_lanedir": 0.37025785151428314, "sim_render-ego": 0.05968667439052037, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.2489522661481585, "deviation-heading": 0.16290079358306278, "set_robot_commands": 0.09025602340698242, "deviation-center-line": 0.09922109875527278, "driven_lanedir_consec": 0.37025785151428314, "sim_compute_sim_state": 0.035672875813075475, "sim_compute_performance-ego": 0.07260489463806152, "sim_compute_robot_state-ego": 0.09340846879141672}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4697929343869585, "sim_physics": 0.12004640579223631, "survival_time": 1.2500000000000004, "driven_lanedir": 0.431749818466148, "sim_render-ego": 0.058878307342529294, "in-drivable-lane": 0, "agent_compute-ego": 0.24309014320373537, "deviation-heading": 0.3370968471517856, "set_robot_commands": 0.09969481468200685, "deviation-center-line": 0.05525180113567536, "driven_lanedir_consec": 0.431749818466148, "sim_compute_sim_state": 0.03994657516479492, "sim_compute_performance-ego": 0.07289329528808594, "sim_compute_robot_state-ego": 0.07731306076049804}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28273013447102285, "sim_physics": 0.13035228848457336, "survival_time": 0.8000000000000002, "driven_lanedir": 0.27491964178588946, "sim_render-ego": 0.0670388787984848, "in-drivable-lane": 0, "agent_compute-ego": 0.234267920255661, "deviation-heading": 0.18993813837912865, "set_robot_commands": 0.09909453988075256, "deviation-center-line": 0.07467470180404599, "driven_lanedir_consec": 0.27491964178588946, "sim_compute_sim_state": 0.037192702293396, "sim_compute_performance-ego": 0.06462275981903076, "sim_compute_robot_state-ego": 0.07585141062736511}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4884229675397246, "sim_physics": 0.13997825332309888, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4669390807531806, "sim_render-ego": 0.06588930669038193, "in-drivable-lane": 0, "agent_compute-ego": 0.26376656864000403, "deviation-heading": 0.345995052331256, "set_robot_commands": 0.0955946445465088, "deviation-center-line": 0.07785372543404256, "driven_lanedir_consec": 0.4669390807531806, "sim_compute_sim_state": 0.039776149003402046, "sim_compute_performance-ego": 0.07078923349795134, "sim_compute_robot_state-ego": 0.0719056855077329}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5833783776226673, "sim_physics": 0.12276480197906496, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2398695287041943, "sim_render-ego": 0.07076876163482666, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.2686178962389628, "deviation-heading": 0.20410713107808, "set_robot_commands": 0.10283422072728476, "deviation-center-line": 0.16850282219718765, "driven_lanedir_consec": 1.2398695287041943, "sim_compute_sim_state": 0.041160384813944496, "sim_compute_performance-ego": 0.07681279579798381, "sim_compute_robot_state-ego": 0.08117243448893229}}
set_robot_commands_max0.10283422072728476
set_robot_commands_mean0.09749484864870708
set_robot_commands_median0.09909453988075256
set_robot_commands_min0.09025602340698242
sim_compute_performance-ego_max0.07681279579798381
sim_compute_performance-ego_mean0.07154459580822267
sim_compute_performance-ego_median0.07260489463806152
sim_compute_performance-ego_min0.06462275981903076
sim_compute_robot_state-ego_max0.09340846879141672
sim_compute_robot_state-ego_mean0.07993021203518902
sim_compute_robot_state-ego_median0.07731306076049804
sim_compute_robot_state-ego_min0.0719056855077329
sim_compute_sim_state_max0.041160384813944496
sim_compute_sim_state_mean0.038749737417722585
sim_compute_sim_state_median0.039776149003402046
sim_compute_sim_state_min0.035672875813075475
sim_physics_max0.13997825332309888
sim_physics_mean0.12825933762810984
sim_physics_median0.12815493856157575
sim_physics_min0.12004640579223631
sim_render-ego_max0.07076876163482666
sim_render-ego_mean0.06445238577134861
sim_render-ego_median0.06588930669038193
sim_render-ego_min0.058878307342529294
simulation-passed1
survival_time_max2.9999999999999973
survival_time_mean1.59
survival_time_min0.8000000000000002
209282970Andrea Censiminimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessno8450:30:17(hidden)
driven_lanedir_consec_median0.6202968959903497
survival_time_median6.8999999999999835
deviation-center-line_median0.2968973039399582
in-drivable-lane_median0


other stats
agent_compute-ego_max0.15873932495391627
agent_compute-ego_mean0.1448686276022345
agent_compute-ego_median0.14483917016777204
agent_compute-ego_min0.13346620287214006
deviation-center-line_max1.2578907011919125
deviation-center-line_mean0.392559795052945
deviation-center-line_min0.20837582250812192
deviation-heading_max1.7338651399303977
deviation-heading_mean0.922434565822337
deviation-heading_median0.801279189692507
deviation-heading_min0.48740885281046914
driven_any_max1.7560498171261352
driven_any_mean0.8746411422725543
driven_any_median0.9886852216355494
driven_any_min0.278862430643389
driven_lanedir_consec_max1.7523714592470048
driven_lanedir_consec_mean0.6813457664348396
driven_lanedir_consec_min0.2720172605900939
driven_lanedir_max1.7523714592470048
driven_lanedir_mean0.6813457664348396
driven_lanedir_median0.6202968959903497
driven_lanedir_min0.2720172605900939
in-drivable-lane_max6.400000000000029
in-drivable-lane_mean1.1100000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.11173401633612544, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06181628412479977, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15873932495391627, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.09974497856853676, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04129604813006285, "sim_compute_performance-ego": 0.07140197170724114, "sim_compute_robot_state-ego": 0.08080625191009302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.10651785135269164, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.05837292841502598, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.150048679964883, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.090572646686009, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.038639567579541886, "sim_compute_performance-ego": 0.0688673973083496, "sim_compute_robot_state-ego": 0.0697739601135254}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.09838187959459092, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.0559720410241021, "in-drivable-lane": 0, "agent_compute-ego": 0.14572413232591416, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.08185766537984213, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.03583669662475586, "sim_compute_performance-ego": 0.059658114115397134, "sim_compute_robot_state-ego": 0.06459732055664062}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.10888435788776564, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.05766843971998795, "in-drivable-lane": 0, "agent_compute-ego": 0.13847725806028946, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.08727742018906967, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.03633668889170107, "sim_compute_performance-ego": 0.06200290762859842, "sim_compute_robot_state-ego": 0.07061457374821538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.10694984322813549, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.06334422494722827, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.15603620276603525, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.09432532798209692, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.03956755111206612, "sim_compute_performance-ego": 0.0688102288877583, "sim_compute_robot_state-ego": 0.07352558009700688}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.0983344486781529, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.054153823852539064, "in-drivable-lane": 0, "agent_compute-ego": 0.13346620287214006, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.08179356711251395, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.03285309246608189, "sim_compute_performance-ego": 0.05896806035723005, "sim_compute_robot_state-ego": 0.06582615034920829}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.09930631980090074, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.059958815574646, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.14188892908499273, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.08638854933456636, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.03598076860669633, "sim_compute_performance-ego": 0.06443359986157485, "sim_compute_robot_state-ego": 0.06781120367453132}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.1024059990177984, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.06018480528955874, "in-drivable-lane": 0, "agent_compute-ego": 0.14056881614353345, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.08882991127345873, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.03707107771997866, "sim_compute_performance-ego": 0.0683067622392074, "sim_compute_robot_state-ego": 0.06788087927776834}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.1062121073404948, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.06237002743615045, "in-drivable-lane": 0, "agent_compute-ego": 0.15121848318311903, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.0911769496070014, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.0379530323876275, "sim_compute_performance-ego": 0.06815758281283908, "sim_compute_robot_state-ego": 0.07455334663391114}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.11499807281770567, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.06062967017077017, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14610944969066675, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.09217523319133814, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.03842308210289997, "sim_compute_performance-ego": 0.07006973287333614, "sim_compute_robot_state-ego": 0.07656210229016733}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.1135181658858553, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.06402451401456781, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.14988496762896897, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.0947333246196082, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.03919841062038317, "sim_compute_performance-ego": 0.06972121098719605, "sim_compute_robot_state-ego": 0.07781501100697649}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.10873079962200588, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.0578373306327396, "in-drivable-lane": 0, "agent_compute-ego": 0.13952911231252882, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.0928849180539449, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.03930274976624383, "sim_compute_performance-ego": 0.06151497032907274, "sim_compute_robot_state-ego": 0.06860702567630345}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.10468586228734296, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.059098653656115635, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14483917016777204, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.08887031610063512, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.03899135864038262, "sim_compute_performance-ego": 0.06889933476345145, "sim_compute_robot_state-ego": 0.07015658111023389}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.10568788900213728, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.06263823428396452, "in-drivable-lane": 0, "agent_compute-ego": 0.13623109510389425, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.08846613512200824, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.03688748004072803, "sim_compute_performance-ego": 0.06604809680227507, "sim_compute_robot_state-ego": 0.07165522898657847}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.09943748212948876, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.05654285854323771, "in-drivable-lane": 0, "agent_compute-ego": 0.14026758977486384, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.08776818865067731, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.03782419446098359, "sim_compute_performance-ego": 0.06230487368413522, "sim_compute_robot_state-ego": 0.06686846349249242}}
set_robot_commands_max0.09974497856853676
set_robot_commands_mean0.08979100879142046
set_robot_commands_median0.08887031610063512
set_robot_commands_min0.08179356711251395
sim_compute_performance-ego_max0.07140197170724114
sim_compute_performance-ego_mean0.06594432295717752
sim_compute_performance-ego_median0.06815758281283908
sim_compute_performance-ego_min0.05896806035723005
sim_compute_robot_state-ego_max0.08080625191009302
sim_compute_robot_state-ego_mean0.0711369119282435
sim_compute_robot_state-ego_median0.07015658111023389
sim_compute_robot_state-ego_min0.06459732055664062
sim_compute_sim_state_max0.04129604813006285
sim_compute_sim_state_mean0.03774411994334222
sim_compute_sim_state_median0.0379530323876275
sim_compute_sim_state_min0.03285309246608189
sim_physics_max0.11499807281770567
sim_physics_mean0.10571900633207948
sim_physics_median0.1062121073404948
sim_physics_min0.0983344486781529
sim_render-ego_max0.06402451401456781
sim_render-ego_mean0.05964084344569558
sim_render-ego_median0.059958815574646
sim_render-ego_min0.054153823852539064
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean6.166666666666666
survival_time_min2.25
209152945Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno8450:05:44(hidden)
driven_lanedir_consec_median0.1568374577975864
survival_time_median1.4500000000000006
deviation-center-line_median0.08558524082765089
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1968095795861606
agent_compute-ego_mean0.16987049497076925
agent_compute-ego_median0.16732014142549956
agent_compute-ego_min0.1511807782309396
deviation-center-line_max0.09823906711300212
deviation-center-line_mean0.08681529750080486
deviation-center-line_min0.07658966369559472
deviation-heading_max0.9807205033097725
deviation-heading_mean0.7860944636478493
deviation-heading_median0.8224660060493492
deviation-heading_min0.5024406494371064
driven_any_max0.2561698941949565
driven_any_mean0.2112350654459715
driven_any_median0.228471898122942
driven_any_min0.13826860568403024
driven_lanedir_consec_max0.1979733230134985
driven_lanedir_consec_mean0.1529847092446626
driven_lanedir_consec_min0.1037789626077168
driven_lanedir_max0.1979733230134985
driven_lanedir_mean0.1529847092446626
driven_lanedir_median0.1568374577975864
driven_lanedir_min0.1037789626077168
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.228471898122942, "sim_physics": 0.13147514441917682, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1568374577975864, "sim_render-ego": 0.06333202329175226, "in-drivable-lane": 0, "agent_compute-ego": 0.1968095795861606, "deviation-heading": 0.8459436857816607, "set_robot_commands": 0.09812531800105652, "deviation-center-line": 0.09440674887044148, "driven_lanedir_consec": 0.1568374577975864, "sim_compute_sim_state": 0.03997543762470114, "sim_compute_performance-ego": 0.07634730996756718, "sim_compute_robot_state-ego": 0.08105384070297768}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2561698941949565, "sim_physics": 0.11552744753220502, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1979733230134985, "sim_render-ego": 0.06003417688257554, "in-drivable-lane": 0, "agent_compute-ego": 0.17031702574561625, "deviation-heading": 0.8224660060493492, "set_robot_commands": 0.09417544392978444, "deviation-center-line": 0.07658966369559472, "driven_lanedir_consec": 0.1979733230134985, "sim_compute_sim_state": 0.03755183079663445, "sim_compute_performance-ego": 0.06819572168238022, "sim_compute_robot_state-ego": 0.07336576545939726}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13826860568403024, "sim_physics": 0.10499227614629836, "survival_time": 1.0500000000000005, "driven_lanedir": 0.11261823394668058, "sim_render-ego": 0.05904652958824521, "in-drivable-lane": 0, "agent_compute-ego": 0.1511807782309396, "deviation-heading": 0.5024406494371064, "set_robot_commands": 0.08856593994867235, "deviation-center-line": 0.09823906711300212, "driven_lanedir_consec": 0.11261823394668058, "sim_compute_sim_state": 0.038728895641508554, "sim_compute_performance-ego": 0.06578042393638975, "sim_compute_robot_state-ego": 0.07233078139168876}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18578676657777116, "sim_physics": 0.11793248470012958, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1037789626077168, "sim_render-ego": 0.05852668101970966, "in-drivable-lane": 0, "agent_compute-ego": 0.16732014142549956, "deviation-heading": 0.9807205033097725, "set_robot_commands": 0.09092037494365986, "deviation-center-line": 0.07925576699733504, "driven_lanedir_consec": 0.1037789626077168, "sim_compute_sim_state": 0.034681421059828535, "sim_compute_performance-ego": 0.06463636801793025, "sim_compute_robot_state-ego": 0.07465190153855544}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.24747816265015793, "sim_physics": 0.1170531113942464, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1937155688578307, "sim_render-ego": 0.06766109033064409, "in-drivable-lane": 0, "agent_compute-ego": 0.1637249498656302, "deviation-heading": 0.7789014736613579, "set_robot_commands": 0.08953428268432617, "deviation-center-line": 0.08558524082765089, "driven_lanedir_consec": 0.1937155688578307, "sim_compute_sim_state": 0.03740788951064601, "sim_compute_performance-ego": 0.0686804959268281, "sim_compute_robot_state-ego": 0.0737451712290446}}
set_robot_commands_max0.09812531800105652
set_robot_commands_mean0.09226427190149988
set_robot_commands_median0.09092037494365986
set_robot_commands_min0.08856593994867235
sim_compute_performance-ego_max0.07634730996756718
sim_compute_performance-ego_mean0.0687280639062191
sim_compute_performance-ego_median0.06819572168238022
sim_compute_performance-ego_min0.06463636801793025
sim_compute_robot_state-ego_max0.08105384070297768
sim_compute_robot_state-ego_mean0.07502949206433275
sim_compute_robot_state-ego_median0.0737451712290446
sim_compute_robot_state-ego_min0.07233078139168876
sim_compute_sim_state_max0.03997543762470114
sim_compute_sim_state_mean0.03766909492666374
sim_compute_sim_state_median0.03755183079663445
sim_compute_sim_state_min0.034681421059828535
sim_physics_max0.13147514441917682
sim_physics_mean0.11739609283841124
sim_physics_median0.1170531113942464
sim_physics_min0.10499227614629836
sim_render-ego_max0.06766109033064409
sim_render-ego_mean0.06172010022258536
sim_render-ego_median0.06003417688257554
sim_render-ego_min0.05852668101970966
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4300000000000004
survival_time_min1.0500000000000005
208972981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno8450:23:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2981/step1-simulation-ip-172-31-42-167-7194-job20897/logs/challenges-runner/stdout.log'
(hidden)
208643063Andrea Censirotationaido2-LFVI-sim-validationstep1-simulationsuccessno8450:35:53(hidden)
driven_lanedir_consec_median0.000305044676884636
survival_time_median14.950000000000076
deviation-center-line_median0.4891046565937845
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.1717841100692749
agent_compute-ego_mean0.15415737930933637
agent_compute-ego_median0.15004813035329184
agent_compute-ego_min0.14874239285786947
deviation-center-line_max0.6113246250082045
deviation-center-line_mean0.4225460275157091
deviation-center-line_min0.020737627062439232
deviation-heading_max5.830135897709594
deviation-heading_mean5.684570550707688
deviation-heading_median5.657649106857694
deviation-heading_min5.536662996854866
driven_any_max0.02647867283405392
driven_any_mean0.024864239592253624
driven_any_median0.02593019554120814
driven_any_min0.02216545266138003
driven_lanedir_consec_max0.002162616049345756
driven_lanedir_consec_mean-0.0004886462276792348
driven_lanedir_consec_min-0.0036402347654349576
driven_lanedir_max0.002162616049345756
driven_lanedir_mean-0.0004886462276792348
driven_lanedir_median0.000305044676884636
driven_lanedir_min-0.0036402347654349576
in-drivable-lane_max7.650000000000043
in-drivable-lane_mean7.600000000000042
in-drivable-lane_min7.550000000000044
per-episodes
details{"udem1-0-0": {"driven_any": 0.02647867283405392, "sim_physics": 0.2233387756347656, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.06811828772226969, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.1717841100692749, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.10776522000630696, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.042684784730275475, "sim_compute_performance-ego": 0.07542207797368368, "sim_compute_robot_state-ego": 0.08368022044499715, "sim_compute_robot_state-npc0": 0.07519597848256429, "sim_compute_robot_state-npc1": 0.07617562929789225, "sim_compute_robot_state-npc2": 0.0742625610033671, "sim_compute_robot_state-npc3": 0.07410948673884074}, "udem1-1-0": {"driven_any": 0.02593019554120814, "sim_physics": 0.20114351987838744, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.060717660586039224, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15023762543996175, "deviation-heading": 5.795316370396738, "set_robot_commands": 0.09531437794367471, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.03684365272521973, "sim_compute_performance-ego": 0.06562578280766805, "sim_compute_robot_state-ego": 0.0711145011583964, "sim_compute_robot_state-npc0": 0.06884404102961222, "sim_compute_robot_state-npc1": 0.06714802424112956, "sim_compute_robot_state-npc2": 0.06642589648564656, "sim_compute_robot_state-npc3": 0.06716026385625204}, "udem1-2-0": {"driven_any": 0.02380440467243486, "sim_physics": 0.19314073165257772, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.06023574670155843, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1499746378262838, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.09583009322484334, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.03940537691116333, "sim_compute_performance-ego": 0.067316259543101, "sim_compute_robot_state-ego": 0.07176966667175293, "sim_compute_robot_state-npc0": 0.06819501797358195, "sim_compute_robot_state-npc1": 0.06805540402730306, "sim_compute_robot_state-npc2": 0.06815248012542724, "sim_compute_robot_state-npc3": 0.0671971861521403}, "udem1-3-0": {"driven_any": 0.02216545266138003, "sim_physics": 0.20058897813161217, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202353105, "sim_render-ego": 0.0620106585820516, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.14874239285786947, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.09354412317276, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202353105, "sim_compute_sim_state": 0.03781956116358439, "sim_compute_performance-ego": 0.06792743841807047, "sim_compute_robot_state-ego": 0.07166570027669271, "sim_compute_robot_state-npc0": 0.06552098115285238, "sim_compute_robot_state-npc1": 0.06488717317581177, "sim_compute_robot_state-npc2": 0.06418054024378458, "sim_compute_robot_state-npc3": 0.06554256836573283}, "udem1-4-0": {"driven_any": 0.02594247225219117, "sim_physics": 0.2011483057339986, "survival_time": 14.950000000000076, "driven_lanedir": 0.000305044676884636, "sim_render-ego": 0.06259693225224813, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.15004813035329184, "deviation-heading": 5.830135897709594, "set_robot_commands": 0.09202473322550456, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.000305044676884636, "sim_compute_sim_state": 0.03984922170639038, "sim_compute_performance-ego": 0.06701574405034383, "sim_compute_robot_state-ego": 0.07142412821451823, "sim_compute_robot_state-npc0": 0.0662182092666626, "sim_compute_robot_state-npc1": 0.06662629763285319, "sim_compute_robot_state-npc2": 0.06842709302902222, "sim_compute_robot_state-npc3": 0.06810958782831827}}
set_robot_commands_max0.10776522000630696
set_robot_commands_mean0.09689570951461791
set_robot_commands_median0.09531437794367471
set_robot_commands_min0.09202473322550456
sim_compute_performance-ego_max0.07542207797368368
sim_compute_performance-ego_mean0.0686614605585734
sim_compute_performance-ego_median0.067316259543101
sim_compute_performance-ego_min0.06562578280766805
sim_compute_robot_state-ego_max0.08368022044499715
sim_compute_robot_state-ego_mean0.07393084335327148
sim_compute_robot_state-ego_median0.07166570027669271
sim_compute_robot_state-ego_min0.0711145011583964
sim_compute_robot_state-npc0_max0.07519597848256429
sim_compute_robot_state-npc0_mean0.06879484558105468
sim_compute_robot_state-npc0_median0.06819501797358195
sim_compute_robot_state-npc0_min0.06552098115285238
sim_compute_robot_state-npc1_max0.07617562929789225
sim_compute_robot_state-npc1_mean0.06857850567499797
sim_compute_robot_state-npc1_median0.06714802424112956
sim_compute_robot_state-npc1_min0.06488717317581177
sim_compute_robot_state-npc2_max0.0742625610033671
sim_compute_robot_state-npc2_mean0.06828971417744954
sim_compute_robot_state-npc2_median0.06815248012542724
sim_compute_robot_state-npc2_min0.06418054024378458
sim_compute_robot_state-npc3_max0.07410948673884074
sim_compute_robot_state-npc3_mean0.06842381858825684
sim_compute_robot_state-npc3_median0.0671971861521403
sim_compute_robot_state-npc3_min0.06554256836573283
sim_compute_sim_state_max0.042684784730275475
sim_compute_sim_state_mean0.03932051944732666
sim_compute_sim_state_median0.03940537691116333
sim_compute_sim_state_min0.03684365272521973
sim_physics_max0.2233387756347656
sim_physics_mean0.20387206220626833
sim_physics_median0.20114351987838744
sim_physics_min0.19314073165257772
sim_render-ego_max0.06811828772226969
sim_render-ego_mean0.06273585716883341
sim_render-ego_median0.0620106585820516
sim_render-ego_min0.06023574670155843
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
208363064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno8450:21:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3064/step1-simulation-ip-172-31-42-167-7194-job20836/logs/challenges-runner/stdout.log'
(hidden)
208182865AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessno8450:28:43(hidden)
driven_lanedir_consec_median0.4906378651204748
survival_time_median14.950000000000076
deviation-center-line_median0.23916579592115045
in-drivable-lane_median3.4000000000000483


other stats
agent_compute-ego_max0.11445613543192544
agent_compute-ego_mean0.10948192346225652
agent_compute-ego_median0.10965794801712037
agent_compute-ego_min0.1025368468514804
deviation-center-line_max0.8598179747822606
deviation-center-line_mean0.4164109816235886
deviation-center-line_min0.1524104407527288
deviation-heading_max5.536030364590776
deviation-heading_mean3.1885992625542134
deviation-heading_median1.9089265344806616
deviation-heading_min1.448341673463684
driven_any_max1.1745667911136657
driven_any_mean0.7993065462620965
driven_any_median1.1745375875148232
driven_any_min0.20621070958903517
driven_lanedir_consec_max0.64427541241931
driven_lanedir_consec_mean0.4197719404475316
driven_lanedir_consec_min0.1532115720161615
driven_lanedir_max0.7380366950743553
driven_lanedir_mean0.4433955772366987
driven_lanedir_median0.4906378651204748
driven_lanedir_min0.1532115720161615
in-drivable-lane_max7.950000000000094
in-drivable-lane_mean3.260000000000036
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2666651060745704, "sim_physics": 0.22426826567263217, "survival_time": 3.699999999999995, "driven_lanedir": 0.1532115720161615, "sim_render-ego": 0.06775473581778037, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.11164505417282516, "deviation-heading": 1.5314631276581263, "set_robot_commands": 0.1118812335504068, "deviation-center-line": 0.1524104407527288, "driven_lanedir_consec": 0.1532115720161615, "sim_compute_sim_state": 0.04338183274140229, "sim_compute_performance-ego": 0.07434112961227829, "sim_compute_robot_state-ego": 0.08290572746379955, "sim_compute_robot_state-npc0": 0.07458131377761429, "sim_compute_robot_state-npc1": 0.07648387148573592, "sim_compute_robot_state-npc2": 0.0750597264315631, "sim_compute_robot_state-npc3": 0.07875589744464771}, "udem1-1-0": {"driven_any": 1.1745375875148232, "sim_physics": 0.2307570195198059, "survival_time": 14.950000000000076, "driven_lanedir": 0.4906378651204748, "sim_render-ego": 0.06981953859329224, "in-drivable-lane": 7.950000000000094, "agent_compute-ego": 0.11445613543192544, "deviation-heading": 1.9089265344806616, "set_robot_commands": 0.10993390719095866, "deviation-center-line": 0.23916579592115045, "driven_lanedir_consec": 0.4906378651204748, "sim_compute_sim_state": 0.04418567816416422, "sim_compute_performance-ego": 0.08068432966868083, "sim_compute_robot_state-ego": 0.08500124375025431, "sim_compute_robot_state-npc0": 0.0760547129313151, "sim_compute_robot_state-npc1": 0.07591456254323324, "sim_compute_robot_state-npc2": 0.07792675813039143, "sim_compute_robot_state-npc3": 0.07701671044031778}, "udem1-2-0": {"driven_any": 1.174552537018389, "sim_physics": 0.21528377056121825, "survival_time": 14.950000000000076, "driven_lanedir": 0.6669058075208681, "sim_render-ego": 0.06567161401112874, "in-drivable-lane": 4.1500000000000385, "agent_compute-ego": 0.10911363283793132, "deviation-heading": 5.536030364590776, "set_robot_commands": 0.1030753747622172, "deviation-center-line": 0.6709099403033454, "driven_lanedir_consec": 0.642548906230078, "sim_compute_sim_state": 0.04081465562184652, "sim_compute_performance-ego": 0.07333365122477213, "sim_compute_robot_state-ego": 0.07943152507146199, "sim_compute_robot_state-npc0": 0.07270699580510458, "sim_compute_robot_state-npc1": 0.0711501677831014, "sim_compute_robot_state-npc2": 0.07263823350270589, "sim_compute_robot_state-npc3": 0.07194299538930257}, "udem1-3-0": {"driven_any": 1.1745667911136657, "sim_physics": 0.20135415156682332, "survival_time": 14.950000000000076, "driven_lanedir": 0.7380366950743553, "sim_render-ego": 0.06528722763061523, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.10965794801712037, "deviation-heading": 5.518234612577819, "set_robot_commands": 0.10125334898630778, "deviation-center-line": 0.8598179747822606, "driven_lanedir_consec": 0.64427541241931, "sim_compute_sim_state": 0.039270044167836506, "sim_compute_performance-ego": 0.07115239938100179, "sim_compute_robot_state-ego": 0.07627529621124268, "sim_compute_robot_state-npc0": 0.07111894845962524, "sim_compute_robot_state-npc1": 0.06980561176935832, "sim_compute_robot_state-npc2": 0.07071214437484741, "sim_compute_robot_state-npc3": 0.07056262095769246}, "udem1-4-0": {"driven_any": 0.20621070958903517, "sim_physics": 0.20105756562331628, "survival_time": 2.8999999999999977, "driven_lanedir": 0.16818594645163398, "sim_render-ego": 0.06471192425694959, "in-drivable-lane": 0, "agent_compute-ego": 0.1025368468514804, "deviation-heading": 1.448341673463684, "set_robot_commands": 0.0960175949951698, "deviation-center-line": 0.15975075635845737, "driven_lanedir_consec": 0.16818594645163398, "sim_compute_sim_state": 0.03916913065417059, "sim_compute_performance-ego": 0.06909774911814723, "sim_compute_robot_state-ego": 0.07507125262556405, "sim_compute_robot_state-npc0": 0.07022135422147553, "sim_compute_robot_state-npc1": 0.07067679536753688, "sim_compute_robot_state-npc2": 0.06912464520026898, "sim_compute_robot_state-npc3": 0.07039469686047785}}
set_robot_commands_max0.1118812335504068
set_robot_commands_mean0.10443229189701204
set_robot_commands_median0.1030753747622172
set_robot_commands_min0.0960175949951698
sim_compute_performance-ego_max0.08068432966868083
sim_compute_performance-ego_mean0.07372185180097605
sim_compute_performance-ego_median0.07333365122477213
sim_compute_performance-ego_min0.06909774911814723
sim_compute_robot_state-ego_max0.08500124375025431
sim_compute_robot_state-ego_mean0.07973700902446453
sim_compute_robot_state-ego_median0.07943152507146199
sim_compute_robot_state-ego_min0.07507125262556405
sim_compute_robot_state-npc0_max0.0760547129313151
sim_compute_robot_state-npc0_mean0.07293666503902695
sim_compute_robot_state-npc0_median0.07270699580510458
sim_compute_robot_state-npc0_min0.07022135422147553
sim_compute_robot_state-npc1_max0.07648387148573592
sim_compute_robot_state-npc1_mean0.07280620178979316
sim_compute_robot_state-npc1_median0.0711501677831014
sim_compute_robot_state-npc1_min0.06980561176935832
sim_compute_robot_state-npc2_max0.07792675813039143
sim_compute_robot_state-npc2_mean0.07309230152795536
sim_compute_robot_state-npc2_median0.07263823350270589
sim_compute_robot_state-npc2_min0.06912464520026898
sim_compute_robot_state-npc3_max0.07875589744464771
sim_compute_robot_state-npc3_mean0.07373458421848768
sim_compute_robot_state-npc3_median0.07194299538930257
sim_compute_robot_state-npc3_min0.07039469686047785
sim_compute_sim_state_max0.04418567816416422
sim_compute_sim_state_mean0.04136426826988403
sim_compute_sim_state_median0.04081465562184652
sim_compute_sim_state_min0.03916913065417059
sim_physics_max0.2307570195198059
sim_physics_mean0.2145441545887592
sim_physics_median0.21528377056121825
sim_physics_min0.20105756562331628
sim_render-ego_max0.06981953859329224
sim_render-ego_mean0.06664900806195324
sim_render-ego_median0.06567161401112874
sim_render-ego_min0.06471192425694959
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.290000000000044
survival_time_min2.8999999999999977
208072873almasipchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessno8450:08:44(hidden)
driven_lanedir_consec_median0.11232790009754055
survival_time_median1.5000000000000009
deviation-center-line_median0.07838303453570936
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19429659843444824
agent_compute-ego_mean0.17382752404408405
agent_compute-ego_median0.16509840362950376
agent_compute-ego_min0.15595928315193422
deviation-center-line_max0.08650564116402884
deviation-center-line_mean0.07608369656432938
deviation-center-line_min0.06604145144995589
deviation-heading_max0.9725952198143292
deviation-heading_mean0.7486526918205163
deviation-heading_median0.6897462599920539
deviation-heading_min0.5182286178054573
driven_any_max0.26454035332833237
driven_any_mean0.20450552871852776
driven_any_median0.20825691494001267
driven_any_min0.11277820422045504
driven_lanedir_consec_max0.20792598476999255
driven_lanedir_consec_mean0.139210412112779
driven_lanedir_consec_min0.08394096623178449
driven_lanedir_max0.20792598476999255
driven_lanedir_mean0.139210412112779
driven_lanedir_median0.11232790009754055
driven_lanedir_min0.08394096623178449
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20825691494001267, "sim_physics": 0.15037620862325032, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11232790009754055, "sim_render-ego": 0.054889520009358726, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16500699520111084, "deviation-heading": 0.8935033888401123, "set_robot_commands": 0.07610936959584554, "deviation-center-line": 0.08323591183901975, "driven_lanedir_consec": 0.11232790009754055, "sim_compute_sim_state": 0.03364555835723877, "sim_compute_performance-ego": 0.074196990331014, "sim_compute_robot_state-ego": 0.06325127283732096}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24864061379585428, "sim_physics": 0.143891203788019, "survival_time": 1.5500000000000007, "driven_lanedir": 0.19818262323518, "sim_render-ego": 0.0672253870194958, "in-drivable-lane": 0, "agent_compute-ego": 0.15595928315193422, "deviation-heading": 0.6897462599920539, "set_robot_commands": 0.08290771515138688, "deviation-center-line": 0.06604145144995589, "driven_lanedir_consec": 0.19818262323518, "sim_compute_sim_state": 0.03657367152552451, "sim_compute_performance-ego": 0.09756228231614636, "sim_compute_robot_state-ego": 0.06272515173881285}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11277820422045504, "sim_physics": 0.11794707649632503, "survival_time": 0.9500000000000004, "driven_lanedir": 0.08394096623178449, "sim_render-ego": 0.06278817277205617, "in-drivable-lane": 0, "agent_compute-ego": 0.16509840362950376, "deviation-heading": 0.5182286178054573, "set_robot_commands": 0.09059693938807438, "deviation-center-line": 0.08650564116402884, "driven_lanedir_consec": 0.08394096623178449, "sim_compute_sim_state": 0.0394954430429559, "sim_compute_performance-ego": 0.06896419274179559, "sim_compute_robot_state-ego": 0.07608866691589355}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1883115573079846, "sim_physics": 0.15280526876449585, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0936745862293975, "sim_render-ego": 0.06792808430535453, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1887763398034232, "deviation-heading": 0.9725952198143292, "set_robot_commands": 0.09853384324482509, "deviation-center-line": 0.06625244383293308, "driven_lanedir_consec": 0.0936745862293975, "sim_compute_sim_state": 0.04459267854690552, "sim_compute_performance-ego": 0.07375419991356987, "sim_compute_robot_state-ego": 0.08201061827795846}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26454035332833237, "sim_physics": 0.1430761045025241, "survival_time": 1.5500000000000007, "driven_lanedir": 0.20792598476999255, "sim_render-ego": 0.06906350197330598, "in-drivable-lane": 0, "agent_compute-ego": 0.19429659843444824, "deviation-heading": 0.6691899726506286, "set_robot_commands": 0.10264792749958654, "deviation-center-line": 0.07838303453570936, "driven_lanedir_consec": 0.20792598476999255, "sim_compute_sim_state": 0.04413562436257639, "sim_compute_performance-ego": 0.07692993071771437, "sim_compute_robot_state-ego": 0.08626484101818453}}
set_robot_commands_max0.10264792749958654
set_robot_commands_mean0.09015915897594368
set_robot_commands_median0.09059693938807438
set_robot_commands_min0.07610936959584554
sim_compute_performance-ego_max0.09756228231614636
sim_compute_performance-ego_mean0.07828151920404804
sim_compute_performance-ego_median0.074196990331014
sim_compute_performance-ego_min0.06896419274179559
sim_compute_robot_state-ego_max0.08626484101818453
sim_compute_robot_state-ego_mean0.07406811015763407
sim_compute_robot_state-ego_median0.07608866691589355
sim_compute_robot_state-ego_min0.06272515173881285
sim_compute_sim_state_max0.04459267854690552
sim_compute_sim_state_mean0.03968859516704022
sim_compute_sim_state_median0.0394954430429559
sim_compute_sim_state_min0.03364555835723877
sim_physics_max0.15280526876449585
sim_physics_mean0.14161917243492284
sim_physics_median0.143891203788019
sim_physics_min0.11794707649632503
sim_render-ego_max0.06906350197330598
sim_render-ego_mean0.06437893321591423
sim_render-ego_median0.0672253870194958
sim_render-ego_min0.054889520009358726
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3900000000000006
survival_time_min0.9500000000000004
207993058Andrea Censirotationaido2-LFV-sim-testingstep1-simulationhost-errorno8450:18:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-42-167-7194-job20799/logs/challenges-runner/stdout.log'
(hidden)
207842956Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno8450:37:55(hidden)
driven_lanedir_consec_median0.30402283162098764
survival_time_median6.999999999999983
deviation-center-line_median0.2460750057446518
in-drivable-lane_median1.949999999999993


other stats
agent_compute-ego_max0.23441464602947237
agent_compute-ego_mean0.20829734870772967
agent_compute-ego_median0.2076818655568657
agent_compute-ego_min0.19237179043649255
deviation-center-line_max0.7276746440916119
deviation-center-line_mean0.29752640344376247
deviation-center-line_min0.12691729211332822
deviation-heading_max2.033670554184505
deviation-heading_mean1.415551082763028
deviation-heading_median1.4269978730797008
deviation-heading_min0.7957972465670914
driven_any_max1.7284100283310049
driven_any_mean0.9079655994745708
driven_any_median0.7959534300907974
driven_any_min0.5303303310165024
driven_lanedir_consec_max1.7159325966482974
driven_lanedir_consec_mean0.5122063347338529
driven_lanedir_consec_min0.2202216963066923
driven_lanedir_max1.7159325966482974
driven_lanedir_mean0.5152442527542744
driven_lanedir_median0.30402283162098764
driven_lanedir_min0.2202216963066923
in-drivable-lane_max6.600000000000024
in-drivable-lane_mean2.323333333333332
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1494503910875793, "sim_physics": 0.10358374118804932, "survival_time": 8.499999999999986, "driven_lanedir": 0.6565509836861607, "sim_render-ego": 0.06177226655623492, "in-drivable-lane": 2.6499999999999986, "agent_compute-ego": 0.19914377156425925, "deviation-heading": 1.6736725762328135, "set_robot_commands": 0.08967792006099926, "deviation-center-line": 0.3786418892512445, "driven_lanedir_consec": 0.6352922929876805, "sim_compute_sim_state": 0.03708499880398021, "sim_compute_performance-ego": 0.06584353166468003, "sim_compute_robot_state-ego": 0.06757954288931455}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.64066476452445, "sim_physics": 0.12368420759836832, "survival_time": 12.900000000000048, "driven_lanedir": 1.2723441540213836, "sim_render-ego": 0.06175023271131885, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.21751454634259837, "deviation-heading": 1.9087482414971244, "set_robot_commands": 0.09301152432611746, "deviation-center-line": 0.5179779264485237, "driven_lanedir_consec": 1.2723441540213836, "sim_compute_sim_state": 0.03941157437110132, "sim_compute_performance-ego": 0.07095158192538475, "sim_compute_robot_state-ego": 0.07426281862480696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8021142110614062, "sim_physics": 0.09794357482423172, "survival_time": 7.049999999999983, "driven_lanedir": 0.46780157266671374, "sim_render-ego": 0.05730730591090859, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.2076818655568657, "deviation-heading": 2.033670554184505, "set_robot_commands": 0.0916481204066716, "deviation-center-line": 0.4215563095900135, "driven_lanedir_consec": 0.46780157266671374, "sim_compute_sim_state": 0.03700806401300092, "sim_compute_performance-ego": 0.06446443720066801, "sim_compute_robot_state-ego": 0.06815715884485989}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5512651802958055, "sim_physics": 0.09372630773806104, "survival_time": 5.09999999999999, "driven_lanedir": 0.22677891307172837, "sim_render-ego": 0.05881020368314257, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.19310953570347208, "deviation-heading": 1.5818208745999327, "set_robot_commands": 0.08289515037162631, "deviation-center-line": 0.2997506836173763, "driven_lanedir_consec": 0.22184697737859205, "sim_compute_sim_state": 0.033966875543781354, "sim_compute_performance-ego": 0.06091374743218515, "sim_compute_robot_state-ego": 0.06451690898222082}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0634130167105256, "sim_physics": 0.10544547130321634, "survival_time": 8.699999999999989, "driven_lanedir": 0.6541658237462022, "sim_render-ego": 0.05891160444281567, "in-drivable-lane": 2.650000000000002, "agent_compute-ego": 0.19237179043649255, "deviation-heading": 0.9540508865563524, "set_robot_commands": 0.08669582591659722, "deviation-center-line": 0.35676444793000617, "driven_lanedir_consec": 0.6541658237462022, "sim_compute_sim_state": 0.03608707860968579, "sim_compute_performance-ego": 0.06474670459484232, "sim_compute_robot_state-ego": 0.06664853945545766}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.7042481730826933, "sim_physics": 0.12448220120535956, "survival_time": 7.199999999999982, "driven_lanedir": 0.25514999353857526, "sim_render-ego": 0.06157862312263913, "in-drivable-lane": 4.449999999999984, "agent_compute-ego": 0.225916079348988, "deviation-heading": 0.7957972465670914, "set_robot_commands": 0.09481671783659192, "deviation-center-line": 0.27395586048876214, "driven_lanedir_consec": 0.25514999353857526, "sim_compute_sim_state": 0.03956356313493517, "sim_compute_performance-ego": 0.06844651699066162, "sim_compute_robot_state-ego": 0.07483147415849897}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0136036231438654, "sim_physics": 0.1108462793486459, "survival_time": 6.999999999999983, "driven_lanedir": 0.6092043454658032, "sim_render-ego": 0.05986277716500418, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.21020264966147287, "deviation-heading": 1.741266057419484, "set_robot_commands": 0.0906983426639012, "deviation-center-line": 0.19237107114977212, "driven_lanedir_consec": 0.5919683111143703, "sim_compute_sim_state": 0.03851289238248553, "sim_compute_performance-ego": 0.0662750448499407, "sim_compute_robot_state-ego": 0.07184634549277169}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.3307611195584497, "sim_physics": 0.10967475008741716, "survival_time": 10.700000000000015, "driven_lanedir": 0.30402283162098764, "sim_render-ego": 0.05794673545338283, "in-drivable-lane": 6.600000000000024, "agent_compute-ego": 0.199751783754224, "deviation-heading": 1.6065697426440213, "set_robot_commands": 0.08748891420453508, "deviation-center-line": 0.2460750057446518, "driven_lanedir_consec": 0.30402283162098764, "sim_compute_sim_state": 0.03716301583798133, "sim_compute_performance-ego": 0.06528315811513741, "sim_compute_robot_state-ego": 0.06813076389170139}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.5303303310165024, "sim_physics": 0.10015204728367816, "survival_time": 4.149999999999993, "driven_lanedir": 0.2202216963066923, "sim_render-ego": 0.0645747270928808, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.21722290314823747, "deviation-heading": 0.9501460811598054, "set_robot_commands": 0.09833818458649048, "deviation-center-line": 0.13117151539853594, "driven_lanedir_consec": 0.2202216963066923, "sim_compute_sim_state": 0.039517813418284954, "sim_compute_performance-ego": 0.07281372346073749, "sim_compute_robot_state-ego": 0.0782841803079628}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.6312090336283087, "sim_physics": 0.09560308736913344, "survival_time": 5.09999999999999, "driven_lanedir": 0.28091082436924575, "sim_render-ego": 0.05984800235897887, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.19919786266252107, "deviation-heading": 1.1855227834021296, "set_robot_commands": 0.09189016445010316, "deviation-center-line": 0.18065348398282724, "driven_lanedir_consec": 0.28091082436924575, "sim_compute_sim_state": 0.038241243829914166, "sim_compute_performance-ego": 0.06703333527434106, "sim_compute_robot_state-ego": 0.06952424610362333}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7959534300907974, "sim_physics": 0.10360501348510268, "survival_time": 6.449999999999985, "driven_lanedir": 0.34931199935935375, "sim_render-ego": 0.05934026259784551, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.19432659666667612, "deviation-heading": 1.4269978730797008, "set_robot_commands": 0.08871792822845223, "deviation-center-line": 0.24509150777387015, "driven_lanedir_consec": 0.34931199935935375, "sim_compute_sim_state": 0.03625230826148691, "sim_compute_performance-ego": 0.0660285986671152, "sim_compute_robot_state-ego": 0.06841622951418855}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5486956659233059, "sim_physics": 0.1025622098342232, "survival_time": 4.599999999999992, "driven_lanedir": 0.22153895356933065, "sim_render-ego": 0.05992983735125998, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.21682943727659143, "deviation-heading": 1.3985596257139206, "set_robot_commands": 0.09222576151723448, "deviation-center-line": 0.16783628245582605, "driven_lanedir_consec": 0.22078361786334844, "sim_compute_sim_state": 0.038692868274191154, "sim_compute_performance-ego": 0.06700444221496582, "sim_compute_robot_state-ego": 0.07055514791737431}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.7284100283310049, "sim_physics": 0.12432448705037435, "survival_time": 14.950000000000076, "driven_lanedir": 1.7159325966482974, "sim_render-ego": 0.05848109324773153, "in-drivable-lane": 0, "agent_compute-ego": 0.20579790353775024, "deviation-heading": 1.4201224110565658, "set_robot_commands": 0.0917504644393921, "deviation-center-line": 0.7276746440916119, "driven_lanedir_consec": 1.7159325966482974, "sim_compute_sim_state": 0.03881040255228679, "sim_compute_performance-ego": 0.06556683619817098, "sim_compute_robot_state-ego": 0.07000837961832683}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.5448248586707799, "sim_physics": 0.11109061539173126, "survival_time": 3.999999999999994, "driven_lanedir": 0.24217527130851255, "sim_render-ego": 0.06471999883651733, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.23441464602947237, "deviation-heading": 1.1211181535825985, "set_robot_commands": 0.0992065817117691, "deviation-center-line": 0.12691729211332822, "driven_lanedir_consec": 0.24101371777598943, "sim_compute_sim_state": 0.041731682419776914, "sim_compute_performance-ego": 0.07146121561527252, "sim_compute_robot_state-ego": 0.07996865510940551}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.584540164993086, "sim_physics": 0.09933919853039004, "survival_time": 4.449999999999992, "driven_lanedir": 0.25255383193513037, "sim_render-ego": 0.061054034179516055, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.210978858926323, "deviation-heading": 1.4352031337493742, "set_robot_commands": 0.0946579006280792, "deviation-center-line": 0.196458131620088, "driven_lanedir_consec": 0.252328611610364, "sim_compute_sim_state": 0.03870952263307035, "sim_compute_performance-ego": 0.06781182932050041, "sim_compute_robot_state-ego": 0.07085774989610308}}
set_robot_commands_max0.0992065817117691
set_robot_commands_mean0.09158130008990405
set_robot_commands_median0.0917504644393921
set_robot_commands_min0.08289515037162631
sim_compute_performance-ego_max0.07281372346073749
sim_compute_performance-ego_mean0.0669763135683069
sim_compute_performance-ego_median0.0662750448499407
sim_compute_performance-ego_min0.06091374743218515
sim_compute_robot_state-ego_max0.07996865510940551
sim_compute_robot_state-ego_mean0.07090587605377442
sim_compute_robot_state-ego_median0.07000837961832683
sim_compute_robot_state-ego_min0.06451690898222082
sim_compute_sim_state_max0.041731682419776914
sim_compute_sim_state_mean0.03805026027239753
sim_compute_sim_state_median0.03851289238248553
sim_compute_sim_state_min0.033966875543781354
sim_physics_max0.12448220120535956
sim_physics_mean0.10707087948253216
sim_physics_median0.10360501348510268
sim_physics_min0.09372630773806104
sim_render-ego_max0.06471999883651733
sim_render-ego_mean0.06039251364734512
sim_render-ego_median0.05986277716500418
sim_render-ego_min0.05730730591090859
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.390000000000001
survival_time_min3.999999999999994
207742932Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrorno8450:01:57
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
207602964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno8450:41:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2964/step1-simulation-ip-172-31-42-167-7194-job20760/logs/challenges-runner/stdout.log'
(hidden)