AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 845

evaluator845
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7194
versiond-c:4.0.19;d-c-r:4.0.30;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success28
# timeout
# failed
# error16
# aborted
# host-error15
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.8 GB
Disk (MB)96.9 GB
Disk available (MB)53.9 GB
Docker Hub
P11
P2
Cloud simulations
PI Camera0
# Duckiebots0
Map 3x3 avaiable0
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
215543220AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessno8450:17:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.11889606217543285
agent_compute-ego_mean0.09569274116425076
agent_compute-ego_median0.08783868686881607
agent_compute-ego_min0.0868136057486901
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1376649186580996, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.046490445921692665, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11137564574615864, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0716216352921498, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.02805747865121576, "sim_compute_performance-ego": 0.04907510552225234, "sim_compute_robot_state-ego": 0.051408284827123715, "sim_compute_robot_state-npc0": 0.051249709310410896, "sim_compute_robot_state-npc1": 0.05182195011573502, "sim_compute_robot_state-npc2": 0.05150762992569163, "sim_compute_robot_state-npc3": 0.0510152985778036}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.13530401672635758, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.04592233044760568, "in-drivable-lane": 0, "agent_compute-ego": 0.107248774596623, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06794045652662005, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.0265069774218968, "sim_compute_performance-ego": 0.04905926329748971, "sim_compute_robot_state-ego": 0.05196744203567505, "sim_compute_robot_state-npc0": 0.05144391741071429, "sim_compute_robot_state-npc1": 0.057449936866760254, "sim_compute_robot_state-npc2": 0.04774745873042515, "sim_compute_robot_state-npc3": 0.046428024768829346}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1342087879921626, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04701360915471049, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1181353527365379, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07394248305015194, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.029090251737427943, "sim_compute_performance-ego": 0.053631062646514, "sim_compute_robot_state-ego": 0.0510743381907639, "sim_compute_robot_state-npc0": 0.05572871328557579, "sim_compute_robot_state-npc1": 0.05360590601430356, "sim_compute_robot_state-npc2": 0.05031938460266706, "sim_compute_robot_state-npc3": 0.05138029635531231}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1448084612687429, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.043710788091023765, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11889606217543285, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07274247705936432, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.027300457159678142, "sim_compute_performance-ego": 0.04700277745723725, "sim_compute_robot_state-ego": 0.047461628913879395, "sim_compute_robot_state-npc0": 0.05205709238847097, "sim_compute_robot_state-npc1": 0.05002166827519735, "sim_compute_robot_state-npc2": 0.048275391260782875, "sim_compute_robot_state-npc3": 0.048860410849253334}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.13150192442394437, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04178074428013393, "in-drivable-lane": 0, "agent_compute-ego": 0.10217055820283436, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.05969617480323428, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.02708269300914946, "sim_compute_performance-ego": 0.04631932576497396, "sim_compute_robot_state-ego": 0.04687632833208357, "sim_compute_robot_state-npc0": 0.04739763623192197, "sim_compute_robot_state-npc1": 0.046098368508475165, "sim_compute_robot_state-npc2": 0.05282719930013021, "sim_compute_robot_state-npc3": 0.04644722030276344}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.10388206007951747, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.03592484297152765, "in-drivable-lane": 2, "agent_compute-ego": 0.08783868686881607, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.05478526732164943, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.023762518774249595, "sim_compute_performance-ego": 0.03868859542344145, "sim_compute_robot_state-ego": 0.04114995031299705, "sim_compute_robot_state-npc0": 0.040367374877015985, "sim_compute_robot_state-npc1": 0.039742842405856016, "sim_compute_robot_state-npc2": 0.03958014956491436, "sim_compute_robot_state-npc3": 0.03971273742036191}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.11132204879834814, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.04215276588514013, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0875901550922579, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.054743880207098805, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02236592885359977, "sim_compute_performance-ego": 0.04072859680768356, "sim_compute_robot_state-ego": 0.04030356129396309, "sim_compute_robot_state-npc0": 0.04002613697237181, "sim_compute_robot_state-npc1": 0.039002418518066406, "sim_compute_robot_state-npc2": 0.03885218009208013, "sim_compute_robot_state-npc3": 0.03880670001205889}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.11398381233215332, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.03642405986785888, "in-drivable-lane": 0, "agent_compute-ego": 0.09191505908966063, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.05392534255981445, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.022822132110595705, "sim_compute_performance-ego": 0.03824660301208496, "sim_compute_robot_state-ego": 0.04036633968353272, "sim_compute_robot_state-npc0": 0.03990102767944336, "sim_compute_robot_state-npc1": 0.03974318504333496, "sim_compute_robot_state-npc2": 0.03917370796203613, "sim_compute_robot_state-npc3": 0.039241485595703125}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.10321545142393844, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03579159424855159, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08724980629407443, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.054338615674238935, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.022460804535792425, "sim_compute_performance-ego": 0.04138764968285194, "sim_compute_robot_state-ego": 0.04020752815099863, "sim_compute_robot_state-npc0": 0.04000105766149667, "sim_compute_robot_state-npc1": 0.03894506050990178, "sim_compute_robot_state-npc2": 0.038894364467033975, "sim_compute_robot_state-npc3": 0.03920409771112295}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.11915843303386982, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03616258731255165, "in-drivable-lane": 0, "agent_compute-ego": 0.08810020410097562, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.05430450806250939, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.02221673268538255, "sim_compute_performance-ego": 0.03860158186692458, "sim_compute_robot_state-ego": 0.04107754047100361, "sim_compute_robot_state-npc0": 0.03975388636955848, "sim_compute_robot_state-npc1": 0.03899177221151499, "sim_compute_robot_state-npc2": 0.03894628928257869, "sim_compute_robot_state-npc3": 0.03884713466350849}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.1080343398180875, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.03618157993663441, "in-drivable-lane": 0, "agent_compute-ego": 0.0869559266350486, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.05382627790624445, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.022132450884038753, "sim_compute_performance-ego": 0.039835485545071686, "sim_compute_robot_state-ego": 0.04047378626736728, "sim_compute_robot_state-npc0": 0.03993794051083652, "sim_compute_robot_state-npc1": 0.038779833100058815, "sim_compute_robot_state-npc2": 0.03846245462244207, "sim_compute_robot_state-npc3": 0.03857508572665128}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.09894132614135742, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.03547544479370117, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08710754871368408, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.05374613761901856, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.022300586700439457, "sim_compute_performance-ego": 0.038331708908081054, "sim_compute_robot_state-ego": 0.040228967666625974, "sim_compute_robot_state-npc0": 0.04044147968292236, "sim_compute_robot_state-npc1": 0.0392544412612915, "sim_compute_robot_state-npc2": 0.03890676975250244, "sim_compute_robot_state-npc3": 0.0387905216217041}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.10438625863257876, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.03546393171269843, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08696058455933915, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.054314897415485786, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.022295959452365306, "sim_compute_performance-ego": 0.0379666343648383, "sim_compute_robot_state-ego": 0.040279824683006775, "sim_compute_robot_state-npc0": 0.03964665849158104, "sim_compute_robot_state-npc1": 0.03895927743708834, "sim_compute_robot_state-npc2": 0.03885722413976142, "sim_compute_robot_state-npc3": 0.03924124545239387}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10048696169486412, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.035392545736753024, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0868136057486901, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.05384903687697191, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.022197530819819525, "sim_compute_performance-ego": 0.038967325137211725, "sim_compute_robot_state-ego": 0.040309594227717474, "sim_compute_robot_state-npc0": 0.0405206955396212, "sim_compute_robot_state-npc1": 0.03914334223820613, "sim_compute_robot_state-npc2": 0.03875061181875376, "sim_compute_robot_state-npc3": 0.03891458878150353}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.10115135510762532, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.035282614117576966, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.0870331469036284, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.05382852327255976, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02224156970069522, "sim_compute_performance-ego": 0.03798954827444894, "sim_compute_robot_state-ego": 0.040123573939005536, "sim_compute_robot_state-npc0": 0.03958408037821451, "sim_compute_robot_state-npc1": 0.038920749936785015, "sim_compute_robot_state-npc2": 0.03914700689769927, "sim_compute_robot_state-npc3": 0.039073971339634486}}
set_robot_commands_max0.07394248305015194
set_robot_commands_mean0.059173714243140794
set_robot_commands_median0.054338615674238935
set_robot_commands_min0.05374613761901856
sim_compute_performance-ego_max0.053631062646514
sim_compute_performance-ego_mean0.04238875091407369
sim_compute_performance-ego_median0.039835485545071686
sim_compute_performance-ego_min0.0379666343648383
sim_compute_robot_state-ego_max0.05196744203567505
sim_compute_robot_state-ego_mean0.043553912599716256
sim_compute_robot_state-ego_median0.04047378626736728
sim_compute_robot_state-ego_min0.040123573939005536
sim_compute_robot_state-npc0_max0.05572871328557579
sim_compute_robot_state-npc0_mean0.04387049378601039
sim_compute_robot_state-npc0_median0.040367374877015985
sim_compute_robot_state-npc0_min0.03958408037821451
sim_compute_robot_state-npc1_max0.057449936866760254
sim_compute_robot_state-npc1_mean0.04336538349617169
sim_compute_robot_state-npc1_median0.0392544412612915
sim_compute_robot_state-npc1_min0.038779833100058815
sim_compute_robot_state-npc2_max0.05282719930013021
sim_compute_robot_state-npc2_mean0.04268318816129994
sim_compute_robot_state-npc2_median0.03914700689769927
sim_compute_robot_state-npc2_min0.03846245462244207
sim_compute_robot_state-npc3_max0.05138029635531231
sim_compute_robot_state-npc3_mean0.042302587945240305
sim_compute_robot_state-npc3_median0.03924124545239387
sim_compute_robot_state-npc3_min0.03857508572665128
sim_compute_sim_state_max0.029090251737427943
sim_compute_sim_state_mean0.02418893816642309
sim_compute_sim_state_median0.022460804535792425
sim_compute_sim_state_min0.022132450884038753
sim_physics_max0.1448084612687429
sim_physics_mean0.11653667707544316
sim_physics_median0.11132204879834814
sim_physics_min0.09894132614135742
sim_render-ego_max0.04701360915471049
sim_render-ego_mean0.03927799229854402
sim_render-ego_median0.03618157993663441
sim_render-ego_min0.035282614117576966
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
214683164awoo424Roasted duckaido2-LF-sim-validationstep1-simulationsuccessno8450:10:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3469843068996177
survival_time_median5.249999999999989
deviation-center-line_median0.3073183948696125
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.1273355029878162
agent_compute-ego_mean0.12503875004991652
agent_compute-ego_median0.12459038654963175
agent_compute-ego_min0.12394006628739208
deviation-center-line_max0.8508939147056557
deviation-center-line_mean0.41815376444419866
deviation-center-line_min0.28047991410230216
deviation-heading_max2.0789451327606305
deviation-heading_mean1.7677784742023193
deviation-heading_median1.8787843619783744
deviation-heading_min1.0799516136348926
driven_any_max1.092829462872696
driven_any_mean0.5611117310162739
driven_any_median0.3912360782722368
driven_any_min0.19319242538978615
driven_lanedir_consec_max1.0747418735491343
driven_lanedir_consec_mean0.5020634950065043
driven_lanedir_consec_min0.1771457454437826
driven_lanedir_max1.0747418735491343
driven_lanedir_mean0.5020634950065043
driven_lanedir_median0.3469843068996177
driven_lanedir_min0.1771457454437826
in-drivable-lane_max1.550000000000022
in-drivable-lane_mean0.3700000000000042
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.092829462872696, "sim_physics": 0.05941671848297119, "survival_time": 14.950000000000076, "driven_lanedir": 1.0747418735491343, "sim_render-ego": 0.037487085660298666, "in-drivable-lane": 0, "agent_compute-ego": 0.12459038654963175, "deviation-heading": 2.0789451327606305, "set_robot_commands": 0.0555642302831014, "deviation-center-line": 0.8508939147056557, "driven_lanedir_consec": 1.0747418735491343, "sim_compute_sim_state": 0.0243882950146993, "sim_compute_performance-ego": 0.03978006521860759, "sim_compute_robot_state-ego": 0.04103028217951456}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8257154880953131, "sim_physics": 0.05661429933539019, "survival_time": 10.650000000000016, "driven_lanedir": 0.6669629561151792, "sim_render-ego": 0.04042156649307466, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.12433633334200148, "deviation-heading": 1.8787843619783744, "set_robot_commands": 0.05549490507779547, "deviation-center-line": 0.361621453791084, "driven_lanedir_consec": 0.6669629561151792, "sim_compute_sim_state": 0.02356605910359414, "sim_compute_performance-ego": 0.04027161575818845, "sim_compute_robot_state-ego": 0.04232074621137879}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19319242538978615, "sim_physics": 0.05769525076213636, "survival_time": 2.849999999999998, "driven_lanedir": 0.1771457454437826, "sim_render-ego": 0.035763648518344814, "in-drivable-lane": 0, "agent_compute-ego": 0.12394006628739208, "deviation-heading": 1.0799516136348926, "set_robot_commands": 0.055745743868643775, "deviation-center-line": 0.3073183948696125, "driven_lanedir_consec": 0.1771457454437826, "sim_compute_sim_state": 0.02383069406475937, "sim_compute_performance-ego": 0.04034789821557831, "sim_compute_robot_state-ego": 0.040463991332472415}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.30258520045133747, "sim_physics": 0.060721653479116934, "survival_time": 4.049999999999994, "driven_lanedir": 0.24448259302480757, "sim_render-ego": 0.036864392551375025, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.12499146108274106, "deviation-heading": 1.995238934450004, "set_robot_commands": 0.055282551565288024, "deviation-center-line": 0.28047991410230216, "driven_lanedir_consec": 0.24448259302480757, "sim_compute_sim_state": 0.02360075785789961, "sim_compute_performance-ego": 0.04094513551688489, "sim_compute_robot_state-ego": 0.041194771542961216}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3912360782722368, "sim_physics": 0.05727074032738095, "survival_time": 5.249999999999989, "driven_lanedir": 0.3469843068996177, "sim_render-ego": 0.03698038827805292, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1273355029878162, "deviation-heading": 1.8059723281876945, "set_robot_commands": 0.05782610575358073, "deviation-center-line": 0.29045514475233897, "driven_lanedir_consec": 0.3469843068996177, "sim_compute_sim_state": 0.02385658763703846, "sim_compute_performance-ego": 0.040279293060302736, "sim_compute_robot_state-ego": 0.04362854957580566}}
set_robot_commands_max0.05782610575358073
set_robot_commands_mean0.05598270730968188
set_robot_commands_median0.0555642302831014
set_robot_commands_min0.055282551565288024
sim_compute_performance-ego_max0.04094513551688489
sim_compute_performance-ego_mean0.0403248015539124
sim_compute_performance-ego_median0.040279293060302736
sim_compute_performance-ego_min0.03978006521860759
sim_compute_robot_state-ego_max0.04362854957580566
sim_compute_robot_state-ego_mean0.04172766816842653
sim_compute_robot_state-ego_median0.041194771542961216
sim_compute_robot_state-ego_min0.040463991332472415
sim_compute_sim_state_max0.0243882950146993
sim_compute_sim_state_mean0.02384847873559818
sim_compute_sim_state_median0.02383069406475937
sim_compute_sim_state_min0.02356605910359414
sim_physics_max0.060721653479116934
sim_physics_mean0.05834373247739912
sim_physics_median0.05769525076213636
sim_physics_min0.05661429933539019
sim_render-ego_max0.04042156649307466
sim_render-ego_mean0.037503416300229214
sim_render-ego_median0.03698038827805292
sim_render-ego_min0.035763648518344814
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.550000000000014
survival_time_min2.849999999999998
214623160aklebanPython templateaido2-AMOD-service_qualitystep1-simulationsuccessyes8450:03:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
214453148JBRRussiachallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno8450:22:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9914518035561424
survival_time_median7.199999999999982
deviation-center-line_median0.5482174238357636
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.06154879279758619
agent_compute-ego_mean0.05866214724490917
agent_compute-ego_median0.058969167868296306
agent_compute-ego_min0.05473165273666382
deviation-center-line_max1.1549293248363104
deviation-center-line_mean0.6560872343499965
deviation-center-line_min0.27566649158998696
deviation-heading_max5.22185776945057
deviation-heading_mean2.3124316949010417
deviation-heading_median1.621570465411234
deviation-heading_min0.4978438120666323
driven_any_max2.3489924079737317
driven_any_mean1.2679604101163109
driven_any_median1.1035277340316625
driven_any_min0.3642178234482664
driven_lanedir_consec_max1.9639129987932065
driven_lanedir_consec_mean0.9569362144302236
driven_lanedir_consec_min0.2938457271940503
driven_lanedir_max2.1132242040932425
driven_lanedir_mean1.0820033214890112
driven_lanedir_median1.043575427009693
driven_lanedir_min0.35626751354370434
in-drivable-lane_max2.8500000000000405
in-drivable-lane_mean0.5633333333333372
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.341401142888106, "sim_physics": 0.06445955673853557, "survival_time": 14.950000000000076, "driven_lanedir": 1.910409896713289, "sim_render-ego": 0.03793974955876668, "in-drivable-lane": 1.100000000000005, "agent_compute-ego": 0.058969167868296306, "deviation-heading": 5.22185776945057, "set_robot_commands": 0.05665533542633057, "deviation-center-line": 1.1549293248363104, "driven_lanedir_consec": 0.9914518035561424, "sim_compute_sim_state": 0.02473978996276855, "sim_compute_performance-ego": 0.04130259116490682, "sim_compute_robot_state-ego": 0.04279916365941366}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6614334363496972, "sim_physics": 0.06691499506489615, "survival_time": 4.449999999999992, "driven_lanedir": 0.4640934824743561, "sim_render-ego": 0.03850770532415154, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.0595972484417176, "deviation-heading": 2.1621026545427737, "set_robot_commands": 0.055251266179459815, "deviation-center-line": 0.3875508947793393, "driven_lanedir_consec": 0.2938457271940503, "sim_compute_sim_state": 0.024468660354614254, "sim_compute_performance-ego": 0.04134774475954891, "sim_compute_robot_state-ego": 0.04301087775926912}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3642178234482664, "sim_physics": 0.06487685441970825, "survival_time": 2.5999999999999988, "driven_lanedir": 0.35626751354370434, "sim_render-ego": 0.037158007805164046, "in-drivable-lane": 0, "agent_compute-ego": 0.05843996543150682, "deviation-heading": 0.4978438120666323, "set_robot_commands": 0.05569258561501136, "deviation-center-line": 0.27566649158998696, "driven_lanedir_consec": 0.35626751354370434, "sim_compute_sim_state": 0.024899941224318285, "sim_compute_performance-ego": 0.0424469388448275, "sim_compute_robot_state-ego": 0.04224674976789034}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1035277340316625, "sim_physics": 0.06722839507791731, "survival_time": 7.199999999999982, "driven_lanedir": 1.043575427009693, "sim_render-ego": 0.037779261668523155, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05660428603490194, "deviation-heading": 1.5274060299708705, "set_robot_commands": 0.05580153730180529, "deviation-center-line": 0.634358446664162, "driven_lanedir_consec": 1.043575427009693, "sim_compute_sim_state": 0.02463195224603017, "sim_compute_performance-ego": 0.041647871335347496, "sim_compute_robot_state-ego": 0.043010744783613414}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2963448385328344, "sim_physics": 0.06186861509368533, "survival_time": 8.399999999999984, "driven_lanedir": 1.1268758095828502, "sim_render-ego": 0.03802173478262765, "in-drivable-lane": 0.4000000000000048, "agent_compute-ego": 0.060507457880746754, "deviation-heading": 2.4791529897198132, "set_robot_commands": 0.05557915852183387, "deviation-center-line": 0.46184479555842567, "driven_lanedir_consec": 1.1268758095828502, "sim_compute_sim_state": 0.025056095350356328, "sim_compute_performance-ego": 0.041422506173451744, "sim_compute_robot_state-ego": 0.04387692326591128}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348852620013533, "sim_physics": 0.0639325992266337, "survival_time": 14.950000000000076, "driven_lanedir": 1.7431548850278498, "sim_render-ego": 0.03774898131688436, "in-drivable-lane": 2.4000000000000075, "agent_compute-ego": 0.058240938981374106, "deviation-heading": 4.788984007078123, "set_robot_commands": 0.05512742837270101, "deviation-center-line": 1.033990625937084, "driven_lanedir_consec": 1.2058766617957308, "sim_compute_sim_state": 0.024862957795461015, "sim_compute_performance-ego": 0.04153526782989502, "sim_compute_robot_state-ego": 0.043649100462595625}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7579564038770219, "sim_physics": 0.060833765728638904, "survival_time": 5.04999999999999, "driven_lanedir": 0.6949633516763912, "sim_render-ego": 0.03755519177654002, "in-drivable-lane": 0, "agent_compute-ego": 0.05965355599280631, "deviation-heading": 1.5306961654978168, "set_robot_commands": 0.05488526230991477, "deviation-center-line": 0.3096478467765337, "driven_lanedir_consec": 0.6949633516763912, "sim_compute_sim_state": 0.02439521326877103, "sim_compute_performance-ego": 0.04096208232464177, "sim_compute_robot_state-ego": 0.04255768096092904}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5374374128862014, "sim_physics": 0.06334417757361827, "survival_time": 9.900000000000006, "driven_lanedir": 1.359438187508489, "sim_render-ego": 0.037913763161861534, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0603054328398271, "deviation-heading": 2.5980013889217637, "set_robot_commands": 0.05467716371170198, "deviation-center-line": 0.9298986577524728, "driven_lanedir_consec": 1.359438187508489, "sim_compute_sim_state": 0.025032558826485064, "sim_compute_performance-ego": 0.04248077821249914, "sim_compute_robot_state-ego": 0.04282891148268574}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4249683891755474, "sim_physics": 0.060494465672451515, "survival_time": 9.199999999999996, "driven_lanedir": 1.3956472004325238, "sim_render-ego": 0.037342764761136925, "in-drivable-lane": 0, "agent_compute-ego": 0.05576889022536899, "deviation-heading": 1.621570465411234, "set_robot_commands": 0.05504650136698847, "deviation-center-line": 0.9126230182500316, "driven_lanedir_consec": 1.3956472004325238, "sim_compute_sim_state": 0.02457206145576809, "sim_compute_performance-ego": 0.0410524308681488, "sim_compute_robot_state-ego": 0.04270218377527983}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5008166923158887, "sim_physics": 0.0618967284326968, "survival_time": 3.4499999999999957, "driven_lanedir": 0.4458441241922335, "sim_render-ego": 0.03788173025932865, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06154879279758619, "deviation-heading": 0.7591340945096213, "set_robot_commands": 0.05439400327378425, "deviation-center-line": 0.29795337218661855, "driven_lanedir_consec": 0.4458441241922335, "sim_compute_sim_state": 0.02485956316408904, "sim_compute_performance-ego": 0.040931411411451256, "sim_compute_robot_state-ego": 0.042496774507605514}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7338793017752316, "sim_physics": 0.06467451611343696, "survival_time": 4.899999999999991, "driven_lanedir": 0.7261903220114927, "sim_render-ego": 0.03753080416698845, "in-drivable-lane": 0, "agent_compute-ego": 0.06019243415521116, "deviation-heading": 0.5849673074380232, "set_robot_commands": 0.061560689186563294, "deviation-center-line": 0.5482174238357636, "driven_lanedir_consec": 0.7261903220114927, "sim_compute_sim_state": 0.024547095201453383, "sim_compute_performance-ego": 0.04084647188381273, "sim_compute_robot_state-ego": 0.04291250267807318}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5008191431794814, "sim_physics": 0.06412624967271004, "survival_time": 3.4499999999999957, "driven_lanedir": 0.44722153824804034, "sim_render-ego": 0.03775756946508435, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06090278556381447, "deviation-heading": 0.7920243769762986, "set_robot_commands": 0.055588632390119026, "deviation-center-line": 0.29627888798551183, "driven_lanedir_consec": 0.44722153824804034, "sim_compute_sim_state": 0.02430491516555565, "sim_compute_performance-ego": 0.040826966797096145, "sim_compute_robot_state-ego": 0.04262080399886421}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.3489924079737317, "sim_physics": 0.0606184728940328, "survival_time": 14.950000000000076, "driven_lanedir": 2.1132242040932425, "sim_render-ego": 0.037612547079722086, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.05731197198232015, "deviation-heading": 4.796992706882113, "set_robot_commands": 0.054840238094329835, "deviation-center-line": 1.106000759837224, "driven_lanedir_consec": 1.9639129987932065, "sim_compute_sim_state": 0.024397624333699543, "sim_compute_performance-ego": 0.04205873727798462, "sim_compute_robot_state-ego": 0.04268139123916626}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7499498946440516, "sim_physics": 0.061876151561737064, "survival_time": 4.99999999999999, "driven_lanedir": 0.736007772718966, "sim_render-ego": 0.037626523971557614, "in-drivable-lane": 0, "agent_compute-ego": 0.05473165273666382, "deviation-heading": 0.8542178431466543, "set_robot_commands": 0.05538791179656982, "deviation-center-line": 0.4484620184176361, "driven_lanedir_consec": 0.736007772718966, "sim_compute_sim_state": 0.024517600536346437, "sim_compute_performance-ego": 0.04120627641677856, "sim_compute_robot_state-ego": 0.042646360397338864}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.348808910653408, "sim_physics": 0.06421884934107462, "survival_time": 14.950000000000076, "driven_lanedir": 1.6671361071020454, "sim_render-ego": 0.03776227871576945, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.05715762774149577, "deviation-heading": 4.471523811903315, "set_robot_commands": 0.0556183115641276, "deviation-center-line": 1.043885950842846, "driven_lanedir_consec": 1.566924778189836, "sim_compute_sim_state": 0.024765522480010987, "sim_compute_performance-ego": 0.04098934014638265, "sim_compute_robot_state-ego": 0.04246569474538167}}
set_robot_commands_max0.061560689186563294
set_robot_commands_mean0.05574040167408272
set_robot_commands_median0.05538791179656982
set_robot_commands_min0.05439400327378425
sim_compute_performance-ego_max0.04248077821249914
sim_compute_performance-ego_mean0.041403827696451546
sim_compute_performance-ego_median0.04130259116490682
sim_compute_performance-ego_min0.040826966797096145
sim_compute_robot_state-ego_max0.04387692326591128
sim_compute_robot_state-ego_mean0.04283372423226785
sim_compute_robot_state-ego_median0.04270218377527983
sim_compute_robot_state-ego_min0.04224674976789034
sim_compute_sim_state_max0.025056095350356328
sim_compute_sim_state_mean0.02467010342438186
sim_compute_sim_state_median0.02463195224603017
sim_compute_sim_state_min0.02430491516555565
sim_physics_max0.06722839507791731
sim_physics_mean0.0634242928407849
sim_physics_median0.0639325992266337
sim_physics_min0.060494465672451515
sim_render-ego_max0.03850770532415154
sim_render-ego_mean0.03774257425427377
sim_render-ego_median0.03775756946508435
sim_render-ego_min0.037158007805164046
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.22666666666668
survival_time_min2.5999999999999988
214353145AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessno8450:18:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.11971490822949456
agent_compute-ego_mean0.09815898108472054
agent_compute-ego_median0.09195340156555176
agent_compute-ego_min0.08757725587257972
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.13716640653489512, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.049434037148198, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11042831215677382, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.06784438181527053, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.0282882346382624, "sim_compute_performance-ego": 0.04825026174134846, "sim_compute_robot_state-ego": 0.05489301983314224, "sim_compute_robot_state-npc0": 0.050183389760270904, "sim_compute_robot_state-npc1": 0.05031887790824793, "sim_compute_robot_state-npc2": 0.04935928839671461, "sim_compute_robot_state-npc3": 0.04906127724466445}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1385188102722168, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.042606311185019355, "in-drivable-lane": 0, "agent_compute-ego": 0.10849771329334804, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06800764799118042, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.028542748519352505, "sim_compute_performance-ego": 0.044943502971104214, "sim_compute_robot_state-ego": 0.04970212493624006, "sim_compute_robot_state-npc0": 0.04953763314655849, "sim_compute_robot_state-npc1": 0.04815731729779925, "sim_compute_robot_state-npc2": 0.04793615000588553, "sim_compute_robot_state-npc3": 0.048108109406062534}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.14176954112006623, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04769153270906615, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11971490822949456, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07282648966150376, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.031014572069482896, "sim_compute_performance-ego": 0.05034355052466531, "sim_compute_robot_state-ego": 0.052476429244846974, "sim_compute_robot_state-npc0": 0.05616254482454466, "sim_compute_robot_state-npc1": 0.054611449102753576, "sim_compute_robot_state-npc2": 0.05428511425129418, "sim_compute_robot_state-npc3": 0.053967739771870735}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.14928274850050607, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.047462448477745056, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11722981929779051, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07265906035900116, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03250265618165334, "sim_compute_performance-ego": 0.05518214901288351, "sim_compute_robot_state-ego": 0.05518616239229838, "sim_compute_robot_state-npc0": 0.053940470019976296, "sim_compute_robot_state-npc1": 0.054489120841026306, "sim_compute_robot_state-npc2": 0.05384333928426107, "sim_compute_robot_state-npc3": 0.05585878590742747}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1471715995243617, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04498370488484701, "in-drivable-lane": 0, "agent_compute-ego": 0.11081417401631671, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.06951508067903064, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03211193992978051, "sim_compute_performance-ego": 0.048916532879783994, "sim_compute_robot_state-ego": 0.05034615879967099, "sim_compute_robot_state-npc0": 0.048187914348783945, "sim_compute_robot_state-npc1": 0.050111884162539526, "sim_compute_robot_state-npc2": 0.056607019333612354, "sim_compute_robot_state-npc3": 0.053315741675240655}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.11579566944145156, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.03919615145928845, "in-drivable-lane": 2, "agent_compute-ego": 0.09662273544037414, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.05854253283517803, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.025399495027736276, "sim_compute_performance-ego": 0.04209602949861995, "sim_compute_robot_state-ego": 0.04317239373030063, "sim_compute_robot_state-npc0": 0.044149483035424514, "sim_compute_robot_state-npc1": 0.043637858179514995, "sim_compute_robot_state-npc2": 0.043894092479865705, "sim_compute_robot_state-npc3": 0.0430588907824305}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.11358720122031796, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.0373881765939657, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08918102505137619, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.05960192958128105, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02383641594821967, "sim_compute_performance-ego": 0.04021765884843845, "sim_compute_robot_state-ego": 0.04148388371884244, "sim_compute_robot_state-npc0": 0.04156775613432949, "sim_compute_robot_state-npc1": 0.04079631925786583, "sim_compute_robot_state-npc2": 0.04060621863429986, "sim_compute_robot_state-npc3": 0.041048360102384995}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.12102121829986572, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.03718843460083008, "in-drivable-lane": 0, "agent_compute-ego": 0.08922771453857421, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.055349264144897464, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.02369203567504883, "sim_compute_performance-ego": 0.03977834701538086, "sim_compute_robot_state-ego": 0.0471280574798584, "sim_compute_robot_state-npc0": 0.04121835708618164, "sim_compute_robot_state-npc1": 0.040769615173339845, "sim_compute_robot_state-npc2": 0.04189007759094238, "sim_compute_robot_state-npc3": 0.04087158203125}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.10525366893181434, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03752008768228384, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0897532793191763, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.05545299328290499, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.02386924853691688, "sim_compute_performance-ego": 0.040302203251765326, "sim_compute_robot_state-ego": 0.04553395968217116, "sim_compute_robot_state-npc0": 0.0411489330805265, "sim_compute_robot_state-npc1": 0.040959408650031455, "sim_compute_robot_state-npc2": 0.04083969501348642, "sim_compute_robot_state-npc3": 0.04099723008962778}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.12932024552271917, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03963512640732985, "in-drivable-lane": 0, "agent_compute-ego": 0.09599724182715784, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.0557262714092548, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.024259172953092135, "sim_compute_performance-ego": 0.03999800865466778, "sim_compute_robot_state-ego": 0.04136202885554387, "sim_compute_robot_state-npc0": 0.04116739676548885, "sim_compute_robot_state-npc1": 0.04088598031264085, "sim_compute_robot_state-npc2": 0.04072228761819693, "sim_compute_robot_state-npc3": 0.04085811284872202}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.11604588682001288, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.03785796598954634, "in-drivable-lane": 0, "agent_compute-ego": 0.08914517272602428, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.05484531142494895, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.02391176873987371, "sim_compute_performance-ego": 0.04005954482338645, "sim_compute_robot_state-ego": 0.04129953817887739, "sim_compute_robot_state-npc0": 0.0410001819783991, "sim_compute_robot_state-npc1": 0.04079794883728027, "sim_compute_robot_state-npc2": 0.04049401933496648, "sim_compute_robot_state-npc3": 0.041112661361694336}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.10475720882415772, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.037283315658569335, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.09195340156555176, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.05580208778381348, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.024075517654418944, "sim_compute_performance-ego": 0.03999893188476562, "sim_compute_robot_state-ego": 0.0414771318435669, "sim_compute_robot_state-npc0": 0.04137904167175293, "sim_compute_robot_state-npc1": 0.041015911102294925, "sim_compute_robot_state-npc2": 0.04076975822448731, "sim_compute_robot_state-npc3": 0.05052807807922363}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.1098555123552363, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.03742308819547613, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08825405861469025, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.05569633270831818, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.024011010819293084, "sim_compute_performance-ego": 0.0407095361263194, "sim_compute_robot_state-ego": 0.04143683200186871, "sim_compute_robot_state-npc0": 0.04115035432450315, "sim_compute_robot_state-npc1": 0.04096870219453852, "sim_compute_robot_state-npc2": 0.04064765382320323, "sim_compute_robot_state-npc3": 0.0409841740385015}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10726426197932316, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.03704586854347816, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.08757725587257972, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.05510913408719576, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.02370785749875582, "sim_compute_performance-ego": 0.039516875377068154, "sim_compute_robot_state-ego": 0.04114452233681312, "sim_compute_robot_state-npc0": 0.04122254481682411, "sim_compute_robot_state-npc1": 0.04182015932523287, "sim_compute_robot_state-npc2": 0.04019270951931293, "sim_compute_robot_state-npc3": 0.040635342781360335}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.10714112463451568, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03743889899480911, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.08798790432157971, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.054805814652215866, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02387214842296782, "sim_compute_performance-ego": 0.039737126940772645, "sim_compute_robot_state-ego": 0.04123052869524275, "sim_compute_robot_state-npc0": 0.04150993937537784, "sim_compute_robot_state-npc1": 0.041583801451183504, "sim_compute_robot_state-npc2": 0.040452371324811665, "sim_compute_robot_state-npc3": 0.0406380744207473}}
set_robot_commands_max0.07282648966150376
set_robot_commands_mean0.06078562216106634
set_robot_commands_median0.05580208778381348
set_robot_commands_min0.054805814652215866
sim_compute_performance-ego_max0.05518214901288351
sim_compute_performance-ego_mean0.04333668397006469
sim_compute_performance-ego_median0.040302203251765326
sim_compute_performance-ego_min0.039516875377068154
sim_compute_robot_state-ego_max0.05518616239229838
sim_compute_robot_state-ego_mean0.04585818478195228
sim_compute_robot_state-ego_median0.04317239373030063
sim_compute_robot_state-ego_min0.04114452233681312
sim_compute_robot_state-npc0_max0.05616254482454466
sim_compute_robot_state-npc0_mean0.04490172935792948
sim_compute_robot_state-npc0_median0.04150993937537784
sim_compute_robot_state-npc0_min0.0410001819783991
sim_compute_robot_state-npc1_max0.054611449102753576
sim_compute_robot_state-npc1_mean0.04472829025308597
sim_compute_robot_state-npc1_median0.041583801451183504
sim_compute_robot_state-npc1_min0.040769615173339845
sim_compute_robot_state-npc2_max0.056607019333612354
sim_compute_robot_state-npc2_mean0.044835986322356046
sim_compute_robot_state-npc2_median0.04083969501348642
sim_compute_robot_state-npc2_min0.04019270951931293
sim_compute_robot_state-npc3_max0.05585878590742747
sim_compute_robot_state-npc3_mean0.04540294403608056
sim_compute_robot_state-npc3_median0.041112661361694336
sim_compute_robot_state-npc3_min0.040635342781360335
sim_compute_sim_state_max0.03250265618165334
sim_compute_sim_state_mean0.026206321507656987
sim_compute_sim_state_median0.024075517654418944
sim_compute_sim_state_min0.02369203567504883
sim_physics_max0.14928274850050607
sim_physics_mean0.12293007359876404
sim_physics_median0.11604588682001288
sim_physics_min0.10475720882415772
sim_render-ego_max0.049434037148198
sim_render-ego_mean0.040677009902030166
sim_render-ego_median0.03785796598954634
sim_render-ego_min0.03704586854347816
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
214333134AmaurXPredictorLastaido2-PREDstep1-simulationsuccessno8450:00:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1053066938706594
error_L20.017717307653598375


214233125RamiNaim[0.35;0.75]aido2-LF-sim-validationstep1-simulationsuccessno8450:08:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6382908517619432
survival_time_median8.449999999999985
deviation-center-line_median0.7020216560985275
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.08101122796872241
agent_compute-ego_mean0.0790298765949238
agent_compute-ego_median0.08066507345120583
agent_compute-ego_min0.07583670117961827
deviation-center-line_max1.2921377241268523
deviation-center-line_mean0.692052188588834
deviation-center-line_min0.29412523591806844
deviation-heading_max4.313266459456157
deviation-heading_mean1.757179783008871
deviation-heading_median1.3658461538318751
deviation-heading_min0.30887069722993316
driven_any_max3.5746669592804254
driven_any_mean1.884824617175888
driven_any_median1.984995159214791
driven_any_min0.7376871652879832
driven_lanedir_consec_max2.8135482799771823
driven_lanedir_consec_mean1.587722210748803
driven_lanedir_consec_min0.734468095924476
driven_lanedir_max2.8135482799771823
driven_lanedir_mean1.587722210748803
driven_lanedir_median1.6382908517619432
driven_lanedir_min0.734468095924476
in-drivable-lane_max2.10000000000003
in-drivable-lane_mean0.8500000000000073
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0711695681860216, "sim_physics": 0.0645474579374669, "survival_time": 8.84999999999999, "driven_lanedir": 1.6382908517619432, "sim_render-ego": 0.03832734506682488, "in-drivable-lane": 1.3500000000000094, "agent_compute-ego": 0.08101122796872241, "deviation-heading": 1.740696182229741, "set_robot_commands": 0.056248713347871425, "deviation-center-line": 0.7020216560985275, "driven_lanedir_consec": 1.6382908517619432, "sim_compute_sim_state": 0.02506750316943153, "sim_compute_performance-ego": 0.04151254993374065, "sim_compute_robot_state-ego": 0.042759919570664225}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.055604233910218, "sim_physics": 0.059761129399781586, "survival_time": 4.6499999999999915, "driven_lanedir": 0.8124942431886749, "sim_render-ego": 0.039442508451400266, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07695396997595347, "deviation-heading": 1.057219422296649, "set_robot_commands": 0.056086832477200414, "deviation-center-line": 0.29412523591806844, "driven_lanedir_consec": 0.8124942431886749, "sim_compute_sim_state": 0.024654583264422672, "sim_compute_performance-ego": 0.04113680316555885, "sim_compute_robot_state-ego": 0.04341783062104256}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7376871652879832, "sim_physics": 0.061543325879680574, "survival_time": 3.349999999999996, "driven_lanedir": 0.734468095924476, "sim_render-ego": 0.03810662653908801, "in-drivable-lane": 0, "agent_compute-ego": 0.07583670117961827, "deviation-heading": 0.30887069722993316, "set_robot_commands": 0.056801361824149514, "deviation-center-line": 0.3781987713890312, "driven_lanedir_consec": 0.734468095924476, "sim_compute_sim_state": 0.025115347620266588, "sim_compute_performance-ego": 0.04177557888315685, "sim_compute_robot_state-ego": 0.0432794841367807}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.5746669592804254, "sim_physics": 0.0647878352801005, "survival_time": 14.950000000000076, "driven_lanedir": 2.8135482799771823, "sim_render-ego": 0.0379798690478007, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.08068241039911905, "deviation-heading": 4.313266459456157, "set_robot_commands": 0.05626055717468262, "deviation-center-line": 1.2921377241268523, "driven_lanedir_consec": 2.8135482799771823, "sim_compute_sim_state": 0.02481385707855225, "sim_compute_performance-ego": 0.04135525465011597, "sim_compute_robot_state-ego": 0.0425331711769104}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.984995159214791, "sim_physics": 0.06149942917231272, "survival_time": 8.449999999999985, "driven_lanedir": 1.939809582891738, "sim_render-ego": 0.03816461845262517, "in-drivable-lane": 0, "agent_compute-ego": 0.08066507345120583, "deviation-heading": 1.3658461538318751, "set_robot_commands": 0.055588699656830734, "deviation-center-line": 0.7937775554116906, "driven_lanedir_consec": 1.939809582891738, "sim_compute_sim_state": 0.025090757911727272, "sim_compute_performance-ego": 0.04139789462794919, "sim_compute_robot_state-ego": 0.04296076227221968}}
set_robot_commands_max0.056801361824149514
set_robot_commands_mean0.05619723289614694
set_robot_commands_median0.056248713347871425
set_robot_commands_min0.055588699656830734
sim_compute_performance-ego_max0.04177557888315685
sim_compute_performance-ego_mean0.041435616252104304
sim_compute_performance-ego_median0.04139789462794919
sim_compute_performance-ego_min0.04113680316555885
sim_compute_robot_state-ego_max0.04341783062104256
sim_compute_robot_state-ego_mean0.04299023355552352
sim_compute_robot_state-ego_median0.04296076227221968
sim_compute_robot_state-ego_min0.0425331711769104
sim_compute_sim_state_max0.025115347620266588
sim_compute_sim_state_mean0.024948409808880054
sim_compute_sim_state_median0.02506750316943153
sim_compute_sim_state_min0.024654583264422672
sim_physics_max0.0647878352801005
sim_physics_mean0.06242783553386846
sim_physics_median0.061543325879680574
sim_physics_min0.059761129399781586
sim_render-ego_max0.039442508451400266
sim_render-ego_mean0.03840419351154781
sim_render-ego_median0.03816461845262517
sim_render-ego_min0.0379798690478007
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.050000000000008
survival_time_min3.349999999999996
214213123RamiNaim[1;0.6]aido2-LF-sim-validationstep1-simulationsuccessno8450:11:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2971398688438205
survival_time_median14.950000000000076
deviation-center-line_median1.1289689758008865
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08119676828384399
agent_compute-ego_mean0.07893367324645388
agent_compute-ego_median0.07868190134985972
agent_compute-ego_min0.07632166862487794
deviation-center-line_max1.2949626659874092
deviation-center-line_mean0.9900846509881448
deviation-center-line_min0.20106101588658865
deviation-heading_max2.2295920528984157
deviation-heading_mean1.733705473844407
deviation-heading_median1.712046308821216
deviation-heading_min0.980636829679724
driven_any_max2.349162072670132
driven_any_mean1.879913989190915
driven_any_median2.3414919915972088
driven_any_min0.4204689020510484
driven_lanedir_consec_max2.32206871678619
driven_lanedir_consec_mean1.7969747825970674
driven_lanedir_consec_min0.3958672443061859
driven_lanedir_max2.32206871678619
driven_lanedir_mean1.7969747825970674
driven_lanedir_median2.2971398688438205
driven_lanedir_min0.3958672443061859
in-drivable-lane_max1.450000000000018
in-drivable-lane_mean0.2900000000000036
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3414919915972088, "sim_physics": 0.05834760983784994, "survival_time": 14.950000000000076, "driven_lanedir": 2.2997161357760287, "sim_render-ego": 0.037949021657307944, "in-drivable-lane": 0, "agent_compute-ego": 0.08031742970148723, "deviation-heading": 2.2295920528984157, "set_robot_commands": 0.05686974684397379, "deviation-center-line": 1.2638245341358152, "driven_lanedir_consec": 2.2997161357760287, "sim_compute_sim_state": 0.024550413290659587, "sim_compute_performance-ego": 0.040843342940012614, "sim_compute_robot_state-ego": 0.04269713719685873}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.349162072670132, "sim_physics": 0.059401676654815674, "survival_time": 14.950000000000076, "driven_lanedir": 2.2971398688438205, "sim_render-ego": 0.03730950673421224, "in-drivable-lane": 0, "agent_compute-ego": 0.07632166862487794, "deviation-heading": 2.1528379003660305, "set_robot_commands": 0.057263902028401696, "deviation-center-line": 1.2949626659874092, "driven_lanedir_consec": 2.2971398688438205, "sim_compute_sim_state": 0.02466272036234538, "sim_compute_performance-ego": 0.04097137451171875, "sim_compute_robot_state-ego": 0.04277988354365031}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9393124185136716, "sim_physics": 0.06160917109058749, "survival_time": 12.40000000000004, "driven_lanedir": 1.6700819472731117, "sim_render-ego": 0.03704632770630621, "in-drivable-lane": 1.450000000000018, "agent_compute-ego": 0.07815059827220056, "deviation-heading": 1.712046308821216, "set_robot_commands": 0.05981907921452676, "deviation-center-line": 1.1289689758008865, "driven_lanedir_consec": 1.6700819472731117, "sim_compute_sim_state": 0.024828074439879385, "sim_compute_performance-ego": 0.040704193615144296, "sim_compute_robot_state-ego": 0.04289096017037669}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4204689020510484, "sim_physics": 0.0642391786736957, "survival_time": 2.9499999999999975, "driven_lanedir": 0.3958672443061859, "sim_render-ego": 0.03792144080339852, "in-drivable-lane": 0, "agent_compute-ego": 0.07868190134985972, "deviation-heading": 0.980636829679724, "set_robot_commands": 0.05740311186192399, "deviation-center-line": 0.20106101588658865, "driven_lanedir_consec": 0.3958672443061859, "sim_compute_sim_state": 0.02496391231730833, "sim_compute_performance-ego": 0.04098071486262952, "sim_compute_robot_state-ego": 0.042814234555777854}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491345611225145, "sim_physics": 0.06322062174479166, "survival_time": 14.950000000000076, "driven_lanedir": 2.32206871678619, "sim_render-ego": 0.03741543134053548, "in-drivable-lane": 0, "agent_compute-ego": 0.08119676828384399, "deviation-heading": 1.593414277456649, "set_robot_commands": 0.056598188877105715, "deviation-center-line": 1.0616060631300237, "driven_lanedir_consec": 2.32206871678619, "sim_compute_sim_state": 0.02468753735224406, "sim_compute_performance-ego": 0.041606345971425374, "sim_compute_robot_state-ego": 0.04342292467753092}}
set_robot_commands_max0.05981907921452676
set_robot_commands_mean0.05759080576518638
set_robot_commands_median0.057263902028401696
set_robot_commands_min0.056598188877105715
sim_compute_performance-ego_max0.041606345971425374
sim_compute_performance-ego_mean0.04102119438018611
sim_compute_performance-ego_median0.04097137451171875
sim_compute_performance-ego_min0.040704193615144296
sim_compute_robot_state-ego_max0.04342292467753092
sim_compute_robot_state-ego_mean0.042921028028838897
sim_compute_robot_state-ego_median0.042814234555777854
sim_compute_robot_state-ego_min0.04269713719685873
sim_compute_sim_state_max0.02496391231730833
sim_compute_sim_state_mean0.02473853155248735
sim_compute_sim_state_median0.02468753735224406
sim_compute_sim_state_min0.024550413290659587
sim_physics_max0.0642391786736957
sim_physics_mean0.06136365160034809
sim_physics_median0.06160917109058749
sim_physics_min0.05834760983784994
sim_render-ego_max0.037949021657307944
sim_render-ego_mean0.03752834564835208
sim_render-ego_median0.03741543134053548
sim_render-ego_min0.03704632770630621
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.040000000000054
survival_time_min2.9499999999999975
213872377Liam Paullminimal_agent_python2 (Python 2)aido2-LFV-sim-testingstep1-simulationsuccessno8450:25:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4295977528045558
survival_time_median3.7499999999999942
deviation-center-line_median0.16525966154163726
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.0770364387615307
agent_compute-ego_mean0.057509734431385746
agent_compute-ego_median0.06015277562076098
agent_compute-ego_min0.038903943953975555
deviation-center-line_max0.44830395948846297
deviation-center-line_mean0.17891237550140934
deviation-center-line_min0.10012774388669717
deviation-heading_max1.272726254754917
deviation-heading_mean0.5883512828498624
deviation-heading_median0.5156622477370731
deviation-heading_min0.2495279988048577
driven_any_max2.0298273185719493
driven_any_mean1.0098349503422042
driven_any_median1.0248273191286312
driven_any_min0.3648701917101209
driven_lanedir_consec_max1.211071354427033
driven_lanedir_consec_mean0.6125599618319294
driven_lanedir_consec_min0.32721267753615213
driven_lanedir_max1.211071354427033
driven_lanedir_mean0.6125599618319294
driven_lanedir_median0.4295977528045558
driven_lanedir_min0.32721267753615213
in-drivable-lane_max4.249999999999985
in-drivable-lane_mean1.2033333333333296
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.16649406576809817, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.05887701086802025, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06015277562076098, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.08578889990506107, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.04021970213276066, "sim_compute_performance-ego": 0.06489077006300835, "sim_compute_robot_state-ego": 0.06835901573912738, "sim_compute_robot_state-npc0": 0.06363469933810299, "sim_compute_robot_state-npc1": 0.06378420411723934, "sim_compute_robot_state-npc2": 0.06696074302882364, "sim_compute_robot_state-npc3": 0.06793180230545671}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.23679212621740392, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.06895084638853331, "in-drivable-lane": 0, "agent_compute-ego": 0.0770364387615307, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.1064649723671578, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.04126825848141232, "sim_compute_performance-ego": 0.07771018389109019, "sim_compute_robot_state-ego": 0.08650564503025364, "sim_compute_robot_state-npc0": 0.07694942886764938, "sim_compute_robot_state-npc1": 0.07480725082191261, "sim_compute_robot_state-npc2": 0.07218692753766034, "sim_compute_robot_state-npc3": 0.07242778185251597}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.16807234500135695, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.060538098216056824, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06337783166340419, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.09137873351573944, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.0391198992729187, "sim_compute_performance-ego": 0.06647387359823499, "sim_compute_robot_state-ego": 0.07062806614807673, "sim_compute_robot_state-npc0": 0.06840919171060834, "sim_compute_robot_state-npc1": 0.06996676751545497, "sim_compute_robot_state-npc2": 0.06781424794878278, "sim_compute_robot_state-npc3": 0.06890262024743217}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.17962517482893808, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.06221624783107212, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06374616282326835, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.09468493929931096, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03873231794152941, "sim_compute_performance-ego": 0.06920555446829114, "sim_compute_robot_state-ego": 0.07623445349080223, "sim_compute_robot_state-npc0": 0.0739156688962664, "sim_compute_robot_state-npc1": 0.06972860012735639, "sim_compute_robot_state-npc2": 0.06869923642703465, "sim_compute_robot_state-npc3": 0.06818052700587682}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.1689397320151329, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.060450479388237, "in-drivable-lane": 0, "agent_compute-ego": 0.062499985098838806, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.08713975548744202, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.042455583810806274, "sim_compute_performance-ego": 0.06498999148607254, "sim_compute_robot_state-ego": 0.062368281185626984, "sim_compute_robot_state-npc0": 0.06633366644382477, "sim_compute_robot_state-npc1": 0.06776758283376694, "sim_compute_robot_state-npc2": 0.07079368829727173, "sim_compute_robot_state-npc3": 0.06837848573923111}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0548273189057833, "sim_physics": 0.15785466231308976, "survival_time": 3.8499999999999943, "driven_lanedir": 0.3963714216744775, "sim_render-ego": 0.06120649251070889, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.059113326010765965, "deviation-heading": 1.272726254754917, "set_robot_commands": 0.08587037742911995, "deviation-center-line": 0.20372147663934215, "driven_lanedir_consec": 0.3963714216744775, "sim_compute_sim_state": 0.03646212119560737, "sim_compute_performance-ego": 0.06724703157102907, "sim_compute_robot_state-ego": 0.07246013740440468, "sim_compute_robot_state-npc0": 0.06561597601159827, "sim_compute_robot_state-npc1": 0.06377976900571353, "sim_compute_robot_state-npc2": 0.06519649864791276, "sim_compute_robot_state-npc3": 0.06624502949900442}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9948273195001682, "sim_physics": 0.1759440245693677, "survival_time": 3.649999999999995, "driven_lanedir": 0.6530046235032079, "sim_render-ego": 0.06675443910572627, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06760218045482896, "deviation-heading": 0.8187446392859457, "set_robot_commands": 0.10006716479993846, "deviation-center-line": 0.19436286934102945, "driven_lanedir_consec": 0.6530046235032079, "sim_compute_sim_state": 0.03984018547894203, "sim_compute_performance-ego": 0.07263155506081777, "sim_compute_robot_state-ego": 0.07814266910291698, "sim_compute_robot_state-npc0": 0.07245215977707954, "sim_compute_robot_state-npc1": 0.06997476538566694, "sim_compute_robot_state-npc2": 0.07173074108280547, "sim_compute_robot_state-npc3": 0.07201003048517933}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.0298273185719493, "sim_physics": 0.1697346996253645, "survival_time": 7.099999999999983, "driven_lanedir": 0.741234184731216, "sim_render-ego": 0.0614470125923694, "in-drivable-lane": 4.249999999999985, "agent_compute-ego": 0.06256751779099586, "deviation-heading": 0.5416787058937298, "set_robot_commands": 0.08989927970187765, "deviation-center-line": 0.21649269357451997, "driven_lanedir_consec": 0.741234184731216, "sim_compute_sim_state": 0.03759887688596484, "sim_compute_performance-ego": 0.0697653226449456, "sim_compute_robot_state-ego": 0.07168232890921579, "sim_compute_robot_state-npc0": 0.06804483709201006, "sim_compute_robot_state-npc1": 0.06828062299271705, "sim_compute_robot_state-npc2": 0.06685630536415207, "sim_compute_robot_state-npc3": 0.06936427405182745}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0248273191286528, "sim_physics": 0.15509300549825034, "survival_time": 3.7499999999999942, "driven_lanedir": 0.38223306402252977, "sim_render-ego": 0.059717384974161784, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.060655765533447266, "deviation-heading": 0.41826512024881946, "set_robot_commands": 0.08871235847473144, "deviation-center-line": 0.14440586530294292, "driven_lanedir_consec": 0.38223306402252977, "sim_compute_sim_state": 0.03715688705444336, "sim_compute_performance-ego": 0.06764202117919922, "sim_compute_robot_state-ego": 0.07043839772542318, "sim_compute_robot_state-npc0": 0.06637500445048014, "sim_compute_robot_state-npc1": 0.06592111905415853, "sim_compute_robot_state-npc2": 0.06395225842793782, "sim_compute_robot_state-npc3": 0.06513011614481608}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4548365617710395, "sim_physics": 0.15775196616714066, "survival_time": 1.850000000000001, "driven_lanedir": 0.43889108545437505, "sim_render-ego": 0.05418775532696698, "in-drivable-lane": 0, "agent_compute-ego": 0.05582450531624459, "deviation-heading": 0.491310634741224, "set_robot_commands": 0.08836135348758183, "deviation-center-line": 0.11665316537398888, "driven_lanedir_consec": 0.43889108545437505, "sim_compute_sim_state": 0.03641741340224807, "sim_compute_performance-ego": 0.060322787310626055, "sim_compute_robot_state-ego": 0.06488250397347115, "sim_compute_robot_state-npc0": 0.06132100723885201, "sim_compute_robot_state-npc1": 0.05859699764767209, "sim_compute_robot_state-npc2": 0.060778559865178286, "sim_compute_robot_state-npc3": 0.06698071634447253}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3648701917101209, "sim_physics": 0.1362826362732918, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552145550754965, "sim_render-ego": 0.04010696564951251, "in-drivable-lane": 0, "agent_compute-ego": 0.038903943953975555, "deviation-heading": 0.5070424162880827, "set_robot_commands": 0.05669767625870243, "deviation-center-line": 0.10012774388669717, "driven_lanedir_consec": 0.34552145550754965, "sim_compute_sim_state": 0.023669865823561145, "sim_compute_performance-ego": 0.04327195690524194, "sim_compute_robot_state-ego": 0.04535386639256631, "sim_compute_robot_state-npc0": 0.04452142407817225, "sim_compute_robot_state-npc1": 0.043201161969092586, "sim_compute_robot_state-npc2": 0.04280662536621094, "sim_compute_robot_state-npc3": 0.042487082942839594}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4098472254790875, "sim_physics": 0.11677187330582564, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054410153244894, "sim_render-ego": 0.04550180014441995, "in-drivable-lane": 0, "agent_compute-ego": 0.0450287706711713, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.06455503491794362, "deviation-center-line": 0.16731811540993266, "driven_lanedir_consec": 0.4054410153244894, "sim_compute_sim_state": 0.028836762203889733, "sim_compute_performance-ego": 0.05008278874789968, "sim_compute_robot_state-ego": 0.051323343725765455, "sim_compute_robot_state-npc0": 0.05475797372705797, "sim_compute_robot_state-npc1": 0.050678463543162626, "sim_compute_robot_state-npc2": 0.05079302367042093, "sim_compute_robot_state-npc3": 0.048697710037231445}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0248273191286312, "sim_physics": 0.10872913678487142, "survival_time": 3.7499999999999942, "driven_lanedir": 0.32721267753615213, "sim_render-ego": 0.04585237185160319, "in-drivable-lane": 2.299999999999994, "agent_compute-ego": 0.04779837290445964, "deviation-heading": 0.3112188917063982, "set_robot_commands": 0.07089273452758789, "deviation-center-line": 0.16525966154163726, "driven_lanedir_consec": 0.32721267753615213, "sim_compute_sim_state": 0.028102874755859375, "sim_compute_performance-ego": 0.05056543986002604, "sim_compute_robot_state-ego": 0.052594785690307615, "sim_compute_robot_state-npc0": 0.05062897364298503, "sim_compute_robot_state-npc1": 0.04972068468729655, "sim_compute_robot_state-npc2": 0.04938918431599935, "sim_compute_robot_state-npc3": 0.04939777374267578}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.1272956963096346, "survival_time": 5.599999999999988, "driven_lanedir": 1.211071354427033, "sim_render-ego": 0.047364620225770135, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.04930051735469273, "deviation-heading": 1.0143384205991224, "set_robot_commands": 0.07179833522864751, "deviation-center-line": 0.44830395948846297, "driven_lanedir_consec": 1.211071354427033, "sim_compute_sim_state": 0.031587722046034675, "sim_compute_performance-ego": 0.05250939513955798, "sim_compute_robot_state-ego": 0.05553274069513593, "sim_compute_robot_state-npc0": 0.05424720474651882, "sim_compute_robot_state-npc1": 0.055529924375670295, "sim_compute_robot_state-npc2": 0.05436215230396816, "sim_compute_robot_state-npc3": 0.055834985205105374}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2198273185919868, "sim_physics": 0.13473643768917432, "survival_time": 4.399999999999992, "driven_lanedir": 0.41711373203649504, "sim_render-ego": 0.0487761145288294, "in-drivable-lane": 2.5999999999999917, "agent_compute-ego": 0.04903792251240124, "deviation-heading": 0.5811284097850438, "set_robot_commands": 0.0743157836523923, "deviation-center-line": 0.13226882250813252, "driven_lanedir_consec": 0.41711373203649504, "sim_compute_sim_state": 0.03076248819177801, "sim_compute_performance-ego": 0.05375073172829368, "sim_compute_robot_state-ego": 0.054853246970610184, "sim_compute_robot_state-npc0": 0.05443701689893549, "sim_compute_robot_state-npc1": 0.05450993234461004, "sim_compute_robot_state-npc2": 0.054886630990288475, "sim_compute_robot_state-npc3": 0.054612021554600106}}
set_robot_commands_max0.1064649723671578
set_robot_commands_mean0.08377515993688228
set_robot_commands_median0.08713975548744202
set_robot_commands_min0.05669767625870243
sim_compute_performance-ego_max0.07771018389109019
sim_compute_performance-ego_mean0.06207062691028895
sim_compute_performance-ego_median0.06498999148607254
sim_compute_performance-ego_min0.04327195690524194
sim_compute_robot_state-ego_max0.08650564503025364
sim_compute_robot_state-ego_mean0.06542396547891362
sim_compute_robot_state-ego_median0.06835901573912738
sim_compute_robot_state-ego_min0.04535386639256631
sim_compute_robot_state-npc0_max0.07694942886764938
sim_compute_robot_state-npc0_mean0.0627762821946761
sim_compute_robot_state-npc0_median0.06561597601159827
sim_compute_robot_state-npc0_min0.04452142407817225
sim_compute_robot_state-npc1_max0.07480725082191261
sim_compute_robot_state-npc1_mean0.06174985642809937
sim_compute_robot_state-npc1_median0.06378420411723934
sim_compute_robot_state-npc1_min0.043201161969092586
sim_compute_robot_state-npc2_max0.07218692753766034
sim_compute_robot_state-npc2_mean0.0618137882182965
sim_compute_robot_state-npc2_median0.06519649864791276
sim_compute_robot_state-npc2_min0.04280662536621094
sim_compute_robot_state-npc3_max0.07242778185251597
sim_compute_robot_state-npc3_mean0.062438730477217645
sim_compute_robot_state-npc3_median0.06698071634447253
sim_compute_robot_state-npc3_min0.042487082942839594
sim_compute_sim_state_max0.042455583810806274
sim_compute_sim_state_mean0.035482063911850395
sim_compute_sim_state_median0.03715688705444336
sim_compute_sim_state_min0.023669865823561145
sim_physics_max0.23679212621740392
sim_physics_mean0.15734117215779608
sim_physics_median0.15785466231308976
sim_physics_min0.10872913678487142
sim_render-ego_max0.06895084638853331
sim_render-ego_mean0.056129842640132536
sim_render-ego_median0.059717384974161784
sim_render-ego_min0.04010696564951251
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean3.6999999999999944
survival_time_min1.5500000000000007
213702410jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationhost-errorno8450:40:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2410/step1-simulation-ip-172-31-42-167-7194-job21370/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213542372Liam Paullminimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationsuccessno8450:18:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6591401084474304
survival_time_median6.949999999999983
deviation-center-line_median0.33899838427143014
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.16334175074704782
agent_compute-ego_mean0.1531661443859877
agent_compute-ego_median0.15143044032747782
agent_compute-ego_min0.14548684544033474
deviation-center-line_max0.4843179558881834
deviation-center-line_mean0.3389764450725529
deviation-center-line_min0.22729035014002288
deviation-heading_max1.1492236283129806
deviation-heading_mean0.9399487053044556
deviation-heading_median1.0007157377877205
deviation-heading_min0.7390440083021812
driven_any_max1.6381859911990262
driven_any_mean1.0096556470575024
driven_any_median0.9900915586687412
driven_any_min0.4167848967141688
driven_lanedir_consec_max1.2206700211390982
driven_lanedir_consec_mean0.7159598687953472
driven_lanedir_consec_min0.3888322247827789
driven_lanedir_max1.2206700211390982
driven_lanedir_mean0.7159598687953472
driven_lanedir_median0.6591401084474304
driven_lanedir_min0.3888322247827789
in-drivable-lane_max4.85000000000004
in-drivable-lane_mean1.8200000000000132
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.16879531462415517, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06284096429673888, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14985681780808263, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.09273525450727065, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03969837778763805, "sim_compute_performance-ego": 0.06883625332400095, "sim_compute_robot_state-ego": 0.07231411316411958, "sim_compute_robot_state-npc0": 0.06708491791924126, "sim_compute_robot_state-npc1": 0.06885383455015773, "sim_compute_robot_state-npc2": 0.06955294471850498, "sim_compute_robot_state-npc3": 0.06883644543105749}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.19120670878697957, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06221492706783234, "in-drivable-lane": 0, "agent_compute-ego": 0.1557148676069956, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.1043312738812159, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.038951260702950616, "sim_compute_performance-ego": 0.06894722438993908, "sim_compute_robot_state-ego": 0.07711257631816561, "sim_compute_robot_state-npc0": 0.07211254513452924, "sim_compute_robot_state-npc1": 0.07108051057845827, "sim_compute_robot_state-npc2": 0.06835432279677618, "sim_compute_robot_state-npc3": 0.0688586878398108}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.16389915042453343, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06016917016771105, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.14548684544033474, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.0897428396013048, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.039468620088365346, "sim_compute_performance-ego": 0.0663769170973036, "sim_compute_robot_state-ego": 0.07147844420539008, "sim_compute_robot_state-npc0": 0.06718135621812608, "sim_compute_robot_state-npc1": 0.06743768056233725, "sim_compute_robot_state-npc2": 0.06856954468621149, "sim_compute_robot_state-npc3": 0.06940330081515841}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.18594599539233791, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.07084216170596637, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.16334175074704782, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.10361051559448242, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.04625309117928079, "sim_compute_performance-ego": 0.07459154436665197, "sim_compute_robot_state-ego": 0.08002159342787782, "sim_compute_robot_state-npc0": 0.07440110725191881, "sim_compute_robot_state-npc1": 0.07625402283558648, "sim_compute_robot_state-npc2": 0.07309662361848189, "sim_compute_robot_state-npc3": 0.07347185930348761}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.17143021689520943, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.062442325410388765, "in-drivable-lane": 0, "agent_compute-ego": 0.15143044032747782, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.0964384192512149, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.04136535856458875, "sim_compute_performance-ego": 0.06929383580646818, "sim_compute_robot_state-ego": 0.07206692014421735, "sim_compute_robot_state-npc0": 0.06975732152424162, "sim_compute_robot_state-npc1": 0.07680866831824892, "sim_compute_robot_state-npc2": 0.07132001907106429, "sim_compute_robot_state-npc3": 0.07485889253162202}}
set_robot_commands_max0.1043312738812159
set_robot_commands_mean0.09737166056709771
set_robot_commands_median0.0964384192512149
set_robot_commands_min0.0897428396013048
sim_compute_performance-ego_max0.07459154436665197
sim_compute_performance-ego_mean0.06960915499687277
sim_compute_performance-ego_median0.06894722438993908
sim_compute_performance-ego_min0.0663769170973036
sim_compute_robot_state-ego_max0.08002159342787782
sim_compute_robot_state-ego_mean0.07459872945195409
sim_compute_robot_state-ego_median0.07231411316411958
sim_compute_robot_state-ego_min0.07147844420539008
sim_compute_robot_state-npc0_max0.07440110725191881
sim_compute_robot_state-npc0_mean0.07010744960961142
sim_compute_robot_state-npc0_median0.06975732152424162
sim_compute_robot_state-npc0_min0.06708491791924126
sim_compute_robot_state-npc1_max0.07680866831824892
sim_compute_robot_state-npc1_mean0.07208694336895774
sim_compute_robot_state-npc1_median0.07108051057845827
sim_compute_robot_state-npc1_min0.06743768056233725
sim_compute_robot_state-npc2_max0.07309662361848189
sim_compute_robot_state-npc2_mean0.07017869097820775
sim_compute_robot_state-npc2_median0.06955294471850498
sim_compute_robot_state-npc2_min0.06835432279677618
sim_compute_robot_state-npc3_max0.07485889253162202
sim_compute_robot_state-npc3_mean0.07108583718422727
sim_compute_robot_state-npc3_median0.06940330081515841
sim_compute_robot_state-npc3_min0.06883644543105749
sim_compute_sim_state_max0.04625309117928079
sim_compute_sim_state_mean0.04114734166456471
sim_compute_sim_state_median0.03969837778763805
sim_compute_sim_state_min0.038951260702950616
sim_physics_max0.19120670878697957
sim_physics_mean0.1762554772246431
sim_physics_median0.17143021689520943
sim_physics_min0.16389915042453343
sim_render-ego_max0.07084216170596637
sim_render-ego_mean0.06370190972972747
sim_render-ego_median0.062442325410388765
sim_render-ego_min0.06016917016771105
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean7.070000000000005
survival_time_min3.149999999999997
213532376Liam Paullminimal_agent_python2 (Python 2)aido2-LF-sim-validationstep1-simulationhost-errorno8450:03:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2376/step1-simulation-ip-172-31-42-167-7194-job21353/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213492380Liam Paullminimal_agent_python2 (Python 2)aido2-LFVI-sim-validationstep1-simulationsuccessno8450:13:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5588337849539742
survival_time_median5.549999999999988
deviation-center-line_median0.3652019984091639
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06471269839518778
agent_compute-ego_mean0.06144619421436387
agent_compute-ego_median0.06222010907078289
agent_compute-ego_min0.0558452308177948
deviation-center-line_max0.5183621890690367
deviation-center-line_mean0.3091633025512927
deviation-center-line_min0.10686438692139356
deviation-heading_max0.6191860504142408
deviation-heading_mean0.5051792851842161
deviation-heading_median0.4989824923438323
deviation-heading_min0.42218734391092383
driven_any_max2.764827318571964
driven_any_mean1.4658358085690737
driven_any_median1.5648273185720385
driven_any_min0.37986052535838966
driven_lanedir_consec_max1.9044523873117627
driven_lanedir_consec_mean1.19641611532087
driven_lanedir_consec_min0.3667130323691865
driven_lanedir_max1.9045033171069223
driven_lanedir_mean1.1964799961413226
driven_lanedir_median1.5590414710313567
driven_lanedir_min0.3667130323691865
in-drivable-lane_max2.8500000000000165
in-drivable-lane_mean0.8600000000000023
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.18071518932376895, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.05921107369500238, "in-drivable-lane": 0, "agent_compute-ego": 0.06217160525622669, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.08618471214363167, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.03753895158166284, "sim_compute_performance-ego": 0.06536160288630305, "sim_compute_robot_state-ego": 0.06756667618278984, "sim_compute_robot_state-npc0": 0.0656323647713876, "sim_compute_robot_state-npc1": 0.06315599905477988, "sim_compute_robot_state-npc2": 0.06509226077311747, "sim_compute_robot_state-npc3": 0.06546846810761872}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.20963553480199865, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.06384692965327082, "in-drivable-lane": 0, "agent_compute-ego": 0.06471269839518778, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.0965916788255846, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.03890859114157187, "sim_compute_performance-ego": 0.07050439473744985, "sim_compute_robot_state-ego": 0.07407306336067818, "sim_compute_robot_state-npc0": 0.07136980907337086, "sim_compute_robot_state-npc1": 0.06676873645266972, "sim_compute_robot_state-npc2": 0.06941238609520164, "sim_compute_robot_state-npc3": 0.07007823119292388}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.18084095487531449, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.05853480850623933, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.062281327531827205, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.08714286538938813, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.03743465846737489, "sim_compute_performance-ego": 0.06431402907466256, "sim_compute_robot_state-ego": 0.06753133780119434, "sim_compute_robot_state-npc0": 0.0653064108842256, "sim_compute_robot_state-npc1": 0.06585549518762045, "sim_compute_robot_state-npc2": 0.06621513303541979, "sim_compute_robot_state-npc3": 0.0634803566711628}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.18674403585064472, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.061289877167546934, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.06222010907078289, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.09248244824833896, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.03905662441752968, "sim_compute_performance-ego": 0.07107392405964318, "sim_compute_robot_state-ego": 0.07169770320672639, "sim_compute_robot_state-npc0": 0.06804532405593633, "sim_compute_robot_state-npc1": 0.06878719904035797, "sim_compute_robot_state-npc2": 0.07083426845011287, "sim_compute_robot_state-npc3": 0.06799374076084316}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.16892769187688828, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.05516951531171799, "in-drivable-lane": 0, "agent_compute-ego": 0.0558452308177948, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.08487004786729813, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.03571736812591553, "sim_compute_performance-ego": 0.06588759273290634, "sim_compute_robot_state-ego": 0.06986677646636963, "sim_compute_robot_state-npc0": 0.06356775015592575, "sim_compute_robot_state-npc1": 0.05963244289159775, "sim_compute_robot_state-npc2": 0.05885729938745499, "sim_compute_robot_state-npc3": 0.06087023764848709}}
set_robot_commands_max0.0965916788255846
set_robot_commands_mean0.0894543504948483
set_robot_commands_median0.08714286538938813
set_robot_commands_min0.08487004786729813
sim_compute_performance-ego_max0.07107392405964318
sim_compute_performance-ego_mean0.067428308698193
sim_compute_performance-ego_median0.06588759273290634
sim_compute_performance-ego_min0.06431402907466256
sim_compute_robot_state-ego_max0.07407306336067818
sim_compute_robot_state-ego_mean0.07014711140355168
sim_compute_robot_state-ego_median0.06986677646636963
sim_compute_robot_state-ego_min0.06753133780119434
sim_compute_robot_state-npc0_max0.07136980907337086
sim_compute_robot_state-npc0_mean0.06678433178816923
sim_compute_robot_state-npc0_median0.0656323647713876
sim_compute_robot_state-npc0_min0.06356775015592575
sim_compute_robot_state-npc1_max0.06878719904035797
sim_compute_robot_state-npc1_mean0.06483997452540516
sim_compute_robot_state-npc1_median0.06585549518762045
sim_compute_robot_state-npc1_min0.05963244289159775
sim_compute_robot_state-npc2_max0.07083426845011287
sim_compute_robot_state-npc2_mean0.06608226954826135
sim_compute_robot_state-npc2_median0.06621513303541979
sim_compute_robot_state-npc2_min0.05885729938745499
sim_compute_robot_state-npc3_max0.07007823119292388
sim_compute_robot_state-npc3_mean0.06557820687620712
sim_compute_robot_state-npc3_median0.06546846810761872
sim_compute_robot_state-npc3_min0.06087023764848709
sim_compute_sim_state_max0.03905662441752968
sim_compute_sim_state_mean0.03773123874681096
sim_compute_sim_state_median0.03753895158166284
sim_compute_sim_state_min0.03571736812591553
sim_physics_max0.20963553480199865
sim_physics_mean0.185372681345723
sim_physics_median0.18084095487531449
sim_physics_min0.16892769187688828
sim_render-ego_max0.06384692965327082
sim_render-ego_mean0.05961044086675549
sim_render-ego_median0.05921107369500238
sim_render-ego_min0.05516951531171799
simulation-passed1
survival_time_max9.55
survival_time_mean5.219999999999994
survival_time_min1.6000000000000008
213472384Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno8450:06:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10819530882768236
survival_time_median1.6000000000000008
deviation-center-line_median0.05922702809365912
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.1807289645075798
agent_compute-ego_mean0.15337581640203873
agent_compute-ego_median0.1636189152212704
agent_compute-ego_min0.10521822422742844
deviation-center-line_max0.09403575193783437
deviation-center-line_mean0.06714068704926472
deviation-center-line_min0.04906170112640911
deviation-heading_max0.8690968390119935
deviation-heading_mean0.7463615728771433
deviation-heading_median0.7929429632796323
deviation-heading_min0.4907376685908688
driven_any_max0.22874006228350552
driven_any_mean0.19337465572922444
driven_any_median0.19710829083883305
driven_any_min0.1348177337597236
driven_lanedir_consec_max0.13746937776659784
driven_lanedir_consec_mean0.10720633411939776
driven_lanedir_consec_min0.06721588230301867
driven_lanedir_max0.13746937776659784
driven_lanedir_mean0.10720633411939776
driven_lanedir_median0.10819530882768236
driven_lanedir_min0.06721588230301867
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.2100000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21388544608638288, "sim_physics": 0.07598353922367096, "survival_time": 1.6000000000000008, "driven_lanedir": 0.10455158890929804, "sim_render-ego": 0.04002079367637634, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10521822422742844, "deviation-heading": 0.8690968390119935, "set_robot_commands": 0.05673227459192276, "deviation-center-line": 0.07847283630326592, "driven_lanedir_consec": 0.10455158890929804, "sim_compute_sim_state": 0.026819884777069092, "sim_compute_performance-ego": 0.04281674325466156, "sim_compute_robot_state-ego": 0.04464627802371979}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1923217456776772, "sim_physics": 0.10606812608653102, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11859951279039184, "sim_render-ego": 0.0548144373400458, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14792246654115873, "deviation-heading": 0.7929429632796323, "set_robot_commands": 0.09893019446011247, "deviation-center-line": 0.0549061177851551, "driven_lanedir_consec": 0.11859951279039184, "sim_compute_sim_state": 0.03651993850181843, "sim_compute_performance-ego": 0.06385905989285173, "sim_compute_robot_state-ego": 0.06708922057316222}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1348177337597236, "sim_physics": 0.11491893529891968, "survival_time": 1.0000000000000002, "driven_lanedir": 0.10819530882768236, "sim_render-ego": 0.06287870407104493, "in-drivable-lane": 0, "agent_compute-ego": 0.16939051151275636, "deviation-heading": 0.4907376685908688, "set_robot_commands": 0.0959615468978882, "deviation-center-line": 0.09403575193783437, "driven_lanedir_consec": 0.10819530882768236, "sim_compute_sim_state": 0.038530361652374265, "sim_compute_performance-ego": 0.0722898006439209, "sim_compute_robot_state-ego": 0.08377233743667603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19710829083883305, "sim_physics": 0.1378018856048584, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06721588230301867, "sim_render-ego": 0.06650807708501816, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1807289645075798, "deviation-heading": 0.815989813982461, "set_robot_commands": 0.09433075785636902, "deviation-center-line": 0.04906170112640911, "driven_lanedir_consec": 0.06721588230301867, "sim_compute_sim_state": 0.03669603168964386, "sim_compute_performance-ego": 0.06901966780424118, "sim_compute_robot_state-ego": 0.07231990993022919}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22874006228350552, "sim_physics": 0.1181779609006994, "survival_time": 1.7000000000000008, "driven_lanedir": 0.13746937776659784, "sim_render-ego": 0.0620187100242166, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1636189152212704, "deviation-heading": 0.763040579520761, "set_robot_commands": 0.09023671991684858, "deviation-center-line": 0.05922702809365912, "driven_lanedir_consec": 0.13746937776659784, "sim_compute_sim_state": 0.03716794182272518, "sim_compute_performance-ego": 0.07090971049140482, "sim_compute_robot_state-ego": 0.07354385712567497}}
set_robot_commands_max0.09893019446011247
set_robot_commands_mean0.08723829874462821
set_robot_commands_median0.09433075785636902
set_robot_commands_min0.05673227459192276
sim_compute_performance-ego_max0.0722898006439209
sim_compute_performance-ego_mean0.06377899641741605
sim_compute_performance-ego_median0.06901966780424118
sim_compute_performance-ego_min0.04281674325466156
sim_compute_robot_state-ego_max0.08377233743667603
sim_compute_robot_state-ego_mean0.06827432061789243
sim_compute_robot_state-ego_median0.07231990993022919
sim_compute_robot_state-ego_min0.04464627802371979
sim_compute_sim_state_max0.038530361652374265
sim_compute_sim_state_mean0.03514683168872616
sim_compute_sim_state_median0.03669603168964386
sim_compute_sim_state_min0.026819884777069092
sim_physics_max0.1378018856048584
sim_physics_mean0.11059008942293588
sim_physics_median0.11491893529891968
sim_physics_min0.07598353922367096
sim_render-ego_max0.06650807708501816
sim_render-ego_mean0.05724814443934037
sim_render-ego_median0.0620187100242166
sim_render-ego_min0.04002079367637634
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4700000000000006
survival_time_min1.0000000000000002
213422411jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationsuccessno8450:34:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.339793520141566
survival_time_median14.950000000000076
deviation-center-line_median1.002134440312669
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.16462040185928345
agent_compute-ego_mean0.16129616260528565
agent_compute-ego_median0.1621641254425049
agent_compute-ego_min0.156118221282959
deviation-center-line_max1.5296442653166566
deviation-center-line_mean0.925371790854924
deviation-center-line_min0.28261955257418875
deviation-heading_max8.558153948461722
deviation-heading_mean7.098260242116498
deviation-heading_median7.090641611385013
deviation-heading_min5.695926383403844
driven_any_max4.378506444052824
driven_any_mean4.378506444052815
driven_any_median4.378506444052811
driven_any_min4.378506444052806
driven_lanedir_consec_max-1.2728379671211965
driven_lanedir_consec_mean-1.3313530019797526
driven_lanedir_consec_min-1.3670015115194478
driven_lanedir_max-1.3662544443440128
driven_lanedir_mean-2.078199826147362
driven_lanedir_median-2.260637650975249
driven_lanedir_min-2.7107548643537447
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.620000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.17342706600824992, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.059780759811401366, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16462040185928345, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.09255687157313028, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.03721405665079753, "sim_compute_performance-ego": 0.06655309279759725, "sim_compute_robot_state-ego": 0.07162491957346598, "sim_compute_robot_state-npc0": 0.06899194876352946, "sim_compute_robot_state-npc1": 0.06781177282333374, "sim_compute_robot_state-npc2": 0.06634271383285523, "sim_compute_robot_state-npc3": 0.0662276554107666}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.1611344281832377, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.06108293851216634, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15900124152501424, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.08820298353830973, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.037884811560312905, "sim_compute_performance-ego": 0.0654678726196289, "sim_compute_robot_state-ego": 0.06960159142812093, "sim_compute_robot_state-npc0": 0.06726158380508424, "sim_compute_robot_state-npc1": 0.06470503012339274, "sim_compute_robot_state-npc2": 0.06466460784276326, "sim_compute_robot_state-npc3": 0.0655835207303365}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.16026698430379233, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.06055567979812622, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.1621641254425049, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.09016114870707194, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.03794880469640096, "sim_compute_performance-ego": 0.0654520575205485, "sim_compute_robot_state-ego": 0.06834216197331747, "sim_compute_robot_state-npc0": 0.06698128779729208, "sim_compute_robot_state-npc1": 0.06732444683710734, "sim_compute_robot_state-npc2": 0.06641126235326131, "sim_compute_robot_state-npc3": 0.06525995333989461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.1630751919746399, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.05758194208145142, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.156118221282959, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.08977429072062175, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.037322386900583905, "sim_compute_performance-ego": 0.06344714164733886, "sim_compute_robot_state-ego": 0.06764498710632325, "sim_compute_robot_state-npc0": 0.06387508233388264, "sim_compute_robot_state-npc1": 0.0630655312538147, "sim_compute_robot_state-npc2": 0.06364034414291382, "sim_compute_robot_state-npc3": 0.06530395984649658}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.17417713403701782, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.06176662762959798, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.16457682291666667, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.090955118338267, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.038988606929779054, "sim_compute_performance-ego": 0.06730377991994221, "sim_compute_robot_state-ego": 0.07174989779790243, "sim_compute_robot_state-npc0": 0.0673455532391866, "sim_compute_robot_state-npc1": 0.0667368205388387, "sim_compute_robot_state-npc2": 0.06679120699564615, "sim_compute_robot_state-npc3": 0.06860694408416748}}
set_robot_commands_max0.09255687157313028
set_robot_commands_mean0.09033008257548016
set_robot_commands_median0.09016114870707194
set_robot_commands_min0.08820298353830973
sim_compute_performance-ego_max0.06730377991994221
sim_compute_performance-ego_mean0.06564478890101114
sim_compute_performance-ego_median0.0654678726196289
sim_compute_performance-ego_min0.06344714164733886
sim_compute_robot_state-ego_max0.07174989779790243
sim_compute_robot_state-ego_mean0.069792711575826
sim_compute_robot_state-ego_median0.06960159142812093
sim_compute_robot_state-ego_min0.06764498710632325
sim_compute_robot_state-npc0_max0.06899194876352946
sim_compute_robot_state-npc0_mean0.066891091187795
sim_compute_robot_state-npc0_median0.06726158380508424
sim_compute_robot_state-npc0_min0.06387508233388264
sim_compute_robot_state-npc1_max0.06781177282333374
sim_compute_robot_state-npc1_mean0.06592872031529744
sim_compute_robot_state-npc1_median0.0667368205388387
sim_compute_robot_state-npc1_min0.0630655312538147
sim_compute_robot_state-npc2_max0.06679120699564615
sim_compute_robot_state-npc2_mean0.06557002703348795
sim_compute_robot_state-npc2_median0.06634271383285523
sim_compute_robot_state-npc2_min0.06364034414291382
sim_compute_robot_state-npc3_max0.06860694408416748
sim_compute_robot_state-npc3_mean0.06619640668233236
sim_compute_robot_state-npc3_median0.0655835207303365
sim_compute_robot_state-npc3_min0.06525995333989461
sim_compute_sim_state_max0.038988606929779054
sim_compute_sim_state_mean0.03787173334757486
sim_compute_sim_state_median0.037884811560312905
sim_compute_sim_state_min0.03721405665079753
sim_physics_max0.17417713403701782
sim_physics_mean0.16641616090138753
sim_physics_median0.1630751919746399
sim_physics_min0.16026698430379233
sim_render-ego_max0.06176662762959798
sim_render-ego_mean0.06015358956654867
sim_render-ego_median0.06055567979812622
sim_render-ego_min0.05758194208145142
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
213212446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno8450:50:51
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-42-167-7194-job21321/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213132400Liam Paullrandom_agentaido2-LFVI-sim-validationstep1-simulationsuccessno8450:08:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1302542894789316
agent_compute-ego_mean0.11660028831756612
agent_compute-ego_median0.12021942380108412
agent_compute-ego_min0.09487939732415336
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1588129785996449, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.049340079102335094, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.12021942380108412, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07979129839547072, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.033801887608781646, "sim_compute_performance-ego": 0.0558710732037508, "sim_compute_robot_state-ego": 0.06128282788433606, "sim_compute_robot_state-npc0": 0.057296001458469824, "sim_compute_robot_state-npc1": 0.054948728295821175, "sim_compute_robot_state-npc2": 0.054698262033583245, "sim_compute_robot_state-npc3": 0.055357320399224}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1464350734438215, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.046173308576856344, "in-drivable-lane": 0, "agent_compute-ego": 0.09487939732415336, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06881364754268102, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.027605967862265452, "sim_compute_performance-ego": 0.048577376774379184, "sim_compute_robot_state-ego": 0.052081167697906494, "sim_compute_robot_state-npc0": 0.049755292279379706, "sim_compute_robot_state-npc1": 0.05076453515461513, "sim_compute_robot_state-npc2": 0.049133547714778354, "sim_compute_robot_state-npc3": 0.04772907495498657}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18615830523296467, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06056837202275841, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1302542894789316, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0901185470877342, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03912347265817587, "sim_compute_performance-ego": 0.06630023937780881, "sim_compute_robot_state-ego": 0.07068185204441108, "sim_compute_robot_state-npc0": 0.06817645934021589, "sim_compute_robot_state-npc1": 0.0666817438255236, "sim_compute_robot_state-npc2": 0.06497423857161143, "sim_compute_robot_state-npc3": 0.06797909736633301}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1943499594926834, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.059941500425338745, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1287700136502584, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08822759985923767, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03849738836288452, "sim_compute_performance-ego": 0.0719939370950063, "sim_compute_robot_state-ego": 0.07065819203853607, "sim_compute_robot_state-npc0": 0.06545456747214, "sim_compute_robot_state-npc1": 0.06438595056533813, "sim_compute_robot_state-npc2": 0.06582966446876526, "sim_compute_robot_state-npc3": 0.06218347450097402}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.13758291516985213, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.049181154796055386, "in-drivable-lane": 0, "agent_compute-ego": 0.10887831733340309, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07291969798860096, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03542275655837286, "sim_compute_performance-ego": 0.05255780901227679, "sim_compute_robot_state-ego": 0.055953411828903926, "sim_compute_robot_state-npc0": 0.05809270767938523, "sim_compute_robot_state-npc1": 0.05818368139721099, "sim_compute_robot_state-npc2": 0.05693150701976958, "sim_compute_robot_state-npc3": 0.055544433139619376}}
set_robot_commands_max0.0901185470877342
set_robot_commands_mean0.07997415817474492
set_robot_commands_median0.07979129839547072
set_robot_commands_min0.06881364754268102
sim_compute_performance-ego_max0.0719939370950063
sim_compute_performance-ego_mean0.059060087092644376
sim_compute_performance-ego_median0.0558710732037508
sim_compute_performance-ego_min0.048577376774379184
sim_compute_robot_state-ego_max0.07068185204441108
sim_compute_robot_state-ego_mean0.06213149029881872
sim_compute_robot_state-ego_median0.06128282788433606
sim_compute_robot_state-ego_min0.052081167697906494
sim_compute_robot_state-npc0_max0.06817645934021589
sim_compute_robot_state-npc0_mean0.05975500564591814
sim_compute_robot_state-npc0_median0.05809270767938523
sim_compute_robot_state-npc0_min0.049755292279379706
sim_compute_robot_state-npc1_max0.0666817438255236
sim_compute_robot_state-npc1_mean0.058992927847701805
sim_compute_robot_state-npc1_median0.05818368139721099
sim_compute_robot_state-npc1_min0.05076453515461513
sim_compute_robot_state-npc2_max0.06582966446876526
sim_compute_robot_state-npc2_mean0.05831344396170157
sim_compute_robot_state-npc2_median0.05693150701976958
sim_compute_robot_state-npc2_min0.049133547714778354
sim_compute_robot_state-npc3_max0.06797909736633301
sim_compute_robot_state-npc3_mean0.0577586800722274
sim_compute_robot_state-npc3_median0.055544433139619376
sim_compute_robot_state-npc3_min0.04772907495498657
sim_compute_sim_state_max0.03912347265817587
sim_compute_sim_state_mean0.03489029461009607
sim_compute_sim_state_median0.03542275655837286
sim_compute_sim_state_min0.027605967862265452
sim_physics_max0.1943499594926834
sim_physics_mean0.16466784638779333
sim_physics_median0.1588129785996449
sim_physics_min0.13758291516985213
sim_render-ego_max0.06056837202275841
sim_render-ego_mean0.05304088298466879
sim_render-ego_median0.049340079102335094
sim_render-ego_min0.046173308576856344
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
212892884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno8450:54:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-42-167-7194-job21289/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212722428Andrea Censirandom_agentaido2-LF-sim-testingstep1-simulationerrorno8450:01:18
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212632450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno8450:29:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-42-167-7194-job21263/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212602455Liam Paullchallenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerrorno8450:00:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212572460Liam Paullchallenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerrorno8450:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212552463Liam Paullchallenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrorno8450:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212542464Liam Paullchallenge-aido_LF-template-rosaido2-LFVI-sim-validationstep1-simulationerrorno8450:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212412491Liam Paullchallenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationsuccessno8450:09:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09136919124345688
survival_time_median1.2500000000000004
deviation-center-line_median0.06545245854791194
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.22332460880279545
agent_compute-ego_mean0.15640031908619725
agent_compute-ego_median0.15742312868436178
agent_compute-ego_min0.1144687952818694
deviation-center-line_max0.10840780468821248
deviation-center-line_mean0.06809506728405552
deviation-center-line_min0.034630630716341176
deviation-heading_max0.8369208796118853
deviation-heading_mean0.6832672849361467
deviation-heading_median0.6925794912374205
deviation-heading_min0.4381772110080602
driven_any_max0.24892701166553136
driven_any_mean0.15879097221389246
driven_any_median0.15156440425209397
driven_any_min0.09301240539794464
driven_lanedir_consec_max0.13277221933000427
driven_lanedir_consec_mean0.08477739407219821
driven_lanedir_consec_min0.05302267162001428
driven_lanedir_max0.13277221933000427
driven_lanedir_mean0.08477739407219821
driven_lanedir_median0.09136919124345688
driven_lanedir_min0.05302267162001428
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.18000000000000016
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.24892701166553136, "sim_physics": 0.103815813322325, "survival_time": 1.850000000000001, "driven_lanedir": 0.1144742580975735, "sim_render-ego": 0.05708205377733385, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15285337293470228, "deviation-heading": 0.7855845518450804, "set_robot_commands": 0.08575407234398094, "deviation-center-line": 0.07107921395323845, "driven_lanedir_consec": 0.1144742580975735, "sim_compute_sim_state": 0.03487904007370408, "sim_compute_performance-ego": 0.062287027771408494, "sim_compute_robot_state-ego": 0.07148390202908902}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18152560806415943, "sim_physics": 0.08352940082550049, "survival_time": 1.5000000000000009, "driven_lanedir": 0.09478886083070726, "sim_render-ego": 0.04708913167317708, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.12549749215443928, "deviation-heading": 0.668212148489838, "set_robot_commands": 0.06753989060719807, "deviation-center-line": 0.03817153449876099, "driven_lanedir_consec": 0.09478886083070726, "sim_compute_sim_state": 0.03018719355265299, "sim_compute_performance-ego": 0.06622920036315919, "sim_compute_robot_state-ego": 0.051372687021891274}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09301240539794464, "sim_physics": 0.08738971948623657, "survival_time": 1.0000000000000002, "driven_lanedir": 0.05326494738046872, "sim_render-ego": 0.04955867528915405, "in-drivable-lane": 0, "agent_compute-ego": 0.14430102109909057, "deviation-heading": 0.6701689134963467, "set_robot_commands": 0.07950725555419921, "deviation-center-line": 0.08878660030357849, "driven_lanedir_consec": 0.05326494738046872, "sim_compute_sim_state": 0.03318552970886231, "sim_compute_performance-ego": 0.05744156837463379, "sim_compute_robot_state-ego": 0.06689628362655639}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21560270370100468, "sim_physics": 0.09924918232542096, "survival_time": 1.6500000000000008, "driven_lanedir": 0.09642939042336972, "sim_render-ego": 0.08094845396099669, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16076024373372397, "deviation-heading": 0.7904097084737016, "set_robot_commands": 0.08884352626222553, "deviation-center-line": 0.051737972112990874, "driven_lanedir_consec": 0.09642939042336972, "sim_compute_sim_state": 0.03658510699416652, "sim_compute_performance-ego": 0.06045202052954472, "sim_compute_robot_state-ego": 0.0638229124473803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1946663949293179, "sim_physics": 0.08311780542135239, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09136919124345688, "sim_render-ego": 0.04279047995805741, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.11974359303712843, "deviation-heading": 0.696886244298025, "set_robot_commands": 0.05816921591758728, "deviation-center-line": 0.04495795745114882, "driven_lanedir_consec": 0.09136919124345688, "sim_compute_sim_state": 0.027214713394641876, "sim_compute_performance-ego": 0.046264439821243286, "sim_compute_robot_state-ego": 0.047980427742004395}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.21799181148518368, "sim_physics": 0.13661358573219992, "survival_time": 1.6500000000000008, "driven_lanedir": 0.070485519012502, "sim_render-ego": 0.06861155683344061, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.18600028211420233, "deviation-heading": 0.8317106468127028, "set_robot_commands": 0.09746241569519044, "deviation-center-line": 0.0558300950975517, "driven_lanedir_consec": 0.070485519012502, "sim_compute_sim_state": 0.043385679071599785, "sim_compute_performance-ego": 0.08311214591517593, "sim_compute_robot_state-ego": 0.08884510126980869}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.13661907957528455, "sim_physics": 0.08704123497009278, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09720548927707372, "sim_render-ego": 0.04151127815246582, "in-drivable-lane": 0, "agent_compute-ego": 0.12238978385925292, "deviation-heading": 0.6352420878876517, "set_robot_commands": 0.06952095985412597, "deviation-center-line": 0.09285814098641049, "driven_lanedir_consec": 0.09720548927707372, "sim_compute_sim_state": 0.028201751708984375, "sim_compute_performance-ego": 0.04453848838806152, "sim_compute_robot_state-ego": 0.04689370155334473}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.09321625556208228, "sim_physics": 0.1407714605331421, "survival_time": 1.0000000000000002, "driven_lanedir": 0.053470402902319414, "sim_render-ego": 0.08261804580688477, "in-drivable-lane": 0, "agent_compute-ego": 0.22332460880279545, "deviation-heading": 0.6791305667933317, "set_robot_commands": 0.11154395341873168, "deviation-center-line": 0.08481681671320729, "driven_lanedir_consec": 0.053470402902319414, "sim_compute_sim_state": 0.0467875599861145, "sim_compute_performance-ego": 0.08200461864471435, "sim_compute_robot_state-ego": 0.0901975393295288}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.15156440425209397, "sim_physics": 0.07786479702702274, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06774544783969061, "sim_render-ego": 0.04201493439850984, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1144687952818694, "deviation-heading": 0.6942859901126176, "set_robot_commands": 0.06607227855258518, "deviation-center-line": 0.034630630716341176, "driven_lanedir_consec": 0.06774544783969061, "sim_compute_sim_state": 0.02740213606092665, "sim_compute_performance-ego": 0.04582560503924334, "sim_compute_robot_state-ego": 0.055143621232774526}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.12971680848651423, "sim_physics": 0.11495998772707852, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09311699692050812, "sim_render-ego": 0.05996069041165439, "in-drivable-lane": 0, "agent_compute-ego": 0.15760260278528387, "deviation-heading": 0.5476421158115766, "set_robot_commands": 0.08151183345101097, "deviation-center-line": 0.07648713935087165, "driven_lanedir_consec": 0.09311699692050812, "sim_compute_sim_state": 0.03509836847131902, "sim_compute_performance-ego": 0.060934012586420234, "sim_compute_robot_state-ego": 0.06227714365178889}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16308678819709677, "sim_physics": 0.11389999389648438, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13277221933000427, "sim_render-ego": 0.056048831939697265, "in-drivable-lane": 0, "agent_compute-ego": 0.15431689262390136, "deviation-heading": 0.4936257490245566, "set_robot_commands": 0.09097792625427246, "deviation-center-line": 0.10784342660356418, "driven_lanedir_consec": 0.13277221933000427, "sim_compute_sim_state": 0.034494390487670896, "sim_compute_performance-ego": 0.061201982498168946, "sim_compute_robot_state-ego": 0.06035331726074219}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11601358192280134, "sim_physics": 0.12390124279519786, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05302267162001428, "sim_render-ego": 0.05895782553631326, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1690538033195164, "deviation-heading": 0.6925794912374205, "set_robot_commands": 0.09702671092489493, "deviation-center-line": 0.05623632930597032, "driven_lanedir_consec": 0.05302267162001428, "sim_compute_sim_state": 0.03808836314989173, "sim_compute_performance-ego": 0.06608535932457965, "sim_compute_robot_state-ego": 0.06551654442496922}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.17861121484688067, "sim_physics": 0.11518290213176184, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09075784695523326, "sim_render-ego": 0.06285200800214495, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1799895167350769, "deviation-heading": 0.8369208796118853, "set_robot_commands": 0.10091409512928554, "deviation-center-line": 0.06545245854791194, "driven_lanedir_consec": 0.09075784695523326, "sim_compute_sim_state": 0.03619083336421421, "sim_compute_performance-ego": 0.06886724063328334, "sim_compute_robot_state-ego": 0.07325811897005353}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.13680501498574038, "sim_physics": 0.1098530391852061, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0651397665087714, "sim_render-ego": 0.05454071362813314, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15742312868436178, "deviation-heading": 0.7884329691394065, "set_robot_commands": 0.08054398496945699, "deviation-center-line": 0.044129888931074, "driven_lanedir_consec": 0.0651397665087714, "sim_compute_sim_state": 0.03774347901344299, "sim_compute_performance-ego": 0.06704298655192058, "sim_compute_robot_state-ego": 0.06978394587834676}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12450550013675064, "sim_physics": 0.10203765739094128, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09761790274128002, "sim_render-ego": 0.06283571503379128, "in-drivable-lane": 0, "agent_compute-ego": 0.1782796491276134, "deviation-heading": 0.4381772110080602, "set_robot_commands": 0.0978942567651922, "deviation-center-line": 0.10840780468821248, "driven_lanedir_consec": 0.09761790274128002, "sim_compute_sim_state": 0.03940852121873335, "sim_compute_performance-ego": 0.06950465115633878, "sim_compute_robot_state-ego": 0.07257769324562767}}
set_robot_commands_max0.11154395341873168
set_robot_commands_mean0.08488549171332917
set_robot_commands_median0.08575407234398094
set_robot_commands_min0.05816921591758728
sim_compute_performance-ego_max0.08311214591517593
sim_compute_performance-ego_mean0.06278608983985975
sim_compute_performance-ego_median0.062287027771408494
sim_compute_performance-ego_min0.04453848838806152
sim_compute_robot_state-ego_max0.0901975393295288
sim_compute_robot_state-ego_mean0.0657601959789271
sim_compute_robot_state-ego_median0.06551654442496922
sim_compute_robot_state-ego_min0.04689370155334473
sim_compute_sim_state_max0.0467875599861145
sim_compute_sim_state_mean0.035256844417128355
sim_compute_sim_state_median0.03509836847131902
sim_compute_sim_state_min0.027214713394641876
sim_physics_max0.1407714605331421
sim_physics_mean0.10528185485133086
sim_physics_median0.103815813322325
sim_physics_min0.07786479702702274
sim_render-ego_max0.08261804580688477
sim_render-ego_mean0.05782802629345029
sim_render-ego_median0.05708205377733385
sim_render-ego_min0.04151127815246582
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.3366666666666671
survival_time_min1.0000000000000002
212362492Liam Paullchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessno8450:04:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08894063925673246
survival_time_median1.5000000000000009
deviation-center-line_median0.04991482380675351
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.1806117296218872
agent_compute-ego_mean0.1655048635403618
agent_compute-ego_median0.16418138043633823
agent_compute-ego_min0.15411489009857177
deviation-center-line_max0.08815886202707515
deviation-center-line_mean0.056926391433218225
deviation-center-line_min0.04373275321710265
deviation-heading_max0.7795006368093428
deviation-heading_mean0.663002000280312
deviation-heading_median0.6705768119375406
deviation-heading_min0.5158413722372513
driven_any_max0.2173731741292939
driven_any_mean0.18665227752146593
driven_any_median0.19390672638172804
driven_any_min0.11916948924631889
driven_lanedir_consec_max0.11778380419287338
driven_lanedir_consec_mean0.09116302842752402
driven_lanedir_consec_min0.05905850043264316
driven_lanedir_max0.11778380419287338
driven_lanedir_mean0.09116302842752402
driven_lanedir_median0.08894063925673246
driven_lanedir_min0.05905850043264316
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.29000000000000026
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2173731741292939, "sim_physics": 0.12315622498007382, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07613382933837265, "sim_render-ego": 0.06360792412477381, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1806117296218872, "deviation-heading": 0.6611856573234065, "set_robot_commands": 0.09807705177980312, "deviation-center-line": 0.057542085208123914, "driven_lanedir_consec": 0.07613382933837265, "sim_compute_sim_state": 0.04104178793290082, "sim_compute_performance-ego": 0.06924310151268454, "sim_compute_robot_state-ego": 0.0793308230007396}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19390672638172804, "sim_physics": 0.10502165761487238, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11389836891699844, "sim_render-ego": 0.05720635940288675, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.16418138043633823, "deviation-heading": 0.6879055230940186, "set_robot_commands": 0.0938858410407757, "deviation-center-line": 0.04373275321710265, "driven_lanedir_consec": 0.11389836891699844, "sim_compute_sim_state": 0.03837948832018622, "sim_compute_performance-ego": 0.06585763240682668, "sim_compute_robot_state-ego": 0.07017013122295511}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11916948924631889, "sim_physics": 0.10663676261901855, "survival_time": 0.9500000000000004, "driven_lanedir": 0.08894063925673246, "sim_render-ego": 0.05624607989662572, "in-drivable-lane": 0, "agent_compute-ego": 0.15416939635025828, "deviation-heading": 0.5158413722372513, "set_robot_commands": 0.0921387797907779, "deviation-center-line": 0.08815886202707515, "driven_lanedir_consec": 0.08894063925673246, "sim_compute_sim_state": 0.04125876175729852, "sim_compute_performance-ego": 0.06381748851976897, "sim_compute_robot_state-ego": 0.06991012472855418}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1929585123916514, "sim_physics": 0.1133077621459961, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05905850043264316, "sim_render-ego": 0.058344459533691405, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.15411489009857177, "deviation-heading": 0.7795006368093428, "set_robot_commands": 0.08405192693074544, "deviation-center-line": 0.04528343290703592, "driven_lanedir_consec": 0.05905850043264316, "sim_compute_sim_state": 0.0362124760945638, "sim_compute_performance-ego": 0.060858265558878584, "sim_compute_robot_state-ego": 0.06752686500549317}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20985348545833743, "sim_physics": 0.1296504928219703, "survival_time": 1.5500000000000007, "driven_lanedir": 0.11778380419287338, "sim_render-ego": 0.06214711743016397, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17444692119475333, "deviation-heading": 0.6705768119375406, "set_robot_commands": 0.0908898691977224, "deviation-center-line": 0.04991482380675351, "driven_lanedir_consec": 0.11778380419287338, "sim_compute_sim_state": 0.03754217393936649, "sim_compute_performance-ego": 0.06786394888354887, "sim_compute_robot_state-ego": 0.07798829386311193}}
set_robot_commands_max0.09807705177980312
set_robot_commands_mean0.09180869374796492
set_robot_commands_median0.0921387797907779
set_robot_commands_min0.08405192693074544
sim_compute_performance-ego_max0.06924310151268454
sim_compute_performance-ego_mean0.06552808737634153
sim_compute_performance-ego_median0.06585763240682668
sim_compute_performance-ego_min0.060858265558878584
sim_compute_robot_state-ego_max0.0793308230007396
sim_compute_robot_state-ego_mean0.0729852475641708
sim_compute_robot_state-ego_median0.07017013122295511
sim_compute_robot_state-ego_min0.06752686500549317
sim_compute_sim_state_max0.04125876175729852
sim_compute_sim_state_mean0.03888693760886317
sim_compute_sim_state_median0.03837948832018622
sim_compute_sim_state_min0.0362124760945638
sim_physics_max0.1296504928219703
sim_physics_mean0.11555458003638625
sim_physics_median0.1133077621459961
sim_physics_min0.10502165761487238
sim_render-ego_max0.06360792412477381
sim_render-ego_mean0.05951038807762833
sim_render-ego_median0.058344459533691405
sim_render-ego_min0.05624607989662572
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4300000000000006
survival_time_min0.9500000000000004
212332504RamiNaimchallenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerrorno8450:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212292510RamiNaimchallenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerrorno8450:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212232512RamiNaimchallenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrorno8450:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212202520Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrorno8450:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212052537Liam Paullbaseline-IL-sim-tensorflowaido2-LFVI-sim-validationstep1-simulationerrorno8450:05:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211692707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno8450:57:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2707/step1-simulation-ip-172-31-42-167-7194-job21169/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211522574AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerrorno8450:02:12
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211233074Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationhost-errorno8450:53:52
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3074/step1-simulation-ip-172-31-42-167-7194-job21123/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211142641zamatorychallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessno8450:05:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.07142785839412523
agent_compute-ego_mean0.0674982227046008
agent_compute-ego_median0.06605472347953102
agent_compute-ego_min0.06496120989322662
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11283720043343558, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05973514033035493, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06927918716215752, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09211865948959136, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03973288267431125, "sim_compute_performance-ego": 0.0677986010699205, "sim_compute_robot_state-ego": 0.07260569048599458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11089439392089843, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.061729522546132405, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06576813459396362, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09436575174331666, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.040313196182250974, "sim_compute_performance-ego": 0.07223219871520996, "sim_compute_robot_state-ego": 0.07747091054916382}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11681672659787264, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.05665001002225009, "in-drivable-lane": 0, "agent_compute-ego": 0.06605472347953102, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09548687934875488, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.039603677662936126, "sim_compute_performance-ego": 0.06536361304196445, "sim_compute_robot_state-ego": 0.07557025822726163}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.10565471152464548, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06278826793034871, "in-drivable-lane": 0, "agent_compute-ego": 0.06496120989322662, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0856667309999466, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03641915321350098, "sim_compute_performance-ego": 0.06533794105052948, "sim_compute_robot_state-ego": 0.06791747609774272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.11234492322672968, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06014040760371996, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07142785839412523, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09934082238570505, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.038412804188935654, "sim_compute_performance-ego": 0.07057675589685855, "sim_compute_robot_state-ego": 0.07528383317201034}}
set_robot_commands_max0.09934082238570505
set_robot_commands_mean0.09339576879346292
set_robot_commands_median0.09436575174331666
set_robot_commands_min0.0856667309999466
sim_compute_performance-ego_max0.07223219871520996
sim_compute_performance-ego_mean0.06826182195489658
sim_compute_performance-ego_median0.0677986010699205
sim_compute_performance-ego_min0.06533794105052948
sim_compute_robot_state-ego_max0.07747091054916382
sim_compute_robot_state-ego_mean0.0737696337064346
sim_compute_robot_state-ego_median0.07528383317201034
sim_compute_robot_state-ego_min0.06791747609774272
sim_compute_sim_state_max0.040313196182250974
sim_compute_sim_state_mean0.03889634278438699
sim_compute_sim_state_median0.039603677662936126
sim_compute_sim_state_min0.03641915321350098
sim_physics_max0.11681672659787264
sim_physics_mean0.11170959114071637
sim_physics_median0.11234492322672968
sim_physics_min0.10565471152464548
sim_render-ego_max0.06278826793034871
sim_render-ego_mean0.060208669686561224
sim_render-ego_median0.06014040760371996
sim_render-ego_min0.05665001002225009
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
210872770Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno8450:57:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-42-167-7194-job21087/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
210132864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno8450:59:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-42-167-7194-job21013/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209932814Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationhost-errorno8450:16:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 486, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1024, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1181, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 39, in copy_to_cache
    msg = 'Copying %s to cache %s' % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2814/step1-simulation-ip-172-31-42-167-7194-job20993/tmp/tmpx3zywuo2/episodes/ETHZ_autolab_technical_track-6-0/drawing.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209882823Liam Paullchallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno8450:08:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1647277729851859
agent_compute-ego_mean0.1581295410580818
agent_compute-ego_median0.15800137873049136
agent_compute-ego_min0.14852274894714357
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16276461989791305, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06159547523215965, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15800137873049136, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10077059268951416, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0401618171621252, "sim_compute_performance-ego": 0.07139444792712177, "sim_compute_robot_state-ego": 0.07510447060620343, "sim_compute_robot_state-npc0": 0.07020055364679408, "sim_compute_robot_state-npc1": 0.07108915293658222, "sim_compute_robot_state-npc2": 0.06862039919252749, "sim_compute_robot_state-npc3": 0.07214004022103769}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1988169860839844, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06441498756408691, "in-drivable-lane": 0, "agent_compute-ego": 0.14852274894714357, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09658520698547364, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03989990234375, "sim_compute_performance-ego": 0.07115654945373535, "sim_compute_robot_state-ego": 0.07548545837402344, "sim_compute_robot_state-npc0": 0.07108907699584961, "sim_compute_robot_state-npc1": 0.07199681282043457, "sim_compute_robot_state-npc2": 0.0678072452545166, "sim_compute_robot_state-npc3": 0.06878486633300782}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18645850608223363, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0651839061787254, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15641108939522191, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09612292992441278, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.039554097150501455, "sim_compute_performance-ego": 0.07143299203169973, "sim_compute_robot_state-ego": 0.07369480634990491, "sim_compute_robot_state-npc0": 0.07104967142406263, "sim_compute_robot_state-npc1": 0.07142457522844013, "sim_compute_robot_state-npc2": 0.07008715366062365, "sim_compute_robot_state-npc3": 0.06798209955817774}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.21603376050538656, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06590033482901658, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16298471523236624, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10003293013270896, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04109033753600302, "sim_compute_performance-ego": 0.07422502734993078, "sim_compute_robot_state-ego": 0.08359972434707835, "sim_compute_robot_state-npc0": 0.07467775405207767, "sim_compute_robot_state-npc1": 0.0726069619383993, "sim_compute_robot_state-npc2": 0.07091570805899705, "sim_compute_robot_state-npc3": 0.07112905345385588}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.2067180701664516, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06897997004645211, "in-drivable-lane": 0, "agent_compute-ego": 0.1647277729851859, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10631983620779854, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04329866170883179, "sim_compute_performance-ego": 0.08016084773199898, "sim_compute_robot_state-ego": 0.08978383030210223, "sim_compute_robot_state-npc0": 0.07944731201444354, "sim_compute_robot_state-npc1": 0.07865578787667411, "sim_compute_robot_state-npc2": 0.07867454630987984, "sim_compute_robot_state-npc3": 0.07827100583485194}}
set_robot_commands_max0.10631983620779854
set_robot_commands_mean0.09996629918798162
set_robot_commands_median0.10003293013270896
set_robot_commands_min0.09612292992441278
sim_compute_performance-ego_max0.08016084773199898
sim_compute_performance-ego_mean0.07367397289889734
sim_compute_performance-ego_median0.07143299203169973
sim_compute_performance-ego_min0.07115654945373535
sim_compute_robot_state-ego_max0.08978383030210223
sim_compute_robot_state-ego_mean0.07953365799586247
sim_compute_robot_state-ego_median0.07548545837402344
sim_compute_robot_state-ego_min0.07369480634990491
sim_compute_robot_state-npc0_max0.07944731201444354
sim_compute_robot_state-npc0_mean0.07329287362664551
sim_compute_robot_state-npc0_median0.07108907699584961
sim_compute_robot_state-npc0_min0.07020055364679408
sim_compute_robot_state-npc1_max0.07865578787667411
sim_compute_robot_state-npc1_mean0.07315465816010605
sim_compute_robot_state-npc1_median0.07199681282043457
sim_compute_robot_state-npc1_min0.07108915293658222
sim_compute_robot_state-npc2_max0.07867454630987984
sim_compute_robot_state-npc2_mean0.07122101049530892
sim_compute_robot_state-npc2_median0.07008715366062365
sim_compute_robot_state-npc2_min0.0678072452545166
sim_compute_robot_state-npc3_max0.07827100583485194
sim_compute_robot_state-npc3_mean0.07166141308018621
sim_compute_robot_state-npc3_median0.07112905345385588
sim_compute_robot_state-npc3_min0.06798209955817774
sim_compute_sim_state_max0.04329866170883179
sim_compute_sim_state_mean0.040800963180242296
sim_compute_sim_state_median0.0401618171621252
sim_compute_sim_state_min0.039554097150501455
sim_physics_max0.21603376050538656
sim_physics_mean0.19415838854719383
sim_physics_median0.1988169860839844
sim_physics_min0.16276461989791305
sim_render-ego_max0.06897997004645211
sim_render-ego_mean0.06521493477008813
sim_render-ego_median0.0651839061787254
sim_render-ego_min0.06159547523215965
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
209872832AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrorno8450:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209832835AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrorno8450:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209812840AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrorno8450:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209792844AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrorno8450:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209732857AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessno8450:10:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4430532861735075
survival_time_median7.049999999999983
deviation-center-line_median0.20873036418961904
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.11424389122225714
agent_compute-ego_mean0.1019383098907178
agent_compute-ego_median0.09952219816354604
agent_compute-ego_min0.09163950764855672
deviation-center-line_max0.4406719765006902
deviation-center-line_mean0.2389268041098079
deviation-center-line_min0.1197182906674316
deviation-heading_max2.0405002394588827
deviation-heading_mean1.6794211129018712
deviation-heading_median1.6898654544228242
deviation-heading_min1.051443625514617
driven_any_max0.5800977204512235
driven_any_mean0.4095623290163637
driven_any_median0.539700175382884
driven_any_min0.145941590384182
driven_lanedir_consec_max0.4807143964063374
driven_lanedir_consec_mean0.336827421987887
driven_lanedir_consec_min0.11998715093122447
driven_lanedir_max0.4807143964063374
driven_lanedir_mean0.336827421987887
driven_lanedir_median0.4430532861735075
driven_lanedir_min0.11998715093122447
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3899999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5800977204512235, "sim_physics": 0.12562400259469686, "survival_time": 7.599999999999981, "driven_lanedir": 0.471157144399132, "sim_render-ego": 0.06570419982859962, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.10857231366006952, "deviation-heading": 2.0405002394588827, "set_robot_commands": 0.10646736778711018, "deviation-center-line": 0.4406719765006902, "driven_lanedir_consec": 0.471157144399132, "sim_compute_sim_state": 0.04145510573136179, "sim_compute_performance-ego": 0.0740889404949389, "sim_compute_robot_state-ego": 0.08323616573685094}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23432920698788115, "sim_physics": 0.11734150373018704, "survival_time": 3.2499999999999964, "driven_lanedir": 0.16922513202923373, "sim_render-ego": 0.06126067821796124, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09952219816354604, "deviation-heading": 1.575960017562641, "set_robot_commands": 0.09768353608938364, "deviation-center-line": 0.1197182906674316, "driven_lanedir_consec": 0.16922513202923373, "sim_compute_sim_state": 0.04137854209313026, "sim_compute_performance-ego": 0.06573031132037822, "sim_compute_robot_state-ego": 0.07341010387127216}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.145941590384182, "sim_physics": 0.10797257756077966, "survival_time": 2.1500000000000004, "driven_lanedir": 0.11998715093122447, "sim_render-ego": 0.058402455130288765, "in-drivable-lane": 0, "agent_compute-ego": 0.09163950764855672, "deviation-heading": 1.051443625514617, "set_robot_commands": 0.09354704479838528, "deviation-center-line": 0.20873036418961904, "driven_lanedir_consec": 0.11998715093122447, "sim_compute_sim_state": 0.0376201119533805, "sim_compute_performance-ego": 0.06827331698218057, "sim_compute_robot_state-ego": 0.07088540875634482}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5477429518756478, "sim_physics": 0.10882659391923384, "survival_time": 7.149999999999983, "driven_lanedir": 0.4807143964063374, "sim_render-ego": 0.05581569838357139, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09571363875915954, "deviation-heading": 2.039336227550392, "set_robot_commands": 0.08734535337328077, "deviation-center-line": 0.22455249635290225, "driven_lanedir_consec": 0.4807143964063374, "sim_compute_sim_state": 0.035767678614262936, "sim_compute_performance-ego": 0.06328660291391652, "sim_compute_robot_state-ego": 0.06796782833712918}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.539700175382884, "sim_physics": 0.13188868549698635, "survival_time": 7.049999999999983, "driven_lanedir": 0.4430532861735075, "sim_render-ego": 0.06847099716781724, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11424389122225714, "deviation-heading": 1.6898654544228242, "set_robot_commands": 0.10856026284238124, "deviation-center-line": 0.2009608928383967, "driven_lanedir_consec": 0.4430532861735075, "sim_compute_sim_state": 0.045470599587082015, "sim_compute_performance-ego": 0.080280657355667, "sim_compute_robot_state-ego": 0.08913160046787126}}
set_robot_commands_max0.10856026284238124
set_robot_commands_mean0.09872071297810822
set_robot_commands_median0.09768353608938364
set_robot_commands_min0.08734535337328077
sim_compute_performance-ego_max0.080280657355667
sim_compute_performance-ego_mean0.07033196581341625
sim_compute_performance-ego_median0.06827331698218057
sim_compute_performance-ego_min0.06328660291391652
sim_compute_robot_state-ego_max0.08913160046787126
sim_compute_robot_state-ego_mean0.07692622143389367
sim_compute_robot_state-ego_median0.07341010387127216
sim_compute_robot_state-ego_min0.06796782833712918
sim_compute_sim_state_max0.045470599587082015
sim_compute_sim_state_mean0.0403384075958435
sim_compute_sim_state_median0.04137854209313026
sim_compute_sim_state_min0.035767678614262936
sim_physics_max0.13188868549698635
sim_physics_mean0.11833067266037674
sim_physics_median0.11734150373018704
sim_physics_min0.10797257756077966
sim_render-ego_max0.06847099716781724
sim_render-ego_mean0.06193080574564765
sim_render-ego_median0.06126067821796124
sim_render-ego_min0.05581569838357139
simulation-passed1
survival_time_max7.599999999999981
survival_time_mean5.439999999999989
survival_time_min2.1500000000000004
209592861AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessno8450:18:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4442836953793563
survival_time_median6.5999999999999845
deviation-center-line_median0.23011717945840268
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.12275256315867106
agent_compute-ego_mean0.10480534467338098
agent_compute-ego_median0.10146036292567398
agent_compute-ego_min0.09774773567914964
deviation-center-line_max0.2677965905311012
deviation-center-line_mean0.2240018824772453
deviation-center-line_min0.1676578222570646
deviation-heading_max1.9590729116640704
deviation-heading_mean1.718855273685324
deviation-heading_median1.759743530959963
deviation-heading_min1.4542236037360072
driven_any_max1.1707030898390385
driven_any_mean0.5517917304513403
driven_any_median0.5035446157600671
driven_any_min0.21826570258829023
driven_lanedir_consec_max0.49543157849784336
driven_lanedir_consec_mean0.363214735545378
driven_lanedir_consec_min0.18106093948028257
driven_lanedir_max0.49543157849784336
driven_lanedir_mean0.363214735545378
driven_lanedir_median0.4442836953793563
driven_lanedir_min0.18106093948028257
in-drivable-lane_max7.9000000000000945
in-drivable-lane_mean1.7800000000000178
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1707030898390385, "sim_physics": 0.15399993658065797, "survival_time": 14.950000000000076, "driven_lanedir": 0.49543157849784336, "sim_render-ego": 0.05325824419657389, "in-drivable-lane": 7.9000000000000945, "agent_compute-ego": 0.12275256315867106, "deviation-heading": 1.637814574719438, "set_robot_commands": 0.0816234024365743, "deviation-center-line": 0.2677965905311012, "driven_lanedir_consec": 0.49543157849784336, "sim_compute_sim_state": 0.03412662744522095, "sim_compute_performance-ego": 0.059219028949737545, "sim_compute_robot_state-ego": 0.06724810202916463, "sim_compute_robot_state-npc0": 0.06217306137084961, "sim_compute_robot_state-npc1": 0.0603417444229126, "sim_compute_robot_state-npc2": 0.06085826794306437, "sim_compute_robot_state-npc3": 0.06146678924560547}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.35888276677719, "sim_physics": 0.17299936215082803, "survival_time": 4.799999999999991, "driven_lanedir": 0.24748331544262123, "sim_render-ego": 0.0627503792444865, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09774773567914964, "deviation-heading": 1.759743530959963, "set_robot_commands": 0.0982886254787445, "deviation-center-line": 0.2070233828025143, "driven_lanedir_consec": 0.24748331544262123, "sim_compute_sim_state": 0.03909137099981308, "sim_compute_performance-ego": 0.06644412875175476, "sim_compute_robot_state-ego": 0.07793417821327846, "sim_compute_robot_state-npc0": 0.0721106082201004, "sim_compute_robot_state-npc1": 0.07072754700978597, "sim_compute_robot_state-npc2": 0.0694346899787585, "sim_compute_robot_state-npc3": 0.06805821011463802}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5075624772921158, "sim_physics": 0.18783265307433625, "survival_time": 6.649999999999984, "driven_lanedir": 0.4478141489267866, "sim_render-ego": 0.062262959946367075, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10391545654239512, "deviation-heading": 1.7834217473471417, "set_robot_commands": 0.10066343967179608, "deviation-center-line": 0.24741443733714355, "driven_lanedir_consec": 0.4478141489267866, "sim_compute_sim_state": 0.03942739156852091, "sim_compute_performance-ego": 0.07062899797482598, "sim_compute_robot_state-ego": 0.07568726145235219, "sim_compute_robot_state-npc0": 0.0719773375002065, "sim_compute_robot_state-npc1": 0.07020208889380433, "sim_compute_robot_state-npc2": 0.07261384519419276, "sim_compute_robot_state-npc3": 0.07338236686878634}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5035446157600671, "sim_physics": 0.1844956116242842, "survival_time": 6.5999999999999845, "driven_lanedir": 0.4442836953793563, "sim_render-ego": 0.06146908528877027, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.10146036292567398, "deviation-heading": 1.9590729116640704, "set_robot_commands": 0.09928793979413582, "deviation-center-line": 0.23011717945840268, "driven_lanedir_consec": 0.4442836953793563, "sim_compute_sim_state": 0.04002102757945205, "sim_compute_performance-ego": 0.0695431087956284, "sim_compute_robot_state-ego": 0.07357061992992055, "sim_compute_robot_state-npc0": 0.06915734392223936, "sim_compute_robot_state-npc1": 0.07379083561174797, "sim_compute_robot_state-npc2": 0.0708716529788393, "sim_compute_robot_state-npc3": 0.07259641452269121}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21826570258829023, "sim_physics": 0.17394244084592725, "survival_time": 3.049999999999997, "driven_lanedir": 0.18106093948028257, "sim_render-ego": 0.06939181734303959, "in-drivable-lane": 0, "agent_compute-ego": 0.09815060506101514, "deviation-heading": 1.4542236037360072, "set_robot_commands": 0.0966396918062304, "deviation-center-line": 0.1676578222570646, "driven_lanedir_consec": 0.18106093948028257, "sim_compute_sim_state": 0.03979993648216373, "sim_compute_performance-ego": 0.0699092833722224, "sim_compute_robot_state-ego": 0.07434421289162557, "sim_compute_robot_state-npc0": 0.07001878003605076, "sim_compute_robot_state-npc1": 0.06707228598047475, "sim_compute_robot_state-npc2": 0.07076052368664351, "sim_compute_robot_state-npc3": 0.07029433328597272}}
set_robot_commands_max0.10066343967179608
set_robot_commands_mean0.0953006198374962
set_robot_commands_median0.0982886254787445
set_robot_commands_min0.0816234024365743
sim_compute_performance-ego_max0.07062899797482598
sim_compute_performance-ego_mean0.06714890956883382
sim_compute_performance-ego_median0.0695431087956284
sim_compute_performance-ego_min0.059219028949737545
sim_compute_robot_state-ego_max0.07793417821327846
sim_compute_robot_state-ego_mean0.07375687490326828
sim_compute_robot_state-ego_median0.07434421289162557
sim_compute_robot_state-ego_min0.06724810202916463
sim_compute_robot_state-npc0_max0.0721106082201004
sim_compute_robot_state-npc0_mean0.06908742620988934
sim_compute_robot_state-npc0_median0.07001878003605076
sim_compute_robot_state-npc0_min0.06217306137084961
sim_compute_robot_state-npc1_max0.07379083561174797
sim_compute_robot_state-npc1_mean0.06842690038374513
sim_compute_robot_state-npc1_median0.07020208889380433
sim_compute_robot_state-npc1_min0.0603417444229126
sim_compute_robot_state-npc2_max0.07261384519419276
sim_compute_robot_state-npc2_mean0.0689077959562997
sim_compute_robot_state-npc2_median0.07076052368664351
sim_compute_robot_state-npc2_min0.06085826794306437
sim_compute_robot_state-npc3_max0.07338236686878634
sim_compute_robot_state-npc3_mean0.06915962280753876
sim_compute_robot_state-npc3_median0.07029433328597272
sim_compute_robot_state-npc3_min0.06146678924560547
sim_compute_sim_state_max0.04002102757945205
sim_compute_sim_state_mean0.03849327081503415
sim_compute_sim_state_median0.03942739156852091
sim_compute_sim_state_min0.03412662744522095
sim_physics_max0.18783265307433625
sim_physics_mean0.17465400085520671
sim_physics_median0.17394244084592725
sim_physics_min0.15399993658065797
sim_render-ego_max0.06939181734303959
sim_render-ego_mean0.06182649720384746
sim_render-ego_median0.062262959946367075
sim_render-ego_min0.05325824419657389
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.210000000000006
survival_time_min3.049999999999997
209512880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errorno8450:04:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2880/step1-simulation-ip-172-31-42-167-7194-job20951/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209462893almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno8450:12:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3004612044380359
survival_time_median4.899999999999991
deviation-center-line_median0.24770995818777833
in-drivable-lane_median1.20000000000001


other stats
agent_compute-ego_max0.18701149929653516
agent_compute-ego_mean0.17924790828734913
agent_compute-ego_median0.17968229371674208
agent_compute-ego_min0.1731323993812173
deviation-center-line_max0.612632943547377
deviation-center-line_mean0.3088841726088521
deviation-center-line_min0.16005125397873246
deviation-heading_max6.254828250705772
deviation-heading_mean2.609587082899453
deviation-heading_median2.1702556178769954
deviation-heading_min0.7256424864991055
driven_any_max1.4334994795858234
driven_any_mean0.8240885074796152
driven_any_median0.6288276408666593
driven_any_min0.5249644395511194
driven_lanedir_consec_max0.6665759722376454
driven_lanedir_consec_mean0.3782246515968707
driven_lanedir_consec_min0.16483096550581067
driven_lanedir_max0.9172567432880294
driven_lanedir_mean0.4821405191643383
driven_lanedir_median0.368195617900545
driven_lanedir_min0.20756098713738247
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean1.319999999999998
in-drivable-lane_min0.6499999999999977
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9939066272326912, "sim_physics": 0.1148185871415219, "survival_time": 5.899999999999987, "driven_lanedir": 0.6665759722376454, "sim_render-ego": 0.062989111674034, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1731323993812173, "deviation-heading": 0.9018486313612406, "set_robot_commands": 0.0941966044700752, "deviation-center-line": 0.22111729086582177, "driven_lanedir_consec": 0.6665759722376454, "sim_compute_sim_state": 0.04150183322065967, "sim_compute_performance-ego": 0.06945890693341271, "sim_compute_robot_state-ego": 0.07632306672758975}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6288276408666593, "sim_physics": 0.13297929569166533, "survival_time": 4.899999999999991, "driven_lanedir": 0.368195617900545, "sim_render-ego": 0.06354881062799571, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.17968229371674208, "deviation-heading": 2.1702556178769954, "set_robot_commands": 0.09778579400510204, "deviation-center-line": 0.30290941646455094, "driven_lanedir_consec": 0.3004612044380359, "sim_compute_sim_state": 0.04110242882553412, "sim_compute_performance-ego": 0.07298643734990334, "sim_compute_robot_state-ego": 0.0815934672647593}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5392443501617825, "sim_physics": 0.12483399293639444, "survival_time": 4.399999999999992, "driven_lanedir": 0.25111327525808935, "sim_render-ego": 0.06701323119076816, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.18701149929653516, "deviation-heading": 2.9953604280541524, "set_robot_commands": 0.1016078618439761, "deviation-center-line": 0.24770995818777833, "driven_lanedir_consec": 0.16483096550581067, "sim_compute_sim_state": 0.04181681166995655, "sim_compute_performance-ego": 0.07316941835663536, "sim_compute_robot_state-ego": 0.08204723217270592}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4334994795858234, "sim_physics": 0.12172752949926588, "survival_time": 10.800000000000018, "driven_lanedir": 0.9172567432880294, "sim_render-ego": 0.06299183434910244, "in-drivable-lane": 1.20000000000001, "agent_compute-ego": 0.1830467504483682, "deviation-heading": 6.254828250705772, "set_robot_commands": 0.09845449416725724, "deviation-center-line": 0.612632943547377, "driven_lanedir_consec": 0.5516941286654791, "sim_compute_sim_state": 0.03969017885349415, "sim_compute_performance-ego": 0.06922387193750452, "sim_compute_robot_state-ego": 0.07590696767524437}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5249644395511194, "sim_physics": 0.11535192147279397, "survival_time": 3.899999999999994, "driven_lanedir": 0.20756098713738247, "sim_render-ego": 0.06417710964496319, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.17336659859388304, "deviation-heading": 0.7256424864991055, "set_robot_commands": 0.09479076128739578, "deviation-center-line": 0.16005125397873246, "driven_lanedir_consec": 0.20756098713738247, "sim_compute_sim_state": 0.039432381972288474, "sim_compute_performance-ego": 0.0711813890016996, "sim_compute_robot_state-ego": 0.07557138724204822}}
set_robot_commands_max0.1016078618439761
set_robot_commands_mean0.09736710315476128
set_robot_commands_median0.09778579400510204
set_robot_commands_min0.0941966044700752
sim_compute_performance-ego_max0.07316941835663536
sim_compute_performance-ego_mean0.0712040047158311
sim_compute_performance-ego_median0.0711813890016996
sim_compute_performance-ego_min0.06922387193750452
sim_compute_robot_state-ego_max0.08204723217270592
sim_compute_robot_state-ego_mean0.0782884242164695
sim_compute_robot_state-ego_median0.07632306672758975
sim_compute_robot_state-ego_min0.07557138724204822
sim_compute_sim_state_max0.04181681166995655
sim_compute_sim_state_mean0.04070872690838659
sim_compute_sim_state_median0.04110242882553412
sim_compute_sim_state_min0.039432381972288474
sim_physics_max0.13297929569166533
sim_physics_mean0.1219422653483283
sim_physics_median0.12172752949926588
sim_physics_min0.1148185871415219
sim_render-ego_max0.06701323119076816
sim_render-ego_mean0.06414401949737271
sim_render-ego_median0.06354881062799571
sim_render-ego_min0.062989111674034
simulation-passed1
survival_time_max10.800000000000018
survival_time_mean5.979999999999997
survival_time_min3.899999999999994
209422909ASHWINRAMchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessno8450:05:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.431749818466148
survival_time_median1.2500000000000004
deviation-center-line_median0.07785372543404256
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2686178962389628
agent_compute-ego_mean0.25173895889730435
agent_compute-ego_median0.2489522661481585
agent_compute-ego_min0.234267920255661
deviation-center-line_max0.16850282219718765
deviation-center-line_mean0.09510082986524487
deviation-center-line_min0.05525180113567536
deviation-heading_max0.345995052331256
deviation-heading_mean0.24800759250466264
deviation-heading_median0.20410713107808
deviation-heading_min0.16290079358306278
driven_any_max1.5833783776226673
driven_any_mean0.7153951164384857
driven_any_median0.4884229675397246
driven_any_min0.28273013447102285
driven_lanedir_consec_max1.2398695287041943
driven_lanedir_consec_mean0.5567471842447391
driven_lanedir_consec_min0.27491964178588946
driven_lanedir_max1.2398695287041943
driven_lanedir_mean0.5567471842447391
driven_lanedir_median0.431749818466148
driven_lanedir_min0.27491964178588946
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.24999999999999972
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7526511681720554, "sim_physics": 0.12815493856157575, "survival_time": 1.7500000000000009, "driven_lanedir": 0.37025785151428314, "sim_render-ego": 0.05968667439052037, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.2489522661481585, "deviation-heading": 0.16290079358306278, "set_robot_commands": 0.09025602340698242, "deviation-center-line": 0.09922109875527278, "driven_lanedir_consec": 0.37025785151428314, "sim_compute_sim_state": 0.035672875813075475, "sim_compute_performance-ego": 0.07260489463806152, "sim_compute_robot_state-ego": 0.09340846879141672}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4697929343869585, "sim_physics": 0.12004640579223631, "survival_time": 1.2500000000000004, "driven_lanedir": 0.431749818466148, "sim_render-ego": 0.058878307342529294, "in-drivable-lane": 0, "agent_compute-ego": 0.24309014320373537, "deviation-heading": 0.3370968471517856, "set_robot_commands": 0.09969481468200685, "deviation-center-line": 0.05525180113567536, "driven_lanedir_consec": 0.431749818466148, "sim_compute_sim_state": 0.03994657516479492, "sim_compute_performance-ego": 0.07289329528808594, "sim_compute_robot_state-ego": 0.07731306076049804}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28273013447102285, "sim_physics": 0.13035228848457336, "survival_time": 0.8000000000000002, "driven_lanedir": 0.27491964178588946, "sim_render-ego": 0.0670388787984848, "in-drivable-lane": 0, "agent_compute-ego": 0.234267920255661, "deviation-heading": 0.18993813837912865, "set_robot_commands": 0.09909453988075256, "deviation-center-line": 0.07467470180404599, "driven_lanedir_consec": 0.27491964178588946, "sim_compute_sim_state": 0.037192702293396, "sim_compute_performance-ego": 0.06462275981903076, "sim_compute_robot_state-ego": 0.07585141062736511}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4884229675397246, "sim_physics": 0.13997825332309888, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4669390807531806, "sim_render-ego": 0.06588930669038193, "in-drivable-lane": 0, "agent_compute-ego": 0.26376656864000403, "deviation-heading": 0.345995052331256, "set_robot_commands": 0.0955946445465088, "deviation-center-line": 0.07785372543404256, "driven_lanedir_consec": 0.4669390807531806, "sim_compute_sim_state": 0.039776149003402046, "sim_compute_performance-ego": 0.07078923349795134, "sim_compute_robot_state-ego": 0.0719056855077329}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5833783776226673, "sim_physics": 0.12276480197906496, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2398695287041943, "sim_render-ego": 0.07076876163482666, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.2686178962389628, "deviation-heading": 0.20410713107808, "set_robot_commands": 0.10283422072728476, "deviation-center-line": 0.16850282219718765, "driven_lanedir_consec": 1.2398695287041943, "sim_compute_sim_state": 0.041160384813944496, "sim_compute_performance-ego": 0.07681279579798381, "sim_compute_robot_state-ego": 0.08117243448893229}}
set_robot_commands_max0.10283422072728476
set_robot_commands_mean0.09749484864870708
set_robot_commands_median0.09909453988075256
set_robot_commands_min0.09025602340698242
sim_compute_performance-ego_max0.07681279579798381
sim_compute_performance-ego_mean0.07154459580822267
sim_compute_performance-ego_median0.07260489463806152
sim_compute_performance-ego_min0.06462275981903076
sim_compute_robot_state-ego_max0.09340846879141672
sim_compute_robot_state-ego_mean0.07993021203518902
sim_compute_robot_state-ego_median0.07731306076049804
sim_compute_robot_state-ego_min0.0719056855077329
sim_compute_sim_state_max0.041160384813944496
sim_compute_sim_state_mean0.038749737417722585
sim_compute_sim_state_median0.039776149003402046
sim_compute_sim_state_min0.035672875813075475
sim_physics_max0.13997825332309888
sim_physics_mean0.12825933762810984
sim_physics_median0.12815493856157575
sim_physics_min0.12004640579223631
sim_render-ego_max0.07076876163482666
sim_render-ego_mean0.06445238577134861
sim_render-ego_median0.06588930669038193
sim_render-ego_min0.058878307342529294
simulation-passed1
survival_time_max2.9999999999999973
survival_time_mean1.59
survival_time_min0.8000000000000002
209282970Andrea Censiminimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessno8450:30:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6202968959903497
survival_time_median6.8999999999999835
deviation-center-line_median0.2968973039399582
in-drivable-lane_median0


other stats
agent_compute-ego_max0.15873932495391627
agent_compute-ego_mean0.1448686276022345
agent_compute-ego_median0.14483917016777204
agent_compute-ego_min0.13346620287214006
deviation-center-line_max1.2578907011919125
deviation-center-line_mean0.392559795052945
deviation-center-line_min0.20837582250812192
deviation-heading_max1.7338651399303977
deviation-heading_mean0.922434565822337
deviation-heading_median0.801279189692507
deviation-heading_min0.48740885281046914
driven_any_max1.7560498171261352
driven_any_mean0.8746411422725543
driven_any_median0.9886852216355494
driven_any_min0.278862430643389
driven_lanedir_consec_max1.7523714592470048
driven_lanedir_consec_mean0.6813457664348396
driven_lanedir_consec_min0.2720172605900939
driven_lanedir_max1.7523714592470048
driven_lanedir_mean0.6813457664348396
driven_lanedir_median0.6202968959903497
driven_lanedir_min0.2720172605900939
in-drivable-lane_max6.400000000000029
in-drivable-lane_mean1.1100000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.11173401633612544, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06181628412479977, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15873932495391627, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.09974497856853676, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04129604813006285, "sim_compute_performance-ego": 0.07140197170724114, "sim_compute_robot_state-ego": 0.08080625191009302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.10651785135269164, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.05837292841502598, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.150048679964883, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.090572646686009, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.038639567579541886, "sim_compute_performance-ego": 0.0688673973083496, "sim_compute_robot_state-ego": 0.0697739601135254}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.09838187959459092, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.0559720410241021, "in-drivable-lane": 0, "agent_compute-ego": 0.14572413232591416, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.08185766537984213, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.03583669662475586, "sim_compute_performance-ego": 0.059658114115397134, "sim_compute_robot_state-ego": 0.06459732055664062}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.10888435788776564, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.05766843971998795, "in-drivable-lane": 0, "agent_compute-ego": 0.13847725806028946, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.08727742018906967, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.03633668889170107, "sim_compute_performance-ego": 0.06200290762859842, "sim_compute_robot_state-ego": 0.07061457374821538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.10694984322813549, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.06334422494722827, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.15603620276603525, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.09432532798209692, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.03956755111206612, "sim_compute_performance-ego": 0.0688102288877583, "sim_compute_robot_state-ego": 0.07352558009700688}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.0983344486781529, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.054153823852539064, "in-drivable-lane": 0, "agent_compute-ego": 0.13346620287214006, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.08179356711251395, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.03285309246608189, "sim_compute_performance-ego": 0.05896806035723005, "sim_compute_robot_state-ego": 0.06582615034920829}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.09930631980090074, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.059958815574646, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.14188892908499273, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.08638854933456636, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.03598076860669633, "sim_compute_performance-ego": 0.06443359986157485, "sim_compute_robot_state-ego": 0.06781120367453132}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.1024059990177984, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.06018480528955874, "in-drivable-lane": 0, "agent_compute-ego": 0.14056881614353345, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.08882991127345873, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.03707107771997866, "sim_compute_performance-ego": 0.0683067622392074, "sim_compute_robot_state-ego": 0.06788087927776834}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.1062121073404948, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.06237002743615045, "in-drivable-lane": 0, "agent_compute-ego": 0.15121848318311903, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.0911769496070014, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.0379530323876275, "sim_compute_performance-ego": 0.06815758281283908, "sim_compute_robot_state-ego": 0.07455334663391114}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.11499807281770567, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.06062967017077017, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14610944969066675, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.09217523319133814, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.03842308210289997, "sim_compute_performance-ego": 0.07006973287333614, "sim_compute_robot_state-ego": 0.07656210229016733}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.1135181658858553, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.06402451401456781, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.14988496762896897, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.0947333246196082, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.03919841062038317, "sim_compute_performance-ego": 0.06972121098719605, "sim_compute_robot_state-ego": 0.07781501100697649}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.10873079962200588, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.0578373306327396, "in-drivable-lane": 0, "agent_compute-ego": 0.13952911231252882, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.0928849180539449, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.03930274976624383, "sim_compute_performance-ego": 0.06151497032907274, "sim_compute_robot_state-ego": 0.06860702567630345}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.10468586228734296, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.059098653656115635, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14483917016777204, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.08887031610063512, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.03899135864038262, "sim_compute_performance-ego": 0.06889933476345145, "sim_compute_robot_state-ego": 0.07015658111023389}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.10568788900213728, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.06263823428396452, "in-drivable-lane": 0, "agent_compute-ego": 0.13623109510389425, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.08846613512200824, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.03688748004072803, "sim_compute_performance-ego": 0.06604809680227507, "sim_compute_robot_state-ego": 0.07165522898657847}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.09943748212948876, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.05654285854323771, "in-drivable-lane": 0, "agent_compute-ego": 0.14026758977486384, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.08776818865067731, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.03782419446098359, "sim_compute_performance-ego": 0.06230487368413522, "sim_compute_robot_state-ego": 0.06686846349249242}}
set_robot_commands_max0.09974497856853676
set_robot_commands_mean0.08979100879142046
set_robot_commands_median0.08887031610063512
set_robot_commands_min0.08179356711251395
sim_compute_performance-ego_max0.07140197170724114
sim_compute_performance-ego_mean0.06594432295717752
sim_compute_performance-ego_median0.06815758281283908
sim_compute_performance-ego_min0.05896806035723005
sim_compute_robot_state-ego_max0.08080625191009302
sim_compute_robot_state-ego_mean0.0711369119282435
sim_compute_robot_state-ego_median0.07015658111023389
sim_compute_robot_state-ego_min0.06459732055664062
sim_compute_sim_state_max0.04129604813006285
sim_compute_sim_state_mean0.03774411994334222
sim_compute_sim_state_median0.0379530323876275
sim_compute_sim_state_min0.03285309246608189
sim_physics_max0.11499807281770567
sim_physics_mean0.10571900633207948
sim_physics_median0.1062121073404948
sim_physics_min0.0983344486781529
sim_render-ego_max0.06402451401456781
sim_render-ego_mean0.05964084344569558
sim_render-ego_median0.059958815574646
sim_render-ego_min0.054153823852539064
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean6.166666666666666
survival_time_min2.25
209152945Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno8450:05:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1568374577975864
survival_time_median1.4500000000000006
deviation-center-line_median0.08558524082765089
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1968095795861606
agent_compute-ego_mean0.16987049497076925
agent_compute-ego_median0.16732014142549956
agent_compute-ego_min0.1511807782309396
deviation-center-line_max0.09823906711300212
deviation-center-line_mean0.08681529750080486
deviation-center-line_min0.07658966369559472
deviation-heading_max0.9807205033097725
deviation-heading_mean0.7860944636478493
deviation-heading_median0.8224660060493492
deviation-heading_min0.5024406494371064
driven_any_max0.2561698941949565
driven_any_mean0.2112350654459715
driven_any_median0.228471898122942
driven_any_min0.13826860568403024
driven_lanedir_consec_max0.1979733230134985
driven_lanedir_consec_mean0.1529847092446626
driven_lanedir_consec_min0.1037789626077168
driven_lanedir_max0.1979733230134985
driven_lanedir_mean0.1529847092446626
driven_lanedir_median0.1568374577975864
driven_lanedir_min0.1037789626077168
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.228471898122942, "sim_physics": 0.13147514441917682, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1568374577975864, "sim_render-ego": 0.06333202329175226, "in-drivable-lane": 0, "agent_compute-ego": 0.1968095795861606, "deviation-heading": 0.8459436857816607, "set_robot_commands": 0.09812531800105652, "deviation-center-line": 0.09440674887044148, "driven_lanedir_consec": 0.1568374577975864, "sim_compute_sim_state": 0.03997543762470114, "sim_compute_performance-ego": 0.07634730996756718, "sim_compute_robot_state-ego": 0.08105384070297768}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2561698941949565, "sim_physics": 0.11552744753220502, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1979733230134985, "sim_render-ego": 0.06003417688257554, "in-drivable-lane": 0, "agent_compute-ego": 0.17031702574561625, "deviation-heading": 0.8224660060493492, "set_robot_commands": 0.09417544392978444, "deviation-center-line": 0.07658966369559472, "driven_lanedir_consec": 0.1979733230134985, "sim_compute_sim_state": 0.03755183079663445, "sim_compute_performance-ego": 0.06819572168238022, "sim_compute_robot_state-ego": 0.07336576545939726}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13826860568403024, "sim_physics": 0.10499227614629836, "survival_time": 1.0500000000000005, "driven_lanedir": 0.11261823394668058, "sim_render-ego": 0.05904652958824521, "in-drivable-lane": 0, "agent_compute-ego": 0.1511807782309396, "deviation-heading": 0.5024406494371064, "set_robot_commands": 0.08856593994867235, "deviation-center-line": 0.09823906711300212, "driven_lanedir_consec": 0.11261823394668058, "sim_compute_sim_state": 0.038728895641508554, "sim_compute_performance-ego": 0.06578042393638975, "sim_compute_robot_state-ego": 0.07233078139168876}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18578676657777116, "sim_physics": 0.11793248470012958, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1037789626077168, "sim_render-ego": 0.05852668101970966, "in-drivable-lane": 0, "agent_compute-ego": 0.16732014142549956, "deviation-heading": 0.9807205033097725, "set_robot_commands": 0.09092037494365986, "deviation-center-line": 0.07925576699733504, "driven_lanedir_consec": 0.1037789626077168, "sim_compute_sim_state": 0.034681421059828535, "sim_compute_performance-ego": 0.06463636801793025, "sim_compute_robot_state-ego": 0.07465190153855544}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.24747816265015793, "sim_physics": 0.1170531113942464, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1937155688578307, "sim_render-ego": 0.06766109033064409, "in-drivable-lane": 0, "agent_compute-ego": 0.1637249498656302, "deviation-heading": 0.7789014736613579, "set_robot_commands": 0.08953428268432617, "deviation-center-line": 0.08558524082765089, "driven_lanedir_consec": 0.1937155688578307, "sim_compute_sim_state": 0.03740788951064601, "sim_compute_performance-ego": 0.0686804959268281, "sim_compute_robot_state-ego": 0.0737451712290446}}
set_robot_commands_max0.09812531800105652
set_robot_commands_mean0.09226427190149988
set_robot_commands_median0.09092037494365986
set_robot_commands_min0.08856593994867235
sim_compute_performance-ego_max0.07634730996756718
sim_compute_performance-ego_mean0.0687280639062191
sim_compute_performance-ego_median0.06819572168238022
sim_compute_performance-ego_min0.06463636801793025
sim_compute_robot_state-ego_max0.08105384070297768
sim_compute_robot_state-ego_mean0.07502949206433275
sim_compute_robot_state-ego_median0.0737451712290446
sim_compute_robot_state-ego_min0.07233078139168876
sim_compute_sim_state_max0.03997543762470114
sim_compute_sim_state_mean0.03766909492666374
sim_compute_sim_state_median0.03755183079663445
sim_compute_sim_state_min0.034681421059828535
sim_physics_max0.13147514441917682
sim_physics_mean0.11739609283841124
sim_physics_median0.1170531113942464
sim_physics_min0.10499227614629836
sim_render-ego_max0.06766109033064409
sim_render-ego_mean0.06172010022258536
sim_render-ego_median0.06003417688257554
sim_render-ego_min0.05852668101970966
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4300000000000004
survival_time_min1.0500000000000005
208972981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno8450:23:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2981/step1-simulation-ip-172-31-42-167-7194-job20897/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
208643063Andrea Censirotationaido2-LFVI-sim-validationstep1-simulationsuccessno8450:35:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.000305044676884636
survival_time_median14.950000000000076
deviation-center-line_median0.4891046565937845
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.1717841100692749
agent_compute-ego_mean0.15415737930933637
agent_compute-ego_median0.15004813035329184
agent_compute-ego_min0.14874239285786947
deviation-center-line_max0.6113246250082045
deviation-center-line_mean0.4225460275157091
deviation-center-line_min0.020737627062439232
deviation-heading_max5.830135897709594
deviation-heading_mean5.684570550707688
deviation-heading_median5.657649106857694
deviation-heading_min5.536662996854866
driven_any_max0.02647867283405392
driven_any_mean0.024864239592253624
driven_any_median0.02593019554120814
driven_any_min0.02216545266138003
driven_lanedir_consec_max0.002162616049345756
driven_lanedir_consec_mean-0.0004886462276792348
driven_lanedir_consec_min-0.0036402347654349576
driven_lanedir_max0.002162616049345756
driven_lanedir_mean-0.0004886462276792348
driven_lanedir_median0.000305044676884636
driven_lanedir_min-0.0036402347654349576
in-drivable-lane_max7.650000000000043
in-drivable-lane_mean7.600000000000042
in-drivable-lane_min7.550000000000044
per-episodes
details{"udem1-0-0": {"driven_any": 0.02647867283405392, "sim_physics": 0.2233387756347656, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.06811828772226969, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.1717841100692749, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.10776522000630696, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.042684784730275475, "sim_compute_performance-ego": 0.07542207797368368, "sim_compute_robot_state-ego": 0.08368022044499715, "sim_compute_robot_state-npc0": 0.07519597848256429, "sim_compute_robot_state-npc1": 0.07617562929789225, "sim_compute_robot_state-npc2": 0.0742625610033671, "sim_compute_robot_state-npc3": 0.07410948673884074}, "udem1-1-0": {"driven_any": 0.02593019554120814, "sim_physics": 0.20114351987838744, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.060717660586039224, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15023762543996175, "deviation-heading": 5.795316370396738, "set_robot_commands": 0.09531437794367471, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.03684365272521973, "sim_compute_performance-ego": 0.06562578280766805, "sim_compute_robot_state-ego": 0.0711145011583964, "sim_compute_robot_state-npc0": 0.06884404102961222, "sim_compute_robot_state-npc1": 0.06714802424112956, "sim_compute_robot_state-npc2": 0.06642589648564656, "sim_compute_robot_state-npc3": 0.06716026385625204}, "udem1-2-0": {"driven_any": 0.02380440467243486, "sim_physics": 0.19314073165257772, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.06023574670155843, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1499746378262838, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.09583009322484334, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.03940537691116333, "sim_compute_performance-ego": 0.067316259543101, "sim_compute_robot_state-ego": 0.07176966667175293, "sim_compute_robot_state-npc0": 0.06819501797358195, "sim_compute_robot_state-npc1": 0.06805540402730306, "sim_compute_robot_state-npc2": 0.06815248012542724, "sim_compute_robot_state-npc3": 0.0671971861521403}, "udem1-3-0": {"driven_any": 0.02216545266138003, "sim_physics": 0.20058897813161217, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202353105, "sim_render-ego": 0.0620106585820516, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.14874239285786947, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.09354412317276, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202353105, "sim_compute_sim_state": 0.03781956116358439, "sim_compute_performance-ego": 0.06792743841807047, "sim_compute_robot_state-ego": 0.07166570027669271, "sim_compute_robot_state-npc0": 0.06552098115285238, "sim_compute_robot_state-npc1": 0.06488717317581177, "sim_compute_robot_state-npc2": 0.06418054024378458, "sim_compute_robot_state-npc3": 0.06554256836573283}, "udem1-4-0": {"driven_any": 0.02594247225219117, "sim_physics": 0.2011483057339986, "survival_time": 14.950000000000076, "driven_lanedir": 0.000305044676884636, "sim_render-ego": 0.06259693225224813, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.15004813035329184, "deviation-heading": 5.830135897709594, "set_robot_commands": 0.09202473322550456, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.000305044676884636, "sim_compute_sim_state": 0.03984922170639038, "sim_compute_performance-ego": 0.06701574405034383, "sim_compute_robot_state-ego": 0.07142412821451823, "sim_compute_robot_state-npc0": 0.0662182092666626, "sim_compute_robot_state-npc1": 0.06662629763285319, "sim_compute_robot_state-npc2": 0.06842709302902222, "sim_compute_robot_state-npc3": 0.06810958782831827}}
set_robot_commands_max0.10776522000630696
set_robot_commands_mean0.09689570951461791
set_robot_commands_median0.09531437794367471
set_robot_commands_min0.09202473322550456
sim_compute_performance-ego_max0.07542207797368368
sim_compute_performance-ego_mean0.0686614605585734
sim_compute_performance-ego_median0.067316259543101
sim_compute_performance-ego_min0.06562578280766805
sim_compute_robot_state-ego_max0.08368022044499715
sim_compute_robot_state-ego_mean0.07393084335327148
sim_compute_robot_state-ego_median0.07166570027669271
sim_compute_robot_state-ego_min0.0711145011583964
sim_compute_robot_state-npc0_max0.07519597848256429
sim_compute_robot_state-npc0_mean0.06879484558105468
sim_compute_robot_state-npc0_median0.06819501797358195
sim_compute_robot_state-npc0_min0.06552098115285238
sim_compute_robot_state-npc1_max0.07617562929789225
sim_compute_robot_state-npc1_mean0.06857850567499797
sim_compute_robot_state-npc1_median0.06714802424112956
sim_compute_robot_state-npc1_min0.06488717317581177
sim_compute_robot_state-npc2_max0.0742625610033671
sim_compute_robot_state-npc2_mean0.06828971417744954
sim_compute_robot_state-npc2_median0.06815248012542724
sim_compute_robot_state-npc2_min0.06418054024378458
sim_compute_robot_state-npc3_max0.07410948673884074
sim_compute_robot_state-npc3_mean0.06842381858825684
sim_compute_robot_state-npc3_median0.0671971861521403
sim_compute_robot_state-npc3_min0.06554256836573283
sim_compute_sim_state_max0.042684784730275475
sim_compute_sim_state_mean0.03932051944732666
sim_compute_sim_state_median0.03940537691116333
sim_compute_sim_state_min0.03684365272521973
sim_physics_max0.2233387756347656
sim_physics_mean0.20387206220626833
sim_physics_median0.20114351987838744
sim_physics_min0.19314073165257772
sim_render-ego_max0.06811828772226969
sim_render-ego_mean0.06273585716883341
sim_render-ego_median0.0620106585820516
sim_render-ego_min0.06023574670155843
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
208363064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno8450:21:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3064/step1-simulation-ip-172-31-42-167-7194-job20836/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
208182865AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessno8450:28:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4906378651204748
survival_time_median14.950000000000076
deviation-center-line_median0.23916579592115045
in-drivable-lane_median3.4000000000000483


other stats
agent_compute-ego_max0.11445613543192544
agent_compute-ego_mean0.10948192346225652
agent_compute-ego_median0.10965794801712037
agent_compute-ego_min0.1025368468514804
deviation-center-line_max0.8598179747822606
deviation-center-line_mean0.4164109816235886
deviation-center-line_min0.1524104407527288
deviation-heading_max5.536030364590776
deviation-heading_mean3.1885992625542134
deviation-heading_median1.9089265344806616
deviation-heading_min1.448341673463684
driven_any_max1.1745667911136657
driven_any_mean0.7993065462620965
driven_any_median1.1745375875148232
driven_any_min0.20621070958903517
driven_lanedir_consec_max0.64427541241931
driven_lanedir_consec_mean0.4197719404475316
driven_lanedir_consec_min0.1532115720161615
driven_lanedir_max0.7380366950743553
driven_lanedir_mean0.4433955772366987
driven_lanedir_median0.4906378651204748
driven_lanedir_min0.1532115720161615
in-drivable-lane_max7.950000000000094
in-drivable-lane_mean3.260000000000036
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2666651060745704, "sim_physics": 0.22426826567263217, "survival_time": 3.699999999999995, "driven_lanedir": 0.1532115720161615, "sim_render-ego": 0.06775473581778037, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.11164505417282516, "deviation-heading": 1.5314631276581263, "set_robot_commands": 0.1118812335504068, "deviation-center-line": 0.1524104407527288, "driven_lanedir_consec": 0.1532115720161615, "sim_compute_sim_state": 0.04338183274140229, "sim_compute_performance-ego": 0.07434112961227829, "sim_compute_robot_state-ego": 0.08290572746379955, "sim_compute_robot_state-npc0": 0.07458131377761429, "sim_compute_robot_state-npc1": 0.07648387148573592, "sim_compute_robot_state-npc2": 0.0750597264315631, "sim_compute_robot_state-npc3": 0.07875589744464771}, "udem1-1-0": {"driven_any": 1.1745375875148232, "sim_physics": 0.2307570195198059, "survival_time": 14.950000000000076, "driven_lanedir": 0.4906378651204748, "sim_render-ego": 0.06981953859329224, "in-drivable-lane": 7.950000000000094, "agent_compute-ego": 0.11445613543192544, "deviation-heading": 1.9089265344806616, "set_robot_commands": 0.10993390719095866, "deviation-center-line": 0.23916579592115045, "driven_lanedir_consec": 0.4906378651204748, "sim_compute_sim_state": 0.04418567816416422, "sim_compute_performance-ego": 0.08068432966868083, "sim_compute_robot_state-ego": 0.08500124375025431, "sim_compute_robot_state-npc0": 0.0760547129313151, "sim_compute_robot_state-npc1": 0.07591456254323324, "sim_compute_robot_state-npc2": 0.07792675813039143, "sim_compute_robot_state-npc3": 0.07701671044031778}, "udem1-2-0": {"driven_any": 1.174552537018389, "sim_physics": 0.21528377056121825, "survival_time": 14.950000000000076, "driven_lanedir": 0.6669058075208681, "sim_render-ego": 0.06567161401112874, "in-drivable-lane": 4.1500000000000385, "agent_compute-ego": 0.10911363283793132, "deviation-heading": 5.536030364590776, "set_robot_commands": 0.1030753747622172, "deviation-center-line": 0.6709099403033454, "driven_lanedir_consec": 0.642548906230078, "sim_compute_sim_state": 0.04081465562184652, "sim_compute_performance-ego": 0.07333365122477213, "sim_compute_robot_state-ego": 0.07943152507146199, "sim_compute_robot_state-npc0": 0.07270699580510458, "sim_compute_robot_state-npc1": 0.0711501677831014, "sim_compute_robot_state-npc2": 0.07263823350270589, "sim_compute_robot_state-npc3": 0.07194299538930257}, "udem1-3-0": {"driven_any": 1.1745667911136657, "sim_physics": 0.20135415156682332, "survival_time": 14.950000000000076, "driven_lanedir": 0.7380366950743553, "sim_render-ego": 0.06528722763061523, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.10965794801712037, "deviation-heading": 5.518234612577819, "set_robot_commands": 0.10125334898630778, "deviation-center-line": 0.8598179747822606, "driven_lanedir_consec": 0.64427541241931, "sim_compute_sim_state": 0.039270044167836506, "sim_compute_performance-ego": 0.07115239938100179, "sim_compute_robot_state-ego": 0.07627529621124268, "sim_compute_robot_state-npc0": 0.07111894845962524, "sim_compute_robot_state-npc1": 0.06980561176935832, "sim_compute_robot_state-npc2": 0.07071214437484741, "sim_compute_robot_state-npc3": 0.07056262095769246}, "udem1-4-0": {"driven_any": 0.20621070958903517, "sim_physics": 0.20105756562331628, "survival_time": 2.8999999999999977, "driven_lanedir": 0.16818594645163398, "sim_render-ego": 0.06471192425694959, "in-drivable-lane": 0, "agent_compute-ego": 0.1025368468514804, "deviation-heading": 1.448341673463684, "set_robot_commands": 0.0960175949951698, "deviation-center-line": 0.15975075635845737, "driven_lanedir_consec": 0.16818594645163398, "sim_compute_sim_state": 0.03916913065417059, "sim_compute_performance-ego": 0.06909774911814723, "sim_compute_robot_state-ego": 0.07507125262556405, "sim_compute_robot_state-npc0": 0.07022135422147553, "sim_compute_robot_state-npc1": 0.07067679536753688, "sim_compute_robot_state-npc2": 0.06912464520026898, "sim_compute_robot_state-npc3": 0.07039469686047785}}
set_robot_commands_max0.1118812335504068
set_robot_commands_mean0.10443229189701204
set_robot_commands_median0.1030753747622172
set_robot_commands_min0.0960175949951698
sim_compute_performance-ego_max0.08068432966868083
sim_compute_performance-ego_mean0.07372185180097605
sim_compute_performance-ego_median0.07333365122477213
sim_compute_performance-ego_min0.06909774911814723
sim_compute_robot_state-ego_max0.08500124375025431
sim_compute_robot_state-ego_mean0.07973700902446453
sim_compute_robot_state-ego_median0.07943152507146199
sim_compute_robot_state-ego_min0.07507125262556405
sim_compute_robot_state-npc0_max0.0760547129313151
sim_compute_robot_state-npc0_mean0.07293666503902695
sim_compute_robot_state-npc0_median0.07270699580510458
sim_compute_robot_state-npc0_min0.07022135422147553
sim_compute_robot_state-npc1_max0.07648387148573592
sim_compute_robot_state-npc1_mean0.07280620178979316
sim_compute_robot_state-npc1_median0.0711501677831014
sim_compute_robot_state-npc1_min0.06980561176935832
sim_compute_robot_state-npc2_max0.07792675813039143
sim_compute_robot_state-npc2_mean0.07309230152795536
sim_compute_robot_state-npc2_median0.07263823350270589
sim_compute_robot_state-npc2_min0.06912464520026898
sim_compute_robot_state-npc3_max0.07875589744464771
sim_compute_robot_state-npc3_mean0.07373458421848768
sim_compute_robot_state-npc3_median0.07194299538930257
sim_compute_robot_state-npc3_min0.07039469686047785
sim_compute_sim_state_max0.04418567816416422
sim_compute_sim_state_mean0.04136426826988403
sim_compute_sim_state_median0.04081465562184652
sim_compute_sim_state_min0.03916913065417059
sim_physics_max0.2307570195198059
sim_physics_mean0.2145441545887592
sim_physics_median0.21528377056121825
sim_physics_min0.20105756562331628
sim_render-ego_max0.06981953859329224
sim_render-ego_mean0.06664900806195324
sim_render-ego_median0.06567161401112874
sim_render-ego_min0.06471192425694959
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.290000000000044
survival_time_min2.8999999999999977
208072873almasipchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessno8450:08:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.11232790009754055
survival_time_median1.5000000000000009
deviation-center-line_median0.07838303453570936
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19429659843444824
agent_compute-ego_mean0.17382752404408405
agent_compute-ego_median0.16509840362950376
agent_compute-ego_min0.15595928315193422
deviation-center-line_max0.08650564116402884
deviation-center-line_mean0.07608369656432938
deviation-center-line_min0.06604145144995589
deviation-heading_max0.9725952198143292
deviation-heading_mean0.7486526918205163
deviation-heading_median0.6897462599920539
deviation-heading_min0.5182286178054573
driven_any_max0.26454035332833237
driven_any_mean0.20450552871852776
driven_any_median0.20825691494001267
driven_any_min0.11277820422045504
driven_lanedir_consec_max0.20792598476999255
driven_lanedir_consec_mean0.139210412112779
driven_lanedir_consec_min0.08394096623178449
driven_lanedir_max0.20792598476999255
driven_lanedir_mean0.139210412112779
driven_lanedir_median0.11232790009754055
driven_lanedir_min0.08394096623178449
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20825691494001267, "sim_physics": 0.15037620862325032, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11232790009754055, "sim_render-ego": 0.054889520009358726, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16500699520111084, "deviation-heading": 0.8935033888401123, "set_robot_commands": 0.07610936959584554, "deviation-center-line": 0.08323591183901975, "driven_lanedir_consec": 0.11232790009754055, "sim_compute_sim_state": 0.03364555835723877, "sim_compute_performance-ego": 0.074196990331014, "sim_compute_robot_state-ego": 0.06325127283732096}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24864061379585428, "sim_physics": 0.143891203788019, "survival_time": 1.5500000000000007, "driven_lanedir": 0.19818262323518, "sim_render-ego": 0.0672253870194958, "in-drivable-lane": 0, "agent_compute-ego": 0.15595928315193422, "deviation-heading": 0.6897462599920539, "set_robot_commands": 0.08290771515138688, "deviation-center-line": 0.06604145144995589, "driven_lanedir_consec": 0.19818262323518, "sim_compute_sim_state": 0.03657367152552451, "sim_compute_performance-ego": 0.09756228231614636, "sim_compute_robot_state-ego": 0.06272515173881285}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11277820422045504, "sim_physics": 0.11794707649632503, "survival_time": 0.9500000000000004, "driven_lanedir": 0.08394096623178449, "sim_render-ego": 0.06278817277205617, "in-drivable-lane": 0, "agent_compute-ego": 0.16509840362950376, "deviation-heading": 0.5182286178054573, "set_robot_commands": 0.09059693938807438, "deviation-center-line": 0.08650564116402884, "driven_lanedir_consec": 0.08394096623178449, "sim_compute_sim_state": 0.0394954430429559, "sim_compute_performance-ego": 0.06896419274179559, "sim_compute_robot_state-ego": 0.07608866691589355}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1883115573079846, "sim_physics": 0.15280526876449585, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0936745862293975, "sim_render-ego": 0.06792808430535453, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1887763398034232, "deviation-heading": 0.9725952198143292, "set_robot_commands": 0.09853384324482509, "deviation-center-line": 0.06625244383293308, "driven_lanedir_consec": 0.0936745862293975, "sim_compute_sim_state": 0.04459267854690552, "sim_compute_performance-ego": 0.07375419991356987, "sim_compute_robot_state-ego": 0.08201061827795846}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26454035332833237, "sim_physics": 0.1430761045025241, "survival_time": 1.5500000000000007, "driven_lanedir": 0.20792598476999255, "sim_render-ego": 0.06906350197330598, "in-drivable-lane": 0, "agent_compute-ego": 0.19429659843444824, "deviation-heading": 0.6691899726506286, "set_robot_commands": 0.10264792749958654, "deviation-center-line": 0.07838303453570936, "driven_lanedir_consec": 0.20792598476999255, "sim_compute_sim_state": 0.04413562436257639, "sim_compute_performance-ego": 0.07692993071771437, "sim_compute_robot_state-ego": 0.08626484101818453}}
set_robot_commands_max0.10264792749958654
set_robot_commands_mean0.09015915897594368
set_robot_commands_median0.09059693938807438
set_robot_commands_min0.07610936959584554
sim_compute_performance-ego_max0.09756228231614636
sim_compute_performance-ego_mean0.07828151920404804
sim_compute_performance-ego_median0.074196990331014
sim_compute_performance-ego_min0.06896419274179559
sim_compute_robot_state-ego_max0.08626484101818453
sim_compute_robot_state-ego_mean0.07406811015763407
sim_compute_robot_state-ego_median0.07608866691589355
sim_compute_robot_state-ego_min0.06272515173881285
sim_compute_sim_state_max0.04459267854690552
sim_compute_sim_state_mean0.03968859516704022
sim_compute_sim_state_median0.0394954430429559
sim_compute_sim_state_min0.03364555835723877
sim_physics_max0.15280526876449585
sim_physics_mean0.14161917243492284
sim_physics_median0.143891203788019
sim_physics_min0.11794707649632503
sim_render-ego_max0.06906350197330598
sim_render-ego_mean0.06437893321591423
sim_render-ego_median0.0672253870194958
sim_render-ego_min0.054889520009358726
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3900000000000006
survival_time_min0.9500000000000004
207993058Andrea Censirotationaido2-LFV-sim-testingstep1-simulationhost-errorno8450:18:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-42-167-7194-job20799/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
207842956Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno8450:37:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30402283162098764
survival_time_median6.999999999999983
deviation-center-line_median0.2460750057446518
in-drivable-lane_median1.949999999999993


other stats
agent_compute-ego_max0.23441464602947237
agent_compute-ego_mean0.20829734870772967
agent_compute-ego_median0.2076818655568657
agent_compute-ego_min0.19237179043649255
deviation-center-line_max0.7276746440916119
deviation-center-line_mean0.29752640344376247
deviation-center-line_min0.12691729211332822
deviation-heading_max2.033670554184505
deviation-heading_mean1.415551082763028
deviation-heading_median1.4269978730797008
deviation-heading_min0.7957972465670914
driven_any_max1.7284100283310049
driven_any_mean0.9079655994745708
driven_any_median0.7959534300907974
driven_any_min0.5303303310165024
driven_lanedir_consec_max1.7159325966482974
driven_lanedir_consec_mean0.5122063347338529
driven_lanedir_consec_min0.2202216963066923
driven_lanedir_max1.7159325966482974
driven_lanedir_mean0.5152442527542744
driven_lanedir_median0.30402283162098764
driven_lanedir_min0.2202216963066923
in-drivable-lane_max6.600000000000024
in-drivable-lane_mean2.323333333333332
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1494503910875793, "sim_physics": 0.10358374118804932, "survival_time": 8.499999999999986, "driven_lanedir": 0.6565509836861607, "sim_render-ego": 0.06177226655623492, "in-drivable-lane": 2.6499999999999986, "agent_compute-ego": 0.19914377156425925, "deviation-heading": 1.6736725762328135, "set_robot_commands": 0.08967792006099926, "deviation-center-line": 0.3786418892512445, "driven_lanedir_consec": 0.6352922929876805, "sim_compute_sim_state": 0.03708499880398021, "sim_compute_performance-ego": 0.06584353166468003, "sim_compute_robot_state-ego": 0.06757954288931455}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.64066476452445, "sim_physics": 0.12368420759836832, "survival_time": 12.900000000000048, "driven_lanedir": 1.2723441540213836, "sim_render-ego": 0.06175023271131885, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.21751454634259837, "deviation-heading": 1.9087482414971244, "set_robot_commands": 0.09301152432611746, "deviation-center-line": 0.5179779264485237, "driven_lanedir_consec": 1.2723441540213836, "sim_compute_sim_state": 0.03941157437110132, "sim_compute_performance-ego": 0.07095158192538475, "sim_compute_robot_state-ego": 0.07426281862480696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8021142110614062, "sim_physics": 0.09794357482423172, "survival_time": 7.049999999999983, "driven_lanedir": 0.46780157266671374, "sim_render-ego": 0.05730730591090859, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.2076818655568657, "deviation-heading": 2.033670554184505, "set_robot_commands": 0.0916481204066716, "deviation-center-line": 0.4215563095900135, "driven_lanedir_consec": 0.46780157266671374, "sim_compute_sim_state": 0.03700806401300092, "sim_compute_performance-ego": 0.06446443720066801, "sim_compute_robot_state-ego": 0.06815715884485989}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5512651802958055, "sim_physics": 0.09372630773806104, "survival_time": 5.09999999999999, "driven_lanedir": 0.22677891307172837, "sim_render-ego": 0.05881020368314257, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.19310953570347208, "deviation-heading": 1.5818208745999327, "set_robot_commands": 0.08289515037162631, "deviation-center-line": 0.2997506836173763, "driven_lanedir_consec": 0.22184697737859205, "sim_compute_sim_state": 0.033966875543781354, "sim_compute_performance-ego": 0.06091374743218515, "sim_compute_robot_state-ego": 0.06451690898222082}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0634130167105256, "sim_physics": 0.10544547130321634, "survival_time": 8.699999999999989, "driven_lanedir": 0.6541658237462022, "sim_render-ego": 0.05891160444281567, "in-drivable-lane": 2.650000000000002, "agent_compute-ego": 0.19237179043649255, "deviation-heading": 0.9540508865563524, "set_robot_commands": 0.08669582591659722, "deviation-center-line": 0.35676444793000617, "driven_lanedir_consec": 0.6541658237462022, "sim_compute_sim_state": 0.03608707860968579, "sim_compute_performance-ego": 0.06474670459484232, "sim_compute_robot_state-ego": 0.06664853945545766}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.7042481730826933, "sim_physics": 0.12448220120535956, "survival_time": 7.199999999999982, "driven_lanedir": 0.25514999353857526, "sim_render-ego": 0.06157862312263913, "in-drivable-lane": 4.449999999999984, "agent_compute-ego": 0.225916079348988, "deviation-heading": 0.7957972465670914, "set_robot_commands": 0.09481671783659192, "deviation-center-line": 0.27395586048876214, "driven_lanedir_consec": 0.25514999353857526, "sim_compute_sim_state": 0.03956356313493517, "sim_compute_performance-ego": 0.06844651699066162, "sim_compute_robot_state-ego": 0.07483147415849897}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0136036231438654, "sim_physics": 0.1108462793486459, "survival_time": 6.999999999999983, "driven_lanedir": 0.6092043454658032, "sim_render-ego": 0.05986277716500418, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.21020264966147287, "deviation-heading": 1.741266057419484, "set_robot_commands": 0.0906983426639012, "deviation-center-line": 0.19237107114977212, "driven_lanedir_consec": 0.5919683111143703, "sim_compute_sim_state": 0.03851289238248553, "sim_compute_performance-ego": 0.0662750448499407, "sim_compute_robot_state-ego": 0.07184634549277169}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.3307611195584497, "sim_physics": 0.10967475008741716, "survival_time": 10.700000000000015, "driven_lanedir": 0.30402283162098764, "sim_render-ego": 0.05794673545338283, "in-drivable-lane": 6.600000000000024, "agent_compute-ego": 0.199751783754224, "deviation-heading": 1.6065697426440213, "set_robot_commands": 0.08748891420453508, "deviation-center-line": 0.2460750057446518, "driven_lanedir_consec": 0.30402283162098764, "sim_compute_sim_state": 0.03716301583798133, "sim_compute_performance-ego": 0.06528315811513741, "sim_compute_robot_state-ego": 0.06813076389170139}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.5303303310165024, "sim_physics": 0.10015204728367816, "survival_time": 4.149999999999993, "driven_lanedir": 0.2202216963066923, "sim_render-ego": 0.0645747270928808, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.21722290314823747, "deviation-heading": 0.9501460811598054, "set_robot_commands": 0.09833818458649048, "deviation-center-line": 0.13117151539853594, "driven_lanedir_consec": 0.2202216963066923, "sim_compute_sim_state": 0.039517813418284954, "sim_compute_performance-ego": 0.07281372346073749, "sim_compute_robot_state-ego": 0.0782841803079628}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.6312090336283087, "sim_physics": 0.09560308736913344, "survival_time": 5.09999999999999, "driven_lanedir": 0.28091082436924575, "sim_render-ego": 0.05984800235897887, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.19919786266252107, "deviation-heading": 1.1855227834021296, "set_robot_commands": 0.09189016445010316, "deviation-center-line": 0.18065348398282724, "driven_lanedir_consec": 0.28091082436924575, "sim_compute_sim_state": 0.038241243829914166, "sim_compute_performance-ego": 0.06703333527434106, "sim_compute_robot_state-ego": 0.06952424610362333}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7959534300907974, "sim_physics": 0.10360501348510268, "survival_time": 6.449999999999985, "driven_lanedir": 0.34931199935935375, "sim_render-ego": 0.05934026259784551, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.19432659666667612, "deviation-heading": 1.4269978730797008, "set_robot_commands": 0.08871792822845223, "deviation-center-line": 0.24509150777387015, "driven_lanedir_consec": 0.34931199935935375, "sim_compute_sim_state": 0.03625230826148691, "sim_compute_performance-ego": 0.0660285986671152, "sim_compute_robot_state-ego": 0.06841622951418855}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5486956659233059, "sim_physics": 0.1025622098342232, "survival_time": 4.599999999999992, "driven_lanedir": 0.22153895356933065, "sim_render-ego": 0.05992983735125998, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.21682943727659143, "deviation-heading": 1.3985596257139206, "set_robot_commands": 0.09222576151723448, "deviation-center-line": 0.16783628245582605, "driven_lanedir_consec": 0.22078361786334844, "sim_compute_sim_state": 0.038692868274191154, "sim_compute_performance-ego": 0.06700444221496582, "sim_compute_robot_state-ego": 0.07055514791737431}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.7284100283310049, "sim_physics": 0.12432448705037435, "survival_time": 14.950000000000076, "driven_lanedir": 1.7159325966482974, "sim_render-ego": 0.05848109324773153, "in-drivable-lane": 0, "agent_compute-ego": 0.20579790353775024, "deviation-heading": 1.4201224110565658, "set_robot_commands": 0.0917504644393921, "deviation-center-line": 0.7276746440916119, "driven_lanedir_consec": 1.7159325966482974, "sim_compute_sim_state": 0.03881040255228679, "sim_compute_performance-ego": 0.06556683619817098, "sim_compute_robot_state-ego": 0.07000837961832683}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.5448248586707799, "sim_physics": 0.11109061539173126, "survival_time": 3.999999999999994, "driven_lanedir": 0.24217527130851255, "sim_render-ego": 0.06471999883651733, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.23441464602947237, "deviation-heading": 1.1211181535825985, "set_robot_commands": 0.0992065817117691, "deviation-center-line": 0.12691729211332822, "driven_lanedir_consec": 0.24101371777598943, "sim_compute_sim_state": 0.041731682419776914, "sim_compute_performance-ego": 0.07146121561527252, "sim_compute_robot_state-ego": 0.07996865510940551}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.584540164993086, "sim_physics": 0.09933919853039004, "survival_time": 4.449999999999992, "driven_lanedir": 0.25255383193513037, "sim_render-ego": 0.061054034179516055, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.210978858926323, "deviation-heading": 1.4352031337493742, "set_robot_commands": 0.0946579006280792, "deviation-center-line": 0.196458131620088, "driven_lanedir_consec": 0.252328611610364, "sim_compute_sim_state": 0.03870952263307035, "sim_compute_performance-ego": 0.06781182932050041, "sim_compute_robot_state-ego": 0.07085774989610308}}
set_robot_commands_max0.0992065817117691
set_robot_commands_mean0.09158130008990405
set_robot_commands_median0.0917504644393921
set_robot_commands_min0.08289515037162631
sim_compute_performance-ego_max0.07281372346073749
sim_compute_performance-ego_mean0.0669763135683069
sim_compute_performance-ego_median0.0662750448499407
sim_compute_performance-ego_min0.06091374743218515
sim_compute_robot_state-ego_max0.07996865510940551
sim_compute_robot_state-ego_mean0.07090587605377442
sim_compute_robot_state-ego_median0.07000837961832683
sim_compute_robot_state-ego_min0.06451690898222082
sim_compute_sim_state_max0.041731682419776914
sim_compute_sim_state_mean0.03805026027239753
sim_compute_sim_state_median0.03851289238248553
sim_compute_sim_state_min0.033966875543781354
sim_physics_max0.12448220120535956
sim_physics_mean0.10707087948253216
sim_physics_median0.10360501348510268
sim_physics_min0.09372630773806104
sim_render-ego_max0.06471999883651733
sim_render-ego_mean0.06039251364734512
sim_render-ego_median0.05986277716500418
sim_render-ego_min0.05730730591090859
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.390000000000001
survival_time_min3.999999999999994
207742932Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrorno8450:01:57
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
207602964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno8450:41:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2964/step1-simulation-ip-172-31-42-167-7194-job20760/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.