Duckietown Challenges Home Challenges Submissions

Evaluator 764

ID764
evaluatoridsc-rudolf-10821
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-10821
versiond-c:4.0.18;d-c-r:4.0.27;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success13 18616
# timeout
# failed2 18628
# error15 18633
# aborted
# host-error1 18728
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
189392881Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-108210:21:06
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189322873Peter Almasi 🇭🇺challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-108210:06:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.11191421876824714
survival_time_median1.3000000000000005
deviation-center-line_median0.05047315617198433
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.1755272516837487
agent_compute-ego_mean0.17024521570939286
agent_compute-ego_median0.1734602451324463
agent_compute-ego_min0.1558463848554171
deviation-center-line_max0.05332790702120703
deviation-center-line_mean0.04828383589301521
deviation-center-line_min0.04003009371859556
deviation-heading_max0.7047572878774514
deviation-heading_mean0.6754536272719036
deviation-heading_median0.682437498056471
deviation-heading_min0.6220693865191721
driven_any_max0.17955234139640197
driven_any_mean0.17065472009187962
driven_any_median0.17534271106761237
driven_any_min0.1561345645124972
driven_lanedir_consec_max0.11693545197416544
driven_lanedir_consec_mean0.10594568393441706
driven_lanedir_consec_min0.09183643626345828
driven_lanedir_max0.11693545197416544
driven_lanedir_mean0.10594568393441706
driven_lanedir_median0.11191421876824714
driven_lanedir_min0.09183643626345828
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.07000000000000006
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17534271106761237, "sim_physics": 0.0173569550881019, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11191421876824714, "sim_render-ego": 0.07126146096449631, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1558463848554171, "deviation-heading": 0.682437498056471, "set_robot_commands": 0.07025986451369065, "deviation-center-line": 0.05047315617198433, "driven_lanedir_consec": 0.11191421876824714, "sim_compute_sim_state": 0.041597568071805514, "sim_compute_performance-ego": 0.07147579926710862, "sim_compute_robot_state-ego": 0.06762014902555026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1561345645124972, "sim_physics": 0.016497440338134765, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09183643626345828, "sim_render-ego": 0.07638587951660156, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17236032485961914, "deviation-heading": 0.6893431409321791, "set_robot_commands": 0.08055398941040039, "deviation-center-line": 0.0450490143539439, "driven_lanedir_consec": 0.09183643626345828, "sim_compute_sim_state": 0.0462408447265625, "sim_compute_performance-ego": 0.07705565452575684, "sim_compute_robot_state-ego": 0.07429775238037109}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17766025267632216, "sim_physics": 0.016812627132122334, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11371907408986016, "sim_render-ego": 0.07615273732405442, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1734602451324463, "deviation-heading": 0.7047572878774514, "set_robot_commands": 0.08059836350954495, "deviation-center-line": 0.05332790702120703, "driven_lanedir_consec": 0.11371907408986016, "sim_compute_sim_state": 0.04658357913677509, "sim_compute_performance-ego": 0.07829547845400296, "sim_compute_robot_state-ego": 0.06973749857682449}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17955234139640197, "sim_physics": 0.017363410729628343, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11693545197416544, "sim_render-ego": 0.07682331708761361, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17403187201573295, "deviation-heading": 0.6786608229742447, "set_robot_commands": 0.08097297411698562, "deviation-center-line": 0.052539008199345226, "driven_lanedir_consec": 0.11693545197416544, "sim_compute_sim_state": 0.04531824588775635, "sim_compute_performance-ego": 0.0757670861024123, "sim_compute_robot_state-ego": 0.07037185705625094}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16458373080656435, "sim_physics": 0.017946206606351413, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09532323857635427, "sim_render-ego": 0.07759645351996788, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1755272516837487, "deviation-heading": 0.6220693865191721, "set_robot_commands": 0.08018977825458233, "deviation-center-line": 0.04003009371859556, "driven_lanedir_consec": 0.09532323857635427, "sim_compute_sim_state": 0.046010264983543984, "sim_compute_performance-ego": 0.07845391676976131, "sim_compute_robot_state-ego": 0.06982406286092904}}
set_robot_commands_max0.08097297411698562
set_robot_commands_mean0.0785149939610408
set_robot_commands_median0.08055398941040039
set_robot_commands_min0.07025986451369065
sim_compute_performance-ego_max0.07845391676976131
sim_compute_performance-ego_mean0.07620958702380841
sim_compute_performance-ego_median0.07705565452575684
sim_compute_performance-ego_min0.07147579926710862
sim_compute_robot_state-ego_max0.07429775238037109
sim_compute_robot_state-ego_mean0.07037026397998516
sim_compute_robot_state-ego_median0.06982406286092904
sim_compute_robot_state-ego_min0.06762014902555026
sim_compute_sim_state_max0.04658357913677509
sim_compute_sim_state_mean0.04515010056128869
sim_compute_sim_state_median0.046010264983543984
sim_compute_sim_state_min0.041597568071805514
sim_physics_max0.017946206606351413
sim_physics_mean0.017195327978867754
sim_physics_median0.0173569550881019
sim_physics_min0.016497440338134765
sim_render-ego_max0.07759645351996788
sim_render-ego_mean0.07564396968254676
sim_render-ego_median0.07638587951660156
sim_render-ego_min0.07126146096449631
simulation-passed1
survival_time_max1.3000000000000005
survival_time_mean1.2900000000000005
survival_time_min1.2500000000000004
No reset possible
189192371Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-108210:21:06
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189082383Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-108210:07:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.11247199025262589
survival_time_median3.899999999999994
deviation-center-line_median0.08907797758531803
in-drivable-lane_median1.649999999999998


other stats
agent_compute-ego_max0.22956278132296157
agent_compute-ego_mean0.21039411123783552
agent_compute-ego_median0.20170932244031856
agent_compute-ego_min0.19885550226484025
deviation-center-line_max0.13621415181600496
deviation-center-line_mean0.07969501278940369
deviation-center-line_min0.021590985025984354
deviation-heading_max2.555155969874982
deviation-heading_mean1.376322081199179
deviation-heading_median1.5241715054005778
deviation-heading_min0.6088141534897106
driven_any_max0.5300192766528421
driven_any_mean0.2891972168632916
driven_any_median0.2865998420337463
driven_any_min0.12692449675861783
driven_lanedir_consec_max0.1897492561653622
driven_lanedir_consec_mean0.10467192777677171
driven_lanedir_consec_min0.03805788210227301
driven_lanedir_max0.1897492561653622
driven_lanedir_mean0.10467192777677171
driven_lanedir_median0.11247199025262589
driven_lanedir_min0.03805788210227301
in-drivable-lane_max3.0499999999999927
in-drivable-lane_mean1.5899999999999976
in-drivable-lane_min0.6000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.34811841852316067, "sim_physics": 0.018413453266538423, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1170327786366725, "sim_render-ego": 0.06351124007126381, "in-drivable-lane": 1.999999999999997, "agent_compute-ego": 0.22956278132296157, "deviation-heading": 1.571521555605618, "set_robot_commands": 0.08001428911055641, "deviation-center-line": 0.08907797758531803, "driven_lanedir_consec": 0.1170327786366725, "sim_compute_sim_state": 0.038376671144332006, "sim_compute_performance-ego": 0.06109570360731805, "sim_compute_robot_state-ego": 0.061701314202670395}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.12692449675861783, "sim_physics": 0.015330112341678505, "survival_time": 1.6500000000000008, "driven_lanedir": 0.03805788210227301, "sim_render-ego": 0.05590404886187929, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.22268403660167344, "deviation-heading": 0.6219472216250064, "set_robot_commands": 0.07622601769187233, "deviation-center-line": 0.021590985025984354, "driven_lanedir_consec": 0.03805788210227301, "sim_compute_sim_state": 0.03434751250527122, "sim_compute_performance-ego": 0.05845223051128966, "sim_compute_robot_state-ego": 0.05833252993496982}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15432405034809102, "sim_physics": 0.01615648137198554, "survival_time": 1.800000000000001, "driven_lanedir": 0.06604773172692502, "sim_render-ego": 0.05896757046381632, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.1991589135593838, "deviation-heading": 0.6088141534897106, "set_robot_commands": 0.07590526342391968, "deviation-center-line": 0.023813216105749095, "driven_lanedir_consec": 0.06604773172692502, "sim_compute_sim_state": 0.03910002443525526, "sim_compute_performance-ego": 0.06118657191594442, "sim_compute_robot_state-ego": 0.06596505641937256}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5300192766528421, "sim_physics": 0.017281838825770786, "survival_time": 6.649999999999984, "driven_lanedir": 0.1897492561653622, "sim_render-ego": 0.06487683066748139, "in-drivable-lane": 3.0499999999999927, "agent_compute-ego": 0.19885550226484025, "deviation-heading": 2.555155969874982, "set_robot_commands": 0.07686415830052885, "deviation-center-line": 0.13621415181600496, "driven_lanedir_consec": 0.1897492561653622, "sim_compute_sim_state": 0.04020292776867859, "sim_compute_performance-ego": 0.06445308197709851, "sim_compute_robot_state-ego": 0.06410300104241622}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2865998420337463, "sim_physics": 0.01844105965051895, "survival_time": 3.899999999999994, "driven_lanedir": 0.11247199025262589, "sim_render-ego": 0.06866835325192182, "in-drivable-lane": 1.649999999999998, "agent_compute-ego": 0.20170932244031856, "deviation-heading": 1.5241715054005778, "set_robot_commands": 0.08018503739283635, "deviation-center-line": 0.12777873341396204, "driven_lanedir_consec": 0.11247199025262589, "sim_compute_sim_state": 0.04217664706401336, "sim_compute_performance-ego": 0.06725991383577004, "sim_compute_robot_state-ego": 0.06672521737905648}}
set_robot_commands_max0.08018503739283635
set_robot_commands_mean0.07783895318394271
set_robot_commands_median0.07686415830052885
set_robot_commands_min0.07590526342391968
sim_compute_performance-ego_max0.06725991383577004
sim_compute_performance-ego_mean0.06248950036948413
sim_compute_performance-ego_median0.06118657191594442
sim_compute_performance-ego_min0.05845223051128966
sim_compute_robot_state-ego_max0.06672521737905648
sim_compute_robot_state-ego_mean0.0633654237956971
sim_compute_robot_state-ego_median0.06410300104241622
sim_compute_robot_state-ego_min0.05833252993496982
sim_compute_sim_state_max0.04217664706401336
sim_compute_sim_state_mean0.03884075658351009
sim_compute_sim_state_median0.03910002443525526
sim_compute_sim_state_min0.03434751250527122
sim_physics_max0.01844105965051895
sim_physics_mean0.017124589091298444
sim_physics_median0.017281838825770786
sim_physics_min0.015330112341678505
sim_render-ego_max0.06866835325192182
sim_render-ego_mean0.06238560866327253
sim_render-ego_median0.06351124007126381
sim_render-ego_min0.05590404886187929
simulation-passed1
survival_time_max6.649999999999984
survival_time_mean3.6699999999999946
survival_time_min1.6500000000000008
No reset possible
188972399Liam Paull 🇨🇦random_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-108210:11:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.1358110767144423
agent_compute-ego_mean0.12871490683335862
agent_compute-ego_median0.13142449297803513
agent_compute-ego_min0.12112933491903638
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.032348042442685083, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05828919486394004, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.12112933491903638, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07937391977461558, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.033805744988577704, "sim_compute_performance-ego": 0.059729856158059744, "sim_compute_robot_state-ego": 0.061964243177383665, "sim_compute_robot_state-npc0": 0.06653381150866312, "sim_compute_robot_state-npc1": 0.06225595020112537, "sim_compute_robot_state-npc2": 0.06197604300483825, "sim_compute_robot_state-npc3": 0.0608350398048522}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.0289000810361376, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05846678041944317, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.12276969703973507, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07689466663435393, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03358077067954868, "sim_compute_performance-ego": 0.05765668083639706, "sim_compute_robot_state-ego": 0.061356268677057006, "sim_compute_robot_state-npc0": 0.06374151566449333, "sim_compute_robot_state-npc1": 0.0626369644613827, "sim_compute_robot_state-npc2": 0.06213228842791389, "sim_compute_robot_state-npc3": 0.061867288514679555}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03178478056384671, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.0643421180786625, "in-drivable-lane": 0, "agent_compute-ego": 0.13243993251554428, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07832372188568115, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03444923508551813, "sim_compute_performance-ego": 0.06204770072813957, "sim_compute_robot_state-ego": 0.06329319169444422, "sim_compute_robot_state-npc0": 0.07188112505020634, "sim_compute_robot_state-npc1": 0.06321747841373566, "sim_compute_robot_state-npc2": 0.06397807598114014, "sim_compute_robot_state-npc3": 0.06355402161998133}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.030408656343500665, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06329697750984355, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13142449297803513, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07870741854322717, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03613143271588264, "sim_compute_performance-ego": 0.06200778737981269, "sim_compute_robot_state-ego": 0.062181546332988336, "sim_compute_robot_state-npc0": 0.07307469591181329, "sim_compute_robot_state-npc1": 0.06552526545017323, "sim_compute_robot_state-npc2": 0.06436348468699354, "sim_compute_robot_state-npc3": 0.06315989443596373}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.028423235966609076, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06350184862430279, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1358110767144423, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07942234094326313, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.035882963584019587, "sim_compute_performance-ego": 0.06393837928771973, "sim_compute_robot_state-ego": 0.06371964399631207, "sim_compute_robot_state-npc0": 0.07033420984561627, "sim_compute_robot_state-npc1": 0.06583285331726074, "sim_compute_robot_state-npc2": 0.06416187378076407, "sim_compute_robot_state-npc3": 0.0639522855098431}}
set_robot_commands_max0.07942234094326313
set_robot_commands_mean0.07854441355622818
set_robot_commands_median0.07870741854322717
set_robot_commands_min0.07689466663435393
sim_compute_performance-ego_max0.06393837928771973
sim_compute_performance-ego_mean0.06107608087802576
sim_compute_performance-ego_median0.06200778737981269
sim_compute_performance-ego_min0.05765668083639706
sim_compute_robot_state-ego_max0.06371964399631207
sim_compute_robot_state-ego_mean0.06250297877563707
sim_compute_robot_state-ego_median0.062181546332988336
sim_compute_robot_state-ego_min0.061356268677057006
sim_compute_robot_state-npc0_max0.07307469591181329
sim_compute_robot_state-npc0_mean0.06911307159615848
sim_compute_robot_state-npc0_median0.07033420984561627
sim_compute_robot_state-npc0_min0.06374151566449333
sim_compute_robot_state-npc1_max0.06583285331726074
sim_compute_robot_state-npc1_mean0.06389370236873554
sim_compute_robot_state-npc1_median0.06321747841373566
sim_compute_robot_state-npc1_min0.06225595020112537
sim_compute_robot_state-npc2_max0.06436348468699354
sim_compute_robot_state-npc2_mean0.06332235317632998
sim_compute_robot_state-npc2_median0.06397807598114014
sim_compute_robot_state-npc2_min0.06197604300483825
sim_compute_robot_state-npc3_max0.0639522855098431
sim_compute_robot_state-npc3_mean0.06267370597706398
sim_compute_robot_state-npc3_median0.06315989443596373
sim_compute_robot_state-npc3_min0.0608350398048522
sim_compute_sim_state_max0.03613143271588264
sim_compute_sim_state_mean0.03477002941070935
sim_compute_sim_state_median0.03444923508551813
sim_compute_sim_state_min0.03358077067954868
sim_physics_max0.032348042442685083
sim_physics_mean0.030372959270555826
sim_physics_median0.030408656343500665
sim_physics_min0.028423235966609076
sim_render-ego_max0.0643421180786625
sim_render-ego_mean0.061579383899238414
sim_render-ego_median0.06329697750984355
sim_render-ego_min0.05828919486394004
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
188912403Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-108210:04:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.20556632151961465
survival_time_median1.4500000000000006
deviation-center-line_median0.06994044370857125
in-drivable-lane_median0


other stats
agent_compute-ego_max0.26153947567117625
agent_compute-ego_mean0.22869314952045436
agent_compute-ego_median0.22361311117808025
agent_compute-ego_min0.213343464095017
deviation-center-line_max0.07669250776113018
deviation-center-line_mean0.07160668220801261
deviation-center-line_min0.06791691982833267
deviation-heading_max0.5901923974852719
deviation-heading_mean0.5713163752740655
deviation-heading_median0.5666610127927063
deviation-heading_min0.5607033748867222
driven_any_max0.2612721115059313
driven_any_mean0.2442842938461624
driven_any_median0.24938148330345272
driven_any_min0.22865027540201327
driven_lanedir_consec_max0.2220276984544096
driven_lanedir_consec_mean0.20296426976676205
driven_lanedir_consec_min0.18472875904318983
driven_lanedir_max0.2220276984544096
driven_lanedir_mean0.20296426976676205
driven_lanedir_median0.20556632151961465
driven_lanedir_min0.18472875904318983
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.24938148330345272, "sim_physics": 0.01591504853347252, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2094504208098762, "sim_render-ego": 0.061864326740133355, "in-drivable-lane": 0, "agent_compute-ego": 0.213343464095017, "deviation-heading": 0.5642012047668415, "set_robot_commands": 0.072527342829211, "deviation-center-line": 0.07540396161746522, "driven_lanedir_consec": 0.2094504208098762, "sim_compute_sim_state": 0.03764547150710534, "sim_compute_performance-ego": 0.059238992888351966, "sim_compute_robot_state-ego": 0.060590456271993706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2612721115059313, "sim_physics": 0.016680034001668294, "survival_time": 1.5000000000000009, "driven_lanedir": 0.2220276984544096, "sim_render-ego": 0.06391087373097738, "in-drivable-lane": 0, "agent_compute-ego": 0.22361311117808025, "deviation-heading": 0.5666610127927063, "set_robot_commands": 0.07613540490468343, "deviation-center-line": 0.07669250776113018, "driven_lanedir_consec": 0.2220276984544096, "sim_compute_sim_state": 0.03977625370025635, "sim_compute_performance-ego": 0.06539766788482666, "sim_compute_robot_state-ego": 0.06364773909250895}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23115721589580013, "sim_physics": 0.016020221369607106, "survival_time": 1.4000000000000006, "driven_lanedir": 0.19304814900671996, "sim_render-ego": 0.06635648863656181, "in-drivable-lane": 0, "agent_compute-ego": 0.22832959038870676, "deviation-heading": 0.5607033748867222, "set_robot_commands": 0.07907892976488386, "deviation-center-line": 0.06994044370857125, "driven_lanedir_consec": 0.19304814900671996, "sim_compute_sim_state": 0.040159872600010464, "sim_compute_performance-ego": 0.06570615087236677, "sim_compute_robot_state-ego": 0.06404322385787964}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2509603831236146, "sim_physics": 0.014795780181884766, "survival_time": 1.4500000000000006, "driven_lanedir": 0.20556632151961465, "sim_render-ego": 0.05511673565568595, "in-drivable-lane": 0, "agent_compute-ego": 0.26153947567117625, "deviation-heading": 0.5748238864387858, "set_robot_commands": 0.07643742396913726, "deviation-center-line": 0.06807957812456367, "driven_lanedir_consec": 0.20556632151961465, "sim_compute_sim_state": 0.03290213387587975, "sim_compute_performance-ego": 0.056869416401304045, "sim_compute_robot_state-ego": 0.0587696124767435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22865027540201327, "sim_physics": 0.016343346663883755, "survival_time": 1.4000000000000006, "driven_lanedir": 0.18472875904318983, "sim_render-ego": 0.063167291028159, "in-drivable-lane": 0, "agent_compute-ego": 0.21664010626929148, "deviation-heading": 0.5901923974852719, "set_robot_commands": 0.07736426591873169, "deviation-center-line": 0.06791691982833267, "driven_lanedir_consec": 0.18472875904318983, "sim_compute_sim_state": 0.03828024012701852, "sim_compute_performance-ego": 0.059997618198394775, "sim_compute_robot_state-ego": 0.06340195451463972}}
set_robot_commands_max0.07907892976488386
set_robot_commands_mean0.07630867347732945
set_robot_commands_median0.07643742396913726
set_robot_commands_min0.072527342829211
sim_compute_performance-ego_max0.06570615087236677
sim_compute_performance-ego_mean0.06144196924904884
sim_compute_performance-ego_median0.059997618198394775
sim_compute_performance-ego_min0.056869416401304045
sim_compute_robot_state-ego_max0.06404322385787964
sim_compute_robot_state-ego_mean0.0620905972427531
sim_compute_robot_state-ego_median0.06340195451463972
sim_compute_robot_state-ego_min0.0587696124767435
sim_compute_sim_state_max0.040159872600010464
sim_compute_sim_state_mean0.03775279436205409
sim_compute_sim_state_median0.03828024012701852
sim_compute_sim_state_min0.03290213387587975
sim_physics_max0.016680034001668294
sim_physics_mean0.01595088615010329
sim_physics_median0.016020221369607106
sim_physics_min0.014795780181884766
sim_render-ego_max0.06635648863656181
sim_render-ego_mean0.0620831431583035
sim_render-ego_median0.063167291028159
sim_render-ego_min0.05511673565568595
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.4400000000000006
survival_time_min1.4000000000000006
No reset possible
188752412jiang pengBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-108210:22:42
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188732429Andrea Censi 🇨🇭random_agentaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-108210:00:40
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188492449Nicky EichmannBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-108210:21:02
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188372468Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-108210:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.147100035349528
agent_compute-ego_mean0.14302958891134995
agent_compute-ego_median0.14488736188636636
agent_compute-ego_min0.13789587511735804
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.017227793639560916, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06361848903152179, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14488736188636636, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07918151369634664, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04132444453689287, "sim_compute_performance-ego": 0.06285821716740446, "sim_compute_robot_state-ego": 0.06482858927744739}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016426118937405674, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06400883197784424, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13928248123689133, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07570694251493974, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.040614507415077904, "sim_compute_performance-ego": 0.0661563819104975, "sim_compute_robot_state-ego": 0.06625695120204579}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01635711987813314, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0687200387318929, "in-drivable-lane": 0, "agent_compute-ego": 0.147100035349528, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07663857671949599, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04238822725084093, "sim_compute_performance-ego": 0.06603004137674967, "sim_compute_robot_state-ego": 0.06619995435078939}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0158309539159139, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06251895427703857, "in-drivable-lane": 0, "agent_compute-ego": 0.14598219096660614, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07659447689851125, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03888757526874542, "sim_compute_performance-ego": 0.06411096453666687, "sim_compute_robot_state-ego": 0.06288864711920421}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01748075204737046, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05958183372721953, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13789587511735804, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07796917242162368, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03873582096660838, "sim_compute_performance-ego": 0.06160100067363066, "sim_compute_robot_state-ego": 0.061562299728393555}}
set_robot_commands_max0.07918151369634664
set_robot_commands_mean0.07721813645018345
set_robot_commands_median0.07663857671949599
set_robot_commands_min0.07570694251493974
sim_compute_performance-ego_max0.0661563819104975
sim_compute_performance-ego_mean0.06415132113298984
sim_compute_performance-ego_median0.06411096453666687
sim_compute_performance-ego_min0.06160100067363066
sim_compute_robot_state-ego_max0.06625695120204579
sim_compute_robot_state-ego_mean0.06434728833557607
sim_compute_robot_state-ego_median0.06482858927744739
sim_compute_robot_state-ego_min0.061562299728393555
sim_compute_sim_state_max0.04238822725084093
sim_compute_sim_state_mean0.040390115087633106
sim_compute_sim_state_median0.040614507415077904
sim_compute_sim_state_min0.03873582096660838
sim_physics_max0.01748075204737046
sim_physics_mean0.01666454768367682
sim_physics_median0.016426118937405674
sim_physics_min0.0158309539159139
sim_render-ego_max0.0687200387318929
sim_render-ego_mean0.06368962954910341
sim_render-ego_median0.06361848903152179
sim_render-ego_min0.05958183372721953
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
188192491Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-108210:06:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07617252815778475
survival_time_median1.5500000000000007
deviation-center-line_median0.04048056165941895
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.29052980192776384
agent_compute-ego_mean0.24237868662380177
agent_compute-ego_median0.2267857982266334
agent_compute-ego_min0.1898632720112801
deviation-center-line_max0.04184896901467821
deviation-center-line_mean0.03519630061303873
deviation-center-line_min0.024611763779202683
deviation-heading_max0.6982639153859251
deviation-heading_mean0.6633133247330315
deviation-heading_median0.6701850748064416
deviation-heading_min0.6184228278775682
driven_any_max0.1721846168024769
driven_any_mean0.15445150119305456
driven_any_median0.1464155045396709
driven_any_min0.14382001725597784
driven_lanedir_consec_max0.08827801441789962
driven_lanedir_consec_mean0.06668609862754557
driven_lanedir_consec_min0.04511978828829033
driven_lanedir_max0.08827801441789962
driven_lanedir_mean0.06668609862754557
driven_lanedir_median0.07617252815778475
driven_lanedir_min0.04511978828829033
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.37000000000000033
in-drivable-lane_min0.15000000000000013
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1721846168024769, "sim_physics": 0.016135324131358753, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07624819349723877, "sim_render-ego": 0.05885149493361965, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2895600506753633, "deviation-heading": 0.6982639153859251, "set_robot_commands": 0.07949478698499275, "deviation-center-line": 0.04184896901467821, "driven_lanedir_consec": 0.07624819349723877, "sim_compute_sim_state": 0.03721739306594386, "sim_compute_performance-ego": 0.059123689478093926, "sim_compute_robot_state-ego": 0.061240217902443626}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1462622179076868, "sim_physics": 0.01612964043250451, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07617252815778475, "sim_render-ego": 0.0636527629999014, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.2151545102779682, "deviation-heading": 0.6750181006448601, "set_robot_commands": 0.07746760661785419, "deviation-center-line": 0.04048056165941895, "driven_lanedir_consec": 0.07617252815778475, "sim_compute_sim_state": 0.04117463185237004, "sim_compute_performance-ego": 0.07082676887512207, "sim_compute_robot_state-ego": 0.06428461808424729}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1635751494594604, "sim_physics": 0.015957371941928207, "survival_time": 1.4500000000000006, "driven_lanedir": 0.08827801441789962, "sim_render-ego": 0.05922250089974239, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.29052980192776384, "deviation-heading": 0.6546767049503628, "set_robot_commands": 0.07848315403379243, "deviation-center-line": 0.04110876608328455, "driven_lanedir_consec": 0.08827801441789962, "sim_compute_sim_state": 0.03632246214767982, "sim_compute_performance-ego": 0.060080717349874566, "sim_compute_robot_state-ego": 0.0635603378558981}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14382001725597784, "sim_physics": 0.015401055735926476, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04761196877651441, "sim_render-ego": 0.06503632760817005, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2267857982266334, "deviation-heading": 0.6184228278775682, "set_robot_commands": 0.0791727804368542, "deviation-center-line": 0.024611763779202683, "driven_lanedir_consec": 0.04761196877651441, "sim_compute_sim_state": 0.04139204179086993, "sim_compute_performance-ego": 0.06379931972872827, "sim_compute_robot_state-ego": 0.06457917921004756}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1464155045396709, "sim_physics": 0.0168711319565773, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04511978828829033, "sim_render-ego": 0.06311016529798508, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1898632720112801, "deviation-heading": 0.6701850748064416, "set_robot_commands": 0.07685405761003494, "deviation-center-line": 0.027931442528609268, "driven_lanedir_consec": 0.04511978828829033, "sim_compute_sim_state": 0.040560588240623474, "sim_compute_performance-ego": 0.06962587684392929, "sim_compute_robot_state-ego": 0.0638752430677414}}
set_robot_commands_max0.07949478698499275
set_robot_commands_mean0.0782944771367057
set_robot_commands_median0.07848315403379243
set_robot_commands_min0.07685405761003494
sim_compute_performance-ego_max0.07082676887512207
sim_compute_performance-ego_mean0.06469127445514963
sim_compute_performance-ego_median0.06379931972872827
sim_compute_performance-ego_min0.059123689478093926
sim_compute_robot_state-ego_max0.06457917921004756
sim_compute_robot_state-ego_mean0.06350791922407559
sim_compute_robot_state-ego_median0.0638752430677414
sim_compute_robot_state-ego_min0.061240217902443626
sim_compute_sim_state_max0.04139204179086993
sim_compute_sim_state_mean0.03933342341949743
sim_compute_sim_state_median0.040560588240623474
sim_compute_sim_state_min0.03632246214767982
sim_physics_max0.0168711319565773
sim_physics_mean0.016098904839659048
sim_physics_median0.01612964043250451
sim_physics_min0.015401055735926476
sim_render-ego_max0.06503632760817005
sim_render-ego_mean0.06197465034788372
sim_render-ego_median0.06311016529798508
sim_render-ego_min0.05885149493361965
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.510000000000001
survival_time_min1.3000000000000005
No reset possible
188142502Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-108210:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188092508Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-108210:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188052524Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-108210:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188002528Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-108210:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187952533Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-108210:01:13
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187912538Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-108210:01:24
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187852547Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-108210:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06837857686556302
agent_compute-ego_mean0.06324729536278857
agent_compute-ego_median0.06230368112262927
agent_compute-ego_min0.05982690904198623
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.015988126033689917, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05560826092231565, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05982690904198623, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07376204467401272, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03679167061317258, "sim_compute_performance-ego": 0.05859388374700779, "sim_compute_robot_state-ego": 0.05924658659027844}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.015073565336374136, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06510995901547946, "in-drivable-lane": 0, "agent_compute-ego": 0.06837857686556302, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07569446930518517, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03964824859912579, "sim_compute_performance-ego": 0.06352994992182805, "sim_compute_robot_state-ego": 0.06184382622058575}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.016405460682321103, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06238535617260223, "in-drivable-lane": 0, "agent_compute-ego": 0.06209851833100014, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07414666135260399, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.04091781250973965, "sim_compute_performance-ego": 0.06521190988256577, "sim_compute_robot_state-ego": 0.06516265361867052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.019290132836981135, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.062005111149379184, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06362879145276415, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07574909597962767, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.037744307256006936, "sim_compute_performance-ego": 0.06202136815249265, "sim_compute_robot_state-ego": 0.06280749184744698}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.015118027988233064, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.057852092542146384, "in-drivable-lane": 0, "agent_compute-ego": 0.06230368112262927, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0731806755065918, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03518446495658473, "sim_compute_performance-ego": 0.05705845355987549, "sim_compute_robot_state-ego": 0.06119707383607563}}
set_robot_commands_max0.07574909597962767
set_robot_commands_mean0.07450658936360428
set_robot_commands_median0.07414666135260399
set_robot_commands_min0.0731806755065918
sim_compute_performance-ego_max0.06521190988256577
sim_compute_performance-ego_mean0.06128311305275395
sim_compute_performance-ego_median0.06202136815249265
sim_compute_performance-ego_min0.05705845355987549
sim_compute_robot_state-ego_max0.06516265361867052
sim_compute_robot_state-ego_mean0.06205152642261147
sim_compute_robot_state-ego_median0.06184382622058575
sim_compute_robot_state-ego_min0.05924658659027844
sim_compute_sim_state_max0.04091781250973965
sim_compute_sim_state_mean0.038057300786925936
sim_compute_sim_state_median0.037744307256006936
sim_compute_sim_state_min0.03518446495658473
sim_physics_max0.019290132836981135
sim_physics_mean0.01637506257551987
sim_physics_median0.015988126033689917
sim_physics_min0.015073565336374136
sim_render-ego_max0.06510995901547946
sim_render-ego_mean0.060592155960384586
sim_render-ego_median0.062005111149379184
sim_render-ego_min0.05560826092231565
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
187792568Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-108210:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06708021902702224
agent_compute-ego_mean0.06545611082544443
agent_compute-ego_median0.06476375931187679
agent_compute-ego_min0.06412087245420976
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.029381380583110607, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06069188117980957, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06476375931187679, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07813492072255988, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03367972373962402, "sim_compute_performance-ego": 0.059500415701615184, "sim_compute_robot_state-ego": 0.06111644192745811, "sim_compute_robot_state-npc0": 0.06773849537498072, "sim_compute_robot_state-npc1": 0.06433553444711786, "sim_compute_robot_state-npc2": 0.06252800037986354, "sim_compute_robot_state-npc3": 0.0614631125801488}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.025292402819583292, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.05999714449832314, "in-drivable-lane": 0, "agent_compute-ego": 0.06461959136159796, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07469566872245387, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.033848894269842854, "sim_compute_performance-ego": 0.060574933102256374, "sim_compute_robot_state-ego": 0.06083666023455168, "sim_compute_robot_state-npc0": 0.06699762218876888, "sim_compute_robot_state-npc1": 0.06398110640676398, "sim_compute_robot_state-npc2": 0.059915279087267424, "sim_compute_robot_state-npc3": 0.06033654589402048}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.029245352133726463, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06674707852877103, "in-drivable-lane": 0, "agent_compute-ego": 0.0666961119725154, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07817372297629333, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.0365605109777206, "sim_compute_performance-ego": 0.061934385544214494, "sim_compute_robot_state-ego": 0.062493171447362654, "sim_compute_robot_state-npc0": 0.06935306084461701, "sim_compute_robot_state-npc1": 0.06355736194512783, "sim_compute_robot_state-npc2": 0.06296925055675018, "sim_compute_robot_state-npc3": 0.06322112450232872}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03178271441392495, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06664459470292212, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06708021902702224, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07886022581181056, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.036158894149350446, "sim_compute_performance-ego": 0.06364378794817857, "sim_compute_robot_state-ego": 0.06369463490768218, "sim_compute_robot_state-npc0": 0.07210025988834005, "sim_compute_robot_state-npc1": 0.06726036944859465, "sim_compute_robot_state-npc2": 0.06590350580887055, "sim_compute_robot_state-npc3": 0.06305516605645838}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02591666850176725, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06158557805148038, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06412087245420976, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07380058006806807, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03510407968000932, "sim_compute_performance-ego": 0.06186426227742976, "sim_compute_robot_state-ego": 0.06613113121552901, "sim_compute_robot_state-npc0": 0.06919363411990079, "sim_compute_robot_state-npc1": 0.06544293056834828, "sim_compute_robot_state-npc2": 0.06257736682891846, "sim_compute_robot_state-npc3": 0.0635662241415544}}
set_robot_commands_max0.07886022581181056
set_robot_commands_mean0.07673302366023714
set_robot_commands_median0.07813492072255988
set_robot_commands_min0.07380058006806807
sim_compute_performance-ego_max0.06364378794817857
sim_compute_performance-ego_mean0.06150355691473888
sim_compute_performance-ego_median0.06186426227742976
sim_compute_performance-ego_min0.059500415701615184
sim_compute_robot_state-ego_max0.06613113121552901
sim_compute_robot_state-ego_mean0.06285440794651673
sim_compute_robot_state-ego_median0.062493171447362654
sim_compute_robot_state-ego_min0.06083666023455168
sim_compute_robot_state-npc0_max0.07210025988834005
sim_compute_robot_state-npc0_mean0.0690766144833215
sim_compute_robot_state-npc0_median0.06919363411990079
sim_compute_robot_state-npc0_min0.06699762218876888
sim_compute_robot_state-npc1_max0.06726036944859465
sim_compute_robot_state-npc1_mean0.06491546056319052
sim_compute_robot_state-npc1_median0.06433553444711786
sim_compute_robot_state-npc1_min0.06355736194512783
sim_compute_robot_state-npc2_max0.06590350580887055
sim_compute_robot_state-npc2_mean0.06277868053233403
sim_compute_robot_state-npc2_median0.06257736682891846
sim_compute_robot_state-npc2_min0.059915279087267424
sim_compute_robot_state-npc3_max0.0635662241415544
sim_compute_robot_state-npc3_mean0.062328434634902154
sim_compute_robot_state-npc3_median0.06305516605645838
sim_compute_robot_state-npc3_min0.06033654589402048
sim_compute_sim_state_max0.0365605109777206
sim_compute_sim_state_mean0.03507042056330946
sim_compute_sim_state_median0.03510407968000932
sim_compute_sim_state_min0.03367972373962402
sim_physics_max0.03178271441392495
sim_physics_mean0.028323703690422513
sim_physics_median0.029245352133726463
sim_physics_min0.025292402819583292
sim_render-ego_max0.06674707852877103
sim_render-ego_mean0.06313325539226125
sim_render-ego_median0.06158557805148038
sim_render-ego_min0.05999714449832314
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
187282685Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationhost-errornoidsc-rudolf-108210:20:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2685/step1-simulation-idsc-rudolf-10821-job18728/tmp/tmpx0u4ww3l/attempts/udem1-4-0.attempt4/log.gs2.cbor']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187142685Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-108210:15:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5899772317367831
survival_time_median4.099999999999993
deviation-center-line_median0.32376686922317166
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06711235467125387
agent_compute-ego_mean0.06398172338789826
agent_compute-ego_median0.0633036014510364
agent_compute-ego_min0.06066203600651509
deviation-center-line_max0.6423475263601296
deviation-center-line_mean0.3476615135079574
deviation-center-line_min0.07490284011542553
deviation-heading_max2.7176918923677467
deviation-heading_mean1.20858162122072
deviation-heading_median0.8520617880510254
deviation-heading_min0.6915673569711595
driven_any_max1.7770096165437566
driven_any_mean0.7929367160513807
driven_any_median0.6118882329745925
driven_any_min0.21811189564873917
driven_lanedir_consec_max1.3491642604706673
driven_lanedir_consec_mean0.6814092350659805
driven_lanedir_consec_min0.17200423330345238
driven_lanedir_max1.360088302919181
driven_lanedir_mean0.6840964427094461
driven_lanedir_median0.5899772317367831
driven_lanedir_min0.17200423330345238
in-drivable-lane_max1.9500000000000275
in-drivable-lane_mean0.3900000000000056
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1315209229644638, "sim_physics": 0.02685081314396214, "survival_time": 7.399999999999982, "driven_lanedir": 1.1122221723007792, "sim_render-ego": 0.05435363988618593, "in-drivable-lane": 0, "agent_compute-ego": 0.06066203600651509, "deviation-heading": 1.0559384392497824, "set_robot_commands": 0.07281863045048069, "deviation-center-line": 0.6423475263601296, "driven_lanedir_consec": 1.1097101765319646, "sim_compute_sim_state": 0.0321593155732026, "sim_compute_performance-ego": 0.05647471949860856, "sim_compute_robot_state-ego": 0.05753874295466655, "sim_compute_robot_state-npc0": 0.06230617697174485, "sim_compute_robot_state-npc1": 0.05724788678658975, "sim_compute_robot_state-npc2": 0.05650285450187889, "sim_compute_robot_state-npc3": 0.05684794284201957}, "udem1-1-0": {"driven_any": 0.21811189564873917, "sim_physics": 0.024855924375129467, "survival_time": 1.6500000000000008, "driven_lanedir": 0.17200423330345238, "sim_render-ego": 0.055684291955196495, "in-drivable-lane": 0, "agent_compute-ego": 0.063029484315352, "deviation-heading": 0.7256486294638864, "set_robot_commands": 0.0704216668100068, "deviation-center-line": 0.07490284011542553, "driven_lanedir_consec": 0.17200423330345238, "sim_compute_sim_state": 0.03083630764123165, "sim_compute_performance-ego": 0.0550781452294552, "sim_compute_robot_state-ego": 0.05719228946801388, "sim_compute_robot_state-npc0": 0.0565370935382265, "sim_compute_robot_state-npc1": 0.05413271441604152, "sim_compute_robot_state-npc2": 0.05294420502402566, "sim_compute_robot_state-npc3": 0.05317378044128418}, "udem1-2-0": {"driven_any": 0.6118882329745925, "sim_physics": 0.03209590621110869, "survival_time": 4.099999999999993, "driven_lanedir": 0.5899772317367831, "sim_render-ego": 0.057874851110504895, "in-drivable-lane": 0, "agent_compute-ego": 0.0633036014510364, "deviation-heading": 0.8520617880510254, "set_robot_commands": 0.07298767857435273, "deviation-center-line": 0.32376686922317166, "driven_lanedir_consec": 0.5899772317367831, "sim_compute_sim_state": 0.03125531208224413, "sim_compute_performance-ego": 0.05712775486271556, "sim_compute_robot_state-ego": 0.05781227495612168, "sim_compute_robot_state-npc0": 0.06349147238382478, "sim_compute_robot_state-npc1": 0.05860752012671494, "sim_compute_robot_state-npc2": 0.0590835344500658, "sim_compute_robot_state-npc3": 0.05820568887198844}, "udem1-3-0": {"driven_any": 0.2261529121253515, "sim_physics": 0.026296545477474436, "survival_time": 1.7000000000000008, "driven_lanedir": 0.18619027328703508, "sim_render-ego": 0.05908659626455868, "in-drivable-lane": 0, "agent_compute-ego": 0.06711235467125387, "deviation-heading": 0.6915673569711595, "set_robot_commands": 0.07497168288511388, "deviation-center-line": 0.07700650382450831, "driven_lanedir_consec": 0.18619027328703508, "sim_compute_sim_state": 0.031647072118871356, "sim_compute_performance-ego": 0.057404125438017005, "sim_compute_robot_state-ego": 0.0575098570655374, "sim_compute_robot_state-npc0": 0.062865229213939, "sim_compute_robot_state-npc1": 0.05728265117196476, "sim_compute_robot_state-npc2": 0.05619502768797033, "sim_compute_robot_state-npc3": 0.05847001776975744}, "udem1-4-0": {"driven_any": 1.7770096165437566, "sim_physics": 0.026932731073858455, "survival_time": 11.350000000000026, "driven_lanedir": 1.360088302919181, "sim_render-ego": 0.058090380109879415, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.0658011404953339, "deviation-heading": 2.7176918923677467, "set_robot_commands": 0.07444879031916547, "deviation-center-line": 0.6202838280165518, "driven_lanedir_consec": 1.3491642604706673, "sim_compute_sim_state": 0.03297592574804365, "sim_compute_performance-ego": 0.058337537202541, "sim_compute_robot_state-ego": 0.058552855437022475, "sim_compute_robot_state-npc0": 0.06375794578753904, "sim_compute_robot_state-npc1": 0.058883256324062265, "sim_compute_robot_state-npc2": 0.05782269486246655, "sim_compute_robot_state-npc3": 0.058283487605628466}}
set_robot_commands_max0.07497168288511388
set_robot_commands_mean0.07312968980782392
set_robot_commands_median0.07298767857435273
set_robot_commands_min0.0704216668100068
sim_compute_performance-ego_max0.058337537202541
sim_compute_performance-ego_mean0.05688445644626746
sim_compute_performance-ego_median0.05712775486271556
sim_compute_performance-ego_min0.0550781452294552
sim_compute_robot_state-ego_max0.058552855437022475
sim_compute_robot_state-ego_mean0.057721203976272395
sim_compute_robot_state-ego_median0.05753874295466655
sim_compute_robot_state-ego_min0.05719228946801388
sim_compute_robot_state-npc0_max0.06375794578753904
sim_compute_robot_state-npc0_mean0.06179158357905483
sim_compute_robot_state-npc0_median0.062865229213939
sim_compute_robot_state-npc0_min0.0565370935382265
sim_compute_robot_state-npc1_max0.058883256324062265
sim_compute_robot_state-npc1_mean0.057230805765074645
sim_compute_robot_state-npc1_median0.05728265117196476
sim_compute_robot_state-npc1_min0.05413271441604152
sim_compute_robot_state-npc2_max0.0590835344500658
sim_compute_robot_state-npc2_mean0.05650966330528144
sim_compute_robot_state-npc2_median0.05650285450187889
sim_compute_robot_state-npc2_min0.05294420502402566
sim_compute_robot_state-npc3_max0.05847001776975744
sim_compute_robot_state-npc3_mean0.056996183506135625
sim_compute_robot_state-npc3_median0.05820568887198844
sim_compute_robot_state-npc3_min0.05317378044128418
sim_compute_sim_state_max0.03297592574804365
sim_compute_sim_state_mean0.031774786632718675
sim_compute_sim_state_median0.031647072118871356
sim_compute_sim_state_min0.03083630764123165
sim_physics_max0.03209590621110869
sim_physics_mean0.02740638405630664
sim_physics_median0.02685081314396214
sim_physics_min0.024855924375129467
sim_render-ego_max0.05908659626455868
sim_render-ego_mean0.05701795186526508
sim_render-ego_median0.057874851110504895
sim_render-ego_min0.05435363988618593
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean5.24
survival_time_min1.6500000000000008
No reset possible
187062649Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-108210:10:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06373329651661408
agent_compute-ego_mean0.06237163881491002
agent_compute-ego_median0.06281297857111151
agent_compute-ego_min0.060694890273244755
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.028623091547112716, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.05354533195495605, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.060694890273244755, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.0750978294171785, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03136128626371685, "sim_compute_performance-ego": 0.05420975936086554, "sim_compute_robot_state-ego": 0.05656764130843313, "sim_compute_robot_state-npc0": 0.06009885135449861, "sim_compute_robot_state-npc1": 0.055945823067112974, "sim_compute_robot_state-npc2": 0.05573086738586426, "sim_compute_robot_state-npc3": 0.05529412972299677}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.02713011440477873, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.0561322852184898, "in-drivable-lane": 0, "agent_compute-ego": 0.061524303335892525, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07312418912586413, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.032612242196735586, "sim_compute_performance-ego": 0.055430092309650625, "sim_compute_robot_state-ego": 0.05635232674448114, "sim_compute_robot_state-npc0": 0.0648197939521388, "sim_compute_robot_state-npc1": 0.06190901680996543, "sim_compute_robot_state-npc2": 0.058993188958419, "sim_compute_robot_state-npc3": 0.057937063668903555}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.029878683579273712, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06087960952367538, "in-drivable-lane": 0, "agent_compute-ego": 0.06373329651661408, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.0749667974618765, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03485455879798302, "sim_compute_performance-ego": 0.06350204883477627, "sim_compute_robot_state-ego": 0.06267653367458245, "sim_compute_robot_state-npc0": 0.0669403809767503, "sim_compute_robot_state-npc1": 0.06135258919153458, "sim_compute_robot_state-npc2": 0.06292522259247608, "sim_compute_robot_state-npc3": 0.0615850962125338}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03167856579095545, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.062461708632993024, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06309272537768727, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07468783687537825, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.0349195809431479, "sim_compute_performance-ego": 0.06044760220487353, "sim_compute_robot_state-ego": 0.06183425137694453, "sim_compute_robot_state-npc0": 0.0705918526985276, "sim_compute_robot_state-npc1": 0.06491127148480483, "sim_compute_robot_state-npc2": 0.061978125236403774, "sim_compute_robot_state-npc3": 0.06249930153430348}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02665380456230857, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.060398746620525016, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06281297857111151, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07410057566382668, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.034333581274205986, "sim_compute_performance-ego": 0.06012424013831399, "sim_compute_robot_state-ego": 0.060959815979003906, "sim_compute_robot_state-npc0": 0.06841706687753851, "sim_compute_robot_state-npc1": 0.06341333280910146, "sim_compute_robot_state-npc2": 0.061252729459242386, "sim_compute_robot_state-npc3": 0.06116603179411455}}
set_robot_commands_max0.0750978294171785
set_robot_commands_mean0.07439544570882481
set_robot_commands_median0.07468783687537825
set_robot_commands_min0.07312418912586413
sim_compute_performance-ego_max0.06350204883477627
sim_compute_performance-ego_mean0.05874274856969599
sim_compute_performance-ego_median0.06012424013831399
sim_compute_performance-ego_min0.05420975936086554
sim_compute_robot_state-ego_max0.06267653367458245
sim_compute_robot_state-ego_mean0.05967811381668904
sim_compute_robot_state-ego_median0.060959815979003906
sim_compute_robot_state-ego_min0.05635232674448114
sim_compute_robot_state-npc0_max0.0705918526985276
sim_compute_robot_state-npc0_mean0.06617358917189076
sim_compute_robot_state-npc0_median0.0669403809767503
sim_compute_robot_state-npc0_min0.06009885135449861
sim_compute_robot_state-npc1_max0.06491127148480483
sim_compute_robot_state-npc1_mean0.06150640667250386
sim_compute_robot_state-npc1_median0.06190901680996543
sim_compute_robot_state-npc1_min0.055945823067112974
sim_compute_robot_state-npc2_max0.06292522259247608
sim_compute_robot_state-npc2_mean0.060176026726481105
sim_compute_robot_state-npc2_median0.061252729459242386
sim_compute_robot_state-npc2_min0.05573086738586426
sim_compute_robot_state-npc3_max0.06249930153430348
sim_compute_robot_state-npc3_mean0.059696324586570426
sim_compute_robot_state-npc3_median0.06116603179411455
sim_compute_robot_state-npc3_min0.05529412972299677
sim_compute_sim_state_max0.0349195809431479
sim_compute_sim_state_mean0.033616249895157865
sim_compute_sim_state_median0.034333581274205986
sim_compute_sim_state_min0.03136128626371685
sim_physics_max0.03167856579095545
sim_physics_mean0.028792851976885837
sim_physics_median0.028623091547112716
sim_physics_min0.02665380456230857
sim_render-ego_max0.062461708632993024
sim_render-ego_mean0.058683536390127855
sim_render-ego_median0.060398746620525016
sim_render-ego_min0.05354533195495605
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
186972661Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-108210:18:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7569634097878868
survival_time_median5.14999999999999
deviation-center-line_median0.4529888653437758
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05895541993198016
agent_compute-ego_mean0.057263236268946395
agent_compute-ego_median0.05724251848980061
agent_compute-ego_min0.05507721662521362
deviation-center-line_max1.1749953599507068
deviation-center-line_mean0.47897544841416606
deviation-center-line_min0.06826179920421413
deviation-heading_max3.784897446289332
deviation-heading_mean1.4711054625874742
deviation-heading_median0.98045330364767
deviation-heading_min0.6694695765082032
driven_any_max2.3556684298839334
driven_any_mean0.945633182526677
driven_any_median0.7806439229755167
driven_any_min0.21007220778022476
driven_lanedir_consec_max2.1732611959936747
driven_lanedir_consec_mean0.8822773340763386
driven_lanedir_consec_min0.16110760340739727
driven_lanedir_max2.1756350388990997
driven_lanedir_mean0.8829069559010421
driven_lanedir_median0.7569634097878868
driven_lanedir_min0.16110760340739727
in-drivable-lane_max0.34999999999999876
in-drivable-lane_mean0.06999999999999976
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1556281369293635, "sim_physics": 0.026169786390089832, "survival_time": 7.549999999999981, "driven_lanedir": 1.1328409436600602, "sim_render-ego": 0.05177836228680137, "in-drivable-lane": 0, "agent_compute-ego": 0.05895541993198016, "deviation-heading": 1.1981299153715863, "set_robot_commands": 0.0707974670738574, "deviation-center-line": 0.624713557469308, "driven_lanedir_consec": 1.1320666774419674, "sim_compute_sim_state": 0.03148902173073876, "sim_compute_performance-ego": 0.052901580633706605, "sim_compute_robot_state-ego": 0.05448048004251442, "sim_compute_robot_state-npc0": 0.05739914660422218, "sim_compute_robot_state-npc1": 0.05493222956625831, "sim_compute_robot_state-npc2": 0.05418053683855676, "sim_compute_robot_state-npc3": 0.05508388272973875}, "udem1-1-0": {"driven_any": 0.21007220778022476, "sim_physics": 0.02427510917186737, "survival_time": 1.6000000000000008, "driven_lanedir": 0.16110760340739727, "sim_render-ego": 0.05174197256565094, "in-drivable-lane": 0, "agent_compute-ego": 0.05636325478553772, "deviation-heading": 0.7225770711205787, "set_robot_commands": 0.07094917446374893, "deviation-center-line": 0.06826179920421413, "driven_lanedir_consec": 0.16110760340739727, "sim_compute_sim_state": 0.030063845217227936, "sim_compute_performance-ego": 0.05106150358915329, "sim_compute_robot_state-ego": 0.0524461641907692, "sim_compute_robot_state-npc0": 0.0547826811671257, "sim_compute_robot_state-npc1": 0.05242941528558731, "sim_compute_robot_state-npc2": 0.05184563994407654, "sim_compute_robot_state-npc3": 0.052342742681503296}, "udem1-2-0": {"driven_any": 0.7806439229755167, "sim_physics": 0.02866572083778752, "survival_time": 5.14999999999999, "driven_lanedir": 0.7569634097878868, "sim_render-ego": 0.05227465768462246, "in-drivable-lane": 0, "agent_compute-ego": 0.05724251848980061, "deviation-heading": 0.98045330364767, "set_robot_commands": 0.07053534035543793, "deviation-center-line": 0.4529888653437758, "driven_lanedir_consec": 0.7569634097878868, "sim_compute_sim_state": 0.03044474935068667, "sim_compute_performance-ego": 0.05185165451568307, "sim_compute_robot_state-ego": 0.0530724548599095, "sim_compute_robot_state-npc0": 0.05611554164330936, "sim_compute_robot_state-npc1": 0.05494008943872544, "sim_compute_robot_state-npc2": 0.05289458534092579, "sim_compute_robot_state-npc3": 0.05341728451182541}, "udem1-3-0": {"driven_any": 0.2261532150643467, "sim_physics": 0.02621598804698271, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1879877837507662, "sim_render-ego": 0.052560069981743306, "in-drivable-lane": 0, "agent_compute-ego": 0.05867777151219985, "deviation-heading": 0.6694695765082032, "set_robot_commands": 0.0705703286563649, "deviation-center-line": 0.07391766010282552, "driven_lanedir_consec": 0.1879877837507662, "sim_compute_sim_state": 0.030936227125280043, "sim_compute_performance-ego": 0.05078234392053941, "sim_compute_robot_state-ego": 0.05368704655591179, "sim_compute_robot_state-npc0": 0.055308082524467915, "sim_compute_robot_state-npc1": 0.052408667171702665, "sim_compute_robot_state-npc2": 0.053267499979804546, "sim_compute_robot_state-npc3": 0.05410484706654268}, "udem1-4-0": {"driven_any": 2.3556684298839334, "sim_physics": 0.02451245705286662, "survival_time": 14.950000000000076, "driven_lanedir": 2.1756350388990997, "sim_render-ego": 0.050719804763793945, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.05507721662521362, "deviation-heading": 3.784897446289332, "set_robot_commands": 0.06991410652796427, "deviation-center-line": 1.1749953599507068, "driven_lanedir_consec": 2.1732611959936747, "sim_compute_sim_state": 0.03015389362970988, "sim_compute_performance-ego": 0.052684072653452554, "sim_compute_robot_state-ego": 0.05361494541168213, "sim_compute_robot_state-npc0": 0.056517126560211184, "sim_compute_robot_state-npc1": 0.05402307113011678, "sim_compute_robot_state-npc2": 0.05383498271306355, "sim_compute_robot_state-npc3": 0.05389678001403809}}
set_robot_commands_max0.07094917446374893
set_robot_commands_mean0.07055328341547469
set_robot_commands_median0.0705703286563649
set_robot_commands_min0.06991410652796427
sim_compute_performance-ego_max0.052901580633706605
sim_compute_performance-ego_mean0.05185623106250699
sim_compute_performance-ego_median0.05185165451568307
sim_compute_performance-ego_min0.05078234392053941
sim_compute_robot_state-ego_max0.05448048004251442
sim_compute_robot_state-ego_mean0.05346021821215741
sim_compute_robot_state-ego_median0.05361494541168213
sim_compute_robot_state-ego_min0.0524461641907692
sim_compute_robot_state-npc0_max0.05739914660422218
sim_compute_robot_state-npc0_mean0.05602451569986727
sim_compute_robot_state-npc0_median0.05611554164330936
sim_compute_robot_state-npc0_min0.0547826811671257
sim_compute_robot_state-npc1_max0.05494008943872544
sim_compute_robot_state-npc1_mean0.0537466945184781
sim_compute_robot_state-npc1_median0.05402307113011678
sim_compute_robot_state-npc1_min0.052408667171702665
sim_compute_robot_state-npc2_max0.05418053683855676
sim_compute_robot_state-npc2_mean0.05320464896328543
sim_compute_robot_state-npc2_median0.053267499979804546
sim_compute_robot_state-npc2_min0.05184563994407654
sim_compute_robot_state-npc3_max0.05508388272973875
sim_compute_robot_state-npc3_mean0.05376910740072964
sim_compute_robot_state-npc3_median0.05389678001403809
sim_compute_robot_state-npc3_min0.052342742681503296
sim_compute_sim_state_max0.03148902173073876
sim_compute_sim_state_mean0.030617547410728654
sim_compute_sim_state_median0.03044474935068667
sim_compute_sim_state_min0.030063845217227936
sim_physics_max0.02866572083778752
sim_physics_mean0.025967812299918812
sim_physics_median0.026169786390089832
sim_physics_min0.02427510917186737
sim_render-ego_max0.052560069981743306
sim_render-ego_mean0.0518149734565224
sim_render-ego_median0.05177836228680137
sim_render-ego_min0.050719804763793945
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.19000000000001
survival_time_min1.6000000000000008
No reset possible
186802694Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-108210:21:09
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186752698Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-108210:15:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4815980559959536
survival_time_median3.8499999999999943
deviation-center-line_median0.23830823642185708
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05885589122772217
agent_compute-ego_mean0.05777585908761111
agent_compute-ego_median0.05827163095059602
agent_compute-ego_min0.055669881502787275
deviation-center-line_max0.689319188683665
deviation-center-line_mean0.3516970841645242
deviation-center-line_min0.0617285052614659
deviation-heading_max3.202119035997067
deviation-heading_mean1.3439542601474346
deviation-heading_median0.9612719961366532
deviation-heading_min0.7086877401907453
driven_any_max1.8332233566719396
driven_any_mean0.8138227792512552
driven_any_median0.5717087289574438
driven_any_min0.19400436941882152
driven_lanedir_consec_max1.3671717862768835
driven_lanedir_consec_mean0.6821907831098335
driven_lanedir_consec_min0.14436378503763603
driven_lanedir_max1.373958070081588
driven_lanedir_mean0.6841767034940824
driven_lanedir_median0.4815980559959536
driven_lanedir_min0.14436378503763603
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean0.4800000000000056
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1475890170100271, "sim_physics": 0.02475247224171956, "survival_time": 7.499999999999981, "driven_lanedir": 1.1259563487477773, "sim_render-ego": 0.05102372964223226, "in-drivable-lane": 0, "agent_compute-ego": 0.055669881502787275, "deviation-heading": 1.1266639642126148, "set_robot_commands": 0.07072511831919352, "deviation-center-line": 0.6211574840637624, "driven_lanedir_consec": 1.1228130306312358, "sim_compute_sim_state": 0.02953587532043457, "sim_compute_performance-ego": 0.05202654679616292, "sim_compute_robot_state-ego": 0.05338795026143392, "sim_compute_robot_state-npc0": 0.05568091074625651, "sim_compute_robot_state-npc1": 0.05363128185272217, "sim_compute_robot_state-npc2": 0.05209211031595866, "sim_compute_robot_state-npc3": 0.05321952978769938}, "udem1-1-0": {"driven_any": 0.19400436941882152, "sim_physics": 0.026282612482706705, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14436378503763603, "sim_render-ego": 0.05355116526285807, "in-drivable-lane": 0, "agent_compute-ego": 0.05885589122772217, "deviation-heading": 0.7086877401907453, "set_robot_commands": 0.07084172566731771, "deviation-center-line": 0.0617285052614659, "driven_lanedir_consec": 0.14436378503763603, "sim_compute_sim_state": 0.031938783327738446, "sim_compute_performance-ego": 0.05100995699564616, "sim_compute_robot_state-ego": 0.05347025394439697, "sim_compute_robot_state-npc0": 0.05931520462036133, "sim_compute_robot_state-npc1": 0.05570268630981445, "sim_compute_robot_state-npc2": 0.055336197217305504, "sim_compute_robot_state-npc3": 0.05458062489827474}, "udem1-2-0": {"driven_any": 0.5717087289574438, "sim_physics": 0.030887430364435368, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4815980559959536, "sim_render-ego": 0.05551463597780698, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.05858634663866712, "deviation-heading": 0.9612719961366532, "set_robot_commands": 0.0730011494128735, "deviation-center-line": 0.23830823642185708, "driven_lanedir_consec": 0.4815980559959536, "sim_compute_sim_state": 0.03217026784822538, "sim_compute_performance-ego": 0.054524886143672, "sim_compute_robot_state-ego": 0.05655317182664747, "sim_compute_robot_state-npc0": 0.05896931809264344, "sim_compute_robot_state-npc1": 0.05667837254412762, "sim_compute_robot_state-npc2": 0.05693208706843388, "sim_compute_robot_state-npc3": 0.056973596671959024}, "udem1-3-0": {"driven_any": 0.32258842419804373, "sim_physics": 0.026266310525977093, "survival_time": 2.3, "driven_lanedir": 0.29500725760745783, "sim_render-ego": 0.052415293195973274, "in-drivable-lane": 0, "agent_compute-ego": 0.05827163095059602, "deviation-heading": 0.7210285642000925, "set_robot_commands": 0.07114940622578496, "deviation-center-line": 0.1479720063918705, "driven_lanedir_consec": 0.29500725760745783, "sim_compute_sim_state": 0.030197179835775623, "sim_compute_performance-ego": 0.055375897366067635, "sim_compute_robot_state-ego": 0.054640189461086106, "sim_compute_robot_state-npc0": 0.05782346103502357, "sim_compute_robot_state-npc1": 0.058458680691926376, "sim_compute_robot_state-npc2": 0.05521162696506666, "sim_compute_robot_state-npc3": 0.05534725603849992}, "udem1-4-0": {"driven_any": 1.8332233566719396, "sim_physics": 0.025689952393882293, "survival_time": 11.700000000000031, "driven_lanedir": 1.373958070081588, "sim_render-ego": 0.05512827481978979, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.05749554511828301, "deviation-heading": 3.202119035997067, "set_robot_commands": 0.07270824399768797, "deviation-center-line": 0.689319188683665, "driven_lanedir_consec": 1.3671717862768835, "sim_compute_sim_state": 0.03182157797691149, "sim_compute_performance-ego": 0.05519170536954179, "sim_compute_robot_state-ego": 0.055922386992690906, "sim_compute_robot_state-npc0": 0.05963351991441515, "sim_compute_robot_state-npc1": 0.05692523666936109, "sim_compute_robot_state-npc2": 0.056228812943156965, "sim_compute_robot_state-npc3": 0.05656739789196569}}
set_robot_commands_max0.0730011494128735
set_robot_commands_mean0.07168512872457153
set_robot_commands_median0.07114940622578496
set_robot_commands_min0.07072511831919352
sim_compute_performance-ego_max0.055375897366067635
sim_compute_performance-ego_mean0.053625798534218096
sim_compute_performance-ego_median0.054524886143672
sim_compute_performance-ego_min0.05100995699564616
sim_compute_robot_state-ego_max0.05655317182664747
sim_compute_robot_state-ego_mean0.05479479049725108
sim_compute_robot_state-ego_median0.054640189461086106
sim_compute_robot_state-ego_min0.05338795026143392
sim_compute_robot_state-npc0_max0.05963351991441515
sim_compute_robot_state-npc0_mean0.05828448288174
sim_compute_robot_state-npc0_median0.05896931809264344
sim_compute_robot_state-npc0_min0.05568091074625651
sim_compute_robot_state-npc1_max0.058458680691926376
sim_compute_robot_state-npc1_mean0.056279251613590354
sim_compute_robot_state-npc1_median0.05667837254412762
sim_compute_robot_state-npc1_min0.05363128185272217
sim_compute_robot_state-npc2_max0.05693208706843388
sim_compute_robot_state-npc2_mean0.05516016690198433
sim_compute_robot_state-npc2_median0.055336197217305504
sim_compute_robot_state-npc2_min0.05209211031595866
sim_compute_robot_state-npc3_max0.056973596671959024
sim_compute_robot_state-npc3_mean0.05533768105767976
sim_compute_robot_state-npc3_median0.05534725603849992
sim_compute_robot_state-npc3_min0.05321952978769938
sim_compute_sim_state_max0.03217026784822538
sim_compute_sim_state_mean0.0311327368618171
sim_compute_sim_state_median0.03182157797691149
sim_compute_sim_state_min0.02953587532043457
sim_physics_max0.030887430364435368
sim_physics_mean0.026775755601744205
sim_physics_median0.026266310525977093
sim_physics_min0.02475247224171956
sim_render-ego_max0.05551463597780698
sim_render-ego_mean0.053526619779732075
sim_render-ego_median0.05355116526285807
sim_render-ego_min0.05102372964223226
simulation-passed1
survival_time_max11.700000000000031
survival_time_mean5.370000000000002
survival_time_min1.5000000000000009
No reset possible
186672716jiang pengtest for ppoaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-108210:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186582734Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationfailednoidsc-rudolf-108210:01:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186372770Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-108210:21:15
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186332786Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-108210:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186282799Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationfailednoidsc-rudolf-108210:01:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186162826Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-108210:11:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.15176679106319652
agent_compute-ego_mean0.1474475082004143
agent_compute-ego_median0.1475031606612667
agent_compute-ego_min0.14416522421735398
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03314940513126434, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06742359721471393, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1485359101068406, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07965538615272158, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.036819855372111, "sim_compute_performance-ego": 0.06480169296264648, "sim_compute_robot_state-ego": 0.06515134705437554, "sim_compute_robot_state-npc0": 0.0729422720651778, "sim_compute_robot_state-npc1": 0.06783550504654173, "sim_compute_robot_state-npc2": 0.06573582830883208, "sim_compute_robot_state-npc3": 0.06650729784889826}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.02927701613482307, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06444712246165556, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.15176679106319652, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0786118226892808, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03771744989881329, "sim_compute_performance-ego": 0.06253400503420363, "sim_compute_robot_state-ego": 0.06531494739008885, "sim_compute_robot_state-npc0": 0.07126713734047085, "sim_compute_robot_state-npc1": 0.06722489992777507, "sim_compute_robot_state-npc2": 0.06417310471628226, "sim_compute_robot_state-npc3": 0.06580688906650917}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03168646366365494, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06424474716186523, "in-drivable-lane": 0, "agent_compute-ego": 0.1475031606612667, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07886987732302758, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03628068201003536, "sim_compute_performance-ego": 0.06169951731158841, "sim_compute_robot_state-ego": 0.06255608989346412, "sim_compute_robot_state-npc0": 0.07119865571298907, "sim_compute_robot_state-npc1": 0.06673589060383459, "sim_compute_robot_state-npc2": 0.06541012179466986, "sim_compute_robot_state-npc3": 0.06349037539574408}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0310861810724786, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.0658963107048197, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14416522421735398, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07541620224080187, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03452622890472412, "sim_compute_performance-ego": 0.06442137221072583, "sim_compute_robot_state-ego": 0.0637407328220124, "sim_compute_robot_state-npc0": 0.07165385053512897, "sim_compute_robot_state-npc1": 0.06397009656784382, "sim_compute_robot_state-npc2": 0.06427996970237569, "sim_compute_robot_state-npc3": 0.06360648540740317}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027818097518040583, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06506128494556133, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14526645495341375, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.0786575720860408, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03536455906354464, "sim_compute_performance-ego": 0.06468304303976205, "sim_compute_robot_state-ego": 0.06580075850853553, "sim_compute_robot_state-npc0": 0.07152285025669979, "sim_compute_robot_state-npc1": 0.06728803652983445, "sim_compute_robot_state-npc2": 0.06525050218288715, "sim_compute_robot_state-npc3": 0.0648796008183406}}
set_robot_commands_max0.07965538615272158
set_robot_commands_mean0.07824217209837453
set_robot_commands_median0.0786575720860408
set_robot_commands_min0.07541620224080187
sim_compute_performance-ego_max0.06480169296264648
sim_compute_performance-ego_mean0.06362792611178528
sim_compute_performance-ego_median0.06442137221072583
sim_compute_performance-ego_min0.06169951731158841
sim_compute_robot_state-ego_max0.06580075850853553
sim_compute_robot_state-ego_mean0.06451277513369529
sim_compute_robot_state-ego_median0.06515134705437554
sim_compute_robot_state-ego_min0.06255608989346412
sim_compute_robot_state-npc0_max0.0729422720651778
sim_compute_robot_state-npc0_mean0.07171695318209328
sim_compute_robot_state-npc0_median0.07152285025669979
sim_compute_robot_state-npc0_min0.07119865571298907
sim_compute_robot_state-npc1_max0.06783550504654173
sim_compute_robot_state-npc1_mean0.06661088573516594
sim_compute_robot_state-npc1_median0.06722489992777507
sim_compute_robot_state-npc1_min0.06397009656784382
sim_compute_robot_state-npc2_max0.06573582830883208
sim_compute_robot_state-npc2_mean0.06496990534100941
sim_compute_robot_state-npc2_median0.06525050218288715
sim_compute_robot_state-npc2_min0.06417310471628226
sim_compute_robot_state-npc3_max0.06650729784889826
sim_compute_robot_state-npc3_mean0.06485812970737906
sim_compute_robot_state-npc3_median0.0648796008183406
sim_compute_robot_state-npc3_min0.06349037539574408
sim_compute_sim_state_max0.03771744989881329
sim_compute_sim_state_mean0.03614175504984568
sim_compute_sim_state_median0.03628068201003536
sim_compute_sim_state_min0.03452622890472412
sim_physics_max0.03314940513126434
sim_physics_mean0.030603432704052302
sim_physics_median0.0310861810724786
sim_physics_min0.027818097518040583
sim_render-ego_max0.06742359721471393
sim_render-ego_mean0.06541461249772315
sim_render-ego_median0.06506128494556133
sim_render-ego_min0.06424474716186523
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible