Duckietown Challenges Home Challenges Submissions

Evaluator 1217

ID1217
evaluatornutonomy-P50-9747
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-9747
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success17 22619
# timeout
# failed
# error14 22703
# aborted1 22628
# host-error3 22755
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230312365Andrea Censi 🇨🇭random_agentaido2-LFV-sim-validationstep1-simulationsuccessyesnutonomy-P50-97470:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.07108789020114475
agent_compute-ego_mean0.06995683109661073
agent_compute-ego_median0.06966183866773333
agent_compute-ego_min0.06926796938243665
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0627402111336037, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03231476412879096, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.07108789020114475, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.049708154466417104, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.020234540656760888, "sim_compute_performance-ego": 0.03477398112968162, "sim_compute_robot_state-ego": 0.03682752008791323, "sim_compute_robot_state-npc0": 0.03599355397401033, "sim_compute_robot_state-npc1": 0.035869086230242694, "sim_compute_robot_state-npc2": 0.035851377028006094, "sim_compute_robot_state-npc3": 0.03580885463290744}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.07280925750732421, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.031942253112792966, "in-drivable-lane": 0, "agent_compute-ego": 0.07018970489501954, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.049176483154296874, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.020061540603637695, "sim_compute_performance-ego": 0.03576681137084961, "sim_compute_robot_state-ego": 0.036793603897094726, "sim_compute_robot_state-npc0": 0.035769624710083006, "sim_compute_robot_state-npc1": 0.03580754280090332, "sim_compute_robot_state-npc2": 0.0355344009399414, "sim_compute_robot_state-npc3": 0.03565446853637695}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.0674737535024944, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.03167616379888434, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.06926796938243665, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.04879066818638852, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.019949138164520264, "sim_compute_performance-ego": 0.03532219874231439, "sim_compute_robot_state-ego": 0.0368588974601344, "sim_compute_robot_state-npc0": 0.03626827817214163, "sim_compute_robot_state-npc1": 0.03563693636342099, "sim_compute_robot_state-npc2": 0.035378374551471914, "sim_compute_robot_state-npc3": 0.03526064910386738}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.06942792180218274, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.032035939301116555, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06957675233671937, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.048632452759561656, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.02011463008349455, "sim_compute_performance-ego": 0.03492539743833904, "sim_compute_robot_state-ego": 0.03687596924697296, "sim_compute_robot_state-npc0": 0.03608697879163525, "sim_compute_robot_state-npc1": 0.035879886603053614, "sim_compute_robot_state-npc2": 0.03519369680670243, "sim_compute_robot_state-npc3": 0.03551515446433538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.06571062122072492, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.032172160489218574, "in-drivable-lane": 0, "agent_compute-ego": 0.06966183866773333, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.04888168403080532, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.02003272090639387, "sim_compute_performance-ego": 0.03535022905894688, "sim_compute_robot_state-ego": 0.03664192131587437, "sim_compute_robot_state-npc0": 0.03549613271440778, "sim_compute_robot_state-npc1": 0.035582542419433594, "sim_compute_robot_state-npc2": 0.036325769765036445, "sim_compute_robot_state-npc3": 0.035104726042066305}}
set_robot_commands_max0.049708154466417104
set_robot_commands_mean0.049037888519493894
set_robot_commands_median0.04888168403080532
set_robot_commands_min0.048632452759561656
sim_compute_performance-ego_max0.03576681137084961
sim_compute_performance-ego_mean0.03522772354802631
sim_compute_performance-ego_median0.03532219874231439
sim_compute_performance-ego_min0.03477398112968162
sim_compute_robot_state-ego_max0.03687596924697296
sim_compute_robot_state-ego_mean0.03679958240159793
sim_compute_robot_state-ego_median0.03682752008791323
sim_compute_robot_state-ego_min0.03664192131587437
sim_compute_robot_state-npc0_max0.03626827817214163
sim_compute_robot_state-npc0_mean0.035922913672455606
sim_compute_robot_state-npc0_median0.03599355397401033
sim_compute_robot_state-npc0_min0.03549613271440778
sim_compute_robot_state-npc1_max0.035879886603053614
sim_compute_robot_state-npc1_mean0.035755198883410846
sim_compute_robot_state-npc1_median0.03580754280090332
sim_compute_robot_state-npc1_min0.035582542419433594
sim_compute_robot_state-npc2_max0.036325769765036445
sim_compute_robot_state-npc2_mean0.035656723818231664
sim_compute_robot_state-npc2_median0.0355344009399414
sim_compute_robot_state-npc2_min0.03519369680670243
sim_compute_robot_state-npc3_max0.03580885463290744
sim_compute_robot_state-npc3_mean0.03546877055591069
sim_compute_robot_state-npc3_median0.03551515446433538
sim_compute_robot_state-npc3_min0.035104726042066305
sim_compute_sim_state_max0.020234540656760888
sim_compute_sim_state_mean0.020078514082961452
sim_compute_sim_state_median0.020061540603637695
sim_compute_sim_state_min0.019949138164520264
sim_physics_max0.07280925750732421
sim_physics_mean0.06763235303326601
sim_physics_median0.0674737535024944
sim_physics_min0.0627402111336037
sim_render-ego_max0.03231476412879096
sim_render-ego_mean0.032028256166160674
sim_render-ego_median0.032035939301116555
sim_render-ego_min0.03167616379888434
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
230182379Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LFVI-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:20:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4674075261701268
survival_time_median3.699999999999995
deviation-center-line_median0.2037212999690195
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03325364806435325
agent_compute-ego_mean0.03248116808109725
agent_compute-ego_median0.03249249395155749
agent_compute-ego_min0.03171076625585556
deviation-center-line_max0.5183621890690367
deviation-center-line_mean0.2365365432439713
deviation-center-line_min0.1001276403534276
deviation-heading_max1.8192903310562811
deviation-heading_mean0.7195980419067693
deviation-heading_median0.5070424162880826
deviation-heading_min0.2495279988048577
driven_any_max2.764827318571964
driven_any_mean1.0818349506618754
driven_any_median1.0098273192909006
driven_any_min0.3648701917101222
driven_lanedir_consec_max1.9044523873117627
driven_lanedir_consec_mean0.759860328609196
driven_lanedir_consec_min0.3272146444894328
driven_lanedir_max1.9045033171069223
driven_lanedir_mean0.7732651243581526
driven_lanedir_median0.6173586051289615
driven_lanedir_min0.3272146444894328
in-drivable-lane_max3.7999999999999887
in-drivable-lane_mean0.8633333333333326
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.0745156563080109, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.03236122174305959, "in-drivable-lane": 0, "agent_compute-ego": 0.03265463983690416, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.0503698426323968, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.02011624542442528, "sim_compute_performance-ego": 0.03496484069136886, "sim_compute_robot_state-ego": 0.03762842298627974, "sim_compute_robot_state-npc0": 0.03583744195130494, "sim_compute_robot_state-npc1": 0.03586632926184852, "sim_compute_robot_state-npc2": 0.035856824737411364, "sim_compute_robot_state-npc3": 0.0356718956887185}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.07845770990526355, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.033194181081411, "in-drivable-lane": 0, "agent_compute-ego": 0.03251635061727988, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.04980333431346996, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.02019351237529033, "sim_compute_performance-ego": 0.03543474223162677, "sim_compute_robot_state-ego": 0.03666121250874287, "sim_compute_robot_state-npc0": 0.03604819967940047, "sim_compute_robot_state-npc1": 0.03637819032411318, "sim_compute_robot_state-npc2": 0.03577627362431707, "sim_compute_robot_state-npc3": 0.03522409619511785}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.07417537518684438, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.032225002516184424, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.03249249395155749, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.04979640284910897, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.020267006577245446, "sim_compute_performance-ego": 0.03495922783352681, "sim_compute_robot_state-ego": 0.036905681850104934, "sim_compute_robot_state-npc0": 0.035924575186723116, "sim_compute_robot_state-npc1": 0.035870032594693416, "sim_compute_robot_state-npc2": 0.03551517101313105, "sim_compute_robot_state-npc3": 0.035530475591192184}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.07485942815610876, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.03220597237192523, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.03318822695946818, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.04974684665340404, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.019947052001953125, "sim_compute_performance-ego": 0.03493750157780672, "sim_compute_robot_state-ego": 0.03710156335880619, "sim_compute_robot_state-npc0": 0.035641705178465516, "sim_compute_robot_state-npc1": 0.035823090538304514, "sim_compute_robot_state-npc2": 0.03584593628089466, "sim_compute_robot_state-npc3": 0.03538878675530718}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.07681906223297119, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.03885068744421005, "in-drivable-lane": 0, "agent_compute-ego": 0.03171076625585556, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.04921960085630417, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.020246252417564392, "sim_compute_performance-ego": 0.03485196828842163, "sim_compute_robot_state-ego": 0.03700580447912216, "sim_compute_robot_state-npc0": 0.036048732697963715, "sim_compute_robot_state-npc1": 0.035823799669742584, "sim_compute_robot_state-npc2": 0.03538917750120163, "sim_compute_robot_state-npc3": 0.03562343865633011}, "udem1-5-0": {"driven_any": 1.0548273189057942, "sim_physics": 0.07560531814377029, "survival_time": 3.8499999999999943, "driven_lanedir": 0.39637369698573455, "sim_render-ego": 0.0325054441179548, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.03228118512537572, "deviation-heading": 1.272726140232846, "set_robot_commands": 0.04974115978587757, "deviation-center-line": 0.2037212999690195, "driven_lanedir_consec": 0.39637369698573455, "sim_compute_sim_state": 0.02013089130451153, "sim_compute_performance-ego": 0.03501032234786393, "sim_compute_robot_state-ego": 0.03754183224269322, "sim_compute_robot_state-npc0": 0.03613819085158311, "sim_compute_robot_state-npc1": 0.03584871973310198, "sim_compute_robot_state-npc2": 0.035907172537469244, "sim_compute_robot_state-npc3": 0.035959866139795876}, "udem1-6-0": {"driven_any": 0.8898273241328052, "sim_physics": 0.08429012876568419, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8871438691197218, "sim_render-ego": 0.032016566305449516, "in-drivable-lane": 0, "agent_compute-ego": 0.03210632006327311, "deviation-heading": 0.2564691131854334, "set_robot_commands": 0.05069940740411931, "deviation-center-line": 0.3019392944051749, "driven_lanedir_consec": 0.8871438691197218, "sim_compute_sim_state": 0.020017732273448597, "sim_compute_performance-ego": 0.035054069576841415, "sim_compute_robot_state-ego": 0.03721287395014907, "sim_compute_robot_state-npc0": 0.03573886914686723, "sim_compute_robot_state-npc1": 0.03514311169133042, "sim_compute_robot_state-npc2": 0.03541539293346983, "sim_compute_robot_state-npc3": 0.03537081227158055}, "udem1-7-0": {"driven_any": 1.0098273192909006, "sim_physics": 0.08329488780047442, "survival_time": 3.699999999999995, "driven_lanedir": 0.8892952338440012, "sim_render-ego": 0.032906983349774335, "in-drivable-lane": 0, "agent_compute-ego": 0.03230967714979842, "deviation-heading": 1.3305395181824708, "set_robot_commands": 0.049454150973139585, "deviation-center-line": 0.2328954250769578, "driven_lanedir_consec": 0.8751257158125099, "sim_compute_sim_state": 0.020055413246154785, "sim_compute_performance-ego": 0.034874278145867424, "sim_compute_robot_state-ego": 0.03645615319947939, "sim_compute_robot_state-npc0": 0.036023574906426506, "sim_compute_robot_state-npc1": 0.03639141933338062, "sim_compute_robot_state-npc2": 0.035136261501827755, "sim_compute_robot_state-npc3": 0.03566246741526836}, "udem1-8-0": {"driven_any": 1.024827319128602, "sim_physics": 0.07417799631754557, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6173586051289615, "sim_render-ego": 0.03232115109761556, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.03224224726359049, "deviation-heading": 1.2558531851712094, "set_robot_commands": 0.04958165168762207, "deviation-center-line": 0.25318000812184893, "driven_lanedir_consec": 0.6173586051289615, "sim_compute_sim_state": 0.01997259775797526, "sim_compute_performance-ego": 0.03564883550008138, "sim_compute_robot_state-ego": 0.03666954676310221, "sim_compute_robot_state-npc0": 0.03607378641764323, "sim_compute_robot_state-npc1": 0.035685946146647135, "sim_compute_robot_state-npc2": 0.03681977907816569, "sim_compute_robot_state-npc3": 0.03548841794331869}, "udem1-9-0": {"driven_any": 0.45483656177104664, "sim_physics": 0.08800168939538904, "survival_time": 1.850000000000001, "driven_lanedir": 0.4388914430822646, "sim_render-ego": 0.03270205291541847, "in-drivable-lane": 0, "agent_compute-ego": 0.03261435998452676, "deviation-heading": 0.49131063474122394, "set_robot_commands": 0.05241576400963035, "deviation-center-line": 0.1166531854243332, "driven_lanedir_consec": 0.4388914430822646, "sim_compute_sim_state": 0.02051653733124604, "sim_compute_performance-ego": 0.03505168089995513, "sim_compute_robot_state-ego": 0.03714143907701647, "sim_compute_robot_state-npc0": 0.0360848517031283, "sim_compute_robot_state-npc1": 0.03589751913740828, "sim_compute_robot_state-npc2": 0.03582440840231406, "sim_compute_robot_state-npc3": 0.035611867904663086}, "udem1-10-0": {"driven_any": 0.3648701917101222, "sim_physics": 0.07976305869317823, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552109787971164, "sim_render-ego": 0.033283695097892516, "in-drivable-lane": 0, "agent_compute-ego": 0.032740116119384766, "deviation-heading": 0.5070424162880826, "set_robot_commands": 0.050033015589560234, "deviation-center-line": 0.1001276403534276, "driven_lanedir_consec": 0.34552109787971164, "sim_compute_sim_state": 0.02035190213111139, "sim_compute_performance-ego": 0.035315490538074125, "sim_compute_robot_state-ego": 0.03675145487631521, "sim_compute_robot_state-npc0": 0.03580281811375772, "sim_compute_robot_state-npc1": 0.035977778896208734, "sim_compute_robot_state-npc2": 0.03605051194467852, "sim_compute_robot_state-npc3": 0.03647822718466482}, "udem1-11-0": {"driven_any": 0.4098472254790859, "sim_physics": 0.0765990649952608, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054397040222266, "sim_render-ego": 0.032596987836501175, "in-drivable-lane": 0, "agent_compute-ego": 0.032210770775290096, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.0509188455693862, "deviation-center-line": 0.16731842400967326, "driven_lanedir_consec": 0.4054397040222266, "sim_compute_sim_state": 0.020020071197958553, "sim_compute_performance-ego": 0.03494712885688333, "sim_compute_robot_state-ego": 0.037166714668273926, "sim_compute_robot_state-npc0": 0.03556365125319537, "sim_compute_robot_state-npc1": 0.03597136806039249, "sim_compute_robot_state-npc2": 0.03540610565858729, "sim_compute_robot_state-npc3": 0.035819011576035446}, "udem1-12-0": {"driven_any": 1.4748273185722356, "sim_physics": 0.0788203375680106, "survival_time": 5.249999999999989, "driven_lanedir": 0.3272146444894328, "sim_render-ego": 0.03307132266816639, "in-drivable-lane": 3.7999999999999887, "agent_compute-ego": 0.03251548494611468, "deviation-heading": 0.3112188917063981, "set_robot_commands": 0.050716456912812735, "deviation-center-line": 0.16525953982768174, "driven_lanedir_consec": 0.3272146444894328, "sim_compute_sim_state": 0.020835985456194195, "sim_compute_performance-ego": 0.03617973554702032, "sim_compute_robot_state-ego": 0.03723642712547665, "sim_compute_robot_state-npc0": 0.037023700986589705, "sim_compute_robot_state-npc1": 0.03657564889817011, "sim_compute_robot_state-npc2": 0.03627385866074335, "sim_compute_robot_state-npc3": 0.03619758061000279}, "udem1-13-0": {"driven_any": 0.9948273195001724, "sim_physics": 0.0743726671558537, "survival_time": 3.649999999999995, "driven_lanedir": 0.6553480498428992, "sim_render-ego": 0.03265874679774454, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.032381234103686186, "deviation-heading": 0.7740959733116568, "set_robot_commands": 0.049474980733166, "deviation-center-line": 0.19736301642105017, "driven_lanedir_consec": 0.6553480498428992, "sim_compute_sim_state": 0.020176982226437084, "sim_compute_performance-ego": 0.03520908094432256, "sim_compute_robot_state-ego": 0.03739174098184664, "sim_compute_robot_state-npc0": 0.03607236522517792, "sim_compute_robot_state-npc1": 0.035593029570906126, "sim_compute_robot_state-npc2": 0.03538371438849462, "sim_compute_robot_state-npc3": 0.03540828783218175}, "udem1-14-0": {"driven_any": 1.219827318592, "sim_physics": 0.08021905476396735, "survival_time": 4.399999999999992, "driven_lanedir": 0.6539905402707253, "sim_render-ego": 0.03222511031410911, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.03325364806435325, "deviation-heading": 1.8192903310562811, "set_robot_commands": 0.050864347002723, "deviation-center-line": 0.26377380229393954, "driven_lanedir_consec": 0.4674075261701268, "sim_compute_sim_state": 0.01981769095767628, "sim_compute_performance-ego": 0.03505371917377819, "sim_compute_robot_state-ego": 0.03682995384389704, "sim_compute_robot_state-npc0": 0.03555477478287437, "sim_compute_robot_state-npc1": 0.03556106307289817, "sim_compute_robot_state-npc2": 0.0361792499368841, "sim_compute_robot_state-npc3": 0.0358753962950273}}
set_robot_commands_max0.05241576400963035
set_robot_commands_mean0.0501890537981814
set_robot_commands_median0.04980333431346996
set_robot_commands_min0.04921960085630417
sim_compute_performance-ego_max0.03617973554702032
sim_compute_performance-ego_mean0.03516617481022924
sim_compute_performance-ego_median0.03505168089995513
sim_compute_performance-ego_min0.03485196828842163
sim_compute_robot_state-ego_max0.03762842298627974
sim_compute_robot_state-ego_mean0.03704672146075372
sim_compute_robot_state-ego_median0.03710156335880619
sim_compute_robot_state-ego_min0.03645615319947939
sim_compute_robot_state-npc0_max0.037023700986589705
sim_compute_robot_state-npc0_mean0.03597181587207342
sim_compute_robot_state-npc0_median0.036023574906426506
sim_compute_robot_state-npc0_min0.03555477478287437
sim_compute_robot_state-npc1_max0.03657564889817011
sim_compute_robot_state-npc1_mean0.03589380312860976
sim_compute_robot_state-npc1_median0.03586632926184852
sim_compute_robot_state-npc1_min0.03514311169133042
sim_compute_robot_state-npc2_max0.03681977907816569
sim_compute_robot_state-npc2_mean0.035785322546639346
sim_compute_robot_state-npc2_median0.03582440840231406
sim_compute_robot_state-npc2_min0.035136261501827755
sim_compute_robot_state-npc3_max0.03647822718466482
sim_compute_robot_state-npc3_mean0.035687375203946964
sim_compute_robot_state-npc3_median0.03562343865633011
sim_compute_robot_state-npc3_min0.03522409619511785
sim_compute_sim_state_max0.020835985456194195
sim_compute_sim_state_mean0.020177724845279486
sim_compute_sim_state_median0.02013089130451153
sim_compute_sim_state_min0.01981769095767628
sim_physics_max0.08800168939538904
sim_physics_mean0.07826476235922221
sim_physics_median0.07681906223297119
sim_physics_min0.07417537518684438
sim_render-ego_max0.03885068744421005
sim_render-ego_mean0.03300834171049445
sim_render-ego_median0.032596987836501175
sim_render-ego_min0.032016566305449516
simulation-passed1
survival_time_max9.55
survival_time_mean3.939999999999995
survival_time_min1.5500000000000007
No reset possible
229682448Nicky EichmannBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:58:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.355676207214709
survival_time_median14.950000000000076
deviation-center-line_median1.002134440312669
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.08804394324620565
agent_compute-ego_mean0.08726267194747923
agent_compute-ego_median0.08715522289276123
agent_compute-ego_min0.08640182971954345
deviation-center-line_max1.5296442653166566
deviation-center-line_mean0.8536767524476552
deviation-center-line_min0.2656525762859935
deviation-heading_max8.682256325592228
deviation-heading_mean6.927230740477735
deviation-heading_median7.090641611385013
deviation-heading_min5.52174661383955
driven_any_max4.378506444052824
driven_any_mean4.378506444052809
driven_any_median4.378506444052808
driven_any_min4.378506444052796
driven_lanedir_consec_max-1.2728379671211965
driven_lanedir_consec_mean-1.352643582087815
driven_lanedir_consec_min-1.388190292394527
driven_lanedir_max-1.3477913186786226
driven_lanedir_mean-2.005867861365606
driven_lanedir_median-2.260637650975249
driven_lanedir_min-2.7253255736285684
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean4.9200000000000275
in-drivable-lane_min2.100000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.06691507339477538, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.0320353372891744, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.08773498217264811, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.04895198663075765, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.019980932076772057, "sim_compute_performance-ego": 0.034768020311991374, "sim_compute_robot_state-ego": 0.0368092155456543, "sim_compute_robot_state-npc0": 0.03571815331776937, "sim_compute_robot_state-npc1": 0.03559604485829671, "sim_compute_robot_state-npc2": 0.03534209410349528, "sim_compute_robot_state-npc3": 0.03534570058186849}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.06592342217763265, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.03232653458913167, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.08760421673456828, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.049942440191904705, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.020406312147776287, "sim_compute_performance-ego": 0.035073644320170086, "sim_compute_robot_state-ego": 0.03683694839477539, "sim_compute_robot_state-npc0": 0.03574262301127116, "sim_compute_robot_state-npc1": 0.035724650224049886, "sim_compute_robot_state-npc2": 0.03557552099227905, "sim_compute_robot_state-npc3": 0.03576503992080689}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.06603608290354411, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.03230990489323934, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.08695316394170126, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.048811421394348145, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.020166085561116535, "sim_compute_performance-ego": 0.034819173812866214, "sim_compute_robot_state-ego": 0.03656471093495687, "sim_compute_robot_state-npc0": 0.03628172477086385, "sim_compute_robot_state-npc1": 0.03566601435343424, "sim_compute_robot_state-npc2": 0.035728437105814616, "sim_compute_robot_state-npc3": 0.0355171545346578}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.0675003719329834, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.03248183886210124, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.08791068077087402, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.04991426467895508, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.020283076763153076, "sim_compute_performance-ego": 0.03513687372207642, "sim_compute_robot_state-ego": 0.03665859619776408, "sim_compute_robot_state-npc0": 0.03604266007741292, "sim_compute_robot_state-npc1": 0.03588028907775879, "sim_compute_robot_state-npc2": 0.03555025815963745, "sim_compute_robot_state-npc3": 0.03566125392913819}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.06647817691167196, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.03240268309911092, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.08804394324620565, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.049210122426350915, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.0202068829536438, "sim_compute_performance-ego": 0.03479743719100952, "sim_compute_robot_state-ego": 0.03665672620137533, "sim_compute_robot_state-npc0": 0.03564338604609171, "sim_compute_robot_state-npc1": 0.03575398921966553, "sim_compute_robot_state-npc2": 0.035478333632151283, "sim_compute_robot_state-npc3": 0.0355373485883077}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.378506444052811, "sim_physics": 0.06545099258422851, "survival_time": 14.950000000000076, "driven_lanedir": -2.608509993180694, "sim_render-ego": 0.03185211737950643, "in-drivable-lane": 2.5500000000000136, "agent_compute-ego": 0.08640182971954345, "deviation-heading": 8.07296329712472, "set_robot_commands": 0.049461113611857094, "deviation-center-line": 1.3867682469030311, "driven_lanedir_consec": -1.388190292394527, "sim_compute_sim_state": 0.020181787808736164, "sim_compute_performance-ego": 0.034665056069691974, "sim_compute_robot_state-ego": 0.03654384692509969, "sim_compute_robot_state-npc0": 0.035563241640726724, "sim_compute_robot_state-npc1": 0.03565384308497111, "sim_compute_robot_state-npc2": 0.0352836012840271, "sim_compute_robot_state-npc3": 0.03542617638905843}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.378506444052805, "sim_physics": 0.06692968606948853, "survival_time": 14.950000000000076, "driven_lanedir": -1.355676207214709, "sim_render-ego": 0.031893750031789146, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.08707944711049398, "deviation-heading": 5.863437531793397, "set_robot_commands": 0.0486759090423584, "deviation-center-line": 0.2923561535172491, "driven_lanedir_consec": -1.355676207214709, "sim_compute_sim_state": 0.020210254987080893, "sim_compute_performance-ego": 0.03518201430638631, "sim_compute_robot_state-ego": 0.03665552775065104, "sim_compute_robot_state-npc0": 0.03562407811482748, "sim_compute_robot_state-npc1": 0.03645795583724976, "sim_compute_robot_state-npc2": 0.035356604258219404, "sim_compute_robot_state-npc3": 0.035545984109242756}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.378506444052796, "sim_physics": 0.0661188260714213, "survival_time": 14.950000000000076, "driven_lanedir": -1.377653082196022, "sim_render-ego": 0.032050597667694095, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.08796389738718668, "deviation-heading": 5.826000672384985, "set_robot_commands": 0.0491202187538147, "deviation-center-line": 0.28890677730047676, "driven_lanedir_consec": -1.377653082196022, "sim_compute_sim_state": 0.020187315940856935, "sim_compute_performance-ego": 0.03487899621327718, "sim_compute_robot_state-ego": 0.03681859413782756, "sim_compute_robot_state-npc0": 0.03570538520812988, "sim_compute_robot_state-npc1": 0.036769155661265054, "sim_compute_robot_state-npc2": 0.03545811494191488, "sim_compute_robot_state-npc3": 0.03562698443730672}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.378506444052807, "sim_physics": 0.06536930958429972, "survival_time": 14.950000000000076, "driven_lanedir": -2.4543552110962836, "sim_render-ego": 0.03206898132960002, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.08663775126139323, "deviation-heading": 7.285030095349859, "set_robot_commands": 0.04865646918614706, "deviation-center-line": 1.16426495230065, "driven_lanedir_consec": -1.3837301815284158, "sim_compute_sim_state": 0.02010954777399699, "sim_compute_performance-ego": 0.03476674159367879, "sim_compute_robot_state-ego": 0.03670417388280233, "sim_compute_robot_state-npc0": 0.03544912020365397, "sim_compute_robot_state-npc1": 0.035543406009674074, "sim_compute_robot_state-npc2": 0.035284396012624106, "sim_compute_robot_state-npc3": 0.03549855470657349}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.378506444052819, "sim_physics": 0.06676714102427164, "survival_time": 14.950000000000076, "driven_lanedir": -2.59861542380514, "sim_render-ego": 0.03214550574620565, "in-drivable-lane": 2.250000000000013, "agent_compute-ego": 0.0869089968999227, "deviation-heading": 8.682256325592228, "set_robot_commands": 0.04901083469390869, "deviation-center-line": 1.4641409944409558, "driven_lanedir_consec": -1.339457603752913, "sim_compute_sim_state": 0.02038749059041341, "sim_compute_performance-ego": 0.03495707591374715, "sim_compute_robot_state-ego": 0.03751779635747274, "sim_compute_robot_state-npc0": 0.03550026257832845, "sim_compute_robot_state-npc1": 0.035844080448150635, "sim_compute_robot_state-npc2": 0.035581978956858315, "sim_compute_robot_state-npc3": 0.035668092568715414}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.378506444052819, "sim_physics": 0.06567803223927816, "survival_time": 14.950000000000076, "driven_lanedir": -2.487619304575852, "sim_render-ego": 0.032221238613128665, "in-drivable-lane": 3.150000000000018, "agent_compute-ego": 0.08742235024770101, "deviation-heading": 7.680289782334559, "set_robot_commands": 0.04925671259562175, "deviation-center-line": 1.2605671921446628, "driven_lanedir_consec": -1.333456085292506, "sim_compute_sim_state": 0.020126797358194982, "sim_compute_performance-ego": 0.03469544410705566, "sim_compute_robot_state-ego": 0.036454696655273434, "sim_compute_robot_state-npc0": 0.03552056392033895, "sim_compute_robot_state-npc1": 0.03564504861831665, "sim_compute_robot_state-npc2": 0.03543694734573364, "sim_compute_robot_state-npc3": 0.035484859943389895}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.378506444052808, "sim_physics": 0.06600751717885335, "survival_time": 14.950000000000076, "driven_lanedir": -1.3477913186786226, "sim_render-ego": 0.032186501026153565, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.0867678173383077, "deviation-heading": 5.52174661383955, "set_robot_commands": 0.048815788427988685, "deviation-center-line": 0.26627156834437943, "driven_lanedir_consec": -1.3477913186786226, "sim_compute_sim_state": 0.02021359364191691, "sim_compute_performance-ego": 0.03477487881978353, "sim_compute_robot_state-ego": 0.03674472411473592, "sim_compute_robot_state-npc0": 0.03560601313908895, "sim_compute_robot_state-npc1": 0.035868821938832604, "sim_compute_robot_state-npc2": 0.03537476857503255, "sim_compute_robot_state-npc3": 0.035578418572743735}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.378506444052802, "sim_physics": 0.06662119626998901, "survival_time": 14.950000000000076, "driven_lanedir": -2.7253255736285684, "sim_render-ego": 0.0322514812151591, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.08749290704727172, "deviation-heading": 8.383960965716458, "set_robot_commands": 0.04887799580891927, "deviation-center-line": 1.5198553376845148, "driven_lanedir_consec": -1.3654612749893655, "sim_compute_sim_state": 0.020183809598286948, "sim_compute_performance-ego": 0.034828532536824545, "sim_compute_robot_state-ego": 0.03672581434249878, "sim_compute_robot_state-npc0": 0.03559701124827067, "sim_compute_robot_state-npc1": 0.03663534879684448, "sim_compute_robot_state-npc2": 0.03549665451049805, "sim_compute_robot_state-npc3": 0.035417293707529704}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.378506444052804, "sim_physics": 0.06569416046142579, "survival_time": 14.950000000000076, "driven_lanedir": -1.3543489995592757, "sim_render-ego": 0.03226106961568197, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.08715522289276123, "deviation-heading": 5.531556420749436, "set_robot_commands": 0.04868130286534627, "deviation-center-line": 0.2656525762859935, "driven_lanedir_consec": -1.3543489995592757, "sim_compute_sim_state": 0.020106682777404784, "sim_compute_performance-ego": 0.03493185838063558, "sim_compute_robot_state-ego": 0.03669173081715902, "sim_compute_robot_state-npc0": 0.035437649885813396, "sim_compute_robot_state-npc1": 0.035773420333862306, "sim_compute_robot_state-npc2": 0.03529057661692302, "sim_compute_robot_state-npc3": 0.035618983904520674}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.378506444052808, "sim_physics": 0.06480865955352783, "survival_time": 14.950000000000076, "driven_lanedir": -1.3871236758121115, "sim_render-ego": 0.03216062148412069, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.0868628724416097, "deviation-heading": 5.569918191698341, "set_robot_commands": 0.0488236403465271, "deviation-center-line": 0.26950853351829485, "driven_lanedir_consec": -1.3871236758121115, "sim_compute_sim_state": 0.020078457991282144, "sim_compute_performance-ego": 0.03492203632990519, "sim_compute_robot_state-ego": 0.036640957196553546, "sim_compute_robot_state-npc0": 0.03551154295603434, "sim_compute_robot_state-npc1": 0.035988214015960696, "sim_compute_robot_state-npc2": 0.03572889407475789, "sim_compute_robot_state-npc3": 0.035588428179423016}}
set_robot_commands_max0.049942440191904705
set_robot_commands_mean0.04908068137698704
set_robot_commands_median0.04895198663075765
set_robot_commands_min0.04865646918614706
sim_compute_performance-ego_max0.03518201430638631
sim_compute_performance-ego_mean0.034879852241939964
sim_compute_performance-ego_median0.034828532536824545
sim_compute_performance-ego_min0.034665056069691974
sim_compute_robot_state-ego_max0.03751779635747274
sim_compute_robot_state-ego_mean0.03673493729697334
sim_compute_robot_state-ego_median0.03669173081715902
sim_compute_robot_state-ego_min0.036454696655273434
sim_compute_robot_state-npc0_max0.03628172477086385
sim_compute_robot_state-npc0_mean0.035662894407908124
sim_compute_robot_state-npc0_median0.03560601313908895
sim_compute_robot_state-npc0_min0.035437649885813396
sim_compute_robot_state-npc1_max0.036769155661265054
sim_compute_robot_state-npc1_mean0.03592001883188883
sim_compute_robot_state-npc1_median0.035773420333862306
sim_compute_robot_state-npc1_min0.035543406009674074
sim_compute_robot_state-npc2_max0.03572889407475789
sim_compute_robot_state-npc2_mean0.035464478704664446
sim_compute_robot_state-npc2_median0.03545811494191488
sim_compute_robot_state-npc2_min0.0352836012840271
sim_compute_robot_state-npc3_max0.03576503992080689
sim_compute_robot_state-npc3_mean0.035552018271552195
sim_compute_robot_state-npc3_median0.035545984109242756
sim_compute_robot_state-npc3_min0.03534570058186849
sim_compute_sim_state_max0.020406312147776287
sim_compute_sim_state_mean0.020188601864708795
sim_compute_sim_state_median0.020183809598286948
sim_compute_sim_state_min0.019980932076772057
sim_physics_max0.0675003719329834
sim_physics_mean0.06615324322382608
sim_physics_median0.06603608290354411
sim_physics_min0.06480865955352783
sim_render-ego_max0.03248183886210124
sim_render-ego_mean0.03217654418945312
sim_render-ego_median0.032186501026153565
sim_render-ego_min0.03185211737950643
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
229632452Liam Paull 🇨🇦Baseline solution using ROSaido2-LF-sim-testingstep1-simulationerroryesnutonomy-P50-97470:01:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229602459Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerroryesnutonomy-P50-97470:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229592463Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerroryesnutonomy-P50-97470:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229582464Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFVI-sim-validationstep1-simulationerroryesnutonomy-P50-97470:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229372496Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationsuccessyesnutonomy-P50-97470:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18462163174115975
survival_time_median1.4000000000000006
deviation-center-line_median0.10242050828714276
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0918498577610139
agent_compute-ego_mean0.0877973462151516
agent_compute-ego_median0.0870335266507905
agent_compute-ego_min0.08591562968034011
deviation-center-line_max0.12388456028300555
deviation-center-line_mean0.09961552829332249
deviation-center-line_min0.06292184880895119
deviation-heading_max0.9961070879711966
deviation-heading_mean0.691725876684593
deviation-heading_median0.7407725106573577
deviation-heading_min0.4114779821994308
driven_any_max0.2521476033920123
driven_any_mean0.2138777757498796
driven_any_median0.2232733064885143
driven_any_min0.16067815824576104
driven_lanedir_consec_max0.20422993493719543
driven_lanedir_consec_mean0.1612975228306234
driven_lanedir_consec_min0.1099402554110811
driven_lanedir_max0.20422993493719543
driven_lanedir_mean0.1612975228306234
driven_lanedir_median0.18462163174115975
driven_lanedir_min0.1099402554110811
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.010000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2521476033920123, "sim_physics": 0.07526690729202763, "survival_time": 1.5500000000000007, "driven_lanedir": 0.18462163174115975, "sim_render-ego": 0.03263758843944919, "in-drivable-lane": 0, "agent_compute-ego": 0.0918498577610139, "deviation-heading": 0.851950795271246, "set_robot_commands": 0.05013842736521075, "deviation-center-line": 0.10242050828714276, "driven_lanedir_consec": 0.18462163174115975, "sim_compute_sim_state": 0.020666014763616743, "sim_compute_performance-ego": 0.03527385957779423, "sim_compute_robot_state-ego": 0.03692400070928758, "sim_compute_robot_state-npc0": 0.0360320306593372, "sim_compute_robot_state-npc1": 0.0356013544144169, "sim_compute_robot_state-npc2": 0.03537808695147114, "sim_compute_robot_state-npc3": 0.03559207147167575}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19365533008821492, "sim_physics": 0.06972313844240628, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11143334839777096, "sim_render-ego": 0.031462788581848145, "in-drivable-lane": 0, "agent_compute-ego": 0.08591562968034011, "deviation-heading": 0.9961070879711966, "set_robot_commands": 0.04872022225306584, "deviation-center-line": 0.08673331400608461, "driven_lanedir_consec": 0.11143334839777096, "sim_compute_sim_state": 0.020786505479079027, "sim_compute_performance-ego": 0.035025138121384844, "sim_compute_robot_state-ego": 0.03679655148432805, "sim_compute_robot_state-npc0": 0.03546291131239671, "sim_compute_robot_state-npc1": 0.035904416671166055, "sim_compute_robot_state-npc2": 0.03574784902425913, "sim_compute_robot_state-npc3": 0.036683119260347806}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23963448053489536, "sim_physics": 0.07407041253714726, "survival_time": 1.4500000000000006, "driven_lanedir": 0.20422993493719543, "sim_render-ego": 0.03266346865686877, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0870335266507905, "deviation-heading": 0.4114779821994308, "set_robot_commands": 0.049198380832014416, "deviation-center-line": 0.12388456028300555, "driven_lanedir_consec": 0.20422993493719543, "sim_compute_sim_state": 0.020156745252938105, "sim_compute_performance-ego": 0.03547442370447619, "sim_compute_robot_state-ego": 0.03726058992846259, "sim_compute_robot_state-npc0": 0.03607349560178559, "sim_compute_robot_state-npc1": 0.03683723252395104, "sim_compute_robot_state-npc2": 0.03568990477200212, "sim_compute_robot_state-npc3": 0.03604187636539854}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2232733064885143, "sim_physics": 0.078384986945561, "survival_time": 1.4000000000000006, "driven_lanedir": 0.19626244366590972, "sim_render-ego": 0.032181807926722934, "in-drivable-lane": 0, "agent_compute-ego": 0.08729584727968488, "deviation-heading": 0.45832100732373365, "set_robot_commands": 0.05292860099247524, "deviation-center-line": 0.1221174100814283, "driven_lanedir_consec": 0.19626244366590972, "sim_compute_sim_state": 0.0202486515045166, "sim_compute_performance-ego": 0.03467951502118792, "sim_compute_robot_state-ego": 0.036733780588422506, "sim_compute_robot_state-npc0": 0.03607603481837681, "sim_compute_robot_state-npc1": 0.03549815075738089, "sim_compute_robot_state-npc2": 0.03573700359889439, "sim_compute_robot_state-npc3": 0.03577016932623727}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16067815824576104, "sim_physics": 0.07047385970751445, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1099402554110811, "sim_render-ego": 0.03201073408126831, "in-drivable-lane": 0, "agent_compute-ego": 0.08689186970392863, "deviation-heading": 0.7407725106573577, "set_robot_commands": 0.053324749072392784, "deviation-center-line": 0.06292184880895119, "driven_lanedir_consec": 0.1099402554110811, "sim_compute_sim_state": 0.020307868719100952, "sim_compute_performance-ego": 0.03475903471310934, "sim_compute_robot_state-ego": 0.036930590867996216, "sim_compute_robot_state-npc0": 0.03577272097269694, "sim_compute_robot_state-npc1": 0.035823434591293335, "sim_compute_robot_state-npc2": 0.03545685609181722, "sim_compute_robot_state-npc3": 0.03616296251614889}}
set_robot_commands_max0.053324749072392784
set_robot_commands_mean0.05086207610303181
set_robot_commands_median0.05013842736521075
set_robot_commands_min0.04872022225306584
sim_compute_performance-ego_max0.03547442370447619
sim_compute_performance-ego_mean0.035042394227590506
sim_compute_performance-ego_median0.035025138121384844
sim_compute_performance-ego_min0.03467951502118792
sim_compute_robot_state-ego_max0.03726058992846259
sim_compute_robot_state-ego_mean0.03692910271569939
sim_compute_robot_state-ego_median0.03692400070928758
sim_compute_robot_state-ego_min0.036733780588422506
sim_compute_robot_state-npc0_max0.03607603481837681
sim_compute_robot_state-npc0_mean0.03588343867291865
sim_compute_robot_state-npc0_median0.0360320306593372
sim_compute_robot_state-npc0_min0.03546291131239671
sim_compute_robot_state-npc1_max0.03683723252395104
sim_compute_robot_state-npc1_mean0.03593291779164164
sim_compute_robot_state-npc1_median0.035823434591293335
sim_compute_robot_state-npc1_min0.03549815075738089
sim_compute_robot_state-npc2_max0.03574784902425913
sim_compute_robot_state-npc2_mean0.035601940087688806
sim_compute_robot_state-npc2_median0.03568990477200212
sim_compute_robot_state-npc2_min0.03537808695147114
sim_compute_robot_state-npc3_max0.036683119260347806
sim_compute_robot_state-npc3_mean0.03605003978796165
sim_compute_robot_state-npc3_median0.03604187636539854
sim_compute_robot_state-npc3_min0.03559207147167575
sim_compute_sim_state_max0.020786505479079027
sim_compute_sim_state_mean0.02043315714385029
sim_compute_sim_state_median0.020307868719100952
sim_compute_sim_state_min0.020156745252938105
sim_physics_max0.078384986945561
sim_physics_mean0.07358386098493133
sim_physics_median0.07407041253714726
sim_physics_min0.06972313844240628
sim_render-ego_max0.03266346865686877
sim_render-ego_mean0.03219127753723147
sim_render-ego_median0.032181807926722934
sim_render-ego_min0.031462788581848145
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3800000000000006
survival_time_min1.2000000000000004
No reset possible
229302505Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerroryesnutonomy-P50-97470:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228992555Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:17:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.03742229496991193
agent_compute-ego_mean0.03638843934469992
agent_compute-ego_median0.03618979921527937
agent_compute-ego_min0.035584424817284875
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.08035716091293886, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.033124561769416534, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.03629562366439635, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.04968200534223074, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.02012667311243264, "sim_compute_performance-ego": 0.035464913012033486, "sim_compute_robot_state-ego": 0.03670555999480098, "sim_compute_robot_state-npc0": 0.036115198250276495, "sim_compute_robot_state-npc1": 0.035699591579207456, "sim_compute_robot_state-npc2": 0.035554067198052465, "sim_compute_robot_state-npc3": 0.03559443462325866}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.08102898244504575, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.03292521723994502, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03742229496991193, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.0495759646097819, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.0200940591317636, "sim_compute_performance-ego": 0.034829016085024235, "sim_compute_robot_state-ego": 0.03654141779299135, "sim_compute_robot_state-npc0": 0.03691785423843949, "sim_compute_robot_state-npc1": 0.035407949376989295, "sim_compute_robot_state-npc2": 0.03579236842967846, "sim_compute_robot_state-npc3": 0.03599068853590223}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.08541112679701585, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.03318473925957313, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.03701631533793914, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.04960502416659624, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.02023177880507249, "sim_compute_performance-ego": 0.03534883107894506, "sim_compute_robot_state-ego": 0.037145556547702886, "sim_compute_robot_state-npc0": 0.0360112067980644, "sim_compute_robot_state-npc1": 0.03599198659261068, "sim_compute_robot_state-npc2": 0.03587466631180201, "sim_compute_robot_state-npc3": 0.03572233823629526}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.08158576697633978, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.032063676599870646, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.036123271574053845, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.04996559494420102, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.02051862080891927, "sim_compute_performance-ego": 0.03502932766027618, "sim_compute_robot_state-ego": 0.03726878500821298, "sim_compute_robot_state-npc0": 0.03603535786009671, "sim_compute_robot_state-npc1": 0.03562447062709875, "sim_compute_robot_state-npc2": 0.035507331814682276, "sim_compute_robot_state-npc3": 0.03619996706644694}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.08198060160097868, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.03197870047196098, "in-drivable-lane": 0, "agent_compute-ego": 0.03628433269003163, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.049159817073656166, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.01976142758908479, "sim_compute_performance-ego": 0.034766072812287704, "sim_compute_robot_state-ego": 0.036811631658802864, "sim_compute_robot_state-npc0": 0.0351786820784859, "sim_compute_robot_state-npc1": 0.03617349914882494, "sim_compute_robot_state-npc2": 0.035586916882058846, "sim_compute_robot_state-npc3": 0.035502381946729576}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.08073924569522634, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.03248116783067292, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.03599894981758267, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.05010882078432569, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.020437993255316044, "sim_compute_performance-ego": 0.03527142487320246, "sim_compute_robot_state-ego": 0.03728824970768947, "sim_compute_robot_state-npc0": 0.036380704711465275, "sim_compute_robot_state-npc1": 0.03583891718995338, "sim_compute_robot_state-npc2": 0.03576194538789637, "sim_compute_robot_state-npc3": 0.035927195175021305}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.07922847781862531, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.03256455319268363, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.036003969396863664, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.05034008877617972, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.01994077478136335, "sim_compute_performance-ego": 0.034859599385942734, "sim_compute_robot_state-ego": 0.036635584490639826, "sim_compute_robot_state-npc0": 0.03551873649869646, "sim_compute_robot_state-npc1": 0.03626098121915545, "sim_compute_robot_state-npc2": 0.03612312759671892, "sim_compute_robot_state-npc3": 0.035678916318075994}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.08417885924038822, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.033338608807080415, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.036171178295187754, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.048654706510778974, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.02019320448783979, "sim_compute_performance-ego": 0.03470016179019458, "sim_compute_robot_state-ego": 0.03662954617853034, "sim_compute_robot_state-npc0": 0.03585578970713158, "sim_compute_robot_state-npc1": 0.03622668410000736, "sim_compute_robot_state-npc2": 0.035563341558796084, "sim_compute_robot_state-npc3": 0.03537048052435052}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.07614908939184145, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.03238085813300554, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.035584424817284875, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.04925437860710676, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.02023070634797562, "sim_compute_performance-ego": 0.03496678485426792, "sim_compute_robot_state-ego": 0.03726999704227891, "sim_compute_robot_state-npc0": 0.036080948142118235, "sim_compute_robot_state-npc1": 0.035573890042859456, "sim_compute_robot_state-npc2": 0.035724426424780555, "sim_compute_robot_state-npc3": 0.03547574198523233}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.0902637059871967, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.034405763332660384, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03708419433006874, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.04944897614992582, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.020515955411470853, "sim_compute_performance-ego": 0.03589354111598088, "sim_compute_robot_state-ego": 0.03766464270078219, "sim_compute_robot_state-npc0": 0.03635778793921837, "sim_compute_robot_state-npc1": 0.03625757877643292, "sim_compute_robot_state-npc2": 0.03604723856999324, "sim_compute_robot_state-npc3": 0.03682374954223633}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.07627735455830892, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.0331515375773112, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.03578185717264811, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.05011655489603679, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.02048972447713216, "sim_compute_performance-ego": 0.03607481320699056, "sim_compute_robot_state-ego": 0.03696616808573405, "sim_compute_robot_state-npc0": 0.03663914362589518, "sim_compute_robot_state-npc1": 0.035787041982014975, "sim_compute_robot_state-npc2": 0.03595687866210937, "sim_compute_robot_state-npc3": 0.03647539774576823}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.08107545262291319, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.03523479189191546, "in-drivable-lane": 0, "agent_compute-ego": 0.0366175061180478, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.04895338558015369, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.0201894896371024, "sim_compute_performance-ego": 0.03483440762474423, "sim_compute_robot_state-ego": 0.03691003436133975, "sim_compute_robot_state-npc0": 0.036101182301839195, "sim_compute_robot_state-npc1": 0.03586201440720331, "sim_compute_robot_state-npc2": 0.03554148901076544, "sim_compute_robot_state-npc3": 0.035480101903279625}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.08145460971566133, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.03230021166246991, "in-drivable-lane": 1.15, "agent_compute-ego": 0.036010187725688134, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.049340259197146394, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.02007085223530614, "sim_compute_performance-ego": 0.03510226205337879, "sim_compute_robot_state-ego": 0.03774099017298499, "sim_compute_robot_state-npc0": 0.035571270210798395, "sim_compute_robot_state-npc1": 0.03568903789963833, "sim_compute_robot_state-npc2": 0.03596586959306584, "sim_compute_robot_state-npc3": 0.035720841829166856}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.07910509620394025, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.033354265349251885, "in-drivable-lane": 0, "agent_compute-ego": 0.03724268504551479, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.04872101545333862, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.020237437316349575, "sim_compute_performance-ego": 0.03456952742167881, "sim_compute_robot_state-ego": 0.03654638358524868, "sim_compute_robot_state-npc0": 0.03564871209008353, "sim_compute_robot_state-npc1": 0.03666795151574271, "sim_compute_robot_state-npc2": 0.03581427676337106, "sim_compute_robot_state-npc3": 0.03531798294612339}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.08990004950878668, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.03241805936775956, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.03618979921527937, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.0500799861608767, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.02028620944303625, "sim_compute_performance-ego": 0.03464384172476974, "sim_compute_robot_state-ego": 0.03777953690173579, "sim_compute_robot_state-npc0": 0.03697453760633282, "sim_compute_robot_state-npc1": 0.035994221182430494, "sim_compute_robot_state-npc2": 0.03542656991996017, "sim_compute_robot_state-npc3": 0.03537311273462632}}
set_robot_commands_max0.05034008877617972
set_robot_commands_mean0.049533771883489015
set_robot_commands_median0.0495759646097819
set_robot_commands_min0.048654706510778974
sim_compute_performance-ego_max0.03607481320699056
sim_compute_performance-ego_mean0.03509030164664782
sim_compute_performance-ego_median0.03496678485426792
sim_compute_performance-ego_min0.03456952742167881
sim_compute_robot_state-ego_max0.03777953690173579
sim_compute_robot_state-ego_mean0.037060272281965
sim_compute_robot_state-ego_median0.03696616808573405
sim_compute_robot_state-ego_min0.03654141779299135
sim_compute_robot_state-npc0_max0.03697453760633282
sim_compute_robot_state-npc0_mean0.036092474137262805
sim_compute_robot_state-npc0_median0.036080948142118235
sim_compute_robot_state-npc0_min0.0351786820784859
sim_compute_robot_state-npc1_max0.03666795151574271
sim_compute_robot_state-npc1_mean0.03593705437601131
sim_compute_robot_state-npc1_median0.03586201440720331
sim_compute_robot_state-npc1_min0.035407949376989295
sim_compute_robot_state-npc2_max0.03612312759671892
sim_compute_robot_state-npc2_mean0.03574936760824874
sim_compute_robot_state-npc2_median0.03576194538789637
sim_compute_robot_state-npc2_min0.03542656991996017
sim_compute_robot_state-npc3_max0.03682374954223633
sim_compute_robot_state-npc3_mean0.03577688874083424
sim_compute_robot_state-npc3_median0.035678916318075994
sim_compute_robot_state-npc3_min0.03531798294612339
sim_compute_sim_state_max0.02051862080891927
sim_compute_sim_state_mean0.020221660456011
sim_compute_sim_state_median0.02023070634797562
sim_compute_sim_state_min0.01976142758908479
sim_physics_max0.0902637059871967
sim_physics_mean0.08191570529834717
sim_physics_median0.08107545262291319
sim_physics_min0.07614908939184145
sim_render-ego_max0.03523479189191546
sim_render-ego_mean0.03299378083237182
sim_render-ego_median0.03292521723994502
sim_render-ego_min0.03197870047196098
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
No reset possible
228892569Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessyesnutonomy-P50-97470:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4702323960536803
survival_time_median2.849999999999998
deviation-center-line_median0.13623952041905
in-drivable-lane_median0.7999999999999976


other stats
agent_compute-ego_max0.03779195877442877
agent_compute-ego_mean0.03681586798109114
agent_compute-ego_median0.037035801471808016
agent_compute-ego_min0.035714680688423026
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.16546426353561405
deviation-center-line_min0.07144385614371519
deviation-heading_max1.2111022380750738
deviation-heading_mean0.8262001110734373
deviation-heading_median0.7978002362162198
deviation-heading_min0.39989969254594865
driven_any_max1.093753441791869
driven_any_mean0.7182169120135662
driven_any_median0.8072381933001392
driven_any_min0.29795781475632777
driven_lanedir_consec_max0.6735785385729686
driven_lanedir_consec_mean0.4271077107010905
driven_lanedir_consec_min0.2312609677194346
driven_lanedir_max0.6758329617605024
driven_lanedir_mean0.4275585953385973
driven_lanedir_median0.4702323960536803
driven_lanedir_min0.2312609677194346
in-drivable-lane_max1.6499999999999957
in-drivable-lane_mean0.7199999999999979
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.08055917038974991, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0334306136671319, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.03779195877442877, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.05053520777139319, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.0206080545862037, "sim_compute_performance-ego": 0.03636457259396473, "sim_compute_robot_state-ego": 0.03748877938971462, "sim_compute_robot_state-npc0": 0.036684073597551825, "sim_compute_robot_state-npc1": 0.03617731347141496, "sim_compute_robot_state-npc2": 0.03640941252191383, "sim_compute_robot_state-npc3": 0.03649904354509101}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.08085169615568938, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.03390152366073043, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03748759516963252, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.04984658735769766, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.01988202554208261, "sim_compute_performance-ego": 0.03515081935458713, "sim_compute_robot_state-ego": 0.03711208590754756, "sim_compute_robot_state-npc0": 0.03536667647185149, "sim_compute_robot_state-npc1": 0.03545565958376284, "sim_compute_robot_state-npc2": 0.03602329889933268, "sim_compute_robot_state-npc3": 0.035760720570882164}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.08364306046412541, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.03340426775125357, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.037035801471808016, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.049314236029600486, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.02023207224332369, "sim_compute_performance-ego": 0.03491252813583765, "sim_compute_robot_state-ego": 0.03708287080128988, "sim_compute_robot_state-npc0": 0.03640468303973858, "sim_compute_robot_state-npc1": 0.03626149128644894, "sim_compute_robot_state-npc2": 0.03598411877950033, "sim_compute_robot_state-npc3": 0.03566101575509096}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.08188403698436, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.032592827813667166, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.035714680688423026, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.04929082017195852, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.020541027972572727, "sim_compute_performance-ego": 0.034901255055477746, "sim_compute_robot_state-ego": 0.03681282411541855, "sim_compute_robot_state-npc0": 0.03608720344409608, "sim_compute_robot_state-npc1": 0.03574798818220172, "sim_compute_robot_state-npc2": 0.035442076231303965, "sim_compute_robot_state-npc3": 0.03543125955682052}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.08179230275361435, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.032389412755551544, "in-drivable-lane": 0, "agent_compute-ego": 0.03604930380116338, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.048672416935796325, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.019954505174056343, "sim_compute_performance-ego": 0.034504330676534904, "sim_compute_robot_state-ego": 0.03714302311772886, "sim_compute_robot_state-npc0": 0.03553101290827212, "sim_compute_robot_state-npc1": 0.036603077598240066, "sim_compute_robot_state-npc2": 0.036380135494729744, "sim_compute_robot_state-npc3": 0.03550966926242994}}
set_robot_commands_max0.05053520777139319
set_robot_commands_mean0.04953185365328923
set_robot_commands_median0.049314236029600486
set_robot_commands_min0.048672416935796325
sim_compute_performance-ego_max0.03636457259396473
sim_compute_performance-ego_mean0.03516670116328043
sim_compute_performance-ego_median0.03491252813583765
sim_compute_performance-ego_min0.034504330676534904
sim_compute_robot_state-ego_max0.03748877938971462
sim_compute_robot_state-ego_mean0.0371279166663399
sim_compute_robot_state-ego_median0.03711208590754756
sim_compute_robot_state-ego_min0.03681282411541855
sim_compute_robot_state-npc0_max0.036684073597551825
sim_compute_robot_state-npc0_mean0.03601472989230202
sim_compute_robot_state-npc0_median0.03608720344409608
sim_compute_robot_state-npc0_min0.03536667647185149
sim_compute_robot_state-npc1_max0.036603077598240066
sim_compute_robot_state-npc1_mean0.036049106024413705
sim_compute_robot_state-npc1_median0.03617731347141496
sim_compute_robot_state-npc1_min0.03545565958376284
sim_compute_robot_state-npc2_max0.03640941252191383
sim_compute_robot_state-npc2_mean0.03604780838535611
sim_compute_robot_state-npc2_median0.03602329889933268
sim_compute_robot_state-npc2_min0.035442076231303965
sim_compute_robot_state-npc3_max0.03649904354509101
sim_compute_robot_state-npc3_mean0.035772341738062916
sim_compute_robot_state-npc3_median0.03566101575509096
sim_compute_robot_state-npc3_min0.03543125955682052
sim_compute_sim_state_max0.0206080545862037
sim_compute_sim_state_mean0.02024353710364781
sim_compute_sim_state_median0.02023207224332369
sim_compute_sim_state_min0.01988202554208261
sim_physics_max0.08364306046412541
sim_physics_mean0.08174605334950782
sim_physics_median0.08179230275361435
sim_physics_min0.08055917038974991
sim_render-ego_max0.03390152366073043
sim_render-ego_mean0.03314372912966693
sim_render-ego_median0.03340426775125357
sim_render-ego_min0.032389412755551544
simulation-passed1
survival_time_max4.149999999999993
survival_time_mean2.679999999999997
survival_time_min1.1500000000000004
No reset possible
228872574Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerroryesnutonomy-P50-97470:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228852577Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerroryesnutonomy-P50-97470:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228842578Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationhost-erroryesnutonomy-P50-97470:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 255, in _do_raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+ip4://127.0.0.1:5001/api/v0/swarm/connect?stream-channels=true&arg=%2Fip4%2F129.132.0.37%2Ftcp%2F4001%2Fipfs%2FQmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1151, in download_artefacts
    res = client.swarm_connect(peer)
  File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
    result = func(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/swarm.py", line 137, in connect
    return self._client.request('/swarm/connect', args, decoder='json', **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 286, in _request
    self._do_raise_for_status(res)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 273, in _do_raise_for_status
    six.raise_from(exceptions.ErrorResponse(msg, error), error)
  File "<string>", line 3, in raise_from
ipfshttpclient.exceptions.ErrorResponse: connect QmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9 failure: dial attempt failed: <peer.ID T35iPP> --> <peer.ID W5P8PZ> dial attempt failed: context deadline exceeded
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228822582Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationerroryesnutonomy-P50-97470:01:15
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228702601FANG MEIYI 🇸🇬baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyesnutonomy-P50-97470:12:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2047179735285702
survival_time_median14.950000000000076
deviation-center-line_median0.387887210596401
in-drivable-lane_median1.2999999999999998


other stats
agent_compute-ego_max0.08128599188793664
agent_compute-ego_mean0.08075380373153525
agent_compute-ego_median0.08055917819341024
agent_compute-ego_min0.0803881523877206
deviation-center-line_max0.7567448241113871
deviation-center-line_mean0.45188386673954273
deviation-center-line_min0.20973936054620676
deviation-heading_max2.730052148382567
deviation-heading_mean1.8316575392778272
deviation-heading_median1.6033474770558855
deviation-heading_min1.0827259728141294
driven_any_max3.1435521190582616
driven_any_mean2.439026555216875
driven_any_median2.7932338466706583
driven_any_min1.6032262160278477
driven_lanedir_consec_max3.128556391011591
driven_lanedir_consec_mean2.169636264922683
driven_lanedir_consec_min1.248590441428972
driven_lanedir_max3.128556391011591
driven_lanedir_mean2.1707743283451775
driven_lanedir_median2.2047179735285702
driven_lanedir_min1.2542807585414442
in-drivable-lane_max2.9999999999999893
in-drivable-lane_mean1.2799999999999978
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7932338466706583, "sim_physics": 0.03968904574712118, "survival_time": 14.950000000000076, "driven_lanedir": 2.2047179735285702, "sim_render-ego": 0.03284593343734741, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.08105300982793172, "deviation-heading": 2.4472602070364977, "set_robot_commands": 0.04948453267415365, "deviation-center-line": 0.5763065820447865, "driven_lanedir_consec": 2.2047179735285702, "sim_compute_sim_state": 0.020168079535166424, "sim_compute_performance-ego": 0.03507746934890747, "sim_compute_robot_state-ego": 0.03708443959554037}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1435521190582616, "sim_physics": 0.03766788085301717, "survival_time": 14.950000000000076, "driven_lanedir": 3.128556391011591, "sim_render-ego": 0.03181162118911743, "in-drivable-lane": 0, "agent_compute-ego": 0.08055917819341024, "deviation-heading": 1.2949018911000556, "set_robot_commands": 0.04910489479700724, "deviation-center-line": 0.387887210596401, "driven_lanedir_consec": 3.128556391011591, "sim_compute_sim_state": 0.020180350144704182, "sim_compute_performance-ego": 0.035196402072906495, "sim_compute_robot_state-ego": 0.03707608540852864}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9850147294870277, "sim_physics": 0.03953489065170288, "survival_time": 14.950000000000076, "driven_lanedir": 2.9618686891784956, "sim_render-ego": 0.03249676783879598, "in-drivable-lane": 0, "agent_compute-ego": 0.08048268636067708, "deviation-heading": 1.6033474770558855, "set_robot_commands": 0.050098876953125, "deviation-center-line": 0.7567448241113871, "driven_lanedir_consec": 2.9618686891784956, "sim_compute_sim_state": 0.020256613890329997, "sim_compute_performance-ego": 0.03530977090199788, "sim_compute_robot_state-ego": 0.036726176738739014}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6032262160278477, "sim_physics": 0.03830061287715517, "survival_time": 8.699999999999989, "driven_lanedir": 1.2542807585414442, "sim_render-ego": 0.03214742534462063, "in-drivable-lane": 1.2999999999999998, "agent_compute-ego": 0.08128599188793664, "deviation-heading": 2.730052148382567, "set_robot_commands": 0.049446906166515134, "deviation-center-line": 0.3287413563989324, "driven_lanedir_consec": 1.248590441428972, "sim_compute_sim_state": 0.020128447433997845, "sim_compute_performance-ego": 0.03529350236914624, "sim_compute_robot_state-ego": 0.03702182742370956}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6701058648405809, "sim_physics": 0.03935129966961562, "survival_time": 8.449999999999985, "driven_lanedir": 1.3044478294657864, "sim_render-ego": 0.032391845827271955, "in-drivable-lane": 2.0999999999999996, "agent_compute-ego": 0.0803881523877206, "deviation-heading": 1.0827259728141294, "set_robot_commands": 0.04934476395330486, "deviation-center-line": 0.20973936054620676, "driven_lanedir_consec": 1.3044478294657864, "sim_compute_sim_state": 0.02014771438914643, "sim_compute_performance-ego": 0.034906631390723954, "sim_compute_robot_state-ego": 0.037079389278705306}}
set_robot_commands_max0.050098876953125
set_robot_commands_mean0.04949599490882118
set_robot_commands_median0.049446906166515134
set_robot_commands_min0.04910489479700724
sim_compute_performance-ego_max0.03530977090199788
sim_compute_performance-ego_mean0.035156755216736404
sim_compute_performance-ego_median0.035196402072906495
sim_compute_performance-ego_min0.034906631390723954
sim_compute_robot_state-ego_max0.03708443959554037
sim_compute_robot_state-ego_mean0.03699758368904458
sim_compute_robot_state-ego_median0.03707608540852864
sim_compute_robot_state-ego_min0.036726176738739014
sim_compute_sim_state_max0.020256613890329997
sim_compute_sim_state_mean0.02017624107866898
sim_compute_sim_state_median0.020168079535166424
sim_compute_sim_state_min0.020128447433997845
sim_physics_max0.03968904574712118
sim_physics_mean0.0389087459597224
sim_physics_median0.03935129966961562
sim_physics_min0.03766788085301717
sim_render-ego_max0.03284593343734741
sim_render-ego_mean0.03233871872743068
sim_render-ego_median0.032391845827271955
sim_render-ego_min0.03181162118911743
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.400000000000045
survival_time_min8.449999999999985
No reset possible
228652609Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessyesnutonomy-P50-97470:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.5999999999999988
deviation-center-line_median0.16987818035809085
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.036033982322329565
agent_compute-ego_mean0.035580784577344954
agent_compute-ego_median0.03549784229647729
agent_compute-ego_min0.035384426654224664
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.14972083567701736
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.4280304166285303
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.2972979671834337
driven_any_mean0.7173901327940211
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max0.97716132702229
driven_lanedir_consec_mean0.5227475277218055
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max0.97716132702229
driven_lanedir_mean0.5227475277218055
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2407721645627201
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.5799999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.06425212470578476, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.03172797888097629, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.035384426654224664, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.05006741470014545, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.020184684807146094, "sim_compute_performance-ego": 0.035045623779296875, "sim_compute_robot_state-ego": 0.03666523476721535, "sim_compute_robot_state-npc0": 0.03584330518480758, "sim_compute_robot_state-npc1": 0.03535757266299825, "sim_compute_robot_state-npc2": 0.035563515945219656, "sim_compute_robot_state-npc3": 0.03558785814634511}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.07316749542951584, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.032245710492134094, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03554913401603699, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.04888872057199478, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.020513661205768585, "sim_compute_performance-ego": 0.03484707325696945, "sim_compute_robot_state-ego": 0.03649450093507767, "sim_compute_robot_state-npc0": 0.03744514286518097, "sim_compute_robot_state-npc1": 0.03577517718076706, "sim_compute_robot_state-npc2": 0.035743094980716705, "sim_compute_robot_state-npc3": 0.035655342042446136}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.07391206576273991, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.03258846814815815, "in-drivable-lane": 0, "agent_compute-ego": 0.03543853759765625, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.05111523316456722, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.020197882102085993, "sim_compute_performance-ego": 0.03460453106806828, "sim_compute_robot_state-ego": 0.03668263325324425, "sim_compute_robot_state-npc0": 0.03632806356136616, "sim_compute_robot_state-npc1": 0.036078498913691595, "sim_compute_robot_state-npc2": 0.03537161075151884, "sim_compute_robot_state-npc3": 0.035523249552800104}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.07106066006486134, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.03224970192037603, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.03549784229647729, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.05000109570000761, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.020966047881751933, "sim_compute_performance-ego": 0.03530040094929357, "sim_compute_robot_state-ego": 0.03710851361674647, "sim_compute_robot_state-npc0": 0.03622047875517158, "sim_compute_robot_state-npc1": 0.03586344821478731, "sim_compute_robot_state-npc2": 0.036135768377652734, "sim_compute_robot_state-npc3": 0.03598164486628707}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.06928290639604841, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.0322984740847633, "in-drivable-lane": 0, "agent_compute-ego": 0.036033982322329565, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.048945097696213496, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.01988219079517183, "sim_compute_performance-ego": 0.035658677419026695, "sim_compute_robot_state-ego": 0.03672887030101958, "sim_compute_robot_state-npc0": 0.03588950066339402, "sim_compute_robot_state-npc1": 0.03622439929417202, "sim_compute_robot_state-npc2": 0.03554842585609073, "sim_compute_robot_state-npc3": 0.03567535536629813}}
set_robot_commands_max0.05111523316456722
set_robot_commands_mean0.04980351236658571
set_robot_commands_median0.05000109570000761
set_robot_commands_min0.04888872057199478
sim_compute_performance-ego_max0.035658677419026695
sim_compute_performance-ego_mean0.03509126129453098
sim_compute_performance-ego_median0.035045623779296875
sim_compute_performance-ego_min0.03460453106806828
sim_compute_robot_state-ego_max0.03710851361674647
sim_compute_robot_state-ego_mean0.036735950574660656
sim_compute_robot_state-ego_median0.03668263325324425
sim_compute_robot_state-ego_min0.03649450093507767
sim_compute_robot_state-npc0_max0.03744514286518097
sim_compute_robot_state-npc0_mean0.03634529820598406
sim_compute_robot_state-npc0_median0.03622047875517158
sim_compute_robot_state-npc0_min0.03584330518480758
sim_compute_robot_state-npc1_max0.03622439929417202
sim_compute_robot_state-npc1_mean0.03585981925328324
sim_compute_robot_state-npc1_median0.03586344821478731
sim_compute_robot_state-npc1_min0.03535757266299825
sim_compute_robot_state-npc2_max0.036135768377652734
sim_compute_robot_state-npc2_mean0.03567248318223973
sim_compute_robot_state-npc2_median0.035563515945219656
sim_compute_robot_state-npc2_min0.03537161075151884
sim_compute_robot_state-npc3_max0.03598164486628707
sim_compute_robot_state-npc3_mean0.0356846899948353
sim_compute_robot_state-npc3_median0.035655342042446136
sim_compute_robot_state-npc3_min0.035523249552800104
sim_compute_sim_state_max0.020966047881751933
sim_compute_sim_state_mean0.020348893358384888
sim_compute_sim_state_median0.020197882102085993
sim_compute_sim_state_min0.01988219079517183
sim_physics_max0.07391206576273991
sim_physics_mean0.07033505047179005
sim_physics_median0.07106066006486134
sim_physics_min0.06425212470578476
sim_render-ego_max0.03258846814815815
sim_render-ego_mean0.03222206670528157
sim_render-ego_median0.03224970192037603
sim_render-ego_min0.03172797888097629
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean2.6899999999999973
survival_time_min1.0500000000000005
No reset possible
228292680Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:46:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8978797544254031
survival_time_median14.950000000000076
deviation-center-line_median0.9053887635539783
in-drivable-lane_median1.8500000000000183


other stats
agent_compute-ego_max0.0410152276357015
agent_compute-ego_mean0.03902189303630465
agent_compute-ego_median0.03871884584426879
agent_compute-ego_min0.038430514335632326
deviation-center-line_max1.1827260995852698
deviation-center-line_mean0.7986541810975463
deviation-center-line_min0.3265371245987829
deviation-heading_max7.287015811488866
deviation-heading_mean4.666623975752733
deviation-heading_median5.24216003320387
deviation-heading_min0.7992649948727001
driven_any_max2.349068078523283
driven_any_mean1.7996518530968126
driven_any_median2.34856485195945
driven_any_min0.6446759124755118
driven_lanedir_consec_max2.022275049294276
driven_lanedir_consec_mean0.9983701823540848
driven_lanedir_consec_min0.24750745880541647
driven_lanedir_max2.022275049294276
driven_lanedir_mean1.2452160723074783
driven_lanedir_median1.2939518100970635
driven_lanedir_min0.4639779886949782
in-drivable-lane_max4.600000000000008
in-drivable-lane_mean1.83666666666667
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6446759124755118, "sim_physics": 0.07152023476161314, "survival_time": 4.449999999999992, "driven_lanedir": 0.5085655977799672, "sim_render-ego": 0.03475114468778117, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04037911972303069, "deviation-heading": 1.4529882919224093, "set_robot_commands": 0.051434168654881166, "deviation-center-line": 0.3265371245987829, "driven_lanedir_consec": 0.5085655977799672, "sim_compute_sim_state": 0.021465130066603756, "sim_compute_performance-ego": 0.03671217232607723, "sim_compute_robot_state-ego": 0.0388655448227786, "sim_compute_robot_state-npc0": 0.037628476539354645, "sim_compute_robot_state-npc1": 0.037997476170572, "sim_compute_robot_state-npc2": 0.037983546096287416, "sim_compute_robot_state-npc3": 0.03745567396785436}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3486643617000205, "sim_physics": 0.07059879144032796, "survival_time": 14.950000000000076, "driven_lanedir": 1.6486043873428429, "sim_render-ego": 0.0341278338432312, "in-drivable-lane": 1.8500000000000183, "agent_compute-ego": 0.03871884584426879, "deviation-heading": 7.129794909194173, "set_robot_commands": 0.05224060455958048, "deviation-center-line": 0.9648410879914784, "driven_lanedir_consec": 1.241300151966395, "sim_compute_sim_state": 0.02162352164586385, "sim_compute_performance-ego": 0.037071423530578615, "sim_compute_robot_state-ego": 0.03855469783147176, "sim_compute_robot_state-npc0": 0.03772365172704061, "sim_compute_robot_state-npc1": 0.03797820011774699, "sim_compute_robot_state-npc2": 0.03778666734695434, "sim_compute_robot_state-npc3": 0.037799630959828696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3486169895288564, "sim_physics": 0.07009765227635702, "survival_time": 14.950000000000076, "driven_lanedir": 1.2939518100970635, "sim_render-ego": 0.0339020037651062, "in-drivable-lane": 3.6000000000000068, "agent_compute-ego": 0.03865463813145956, "deviation-heading": 7.287015811488866, "set_robot_commands": 0.05201335430145264, "deviation-center-line": 0.8795195010110861, "driven_lanedir_consec": 0.8589812116333073, "sim_compute_sim_state": 0.02135192632675171, "sim_compute_performance-ego": 0.037140968640645346, "sim_compute_robot_state-ego": 0.03826268513997396, "sim_compute_robot_state-npc0": 0.03766241312026977, "sim_compute_robot_state-npc1": 0.037969391345977786, "sim_compute_robot_state-npc2": 0.03790225505828857, "sim_compute_robot_state-npc3": 0.03786034901936849}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485874889438167, "sim_physics": 0.07178265810012817, "survival_time": 14.950000000000076, "driven_lanedir": 1.2931001153650192, "sim_render-ego": 0.033975416819254554, "in-drivable-lane": 4.600000000000008, "agent_compute-ego": 0.03949803511301676, "deviation-heading": 5.370937819382867, "set_robot_commands": 0.05218669732411702, "deviation-center-line": 1.006528047271139, "driven_lanedir_consec": 0.8939800674811287, "sim_compute_sim_state": 0.02141225814819336, "sim_compute_performance-ego": 0.037219637235005695, "sim_compute_robot_state-ego": 0.03861245393753051, "sim_compute_robot_state-npc0": 0.037773265838623046, "sim_compute_robot_state-npc1": 0.03796491543451945, "sim_compute_robot_state-npc2": 0.03787972132364909, "sim_compute_robot_state-npc3": 0.037599267164866126}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6454831015144277, "sim_physics": 0.06520662362548127, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6333644034153836, "sim_render-ego": 0.03432203709394082, "in-drivable-lane": 0, "agent_compute-ego": 0.038747395592174314, "deviation-heading": 0.7992649948727001, "set_robot_commands": 0.05194716892023196, "deviation-center-line": 0.3583495808721403, "driven_lanedir_consec": 0.6333644034153836, "sim_compute_sim_state": 0.0214436465296252, "sim_compute_performance-ego": 0.03692472118070756, "sim_compute_robot_state-ego": 0.038184683898399616, "sim_compute_robot_state-npc0": 0.03824785111964434, "sim_compute_robot_state-npc1": 0.037701946565474584, "sim_compute_robot_state-npc2": 0.03785560048859695, "sim_compute_robot_state-npc3": 0.03727758067777787}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.071188250223395, "sim_physics": 0.07013532263892037, "survival_time": 6.999999999999983, "driven_lanedir": 0.5566436956560228, "sim_render-ego": 0.03421661513192313, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.03853212084089007, "deviation-heading": 3.3917851165100856, "set_robot_commands": 0.05223367043903896, "deviation-center-line": 0.5658477439972391, "driven_lanedir_consec": 0.28889244118302204, "sim_compute_sim_state": 0.02150033371789115, "sim_compute_performance-ego": 0.03702266727175031, "sim_compute_robot_state-ego": 0.03955997228622436, "sim_compute_robot_state-npc0": 0.037786456516810826, "sim_compute_robot_state-npc1": 0.03810385465621948, "sim_compute_robot_state-npc2": 0.03775852067129953, "sim_compute_robot_state-npc3": 0.03770705461502075}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9106108218985782, "sim_physics": 0.07075324654579163, "survival_time": 5.999999999999987, "driven_lanedir": 0.8619235094803662, "sim_render-ego": 0.034204667806625365, "in-drivable-lane": 0, "agent_compute-ego": 0.03856101234753927, "deviation-heading": 1.4794498745455007, "set_robot_commands": 0.05223226348559062, "deviation-center-line": 0.4781765916297879, "driven_lanedir_consec": 0.8619235094803662, "sim_compute_sim_state": 0.021222678820292155, "sim_compute_performance-ego": 0.03742044369379679, "sim_compute_robot_state-ego": 0.038370126485824586, "sim_compute_robot_state-npc0": 0.038155738512674967, "sim_compute_robot_state-npc1": 0.03773999015490214, "sim_compute_robot_state-npc2": 0.03849217096964518, "sim_compute_robot_state-npc3": 0.03814038435618083}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.7658832312059227, "sim_physics": 0.07007530623791265, "survival_time": 5.09999999999999, "driven_lanedir": 0.4639779886949782, "sim_render-ego": 0.034153386658313224, "in-drivable-lane": 0.55, "agent_compute-ego": 0.0410152276357015, "deviation-heading": 2.9457570883426687, "set_robot_commands": 0.05136306379355636, "deviation-center-line": 0.4726268180199212, "driven_lanedir_consec": 0.24750745880541647, "sim_compute_sim_state": 0.021163631887996897, "sim_compute_performance-ego": 0.03677391772176705, "sim_compute_robot_state-ego": 0.0386196117775113, "sim_compute_robot_state-npc0": 0.0377655076045616, "sim_compute_robot_state-npc1": 0.03828177966323553, "sim_compute_robot_state-npc2": 0.03792843397925882, "sim_compute_robot_state-npc3": 0.03819968653660195}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3488046627326997, "sim_physics": 0.06894954919815063, "survival_time": 14.950000000000076, "driven_lanedir": 1.948707000596421, "sim_render-ego": 0.0339596144358317, "in-drivable-lane": 0.7000000000000031, "agent_compute-ego": 0.038630271752675374, "deviation-heading": 5.829305210448549, "set_robot_commands": 0.05206413427988688, "deviation-center-line": 1.1081301352868396, "driven_lanedir_consec": 1.4215317188111218, "sim_compute_sim_state": 0.02140802303949992, "sim_compute_performance-ego": 0.0367464025815328, "sim_compute_robot_state-ego": 0.03812904755274455, "sim_compute_robot_state-npc0": 0.037823726336161295, "sim_compute_robot_state-npc1": 0.037701642513275145, "sim_compute_robot_state-npc2": 0.037548521359761555, "sim_compute_robot_state-npc3": 0.03755371809005737}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.348675149610332, "sim_physics": 0.07312440554300945, "survival_time": 14.950000000000076, "driven_lanedir": 1.375361041512425, "sim_render-ego": 0.03416662931442261, "in-drivable-lane": 3.3000000000000114, "agent_compute-ego": 0.038430514335632326, "deviation-heading": 7.070502895800575, "set_robot_commands": 0.05176014423370361, "deviation-center-line": 0.787762859460344, "driven_lanedir_consec": 1.1917471920683638, "sim_compute_sim_state": 0.02143421729405721, "sim_compute_performance-ego": 0.03715886036554973, "sim_compute_robot_state-ego": 0.038602335453033446, "sim_compute_robot_state-npc0": 0.03778303225835165, "sim_compute_robot_state-npc1": 0.03799190203348795, "sim_compute_robot_state-npc2": 0.03770037015279134, "sim_compute_robot_state-npc3": 0.03789130846659342}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.349068078523283, "sim_physics": 0.0679710292816162, "survival_time": 14.950000000000076, "driven_lanedir": 1.8444163179922024, "sim_render-ego": 0.034144775072733564, "in-drivable-lane": 1.900000000000003, "agent_compute-ego": 0.0387628165880839, "deviation-heading": 5.24216003320387, "set_robot_commands": 0.05228164037068685, "deviation-center-line": 0.9985419346867458, "driven_lanedir_consec": 1.8444163179922024, "sim_compute_sim_state": 0.021434213320414227, "sim_compute_performance-ego": 0.03699474414189657, "sim_compute_robot_state-ego": 0.03842739661534627, "sim_compute_robot_state-npc0": 0.03781946023305257, "sim_compute_robot_state-npc1": 0.037896774609883624, "sim_compute_robot_state-npc2": 0.03782220602035522, "sim_compute_robot_state-npc3": 0.037617974281311035}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.3490417922239817, "sim_physics": 0.06689083258310954, "survival_time": 14.950000000000076, "driven_lanedir": 2.022275049294276, "sim_render-ego": 0.03363688309987386, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03905247767766317, "deviation-heading": 4.1972179821626705, "set_robot_commands": 0.051466715335845944, "deviation-center-line": 1.0386131686552715, "driven_lanedir_consec": 2.022275049294276, "sim_compute_sim_state": 0.02125149647394816, "sim_compute_performance-ego": 0.03679918845494588, "sim_compute_robot_state-ego": 0.038499943415323895, "sim_compute_robot_state-npc0": 0.03752013921737671, "sim_compute_robot_state-npc1": 0.03754080931345622, "sim_compute_robot_state-npc2": 0.03782504717508952, "sim_compute_robot_state-npc3": 0.0378455909093221}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.8183701846397415, "sim_physics": 0.06720255884489788, "survival_time": 11.65000000000003, "driven_lanedir": 1.254122761820048, "sim_render-ego": 0.03446632802742233, "in-drivable-lane": 1.7999999999999952, "agent_compute-ego": 0.038507359222281136, "deviation-heading": 4.736929297442443, "set_robot_commands": 0.05190430792616161, "deviation-center-line": 0.9053887635539783, "driven_lanedir_consec": 1.0799769557365442, "sim_compute_sim_state": 0.02147573053581009, "sim_compute_performance-ego": 0.037211633035553374, "sim_compute_robot_state-ego": 0.0384113716976837, "sim_compute_robot_state-npc0": 0.038171670979184655, "sim_compute_robot_state-npc1": 0.03806118596776872, "sim_compute_robot_state-npc2": 0.03799399899822448, "sim_compute_robot_state-npc3": 0.037845064130463825}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.34856485195945, "sim_physics": 0.06996794859568278, "survival_time": 14.950000000000076, "driven_lanedir": 1.362205116595515, "sim_render-ego": 0.033998185793558754, "in-drivable-lane": 3.90000000000001, "agent_compute-ego": 0.03921487967173259, "deviation-heading": 5.909834507439167, "set_robot_commands": 0.05122409184773763, "deviation-center-line": 0.906223259843169, "driven_lanedir_consec": 0.9832109052383768, "sim_compute_sim_state": 0.02130258083343506, "sim_compute_performance-ego": 0.03670088132222493, "sim_compute_robot_state-ego": 0.038633507092793784, "sim_compute_robot_state-npc0": 0.0376745859781901, "sim_compute_robot_state-npc1": 0.03781512896219889, "sim_compute_robot_state-npc2": 0.03762899080912272, "sim_compute_robot_state-npc3": 0.03756457567214966}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3485429192721696, "sim_physics": 0.07104145447413127, "survival_time": 14.950000000000076, "driven_lanedir": 1.6110222889696435, "sim_render-ego": 0.03418943723042806, "in-drivable-lane": 2.0000000000000107, "agent_compute-ego": 0.03862368106842041, "deviation-heading": 7.156415803534466, "set_robot_commands": 0.05231973965962728, "deviation-center-line": 1.1827260995852698, "driven_lanedir_consec": 0.8978797544254031, "sim_compute_sim_state": 0.021568671862284346, "sim_compute_performance-ego": 0.037292234897613526, "sim_compute_robot_state-ego": 0.03868702173233032, "sim_compute_robot_state-npc0": 0.03792251348495483, "sim_compute_robot_state-npc1": 0.038045072555541994, "sim_compute_robot_state-npc2": 0.038802358309427895, "sim_compute_robot_state-npc3": 0.038144535223642986}}
set_robot_commands_max0.05231973965962728
set_robot_commands_mean0.05191145100880659
set_robot_commands_median0.05201335430145264
set_robot_commands_min0.05122409184773763
sim_compute_performance-ego_max0.03742044369379679
sim_compute_performance-ego_mean0.03701265975997636
sim_compute_performance-ego_median0.03702266727175031
sim_compute_performance-ego_min0.03670088132222493
sim_compute_robot_state-ego_max0.03955997228622436
sim_compute_robot_state-ego_mean0.03856135998259804
sim_compute_robot_state-ego_median0.03855469783147176
sim_compute_robot_state-ego_min0.03812904755274455
sim_compute_robot_state-npc0_max0.03824785111964434
sim_compute_robot_state-npc0_mean0.03783056596441677
sim_compute_robot_state-npc0_median0.03778303225835165
sim_compute_robot_state-npc0_min0.03752013921737671
sim_compute_robot_state-npc1_max0.03828177966323553
sim_compute_robot_state-npc1_mean0.037919338004284035
sim_compute_robot_state-npc1_median0.037969391345977786
sim_compute_robot_state-npc1_min0.03754080931345622
sim_compute_robot_state-npc2_max0.038802358309427895
sim_compute_robot_state-npc2_mean0.037927227250583506
sim_compute_robot_state-npc2_median0.03785560048859695
sim_compute_robot_state-npc2_min0.037548521359761555
sim_compute_robot_state-npc3_max0.03819968653660195
sim_compute_robot_state-npc3_mean0.03776682627140263
sim_compute_robot_state-npc3_median0.037799630959828696
sim_compute_robot_state-npc3_min0.03727758067777787
sim_compute_sim_state_max0.02162352164586385
sim_compute_sim_state_mean0.021403870700177803
sim_compute_sim_state_median0.021434213320414227
sim_compute_sim_state_min0.021163631887996897
sim_physics_max0.07312440554300945
sim_physics_mean0.06968784094314201
sim_physics_median0.07009765227635702
sim_physics_min0.06520662362548127
sim_render-ego_max0.03475114468778117
sim_render-ego_mean0.03414766391869643
sim_render-ego_median0.034153386658313224
sim_render-ego_min0.03363688309987386
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.540000000000044
survival_time_min4.3499999999999925
No reset possible
227892907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:31:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.466627654289285
survival_time_median6.099999999999986
deviation-center-line_median0.33341663981606123
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1145672897497813
agent_compute-ego_mean0.11280293562696216
agent_compute-ego_median0.11285812714520622
agent_compute-ego_min0.1089727467504041
deviation-center-line_max1.0678270161928525
deviation-center-line_mean0.3924833225550088
deviation-center-line_min0.16662188238079648
deviation-heading_max3.00376928154286
deviation-heading_mean1.182722648012555
deviation-heading_median0.8526023258587172
deviation-heading_min0.3980684508158633
driven_any_max2.553475024767484
driven_any_mean1.0539409492023473
driven_any_median1.0073534337261636
driven_any_min0.3609526397352217
driven_lanedir_consec_max2.3199839675073
driven_lanedir_consec_mean0.7711579392535753
driven_lanedir_consec_min0.3359040954329422
driven_lanedir_max2.320009778733091
driven_lanedir_mean0.7846552677152641
driven_lanedir_median0.6115512044452298
driven_lanedir_min0.3359040954329422
in-drivable-lane_max6.899999999999996
in-drivable-lane_mean1.2566666666666677
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.391700043905229, "sim_physics": 0.07472640635019326, "survival_time": 8.299999999999983, "driven_lanedir": 1.3851647080326188, "sim_render-ego": 0.0320512013263013, "in-drivable-lane": 0, "agent_compute-ego": 0.11344962953084922, "deviation-heading": 0.7900143744696351, "set_robot_commands": 0.05085933208465576, "deviation-center-line": 0.531419937088551, "driven_lanedir_consec": 1.384801018742178, "sim_compute_sim_state": 0.02019425903458193, "sim_compute_performance-ego": 0.03522699281393764, "sim_compute_robot_state-ego": 0.03668254111186568, "sim_compute_robot_state-npc0": 0.037042319056499434, "sim_compute_robot_state-npc1": 0.036260652254862955, "sim_compute_robot_state-npc2": 0.035822931542453994, "sim_compute_robot_state-npc3": 0.03556485492062856}, "udem1-1-0": {"driven_any": 0.4483038438306956, "sim_physics": 0.07672588167519405, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226836157735168, "sim_render-ego": 0.032529978916562834, "in-drivable-lane": 0, "agent_compute-ego": 0.1089727467504041, "deviation-heading": 0.9834096544692096, "set_robot_commands": 0.051750832590563546, "deviation-center-line": 0.2083887780063803, "driven_lanedir_consec": 0.4226836157735168, "sim_compute_sim_state": 0.01996939757774616, "sim_compute_performance-ego": 0.0342238319331202, "sim_compute_robot_state-ego": 0.036735357909367, "sim_compute_robot_state-npc0": 0.036544059884959255, "sim_compute_robot_state-npc1": 0.036746131962743296, "sim_compute_robot_state-npc2": 0.035865578158148406, "sim_compute_robot_state-npc3": 0.035821347401059904}, "udem1-2-0": {"driven_any": 2.1691284131233446, "sim_physics": 0.07492982079001034, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728103279359904, "sim_render-ego": 0.032491230497173236, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.11285812714520622, "deviation-heading": 0.8643309130348766, "set_robot_commands": 0.050339698791503906, "deviation-center-line": 0.6335547372660157, "driven_lanedir_consec": 1.7727850975910913, "sim_compute_sim_state": 0.02034455467672909, "sim_compute_performance-ego": 0.03525847360199573, "sim_compute_robot_state-ego": 0.03692989162370271, "sim_compute_robot_state-npc0": 0.035881539887072995, "sim_compute_robot_state-npc1": 0.03620606684217266, "sim_compute_robot_state-npc2": 0.03559434928146063, "sim_compute_robot_state-npc3": 0.03572536543303845}, "udem1-3-0": {"driven_any": 2.553475024767484, "sim_physics": 0.07631842692693075, "survival_time": 14.950000000000076, "driven_lanedir": 2.320009778733091, "sim_render-ego": 0.032252218723297116, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.1128422753016154, "deviation-heading": 0.8526023258587172, "set_robot_commands": 0.049665621916453045, "deviation-center-line": 1.0678270161928525, "driven_lanedir_consec": 2.3199839675073, "sim_compute_sim_state": 0.02014336347579956, "sim_compute_performance-ego": 0.03529156843821208, "sim_compute_robot_state-ego": 0.037095634937286376, "sim_compute_robot_state-npc0": 0.03570375521977742, "sim_compute_robot_state-npc1": 0.03610529104868571, "sim_compute_robot_state-npc2": 0.035761168797810876, "sim_compute_robot_state-npc3": 0.03622866948445638}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.07703253201075963, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.0313941021354831, "in-drivable-lane": 0, "agent_compute-ego": 0.1122927714367302, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.04979231406231316, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.02075913974217006, "sim_compute_performance-ego": 0.0344166950303681, "sim_compute_robot_state-ego": 0.0367360309678681, "sim_compute_robot_state-npc0": 0.036418204404869856, "sim_compute_robot_state-npc1": 0.03638648500247878, "sim_compute_robot_state-npc2": 0.03645906642991669, "sim_compute_robot_state-npc3": 0.03611574854169573}, "udem1-5-0": {"driven_any": 1.042294034462269, "sim_physics": 0.07612440131959461, "survival_time": 6.299999999999986, "driven_lanedir": 0.3977853477095068, "sim_render-ego": 0.032426256982107014, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.11339807321154882, "deviation-heading": 2.060706771196367, "set_robot_commands": 0.0514897864962381, "deviation-center-line": 0.33341663981606123, "driven_lanedir_consec": 0.3977853477095068, "sim_compute_sim_state": 0.0203024565227448, "sim_compute_performance-ego": 0.03575714239998469, "sim_compute_robot_state-ego": 0.03699760777609689, "sim_compute_robot_state-npc0": 0.03603220553625198, "sim_compute_robot_state-npc1": 0.03633174063667419, "sim_compute_robot_state-npc2": 0.0357469225686694, "sim_compute_robot_state-npc3": 0.03591345983838278}, "udem1-6-0": {"driven_any": 0.8064449781297804, "sim_physics": 0.08537807368268871, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035057918243635, "sim_render-ego": 0.032685725375859426, "in-drivable-lane": 0, "agent_compute-ego": 0.11433415220241354, "deviation-heading": 0.4192648649548546, "set_robot_commands": 0.04979162023525045, "deviation-center-line": 0.4521049008644824, "driven_lanedir_consec": 0.8035057918243635, "sim_compute_sim_state": 0.019968651761912336, "sim_compute_performance-ego": 0.0350173001337533, "sim_compute_robot_state-ego": 0.03725468751155969, "sim_compute_robot_state-npc0": 0.03576721567096132, "sim_compute_robot_state-npc1": 0.03590624982660467, "sim_compute_robot_state-npc2": 0.03526998770357383, "sim_compute_robot_state-npc3": 0.03538241049255988}, "udem1-7-0": {"driven_any": 1.0073534337261636, "sim_physics": 0.08103795716019928, "survival_time": 6.099999999999986, "driven_lanedir": 0.8835123128772164, "sim_render-ego": 0.032775183193019176, "in-drivable-lane": 0, "agent_compute-ego": 0.11410353809106544, "deviation-heading": 2.2471929051607855, "set_robot_commands": 0.050079926115567566, "deviation-center-line": 0.3798478400382373, "driven_lanedir_consec": 0.8699557215089209, "sim_compute_sim_state": 0.02000480010861256, "sim_compute_performance-ego": 0.03539958938223417, "sim_compute_robot_state-ego": 0.03694274386421579, "sim_compute_robot_state-npc0": 0.035558735738035106, "sim_compute_robot_state-npc1": 0.03653781922137151, "sim_compute_robot_state-npc2": 0.035670589228145415, "sim_compute_robot_state-npc3": 0.035717876231084106}, "udem1-8-0": {"driven_any": 1.0248237349996017, "sim_physics": 0.07631153445090016, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115512044452298, "sim_render-ego": 0.03288006974804786, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.11227964778100293, "deviation-heading": 2.0843969428116633, "set_robot_commands": 0.05090678122735793, "deviation-center-line": 0.4228099488267053, "driven_lanedir_consec": 0.6115512044452298, "sim_compute_sim_state": 0.020218643449967908, "sim_compute_performance-ego": 0.0359232694871964, "sim_compute_robot_state-ego": 0.03716015046642673, "sim_compute_robot_state-npc0": 0.03560947410521969, "sim_compute_robot_state-npc1": 0.03608220046566379, "sim_compute_robot_state-npc2": 0.03563206618832004, "sim_compute_robot_state-npc3": 0.03557609550414547}, "udem1-9-0": {"driven_any": 0.44830384366262993, "sim_physics": 0.08678409559973355, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4319199663087821, "sim_render-ego": 0.032657199892504464, "in-drivable-lane": 0, "agent_compute-ego": 0.11270154344624486, "deviation-heading": 0.7843859210886422, "set_robot_commands": 0.04949124517111943, "deviation-center-line": 0.19267161522996132, "driven_lanedir_consec": 0.4319199663087821, "sim_compute_sim_state": 0.020164699390016753, "sim_compute_performance-ego": 0.03502658317829001, "sim_compute_robot_state-ego": 0.03722565338529389, "sim_compute_robot_state-npc0": 0.03597389007436818, "sim_compute_robot_state-npc1": 0.036136195577424146, "sim_compute_robot_state-npc2": 0.035704781269205024, "sim_compute_robot_state-npc3": 0.03587900359055091}, "udem1-10-0": {"driven_any": 0.3609526397352217, "sim_physics": 0.07937508821487427, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3414443288920854, "sim_render-ego": 0.03244545559088389, "in-drivable-lane": 0, "agent_compute-ego": 0.1145672897497813, "deviation-heading": 0.7915362159748539, "set_robot_commands": 0.04971388975779215, "deviation-center-line": 0.16662188238079648, "driven_lanedir_consec": 0.3414443288920854, "sim_compute_sim_state": 0.019728243350982663, "sim_compute_performance-ego": 0.035220980644226074, "sim_compute_robot_state-ego": 0.03813609480857849, "sim_compute_robot_state-npc0": 0.03553371628125509, "sim_compute_robot_state-npc1": 0.03562937180201212, "sim_compute_robot_state-npc2": 0.03530546526114146, "sim_compute_robot_state-npc3": 0.0352599173784256}, "udem1-11-0": {"driven_any": 0.4046281574961264, "sim_physics": 0.07699596656943267, "survival_time": 2.6499999999999986, "driven_lanedir": 0.40003643479537576, "sim_render-ego": 0.03253709145312039, "in-drivable-lane": 0, "agent_compute-ego": 0.11096872473662754, "deviation-heading": 0.3980684508158633, "set_robot_commands": 0.05006668702611383, "deviation-center-line": 0.2708859521467339, "driven_lanedir_consec": 0.40003643479537576, "sim_compute_sim_state": 0.020104664676594285, "sim_compute_performance-ego": 0.03569423027758328, "sim_compute_robot_state-ego": 0.03685567963798091, "sim_compute_robot_state-npc0": 0.036649546533260705, "sim_compute_robot_state-npc1": 0.035206466350915296, "sim_compute_robot_state-npc2": 0.03696849211206976, "sim_compute_robot_state-npc3": 0.035574859043337265}, "udem1-12-0": {"driven_any": 1.5489327489516758, "sim_physics": 0.07977798451548038, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.03216033396513566, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.11212264454883078, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.05000009096187094, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.020557235116543976, "sim_compute_performance-ego": 0.03532131340192712, "sim_compute_robot_state-ego": 0.03672677667244621, "sim_compute_robot_state-npc0": 0.03568084214044654, "sim_compute_robot_state-npc1": 0.03599237099937771, "sim_compute_robot_state-npc2": 0.03542442166286966, "sim_compute_robot_state-npc3": 0.03605055809020996}, "udem1-13-0": {"driven_any": 0.9898831334126, "sim_physics": 0.0766534686088562, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517705220330678, "sim_render-ego": 0.03249402046203613, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.11407612760861714, "deviation-heading": 1.323248045391386, "set_robot_commands": 0.050547532240549725, "deviation-center-line": 0.3285033071320674, "driven_lanedir_consec": 0.6517705220330678, "sim_compute_sim_state": 0.02088234623273214, "sim_compute_performance-ego": 0.03519213596979777, "sim_compute_robot_state-ego": 0.03679651816685994, "sim_compute_robot_state-npc0": 0.036435035864512126, "sim_compute_robot_state-npc1": 0.03674241105715434, "sim_compute_robot_state-npc2": 0.03615872859954834, "sim_compute_robot_state-npc3": 0.03597831726074219}, "udem1-14-0": {"driven_any": 1.2432024907546595, "sim_physics": 0.08267429851045545, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551162589851884, "sim_render-ego": 0.032208700308063686, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.11307674286349507, "deviation-heading": 3.00376928154286, "set_robot_commands": 0.04945273047325595, "deviation-center-line": 0.4491548536824948, "driven_lanedir_consec": 0.466627654289285, "sim_compute_sim_state": 0.020314541439082, "sim_compute_performance-ego": 0.03505162904726579, "sim_compute_robot_state-ego": 0.036812140637596184, "sim_compute_robot_state-npc0": 0.035848046309195906, "sim_compute_robot_state-npc1": 0.03563666983738842, "sim_compute_robot_state-npc2": 0.03561194791089768, "sim_compute_robot_state-npc3": 0.03557354011791664}}
set_robot_commands_max0.051750832590563546
set_robot_commands_mean0.050263205943373704
set_robot_commands_median0.05006668702611383
set_robot_commands_min0.04945273047325595
sim_compute_performance-ego_max0.0359232694871964
sim_compute_performance-ego_mean0.035201449049326164
sim_compute_performance-ego_median0.03522699281393764
sim_compute_performance-ego_min0.0342238319331202
sim_compute_robot_state-ego_max0.03813609480857849
sim_compute_robot_state-ego_mean0.037005833965142974
sim_compute_robot_state-ego_median0.03692989162370271
sim_compute_robot_state-ego_min0.03668254111186568
sim_compute_robot_state-npc0_max0.037042319056499434
sim_compute_robot_state-npc0_mean0.036045239113779035
sim_compute_robot_state-npc0_median0.035881539887072995
sim_compute_robot_state-npc0_min0.03553371628125509
sim_compute_robot_state-npc1_max0.036746131962743296
sim_compute_robot_state-npc1_mean0.03612707485903531
sim_compute_robot_state-npc1_median0.036136195577424146
sim_compute_robot_state-npc1_min0.035206466350915296
sim_compute_robot_state-npc2_max0.03696849211206976
sim_compute_robot_state-npc2_mean0.03579976644761542
sim_compute_robot_state-npc2_median0.035704781269205024
sim_compute_robot_state-npc2_min0.03526998770357383
sim_compute_robot_state-npc3_max0.03622866948445638
sim_compute_robot_state-npc3_mean0.03575746822188226
sim_compute_robot_state-npc3_median0.03572536543303845
sim_compute_robot_state-npc3_min0.0352599173784256
sim_compute_sim_state_max0.02088234623273214
sim_compute_sim_state_mean0.020243799770414416
sim_compute_sim_state_median0.02019425903458193
sim_compute_sim_state_min0.019728243350982663
sim_physics_max0.08678409559973355
sim_physics_mean0.07872306242568688
sim_physics_median0.07699596656943267
sim_physics_min0.07472640635019326
sim_render-ego_max0.03288006974804786
sim_render-ego_mean0.03239925123797302
sim_render-ego_median0.032491230497173236
sim_render-ego_min0.0313941021354831
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.366666666666666
survival_time_min2.3999999999999995
No reset possible
227622812Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LFVI-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:19:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.08159929589380192
agent_compute-ego_mean0.08010377164327694
agent_compute-ego_median0.08003342151641846
agent_compute-ego_min0.07928786958966937
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.08039326305630841, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.03314140476757967, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08159929589380192, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.04966377608383758, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.020306713973419575, "sim_compute_performance-ego": 0.03539970856678637, "sim_compute_robot_state-ego": 0.037084582485730135, "sim_compute_robot_state-npc0": 0.035739889627770534, "sim_compute_robot_state-npc1": 0.03630760651600512, "sim_compute_robot_state-npc2": 0.0357013593746137, "sim_compute_robot_state-npc3": 0.035717182521578635}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.08258347000394549, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.032463175909859796, "in-drivable-lane": 0, "agent_compute-ego": 0.07928786958966937, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.05332995312554496, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.02017475025994437, "sim_compute_performance-ego": 0.03517709459577288, "sim_compute_robot_state-ego": 0.038001571382795064, "sim_compute_robot_state-npc0": 0.035616116864340644, "sim_compute_robot_state-npc1": 0.03524276188441685, "sim_compute_robot_state-npc2": 0.03519161258425031, "sim_compute_robot_state-npc3": 0.03580080611365182}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.07807530477208999, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.032518366008128935, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07988288333115068, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.04902837345901045, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.020172135343829407, "sim_compute_performance-ego": 0.034621984055898725, "sim_compute_robot_state-ego": 0.036765927249945485, "sim_compute_robot_state-npc0": 0.03594156144892128, "sim_compute_robot_state-npc1": 0.03580017228728359, "sim_compute_robot_state-npc2": 0.03524832586640293, "sim_compute_robot_state-npc3": 0.03578958233583321}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.08323693772157033, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.031805604696273804, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.08027418951193492, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.04937850932280222, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.02008016407489777, "sim_compute_performance-ego": 0.03473569949467977, "sim_compute_robot_state-ego": 0.03652379413445791, "sim_compute_robot_state-npc0": 0.03618775308132171, "sim_compute_robot_state-npc1": 0.03762519359588623, "sim_compute_robot_state-npc2": 0.035242716471354164, "sim_compute_robot_state-npc3": 0.03505929311116537}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.08134789693923224, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.03196892284211658, "in-drivable-lane": 0, "agent_compute-ego": 0.0800223918188186, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.04880211466834659, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.020555087498256137, "sim_compute_performance-ego": 0.03469797543116978, "sim_compute_robot_state-ego": 0.03695090611775717, "sim_compute_robot_state-npc0": 0.03562206313723609, "sim_compute_robot_state-npc1": 0.03553233827863421, "sim_compute_robot_state-npc2": 0.036879721141996835, "sim_compute_robot_state-npc3": 0.035250255039760044}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.07828552851419963, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.032346581270594796, "in-drivable-lane": 2, "agent_compute-ego": 0.07985001695370246, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.04947011342305623, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.020055976456510808, "sim_compute_performance-ego": 0.0348404638781519, "sim_compute_robot_state-ego": 0.03698831118509441, "sim_compute_robot_state-npc0": 0.035535041443602054, "sim_compute_robot_state-npc1": 0.03580024999058889, "sim_compute_robot_state-npc2": 0.03540664233133464, "sim_compute_robot_state-npc3": 0.035461218771106466}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.08338028944811775, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.03251639616142199, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08026771175051198, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.04923785311504475, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02232622405857716, "sim_compute_performance-ego": 0.035184874117953104, "sim_compute_robot_state-ego": 0.03701603528365348, "sim_compute_robot_state-npc0": 0.03561289333602757, "sim_compute_robot_state-npc1": 0.03568504157575589, "sim_compute_robot_state-npc2": 0.03570443218194165, "sim_compute_robot_state-npc3": 0.035498359828319365}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.08709868431091308, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.033323841094970705, "in-drivable-lane": 0, "agent_compute-ego": 0.07979367733001709, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.049545788764953615, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.020580053329467773, "sim_compute_performance-ego": 0.03516577243804932, "sim_compute_robot_state-ego": 0.03687504768371582, "sim_compute_robot_state-npc0": 0.03555574417114258, "sim_compute_robot_state-npc1": 0.035804734230041504, "sim_compute_robot_state-npc2": 0.03564877986907959, "sim_compute_robot_state-npc3": 0.03580949306488037}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.07779416671166053, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03210646372575026, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08046816404049213, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.04947532140291654, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.02012214293846717, "sim_compute_performance-ego": 0.034948188524979815, "sim_compute_robot_state-ego": 0.036595862645369306, "sim_compute_robot_state-npc0": 0.035439317043011, "sim_compute_robot_state-npc1": 0.03622367748847374, "sim_compute_robot_state-npc2": 0.035384599979107194, "sim_compute_robot_state-npc3": 0.035491764545440674}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.0902965160516592, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03250425595503587, "in-drivable-lane": 0, "agent_compute-ego": 0.0803055213047908, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.05005935522226187, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.020062694182762734, "sim_compute_performance-ego": 0.03438243499168983, "sim_compute_robot_state-ego": 0.03647946394406832, "sim_compute_robot_state-npc0": 0.03703382382026085, "sim_compute_robot_state-npc1": 0.03621357220869798, "sim_compute_robot_state-npc2": 0.03600981602301964, "sim_compute_robot_state-npc3": 0.03533339500427246}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.08259116519581187, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.032793218439275566, "in-drivable-lane": 0, "agent_compute-ego": 0.08003342151641846, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.04836073788729581, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.02011871337890625, "sim_compute_performance-ego": 0.036095922643488106, "sim_compute_robot_state-ego": 0.037366541949185456, "sim_compute_robot_state-npc0": 0.03634566610509699, "sim_compute_robot_state-npc1": 0.03557113083926114, "sim_compute_robot_state-npc2": 0.03476527604189786, "sim_compute_robot_state-npc3": 0.03528240593996915}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.07718895435333252, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.03232187747955322, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08034112930297851, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.04935735702514649, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.020695905685424804, "sim_compute_performance-ego": 0.03499733924865723, "sim_compute_robot_state-ego": 0.03668574810028076, "sim_compute_robot_state-npc0": 0.035890660285949706, "sim_compute_robot_state-npc1": 0.036248397827148435, "sim_compute_robot_state-npc2": 0.036390581130981446, "sim_compute_robot_state-npc3": 0.03597043037414551}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.08086198187888936, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.032052126336604994, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08007775976302776, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.04924366575606326, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.020305258162478183, "sim_compute_performance-ego": 0.03488607863162426, "sim_compute_robot_state-ego": 0.03684472530446154, "sim_compute_robot_state-npc0": 0.03568622152856056, "sim_compute_robot_state-npc1": 0.035876045835779066, "sim_compute_robot_state-npc2": 0.035549747182967814, "sim_compute_robot_state-npc3": 0.03592645614705187}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.07821430151279156, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.032327088025900036, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.07935063655559833, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.04900371569853563, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.020174053999093864, "sim_compute_performance-ego": 0.035804798969855674, "sim_compute_robot_state-ego": 0.037469955591055065, "sim_compute_robot_state-npc0": 0.035777467947739824, "sim_compute_robot_state-npc1": 0.03577268582123976, "sim_compute_robot_state-npc2": 0.03603301598475529, "sim_compute_robot_state-npc3": 0.03566525074151846}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.07785161109197708, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03313965116228376, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.08000190598624093, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.04924586613972982, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.020072230838593982, "sim_compute_performance-ego": 0.03490605581374395, "sim_compute_robot_state-ego": 0.03721928369431268, "sim_compute_robot_state-npc0": 0.035785790852137976, "sim_compute_robot_state-npc1": 0.03596053350539435, "sim_compute_robot_state-npc2": 0.03561942463829404, "sim_compute_robot_state-npc3": 0.03556650706699916}}
set_robot_commands_max0.05332995312554496
set_robot_commands_mean0.04954683340630306
set_robot_commands_median0.04935735702514649
set_robot_commands_min0.04836073788729581
sim_compute_performance-ego_max0.036095922643488106
sim_compute_performance-ego_mean0.03505629276016672
sim_compute_performance-ego_median0.034948188524979815
sim_compute_performance-ego_min0.03438243499168983
sim_compute_robot_state-ego_max0.038001571382795064
sim_compute_robot_state-ego_mean0.03699118378345884
sim_compute_robot_state-ego_median0.03695090611775717
sim_compute_robot_state-ego_min0.03647946394406832
sim_compute_robot_state-npc0_max0.03703382382026085
sim_compute_robot_state-npc0_mean0.03585133404620796
sim_compute_robot_state-npc0_median0.035739889627770534
sim_compute_robot_state-npc0_min0.035439317043011
sim_compute_robot_state-npc1_max0.03762519359588623
sim_compute_robot_state-npc1_mean0.03597760945897378
sim_compute_robot_state-npc1_median0.035804734230041504
sim_compute_robot_state-npc1_min0.03524276188441685
sim_compute_robot_state-npc2_max0.036879721141996835
sim_compute_robot_state-npc2_mean0.03565173672013314
sim_compute_robot_state-npc2_median0.03561942463829404
sim_compute_robot_state-npc2_min0.03476527604189786
sim_compute_robot_state-npc3_max0.03597043037414551
sim_compute_robot_state-npc3_mean0.03557482670704617
sim_compute_robot_state-npc3_median0.03556650706699916
sim_compute_robot_state-npc3_min0.03505929311116537
sim_compute_sim_state_max0.02232622405857716
sim_compute_sim_state_mean0.020386806945375337
sim_compute_sim_state_median0.020174053999093864
sim_compute_sim_state_min0.020055976456510808
sim_physics_max0.0902965160516592
sim_physics_mean0.08128000477083328
sim_physics_median0.08086198187888936
sim_physics_min0.07718895435333252
sim_render-ego_max0.033323841094970705
sim_render-ego_mean0.03248859825835667
sim_render-ego_median0.032463175909859796
sim_render-ego_min0.031805604696273804
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
227582814Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:12:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.08406064033508301
agent_compute-ego_mean0.07988255274132959
agent_compute-ego_median0.07933453952564913
agent_compute-ego_min0.0790115197499593
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.04049600053716589, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.031716991353918006, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0811302970956873, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.04913304028687654, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.01991147465176053, "sim_compute_performance-ego": 0.03488934481585467, "sim_compute_robot_state-ego": 0.036982571637188946}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.03971535551781748, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.032250380983539655, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07924856391607546, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.048740022322710824, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.020247945598527495, "sim_compute_performance-ego": 0.035019977419984104, "sim_compute_robot_state-ego": 0.03704035515878715}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.04346682043636546, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0321493008557488, "in-drivable-lane": 0, "agent_compute-ego": 0.0793310614193187, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.048760259852689856, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.01981369186850155, "sim_compute_performance-ego": 0.03513449781081256, "sim_compute_robot_state-ego": 0.0368345344767851}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.04195998191833496, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0321730899810791, "in-drivable-lane": 0, "agent_compute-ego": 0.08406064033508301, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.048550891876220706, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.019958391189575195, "sim_compute_performance-ego": 0.03463831901550293, "sim_compute_robot_state-ego": 0.037802114486694335}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.04047008405757856, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.032347522204435326, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.07919234263746044, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.04951326454742045, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.02020062977754617, "sim_compute_performance-ego": 0.035157816319526, "sim_compute_robot_state-ego": 0.03743522076667109}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.039853100873986066, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.03202736621000329, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.07905399556062659, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.0493373627565345, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.02004294979329012, "sim_compute_performance-ego": 0.03492199644750478, "sim_compute_robot_state-ego": 0.03737764942402742}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.03865353124482291, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.03234850083078657, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.07902286733899798, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.05145572338785444, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.02010388033730643, "sim_compute_performance-ego": 0.035251736640930176, "sim_compute_robot_state-ego": 0.03658502868243626}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.043501240866524835, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.03156669934590658, "in-drivable-lane": 0, "agent_compute-ego": 0.07913316999162946, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.04841228893824986, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.019844021115984236, "sim_compute_performance-ego": 0.03483070646013532, "sim_compute_robot_state-ego": 0.03708867799668085}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.040710578530521714, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.03310443587222342, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0804105007042319, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.04984473778029619, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.02015957185777567, "sim_compute_performance-ego": 0.03570150520841954, "sim_compute_robot_state-ego": 0.03691873712054754}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.040827699141068895, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.032064628601074216, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.0796168717471036, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.04901751171458851, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.020396601070057262, "sim_compute_performance-ego": 0.03529777093367143, "sim_compute_robot_state-ego": 0.03697701800953258}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.04015307302598829, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.03219540707476727, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08070238534506265, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.049953943723207946, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.020804346381843863, "sim_compute_performance-ego": 0.03524313034949365, "sim_compute_robot_state-ego": 0.03696220261710031}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.04150243316377912, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.032655341284615655, "in-drivable-lane": 0, "agent_compute-ego": 0.07958959681647164, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.04946574994495937, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.02003248248781477, "sim_compute_performance-ego": 0.03582922901426043, "sim_compute_robot_state-ego": 0.03692769152777536}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.03949393945581773, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03157952720043706, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0790115197499593, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.049213591743918025, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.020080739376591702, "sim_compute_performance-ego": 0.03513287562949985, "sim_compute_robot_state-ego": 0.036904162051630954}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.041203048494127065, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.03177572179723669, "in-drivable-lane": 0, "agent_compute-ego": 0.07939993893658673, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.04966685507032606, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.01999495647571705, "sim_compute_performance-ego": 0.034668163016990376, "sim_compute_robot_state-ego": 0.03711348109775119}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.03860734958274692, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03195470454646092, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.07933453952564913, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.04893013309029972, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.020009875297546387, "sim_compute_performance-ego": 0.03540206890480191, "sim_compute_robot_state-ego": 0.03710757751090854}}
set_robot_commands_max0.05145572338785444
set_robot_commands_mean0.04933302513574354
set_robot_commands_median0.049213591743918025
set_robot_commands_min0.04841228893824986
sim_compute_performance-ego_max0.03582922901426043
sim_compute_performance-ego_mean0.03514127586582585
sim_compute_performance-ego_median0.03513449781081256
sim_compute_performance-ego_min0.03463831901550293
sim_compute_robot_state-ego_max0.037802114486694335
sim_compute_robot_state-ego_mean0.03707046817096784
sim_compute_robot_state-ego_median0.036982571637188946
sim_compute_robot_state-ego_min0.03658502868243626
sim_compute_sim_state_max0.020804346381843863
sim_compute_sim_state_mean0.02010677048532256
sim_compute_sim_state_median0.02004294979329012
sim_compute_sim_state_min0.01981369186850155
sim_physics_max0.043501240866524835
sim_physics_mean0.04070761578977639
sim_physics_median0.04049600053716589
sim_physics_min0.03860734958274692
sim_render-ego_max0.03310443587222342
sim_render-ego_mean0.03212730787614884
sim_render-ego_median0.0321493008557488
sim_render-ego_min0.03156669934590658
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
227572818Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationhost-erroryesnutonomy-P50-97470:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 255, in _do_raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+ip4://127.0.0.1:5001/api/v0/swarm/connect?stream-channels=true&arg=%2Fdns4%2Fipfs.duckietown.org%2Ftcp%2F4001%2Fipfs%2FQmPyoL4ZwaTYtGsvFG8A5fG85tQH5sCHWtexkNVjqa52iK

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1151, in download_artefacts
    res = client.swarm_connect(peer)
  File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
    result = func(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/swarm.py", line 137, in connect
    return self._client.request('/swarm/connect', args, decoder='json', **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 286, in _request
    self._do_raise_for_status(res)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 273, in _do_raise_for_status
    six.raise_from(exceptions.ErrorResponse(msg, error), error)
  File "<string>", line 3, in raise_from
ipfshttpclient.exceptions.ErrorResponse: connect QmPyoL4ZwaTYtGsvFG8A5fG85tQH5sCHWtexkNVjqa52iK failure: dial attempt failed: <peer.ID T35iPP> --> <peer.ID PyoL4Z> dial attempt failed: context deadline exceeded
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227552819Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationhost-erroryesnutonomy-P50-97470:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 255, in _do_raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+ip4://127.0.0.1:5001/api/v0/swarm/connect?stream-channels=true&arg=%2Fip4%2F129.132.0.37%2Ftcp%2F4001%2Fipfs%2FQmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1151, in download_artefacts
    res = client.swarm_connect(peer)
  File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
    result = func(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/swarm.py", line 137, in connect
    return self._client.request('/swarm/connect', args, decoder='json', **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 286, in _request
    self._do_raise_for_status(res)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 273, in _do_raise_for_status
    six.raise_from(exceptions.ErrorResponse(msg, error), error)
  File "<string>", line 3, in raise_from
ipfshttpclient.exceptions.ErrorResponse: connect QmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9 failure: dial attempt failed: <peer.ID T35iPP> --> <peer.ID W5P8PZ> dial attempt failed: context deadline exceeded
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227512831Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryesnutonomy-P50-97470:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227472840Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerroryesnutonomy-P50-97470:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227422847Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryesnutonomy-P50-97470:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227402848Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerroryesnutonomy-P50-97470:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227302868Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:13:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5885414934234479
survival_time_median2.25
deviation-center-line_median0.10447263985717296
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.09468683382359946
agent_compute-ego_mean0.09196903335644628
agent_compute-ego_median0.09206134665246105
agent_compute-ego_min0.09005194618588402
deviation-center-line_max0.37621264593942727
deviation-center-line_mean0.13059434128418543
deviation-center-line_min0.06640840348138048
deviation-heading_max1.988397647695644
deviation-heading_mean0.7450004069261837
deviation-heading_median0.5319310251869941
deviation-heading_min0.19281043566106773
driven_any_max2.3167988054662683
driven_any_mean1.1012220956993768
driven_any_median1.0034715487370909
driven_any_min0.5889231238681565
driven_lanedir_consec_max1.7731298647407658
driven_lanedir_consec_mean0.5997903291955192
driven_lanedir_consec_min0.2492937117080367
driven_lanedir_max1.7785263612624065
driven_lanedir_mean0.641868673177321
driven_lanedir_median0.6064968425890118
driven_lanedir_min0.26263992171444817
in-drivable-lane_max1.6499999999999977
in-drivable-lane_mean0.6833333333333329
in-drivable-lane_min0.1499999999999997
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.015424119834213, "sim_physics": 0.03895984626397854, "survival_time": 2.0500000000000007, "driven_lanedir": 0.6855046563537921, "sim_render-ego": 0.032237320411496045, "in-drivable-lane": 0.5, "agent_compute-ego": 0.09468683382359946, "deviation-heading": 0.3146134204397484, "set_robot_commands": 0.05036472111213498, "deviation-center-line": 0.08876804179724099, "driven_lanedir_consec": 0.6855046563537921, "sim_compute_sim_state": 0.020140438545040967, "sim_compute_performance-ego": 0.034891291362483326, "sim_compute_robot_state-ego": 0.03731899726681593}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0811996820971026, "sim_physics": 0.040049958229064944, "survival_time": 2.499999999999999, "driven_lanedir": 0.3417519223721328, "sim_render-ego": 0.03209218978881836, "in-drivable-lane": 1.549999999999999, "agent_compute-ego": 0.0912215280532837, "deviation-heading": 0.24495495950787743, "set_robot_commands": 0.05241588115692139, "deviation-center-line": 0.06640840348138048, "driven_lanedir_consec": 0.3417519223721328, "sim_compute_sim_state": 0.020667943954467773, "sim_compute_performance-ego": 0.03544701099395752, "sim_compute_robot_state-ego": 0.036734180450439455}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.998660052051846, "sim_physics": 0.04028624912788128, "survival_time": 2.8999999999999977, "driven_lanedir": 0.556497982243314, "sim_render-ego": 0.03255771768504176, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.09212851113286512, "deviation-heading": 1.988397647695644, "set_robot_commands": 0.05037529304109771, "deviation-center-line": 0.19899178061285744, "driven_lanedir_consec": 0.35446847716043406, "sim_compute_sim_state": 0.020399775998345734, "sim_compute_performance-ego": 0.0355105893365268, "sim_compute_robot_state-ego": 0.037551645574898554}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5889231238681565, "sim_physics": 0.04017601994907155, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3111750075470283, "sim_render-ego": 0.0316315118004294, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09072012761059928, "deviation-heading": 0.916867991087866, "set_robot_commands": 0.049167240367216224, "deviation-center-line": 0.10447263985717296, "driven_lanedir_consec": 0.2492937117080367, "sim_compute_sim_state": 0.020003346835865694, "sim_compute_performance-ego": 0.03595089211183436, "sim_compute_robot_state-ego": 0.037491924622479605}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9572780127028024, "sim_physics": 0.03917511304219564, "survival_time": 2.1000000000000005, "driven_lanedir": 0.4464615982778133, "sim_render-ego": 0.03281348092215402, "in-drivable-lane": 0.9500000000000002, "agent_compute-ego": 0.09369607198806036, "deviation-heading": 0.19281043566106773, "set_robot_commands": 0.053569243067786806, "deviation-center-line": 0.08291428856941858, "driven_lanedir_consec": 0.4464615982778133, "sim_compute_sim_state": 0.020928621292114254, "sim_compute_performance-ego": 0.03633812495640346, "sim_compute_robot_state-ego": 0.03854982058207194}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3167988054662683, "sim_physics": 0.039170085167398255, "survival_time": 4.899999999999991, "driven_lanedir": 1.7785263612624065, "sim_render-ego": 0.032392745115319074, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.09079765543645742, "deviation-heading": 1.6832008610634357, "set_robot_commands": 0.049745975708474915, "deviation-center-line": 0.37621264593942727, "driven_lanedir_consec": 1.7731298647407658, "sim_compute_sim_state": 0.020246354901060765, "sim_compute_performance-ego": 0.03559680617585474, "sim_compute_robot_state-ego": 0.036950821779212176}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9841715436990536, "sim_physics": 0.040805816650390625, "survival_time": 2.1000000000000005, "driven_lanedir": 0.5079943433524821, "sim_render-ego": 0.03209971813928513, "in-drivable-lane": 0.8500000000000001, "agent_compute-ego": 0.09005194618588402, "deviation-heading": 0.32945499107350396, "set_robot_commands": 0.05027244772229876, "deviation-center-line": 0.07761654864312081, "driven_lanedir_consec": 0.5079943433524821, "sim_compute_sim_state": 0.020858758971804663, "sim_compute_performance-ego": 0.03530928634461902, "sim_compute_robot_state-ego": 0.036822585832505}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6087946046105039, "sim_physics": 0.04201486706733704, "survival_time": 1.6000000000000008, "driven_lanedir": 0.26263992171444817, "sim_render-ego": 0.033352114260196686, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09230123460292816, "deviation-heading": 0.4417737502963447, "set_robot_commands": 0.04986698180437088, "deviation-center-line": 0.06733815764720119, "driven_lanedir_consec": 0.26263992171444817, "sim_compute_sim_state": 0.0199410617351532, "sim_compute_performance-ego": 0.03540212661027908, "sim_compute_robot_state-ego": 0.03710438311100006}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.1933998133228594, "sim_physics": 0.04129302501678467, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8809374204081752, "sim_render-ego": 0.03276078059123112, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09204561893756572, "deviation-heading": 0.4067278067046391, "set_robot_commands": 0.04974098388965313, "deviation-center-line": 0.08575798987317822, "driven_lanedir_consec": 0.8781058713701944, "sim_compute_sim_state": 0.02065509557723999, "sim_compute_performance-ego": 0.03599970157329853, "sim_compute_robot_state-ego": 0.03733115929823656}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9918847554228204, "sim_physics": 0.04007272720336914, "survival_time": 2.25, "driven_lanedir": 0.6064968425890118, "sim_render-ego": 0.032299539777967665, "in-drivable-lane": 0.4499999999999995, "agent_compute-ego": 0.09245450231764052, "deviation-heading": 0.7563061787136699, "set_robot_commands": 0.050040112601386175, "deviation-center-line": 0.10780199688895407, "driven_lanedir_consec": 0.5885414934234479, "sim_compute_sim_state": 0.02005506091647678, "sim_compute_performance-ego": 0.035206270217895505, "sim_compute_robot_state-ego": 0.0376078552669949}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.9093569820232807, "sim_physics": 0.04011066555976868, "survival_time": 2.000000000000001, "driven_lanedir": 0.3680406089872187, "sim_render-ego": 0.032709598541259766, "in-drivable-lane": 0.9500000000000006, "agent_compute-ego": 0.0910205066204071, "deviation-heading": 0.31701735635158956, "set_robot_commands": 0.050066953897476195, "deviation-center-line": 0.07016829513471222, "driven_lanedir_consec": 0.3680406089872187, "sim_compute_sim_state": 0.020284026861190796, "sim_compute_performance-ego": 0.03497624397277832, "sim_compute_robot_state-ego": 0.03744492530822754}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0307605485359177, "sim_physics": 0.04092670546637641, "survival_time": 2.25, "driven_lanedir": 0.6546656167898023, "sim_render-ego": 0.03234973483615451, "in-drivable-lane": 0.45, "agent_compute-ego": 0.09253588252597383, "deviation-heading": 0.7960414391210141, "set_robot_commands": 0.04949850506252713, "deviation-center-line": 0.1393907642699906, "driven_lanedir_consec": 0.6322304263470951, "sim_compute_sim_state": 0.02002632353040907, "sim_compute_performance-ego": 0.03515705002678765, "sim_compute_robot_state-ego": 0.03809114032321506}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.7569757882184522, "sim_physics": 0.037990452330789445, "survival_time": 4.049999999999994, "driven_lanedir": 0.748673569379265, "sim_render-ego": 0.03264433954968864, "in-drivable-lane": 1.6499999999999977, "agent_compute-ego": 0.09146052525367264, "deviation-heading": 1.0013052229641988, "set_robot_commands": 0.049963144608485846, "deviation-center-line": 0.20018959449728585, "driven_lanedir_consec": 0.6081542545118002, "sim_compute_sim_state": 0.02015013164944119, "sim_compute_performance-ego": 0.0349487316461257, "sim_compute_robot_state-ego": 0.037048027839189694}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.0812320549002832, "sim_physics": 0.04058742990680769, "survival_time": 2.549999999999999, "driven_lanedir": 0.7866871619296378, "sim_render-ego": 0.03241820896373076, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.09206134665246105, "deviation-heading": 1.2536030180251625, "set_robot_commands": 0.05006611580942191, "deviation-center-line": 0.17448299281046964, "driven_lanedir_consec": 0.6253146234708695, "sim_compute_sim_state": 0.020345154930563533, "sim_compute_performance-ego": 0.0355070104785994, "sim_compute_robot_state-ego": 0.03725889617321538}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.0034715487370909, "sim_physics": 0.04146402815113897, "survival_time": 2.3, "driven_lanedir": 0.6919770844532871, "sim_render-ego": 0.03263040729190992, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.09235320920529572, "deviation-heading": 0.5319310251869941, "set_robot_commands": 0.05017643389494523, "deviation-center-line": 0.11840097924037146, "driven_lanedir_consec": 0.6752231641422584, "sim_compute_sim_state": 0.02023744064828624, "sim_compute_performance-ego": 0.03545595251995584, "sim_compute_robot_state-ego": 0.03760224321614141}}
set_robot_commands_max0.053569243067786806
set_robot_commands_mean0.05035533558294648
set_robot_commands_median0.05006611580942191
set_robot_commands_min0.049167240367216224
sim_compute_performance-ego_max0.03633812495640346
sim_compute_performance-ego_mean0.03544647255515995
sim_compute_performance-ego_median0.03544701099395752
sim_compute_performance-ego_min0.034891291362483326
sim_compute_robot_state-ego_max0.03854982058207194
sim_compute_robot_state-ego_mean0.03739390710964288
sim_compute_robot_state-ego_median0.03733115929823656
sim_compute_robot_state-ego_min0.036734180450439455
sim_compute_sim_state_max0.020928621292114254
sim_compute_sim_state_mean0.02032930242316405
sim_compute_sim_state_median0.020246354901060765
sim_compute_sim_state_min0.0199410617351532
sim_physics_max0.04201486706733704
sim_physics_mean0.04020553260882352
sim_physics_median0.04017601994907155
sim_physics_min0.037990452330789445
sim_render-ego_max0.033352114260196686
sim_render-ego_mean0.03246596051164553
sim_render-ego_median0.03241820896373076
sim_render-ego_min0.0316315118004294
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean2.523333333333332
survival_time_min1.6000000000000008
No reset possible
227132920Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationsuccessyesnutonomy-P50-97470:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07158673794245063
survival_time_median1.3500000000000003
deviation-center-line_median0.06608240685201971
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0899724077295374
agent_compute-ego_mean0.08744085143696093
agent_compute-ego_median0.08724072817209605
agent_compute-ego_min0.0846339225769043
deviation-center-line_max0.12472209448104056
deviation-center-line_mean0.07825262092019689
deviation-center-line_min0.04927027945218111
deviation-heading_max0.9205106098327462
deviation-heading_mean0.7906993837132256
deviation-heading_median0.8408022352329987
deviation-heading_min0.4854931921059073
driven_any_max0.20104404950498284
driven_any_mean0.1532752282483308
driven_any_median0.1470390884460707
driven_any_min0.09322908353936342
driven_lanedir_consec_max0.14052137816915788
driven_lanedir_consec_mean0.0810999113480628
driven_lanedir_consec_min0.03111203047955735
driven_lanedir_max0.14052137816915788
driven_lanedir_mean0.0810999113480628
driven_lanedir_median0.07158673794245063
driven_lanedir_min0.03111203047955735
in-drivable-lane_max0.8500000000000005
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2005656054822796, "sim_physics": 0.04052538871765136, "survival_time": 2.000000000000001, "driven_lanedir": 0.0517787602083688, "sim_render-ego": 0.03202379941940307, "in-drivable-lane": 0.8500000000000005, "agent_compute-ego": 0.08904731869697571, "deviation-heading": 0.7141433377212214, "set_robot_commands": 0.05031598806381225, "deviation-center-line": 0.06122970154255067, "driven_lanedir_consec": 0.0517787602083688, "sim_compute_sim_state": 0.020115262269973753, "sim_compute_performance-ego": 0.0355165958404541, "sim_compute_robot_state-ego": 0.036825031042099}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20104404950498284, "sim_physics": 0.04064951837062836, "survival_time": 1.6000000000000008, "driven_lanedir": 0.12896244607290286, "sim_render-ego": 0.035058289766311646, "in-drivable-lane": 0, "agent_compute-ego": 0.08627792447805405, "deviation-heading": 0.9204725877249657, "set_robot_commands": 0.04903363436460495, "deviation-center-line": 0.06608240685201971, "driven_lanedir_consec": 0.12896244607290286, "sim_compute_sim_state": 0.019657492637634277, "sim_compute_performance-ego": 0.034907467663288116, "sim_compute_robot_state-ego": 0.03708796948194504}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09322908353936342, "sim_physics": 0.04007787931533087, "survival_time": 1.0500000000000005, "driven_lanedir": 0.0564597012955006, "sim_render-ego": 0.03156052316938128, "in-drivable-lane": 0, "agent_compute-ego": 0.08740444410414923, "deviation-heading": 0.6950216693210383, "set_robot_commands": 0.04851889610290527, "deviation-center-line": 0.0942554393901761, "driven_lanedir_consec": 0.0564597012955006, "sim_compute_sim_state": 0.020133563450404575, "sim_compute_performance-ego": 0.03488615580967495, "sim_compute_robot_state-ego": 0.03732814107622419}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17817856557718134, "sim_physics": 0.043682298352641445, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07158673794245063, "sim_render-ego": 0.03262079146600539, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.08743914481132262, "deviation-heading": 0.9053006068378135, "set_robot_commands": 0.04946755593822848, "deviation-center-line": 0.05715555530998222, "driven_lanedir_consec": 0.07158673794245063, "sim_compute_sim_state": 0.020297535004154328, "sim_compute_performance-ego": 0.03506059031332693, "sim_compute_robot_state-ego": 0.03723992070844097}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17789848299222463, "sim_physics": 0.04174615355098949, "survival_time": 1.7000000000000008, "driven_lanedir": 0.08828905286060929, "sim_render-ego": 0.03254326652078068, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.08948341537924374, "deviation-heading": 0.9205106098327462, "set_robot_commands": 0.0497132890364703, "deviation-center-line": 0.05863399460166732, "driven_lanedir_consec": 0.08828905286060929, "sim_compute_sim_state": 0.019999034264508418, "sim_compute_performance-ego": 0.03478666614083683, "sim_compute_robot_state-ego": 0.036934824550853056}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.1895834778167244, "sim_physics": 0.04251188845247836, "survival_time": 1.850000000000001, "driven_lanedir": 0.03111203047955735, "sim_render-ego": 0.032652358751039244, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.08724072817209605, "deviation-heading": 0.8618383903122427, "set_robot_commands": 0.0494433931402258, "deviation-center-line": 0.05833395362900171, "driven_lanedir_consec": 0.03111203047955735, "sim_compute_sim_state": 0.02009951746141588, "sim_compute_performance-ego": 0.03608305389816697, "sim_compute_robot_state-ego": 0.037755618224272855}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1869026551080358, "sim_physics": 0.043224544236154266, "survival_time": 1.6500000000000008, "driven_lanedir": 0.14052137816915788, "sim_render-ego": 0.032302198988018616, "in-drivable-lane": 0, "agent_compute-ego": 0.08890543561993224, "deviation-heading": 0.8408022352329987, "set_robot_commands": 0.04980723785631584, "deviation-center-line": 0.11416869572164154, "driven_lanedir_consec": 0.14052137816915788, "sim_compute_sim_state": 0.020109422279126717, "sim_compute_performance-ego": 0.035104802160552055, "sim_compute_robot_state-ego": 0.03764958092660615}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1033870023337533, "sim_physics": 0.04260275477454776, "survival_time": 1.0500000000000005, "driven_lanedir": 0.07007326041275697, "sim_render-ego": 0.031496013913835795, "in-drivable-lane": 0, "agent_compute-ego": 0.08638300214494977, "deviation-heading": 0.6360732372271093, "set_robot_commands": 0.04900170507885161, "deviation-center-line": 0.09116414622074204, "driven_lanedir_consec": 0.07007326041275697, "sim_compute_sim_state": 0.020231315067836216, "sim_compute_performance-ego": 0.03564092091151646, "sim_compute_robot_state-ego": 0.03713761057172503}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.13082081850917188, "sim_physics": 0.04172055537884052, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0665814714006201, "sim_render-ego": 0.03256851893204909, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08723572584298941, "deviation-heading": 0.8497151398181275, "set_robot_commands": 0.050502502001248874, "deviation-center-line": 0.04927027945218111, "driven_lanedir_consec": 0.0665814714006201, "sim_compute_sim_state": 0.02027481335860032, "sim_compute_performance-ego": 0.03563515956585224, "sim_compute_robot_state-ego": 0.037157691442049466}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.10687096842728164, "sim_physics": 0.0429112720489502, "survival_time": 1.2500000000000004, "driven_lanedir": 0.05642687544065117, "sim_render-ego": 0.032940006256103514, "in-drivable-lane": 0, "agent_compute-ego": 0.08817813873291015, "deviation-heading": 0.8078099529903776, "set_robot_commands": 0.04909526824951172, "deviation-center-line": 0.08683705894284759, "driven_lanedir_consec": 0.05642687544065117, "sim_compute_sim_state": 0.01993614196777344, "sim_compute_performance-ego": 0.03569777488708496, "sim_compute_robot_state-ego": 0.03733397483825684}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1470390884460707, "sim_physics": 0.040786531236436635, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11622688714402264, "sim_render-ego": 0.03284203564679181, "in-drivable-lane": 0, "agent_compute-ego": 0.0899724077295374, "deviation-heading": 0.5939272917649253, "set_robot_commands": 0.049409716217606155, "deviation-center-line": 0.1159736520363788, "driven_lanedir_consec": 0.11622688714402264, "sim_compute_sim_state": 0.020615303957903827, "sim_compute_performance-ego": 0.034628347114280415, "sim_compute_robot_state-ego": 0.036817709604899086}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11764582676770426, "sim_physics": 0.042272366010225736, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06376296949631344, "sim_render-ego": 0.03640511402717003, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08700016828683707, "deviation-heading": 0.8390689861434011, "set_robot_commands": 0.0497518227650569, "deviation-center-line": 0.07371404618229968, "driven_lanedir_consec": 0.06376296949631344, "sim_compute_sim_state": 0.019874068406911995, "sim_compute_performance-ego": 0.03557021801288311, "sim_compute_robot_state-ego": 0.036955989324129544}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.19046622053232137, "sim_physics": 0.04110651156481575, "survival_time": 1.7000000000000008, "driven_lanedir": 0.09139504586964198, "sim_render-ego": 0.03390188076916863, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.08593611857470344, "deviation-heading": 0.8766157187457224, "set_robot_commands": 0.04977672941544477, "deviation-center-line": 0.061370071819003794, "driven_lanedir_consec": 0.09139504586964198, "sim_compute_sim_state": 0.020363569259643555, "sim_compute_performance-ego": 0.03553156992968391, "sim_compute_robot_state-ego": 0.036627979839549345}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.13990225046977053, "sim_physics": 0.041807212829589845, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07383233252907173, "sim_render-ego": 0.031493520736694335, "in-drivable-lane": 0, "agent_compute-ego": 0.0846339225769043, "deviation-heading": 0.9136977999197856, "set_robot_commands": 0.04899620056152344, "deviation-center-line": 0.06087821762142067, "driven_lanedir_consec": 0.07383233252907173, "sim_compute_sim_state": 0.020046863555908203, "sim_compute_performance-ego": 0.03481867790222168, "sim_compute_robot_state-ego": 0.036924924850463864}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.13559432821809636, "sim_physics": 0.04209183692932129, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10948972089931663, "sim_render-ego": 0.03202202796936035, "in-drivable-lane": 0, "agent_compute-ego": 0.08647487640380859, "deviation-heading": 0.4854931921059073, "set_robot_commands": 0.04931802749633789, "deviation-center-line": 0.12472209448104056, "driven_lanedir_consec": 0.10948972089931663, "sim_compute_sim_state": 0.019855756759643555, "sim_compute_performance-ego": 0.034697961807250974, "sim_compute_robot_state-ego": 0.03684240341186523}}
set_robot_commands_max0.050502502001248874
set_robot_commands_mean0.04947679775254295
set_robot_commands_median0.0494433931402258
set_robot_commands_min0.04851889610290527
sim_compute_performance-ego_max0.03608305389816697
sim_compute_performance-ego_mean0.035237730797138246
sim_compute_performance-ego_median0.035104802160552055
sim_compute_performance-ego_min0.034628347114280415
sim_compute_robot_state-ego_max0.037755618224272855
sim_compute_robot_state-ego_mean0.03710795799289198
sim_compute_robot_state-ego_median0.03708796948194504
sim_compute_robot_state-ego_min0.036627979839549345
sim_compute_sim_state_max0.020615303957903827
sim_compute_sim_state_mean0.0201073106467626
sim_compute_sim_state_median0.020109422279126717
sim_compute_sim_state_min0.019657492637634277
sim_physics_max0.043682298352641445
sim_physics_mean0.041847780784573456
sim_physics_median0.041807212829589845
sim_physics_min0.04007787931533087
sim_render-ego_max0.03640511402717003
sim_render-ego_mean0.03282868975547423
sim_render-ego_median0.03256851893204909
sim_render-ego_min0.031493520736694335
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.4566666666666672
survival_time_min1.0500000000000005
No reset possible
227072929Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationsuccessyesnutonomy-P50-97470:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.20453316292280643
survival_time_median1.4500000000000006
deviation-center-line_median0.1065996517661108
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09194540208385836
agent_compute-ego_mean0.08903485944469484
agent_compute-ego_median0.08843268394470215
agent_compute-ego_min0.08747576872507731
deviation-center-line_max0.13401789425715713
deviation-center-line_mean0.10617555620835892
deviation-center-line_min0.06588707467883789
deviation-heading_max0.924065884293969
deviation-heading_mean0.6496683954885244
deviation-heading_median0.6374844357576805
deviation-heading_min0.4232817057268506
driven_any_max0.2687247005644067
driven_any_mean0.23277262815534047
driven_any_median0.23720898108388672
driven_any_min0.19084113241363876
driven_lanedir_consec_max0.21365027801071124
driven_lanedir_consec_mean0.18901484195870985
driven_lanedir_consec_min0.15227991498091664
driven_lanedir_max0.21365027801071124
driven_lanedir_mean0.18901484195870985
driven_lanedir_median0.20453316292280643
driven_lanedir_min0.15227991498091664
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2687247005644067, "sim_physics": 0.08053725765597436, "survival_time": 1.5500000000000007, "driven_lanedir": 0.2052858398503823, "sim_render-ego": 0.032356316043484594, "in-drivable-lane": 0, "agent_compute-ego": 0.09194540208385836, "deviation-heading": 0.8016715314787447, "set_robot_commands": 0.05055078383414976, "deviation-center-line": 0.1065996517661108, "driven_lanedir_consec": 0.2052858398503823, "sim_compute_sim_state": 0.020283506762596867, "sim_compute_performance-ego": 0.03480807427437075, "sim_compute_robot_state-ego": 0.03698015213012695, "sim_compute_robot_state-npc0": 0.03548542145759829, "sim_compute_robot_state-npc1": 0.03505106895200668, "sim_compute_robot_state-npc2": 0.035350776487781156, "sim_compute_robot_state-npc3": 0.035224030094762}, "udem1-1-0": {"driven_any": 0.23720898108388672, "sim_physics": 0.0838818961176379, "survival_time": 1.4500000000000006, "driven_lanedir": 0.16932501402873257, "sim_render-ego": 0.03314875734263453, "in-drivable-lane": 0, "agent_compute-ego": 0.08794723708054115, "deviation-heading": 0.924065884293969, "set_robot_commands": 0.05214738023692164, "deviation-center-line": 0.10124575035370076, "driven_lanedir_consec": 0.16932501402873257, "sim_compute_sim_state": 0.020609165060109104, "sim_compute_performance-ego": 0.03446468813665982, "sim_compute_robot_state-ego": 0.03667653840163659, "sim_compute_robot_state-npc0": 0.03626825069559032, "sim_compute_robot_state-npc1": 0.03661921106535813, "sim_compute_robot_state-npc2": 0.036330445059414566, "sim_compute_robot_state-npc3": 0.03677774297780004}, "udem1-2-0": {"driven_any": 0.2389609237721994, "sim_physics": 0.09283319314320884, "survival_time": 1.5000000000000009, "driven_lanedir": 0.21365027801071124, "sim_render-ego": 0.032239278157552086, "in-drivable-lane": 0, "agent_compute-ego": 0.08747576872507731, "deviation-heading": 0.4618384201853773, "set_robot_commands": 0.04832928180694581, "deviation-center-line": 0.13401789425715713, "driven_lanedir_consec": 0.21365027801071124, "sim_compute_sim_state": 0.021012489000956217, "sim_compute_performance-ego": 0.03506945768992106, "sim_compute_robot_state-ego": 0.03687240282694499, "sim_compute_robot_state-npc0": 0.03633581797281901, "sim_compute_robot_state-npc1": 0.03664944966634114, "sim_compute_robot_state-npc2": 0.03629121780395508, "sim_compute_robot_state-npc3": 0.03658889929453532}, "udem1-3-0": {"driven_any": 0.22812740294257092, "sim_physics": 0.08507010766438075, "survival_time": 1.4000000000000006, "driven_lanedir": 0.20453316292280643, "sim_render-ego": 0.03265414919172015, "in-drivable-lane": 0, "agent_compute-ego": 0.0893732053892953, "deviation-heading": 0.4232817057268506, "set_robot_commands": 0.04877062354769025, "deviation-center-line": 0.123127409985988, "driven_lanedir_consec": 0.20453316292280643, "sim_compute_sim_state": 0.020934624331338064, "sim_compute_performance-ego": 0.03492919887815203, "sim_compute_robot_state-ego": 0.03662632192884173, "sim_compute_robot_state-npc0": 0.03582933970860073, "sim_compute_robot_state-npc1": 0.03566129718508039, "sim_compute_robot_state-npc2": 0.03558442422321865, "sim_compute_robot_state-npc3": 0.03591504267283848}, "udem1-4-0": {"driven_any": 0.19084113241363876, "sim_physics": 0.08167321205139161, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15227991498091664, "sim_render-ego": 0.03231807708740234, "in-drivable-lane": 0, "agent_compute-ego": 0.08843268394470215, "deviation-heading": 0.6374844357576805, "set_robot_commands": 0.050458002090454104, "deviation-center-line": 0.06588707467883789, "driven_lanedir_consec": 0.15227991498091664, "sim_compute_sim_state": 0.01998819351196289, "sim_compute_performance-ego": 0.03535227775573731, "sim_compute_robot_state-ego": 0.03708992958068848, "sim_compute_robot_state-npc0": 0.035353565216064455, "sim_compute_robot_state-npc1": 0.03569354057312012, "sim_compute_robot_state-npc2": 0.03507904052734375, "sim_compute_robot_state-npc3": 0.03496994972229004}}
set_robot_commands_max0.05214738023692164
set_robot_commands_mean0.050051214303232304
set_robot_commands_median0.050458002090454104
set_robot_commands_min0.04832928180694581
sim_compute_performance-ego_max0.03535227775573731
sim_compute_performance-ego_mean0.034924739346968194
sim_compute_performance-ego_median0.03492919887815203
sim_compute_performance-ego_min0.03446468813665982
sim_compute_robot_state-ego_max0.03708992958068848
sim_compute_robot_state-ego_mean0.036849068973647744
sim_compute_robot_state-ego_median0.03687240282694499
sim_compute_robot_state-ego_min0.03662632192884173
sim_compute_robot_state-npc0_max0.03633581797281901
sim_compute_robot_state-npc0_mean0.03585447901013456
sim_compute_robot_state-npc0_median0.03582933970860073
sim_compute_robot_state-npc0_min0.035353565216064455
sim_compute_robot_state-npc1_max0.03664944966634114
sim_compute_robot_state-npc1_mean0.03593491348838129
sim_compute_robot_state-npc1_median0.03569354057312012
sim_compute_robot_state-npc1_min0.03505106895200668
sim_compute_robot_state-npc2_max0.036330445059414566
sim_compute_robot_state-npc2_mean0.03572718082034264
sim_compute_robot_state-npc2_median0.03558442422321865
sim_compute_robot_state-npc2_min0.03507904052734375
sim_compute_robot_state-npc3_max0.03677774297780004
sim_compute_robot_state-npc3_mean0.035895132952445175
sim_compute_robot_state-npc3_median0.03591504267283848
sim_compute_robot_state-npc3_min0.03496994972229004
sim_compute_sim_state_max0.021012489000956217
sim_compute_sim_state_mean0.020565595733392627
sim_compute_sim_state_median0.020609165060109104
sim_compute_sim_state_min0.01998819351196289
sim_physics_max0.09283319314320884
sim_physics_mean0.08479913332651869
sim_physics_median0.0838818961176379
sim_physics_min0.08053725765597436
sim_render-ego_max0.03314875734263453
sim_render-ego_mean0.03254331556455874
sim_render-ego_median0.032356316043484594
sim_render-ego_min0.032239278157552086
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.4300000000000004
survival_time_min1.2500000000000004
No reset possible
227052936Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerroryesnutonomy-P50-97470:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227032940Bhairav MehtaBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryesnutonomy-P50-97470:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226853494Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-real-validationeval0-videossuccessnonutonomy-P50-97470:30:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226283535Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-real-validationeval0-extractATsabortednonutonomy-P50-97470:23:12
The result file is n [...]
The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation/submission3535/eval0-extractATs-nutonomy-P50-9747-job22628:

File '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation/submission3535/eval0-extractATs-nutonomy-P50-9747-job22628/challenge-results/challenge_results.yaml' does not exist. 

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226193535Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-real-validationeval0-videossuccessnonutonomy-P50-97470:19:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible