Duckietown Challenges Home Challenges Submissions

Evaluator 1613

ID1613
evaluatorip-172-31-46-148-10492
ownerI don't have one 😀
machineip-172-31-46-148
processip-172-31-46-148-10492
versiond-c:5.1.1;d-c-r:5.0.12;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success186 25232
# timeout
# failed10 26238
# error40 25433
# aborted11 26008
# host-error19 25195
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
308096329YUNG-CHIEN CHOU 🇹🇼challenge-aido_LF-template-randomaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.014884105095496545
agent_compute-ego_mean0.01441518091939854
agent_compute-ego_median0.014259330561903656
agent_compute-ego_min0.013893604278564451
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.0589141478905311, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.007449888266049898, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.014884105095496545, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.0051342432315532975, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.0030293648059551534, "sim_compute_performance-ego": 0.004302061521089994, "sim_compute_robot_state-ego": 0.0053185132833627555}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06427348852157592, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.007230150699615479, "in-drivable-lane": 0, "agent_compute-ego": 0.013893604278564451, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.005042910575866699, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.0029226183891296388, "sim_compute_performance-ego": 0.003962218761444092, "sim_compute_robot_state-ego": 0.0051890254020690914}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.059993708834928626, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.007462789030636058, "in-drivable-lane": 0, "agent_compute-ego": 0.014257248710183535, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.004917137763079475, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.0030050978941075944, "sim_compute_performance-ego": 0.0040115398519179404, "sim_compute_robot_state-ego": 0.005352076362161075}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.06077271993042993, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.00752293086442791, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.014259330561903656, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.00802957034501873, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.0031058944639612415, "sim_compute_performance-ego": 0.004139732141963771, "sim_compute_robot_state-ego": 0.005320044814563188}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.06625593792308461, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.007861419157548384, "in-drivable-lane": 0, "agent_compute-ego": 0.014781615950844504, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.005237427624789151, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.0031951774250377307, "sim_compute_performance-ego": 0.004162322391163219, "sim_compute_robot_state-ego": 0.0054847002029418945}}
set_robot_commands_max0.00802957034501873
set_robot_commands_mean0.005672257908061471
set_robot_commands_median0.0051342432315532975
set_robot_commands_min0.004917137763079475
sim_compute_performance-ego_max0.004302061521089994
sim_compute_performance-ego_mean0.004115574933515803
sim_compute_performance-ego_median0.004139732141963771
sim_compute_performance-ego_min0.003962218761444092
sim_compute_robot_state-ego_max0.0054847002029418945
sim_compute_robot_state-ego_mean0.005332872013019601
sim_compute_robot_state-ego_median0.005320044814563188
sim_compute_robot_state-ego_min0.0051890254020690914
sim_compute_sim_state_max0.0031951774250377307
sim_compute_sim_state_mean0.003051630595638272
sim_compute_sim_state_median0.0030293648059551534
sim_compute_sim_state_min0.0029226183891296388
sim_physics_max0.06625593792308461
sim_physics_mean0.06204200062011004
sim_physics_median0.06077271993042993
sim_physics_min0.0589141478905311
sim_render-ego_max0.007861419157548384
sim_render-ego_mean0.007505435603655545
sim_render-ego_median0.007462789030636058
sim_render-ego_min0.007230150699615479
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
307996324Maxim Derksenchallenge-aido_LF-template-randomaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01451176404953003
agent_compute-ego_mean0.01415629314040703
agent_compute-ego_median0.014106468720869583
agent_compute-ego_min0.013960291357601393
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.05883513047144963, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.007239699363708496, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.01451176404953003, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.005142881320073054, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.0029091835021972656, "sim_compute_performance-ego": 0.004258467600895808, "sim_compute_robot_state-ego": 0.005288422107696533}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06057072877883911, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.007291948795318604, "in-drivable-lane": 0, "agent_compute-ego": 0.014045321941375732, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.004932582378387451, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.0028348445892333986, "sim_compute_performance-ego": 0.004002499580383301, "sim_compute_robot_state-ego": 0.005176281929016114}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.05945788411533131, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.007305425756117877, "in-drivable-lane": 0, "agent_compute-ego": 0.013960291357601393, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.004912698970121496, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.0028496489805333756, "sim_compute_performance-ego": 0.0040703871670891255, "sim_compute_robot_state-ego": 0.005252550630008473}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.05786611603908851, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.007208898419239482, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.014157619632658412, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.004977796898513544, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.0028874678689925397, "sim_compute_performance-ego": 0.003968391262116979, "sim_compute_robot_state-ego": 0.005142567587680504}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.06161790544336492, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.007354617118835449, "in-drivable-lane": 0, "agent_compute-ego": 0.014106468720869583, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.004901896823536266, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.002877798947420987, "sim_compute_performance-ego": 0.003982413898814808, "sim_compute_robot_state-ego": 0.005228281021118164}}
set_robot_commands_max0.005142881320073054
set_robot_commands_mean0.004973571278126363
set_robot_commands_median0.004932582378387451
set_robot_commands_min0.004901896823536266
sim_compute_performance-ego_max0.004258467600895808
sim_compute_performance-ego_mean0.004056431901860004
sim_compute_performance-ego_median0.004002499580383301
sim_compute_performance-ego_min0.003968391262116979
sim_compute_robot_state-ego_max0.005288422107696533
sim_compute_robot_state-ego_mean0.005217620655103958
sim_compute_robot_state-ego_median0.005228281021118164
sim_compute_robot_state-ego_min0.005142567587680504
sim_compute_sim_state_max0.0029091835021972656
sim_compute_sim_state_mean0.002871788777675513
sim_compute_sim_state_median0.002877798947420987
sim_compute_sim_state_min0.0028348445892333986
sim_physics_max0.06161790544336492
sim_physics_mean0.059669552969614695
sim_physics_median0.05945788411533131
sim_physics_min0.05786611603908851
sim_render-ego_max0.007354617118835449
sim_render-ego_mean0.0072801178906439805
sim_render-ego_median0.007291948795318604
sim_render-ego_min0.007208898419239482
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
307896319Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:02:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
307596303Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:11:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
307466297Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:08:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8731023916270946
survival_time_median14.950000000000076
deviation-center-line_median0.6483412442223273
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02264381806055705
agent_compute-ego_mean0.0214114359219869
agent_compute-ego_median0.021397371292114255
agent_compute-ego_min0.02062296787897746
deviation-center-line_max1.0233979990998336
deviation-center-line_mean0.6975561310392354
deviation-center-line_min0.5295468540523574
deviation-heading_max2.9452470898234484
deviation-heading_mean2.1382062277652167
deviation-heading_median2.0802861885976016
deviation-heading_min1.3038380054976115
driven_any_max3.7313588936496207
driven_any_mean3.0155902298710857
driven_any_median2.902822436644538
driven_any_min2.7340038757630016
driven_lanedir_consec_max3.7132045748534535
driven_lanedir_consec_mean2.9694491751525263
driven_lanedir_consec_min2.6388202549027344
driven_lanedir_max3.7132045748534535
driven_lanedir_mean2.9694491751525263
driven_lanedir_median2.8731023916270946
driven_lanedir_min2.6388202549027344
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.775686397513905, "sim_physics": 0.07693417231241861, "survival_time": 14.950000000000076, "driven_lanedir": 2.7220299751682373, "sim_render-ego": 0.007920334339141846, "in-drivable-lane": 0, "agent_compute-ego": 0.02264381806055705, "deviation-heading": 2.3619788422376353, "set_robot_commands": 0.009035977522532143, "deviation-center-line": 0.673379573194821, "driven_lanedir_consec": 2.7220299751682373, "sim_compute_sim_state": 0.004765630563100179, "sim_compute_performance-ego": 0.004837143421173096, "sim_compute_robot_state-ego": 0.006205290953318278}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.902822436644538, "sim_physics": 0.07583557764689128, "survival_time": 14.950000000000076, "driven_lanedir": 2.8731023916270946, "sim_render-ego": 0.008145856062571207, "in-drivable-lane": 0, "agent_compute-ego": 0.02072891632715861, "deviation-heading": 1.9996810126697868, "set_robot_commands": 0.00917487382888794, "deviation-center-line": 0.6131149846268379, "driven_lanedir_consec": 2.8731023916270946, "sim_compute_sim_state": 0.004859530131022136, "sim_compute_performance-ego": 0.004812589486440023, "sim_compute_robot_state-ego": 0.0063541197776794435}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7340038757630016, "sim_physics": 0.07882030725479126, "survival_time": 14.950000000000076, "driven_lanedir": 2.6388202549027344, "sim_render-ego": 0.007989002068837485, "in-drivable-lane": 0, "agent_compute-ego": 0.021397371292114255, "deviation-heading": 2.9452470898234484, "set_robot_commands": 0.009137845039367676, "deviation-center-line": 1.0233979990998336, "driven_lanedir_consec": 2.6388202549027344, "sim_compute_sim_state": 0.004878370761871338, "sim_compute_performance-ego": 0.0046607128779093425, "sim_compute_robot_state-ego": 0.006009112993876139}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.7313588936496207, "sim_physics": 0.07817103068033854, "survival_time": 14.950000000000076, "driven_lanedir": 3.7132045748534535, "sim_render-ego": 0.007971850236256918, "in-drivable-lane": 0, "agent_compute-ego": 0.02062296787897746, "deviation-heading": 1.3038380054976115, "set_robot_commands": 0.009165276686350504, "deviation-center-line": 0.5295468540523574, "driven_lanedir_consec": 3.7132045748534535, "sim_compute_sim_state": 0.005018436113993327, "sim_compute_performance-ego": 0.004871561527252198, "sim_compute_robot_state-ego": 0.006311713059743245}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.9340795457843636, "sim_physics": 0.07925689220428467, "survival_time": 14.950000000000076, "driven_lanedir": 2.9000886792111116, "sim_render-ego": 0.008254915873209635, "in-drivable-lane": 0, "agent_compute-ego": 0.021664106051127115, "deviation-heading": 2.0802861885976016, "set_robot_commands": 0.009161651929219564, "deviation-center-line": 0.6483412442223273, "driven_lanedir_consec": 2.9000886792111116, "sim_compute_sim_state": 0.004967790444691976, "sim_compute_performance-ego": 0.004990247885386149, "sim_compute_robot_state-ego": 0.00642225980758667}}
set_robot_commands_max0.00917487382888794
set_robot_commands_mean0.009135125001271564
set_robot_commands_median0.009161651929219564
set_robot_commands_min0.009035977522532143
sim_compute_performance-ego_max0.004990247885386149
sim_compute_performance-ego_mean0.004834451039632161
sim_compute_performance-ego_median0.004837143421173096
sim_compute_performance-ego_min0.0046607128779093425
sim_compute_robot_state-ego_max0.00642225980758667
sim_compute_robot_state-ego_mean0.006260499318440754
sim_compute_robot_state-ego_median0.006311713059743245
sim_compute_robot_state-ego_min0.006009112993876139
sim_compute_sim_state_max0.005018436113993327
sim_compute_sim_state_mean0.004897951602935791
sim_compute_sim_state_median0.004878370761871338
sim_compute_sim_state_min0.004765630563100179
sim_physics_max0.07925689220428467
sim_physics_mean0.07780359601974488
sim_physics_median0.07817103068033854
sim_physics_min0.07583557764689128
sim_render-ego_max0.008254915873209635
sim_render-ego_mean0.00805639171600342
sim_render-ego_median0.007989002068837485
sim_render-ego_min0.007920334339141846
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
306126123Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-real-validationeval1-visualizesuccessnoip-172-31-46-148-104920:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.8964258413362156
survival_time9.3333
deviation-center-line0.3671228496318495
in-drivable-lane3.3332999999999995


other stats
deviation-heading0.8761507793575634
driven_any2.613025437077337
driven_lanedir1.8964258413362156
visualized-eval1-passed1
No reset possible
305495977c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LFV-real-validationeval1-videossuccessnoip-172-31-46-148-104920:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
305475977c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LFV-real-validationeval0-videossuccessnoip-172-31-46-148-104920:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
305366058Frank (Chude) Qian 🇨🇦2019-12-10|FrankNet|(Kay❤️Frank)aido3-LF-real-validationeval0-visualizesuccessnoip-172-31-46-148-104920:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.3647576089866127
survival_time9.3333
deviation-center-line0.3076661664434663
in-drivable-lane4.6666


other stats
deviation-heading0.4719928452173808
driven_any2.126784273002851
driven_lanedir1.3647576089866127
visualized-eval0-passed1
No reset possible
305196063Oliver Widlerchallenge-aido_LF-template-pytorchaido3-LF-real-validationeval0-videossuccessnoip-172-31-46-148-104920:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
305125941Aleksei Shpilman 🇷🇺challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-videossuccessnoip-172-31-46-148-104920:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
305065941Aleksei Shpilman 🇷🇺challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-visualizeabortednoip-172-31-46-148-104920:02:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(logdir, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 41, in evaluate_robotarium_log
    d = yaml.load(open(mapfile).read())
FileNotFoundError: [Errno 2] No such file or directory: '/challenges/previous-steps/eval2/trajectories/map.yaml'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(cie)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
305015826Robert Moni 🇭🇺kaland-225308aido3-LF-real-validationeval2-videossuccessnoip-172-31-46-148-104920:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
304955826Robert Moni 🇭🇺kaland-225308aido3-LF-real-validationeval1-videossuccessnoip-172-31-46-148-104920:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
304945826Robert Moni 🇭🇺kaland-225308aido3-LF-real-validationeval0-visualizesuccessnoip-172-31-46-148-104920:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5237365956717164
survival_time8.6667
deviation-center-line0.2145614548226669
in-drivable-lane4.6667000000000005


other stats
deviation-heading1.6227309266804872
driven_any1.6783693749728987
driven_lanedir0.5237365956717164
visualized-eval0-passed1
No reset possible
304905897Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-real-validationeval2-visualizesuccessnoip-172-31-46-148-104920:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.7884289455276379
survival_time7.3333
deviation-center-line0.2534912484731812
in-drivable-lane1.3333000000000004


other stats
deviation-heading0.7779439046472226
driven_any0.9886612480548674
driven_lanedir0.7884289455276379
visualized-eval2-passed1
No reset possible
304696281Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:12:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.543907071003018
survival_time_median14.950000000000076
deviation-center-line_median0.5061068045519777
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05277583122253418
agent_compute-ego_mean0.044871098200480145
agent_compute-ego_median0.044667383829752605
agent_compute-ego_min0.035205926100413
deviation-center-line_max0.8696266337821387
deviation-center-line_mean0.6325084480258482
deviation-center-line_min0.4445201659010437
deviation-heading_max4.4602504397999265
deviation-heading_mean3.164982432359738
deviation-heading_median3.079926689816748
deviation-heading_min2.4525519543882437
driven_any_max4.146831504633919
driven_any_mean3.624993784231669
driven_any_median3.724438059901764
driven_any_min2.7588419886989852
driven_lanedir_consec_max4.043929761783956
driven_lanedir_consec_mean3.4462486132430294
driven_lanedir_consec_min2.5761679084150115
driven_lanedir_max4.043929761783956
driven_lanedir_mean3.4462486132430294
driven_lanedir_median3.543907071003018
driven_lanedir_min2.5761679084150115
in-drivable-lane_max1.9000000000000004
in-drivable-lane_mean0.38000000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7588419886989852, "sim_physics": 0.1164719804128011, "survival_time": 14.950000000000076, "driven_lanedir": 2.5761679084150115, "sim_render-ego": 0.01238633950551351, "in-drivable-lane": 0, "agent_compute-ego": 0.035205926100413, "deviation-heading": 4.4602504397999265, "set_robot_commands": 0.012137564023335774, "deviation-center-line": 0.8696266337821387, "driven_lanedir_consec": 2.5761679084150115, "sim_compute_sim_state": 0.005732520421346029, "sim_compute_performance-ego": 0.007727484703063964, "sim_compute_robot_state-ego": 0.009609500567118326}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.624784993882325, "sim_physics": 0.11718817313512166, "survival_time": 14.950000000000076, "driven_lanedir": 3.543907071003018, "sim_render-ego": 0.013511387507120769, "in-drivable-lane": 0, "agent_compute-ego": 0.05277583122253418, "deviation-heading": 2.6959945293854877, "set_robot_commands": 0.010682857036590577, "deviation-center-line": 0.5061068045519777, "driven_lanedir_consec": 3.543907071003018, "sim_compute_sim_state": 0.005616401831309001, "sim_compute_performance-ego": 0.008247907956441243, "sim_compute_robot_state-ego": 0.010286686420440672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.870072374041348, "sim_physics": 0.12039286454518636, "survival_time": 14.950000000000076, "driven_lanedir": 3.4073056336860836, "sim_render-ego": 0.01372357447942098, "in-drivable-lane": 1.9000000000000004, "agent_compute-ego": 0.05081245660781861, "deviation-heading": 3.079926689816748, "set_robot_commands": 0.011418890953063966, "deviation-center-line": 0.8523316036576907, "driven_lanedir_consec": 3.4073056336860836, "sim_compute_sim_state": 0.005635212262471517, "sim_compute_performance-ego": 0.008212448755900065, "sim_compute_robot_state-ego": 0.010251617431640624}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.724438059901764, "sim_physics": 0.07849744081497192, "survival_time": 14.950000000000076, "driven_lanedir": 3.659932691327074, "sim_render-ego": 0.009645876089731852, "in-drivable-lane": 0, "agent_compute-ego": 0.04089389324188233, "deviation-heading": 2.4525519543882437, "set_robot_commands": 0.00700739065806071, "deviation-center-line": 0.48995703223638953, "driven_lanedir_consec": 3.659932691327074, "sim_compute_sim_state": 0.0041342973709106445, "sim_compute_performance-ego": 0.005654417673746745, "sim_compute_robot_state-ego": 0.0070331398646036785}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.146831504633919, "sim_physics": 0.09072194894154868, "survival_time": 14.950000000000076, "driven_lanedir": 4.043929761783956, "sim_render-ego": 0.010430688858032227, "in-drivable-lane": 0, "agent_compute-ego": 0.044667383829752605, "deviation-heading": 3.136188548408285, "set_robot_commands": 0.00839730421702067, "deviation-center-line": 0.4445201659010437, "driven_lanedir_consec": 4.043929761783956, "sim_compute_sim_state": 0.004331566492716471, "sim_compute_performance-ego": 0.006113549868265788, "sim_compute_robot_state-ego": 0.00765689214070638}}
set_robot_commands_max0.012137564023335774
set_robot_commands_mean0.009928801377614338
set_robot_commands_median0.010682857036590577
set_robot_commands_min0.00700739065806071
sim_compute_performance-ego_max0.008247907956441243
sim_compute_performance-ego_mean0.007191161791483561
sim_compute_performance-ego_median0.007727484703063964
sim_compute_performance-ego_min0.005654417673746745
sim_compute_robot_state-ego_max0.010286686420440672
sim_compute_robot_state-ego_mean0.008967567284901938
sim_compute_robot_state-ego_median0.009609500567118326
sim_compute_robot_state-ego_min0.0070331398646036785
sim_compute_sim_state_max0.005732520421346029
sim_compute_sim_state_mean0.005089999675750733
sim_compute_sim_state_median0.005616401831309001
sim_compute_sim_state_min0.0041342973709106445
sim_physics_max0.12039286454518636
sim_physics_mean0.10465448156992592
sim_physics_median0.1164719804128011
sim_physics_min0.07849744081497192
sim_render-ego_max0.01372357447942098
sim_render-ego_mean0.011939573287963866
sim_render-ego_median0.01238633950551351
sim_render-ego_min0.009645876089731852
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
304436277Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:14:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8539199649317357
survival_time_median14.950000000000076
deviation-center-line_median0.8094081829211389
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04295552492141723
agent_compute-ego_mean0.037675009250640865
agent_compute-ego_median0.03609119176864624
agent_compute-ego_min0.03156948566436767
deviation-center-line_max0.9885738413491516
deviation-center-line_mean0.8409133336378195
deviation-center-line_min0.741295134097205
deviation-heading_max4.452178449789174
deviation-heading_mean3.842518578963296
deviation-heading_median3.784314928815691
deviation-heading_min3.447753698663899
driven_any_max3.1510276603819554
driven_any_mean2.9652071399189177
driven_any_median3.007205566932868
driven_any_min2.632870740420795
driven_lanedir_consec_max2.877390212576157
driven_lanedir_consec_mean2.7714616619434276
driven_lanedir_consec_min2.464484604243201
driven_lanedir_max2.877390212576157
driven_lanedir_mean2.7714616619434276
driven_lanedir_median2.8539199649317357
driven_lanedir_min2.464484604243201
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.5200000000000019
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.007205566932868, "sim_physics": 0.10272941907246907, "survival_time": 14.950000000000076, "driven_lanedir": 2.866777854141637, "sim_render-ego": 0.007268225351969401, "in-drivable-lane": 0, "agent_compute-ego": 0.03156948566436767, "deviation-heading": 3.784314928815691, "set_robot_commands": 0.00579749584197998, "deviation-center-line": 0.9026195439773964, "driven_lanedir_consec": 2.866777854141637, "sim_compute_sim_state": 0.003030244509379069, "sim_compute_performance-ego": 0.004151748021443685, "sim_compute_robot_state-ego": 0.005352893670399984, "sim_compute_robot_state-npc0": 0.005415663719177246, "sim_compute_robot_state-npc1": 0.004878102938334147, "sim_compute_robot_state-npc2": 0.004843858083089193, "sim_compute_robot_state-npc3": 0.004847316741943359}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.991403233953611, "sim_physics": 0.11429238398869832, "survival_time": 14.950000000000076, "driven_lanedir": 2.877390212576157, "sim_render-ego": 0.007307328383127848, "in-drivable-lane": 0, "agent_compute-ego": 0.03609119176864624, "deviation-heading": 3.447753698663899, "set_robot_commands": 0.005298613707224528, "deviation-center-line": 0.7626699658442051, "driven_lanedir_consec": 2.877390212576157, "sim_compute_sim_state": 0.0030541197458902993, "sim_compute_performance-ego": 0.0041691223780314125, "sim_compute_robot_state-ego": 0.005378318627675374, "sim_compute_robot_state-npc0": 0.005270076592763265, "sim_compute_robot_state-npc1": 0.004905210336049398, "sim_compute_robot_state-npc2": 0.004902176856994629, "sim_compute_robot_state-npc3": 0.004879967371622721}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.0435284979053563, "sim_physics": 0.10226814905802407, "survival_time": 14.950000000000076, "driven_lanedir": 2.7947356738244085, "sim_render-ego": 0.007257299423217773, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.035859713554382326, "deviation-heading": 3.9137890637811967, "set_robot_commands": 0.005231703122456868, "deviation-center-line": 0.8094081829211389, "driven_lanedir_consec": 2.7947356738244085, "sim_compute_sim_state": 0.003010392189025879, "sim_compute_performance-ego": 0.004146912892659505, "sim_compute_robot_state-ego": 0.00538148562113444, "sim_compute_robot_state-npc0": 0.00519900639851888, "sim_compute_robot_state-npc1": 0.004810442129770914, "sim_compute_robot_state-npc2": 0.004783343474070231, "sim_compute_robot_state-npc3": 0.004806323846181234}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.632870740420795, "sim_physics": 0.14640905221303305, "survival_time": 14.950000000000076, "driven_lanedir": 2.464484604243201, "sim_render-ego": 0.00912325143814087, "in-drivable-lane": 0, "agent_compute-ego": 0.04295552492141723, "deviation-heading": 4.452178449789174, "set_robot_commands": 0.006940960884094238, "deviation-center-line": 0.9885738413491516, "driven_lanedir_consec": 2.464484604243201, "sim_compute_sim_state": 0.003775211175282796, "sim_compute_performance-ego": 0.0052073287963867185, "sim_compute_robot_state-ego": 0.006767476399739583, "sim_compute_robot_state-npc0": 0.00675087054570516, "sim_compute_robot_state-npc1": 0.006493817965189616, "sim_compute_robot_state-npc2": 0.006256037553151448, "sim_compute_robot_state-npc3": 0.0063100870450337725}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1510276603819554, "sim_physics": 0.13358838558197025, "survival_time": 14.950000000000076, "driven_lanedir": 2.8539199649317357, "sim_render-ego": 0.009529290994008382, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.04189913034439087, "deviation-heading": 3.6145567537665166, "set_robot_commands": 0.00775132417678833, "deviation-center-line": 0.741295134097205, "driven_lanedir_consec": 2.8539199649317357, "sim_compute_sim_state": 0.003921028772989909, "sim_compute_performance-ego": 0.005547095934549967, "sim_compute_robot_state-ego": 0.007040011088053385, "sim_compute_robot_state-npc0": 0.007017676035563151, "sim_compute_robot_state-npc1": 0.006624160607655843, "sim_compute_robot_state-npc2": 0.006502649784088135, "sim_compute_robot_state-npc3": 0.006590028603871663}}
set_robot_commands_max0.00775132417678833
set_robot_commands_mean0.0062040195465087895
set_robot_commands_median0.00579749584197998
set_robot_commands_min0.005231703122456868
sim_compute_performance-ego_max0.005547095934549967
sim_compute_performance-ego_mean0.004644441604614257
sim_compute_performance-ego_median0.0041691223780314125
sim_compute_performance-ego_min0.004146912892659505
sim_compute_robot_state-ego_max0.007040011088053385
sim_compute_robot_state-ego_mean0.005984037081400553
sim_compute_robot_state-ego_median0.00538148562113444
sim_compute_robot_state-ego_min0.005352893670399984
sim_compute_robot_state-npc0_max0.007017676035563151
sim_compute_robot_state-npc0_mean0.0059306586583455405
sim_compute_robot_state-npc0_median0.005415663719177246
sim_compute_robot_state-npc0_min0.00519900639851888
sim_compute_robot_state-npc1_max0.006624160607655843
sim_compute_robot_state-npc1_mean0.005542346795399984
sim_compute_robot_state-npc1_median0.004905210336049398
sim_compute_robot_state-npc1_min0.004810442129770914
sim_compute_robot_state-npc2_max0.006502649784088135
sim_compute_robot_state-npc2_mean0.005457613150278727
sim_compute_robot_state-npc2_median0.004902176856994629
sim_compute_robot_state-npc2_min0.004783343474070231
sim_compute_robot_state-npc3_max0.006590028603871663
sim_compute_robot_state-npc3_mean0.00548674472173055
sim_compute_robot_state-npc3_median0.004879967371622721
sim_compute_robot_state-npc3_min0.004806323846181234
sim_compute_sim_state_max0.003921028772989909
sim_compute_sim_state_mean0.0033581992785135907
sim_compute_sim_state_median0.0030541197458902993
sim_compute_sim_state_min0.003010392189025879
sim_physics_max0.14640905221303305
sim_physics_mean0.11985747798283897
sim_physics_median0.11429238398869832
sim_physics_min0.10226814905802407
sim_render-ego_max0.009529290994008382
sim_render-ego_mean0.008097079118092853
sim_render-ego_median0.007307328383127848
sim_render-ego_min0.007257299423217773
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
304285897Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-real-validationeval0-videossuccessnoip-172-31-46-148-104920:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
304046264Aleksei Shpilman 🇷🇺0531 seasonsaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:11:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.587155649796836
survival_time_median13.05000000000005
deviation-center-line_median0.9775446560671428
in-drivable-lane_median1.1000000000000156


other stats
agent_compute-ego_max0.026995864936283656
agent_compute-ego_mean0.02447655991546525
agent_compute-ego_median0.024155054773603166
agent_compute-ego_min0.022919645711379947
deviation-center-line_max1.0413649776966898
deviation-center-line_mean0.8371102921666743
deviation-center-line_min0.24060089731928147
deviation-heading_max4.632460558457808
deviation-heading_mean3.539422603009599
deviation-heading_median3.917904148128017
deviation-heading_min0.7855776932129415
driven_any_max5.358449914373121
driven_any_mean4.0961858045584165
driven_any_median4.293720972369107
driven_any_min2.360332463612415
driven_lanedir_consec_max4.923650311081214
driven_lanedir_consec_mean3.5392987506849267
driven_lanedir_consec_min2.2618913401108216
driven_lanedir_max4.923650311081214
driven_lanedir_mean3.5392987506849267
driven_lanedir_median3.587155649796836
driven_lanedir_min2.2618913401108216
in-drivable-lane_max3.1000000000000245
in-drivable-lane_mean1.1600000000000077
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.447126865150667, "sim_physics": 0.096979592527662, "survival_time": 14.000000000000064, "driven_lanedir": 3.2173186130265514, "sim_render-ego": 0.011056184768676758, "in-drivable-lane": 3.1000000000000245, "agent_compute-ego": 0.026995864936283656, "deviation-heading": 4.632460558457808, "set_robot_commands": 0.008700752258300781, "deviation-center-line": 0.92403112269364, "driven_lanedir_consec": 3.2173186130265514, "sim_compute_sim_state": 0.00456781131880624, "sim_compute_performance-ego": 0.006417640617915562, "sim_compute_robot_state-ego": 0.008065662213734217}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.293720972369107, "sim_physics": 0.08128375020520441, "survival_time": 13.05000000000005, "driven_lanedir": 3.587155649796836, "sim_render-ego": 0.009731743070814343, "in-drivable-lane": 1.2499999999999991, "agent_compute-ego": 0.022919645711379947, "deviation-heading": 4.521846772316645, "set_robot_commands": 0.007546227553795124, "deviation-center-line": 0.9775446560671428, "driven_lanedir_consec": 3.587155649796836, "sim_compute_sim_state": 0.004232131658385997, "sim_compute_performance-ego": 0.005675896830942439, "sim_compute_robot_state-ego": 0.0070835438724678595}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.360332463612415, "sim_physics": 0.0832087365063754, "survival_time": 5.4999999999999885, "driven_lanedir": 2.2618913401108216, "sim_render-ego": 0.009558144482699309, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.02345933047207919, "deviation-heading": 0.7855776932129415, "set_robot_commands": 0.007183191993019798, "deviation-center-line": 0.24060089731928147, "driven_lanedir_consec": 2.2618913401108216, "sim_compute_sim_state": 0.003993834148753773, "sim_compute_performance-ego": 0.005403976006941362, "sim_compute_robot_state-ego": 0.0067857633937488905}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.0212988072867715, "sim_physics": 0.08071178648652148, "survival_time": 11.900000000000034, "driven_lanedir": 3.706477839409211, "sim_render-ego": 0.009742138766441024, "in-drivable-lane": 0, "agent_compute-ego": 0.024155054773603166, "deviation-heading": 3.917904148128017, "set_robot_commands": 0.007753248976058319, "deviation-center-line": 1.0413649776966898, "driven_lanedir_consec": 3.706477839409211, "sim_compute_sim_state": 0.004047164396077645, "sim_compute_performance-ego": 0.005530438503297437, "sim_compute_robot_state-ego": 0.006913493661319508}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.358449914373121, "sim_physics": 0.08225536743799845, "survival_time": 14.950000000000076, "driven_lanedir": 4.923650311081214, "sim_render-ego": 0.009564239184061686, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.024852903683980306, "deviation-heading": 3.839323842932582, "set_robot_commands": 0.007591014703114828, "deviation-center-line": 1.002009807056618, "driven_lanedir_consec": 4.923650311081214, "sim_compute_sim_state": 0.004094280401865641, "sim_compute_performance-ego": 0.005515730381011963, "sim_compute_robot_state-ego": 0.006930112838745117}}
set_robot_commands_max0.008700752258300781
set_robot_commands_mean0.0077548870968577694
set_robot_commands_median0.007591014703114828
set_robot_commands_min0.007183191993019798
sim_compute_performance-ego_max0.006417640617915562
sim_compute_performance-ego_mean0.005708736468021752
sim_compute_performance-ego_median0.005530438503297437
sim_compute_performance-ego_min0.005403976006941362
sim_compute_robot_state-ego_max0.008065662213734217
sim_compute_robot_state-ego_mean0.007155715196003118
sim_compute_robot_state-ego_median0.006930112838745117
sim_compute_robot_state-ego_min0.0067857633937488905
sim_compute_sim_state_max0.00456781131880624
sim_compute_sim_state_mean0.004187044384777859
sim_compute_sim_state_median0.004094280401865641
sim_compute_sim_state_min0.003993834148753773
sim_physics_max0.096979592527662
sim_physics_mean0.08488784663275235
sim_physics_median0.08225536743799845
sim_physics_min0.08071178648652148
sim_render-ego_max0.011056184768676758
sim_render-ego_mean0.009930490054538624
sim_render-ego_median0.009731743070814343
sim_render-ego_min0.009558144482699309
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.880000000000043
survival_time_min5.4999999999999885
No reset possible
303966262Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1927494192511956
survival_time_median14.950000000000076
deviation-center-line_median0.6657081440228224
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016570242245992024
agent_compute-ego_mean0.01612865098317464
agent_compute-ego_median0.016069286664326984
agent_compute-ego_min0.015948647658030193
deviation-center-line_max0.8287513922658546
deviation-center-line_mean0.6824994104983244
deviation-center-line_min0.49175671326097153
deviation-heading_max3.463011765125806
deviation-heading_mean3.180772391091236
deviation-heading_median3.4067108970362527
deviation-heading_min2.7610493351802257
driven_any_max3.858547765413843
driven_any_mean3.3790779949988505
driven_any_median3.289667553293494
driven_any_min3.0138394610013046
driven_lanedir_consec_max3.615837275509023
driven_lanedir_consec_mean3.223611030333232
driven_lanedir_consec_min2.9061809253583792
driven_lanedir_max3.615837275509023
driven_lanedir_mean3.223611030333232
driven_lanedir_median3.1927494192511956
driven_lanedir_min2.9061809253583792
in-drivable-lane_max2.0000000000000115
in-drivable-lane_mean0.4000000000000023
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0138394610013046, "sim_physics": 0.05701050917307536, "survival_time": 14.950000000000076, "driven_lanedir": 2.9061809253583792, "sim_render-ego": 0.0071757205327351884, "in-drivable-lane": 0, "agent_compute-ego": 0.016570242245992024, "deviation-heading": 3.463011765125806, "set_robot_commands": 0.007620046933492025, "deviation-center-line": 0.8287513922658546, "driven_lanedir_consec": 2.9061809253583792, "sim_compute_sim_state": 0.004012043476104736, "sim_compute_performance-ego": 0.0041533541679382325, "sim_compute_robot_state-ego": 0.00524335781733195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.015075901841765, "sim_physics": 0.0587405522664388, "survival_time": 14.950000000000076, "driven_lanedir": 2.9166073106028185, "sim_render-ego": 0.00727730909983317, "in-drivable-lane": 0, "agent_compute-ego": 0.01597174326578776, "deviation-heading": 3.4067108970362527, "set_robot_commands": 0.0072847278912862145, "deviation-center-line": 0.6191012198871827, "driven_lanedir_consec": 2.9166073106028185, "sim_compute_sim_state": 0.003769661585489909, "sim_compute_performance-ego": 0.004092777570088704, "sim_compute_robot_state-ego": 0.00526947021484375}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.858547765413843, "sim_physics": 0.05908058087031046, "survival_time": 14.950000000000076, "driven_lanedir": 3.4866802209447427, "sim_render-ego": 0.007272099653879802, "in-drivable-lane": 2.0000000000000115, "agent_compute-ego": 0.015948647658030193, "deviation-heading": 2.7610493351802257, "set_robot_commands": 0.007272976239522298, "deviation-center-line": 0.6657081440228224, "driven_lanedir_consec": 3.4866802209447427, "sim_compute_sim_state": 0.003863855997721354, "sim_compute_performance-ego": 0.004098424911499024, "sim_compute_robot_state-ego": 0.005283318360646566}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.718259293443845, "sim_physics": 0.055563690662384035, "survival_time": 14.950000000000076, "driven_lanedir": 3.615837275509023, "sim_render-ego": 0.007288503646850586, "in-drivable-lane": 0, "agent_compute-ego": 0.016069286664326984, "deviation-heading": 2.8495650620705515, "set_robot_commands": 0.007315920988718669, "deviation-center-line": 0.8071795830547908, "driven_lanedir_consec": 3.615837275509023, "sim_compute_sim_state": 0.003808025519053141, "sim_compute_performance-ego": 0.004109258651733398, "sim_compute_robot_state-ego": 0.005248633225758871}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.289667553293494, "sim_physics": 0.05858235200246175, "survival_time": 14.950000000000076, "driven_lanedir": 3.1927494192511956, "sim_render-ego": 0.007212405999501547, "in-drivable-lane": 0, "agent_compute-ego": 0.016083335081736247, "deviation-heading": 3.4235248960433453, "set_robot_commands": 0.007393425305684408, "deviation-center-line": 0.49175671326097153, "driven_lanedir_consec": 3.1927494192511956, "sim_compute_sim_state": 0.003953525225321452, "sim_compute_performance-ego": 0.004105421702067057, "sim_compute_robot_state-ego": 0.005254847208658854}}
set_robot_commands_max0.007620046933492025
set_robot_commands_mean0.007377419471740723
set_robot_commands_median0.007315920988718669
set_robot_commands_min0.007272976239522298
sim_compute_performance-ego_max0.0041533541679382325
sim_compute_performance-ego_mean0.004111847400665283
sim_compute_performance-ego_median0.004105421702067057
sim_compute_performance-ego_min0.004092777570088704
sim_compute_robot_state-ego_max0.005283318360646566
sim_compute_robot_state-ego_mean0.005259925365447999
sim_compute_robot_state-ego_median0.005254847208658854
sim_compute_robot_state-ego_min0.00524335781733195
sim_compute_sim_state_max0.004012043476104736
sim_compute_sim_state_mean0.003881422360738118
sim_compute_sim_state_median0.003863855997721354
sim_compute_sim_state_min0.003769661585489909
sim_physics_max0.05908058087031046
sim_physics_mean0.05779553699493408
sim_physics_median0.05858235200246175
sim_physics_min0.055563690662384035
sim_render-ego_max0.007288503646850586
sim_render-ego_mean0.007245207786560058
sim_render-ego_median0.007272099653879802
sim_render-ego_min0.0071757205327351884
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
303556236Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-46-148-104920:00:44
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/3e1dfaae404ce8de27d33abfe99adab7cd016a3cd173a9f5a9af66e171806278/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
303516234Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:04:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.084572285969625
survival_time_median5.599999999999988
deviation-center-line_median0.3409653791902398
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02242759033873841
agent_compute-ego_mean0.02185057077822809
agent_compute-ego_median0.021809756755828857
agent_compute-ego_min0.0213039231300354
deviation-center-line_max0.579362972652727
deviation-center-line_mean0.35057356574480075
deviation-center-line_min0.19531969305528507
deviation-heading_max2.248774878099941
deviation-heading_mean1.556358026728535
deviation-heading_median1.4582684165827515
deviation-heading_min1.0154073233360403
driven_any_max4.120213972302458
driven_any_mean2.4560267041096595
driven_any_median2.186992255624559
driven_any_min1.2855042248709063
driven_lanedir_consec_max4.037812515448115
driven_lanedir_consec_mean2.1937187568729692
driven_lanedir_consec_min1.1467983924232132
driven_lanedir_max4.037812515448115
driven_lanedir_mean2.1937187568729692
driven_lanedir_median2.084572285969625
driven_lanedir_min1.1467983924232132
in-drivable-lane_max1.7500000000000009
in-drivable-lane_mean0.38000000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3725176783122963, "sim_physics": 0.05903663740053282, "survival_time": 4.549999999999992, "driven_lanedir": 1.3182765153426832, "sim_render-ego": 0.007388023229745718, "in-drivable-lane": 0, "agent_compute-ego": 0.02242759033873841, "deviation-heading": 1.0290858686331643, "set_robot_commands": 0.005282221259651603, "deviation-center-line": 0.19531969305528507, "driven_lanedir_consec": 1.3182765153426832, "sim_compute_sim_state": 0.003085241212949648, "sim_compute_performance-ego": 0.004265041141719609, "sim_compute_robot_state-ego": 0.005320905329106928}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2855042248709063, "sim_physics": 0.059166950338027054, "survival_time": 3.399999999999996, "driven_lanedir": 1.1467983924232132, "sim_render-ego": 0.0072539904538322895, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.021809756755828857, "deviation-heading": 1.0154073233360403, "set_robot_commands": 0.005261578980614157, "deviation-center-line": 0.2790819867491501, "driven_lanedir_consec": 1.1467983924232132, "sim_compute_sim_state": 0.0030545417000265684, "sim_compute_performance-ego": 0.0040741387535544, "sim_compute_robot_state-ego": 0.005267946159138399}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.120213972302458, "sim_physics": 0.05632037162780762, "survival_time": 14.950000000000076, "driven_lanedir": 4.037812515448115, "sim_render-ego": 0.007149612108866374, "in-drivable-lane": 0, "agent_compute-ego": 0.0213039231300354, "deviation-heading": 2.030253646990779, "set_robot_commands": 0.005200746059417724, "deviation-center-line": 0.579362972652727, "driven_lanedir_consec": 4.037812515448115, "sim_compute_sim_state": 0.003008761405944824, "sim_compute_performance-ego": 0.004042692979176839, "sim_compute_robot_state-ego": 0.0051883180936177576}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.3149053894380787, "sim_physics": 0.05719744261874947, "survival_time": 9.299999999999995, "driven_lanedir": 2.3811340751812096, "sim_render-ego": 0.007242209167890651, "in-drivable-lane": 1.7500000000000009, "agent_compute-ego": 0.021396317789631504, "deviation-heading": 2.248774878099941, "set_robot_commands": 0.005225892989866195, "deviation-center-line": 0.3581377970766017, "driven_lanedir_consec": 2.3811340751812096, "sim_compute_sim_state": 0.0030248741949758223, "sim_compute_performance-ego": 0.004045139076889202, "sim_compute_robot_state-ego": 0.005172589773772865}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.186992255624559, "sim_physics": 0.061014582003865926, "survival_time": 5.599999999999988, "driven_lanedir": 2.084572285969625, "sim_render-ego": 0.007528632879257202, "in-drivable-lane": 0, "agent_compute-ego": 0.02231526587690626, "deviation-heading": 1.4582684165827515, "set_robot_commands": 0.0053749361208506995, "deviation-center-line": 0.3409653791902398, "driven_lanedir_consec": 2.084572285969625, "sim_compute_sim_state": 0.0031253589051110403, "sim_compute_performance-ego": 0.004172840288707188, "sim_compute_robot_state-ego": 0.00536906932081495}}
set_robot_commands_max0.0053749361208506995
set_robot_commands_mean0.005269075082080075
set_robot_commands_median0.005261578980614157
set_robot_commands_min0.005200746059417724
sim_compute_performance-ego_max0.004265041141719609
sim_compute_performance-ego_mean0.004119970448009448
sim_compute_performance-ego_median0.0040741387535544
sim_compute_performance-ego_min0.004042692979176839
sim_compute_robot_state-ego_max0.00536906932081495
sim_compute_robot_state-ego_mean0.0052637657352901795
sim_compute_robot_state-ego_median0.005267946159138399
sim_compute_robot_state-ego_min0.005172589773772865
sim_compute_sim_state_max0.0031253589051110403
sim_compute_sim_state_mean0.0030597554838015803
sim_compute_sim_state_median0.0030545417000265684
sim_compute_sim_state_min0.003008761405944824
sim_physics_max0.061014582003865926
sim_physics_mean0.05854719679779659
sim_physics_median0.05903663740053282
sim_physics_min0.05632037162780762
sim_render-ego_max0.007528632879257202
sim_render-ego_mean0.007312493567918447
sim_render-ego_median0.0072539904538322895
sim_render-ego_min0.007149612108866374
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.560000000000009
survival_time_min3.399999999999996
No reset possible
303476231Dong Wang 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6683354255587223
survival_time_median5.14999999999999
deviation-center-line_median0.238661001266366
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.017754638317934016
agent_compute-ego_mean0.017320560754724885
agent_compute-ego_median0.017298197171774256
agent_compute-ego_min0.016899349814967105
deviation-center-line_max0.33169852872583727
deviation-center-line_mean0.2223348305721789
deviation-center-line_min0.12920176519311163
deviation-heading_max2.3380139889350113
deviation-heading_mean1.563376409271036
deviation-heading_median1.1833194312985955
deviation-heading_min0.9923672055702082
driven_any_max1.2802810152646718
driven_any_mean0.8544398943788053
driven_any_median0.7739976402667978
driven_any_min0.7097451966355481
driven_lanedir_consec_max1.1058662448476908
driven_lanedir_consec_mean0.7644314719567821
driven_lanedir_consec_min0.6542466585272254
driven_lanedir_max1.1058662448476908
driven_lanedir_mean0.7644314719567821
driven_lanedir_median0.6683354255587223
driven_lanedir_min0.6542466585272254
in-drivable-lane_max0.4500000000000029
in-drivable-lane_mean0.1600000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7181533904320765, "sim_physics": 0.11992078466513724, "survival_time": 4.849999999999991, "driven_lanedir": 0.6569952263244263, "sim_render-ego": 0.00786187230926199, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.017754638317934016, "deviation-heading": 1.1833194312985955, "set_robot_commands": 0.0074421867881853555, "deviation-center-line": 0.16633223288672974, "driven_lanedir_consec": 0.6569952263244263, "sim_compute_sim_state": 0.0031437357676397893, "sim_compute_performance-ego": 0.004441971631394219, "sim_compute_robot_state-ego": 0.005645619225256222, "sim_compute_robot_state-npc0": 0.00657348042910861, "sim_compute_robot_state-npc1": 0.005320072174072266, "sim_compute_robot_state-npc2": 0.005092746203707666, "sim_compute_robot_state-npc3": 0.0050627964059102165}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7097451966355481, "sim_physics": 0.11245980262756348, "survival_time": 4.749999999999991, "driven_lanedir": 0.6542466585272254, "sim_render-ego": 0.007620492734407124, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.016899349814967105, "deviation-heading": 0.9923672055702082, "set_robot_commands": 0.007661427949604235, "deviation-center-line": 0.238661001266366, "driven_lanedir_consec": 0.6542466585272254, "sim_compute_sim_state": 0.003115543566252056, "sim_compute_performance-ego": 0.004281804436131528, "sim_compute_robot_state-ego": 0.005595960115131579, "sim_compute_robot_state-npc0": 0.0065272958655106395, "sim_compute_robot_state-npc1": 0.005439384360062449, "sim_compute_robot_state-npc2": 0.005225046057450144, "sim_compute_robot_state-npc3": 0.005122543636121248}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2802810152646718, "sim_physics": 0.1185311912054039, "survival_time": 8.299999999999983, "driven_lanedir": 1.1058662448476908, "sim_render-ego": 0.007617276835154338, "in-drivable-lane": 0.4500000000000029, "agent_compute-ego": 0.017298197171774256, "deviation-heading": 2.3380139889350113, "set_robot_commands": 0.0075414180755615234, "deviation-center-line": 0.33169852872583727, "driven_lanedir_consec": 1.1058662448476908, "sim_compute_sim_state": 0.0030756025429231576, "sim_compute_performance-ego": 0.004300120365188782, "sim_compute_robot_state-ego": 0.0056209004068949135, "sim_compute_robot_state-npc0": 0.006424267607999135, "sim_compute_robot_state-npc1": 0.005242535866886736, "sim_compute_robot_state-npc2": 0.005106322736625212, "sim_compute_robot_state-npc3": 0.005073578960924263}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7739976402667978, "sim_physics": 0.11840746240708434, "survival_time": 5.14999999999999, "driven_lanedir": 0.7367138045258456, "sim_render-ego": 0.007748372346452139, "in-drivable-lane": 0, "agent_compute-ego": 0.017056215156629247, "deviation-heading": 1.090446707847379, "set_robot_commands": 0.007371622381858455, "deviation-center-line": 0.12920176519311163, "driven_lanedir_consec": 0.7367138045258456, "sim_compute_sim_state": 0.0030895413704288815, "sim_compute_performance-ego": 0.004270692473476373, "sim_compute_robot_state-ego": 0.005530033296751745, "sim_compute_robot_state-npc0": 0.006519326885927071, "sim_compute_robot_state-npc1": 0.005395396241863954, "sim_compute_robot_state-npc2": 0.005160410427352757, "sim_compute_robot_state-npc3": 0.005034506899639241}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7900222292949319, "sim_physics": 0.11793744223458426, "survival_time": 5.249999999999989, "driven_lanedir": 0.6683354255587223, "sim_render-ego": 0.007607659839448474, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.0175944033123198, "deviation-heading": 2.212734712703987, "set_robot_commands": 0.0075160889398484, "deviation-center-line": 0.24578062478884968, "driven_lanedir_consec": 0.6683354255587223, "sim_compute_sim_state": 0.0030711900620233445, "sim_compute_performance-ego": 0.004369772048223587, "sim_compute_robot_state-ego": 0.005659123829432896, "sim_compute_robot_state-npc0": 0.006389356794811431, "sim_compute_robot_state-npc1": 0.005236412229992094, "sim_compute_robot_state-npc2": 0.005154725483485631, "sim_compute_robot_state-npc3": 0.005107997712634859}}
set_robot_commands_max0.007661427949604235
set_robot_commands_mean0.007506548827011595
set_robot_commands_median0.0075160889398484
set_robot_commands_min0.007371622381858455
sim_compute_performance-ego_max0.004441971631394219
sim_compute_performance-ego_mean0.004332872190882898
sim_compute_performance-ego_median0.004300120365188782
sim_compute_performance-ego_min0.004270692473476373
sim_compute_robot_state-ego_max0.005659123829432896
sim_compute_robot_state-ego_mean0.005610327374693471
sim_compute_robot_state-ego_median0.0056209004068949135
sim_compute_robot_state-ego_min0.005530033296751745
sim_compute_robot_state-npc0_max0.00657348042910861
sim_compute_robot_state-npc0_mean0.006486745516671377
sim_compute_robot_state-npc0_median0.006519326885927071
sim_compute_robot_state-npc0_min0.006389356794811431
sim_compute_robot_state-npc1_max0.005439384360062449
sim_compute_robot_state-npc1_mean0.005326760174575501
sim_compute_robot_state-npc1_median0.005320072174072266
sim_compute_robot_state-npc1_min0.005236412229992094
sim_compute_robot_state-npc2_max0.005225046057450144
sim_compute_robot_state-npc2_mean0.005147850181724282
sim_compute_robot_state-npc2_median0.005154725483485631
sim_compute_robot_state-npc2_min0.005092746203707666
sim_compute_robot_state-npc3_max0.005122543636121248
sim_compute_robot_state-npc3_mean0.005080284723045965
sim_compute_robot_state-npc3_median0.005073578960924263
sim_compute_robot_state-npc3_min0.005034506899639241
sim_compute_sim_state_max0.0031437357676397893
sim_compute_sim_state_mean0.0030991226618534455
sim_compute_sim_state_median0.0030895413704288815
sim_compute_sim_state_min0.0030711900620233445
sim_physics_max0.11992078466513724
sim_physics_mean0.11745133662795464
sim_physics_median0.11840746240708434
sim_physics_min0.11245980262756348
sim_render-ego_max0.00786187230926199
sim_render-ego_mean0.007691134812944813
sim_render-ego_median0.007620492734407124
sim_render-ego_min0.007607659839448474
simulation-passed1
survival_time_max8.299999999999983
survival_time_mean5.659999999999989
survival_time_min4.749999999999991
No reset possible
303456230Dong Wang 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2736613565731756
survival_time_median11.150000000000023
deviation-center-line_median0.5491262821388503
in-drivable-lane_median0.25000000000000355


other stats
agent_compute-ego_max0.0175383428130487
agent_compute-ego_mean0.016891737468708267
agent_compute-ego_median0.016778016090393068
agent_compute-ego_min0.016423048994466328
deviation-center-line_max0.6420133175332481
deviation-center-line_mean0.4588209003435593
deviation-center-line_min0.15394183108903547
deviation-heading_max3.105085928240228
deviation-heading_mean2.089597118348568
deviation-heading_median1.8679627610266285
deviation-heading_min1.05063194646957
driven_any_max2.34898939484672
driven_any_mean1.6066106876623327
driven_any_median1.7383141498023544
driven_any_min0.7342296413036693
driven_lanedir_consec_max1.79788238422571
driven_lanedir_consec_mean1.237161501686327
driven_lanedir_consec_min0.6981010406996059
driven_lanedir_max1.79788238422571
driven_lanedir_mean1.373205447082982
driven_lanedir_median1.3496219089895185
driven_lanedir_min0.6981010406996059
in-drivable-lane_max2.950000000000034
in-drivable-lane_mean1.0000000000000129
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7342296413036693, "sim_physics": 0.06028846297601257, "survival_time": 4.94999999999999, "driven_lanedir": 0.6981010406996059, "sim_render-ego": 0.007786690586745137, "in-drivable-lane": 0, "agent_compute-ego": 0.0175383428130487, "deviation-heading": 1.05063194646957, "set_robot_commands": 0.0073579272838554, "deviation-center-line": 0.15394183108903547, "driven_lanedir_consec": 0.6981010406996059, "sim_compute_sim_state": 0.004005217793011906, "sim_compute_performance-ego": 0.004496615342419557, "sim_compute_robot_state-ego": 0.0055045888881490685}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8910521346030436, "sim_physics": 0.06072344267663877, "survival_time": 12.100000000000035, "driven_lanedir": 1.79788238422571, "sim_render-ego": 0.0077199807836989725, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.016997692013575025, "deviation-heading": 1.78175216688881, "set_robot_commands": 0.007511476839869476, "deviation-center-line": 0.6420133175332481, "driven_lanedir_consec": 1.79788238422571, "sim_compute_sim_state": 0.0039291756212218735, "sim_compute_performance-ego": 0.004423947373697581, "sim_compute_robot_state-ego": 0.005641900803431992}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7383141498023544, "sim_physics": 0.05745671255171566, "survival_time": 11.150000000000023, "driven_lanedir": 1.3496219089895185, "sim_render-ego": 0.007450327210362182, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.016423048994466328, "deviation-heading": 2.6425527891176013, "set_robot_commands": 0.007294021914358096, "deviation-center-line": 0.5491262821388503, "driven_lanedir_consec": 1.3496219089895185, "sim_compute_sim_state": 0.003685517161416366, "sim_compute_performance-ego": 0.004318896965061068, "sim_compute_robot_state-ego": 0.00545581466948505}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320468117755876, "sim_physics": 0.05821393665514494, "survival_time": 8.549999999999986, "driven_lanedir": 1.2736613565731756, "sim_render-ego": 0.007597074174044425, "in-drivable-lane": 0, "agent_compute-ego": 0.016721587432058233, "deviation-heading": 1.8679627610266285, "set_robot_commands": 0.007091286586739166, "deviation-center-line": 0.34528239609504957, "driven_lanedir_consec": 1.2736613565731756, "sim_compute_sim_state": 0.003980460919831928, "sim_compute_performance-ego": 0.004309478558992085, "sim_compute_robot_state-ego": 0.005558408491792735}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.34898939484672, "sim_physics": 0.05985295534133911, "survival_time": 14.950000000000076, "driven_lanedir": 1.7467605449269, "sim_render-ego": 0.007610268592834472, "in-drivable-lane": 2.950000000000034, "agent_compute-ego": 0.016778016090393068, "deviation-heading": 3.105085928240228, "set_robot_commands": 0.007346067428588867, "deviation-center-line": 0.6037406748616131, "driven_lanedir_consec": 1.0665408179436262, "sim_compute_sim_state": 0.0038795797030131023, "sim_compute_performance-ego": 0.004297175407409668, "sim_compute_robot_state-ego": 0.0055074763298034665}}
set_robot_commands_max0.007511476839869476
set_robot_commands_mean0.007320156010682201
set_robot_commands_median0.007346067428588867
set_robot_commands_min0.007091286586739166
sim_compute_performance-ego_max0.004496615342419557
sim_compute_performance-ego_mean0.004369222729515992
sim_compute_performance-ego_median0.004318896965061068
sim_compute_performance-ego_min0.004297175407409668
sim_compute_robot_state-ego_max0.005641900803431992
sim_compute_robot_state-ego_mean0.005533637836532462
sim_compute_robot_state-ego_median0.0055074763298034665
sim_compute_robot_state-ego_min0.00545581466948505
sim_compute_sim_state_max0.004005217793011906
sim_compute_sim_state_mean0.003895990239699035
sim_compute_sim_state_median0.0039291756212218735
sim_compute_sim_state_min0.003685517161416366
sim_physics_max0.06072344267663877
sim_physics_mean0.0593071020401702
sim_physics_median0.05985295534133911
sim_physics_min0.05745671255171566
sim_render-ego_max0.007786690586745137
sim_render-ego_mean0.007632868269537038
sim_render-ego_median0.007610268592834472
sim_render-ego_min0.007450327210362182
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.340000000000025
survival_time_min4.94999999999999
No reset possible
303306222Dong Wang 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7034043371212304
survival_time_median4.849999999999991
deviation-center-line_median0.22760246899461584
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01863917017478019
agent_compute-ego_mean0.0177382898248405
agent_compute-ego_median0.017660728434926456
agent_compute-ego_min0.017298247554514666
deviation-center-line_max0.7692799793832569
deviation-center-line_mean0.319147998081583
deviation-center-line_min0.13843403307631422
deviation-heading_max5.204190454045983
deviation-heading_mean1.8954074955033768
deviation-heading_median1.092640950743763
deviation-heading_min1.0051442755985005
driven_any_max2.268499224489128
driven_any_mean1.029597811799368
driven_any_median0.725800420200897
driven_any_min0.6779965476328702
driven_lanedir_consec_max1.5860430299253734
driven_lanedir_consec_mean0.8560884042034542
driven_lanedir_consec_min0.581811019495229
driven_lanedir_max1.8404145235318137
driven_lanedir_mean0.9069627029247422
driven_lanedir_median0.7034043371212304
driven_lanedir_min0.581811019495229
in-drivable-lane_max1.099999999999996
in-drivable-lane_mean0.279999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6779965476328702, "sim_physics": 0.11903568713561348, "survival_time": 4.599999999999992, "driven_lanedir": 0.581811019495229, "sim_render-ego": 0.007919360762057097, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.017673860425534454, "deviation-heading": 1.1620572653309031, "set_robot_commands": 0.007497419481692107, "deviation-center-line": 0.13843403307631422, "driven_lanedir_consec": 0.581811019495229, "sim_compute_sim_state": 0.003198012061741041, "sim_compute_performance-ego": 0.004550011261649754, "sim_compute_robot_state-ego": 0.005700098431628683, "sim_compute_robot_state-npc0": 0.006883126238118048, "sim_compute_robot_state-npc1": 0.005295722380928371, "sim_compute_robot_state-npc2": 0.005208888779515805, "sim_compute_robot_state-npc3": 0.005067908245584239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7579265418045009, "sim_physics": 0.11779590408400734, "survival_time": 5.04999999999999, "driven_lanedir": 0.7145139154193744, "sim_render-ego": 0.007912971005581393, "in-drivable-lane": 0, "agent_compute-ego": 0.017298247554514666, "deviation-heading": 1.0130045317977356, "set_robot_commands": 0.00773509422151169, "deviation-center-line": 0.22760246899461584, "driven_lanedir_consec": 0.7145139154193744, "sim_compute_sim_state": 0.003316706950121587, "sim_compute_performance-ego": 0.0044999004590629355, "sim_compute_robot_state-ego": 0.005754062444856852, "sim_compute_robot_state-npc0": 0.006678772444772248, "sim_compute_robot_state-npc1": 0.0055791387463560195, "sim_compute_robot_state-npc2": 0.005312091053122341, "sim_compute_robot_state-npc3": 0.005242876487203164}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.268499224489128, "sim_physics": 0.119042086353764, "survival_time": 14.45000000000007, "driven_lanedir": 1.8404145235318137, "sim_render-ego": 0.0079858039077178, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.01863917017478019, "deviation-heading": 5.204190454045983, "set_robot_commands": 0.00765043558958905, "deviation-center-line": 0.7692799793832569, "driven_lanedir_consec": 1.5860430299253734, "sim_compute_sim_state": 0.0033183782570914825, "sim_compute_performance-ego": 0.004559185265669773, "sim_compute_robot_state-ego": 0.005886354248416465, "sim_compute_robot_state-npc0": 0.00652071513931644, "sim_compute_robot_state-npc1": 0.005547588671779962, "sim_compute_robot_state-npc2": 0.005346264393684361, "sim_compute_robot_state-npc3": 0.00527622460493992}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7177663248694445, "sim_physics": 0.12626738597949347, "survival_time": 4.799999999999991, "driven_lanedir": 0.694669719056064, "sim_render-ego": 0.008206432064374289, "in-drivable-lane": 0, "agent_compute-ego": 0.017419442534446716, "deviation-heading": 1.092640950743763, "set_robot_commands": 0.007775214811166127, "deviation-center-line": 0.20815176735214744, "driven_lanedir_consec": 0.694669719056064, "sim_compute_sim_state": 0.003248328963915507, "sim_compute_performance-ego": 0.004596528907616933, "sim_compute_robot_state-ego": 0.00582356999317805, "sim_compute_robot_state-npc0": 0.006653428077697754, "sim_compute_robot_state-npc1": 0.005466729402542114, "sim_compute_robot_state-npc2": 0.005260919531186421, "sim_compute_robot_state-npc3": 0.0051798224449157715}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.725800420200897, "sim_physics": 0.12309543865243185, "survival_time": 4.849999999999991, "driven_lanedir": 0.7034043371212304, "sim_render-ego": 0.007990819891703497, "in-drivable-lane": 0, "agent_compute-ego": 0.017660728434926456, "deviation-heading": 1.0051442755985005, "set_robot_commands": 0.007981708369304225, "deviation-center-line": 0.25227174160158067, "driven_lanedir_consec": 0.7034043371212304, "sim_compute_sim_state": 0.003278896980678912, "sim_compute_performance-ego": 0.004503382849939091, "sim_compute_robot_state-ego": 0.005756505985849912, "sim_compute_robot_state-npc0": 0.006845754446442595, "sim_compute_robot_state-npc1": 0.00549655108107734, "sim_compute_robot_state-npc2": 0.005252533352252134, "sim_compute_robot_state-npc3": 0.005194600095453951}}
set_robot_commands_max0.007981708369304225
set_robot_commands_mean0.00772797449465264
set_robot_commands_median0.00773509422151169
set_robot_commands_min0.007497419481692107
sim_compute_performance-ego_max0.004596528907616933
sim_compute_performance-ego_mean0.0045418017487876975
sim_compute_performance-ego_median0.004550011261649754
sim_compute_performance-ego_min0.0044999004590629355
sim_compute_robot_state-ego_max0.005886354248416465
sim_compute_robot_state-ego_mean0.005784118220785992
sim_compute_robot_state-ego_median0.005756505985849912
sim_compute_robot_state-ego_min0.005700098431628683
sim_compute_robot_state-npc0_max0.006883126238118048
sim_compute_robot_state-npc0_mean0.006716359269269417
sim_compute_robot_state-npc0_median0.006678772444772248
sim_compute_robot_state-npc0_min0.00652071513931644
sim_compute_robot_state-npc1_max0.0055791387463560195
sim_compute_robot_state-npc1_mean0.005477146056536762
sim_compute_robot_state-npc1_median0.00549655108107734
sim_compute_robot_state-npc1_min0.005295722380928371
sim_compute_robot_state-npc2_max0.005346264393684361
sim_compute_robot_state-npc2_mean0.005276139421952212
sim_compute_robot_state-npc2_median0.005260919531186421
sim_compute_robot_state-npc2_min0.005208888779515805
sim_compute_robot_state-npc3_max0.00527622460493992
sim_compute_robot_state-npc3_mean0.00519228637561941
sim_compute_robot_state-npc3_median0.005194600095453951
sim_compute_robot_state-npc3_min0.005067908245584239
sim_compute_sim_state_max0.0033183782570914825
sim_compute_sim_state_mean0.0032720646427097056
sim_compute_sim_state_median0.003278896980678912
sim_compute_sim_state_min0.003198012061741041
sim_physics_max0.12626738597949347
sim_physics_mean0.12104730044106204
sim_physics_median0.119042086353764
sim_physics_min0.11779590408400734
sim_render-ego_max0.008206432064374289
sim_render-ego_mean0.008003077526286815
sim_render-ego_median0.0079858039077178
sim_render-ego_min0.007912971005581393
simulation-passed1
survival_time_max14.45000000000007
survival_time_mean6.750000000000005
survival_time_min4.599999999999992
No reset possible
303206212Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.680905471079696
survival_time_median4.899999999999991
deviation-center-line_median0.18771442157070703
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07109393924474716
agent_compute-ego_mean0.048634329214267066
agent_compute-ego_median0.05847769113456678
agent_compute-ego_min0.023791181797883948
deviation-center-line_max0.45382356294901866
deviation-center-line_mean0.24463200783108752
deviation-center-line_min0.15987098186425583
deviation-heading_max1.4437860072948543
deviation-heading_mean1.174945450629434
deviation-heading_median1.1532460958541844
deviation-heading_min1.0152490827504186
driven_any_max1.2240594362749764
driven_any_mean0.8207118574842781
driven_any_median0.7261969248030306
driven_any_min0.7016997027077243
driven_lanedir_consec_max1.1909979021515316
driven_lanedir_consec_mean0.7778798058708845
driven_lanedir_consec_min0.6609682781984791
driven_lanedir_max1.1909979021515316
driven_lanedir_mean0.7778798058708845
driven_lanedir_median0.680905471079696
driven_lanedir_min0.6609682781984791
in-drivable-lane_max0.14999999999999947
in-drivable-lane_mean0.029999999999999895
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7261969248030306, "sim_physics": 0.17958162755382304, "survival_time": 4.899999999999991, "driven_lanedir": 0.6847079403952694, "sim_render-ego": 0.011329699535759128, "in-drivable-lane": 0, "agent_compute-ego": 0.026196073512641752, "deviation-heading": 1.1532460958541844, "set_robot_commands": 0.010331516363182846, "deviation-center-line": 0.16755565178265633, "driven_lanedir_consec": 0.6847079403952694, "sim_compute_sim_state": 0.004462804113115583, "sim_compute_performance-ego": 0.0065652691588109855, "sim_compute_robot_state-ego": 0.008011392184666224, "sim_compute_robot_state-npc0": 0.00936702076269656, "sim_compute_robot_state-npc1": 0.008478923719756457, "sim_compute_robot_state-npc2": 0.007898552077157157, "sim_compute_robot_state-npc3": 0.007520130702427456}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7338356306150977, "sim_physics": 0.16307705032582187, "survival_time": 4.899999999999991, "driven_lanedir": 0.6609682781984791, "sim_render-ego": 0.010908766668670033, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.023791181797883948, "deviation-heading": 1.0379105914834823, "set_robot_commands": 0.010026046207972936, "deviation-center-line": 0.2541954209887999, "driven_lanedir_consec": 0.6609682781984791, "sim_compute_sim_state": 0.004767400877816337, "sim_compute_performance-ego": 0.006066998656915158, "sim_compute_robot_state-ego": 0.007940805688196299, "sim_compute_robot_state-npc0": 0.008817222653603067, "sim_compute_robot_state-npc1": 0.00781565539690913, "sim_compute_robot_state-npc2": 0.007539065516724878, "sim_compute_robot_state-npc3": 0.007722402105526049}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2240594362749764, "sim_physics": 0.26543583959903355, "survival_time": 7.94999999999998, "driven_lanedir": 1.1909979021515316, "sim_render-ego": 0.014578271961811952, "in-drivable-lane": 0, "agent_compute-ego": 0.05847769113456678, "deviation-heading": 1.4437860072948543, "set_robot_commands": 0.01271666520796482, "deviation-center-line": 0.45382356294901866, "driven_lanedir_consec": 1.1909979021515316, "sim_compute_sim_state": 0.006004723362952658, "sim_compute_performance-ego": 0.00861229236770726, "sim_compute_robot_state-ego": 0.010950163475372506, "sim_compute_robot_state-npc0": 0.011054167957425868, "sim_compute_robot_state-npc1": 0.01084838423339076, "sim_compute_robot_state-npc2": 0.010835550116293086, "sim_compute_robot_state-npc3": 0.010722155840891713}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7016997027077243, "sim_physics": 0.26963568494675005, "survival_time": 4.699999999999991, "driven_lanedir": 0.6718194375294455, "sim_render-ego": 0.01523742269962392, "in-drivable-lane": 0, "agent_compute-ego": 0.0636127603814957, "deviation-heading": 1.0152490827504186, "set_robot_commands": 0.01223359209425906, "deviation-center-line": 0.15987098186425583, "driven_lanedir_consec": 0.6718194375294455, "sim_compute_sim_state": 0.006043451897641446, "sim_compute_performance-ego": 0.008781902333523365, "sim_compute_robot_state-ego": 0.011631197117744609, "sim_compute_robot_state-npc0": 0.01071983702639316, "sim_compute_robot_state-npc1": 0.011371156002612823, "sim_compute_robot_state-npc2": 0.01156872384091641, "sim_compute_robot_state-npc3": 0.010938735718422748}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7177675930205605, "sim_physics": 0.26582033932209015, "survival_time": 4.799999999999991, "driven_lanedir": 0.680905471079696, "sim_render-ego": 0.0147815669576327, "in-drivable-lane": 0, "agent_compute-ego": 0.07109393924474716, "deviation-heading": 1.2245354757642308, "set_robot_commands": 0.011846989393234251, "deviation-center-line": 0.18771442157070703, "driven_lanedir_consec": 0.680905471079696, "sim_compute_sim_state": 0.006115525960922241, "sim_compute_performance-ego": 0.009097124139467876, "sim_compute_robot_state-ego": 0.012203936775525412, "sim_compute_robot_state-npc0": 0.010234375794728598, "sim_compute_robot_state-npc1": 0.010347120463848114, "sim_compute_robot_state-npc2": 0.010675241549809774, "sim_compute_robot_state-npc3": 0.010393609603246054}}
set_robot_commands_max0.01271666520796482
set_robot_commands_mean0.011430961853322782
set_robot_commands_median0.011846989393234251
set_robot_commands_min0.010026046207972936
sim_compute_performance-ego_max0.009097124139467876
sim_compute_performance-ego_mean0.007824717331284928
sim_compute_performance-ego_median0.00861229236770726
sim_compute_performance-ego_min0.006066998656915158
sim_compute_robot_state-ego_max0.012203936775525412
sim_compute_robot_state-ego_mean0.01014749904830101
sim_compute_robot_state-ego_median0.010950163475372506
sim_compute_robot_state-ego_min0.007940805688196299
sim_compute_robot_state-npc0_max0.011054167957425868
sim_compute_robot_state-npc0_mean0.010038524838969451
sim_compute_robot_state-npc0_median0.010234375794728598
sim_compute_robot_state-npc0_min0.008817222653603067
sim_compute_robot_state-npc1_max0.011371156002612823
sim_compute_robot_state-npc1_mean0.009772247963303456
sim_compute_robot_state-npc1_median0.010347120463848114
sim_compute_robot_state-npc1_min0.00781565539690913
sim_compute_robot_state-npc2_max0.01156872384091641
sim_compute_robot_state-npc2_mean0.00970342662018026
sim_compute_robot_state-npc2_median0.010675241549809774
sim_compute_robot_state-npc2_min0.007539065516724878
sim_compute_robot_state-npc3_max0.010938735718422748
sim_compute_robot_state-npc3_mean0.009459406794102804
sim_compute_robot_state-npc3_median0.010393609603246054
sim_compute_robot_state-npc3_min0.007520130702427456
sim_compute_sim_state_max0.006115525960922241
sim_compute_sim_state_mean0.005478781242489653
sim_compute_sim_state_median0.006004723362952658
sim_compute_sim_state_min0.004462804113115583
sim_physics_max0.26963568494675005
sim_physics_mean0.22871010834950373
sim_physics_median0.26543583959903355
sim_physics_min0.16307705032582187
sim_render-ego_max0.01523742269962392
sim_render-ego_mean0.013367145564699548
sim_render-ego_median0.014578271961811952
sim_render-ego_min0.010908766668670033
simulation-passed1
survival_time_max7.94999999999998
survival_time_mean5.449999999999989
survival_time_min4.699999999999991
No reset possible
303126215Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:05:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
303106210Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
302006145Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:10:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.301664090058226
survival_time_median4.149999999999993
deviation-center-line_median0.25983129717944886
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04593312367796898
agent_compute-ego_mean0.03942007392143902
agent_compute-ego_median0.03780132830142975
agent_compute-ego_min0.0365574762045619
deviation-center-line_max0.6462094022810834
deviation-center-line_mean0.32947843242828545
deviation-center-line_min0.0844914373254049
deviation-heading_max2.411737075610376
deviation-heading_mean1.2722564426654446
deviation-heading_median0.8844927712083676
deviation-heading_min0.41887647362579944
driven_any_max3.2330214698690707
driven_any_mean2.004550447055758
driven_any_median1.6183876520631728
driven_any_min1.301797872690228
driven_lanedir_consec_max3.056821178299259
driven_lanedir_consec_mean1.866310700305035
driven_lanedir_consec_min1.2369339920358124
driven_lanedir_max3.056821178299259
driven_lanedir_mean1.866310700305035
driven_lanedir_median1.301664090058226
driven_lanedir_min1.2369339920358124
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.1999999999999993
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.34231437318074, "sim_physics": 0.11798827350139618, "survival_time": 3.999999999999994, "driven_lanedir": 1.301664090058226, "sim_render-ego": 0.013028058409690856, "in-drivable-lane": 0, "agent_compute-ego": 0.03780132830142975, "deviation-heading": 0.7158782945822314, "set_robot_commands": 0.010570624470710754, "deviation-center-line": 0.18085725036549705, "driven_lanedir_consec": 1.301664090058226, "sim_compute_sim_state": 0.005365297198295593, "sim_compute_performance-ego": 0.007636597752571106, "sim_compute_robot_state-ego": 0.009163394570350649}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.301797872690228, "sim_physics": 0.12847086414694786, "survival_time": 3.1999999999999966, "driven_lanedir": 1.2369339920358124, "sim_render-ego": 0.013899479061365128, "in-drivable-lane": 0, "agent_compute-ego": 0.04593312367796898, "deviation-heading": 0.8844927712083676, "set_robot_commands": 0.011102266609668732, "deviation-center-line": 0.25983129717944886, "driven_lanedir_consec": 1.2369339920358124, "sim_compute_sim_state": 0.005617212504148483, "sim_compute_performance-ego": 0.008169185370206833, "sim_compute_robot_state-ego": 0.010225482285022736}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.527230867475577, "sim_physics": 0.11536288102467857, "survival_time": 14.950000000000076, "driven_lanedir": 2.4910929399833783, "sim_render-ego": 0.013247697353363038, "in-drivable-lane": 0, "agent_compute-ego": 0.03958863178888957, "deviation-heading": 1.930297598300448, "set_robot_commands": 0.010091443061828614, "deviation-center-line": 0.476002774989993, "driven_lanedir_consec": 2.4910929399833783, "sim_compute_sim_state": 0.0053552452723185226, "sim_compute_performance-ego": 0.007964287598927816, "sim_compute_robot_state-ego": 0.009961874485015869}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6183876520631728, "sim_physics": 0.10856483930564788, "survival_time": 4.149999999999993, "driven_lanedir": 1.2450413011484995, "sim_render-ego": 0.01346027420227786, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0365574762045619, "deviation-heading": 0.41887647362579944, "set_robot_commands": 0.009123796440032592, "deviation-center-line": 0.0844914373254049, "driven_lanedir_consec": 1.2450413011484995, "sim_compute_sim_state": 0.005388880350503577, "sim_compute_performance-ego": 0.0080380956810641, "sim_compute_robot_state-ego": 0.00956157891147108}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.2330214698690707, "sim_physics": 0.1019245173249926, "survival_time": 8.399999999999984, "driven_lanedir": 3.056821178299259, "sim_render-ego": 0.01210674075853257, "in-drivable-lane": 0, "agent_compute-ego": 0.03721980963434491, "deviation-heading": 2.411737075610376, "set_robot_commands": 0.009601290736879622, "deviation-center-line": 0.6462094022810834, "driven_lanedir_consec": 3.056821178299259, "sim_compute_sim_state": 0.005132299093973069, "sim_compute_performance-ego": 0.007298486573355538, "sim_compute_robot_state-ego": 0.009076537120909918}}
set_robot_commands_max0.011102266609668732
set_robot_commands_mean0.01009788426382406
set_robot_commands_median0.010091443061828614
set_robot_commands_min0.009123796440032592
sim_compute_performance-ego_max0.008169185370206833
sim_compute_performance-ego_mean0.007821330595225079
sim_compute_performance-ego_median0.007964287598927816
sim_compute_performance-ego_min0.007298486573355538
sim_compute_robot_state-ego_max0.010225482285022736
sim_compute_robot_state-ego_mean0.00959777347455405
sim_compute_robot_state-ego_median0.00956157891147108
sim_compute_robot_state-ego_min0.009076537120909918
sim_compute_sim_state_max0.005617212504148483
sim_compute_sim_state_mean0.005371786883847849
sim_compute_sim_state_median0.005365297198295593
sim_compute_sim_state_min0.005132299093973069
sim_physics_max0.12847086414694786
sim_physics_mean0.11446227506073262
sim_physics_median0.11536288102467857
sim_physics_min0.1019245173249926
sim_render-ego_max0.013899479061365128
sim_render-ego_mean0.01314844995704589
sim_render-ego_median0.013247697353363038
sim_render-ego_min0.01210674075853257
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.940000000000009
survival_time_min3.1999999999999966
No reset possible
301454454Bea Baselines 🐤challenge-aido_LF-baseline-duckietownaido3-LFV-real-validationeval2-visualizehost-errornoip-172-31-46-148-104920:07:40
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1420, in download_artefacts
    copy_to_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
301226141Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-46-148-104920:04:16
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 372, in setup_logging
    my_stderr.flush()
  File "/project/src/duckietown_challenges_runner/runner.py", line 1247, in flush
    self.file.flush()
OSError: [Errno 28] No space left on device

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
301146140Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.747186427701179
survival_time_median10.15000000000001
deviation-center-line_median0.6128071100128247
in-drivable-lane_median0


other stats
agent_compute-ego_max0.022474599002030096
agent_compute-ego_mean0.021707414070723623
agent_compute-ego_median0.021620535055796305
agent_compute-ego_min0.021329832077026368
deviation-center-line_max0.7049388419015998
deviation-center-line_mean0.547859209296774
deviation-center-line_min0.2789825854049597
deviation-heading_max3.3081706318897255
deviation-heading_mean2.1217881931518137
deviation-heading_median2.035736892091443
deviation-heading_min0.9869039121929944
driven_any_max3.28005857121949
driven_any_mean2.724967280436226
driven_any_median2.998140659223586
driven_any_min1.2224369737270029
driven_lanedir_consec_max3.1855163764991525
driven_lanedir_consec_mean2.501507629187981
driven_lanedir_consec_min1.1488647907139422
driven_lanedir_max3.1855163764991525
driven_lanedir_mean2.501507629187981
driven_lanedir_median2.747186427701179
driven_lanedir_min1.1488647907139422
in-drivable-lane_max0.70000000000001
in-drivable-lane_mean0.2700000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.998140659223586, "sim_physics": 0.057131589927109594, "survival_time": 10.15000000000001, "driven_lanedir": 2.4890837526334586, "sim_render-ego": 0.007300281759553355, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.022474599002030096, "deviation-heading": 3.055820940180275, "set_robot_commands": 0.005217421818249331, "deviation-center-line": 0.6128071100128247, "driven_lanedir_consec": 2.4890837526334586, "sim_compute_sim_state": 0.003139700208391462, "sim_compute_performance-ego": 0.004246167948680558, "sim_compute_robot_state-ego": 0.005310036278710577}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2224369737270029, "sim_physics": 0.05826474336477427, "survival_time": 3.2499999999999964, "driven_lanedir": 1.1488647907139422, "sim_render-ego": 0.007350712556105393, "in-drivable-lane": 0, "agent_compute-ego": 0.021329832077026368, "deviation-heading": 0.9869039121929944, "set_robot_commands": 0.00522924569936899, "deviation-center-line": 0.2789825854049597, "driven_lanedir_consec": 1.1488647907139422, "sim_compute_sim_state": 0.0030497367565448467, "sim_compute_performance-ego": 0.004007985041691707, "sim_compute_robot_state-ego": 0.005186385374802809}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9513818533021667, "sim_physics": 0.055643935998280845, "survival_time": 14.950000000000076, "driven_lanedir": 2.9368867983921723, "sim_render-ego": 0.007221916516621908, "in-drivable-lane": 0, "agent_compute-ego": 0.021682562828063964, "deviation-heading": 1.22230858940463, "set_robot_commands": 0.00521011749903361, "deviation-center-line": 0.7049388419015998, "driven_lanedir_consec": 2.9368867983921723, "sim_compute_sim_state": 0.003042547702789307, "sim_compute_performance-ego": 0.004071340560913086, "sim_compute_robot_state-ego": 0.005166722138722738}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.172818344708887, "sim_physics": 0.05776446491646367, "survival_time": 8.949999999999992, "driven_lanedir": 2.747186427701179, "sim_render-ego": 0.007227700515832315, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.02142954139070138, "deviation-heading": 2.035736892091443, "set_robot_commands": 0.005132171694792849, "deviation-center-line": 0.4615045472872737, "driven_lanedir_consec": 2.747186427701179, "sim_compute_sim_state": 0.003005631143154379, "sim_compute_performance-ego": 0.004048246245144466, "sim_compute_robot_state-ego": 0.00512062371110117}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.28005857121949, "sim_physics": 0.05618656714757283, "survival_time": 14.950000000000076, "driven_lanedir": 3.1855163764991525, "sim_render-ego": 0.007236940066019694, "in-drivable-lane": 0, "agent_compute-ego": 0.021620535055796305, "deviation-heading": 3.3081706318897255, "set_robot_commands": 0.005189921061197917, "deviation-center-line": 0.6810629618772118, "driven_lanedir_consec": 3.1855163764991525, "sim_compute_sim_state": 0.003035236994425456, "sim_compute_performance-ego": 0.004064470132191976, "sim_compute_robot_state-ego": 0.005145644346872966}}
set_robot_commands_max0.00522924569936899
set_robot_commands_mean0.005195775554528539
set_robot_commands_median0.00521011749903361
set_robot_commands_min0.005132171694792849
sim_compute_performance-ego_max0.004246167948680558
sim_compute_performance-ego_mean0.004087641985724358
sim_compute_performance-ego_median0.004064470132191976
sim_compute_performance-ego_min0.004007985041691707
sim_compute_robot_state-ego_max0.005310036278710577
sim_compute_robot_state-ego_mean0.005185882370042052
sim_compute_robot_state-ego_median0.005166722138722738
sim_compute_robot_state-ego_min0.00512062371110117
sim_compute_sim_state_max0.003139700208391462
sim_compute_sim_state_mean0.0030545705610610903
sim_compute_sim_state_median0.003042547702789307
sim_compute_sim_state_min0.003005631143154379
sim_physics_max0.05826474336477427
sim_physics_mean0.05699826027084025
sim_physics_median0.057131589927109594
sim_physics_min0.055643935998280845
sim_render-ego_max0.007350712556105393
sim_render-ego_mean0.007267510282826533
sim_render-ego_median0.007236940066019694
sim_render-ego_min0.007221916516621908
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.450000000000031
survival_time_min3.2499999999999964
No reset possible
300634454Bea Baselines 🐤challenge-aido_LF-baseline-duckietownaido3-LFV-real-validationeval1-visualizehost-errornoip-172-31-46-148-104920:06:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1420, in download_artefacts
    copy_to_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
300476117Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0515499071171903
survival_time_median6.099999999999986
deviation-center-line_median0.38216199860118294
in-drivable-lane_median0.3999999999999997


other stats
agent_compute-ego_max0.05046287924051285
agent_compute-ego_mean0.038519198411120545
agent_compute-ego_median0.040063866774241126
agent_compute-ego_min0.022019036208526997
deviation-center-line_max0.660487617125942
deviation-center-line_mean0.3756563557666115
deviation-center-line_min0.1921902887077068
deviation-heading_max1.977339575854915
deviation-heading_mean1.4900582967869205
deviation-heading_median1.7559012212244816
deviation-heading_min0.9091042466504552
driven_any_max3.6877537684152646
driven_any_mean2.3835868661596757
driven_any_median2.4380866288005874
driven_any_min1.2023491711280945
driven_lanedir_consec_max3.637728536646304
driven_lanedir_consec_mean2.0708484600880075
driven_lanedir_consec_min1.000509118340519
driven_lanedir_max3.637728536646304
driven_lanedir_mean2.0708484600880075
driven_lanedir_median2.0515499071171903
driven_lanedir_min1.000509118340519
in-drivable-lane_max2.4999999999999947
in-drivable-lane_mean0.7199999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3619977653481257, "sim_physics": 0.05877430831329732, "survival_time": 3.949999999999994, "driven_lanedir": 1.2978935077780274, "sim_render-ego": 0.0073145190371742734, "in-drivable-lane": 0, "agent_compute-ego": 0.022019036208526997, "deviation-heading": 0.9091042466504552, "set_robot_commands": 0.005412201338176486, "deviation-center-line": 0.1921902887077068, "driven_lanedir_consec": 1.2978935077780274, "sim_compute_sim_state": 0.0030674089359331736, "sim_compute_performance-ego": 0.004307318337355988, "sim_compute_robot_state-ego": 0.005150511294980592}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2023491711280945, "sim_physics": 0.1379062607884407, "survival_time": 3.1999999999999966, "driven_lanedir": 1.000509118340519, "sim_render-ego": 0.01462211087346077, "in-drivable-lane": 0.3999999999999997, "agent_compute-ego": 0.05046287924051285, "deviation-heading": 0.9705595670203052, "set_robot_commands": 0.011411599814891815, "deviation-center-line": 0.229512451083044, "driven_lanedir_consec": 1.000509118340519, "sim_compute_sim_state": 0.0053703673183918, "sim_compute_performance-ego": 0.00824807956814766, "sim_compute_robot_state-ego": 0.010342281311750412}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.6877537684152646, "sim_physics": 0.12354048252105714, "survival_time": 14.950000000000076, "driven_lanedir": 3.637728536646304, "sim_render-ego": 0.01333902676900228, "in-drivable-lane": 0, "agent_compute-ego": 0.040063866774241126, "deviation-heading": 1.8373868731844432, "set_robot_commands": 0.010832863648732503, "deviation-center-line": 0.660487617125942, "driven_lanedir_consec": 3.637728536646304, "sim_compute_sim_state": 0.005335009892781575, "sim_compute_performance-ego": 0.00790525197982788, "sim_compute_robot_state-ego": 0.009980773131052651}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.227746997106306, "sim_physics": 0.12232437420412492, "survival_time": 9.149999999999997, "driven_lanedir": 2.366561230557999, "sim_render-ego": 0.013125252853977224, "in-drivable-lane": 2.4999999999999947, "agent_compute-ego": 0.04091409516464817, "deviation-heading": 1.977339575854915, "set_robot_commands": 0.010660425561373352, "deviation-center-line": 0.41392942331518184, "driven_lanedir_consec": 2.366561230557999, "sim_compute_sim_state": 0.005350099886701406, "sim_compute_performance-ego": 0.007901323297636105, "sim_compute_robot_state-ego": 0.010129445237540157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.4380866288005874, "sim_physics": 0.1154398976779375, "survival_time": 6.099999999999986, "driven_lanedir": 2.0515499071171903, "sim_render-ego": 0.012537561479161996, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.03913611466767358, "deviation-heading": 1.7559012212244816, "set_robot_commands": 0.010593293143100426, "deviation-center-line": 0.38216199860118294, "driven_lanedir_consec": 2.0515499071171903, "sim_compute_sim_state": 0.004976241314997439, "sim_compute_performance-ego": 0.007711811143843854, "sim_compute_robot_state-ego": 0.009558290731711466}}
set_robot_commands_max0.011411599814891815
set_robot_commands_mean0.009782076701254916
set_robot_commands_median0.010660425561373352
set_robot_commands_min0.005412201338176486
sim_compute_performance-ego_max0.00824807956814766
sim_compute_performance-ego_mean0.007214756865362297
sim_compute_performance-ego_median0.007901323297636105
sim_compute_performance-ego_min0.004307318337355988
sim_compute_robot_state-ego_max0.010342281311750412
sim_compute_robot_state-ego_mean0.009032260341407056
sim_compute_robot_state-ego_median0.009980773131052651
sim_compute_robot_state-ego_min0.005150511294980592
sim_compute_sim_state_max0.0053703673183918
sim_compute_sim_state_mean0.004819825469761079
sim_compute_sim_state_median0.005335009892781575
sim_compute_sim_state_min0.0030674089359331736
sim_physics_max0.1379062607884407
sim_physics_mean0.1115970647009715
sim_physics_median0.12232437420412492
sim_physics_min0.05877430831329732
sim_render-ego_max0.01462211087346077
sim_render-ego_mean0.012187694202555308
sim_render-ego_median0.013125252853977224
sim_render-ego_min0.0073145190371742734
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.47000000000001
survival_time_min3.1999999999999966
No reset possible
300015839Soroush Saryazdi 🇨🇦upduckaido3-LF-real-validationeval1-visualizesuccessnoip-172-31-46-148-104920:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.7084004722999664
survival_time4.6667
deviation-center-line0.20207493943401408
in-drivable-lane0


other stats
deviation-heading1.1028786269833295
driven_any0.7145120954386449
driven_lanedir0.7084004722999664
visualized-eval1-passed1
No reset possible
299926100Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.781016014828945
survival_time_median8.74999999999999
deviation-center-line_median0.4152861827148592
in-drivable-lane_median0


other stats
agent_compute-ego_max0.027510344982147217
agent_compute-ego_mean0.0228907676228553
agent_compute-ego_median0.021395527083298255
agent_compute-ego_min0.02073050101598104
deviation-center-line_max0.8844475302627421
deviation-center-line_mean0.5117487939969194
deviation-center-line_min0.14580684861339074
deviation-heading_max3.939020119613584
deviation-heading_mean2.0858238300737195
deviation-heading_median1.7660028148503335
deviation-heading_min0.8440993652544267
driven_any_max4.625802166795949
driven_any_mean2.981904622963603
driven_any_median3.27652190031015
driven_any_min1.2854878380467527
driven_lanedir_consec_max4.487666702351923
driven_lanedir_consec_mean2.7658240428574064
driven_lanedir_consec_min1.2101724518002348
driven_lanedir_max4.487666702351923
driven_lanedir_mean2.7658240428574064
driven_lanedir_median2.781016014828945
driven_lanedir_min1.2101724518002348
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.2300000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4110010210531885, "sim_physics": 0.0563442953701677, "survival_time": 4.3499999999999925, "driven_lanedir": 1.376478060179556, "sim_render-ego": 0.007205201291489875, "in-drivable-lane": 0, "agent_compute-ego": 0.021395527083298255, "deviation-heading": 0.8440993652544267, "set_robot_commands": 0.005148890374720782, "deviation-center-line": 0.14580684861339074, "driven_lanedir_consec": 1.376478060179556, "sim_compute_sim_state": 0.002907750250279218, "sim_compute_performance-ego": 0.004180957531106883, "sim_compute_robot_state-ego": 0.00499651897912738}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2854878380467527, "sim_physics": 0.05559645330204683, "survival_time": 3.399999999999996, "driven_lanedir": 1.2101724518002348, "sim_render-ego": 0.007188001099754782, "in-drivable-lane": 0, "agent_compute-ego": 0.02081376314163208, "deviation-heading": 1.0166897116594218, "set_robot_commands": 0.005133099415723015, "deviation-center-line": 0.30375914696682316, "driven_lanedir_consec": 1.2101724518002348, "sim_compute_sim_state": 0.0028584424187155333, "sim_compute_performance-ego": 0.003975847188164206, "sim_compute_robot_state-ego": 0.004941775518305162}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.310710188611973, "sim_physics": 0.05325123151143392, "survival_time": 14.950000000000076, "driven_lanedir": 3.973786985126373, "sim_render-ego": 0.007603045304616292, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.02073050101598104, "deviation-heading": 3.939020119613584, "set_robot_commands": 0.005202632745107015, "deviation-center-line": 0.8094442614267822, "driven_lanedir_consec": 3.973786985126373, "sim_compute_sim_state": 0.0029103763898213706, "sim_compute_performance-ego": 0.004007221857706706, "sim_compute_robot_state-ego": 0.004980198542277018}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.27652190031015, "sim_physics": 0.06193908146449498, "survival_time": 8.74999999999999, "driven_lanedir": 2.781016014828945, "sim_render-ego": 0.007932583945138114, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.02400370189121791, "deviation-heading": 1.7660028148503335, "set_robot_commands": 0.006136458260672433, "deviation-center-line": 0.4152861827148592, "driven_lanedir_consec": 2.781016014828945, "sim_compute_sim_state": 0.0031602096557617186, "sim_compute_performance-ego": 0.00446613039289202, "sim_compute_robot_state-ego": 0.005638821465628488}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.625802166795949, "sim_physics": 0.07503313700358073, "survival_time": 14.950000000000076, "driven_lanedir": 4.487666702351923, "sim_render-ego": 0.00921756664911906, "in-drivable-lane": 0, "agent_compute-ego": 0.027510344982147217, "deviation-heading": 2.8633071389908324, "set_robot_commands": 0.007174301942189535, "deviation-center-line": 0.8844475302627421, "driven_lanedir_consec": 4.487666702351923, "sim_compute_sim_state": 0.0039111812909444175, "sim_compute_performance-ego": 0.005467055638631185, "sim_compute_robot_state-ego": 0.0067409737904866535}}
set_robot_commands_max0.007174301942189535
set_robot_commands_mean0.005759076547682556
set_robot_commands_median0.005202632745107015
set_robot_commands_min0.005133099415723015
sim_compute_performance-ego_max0.005467055638631185
sim_compute_performance-ego_mean0.0044194425217002
sim_compute_performance-ego_median0.004180957531106883
sim_compute_performance-ego_min0.003975847188164206
sim_compute_robot_state-ego_max0.0067409737904866535
sim_compute_robot_state-ego_mean0.00545965765916494
sim_compute_robot_state-ego_median0.00499651897912738
sim_compute_robot_state-ego_min0.004941775518305162
sim_compute_sim_state_max0.0039111812909444175
sim_compute_sim_state_mean0.0031495920011044517
sim_compute_sim_state_median0.0029103763898213706
sim_compute_sim_state_min0.0028584424187155333
sim_physics_max0.07503313700358073
sim_physics_mean0.060432839730344835
sim_physics_median0.0563442953701677
sim_physics_min0.05325123151143392
sim_render-ego_max0.00921756664911906
sim_render-ego_mean0.007829279658023625
sim_render-ego_median0.007603045304616292
sim_render-ego_min0.007188001099754782
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.280000000000026
survival_time_min3.399999999999996
No reset possible
299866096Aleksei Shpilman 🇷🇺4 seasonsaido3-LF-sim-testingstep1-simulationabortednoip-172-31-46-148-104920:07:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
299746094Aleksei Shpilman 🇷🇺4 seasonsaido3-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:10:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0748057133665205
survival_time_median13.900000000000064
deviation-center-line_median0.6161323267207105
in-drivable-lane_median0.8500000000000121


other stats
agent_compute-ego_max0.01791002909342448
agent_compute-ego_mean0.01737746452470349
agent_compute-ego_median0.017268773582246568
agent_compute-ego_min0.017073640952239167
deviation-center-line_max0.8518260011712052
deviation-center-line_mean0.5615313694231755
deviation-center-line_min0.25863356319326464
deviation-heading_max4.786298404920682
deviation-heading_mean3.3051218681152505
deviation-heading_median3.923813599361512
deviation-heading_min1.2214432624586853
driven_any_max3.72388477844626
driven_any_mean2.8906016020890717
driven_any_median3.6133743618486664
driven_any_min1.183058728563821
driven_lanedir_consec_max3.173237204056393
driven_lanedir_consec_mean2.4981276532352754
driven_lanedir_consec_min1.0623822833434255
driven_lanedir_max3.2404504625786124
driven_lanedir_mean2.5179215292874284
driven_lanedir_median3.0748057133665205
driven_lanedir_min1.0623822833434255
in-drivable-lane_max1.3500000000000192
in-drivable-lane_mean0.6700000000000094
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 3.6133743618486664, "sim_physics": 0.12399781306584676, "survival_time": 14.950000000000076, "driven_lanedir": 3.0748057133665205, "sim_render-ego": 0.0071361509958903, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.01791002909342448, "deviation-heading": 3.923813599361512, "set_robot_commands": 0.005126755237579345, "deviation-center-line": 0.6161323267207105, "driven_lanedir_consec": 3.0748057133665205, "sim_compute_sim_state": 0.002956569194793701, "sim_compute_performance-ego": 0.004047462940216065, "sim_compute_robot_state-ego": 0.005189347267150879, "sim_compute_robot_state-npc0": 0.004957278569539388, "sim_compute_robot_state-npc1": 0.004773218631744385, "sim_compute_robot_state-npc2": 0.004771963755289713, "sim_compute_robot_state-npc3": 0.004737301667531332}, "udem1-1-0": {"driven_any": 3.72388477844626, "sim_physics": 0.11866603223539944, "survival_time": 13.900000000000064, "driven_lanedir": 3.2404504625786124, "sim_render-ego": 0.007167452530895206, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.01718249595422539, "deviation-heading": 4.786298404920682, "set_robot_commands": 0.005080948630682856, "deviation-center-line": 0.8518260011712052, "driven_lanedir_consec": 3.173237204056393, "sim_compute_sim_state": 0.0029506511825451746, "sim_compute_performance-ego": 0.004049654487225649, "sim_compute_robot_state-ego": 0.005188533728071254, "sim_compute_robot_state-npc0": 0.004937901771325859, "sim_compute_robot_state-npc1": 0.004792725439551923, "sim_compute_robot_state-npc2": 0.004746102600646534, "sim_compute_robot_state-npc3": 0.00475265310822631}, "udem1-2-0": {"driven_any": 1.183058728563821, "sim_physics": 0.10691575424091236, "survival_time": 3.699999999999995, "driven_lanedir": 1.0623822833434255, "sim_render-ego": 0.012697364832903887, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.017073640952239167, "deviation-heading": 1.2214432624586853, "set_robot_commands": 0.005203140748513711, "deviation-center-line": 0.25863356319326464, "driven_lanedir_consec": 1.0623822833434255, "sim_compute_sim_state": 0.002931002024057749, "sim_compute_performance-ego": 0.004037663743302629, "sim_compute_robot_state-ego": 0.005254674602199245, "sim_compute_robot_state-npc0": 0.004911761026124697, "sim_compute_robot_state-npc1": 0.004792935139424092, "sim_compute_robot_state-npc2": 0.004726770761850718, "sim_compute_robot_state-npc3": 0.004667265995128735}, "udem1-3-0": {"driven_any": 2.3158013973835434, "sim_physics": 0.11607234676678976, "survival_time": 7.199999999999982, "driven_lanedir": 2.086677100048255, "sim_render-ego": 0.007240702708562215, "in-drivable-lane": 0, "agent_compute-ego": 0.017268773582246568, "deviation-heading": 2.4756610304382156, "set_robot_commands": 0.005159934361775716, "deviation-center-line": 0.44815763707435985, "driven_lanedir_consec": 2.0731594217806624, "sim_compute_sim_state": 0.0029489679469002616, "sim_compute_performance-ego": 0.004019786914189656, "sim_compute_robot_state-ego": 0.005207374691963196, "sim_compute_robot_state-npc0": 0.004947374264399211, "sim_compute_robot_state-npc1": 0.004759790168868171, "sim_compute_robot_state-npc2": 0.004747544725735982, "sim_compute_robot_state-npc3": 0.004719843467076619}, "udem1-4-0": {"driven_any": 3.6168887442030657, "sim_physics": 0.12532496213912964, "survival_time": 14.950000000000076, "driven_lanedir": 3.1252920871003265, "sim_render-ego": 0.007135570049285889, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.017452383041381837, "deviation-heading": 4.118393043397159, "set_robot_commands": 0.0050866254170735675, "deviation-center-line": 0.632907318956337, "driven_lanedir_consec": 3.1070536436293756, "sim_compute_sim_state": 0.002891124884287516, "sim_compute_performance-ego": 0.004022428194681803, "sim_compute_robot_state-ego": 0.005174402395884196, "sim_compute_robot_state-npc0": 0.004927771091461182, "sim_compute_robot_state-npc1": 0.004725444316864014, "sim_compute_robot_state-npc2": 0.0047094297409057614, "sim_compute_robot_state-npc3": 0.004699421723683675}}
set_robot_commands_max0.005203140748513711
set_robot_commands_mean0.005131480879125039
set_robot_commands_median0.005126755237579345
set_robot_commands_min0.005080948630682856
sim_compute_performance-ego_max0.004049654487225649
sim_compute_performance-ego_mean0.0040353992559231605
sim_compute_performance-ego_median0.004037663743302629
sim_compute_performance-ego_min0.004019786914189656
sim_compute_robot_state-ego_max0.005254674602199245
sim_compute_robot_state-ego_mean0.005202866537053754
sim_compute_robot_state-ego_median0.005189347267150879
sim_compute_robot_state-ego_min0.005174402395884196
sim_compute_robot_state-npc0_max0.004957278569539388
sim_compute_robot_state-npc0_mean0.004936417344570067
sim_compute_robot_state-npc0_median0.004937901771325859
sim_compute_robot_state-npc0_min0.004911761026124697
sim_compute_robot_state-npc1_max0.004792935139424092
sim_compute_robot_state-npc1_mean0.0047688227392905175
sim_compute_robot_state-npc1_median0.004773218631744385
sim_compute_robot_state-npc1_min0.004725444316864014
sim_compute_robot_state-npc2_max0.004771963755289713
sim_compute_robot_state-npc2_mean0.004740362316885742
sim_compute_robot_state-npc2_median0.004746102600646534
sim_compute_robot_state-npc2_min0.0047094297409057614
sim_compute_robot_state-npc3_max0.00475265310822631
sim_compute_robot_state-npc3_mean0.004715297192329334
sim_compute_robot_state-npc3_median0.004719843467076619
sim_compute_robot_state-npc3_min0.004667265995128735
sim_compute_sim_state_max0.002956569194793701
sim_compute_sim_state_mean0.0029356630465168804
sim_compute_sim_state_median0.0029489679469002616
sim_compute_sim_state_min0.002891124884287516
sim_physics_max0.12532496213912964
sim_physics_mean0.1181953816896156
sim_physics_median0.11866603223539944
sim_physics_min0.10691575424091236
sim_render-ego_max0.012697364832903887
sim_render-ego_mean0.008275448223507498
sim_render-ego_median0.007167452530895206
sim_render-ego_min0.007135570049285889
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.940000000000037
survival_time_min3.699999999999995
No reset possible
299716096Aleksei Shpilman 🇷🇺4 seasonsaido3-LF-sim-testingstep1-simulationabortednoip-172-31-46-148-104920:13:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
299606014Philippe Marcotte 🇨🇦pp + veh dectaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:19:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4729659423711947
survival_time_median14.950000000000076
deviation-center-line_median0.5391839407371686
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05371260484059652
agent_compute-ego_mean0.05150091298421224
agent_compute-ego_median0.05130107720692952
agent_compute-ego_min0.05040753444035848
deviation-center-line_max0.9903282949281188
deviation-center-line_mean0.610319979459826
deviation-center-line_min0.4465271230035944
deviation-heading_max3.9316697129382754
deviation-heading_mean2.7770181025048077
deviation-heading_median2.699036935694174
deviation-heading_min2.0260079154082566
driven_any_max2.5486901842566723
driven_any_mean2.523857787131066
driven_any_median2.519619545418888
driven_any_min2.5013291710839916
driven_lanedir_consec_max2.5055529353421933
driven_lanedir_consec_mean2.4590272130158004
driven_lanedir_consec_min2.3960086491595636
driven_lanedir_max2.5055529353421933
driven_lanedir_mean2.4590272130158004
driven_lanedir_median2.4729659423711947
driven_lanedir_min2.3960086491595636
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5013291710839916, "sim_physics": 0.15935739358266196, "survival_time": 14.950000000000076, "driven_lanedir": 2.4468642907091662, "sim_render-ego": 0.011025147438049316, "in-drivable-lane": 0, "agent_compute-ego": 0.05130107720692952, "deviation-heading": 2.699036935694174, "set_robot_commands": 0.008881466388702393, "deviation-center-line": 0.582101005854331, "driven_lanedir_consec": 2.4468642907091662, "sim_compute_sim_state": 0.004449429512023925, "sim_compute_performance-ego": 0.006581958134969076, "sim_compute_robot_state-ego": 0.008283216158548991, "sim_compute_robot_state-npc0": 0.00807250181833903, "sim_compute_robot_state-npc1": 0.0077630615234375, "sim_compute_robot_state-npc2": 0.007650031248728434, "sim_compute_robot_state-npc3": 0.0075941268603007}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5059211660607597, "sim_physics": 0.17360079685846966, "survival_time": 14.950000000000076, "driven_lanedir": 2.4729659423711947, "sim_render-ego": 0.0113015087445577, "in-drivable-lane": 0, "agent_compute-ego": 0.05158140341440837, "deviation-heading": 2.0260079154082566, "set_robot_commands": 0.009015679359436035, "deviation-center-line": 0.4465271230035944, "driven_lanedir_consec": 2.4729659423711947, "sim_compute_sim_state": 0.004483280976613362, "sim_compute_performance-ego": 0.006630360285441081, "sim_compute_robot_state-ego": 0.008398321469624838, "sim_compute_robot_state-npc0": 0.00813835859298706, "sim_compute_robot_state-npc1": 0.007804841995239258, "sim_compute_robot_state-npc2": 0.007530316511789958, "sim_compute_robot_state-npc3": 0.007769215106964112}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5486901842566723, "sim_physics": 0.16241014877955118, "survival_time": 14.950000000000076, "driven_lanedir": 2.4737442474968834, "sim_render-ego": 0.011262088616689049, "in-drivable-lane": 0, "agent_compute-ego": 0.05050194501876831, "deviation-heading": 2.93576859697351, "set_robot_commands": 0.009344964822133385, "deviation-center-line": 0.5391839407371686, "driven_lanedir_consec": 2.4737442474968834, "sim_compute_sim_state": 0.004600626627604167, "sim_compute_performance-ego": 0.006523385842641194, "sim_compute_robot_state-ego": 0.00837412675221761, "sim_compute_robot_state-npc0": 0.008368432521820068, "sim_compute_robot_state-npc1": 0.007788049379984538, "sim_compute_robot_state-npc2": 0.007694286505381266, "sim_compute_robot_state-npc3": 0.007752545674641927}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.5437288688350193, "sim_physics": 0.17291014750798545, "survival_time": 14.950000000000076, "driven_lanedir": 2.5055529353421933, "sim_render-ego": 0.011038142840067546, "in-drivable-lane": 0, "agent_compute-ego": 0.05371260484059652, "deviation-heading": 2.2926073515098233, "set_robot_commands": 0.008989946047465006, "deviation-center-line": 0.49345953277591686, "driven_lanedir_consec": 2.5055529353421933, "sim_compute_sim_state": 0.004405976136525472, "sim_compute_performance-ego": 0.006609576543172201, "sim_compute_robot_state-ego": 0.008417112827301025, "sim_compute_robot_state-npc0": 0.008304295539855957, "sim_compute_robot_state-npc1": 0.007904175917307537, "sim_compute_robot_state-npc2": 0.007613231341044108, "sim_compute_robot_state-npc3": 0.007774458726247152}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.519619545418888, "sim_physics": 0.16204975684483847, "survival_time": 14.950000000000076, "driven_lanedir": 2.3960086491595636, "sim_render-ego": 0.011254899501800536, "in-drivable-lane": 0, "agent_compute-ego": 0.05040753444035848, "deviation-heading": 3.9316697129382754, "set_robot_commands": 0.009392389456431073, "deviation-center-line": 0.9903282949281188, "driven_lanedir_consec": 2.3960086491595636, "sim_compute_sim_state": 0.004595959981282552, "sim_compute_performance-ego": 0.006526002089182536, "sim_compute_robot_state-ego": 0.008327696323394775, "sim_compute_robot_state-npc0": 0.008120954036712646, "sim_compute_robot_state-npc1": 0.007874295711517335, "sim_compute_robot_state-npc2": 0.007771848042805989, "sim_compute_robot_state-npc3": 0.0077837944030761715}}
set_robot_commands_max0.009392389456431073
set_robot_commands_mean0.00912488921483358
set_robot_commands_median0.009015679359436035
set_robot_commands_min0.008881466388702393
sim_compute_performance-ego_max0.006630360285441081
sim_compute_performance-ego_mean0.006574256579081217
sim_compute_performance-ego_median0.006581958134969076
sim_compute_performance-ego_min0.006523385842641194
sim_compute_robot_state-ego_max0.008417112827301025
sim_compute_robot_state-ego_mean0.008360094706217448
sim_compute_robot_state-ego_median0.00837412675221761
sim_compute_robot_state-ego_min0.008283216158548991
sim_compute_robot_state-npc0_max0.008368432521820068
sim_compute_robot_state-npc0_mean0.008200908501942952
sim_compute_robot_state-npc0_median0.00813835859298706
sim_compute_robot_state-npc0_min0.00807250181833903
sim_compute_robot_state-npc1_max0.007904175917307537
sim_compute_robot_state-npc1_mean0.007826884905497234
sim_compute_robot_state-npc1_median0.007804841995239258
sim_compute_robot_state-npc1_min0.0077630615234375
sim_compute_robot_state-npc2_max0.007771848042805989
sim_compute_robot_state-npc2_mean0.007651942729949951
sim_compute_robot_state-npc2_median0.007650031248728434
sim_compute_robot_state-npc2_min0.007530316511789958
sim_compute_robot_state-npc3_max0.0077837944030761715
sim_compute_robot_state-npc3_mean0.007734828154246013
sim_compute_robot_state-npc3_median0.007769215106964112
sim_compute_robot_state-npc3_min0.0075941268603007
sim_compute_sim_state_max0.004600626627604167
sim_compute_sim_state_mean0.0045070546468098955
sim_compute_sim_state_median0.004483280976613362
sim_compute_sim_state_min0.004405976136525472
sim_physics_max0.17360079685846966
sim_physics_mean0.16606564871470134
sim_physics_median0.16241014877955118
sim_physics_min0.15935739358266196
sim_render-ego_max0.0113015087445577
sim_render-ego_mean0.011176357428232827
sim_render-ego_median0.011254899501800536
sim_render-ego_min0.011025147438049316
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
299376085Mikita Sazanovich 🇷🇺chameleon-09-trioaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:15:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2340181892725437
survival_time_median14.950000000000076
deviation-center-line_median0.741216172319145
in-drivable-lane_median2.1500000000000306


other stats
agent_compute-ego_max0.024376225471496583
agent_compute-ego_mean0.023682932913772707
agent_compute-ego_median0.02371817747751872
agent_compute-ego_min0.022759937445322672
deviation-center-line_max0.9116242349457176
deviation-center-line_mean0.7535062019642869
deviation-center-line_min0.6748852540797757
deviation-heading_max4.731081340904259
deviation-heading_mean3.9606352502076314
deviation-heading_median4.061442867213547
deviation-heading_min2.325805734161989
driven_any_max4.141232620329279
driven_any_mean3.851314376425667
driven_any_median4.124992448727021
driven_any_min3.3863320446104024
driven_lanedir_consec_max3.5673123338697934
driven_lanedir_consec_mean2.8574045987692887
driven_lanedir_consec_min1.0989392544483303
driven_lanedir_max3.5673123338697934
driven_lanedir_mean3.0748304372381687
driven_lanedir_median3.2340181892725437
driven_lanedir_min2.1860684467927314
in-drivable-lane_max5
in-drivable-lane_mean2.270000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.13014438130279, "sim_physics": 0.13211294651031494, "survival_time": 14.950000000000076, "driven_lanedir": 3.0955004352788973, "sim_render-ego": 0.009321422576904296, "in-drivable-lane": 2.900000000000026, "agent_compute-ego": 0.02437508980433146, "deviation-heading": 4.731081340904259, "set_robot_commands": 0.007302929560343424, "deviation-center-line": 0.6912001665963581, "driven_lanedir_consec": 3.0955004352788973, "sim_compute_sim_state": 0.0038701279958089194, "sim_compute_performance-ego": 0.005438311894734701, "sim_compute_robot_state-ego": 0.006944054762522379, "sim_compute_robot_state-npc0": 0.0067619983355204265, "sim_compute_robot_state-npc1": 0.006514074802398681, "sim_compute_robot_state-npc2": 0.00649084488550822, "sim_compute_robot_state-npc3": 0.006393323739369711}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4738703871588417, "sim_physics": 0.14525809208552043, "survival_time": 14.950000000000076, "driven_lanedir": 2.1860684467927314, "sim_render-ego": 0.009470016956329343, "in-drivable-lane": 5, "agent_compute-ego": 0.022759937445322672, "deviation-heading": 4.0584913989087505, "set_robot_commands": 0.007428603172302246, "deviation-center-line": 0.741216172319145, "driven_lanedir_consec": 1.0989392544483303, "sim_compute_sim_state": 0.0038681697845458986, "sim_compute_performance-ego": 0.00562279224395752, "sim_compute_robot_state-ego": 0.00704028844833374, "sim_compute_robot_state-npc0": 0.00684263547261556, "sim_compute_robot_state-npc1": 0.006551656723022461, "sim_compute_robot_state-npc2": 0.006483150323232015, "sim_compute_robot_state-npc3": 0.006455887953440348}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.3863320446104024, "sim_physics": 0.13305871036109024, "survival_time": 12.700000000000044, "driven_lanedir": 3.291252780976879, "sim_render-ego": 0.009573152684789943, "in-drivable-lane": 0, "agent_compute-ego": 0.023185234370194083, "deviation-heading": 2.325805734161989, "set_robot_commands": 0.007502650651406115, "deviation-center-line": 0.6748852540797757, "driven_lanedir_consec": 3.291252780976879, "sim_compute_sim_state": 0.0037712872497678743, "sim_compute_performance-ego": 0.005483321317537563, "sim_compute_robot_state-ego": 0.006921116761335238, "sim_compute_robot_state-npc0": 0.006764125636243444, "sim_compute_robot_state-npc1": 0.006495207313477524, "sim_compute_robot_state-npc2": 0.006504371410279762, "sim_compute_robot_state-npc3": 0.006474521216445082}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.141232620329279, "sim_physics": 0.1407990042368571, "survival_time": 14.950000000000076, "driven_lanedir": 3.2340181892725437, "sim_render-ego": 0.009764180978139242, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.02371817747751872, "deviation-heading": 4.62635490984961, "set_robot_commands": 0.0075629933675130205, "deviation-center-line": 0.7486051818804382, "driven_lanedir_consec": 3.2340181892725437, "sim_compute_sim_state": 0.00397582213083903, "sim_compute_performance-ego": 0.005660264492034912, "sim_compute_robot_state-ego": 0.007198143800099691, "sim_compute_robot_state-npc0": 0.007086394627888997, "sim_compute_robot_state-npc1": 0.006910163561503093, "sim_compute_robot_state-npc2": 0.006732711791992188, "sim_compute_robot_state-npc3": 0.006787447134653727}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.124992448727021, "sim_physics": 0.14279507398605346, "survival_time": 14.950000000000076, "driven_lanedir": 3.5673123338697934, "sim_render-ego": 0.009550180435180664, "in-drivable-lane": 1.3000000000000025, "agent_compute-ego": 0.024376225471496583, "deviation-heading": 4.061442867213547, "set_robot_commands": 0.007673755486806233, "deviation-center-line": 0.9116242349457176, "driven_lanedir_consec": 3.5673123338697934, "sim_compute_sim_state": 0.003987249533335368, "sim_compute_performance-ego": 0.005555903116861979, "sim_compute_robot_state-ego": 0.007176187833150228, "sim_compute_robot_state-npc0": 0.00713806947072347, "sim_compute_robot_state-npc1": 0.006706287066141764, "sim_compute_robot_state-npc2": 0.006673997243245443, "sim_compute_robot_state-npc3": 0.006535124778747558}}
set_robot_commands_max0.007673755486806233
set_robot_commands_mean0.007494186447674208
set_robot_commands_median0.007502650651406115
set_robot_commands_min0.007302929560343424
sim_compute_performance-ego_max0.005660264492034912
sim_compute_performance-ego_mean0.005552118613025335
sim_compute_performance-ego_median0.005555903116861979
sim_compute_performance-ego_min0.005438311894734701
sim_compute_robot_state-ego_max0.007198143800099691
sim_compute_robot_state-ego_mean0.007055958321088256
sim_compute_robot_state-ego_median0.00704028844833374
sim_compute_robot_state-ego_min0.006921116761335238
sim_compute_robot_state-npc0_max0.00713806947072347
sim_compute_robot_state-npc0_mean0.006918644708598379
sim_compute_robot_state-npc0_median0.00684263547261556
sim_compute_robot_state-npc0_min0.0067619983355204265
sim_compute_robot_state-npc1_max0.006910163561503093
sim_compute_robot_state-npc1_mean0.006635477893308704
sim_compute_robot_state-npc1_median0.006551656723022461
sim_compute_robot_state-npc1_min0.006495207313477524
sim_compute_robot_state-npc2_max0.006732711791992188
sim_compute_robot_state-npc2_mean0.006577015130851527
sim_compute_robot_state-npc2_median0.006504371410279762
sim_compute_robot_state-npc2_min0.006483150323232015
sim_compute_robot_state-npc3_max0.006787447134653727
sim_compute_robot_state-npc3_mean0.006529260964531285
sim_compute_robot_state-npc3_median0.006474521216445082
sim_compute_robot_state-npc3_min0.006393323739369711
sim_compute_sim_state_max0.003987249533335368
sim_compute_sim_state_mean0.003894531338859418
sim_compute_sim_state_median0.0038701279958089194
sim_compute_sim_state_min0.0037712872497678743
sim_physics_max0.14525809208552043
sim_physics_mean0.13880476543596726
sim_physics_median0.1407990042368571
sim_physics_min0.13211294651031494
sim_render-ego_max0.009764180978139242
sim_render-ego_mean0.009535790726268697
sim_render-ego_median0.009550180435180664
sim_render-ego_min0.009321422576904296
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.500000000000073
survival_time_min12.700000000000044
No reset possible
299266078Mikita Sazanovich 🇷🇺chameleon-09-trioaido3-LFV-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:02:12
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
299036032Frank (Chude) Qian 🇨🇦2019-12-10|FrankNet|(Kay❤️Frank)aido3-LFVI-sim-testingstep1-simulationsuccessyesip-172-31-46-148-104920:29:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.166146805013589
survival_time_median8.499999999999986
deviation-center-line_median0.5540282918817172
in-drivable-lane_median1.1000000000000032


other stats
agent_compute-ego_max0.041687820939456714
agent_compute-ego_mean0.0394567822024976
agent_compute-ego_median0.039374662240346275
agent_compute-ego_min0.038698033725514135
deviation-center-line_max1.3015329128795825
deviation-center-line_mean0.621473954969933
deviation-center-line_min0.07429147229702793
deviation-heading_max3.452423504580941
deviation-heading_mean2.276174804565353
deviation-heading_median2.443345202114528
deviation-heading_min0.5998652308005579
driven_any_max4.796996474966152
driven_any_mean2.8884157618911175
driven_any_median2.6316277458081725
driven_any_min0.6572009026151584
driven_lanedir_consec_max3.805065604185831
driven_lanedir_consec_mean2.0196877120538392
driven_lanedir_consec_min0.5486425824322939
driven_lanedir_max3.8881360547260138
driven_lanedir_mean2.1555107682916193
driven_lanedir_median2.2385763288922993
driven_lanedir_min0.5486425824322939
in-drivable-lane_max6.150000000000068
in-drivable-lane_mean1.853333333333348
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.6316277458081725, "sim_physics": 0.13364076333887437, "survival_time": 8.499999999999986, "driven_lanedir": 2.5666591571669275, "sim_render-ego": 0.007605305839987362, "in-drivable-lane": 0, "agent_compute-ego": 0.041687820939456714, "deviation-heading": 1.5748379865410955, "set_robot_commands": 0.005150306926054113, "deviation-center-line": 0.4233217821446303, "driven_lanedir_consec": 2.176619583656598, "sim_compute_sim_state": 0.0032030638526467717, "sim_compute_performance-ego": 0.004335082278532141, "sim_compute_robot_state-ego": 0.005373024940490722, "sim_compute_robot_state-npc0": 0.005316717484418083, "sim_compute_robot_state-npc1": 0.005132707427529728, "sim_compute_robot_state-npc2": 0.005085656222175149, "sim_compute_robot_state-npc3": 0.005031376726487104}, "udem1-1-0": {"driven_any": 1.160406750811721, "sim_physics": 0.13279051913155449, "survival_time": 3.599999999999995, "driven_lanedir": 1.1274683470573132, "sim_render-ego": 0.007731149593989055, "in-drivable-lane": 0, "agent_compute-ego": 0.03929420643382602, "deviation-heading": 0.6112890452090898, "set_robot_commands": 0.005141066180335151, "deviation-center-line": 0.17974368779706926, "driven_lanedir_consec": 1.1274683470573132, "sim_compute_sim_state": 0.0032351315021514893, "sim_compute_performance-ego": 0.004342794418334961, "sim_compute_robot_state-ego": 0.00539243221282959, "sim_compute_robot_state-npc0": 0.005344947179158528, "sim_compute_robot_state-npc1": 0.005167365074157715, "sim_compute_robot_state-npc2": 0.005094889137479994, "sim_compute_robot_state-npc3": 0.0050468577278984916}, "udem1-2-0": {"driven_any": 2.667208657282508, "sim_physics": 0.11348920191327733, "survival_time": 9.6, "driven_lanedir": 2.1166446580795335, "sim_render-ego": 0.007678743451833725, "in-drivable-lane": 1.1000000000000032, "agent_compute-ego": 0.03939718256394068, "deviation-heading": 3.0273603843008177, "set_robot_commands": 0.005277017752329509, "deviation-center-line": 0.8375591567374681, "driven_lanedir_consec": 1.6877257734633373, "sim_compute_sim_state": 0.0032438995937506356, "sim_compute_performance-ego": 0.004353448748588562, "sim_compute_robot_state-ego": 0.005418432255585988, "sim_compute_robot_state-npc0": 0.0053611186643441515, "sim_compute_robot_state-npc1": 0.00516048197944959, "sim_compute_robot_state-npc2": 0.005096763372421265, "sim_compute_robot_state-npc3": 0.005053459356228511}, "udem1-3-0": {"driven_any": 4.796996474966152, "sim_physics": 0.1168959927558899, "survival_time": 14.950000000000076, "driven_lanedir": 3.8881360547260138, "sim_render-ego": 0.007584106922149658, "in-drivable-lane": 1.950000000000016, "agent_compute-ego": 0.039488542874654135, "deviation-heading": 3.452423504580941, "set_robot_commands": 0.0052605565388997395, "deviation-center-line": 1.3015329128795825, "driven_lanedir_consec": 3.805065604185831, "sim_compute_sim_state": 0.0032994349797566733, "sim_compute_performance-ego": 0.004347224235534668, "sim_compute_robot_state-ego": 0.0054152774810791015, "sim_compute_robot_state-npc0": 0.005421629746754964, "sim_compute_robot_state-npc1": 0.005198424657185873, "sim_compute_robot_state-npc2": 0.00512088139851888, "sim_compute_robot_state-npc3": 0.005110026200612386}, "udem1-4-0": {"driven_any": 2.3704159483275404, "sim_physics": 0.13379809124017852, "survival_time": 7.649999999999981, "driven_lanedir": 2.2385763288922993, "sim_render-ego": 0.007773830999735914, "in-drivable-lane": 0, "agent_compute-ego": 0.03953748902464225, "deviation-heading": 2.166938342561829, "set_robot_commands": 0.005234204086602903, "deviation-center-line": 0.3840028503940004, "driven_lanedir_consec": 2.2385692151427534, "sim_compute_sim_state": 0.0031947996102127374, "sim_compute_performance-ego": 0.004335655885584214, "sim_compute_robot_state-ego": 0.0053656506382561975, "sim_compute_robot_state-npc0": 0.005354323418311824, "sim_compute_robot_state-npc1": 0.005149979996525385, "sim_compute_robot_state-npc2": 0.005051531822852839, "sim_compute_robot_state-npc3": 0.005066051981807534}, "udem1-5-0": {"driven_any": 1.5955803880912038, "sim_physics": 0.12593889644003323, "survival_time": 5.849999999999987, "driven_lanedir": 1.2179098395189905, "sim_render-ego": 0.007694299404437725, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.03882806729047726, "deviation-heading": 1.9314209268586415, "set_robot_commands": 0.005215121130658011, "deviation-center-line": 0.3421749758935699, "driven_lanedir_consec": 1.2179098395189905, "sim_compute_sim_state": 0.003202693075196356, "sim_compute_performance-ego": 0.004310842253204085, "sim_compute_robot_state-ego": 0.005432332682813334, "sim_compute_robot_state-npc0": 0.00530850581633739, "sim_compute_robot_state-npc1": 0.005072940109122513, "sim_compute_robot_state-npc2": 0.00507409552223662, "sim_compute_robot_state-npc3": 0.005035614356016502}, "udem1-6-0": {"driven_any": 4.373638495262478, "sim_physics": 0.11899874448776245, "survival_time": 14.950000000000076, "driven_lanedir": 2.3099244875298175, "sim_render-ego": 0.007584031422932943, "in-drivable-lane": 5.700000000000042, "agent_compute-ego": 0.03964666446050008, "deviation-heading": 3.2420561112364013, "set_robot_commands": 0.005227602322896321, "deviation-center-line": 1.0170899759014798, "driven_lanedir_consec": 2.3006177663091205, "sim_compute_sim_state": 0.0032767740885416667, "sim_compute_performance-ego": 0.004371192455291748, "sim_compute_robot_state-ego": 0.005438891251881918, "sim_compute_robot_state-npc0": 0.005432621637980143, "sim_compute_robot_state-npc1": 0.005165303548177083, "sim_compute_robot_state-npc2": 0.005149931112925212, "sim_compute_robot_state-npc3": 0.0050835355122884115}, "udem1-7-0": {"driven_any": 4.5039672839328215, "sim_physics": 0.1264931607246399, "survival_time": 14.950000000000076, "driven_lanedir": 2.441023974803256, "sim_render-ego": 0.007493696212768555, "in-drivable-lane": 5.650000000000039, "agent_compute-ego": 0.03921213785807292, "deviation-heading": 3.2171618527601265, "set_robot_commands": 0.005214622020721435, "deviation-center-line": 0.8420968614454358, "driven_lanedir_consec": 2.441023974803256, "sim_compute_sim_state": 0.0032001407941182453, "sim_compute_performance-ego": 0.004319078127543132, "sim_compute_robot_state-ego": 0.005376202265421549, "sim_compute_robot_state-npc0": 0.005323485533396403, "sim_compute_robot_state-npc1": 0.005112561384836832, "sim_compute_robot_state-npc2": 0.005051323572794596, "sim_compute_robot_state-npc3": 0.00503915786743164}, "udem1-8-0": {"driven_any": 2.3987038425099225, "sim_physics": 0.11577585304484649, "survival_time": 8.499999999999986, "driven_lanedir": 1.4075386246496449, "sim_render-ego": 0.007372317594640395, "in-drivable-lane": 2.1999999999999966, "agent_compute-ego": 0.038698033725514135, "deviation-heading": 2.835731823791976, "set_robot_commands": 0.005065432716818417, "deviation-center-line": 0.5540282918817172, "driven_lanedir_consec": 1.405453816078025, "sim_compute_sim_state": 0.003035452786613913, "sim_compute_performance-ego": 0.004144479246700511, "sim_compute_robot_state-ego": 0.00529019271626192, "sim_compute_robot_state-npc0": 0.005114172486697926, "sim_compute_robot_state-npc1": 0.004829016853781307, "sim_compute_robot_state-npc2": 0.004832858197829302, "sim_compute_robot_state-npc3": 0.004816783175748937}, "udem1-9-0": {"driven_any": 4.716146778507463, "sim_physics": 0.12612573464711507, "survival_time": 14.950000000000076, "driven_lanedir": 3.545323471375969, "sim_render-ego": 0.007673579851786296, "in-drivable-lane": 3.0500000000000433, "agent_compute-ego": 0.039374662240346275, "deviation-heading": 3.3209899098345304, "set_robot_commands": 0.005214589436848958, "deviation-center-line": 0.8693305065584765, "driven_lanedir_consec": 3.5311757485622843, "sim_compute_sim_state": 0.003352194627126058, "sim_compute_performance-ego": 0.004424453576405843, "sim_compute_robot_state-ego": 0.005421914259592692, "sim_compute_robot_state-npc0": 0.005401602586110433, "sim_compute_robot_state-npc1": 0.005217155615488688, "sim_compute_robot_state-npc2": 0.0051831857363382975, "sim_compute_robot_state-npc3": 0.0051723750432332355}, "udem1-10-0": {"driven_any": 0.6572009026151584, "sim_physics": 0.1314161018449433, "survival_time": 2.4499999999999993, "driven_lanedir": 0.5486425824322939, "sim_render-ego": 0.007978556107501594, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.03923163608628876, "deviation-heading": 0.5998652308005579, "set_robot_commands": 0.005310949014157665, "deviation-center-line": 0.07429147229702793, "driven_lanedir_consec": 0.5486425824322939, "sim_compute_sim_state": 0.003403201395151566, "sim_compute_performance-ego": 0.004549148131390007, "sim_compute_robot_state-ego": 0.005488673034979373, "sim_compute_robot_state-npc0": 0.0055344688649080235, "sim_compute_robot_state-npc1": 0.0053830973956049705, "sim_compute_robot_state-npc2": 0.005355640333525988, "sim_compute_robot_state-npc3": 0.005350122646409638}, "udem1-11-0": {"driven_any": 1.1493982518071542, "sim_physics": 0.1372336691076105, "survival_time": 3.8499999999999943, "driven_lanedir": 1.0860259030661052, "sim_render-ego": 0.007826724609771333, "in-drivable-lane": 0, "agent_compute-ego": 0.038839132754833666, "deviation-heading": 0.981397042238048, "set_robot_commands": 0.005381810200678838, "deviation-center-line": 0.21201701539850729, "driven_lanedir_consec": 1.0860259030661052, "sim_compute_sim_state": 0.0032809461866106305, "sim_compute_performance-ego": 0.0044609912030108565, "sim_compute_robot_state-ego": 0.005422753173035461, "sim_compute_robot_state-npc0": 0.005507224565976626, "sim_compute_robot_state-npc1": 0.005347710151176948, "sim_compute_robot_state-npc2": 0.005230312223558302, "sim_compute_robot_state-npc3": 0.005192806194354961}, "udem1-12-0": {"driven_any": 4.2718375952068675, "sim_physics": 0.12578440109888714, "survival_time": 14.950000000000076, "driven_lanedir": 2.3533500914081884, "sim_render-ego": 0.007615462144215901, "in-drivable-lane": 6.150000000000068, "agent_compute-ego": 0.039549596309661865, "deviation-heading": 2.443345202114528, "set_robot_commands": 0.005177923043568929, "deviation-center-line": 0.7183675595348308, "driven_lanedir_consec": 2.166146805013589, "sim_compute_sim_state": 0.003233374754587809, "sim_compute_performance-ego": 0.0043966833750406905, "sim_compute_robot_state-ego": 0.005403794447580973, "sim_compute_robot_state-npc0": 0.005350707372029622, "sim_compute_robot_state-npc1": 0.005192219416300456, "sim_compute_robot_state-npc2": 0.005097358226776123, "sim_compute_robot_state-npc3": 0.005092372894287109}, "udem1-13-0": {"driven_any": 2.184211732062981, "sim_physics": 0.11797238049441822, "survival_time": 7.299999999999982, "driven_lanedir": 2.126667458932426, "sim_render-ego": 0.007650349238147475, "in-drivable-lane": 0, "agent_compute-ego": 0.03925041139942326, "deviation-heading": 1.503888855903618, "set_robot_commands": 0.005175662367311242, "deviation-center-line": 0.41542447060071785, "driven_lanedir_consec": 1.752284061227201, "sim_compute_sim_state": 0.003229062851161173, "sim_compute_performance-ego": 0.004344006107278066, "sim_compute_robot_state-ego": 0.005405875101481399, "sim_compute_robot_state-npc0": 0.00531053216490027, "sim_compute_robot_state-npc1": 0.005122272935632157, "sim_compute_robot_state-npc2": 0.005058523726789919, "sim_compute_robot_state-npc3": 0.005071736361882458}, "udem1-14-0": {"driven_any": 3.848895581174612, "sim_physics": 0.1408984398841858, "survival_time": 14.950000000000076, "driven_lanedir": 3.3587705447355054, "sim_render-ego": 0.00787693977355957, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.03981614907582601, "deviation-heading": 3.2339158497481018, "set_robot_commands": 0.0052538712819417315, "deviation-center-line": 1.151127805084479, "driven_lanedir_consec": 2.8105866602908938, "sim_compute_sim_state": 0.003284308910369873, "sim_compute_performance-ego": 0.004435034592946371, "sim_compute_robot_state-ego": 0.005425715446472168, "sim_compute_robot_state-npc0": 0.005413371721903483, "sim_compute_robot_state-npc1": 0.005188445250193278, "sim_compute_robot_state-npc2": 0.005123620827992757, "sim_compute_robot_state-npc3": 0.005098621845245361}}
set_robot_commands_max0.005381810200678838
set_robot_commands_mean0.005220049001321531
set_robot_commands_median0.005215121130658011
set_robot_commands_min0.005065432716818417
sim_compute_performance-ego_max0.004549148131390007
sim_compute_performance-ego_mean0.004364674309025724
sim_compute_performance-ego_median0.004347224235534668
sim_compute_performance-ego_min0.004144479246700511
sim_compute_robot_state-ego_max0.005488673034979373
sim_compute_robot_state-ego_mean0.0054047441271841586
sim_compute_robot_state-ego_median0.0054152774810791015
sim_compute_robot_state-ego_min0.00529019271626192
sim_compute_robot_state-npc0_max0.0055344688649080235
sim_compute_robot_state-npc0_mean0.005366361949548525
sim_compute_robot_state-npc0_median0.005354323418311824
sim_compute_robot_state-npc0_min0.005114172486697926
sim_compute_robot_state-npc1_max0.0053830973956049705
sim_compute_robot_state-npc1_mean0.005162645453010834
sim_compute_robot_state-npc1_median0.005165303548177083
sim_compute_robot_state-npc1_min0.004829016853781307
sim_compute_robot_state-npc2_max0.005355640333525988
sim_compute_robot_state-npc2_mean0.005107104762281016
sim_compute_robot_state-npc2_median0.005096763372421265
sim_compute_robot_state-npc2_min0.004832858197829302
sim_compute_robot_state-npc3_max0.005350122646409638
sim_compute_robot_state-npc3_mean0.005084059859328818
sim_compute_robot_state-npc3_median0.005071736361882458
sim_compute_robot_state-npc3_min0.004816783175748937
sim_compute_sim_state_max0.003403201395151566
sim_compute_sim_state_mean0.003244965267199706
sim_compute_sim_state_median0.0032351315021514893
sim_compute_sim_state_min0.003035452786613913
sim_physics_max0.1408984398841858
sim_physics_mean0.12648346334361443
sim_physics_median0.12612573464711507
sim_physics_min0.11348920191327733
sim_render-ego_max0.007978556107501594
sim_render-ego_mean0.007675939544497166
sim_render-ego_median0.007673579851786296
sim_render-ego_min0.007372317594640395
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.800000000000024
survival_time_min2.4499999999999993
No reset possible
298985839Soroush Saryazdi 🇨🇦upduckaido3-LF-real-validationeval0-visualizesuccessnoip-172-31-46-148-104920:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.624175599549897
survival_time6
deviation-center-line0.23481888815839447
in-drivable-lane2.6667


other stats
deviation-heading0.4880796171424164
driven_any1.1588024917894402
driven_lanedir0.624175599549897
visualized-eval0-passed1
No reset possible
298875783Robert Moni 🇭🇺kaland-225210aido3-LF-real-validationeval2-visualizesuccessnoip-172-31-46-148-104920:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec9.790692052838706
survival_time40.6666
deviation-center-line2.4232077820657354
in-drivable-lane4.6667999999999985


other stats
deviation-heading10.933481540432318
driven_any11.78311742595495
driven_lanedir9.790692052838706
visualized-eval2-passed1
No reset possible
298505985Frank (Chude) Qian 🇨🇦2019-12-09|FrankNet|v3-LFSIMaido3-LFV-sim-testingstep1-simulationsuccessyesip-172-31-46-148-104920:54:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.287550376498553
survival_time_median14.950000000000076
deviation-center-line_median0.9070332640735664
in-drivable-lane_median1.2499999999999956


other stats
agent_compute-ego_max0.07299140691757203
agent_compute-ego_mean0.06305844352859667
agent_compute-ego_median0.06695802927017212
agent_compute-ego_min0.04394786119461059
deviation-center-line_max1.1818040928264244
deviation-center-line_mean0.8025320740477856
deviation-center-line_min0.22307400914119593
deviation-heading_max3.8751441023170217
deviation-heading_mean2.7740756275258662
deviation-heading_median2.9844942525175813
deviation-heading_min0.9443903829884468
driven_any_max6.125731577826896
driven_any_mean4.524750469559961
driven_any_median4.760248971791701
driven_any_min1.339017857380343
driven_lanedir_consec_max5.6192201123069285
driven_lanedir_consec_mean3.797607825607813
driven_lanedir_consec_min1.286349121351606
driven_lanedir_max5.6192201123069285
driven_lanedir_mean3.797607825607813
driven_lanedir_median4.287550376498553
driven_lanedir_min1.286349121351606
in-drivable-lane_max5.150000000000024
in-drivable-lane_mean1.6033333333333402
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.3829683467615315, "sim_physics": 0.17919276158014932, "survival_time": 14.950000000000076, "driven_lanedir": 4.287550376498553, "sim_render-ego": 0.012411152521769206, "in-drivable-lane": 0, "agent_compute-ego": 0.06695802927017212, "deviation-heading": 2.9844942525175813, "set_robot_commands": 0.009347201188405357, "deviation-center-line": 0.9978607045804516, "driven_lanedir_consec": 4.287550376498553, "sim_compute_sim_state": 0.005350996653238932, "sim_compute_performance-ego": 0.007683248519897461, "sim_compute_robot_state-ego": 0.009663247267405192, "sim_compute_robot_state-npc0": 0.008871235052744548, "sim_compute_robot_state-npc1": 0.008764340877532958, "sim_compute_robot_state-npc2": 0.00893116315205892, "sim_compute_robot_state-npc3": 0.008816877206166585}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.118778827182721, "sim_physics": 0.21237647851308183, "survival_time": 14.950000000000076, "driven_lanedir": 4.507729473173159, "sim_render-ego": 0.01389183521270752, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.07221120595932007, "deviation-heading": 3.028407390959487, "set_robot_commands": 0.010109410285949708, "deviation-center-line": 1.0467008400628492, "driven_lanedir_consec": 4.507729473173159, "sim_compute_sim_state": 0.006007920900980631, "sim_compute_performance-ego": 0.00823191245396932, "sim_compute_robot_state-ego": 0.01026759147644043, "sim_compute_robot_state-npc0": 0.009612011909484864, "sim_compute_robot_state-npc1": 0.009885197480519612, "sim_compute_robot_state-npc2": 0.00987558921178182, "sim_compute_robot_state-npc3": 0.009718742370605467}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.537547463407202, "sim_physics": 0.21510707934697468, "survival_time": 14.950000000000076, "driven_lanedir": 4.74667543844416, "sim_render-ego": 0.013165403207143147, "in-drivable-lane": 1.5000000000000098, "agent_compute-ego": 0.07229929288228353, "deviation-heading": 3.646786647996812, "set_robot_commands": 0.010191832383473714, "deviation-center-line": 1.1818040928264244, "driven_lanedir_consec": 4.74667543844416, "sim_compute_sim_state": 0.005586400826772054, "sim_compute_performance-ego": 0.007876845200856526, "sim_compute_robot_state-ego": 0.01011816660563151, "sim_compute_robot_state-npc0": 0.009567235310872396, "sim_compute_robot_state-npc1": 0.00945292075475057, "sim_compute_robot_state-npc2": 0.009288681348164875, "sim_compute_robot_state-npc3": 0.009507569471995036}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.760248971791701, "sim_physics": 0.1814605323562908, "survival_time": 13.350000000000056, "driven_lanedir": 4.633885959023437, "sim_render-ego": 0.01194653528906433, "in-drivable-lane": 0, "agent_compute-ego": 0.06698118792044536, "deviation-heading": 2.696291427648497, "set_robot_commands": 0.00948166400752264, "deviation-center-line": 0.6916450792324704, "driven_lanedir_consec": 4.633885959023437, "sim_compute_sim_state": 0.004719211814108859, "sim_compute_performance-ego": 0.007277411914496832, "sim_compute_robot_state-ego": 0.009294835815715432, "sim_compute_robot_state-npc0": 0.008594055747271477, "sim_compute_robot_state-npc1": 0.008263931738749872, "sim_compute_robot_state-npc2": 0.00820236884699332, "sim_compute_robot_state-npc3": 0.008219078685460466}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.181075554447752, "sim_physics": 0.1995266842842102, "survival_time": 14.950000000000076, "driven_lanedir": 2.4847535894546087, "sim_render-ego": 0.01274798075358073, "in-drivable-lane": 5.150000000000024, "agent_compute-ego": 0.06663281361262004, "deviation-heading": 2.787511964335597, "set_robot_commands": 0.009354098637898763, "deviation-center-line": 0.916578860535522, "driven_lanedir_consec": 2.4847535894546087, "sim_compute_sim_state": 0.004882332483927409, "sim_compute_performance-ego": 0.00746161699295044, "sim_compute_robot_state-ego": 0.00939483642578125, "sim_compute_robot_state-npc0": 0.008746498425801595, "sim_compute_robot_state-npc1": 0.008573171297709146, "sim_compute_robot_state-npc2": 0.008396185239156088, "sim_compute_robot_state-npc3": 0.00860965092976888}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.6192424671739754, "sim_physics": 0.22302692963017356, "survival_time": 7.199999999999982, "driven_lanedir": 2.0659178920994643, "sim_render-ego": 0.013230340348349676, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07295993467171986, "deviation-heading": 1.5240802845536334, "set_robot_commands": 0.009924085603819952, "deviation-center-line": 0.4926395907016424, "driven_lanedir_consec": 2.0659178920994643, "sim_compute_sim_state": 0.005334312717119853, "sim_compute_performance-ego": 0.007609498169687059, "sim_compute_robot_state-ego": 0.009600611196623908, "sim_compute_robot_state-npc0": 0.009179587165514628, "sim_compute_robot_state-npc1": 0.009010429183642067, "sim_compute_robot_state-npc2": 0.008767942587534586, "sim_compute_robot_state-npc3": 0.008740663528442383}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 5.692718904776961, "sim_physics": 0.20420873403549197, "survival_time": 14.950000000000076, "driven_lanedir": 5.00201049253231, "sim_render-ego": 0.01277112325032552, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.07142425775527954, "deviation-heading": 3.25623067255731, "set_robot_commands": 0.009922684033711751, "deviation-center-line": 0.9070332640735664, "driven_lanedir_consec": 5.00201049253231, "sim_compute_sim_state": 0.004928563435872396, "sim_compute_performance-ego": 0.007477575143178304, "sim_compute_robot_state-ego": 0.010088785489400228, "sim_compute_robot_state-npc0": 0.009233501752217613, "sim_compute_robot_state-npc1": 0.008961335817972819, "sim_compute_robot_state-npc2": 0.009158907731374104, "sim_compute_robot_state-npc3": 0.008725887934366862}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 6.021307058588554, "sim_physics": 0.19623600085576376, "survival_time": 14.950000000000076, "driven_lanedir": 4.560613931433271, "sim_render-ego": 0.012045046488444011, "in-drivable-lane": 2.9500000000000277, "agent_compute-ego": 0.06381570974985759, "deviation-heading": 3.6868274456318817, "set_robot_commands": 0.00926026503245036, "deviation-center-line": 0.9159630351092196, "driven_lanedir_consec": 4.560613931433271, "sim_compute_sim_state": 0.004762855370839437, "sim_compute_performance-ego": 0.007016512552897135, "sim_compute_robot_state-ego": 0.008974614143371583, "sim_compute_robot_state-npc0": 0.008345177173614502, "sim_compute_robot_state-npc1": 0.008194518089294434, "sim_compute_robot_state-npc2": 0.008167760372161865, "sim_compute_robot_state-npc3": 0.008132007916768392}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 5.781629584311985, "sim_physics": 0.19504515568415323, "survival_time": 14.950000000000076, "driven_lanedir": 3.834017872256752, "sim_render-ego": 0.012343523502349851, "in-drivable-lane": 4.65000000000004, "agent_compute-ego": 0.07299140691757203, "deviation-heading": 3.2450858405997565, "set_robot_commands": 0.01010127067565918, "deviation-center-line": 0.9552096839168374, "driven_lanedir_consec": 3.834017872256752, "sim_compute_sim_state": 0.0051690785090128585, "sim_compute_performance-ego": 0.007356138229370117, "sim_compute_robot_state-ego": 0.009225807189941404, "sim_compute_robot_state-npc0": 0.009008071422576903, "sim_compute_robot_state-npc1": 0.008660730520884195, "sim_compute_robot_state-npc2": 0.00871784528096517, "sim_compute_robot_state-npc3": 0.008684466679890951}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.4950756019794116, "sim_physics": 0.1829323121479579, "survival_time": 10.500000000000014, "driven_lanedir": 2.6619949775655267, "sim_render-ego": 0.01248603207724435, "in-drivable-lane": 2.2500000000000187, "agent_compute-ego": 0.06988145169757662, "deviation-heading": 3.2339586752493004, "set_robot_commands": 0.009651561010451544, "deviation-center-line": 0.7847018998242521, "driven_lanedir_consec": 2.6619949775655267, "sim_compute_sim_state": 0.005053607622782389, "sim_compute_performance-ego": 0.007334339051019578, "sim_compute_robot_state-ego": 0.009113857859656923, "sim_compute_robot_state-npc0": 0.008689490954081218, "sim_compute_robot_state-npc1": 0.00874700319199335, "sim_compute_robot_state-npc2": 0.008537007513500396, "sim_compute_robot_state-npc3": 0.00878488336290632}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.118375714440843, "sim_physics": 0.15238091965352207, "survival_time": 12.100000000000035, "driven_lanedir": 3.070889864575808, "sim_render-ego": 0.009194327780037872, "in-drivable-lane": 2.100000000000004, "agent_compute-ego": 0.0516871144948912, "deviation-heading": 3.8751441023170217, "set_robot_commands": 0.007204828183513042, "deviation-center-line": 0.6632537926149755, "driven_lanedir_consec": 3.070889864575808, "sim_compute_sim_state": 0.0037589871193751817, "sim_compute_performance-ego": 0.005295252011827201, "sim_compute_robot_state-ego": 0.006664370702317924, "sim_compute_robot_state-npc0": 0.006520888036932827, "sim_compute_robot_state-npc1": 0.006249874091345416, "sim_compute_robot_state-npc2": 0.006216243278881735, "sim_compute_robot_state-npc3": 0.006254394192340945}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 3.684783822944692, "sim_physics": 0.14021396366032687, "survival_time": 8.79999999999999, "driven_lanedir": 3.650755591789237, "sim_render-ego": 0.0091806176033887, "in-drivable-lane": 0, "agent_compute-ego": 0.05401681769977917, "deviation-heading": 1.0109120125199156, "set_robot_commands": 0.007272949272936041, "deviation-center-line": 0.6224423572612885, "driven_lanedir_consec": 3.650755591789237, "sim_compute_sim_state": 0.003785622390833768, "sim_compute_performance-ego": 0.005223054777492176, "sim_compute_robot_state-ego": 0.006663986227729104, "sim_compute_robot_state-npc0": 0.006597612391818653, "sim_compute_robot_state-npc1": 0.006515493447130377, "sim_compute_robot_state-npc2": 0.006332794373685663, "sim_compute_robot_state-npc3": 0.0063262243162501945}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 6.125731577826896, "sim_physics": 0.11745169957478842, "survival_time": 14.950000000000076, "driven_lanedir": 5.6192201123069285, "sim_render-ego": 0.00820540189743042, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.04394786119461059, "deviation-heading": 2.8530673333309613, "set_robot_commands": 0.00613985538482666, "deviation-center-line": 0.9270450097907748, "driven_lanedir_consec": 5.6192201123069285, "sim_compute_sim_state": 0.003298764228820801, "sim_compute_performance-ego": 0.004827845096588135, "sim_compute_robot_state-ego": 0.005991083780924479, "sim_compute_robot_state-npc0": 0.005918153127034505, "sim_compute_robot_state-npc1": 0.005524468421936035, "sim_compute_robot_state-npc2": 0.005570945739746094, "sim_compute_robot_state-npc3": 0.005484824975331625}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.339017857380343, "sim_physics": 0.13391682467883145, "survival_time": 3.949999999999994, "driven_lanedir": 1.286349121351606, "sim_render-ego": 0.01023178764536411, "in-drivable-lane": 0, "agent_compute-ego": 0.04909969583342347, "deviation-heading": 0.9443903829884468, "set_robot_commands": 0.007260301445103898, "deviation-center-line": 0.22307400914119593, "driven_lanedir_consec": 1.286349121351606, "sim_compute_sim_state": 0.004230704488633554, "sim_compute_performance-ego": 0.006117425387418723, "sim_compute_robot_state-ego": 0.007220533829701098, "sim_compute_robot_state-npc0": 0.007001894938794872, "sim_compute_robot_state-npc1": 0.006847438932974128, "sim_compute_robot_state-npc2": 0.0070552765568600425, "sim_compute_robot_state-npc3": 0.006693788721591611}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.012755290384834, "sim_physics": 0.13614205201466878, "survival_time": 14.950000000000076, "driven_lanedir": 4.5517526916123625, "sim_render-ego": 0.009724797407786052, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.05096987326939901, "deviation-heading": 2.8379459796817934, "set_robot_commands": 0.007302385965983073, "deviation-center-line": 0.7120288910453122, "driven_lanedir_consec": 4.5517526916123625, "sim_compute_sim_state": 0.004306108951568604, "sim_compute_performance-ego": 0.0058032957712809245, "sim_compute_robot_state-ego": 0.007180186907450358, "sim_compute_robot_state-npc0": 0.007127174536387126, "sim_compute_robot_state-npc1": 0.00692331075668335, "sim_compute_robot_state-npc2": 0.006953980922698975, "sim_compute_robot_state-npc3": 0.006851398944854736}}
set_robot_commands_max0.010191832383473714
set_robot_commands_mean0.008834959540780377
set_robot_commands_median0.009354098637898763
set_robot_commands_min0.00613985538482666
sim_compute_performance-ego_max0.00823191245396932
sim_compute_performance-ego_mean0.006839464751528662
sim_compute_performance-ego_median0.007334339051019578
sim_compute_performance-ego_min0.004827845096588135
sim_compute_robot_state-ego_max0.01026759147644043
sim_compute_robot_state-ego_mean0.008630834327872724
sim_compute_robot_state-ego_median0.009225807189941404
sim_compute_robot_state-ego_min0.005991083780924479
sim_compute_robot_state-npc0_max0.009612011909484864
sim_compute_robot_state-npc0_mean0.008200839196343181
sim_compute_robot_state-npc0_median0.008689490954081218
sim_compute_robot_state-npc0_min0.005918153127034505
sim_compute_robot_state-npc1_max0.009885197480519612
sim_compute_robot_state-npc1_mean0.008038277640207888
sim_compute_robot_state-npc1_median0.008573171297709146
sim_compute_robot_state-npc1_min0.005524468421936035
sim_compute_robot_state-npc2_max0.00987558921178182
sim_compute_robot_state-npc2_mean0.008011512810370911
sim_compute_robot_state-npc2_median0.008396185239156088
sim_compute_robot_state-npc2_min0.005570945739746094
sim_compute_robot_state-npc3_max0.009718742370605467
sim_compute_robot_state-npc3_mean0.007970030615782697
sim_compute_robot_state-npc3_median0.00860965092976888
sim_compute_robot_state-npc3_min0.005484824975331625
sim_compute_sim_state_max0.006007920900980631
sim_compute_sim_state_mean0.004745031167592449
sim_compute_sim_state_median0.004882332483927409
sim_compute_sim_state_min0.003298764228820801
sim_physics_max0.22302692963017356
sim_physics_mean0.17794787520109231
sim_physics_median0.1829323121479579
sim_physics_min0.11745169957478842
sim_render-ego_max0.01389183521270752
sim_render-ego_mean0.011571726998999034
sim_render-ego_median0.012343523502349851
sim_render-ego_min0.00820540189743042
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.696666666666715
survival_time_min3.949999999999994
No reset possible
298256014Philippe Marcotte 🇨🇦pp + veh dectaido3-LFV-sim-validationstep1-simulationabortedyesip-172-31-46-148-104920:02:57
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
298136041Riza Velioglu 🇩🇪UniBielefeld-#10aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:15:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.32852050569067
survival_time_median14.950000000000076
deviation-center-line_median0.9940075778637812
in-drivable-lane_median1.3500000000000192


other stats
agent_compute-ego_max0.15842145601908367
agent_compute-ego_mean0.12803611509423504
agent_compute-ego_median0.13481352011362713
agent_compute-ego_min0.06682729641596476
deviation-center-line_max1.180153143295506
deviation-center-line_mean1.0244630309582037
deviation-center-line_min0.9452855382959982
deviation-heading_max5.232268803543269
deviation-heading_mean4.755621619931357
deviation-heading_median4.830200990727941
deviation-heading_min4.112803539317043
driven_any_max4.070900394558282
driven_any_mean3.7480060136302207
driven_any_median3.736025470173117
driven_any_min3.3811652153084055
driven_lanedir_consec_max3.8125058197860016
driven_lanedir_consec_mean3.298836973928185
driven_lanedir_consec_min2.743244784985204
driven_lanedir_max3.8125058197860016
driven_lanedir_mean3.298836973928185
driven_lanedir_median3.32852050569067
driven_lanedir_min2.743244784985204
in-drivable-lane_max1.9500000000000055
in-drivable-lane_mean0.950000000000004
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.736025470173117, "sim_physics": 0.1041349188486735, "survival_time": 14.950000000000076, "driven_lanedir": 3.080120581091992, "sim_render-ego": 0.012946565945943195, "in-drivable-lane": 1.9500000000000055, "agent_compute-ego": 0.13481352011362713, "deviation-heading": 4.904420242849814, "set_robot_commands": 0.009708542823791504, "deviation-center-line": 1.180153143295506, "driven_lanedir_consec": 3.080120581091992, "sim_compute_sim_state": 0.005518401463826497, "sim_compute_performance-ego": 0.008048376242319744, "sim_compute_robot_state-ego": 0.009480477968851726}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.3811652153084055, "sim_physics": 0.11842385718696996, "survival_time": 13.300000000000054, "driven_lanedir": 2.743244784985204, "sim_render-ego": 0.014463084084647042, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.15230950556303324, "deviation-heading": 5.232268803543269, "set_robot_commands": 0.010616257674711988, "deviation-center-line": 0.9861401475863222, "driven_lanedir_consec": 2.743244784985204, "sim_compute_sim_state": 0.006213489331697163, "sim_compute_performance-ego": 0.008628544054533305, "sim_compute_robot_state-ego": 0.01045110709685132}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.070900394558282, "sim_physics": 0.1220818813641866, "survival_time": 14.950000000000076, "driven_lanedir": 3.8125058197860016, "sim_render-ego": 0.01426785389582316, "in-drivable-lane": 0, "agent_compute-ego": 0.15842145601908367, "deviation-heading": 4.698414523218714, "set_robot_commands": 0.010615488688151042, "deviation-center-line": 0.9940075778637812, "driven_lanedir_consec": 3.8125058197860016, "sim_compute_sim_state": 0.006091114679972331, "sim_compute_performance-ego": 0.008763517538706462, "sim_compute_robot_state-ego": 0.010656704902648926}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.991182076064074, "sim_physics": 0.10445000410079956, "survival_time": 14.950000000000076, "driven_lanedir": 3.5297931780870586, "sim_render-ego": 0.012722750504811604, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.12780879735946654, "deviation-heading": 4.112803539317043, "set_robot_commands": 0.00944266398747762, "deviation-center-line": 0.9452855382959982, "driven_lanedir_consec": 3.5297931780870586, "sim_compute_sim_state": 0.005349438190460205, "sim_compute_performance-ego": 0.007553689479827881, "sim_compute_robot_state-ego": 0.009269107182820636}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5607569120472244, "sim_physics": 0.05951813538869222, "survival_time": 14.950000000000076, "driven_lanedir": 3.32852050569067, "sim_render-ego": 0.00780913511912028, "in-drivable-lane": 0, "agent_compute-ego": 0.06682729641596476, "deviation-heading": 4.830200990727941, "set_robot_commands": 0.005276422500610351, "deviation-center-line": 1.0167287477494114, "driven_lanedir_consec": 3.32852050569067, "sim_compute_sim_state": 0.0033678348859151204, "sim_compute_performance-ego": 0.0044512279828389486, "sim_compute_robot_state-ego": 0.005529669920603434}}
set_robot_commands_max0.010616257674711988
set_robot_commands_mean0.0091318751349485
set_robot_commands_median0.009708542823791504
set_robot_commands_min0.005276422500610351
sim_compute_performance-ego_max0.008763517538706462
sim_compute_performance-ego_mean0.007489071059645268
sim_compute_performance-ego_median0.008048376242319744
sim_compute_performance-ego_min0.0044512279828389486
sim_compute_robot_state-ego_max0.010656704902648926
sim_compute_robot_state-ego_mean0.00907741341435521
sim_compute_robot_state-ego_median0.009480477968851726
sim_compute_robot_state-ego_min0.005529669920603434
sim_compute_sim_state_max0.006213489331697163
sim_compute_sim_state_mean0.005308055710374263
sim_compute_sim_state_median0.005518401463826497
sim_compute_sim_state_min0.0033678348859151204
sim_physics_max0.1220818813641866
sim_physics_mean0.10172175937786436
sim_physics_median0.10445000410079956
sim_physics_min0.05951813538869222
sim_render-ego_max0.014463084084647042
sim_render-ego_mean0.012441877910069055
sim_render-ego_median0.012946565945943195
sim_render-ego_min0.00780913511912028
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.620000000000072
survival_time_min13.300000000000054
No reset possible
297685978c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4663487367959873
survival_time_median14.950000000000076
deviation-center-line_median0.5308997802719009
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016223487854003907
agent_compute-ego_mean0.015886576369956683
agent_compute-ego_median0.015749138372915764
agent_compute-ego_min0.015629649957021076
deviation-center-line_max0.9074633790713574
deviation-center-line_mean0.5695879541129545
deviation-center-line_min0.40198880726492375
deviation-heading_max5.948207220704098
deviation-heading_mean3.6628038824749054
deviation-heading_median3.125251364312573
deviation-heading_min2.6625165756488283
driven_any_max2.553370791268036
driven_any_mean2.501002078142978
driven_any_median2.553256066015645
driven_any_min2.2999943485276058
driven_lanedir_consec_max2.4945894410659415
driven_lanedir_consec_mean2.2916142049159127
driven_lanedir_consec_min1.9388128390919117
driven_lanedir_max2.4945894410659415
driven_lanedir_mean2.294721771887559
driven_lanedir_median2.4663487367959873
driven_lanedir_min1.954350673950143
in-drivable-lane_max1.050000000000015
in-drivable-lane_mean0.420000000000004
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5450463601396636, "sim_physics": 0.05697107871373495, "survival_time": 14.950000000000076, "driven_lanedir": 2.474743733223085, "sim_render-ego": 0.007136459350585937, "in-drivable-lane": 0, "agent_compute-ego": 0.016223487854003907, "deviation-heading": 2.7963959849101063, "set_robot_commands": 0.007561826705932617, "deviation-center-line": 0.5415775690093311, "driven_lanedir_consec": 2.474743733223085, "sim_compute_sim_state": 0.0037857945760091144, "sim_compute_performance-ego": 0.004261642297108968, "sim_compute_robot_state-ego": 0.005222094058990478}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2999943485276058, "sim_physics": 0.05640741984049479, "survival_time": 13.500000000000057, "driven_lanedir": 1.954350673950143, "sim_render-ego": 0.007241417743541576, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.015749138372915764, "deviation-heading": 3.7816482667989257, "set_robot_commands": 0.007344200876024034, "deviation-center-line": 0.5308997802719009, "driven_lanedir_consec": 1.9388128390919117, "sim_compute_sim_state": 0.0035749665013066045, "sim_compute_performance-ego": 0.004109485061080368, "sim_compute_robot_state-ego": 0.005211176695647063}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.553256066015645, "sim_physics": 0.05621547063191732, "survival_time": 14.950000000000076, "driven_lanedir": 2.083576274402638, "sim_render-ego": 0.007219516436258952, "in-drivable-lane": 1.0500000000000052, "agent_compute-ego": 0.01569038232167562, "deviation-heading": 5.948207220704098, "set_robot_commands": 0.007345172564188639, "deviation-center-line": 0.9074633790713574, "driven_lanedir_consec": 2.083576274402638, "sim_compute_sim_state": 0.0036391258239746095, "sim_compute_performance-ego": 0.004082960287729899, "sim_compute_robot_state-ego": 0.005171317259470622}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.5533428247639387, "sim_physics": 0.0547337285677592, "survival_time": 14.950000000000076, "driven_lanedir": 2.4663487367959873, "sim_render-ego": 0.007167580127716064, "in-drivable-lane": 0, "agent_compute-ego": 0.015629649957021076, "deviation-heading": 3.125251364312573, "set_robot_commands": 0.007233913739522298, "deviation-center-line": 0.4660102349472592, "driven_lanedir_consec": 2.4663487367959873, "sim_compute_sim_state": 0.003652777671813965, "sim_compute_performance-ego": 0.004092464447021485, "sim_compute_robot_state-ego": 0.005165026187896728}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.553370791268036, "sim_physics": 0.05715722640355428, "survival_time": 14.950000000000076, "driven_lanedir": 2.4945894410659415, "sim_render-ego": 0.007271921634674073, "in-drivable-lane": 0, "agent_compute-ego": 0.016140223344167072, "deviation-heading": 2.6625165756488283, "set_robot_commands": 0.007417271931966146, "deviation-center-line": 0.40198880726492375, "driven_lanedir_consec": 2.4945894410659415, "sim_compute_sim_state": 0.003813472588857015, "sim_compute_performance-ego": 0.004124687512715657, "sim_compute_robot_state-ego": 0.005216771761576334}}
set_robot_commands_max0.007561826705932617
set_robot_commands_mean0.007380477163526747
set_robot_commands_median0.007345172564188639
set_robot_commands_min0.007233913739522298
sim_compute_performance-ego_max0.004261642297108968
sim_compute_performance-ego_mean0.004134247921131274
sim_compute_performance-ego_median0.004109485061080368
sim_compute_performance-ego_min0.004082960287729899
sim_compute_robot_state-ego_max0.005222094058990478
sim_compute_robot_state-ego_mean0.005197277192716245
sim_compute_robot_state-ego_median0.005211176695647063
sim_compute_robot_state-ego_min0.005165026187896728
sim_compute_sim_state_max0.003813472588857015
sim_compute_sim_state_mean0.003693227432392261
sim_compute_sim_state_median0.003652777671813965
sim_compute_sim_state_min0.0035749665013066045
sim_physics_max0.05715722640355428
sim_physics_mean0.056296984831492106
sim_physics_median0.05640741984049479
sim_physics_min0.0547337285677592
sim_render-ego_max0.007271921634674073
sim_render-ego_mean0.00720737905855532
sim_render-ego_median0.007219516436258952
sim_render-ego_min0.007136459350585937
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.660000000000071
survival_time_min13.500000000000057
No reset possible
297575969c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.433085423193077
survival_time_median14.950000000000076
deviation-center-line_median0.6186791763902932
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01620199124018351
agent_compute-ego_mean0.01598003609975179
agent_compute-ego_median0.015925107002258302
agent_compute-ego_min0.015754013061523436
deviation-center-line_max0.9538753703481008
deviation-center-line_mean0.6573020847903581
deviation-center-line_min0.4446193024153768
deviation-heading_max5.49470642615468
deviation-heading_mean3.498725815846447
deviation-heading_median3.586552252702063
deviation-heading_min1.9089261843890728
driven_any_max2.5633775311531735
driven_any_mean2.553677485259139
driven_any_median2.5533029327719365
driven_any_min2.5450380914471284
driven_lanedir_consec_max2.5312022781709667
driven_lanedir_consec_mean2.4225083269185044
driven_lanedir_consec_min2.2414138891640345
driven_lanedir_max2.5312022781709667
driven_lanedir_mean2.4225083269185044
driven_lanedir_median2.433085423193077
driven_lanedir_min2.2414138891640345
in-drivable-lane_max0.3999999999999986
in-drivable-lane_mean0.07999999999999971
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5450380914471284, "sim_physics": 0.0571026603380839, "survival_time": 14.950000000000076, "driven_lanedir": 2.4211259195776647, "sim_render-ego": 0.007055654525756836, "in-drivable-lane": 0, "agent_compute-ego": 0.01620199124018351, "deviation-heading": 4.005082894832349, "set_robot_commands": 0.007430906295776367, "deviation-center-line": 0.7293002135523294, "driven_lanedir_consec": 2.4211259195776647, "sim_compute_sim_state": 0.003690598805745443, "sim_compute_performance-ego": 0.004175669352213542, "sim_compute_robot_state-ego": 0.005118655363718669}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.553284079801847, "sim_physics": 0.05611923138300578, "survival_time": 14.950000000000076, "driven_lanedir": 2.433085423193077, "sim_render-ego": 0.007142605781555175, "in-drivable-lane": 0, "agent_compute-ego": 0.015892207622528076, "deviation-heading": 3.586552252702063, "set_robot_commands": 0.0071125523249308265, "deviation-center-line": 0.5400363612456903, "driven_lanedir_consec": 2.433085423193077, "sim_compute_sim_state": 0.003709115982055664, "sim_compute_performance-ego": 0.004060996373494466, "sim_compute_robot_state-ego": 0.005093995730082194}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5533029327719365, "sim_physics": 0.05543272574742635, "survival_time": 14.950000000000076, "driven_lanedir": 2.2414138891640345, "sim_render-ego": 0.00720351775487264, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.015754013061523436, "deviation-heading": 5.49470642615468, "set_robot_commands": 0.007213092645009358, "deviation-center-line": 0.9538753703481008, "driven_lanedir_consec": 2.2414138891640345, "sim_compute_sim_state": 0.0035305142402648924, "sim_compute_performance-ego": 0.004082129001617431, "sim_compute_robot_state-ego": 0.005152947107950847}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.5533847911216077, "sim_physics": 0.05635193109512329, "survival_time": 14.950000000000076, "driven_lanedir": 2.4857141244867766, "sim_render-ego": 0.007197710673014323, "in-drivable-lane": 0, "agent_compute-ego": 0.015925107002258302, "deviation-heading": 2.4983613211540683, "set_robot_commands": 0.007194774945576986, "deviation-center-line": 0.6186791763902932, "driven_lanedir_consec": 2.4857141244867766, "sim_compute_sim_state": 0.003766254583994548, "sim_compute_performance-ego": 0.004079318841298421, "sim_compute_robot_state-ego": 0.005164988040924072}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.5633775311531735, "sim_physics": 0.05695029020309448, "survival_time": 14.950000000000076, "driven_lanedir": 2.5312022781709667, "sim_render-ego": 0.007203927834828695, "in-drivable-lane": 0, "agent_compute-ego": 0.016126861572265627, "deviation-heading": 1.9089261843890728, "set_robot_commands": 0.007314791679382324, "deviation-center-line": 0.4446193024153768, "driven_lanedir_consec": 2.5312022781709667, "sim_compute_sim_state": 0.003918095429738363, "sim_compute_performance-ego": 0.004069191614786784, "sim_compute_robot_state-ego": 0.005166386763254802}}
set_robot_commands_max0.007430906295776367
set_robot_commands_mean0.007253223578135172
set_robot_commands_median0.007213092645009358
set_robot_commands_min0.0071125523249308265
sim_compute_performance-ego_max0.004175669352213542
sim_compute_performance-ego_mean0.004093461036682129
sim_compute_performance-ego_median0.004079318841298421
sim_compute_performance-ego_min0.004060996373494466
sim_compute_robot_state-ego_max0.005166386763254802
sim_compute_robot_state-ego_mean0.005139394601186117
sim_compute_robot_state-ego_median0.005152947107950847
sim_compute_robot_state-ego_min0.005093995730082194
sim_compute_sim_state_max0.003918095429738363
sim_compute_sim_state_mean0.003722915808359782
sim_compute_sim_state_median0.003709115982055664
sim_compute_sim_state_min0.0035305142402648924
sim_physics_max0.0571026603380839
sim_physics_mean0.056391367753346765
sim_physics_median0.05635193109512329
sim_physics_min0.05543272574742635
sim_render-ego_max0.007203927834828695
sim_render-ego_mean0.0071606833140055335
sim_render-ego_median0.007197710673014323
sim_render-ego_min0.007055654525756836
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
297535959c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LFV-sim-testingstep1-simulationabortedyesip-172-31-46-148-104920:00:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
297415950Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:18:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.824324296302566
survival_time_median10.350000000000012
deviation-center-line_median0.5751876310807177
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.034398823518019456
agent_compute-ego_mean0.025881011106327075
agent_compute-ego_median0.02407592296600342
agent_compute-ego_min0.02041599194208781
deviation-center-line_max0.9169407061331248
deviation-center-line_mean0.533281560956596
deviation-center-line_min0.08099816208103534
deviation-heading_max4.119142476733162
deviation-heading_mean2.2487147021979195
deviation-heading_median2.2914269660614384
deviation-heading_min0.3643581003302907
driven_any_max4.687737320278567
driven_any_mean3.340787441317281
driven_any_median3.484966997389709
driven_any_min1.0884573905365975
driven_lanedir_consec_max4.528202207912843
driven_lanedir_consec_mean2.8715269097959224
driven_lanedir_consec_min0.6794476034945223
driven_lanedir_max4.528202207912843
driven_lanedir_mean2.8715269097959224
driven_lanedir_median2.824324296302566
driven_lanedir_min0.6794476034945223
in-drivable-lane_max4.8500000000000405
in-drivable-lane_mean1.0400000000000051
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9957094744286854, "sim_physics": 0.08421731916602683, "survival_time": 10.350000000000012, "driven_lanedir": 2.4896775484250377, "sim_render-ego": 0.010260822692355096, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.030158691360178777, "deviation-heading": 2.2914269660614384, "set_robot_commands": 0.007770622410060127, "deviation-center-line": 0.5751876310807177, "driven_lanedir_consec": 2.4896775484250377, "sim_compute_sim_state": 0.004267735181799257, "sim_compute_performance-ego": 0.006035853123319322, "sim_compute_robot_state-ego": 0.007456787542444497}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2309366509312443, "sim_physics": 0.07918749124773088, "survival_time": 6.199999999999986, "driven_lanedir": 1.8397134710641896, "sim_render-ego": 0.009609376230547506, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.028230569055003506, "deviation-heading": 1.4852023347823322, "set_robot_commands": 0.007422226090585032, "deviation-center-line": 0.4143128735156004, "driven_lanedir_consec": 1.8397134710641896, "sim_compute_sim_state": 0.004051246950703282, "sim_compute_performance-ego": 0.00543604935369184, "sim_compute_robot_state-ego": 0.006856551093439902}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.629773673686926, "sim_physics": 0.08400593757629395, "survival_time": 14.950000000000076, "driven_lanedir": 4.528202207912843, "sim_render-ego": 0.010286874771118164, "in-drivable-lane": 0, "agent_compute-ego": 0.032351728280385336, "deviation-heading": 2.6195627928484595, "set_robot_commands": 0.008290890057881674, "deviation-center-line": 0.7340281950331404, "driven_lanedir_consec": 4.528202207912843, "sim_compute_sim_state": 0.004410667419433594, "sim_compute_performance-ego": 0.00604763666788737, "sim_compute_robot_state-ego": 0.007513348261515299}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4826363501436224, "sim_physics": 0.08542879783745969, "survival_time": 9.900000000000006, "driven_lanedir": 3.376576363303625, "sim_render-ego": 0.011116698534801753, "in-drivable-lane": 0, "agent_compute-ego": 0.03422680045619155, "deviation-heading": 1.7836505059591037, "set_robot_commands": 0.008692412665396027, "deviation-center-line": 0.5965705995403524, "driven_lanedir_consec": 3.376576363303625, "sim_compute_sim_state": 0.0047223616128016, "sim_compute_performance-ego": 0.006501846843295627, "sim_compute_robot_state-ego": 0.007948907938870516}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.878754429073062, "sim_physics": 0.0813421865480136, "survival_time": 11.300000000000026, "driven_lanedir": 2.4391859427202216, "sim_render-ego": 0.010313418059222468, "in-drivable-lane": 4.8500000000000405, "agent_compute-ego": 0.029493149402922234, "deviation-heading": 1.063984801018076, "set_robot_commands": 0.007619866227681658, "deviation-center-line": 0.3991087226039388, "driven_lanedir_consec": 2.4391859427202216, "sim_compute_sim_state": 0.00445225386492974, "sim_compute_performance-ego": 0.005867273406644838, "sim_compute_robot_state-ego": 0.006983702161670786}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3782065752094876, "sim_physics": 0.08256840012794317, "survival_time": 8.599999999999987, "driven_lanedir": 1.8451610959782443, "sim_render-ego": 0.010066334591355437, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.029400855995887935, "deviation-heading": 2.1741786172885886, "set_robot_commands": 0.0076153666474098386, "deviation-center-line": 0.4158448932687376, "driven_lanedir_consec": 1.8451610959782443, "sim_compute_sim_state": 0.004470998464628707, "sim_compute_performance-ego": 0.005872535151104594, "sim_compute_robot_state-ego": 0.007314720819162768}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.484966997389709, "sim_physics": 0.08682676339760804, "survival_time": 9.750000000000004, "driven_lanedir": 2.824324296302566, "sim_render-ego": 0.010881397051688953, "in-drivable-lane": 1.2500000000000089, "agent_compute-ego": 0.034398823518019456, "deviation-heading": 2.5750251608604504, "set_robot_commands": 0.008745373212374175, "deviation-center-line": 0.6664910439909918, "driven_lanedir_consec": 2.824324296302566, "sim_compute_sim_state": 0.004532207586826422, "sim_compute_performance-ego": 0.006207387875287961, "sim_compute_robot_state-ego": 0.007657667306753305}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.750023763552312, "sim_physics": 0.06202054182688395, "survival_time": 14.950000000000076, "driven_lanedir": 3.64455345724388, "sim_render-ego": 0.008008267084757487, "in-drivable-lane": 0, "agent_compute-ego": 0.02407592296600342, "deviation-heading": 3.28742077924772, "set_robot_commands": 0.00611242135365804, "deviation-center-line": 0.6408035672148963, "driven_lanedir_consec": 3.64455345724388, "sim_compute_sim_state": 0.0033566904067993163, "sim_compute_performance-ego": 0.004564997355143229, "sim_compute_robot_state-ego": 0.005786603291829427}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0884573905365975, "sim_physics": 0.05812413005505578, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6794476034945223, "sim_render-ego": 0.007396782858897064, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.020659479044251524, "deviation-heading": 0.3643581003302907, "set_robot_commands": 0.00514303627660719, "deviation-center-line": 0.08099816208103534, "driven_lanedir_consec": 0.6794476034945223, "sim_compute_sim_state": 0.002940832558324782, "sim_compute_performance-ego": 0.004041801064701403, "sim_compute_robot_state-ego": 0.005018399933637199}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.423051167596297, "sim_physics": 0.05625075340270996, "survival_time": 14.950000000000076, "driven_lanedir": 3.383576418783807, "sim_render-ego": 0.0070222592353820805, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.020943998495737713, "deviation-heading": 4.119142476733162, "set_robot_commands": 0.005163659254709879, "deviation-center-line": 0.6330071422093816, "driven_lanedir_consec": 3.383576418783807, "sim_compute_sim_state": 0.002941126028696696, "sim_compute_performance-ego": 0.004024291038513183, "sim_compute_robot_state-ego": 0.0050234405199686685}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 3.8311978886424702, "sim_physics": 0.05441399812698365, "survival_time": 14.950000000000076, "driven_lanedir": 3.7918971886347586, "sim_render-ego": 0.006947351296742757, "in-drivable-lane": 0, "agent_compute-ego": 0.02041599194208781, "deviation-heading": 1.718667673638925, "set_robot_commands": 0.005100715160369873, "deviation-center-line": 0.4969615864440431, "driven_lanedir_consec": 3.7918971886347586, "sim_compute_sim_state": 0.002904687722524007, "sim_compute_performance-ego": 0.0039718103408813476, "sim_compute_robot_state-ego": 0.004890061219533284}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.045358551058395, "sim_physics": 0.05281819979349772, "survival_time": 14.950000000000076, "driven_lanedir": 3.9404172710123833, "sim_render-ego": 0.007044287522633871, "in-drivable-lane": 0, "agent_compute-ego": 0.020756025314331055, "deviation-heading": 2.8272207080928538, "set_robot_commands": 0.005136522452036539, "deviation-center-line": 0.7400568167852243, "driven_lanedir_consec": 3.9404172710123833, "sim_compute_sim_state": 0.0029442183176676432, "sim_compute_performance-ego": 0.00400982936223348, "sim_compute_robot_state-ego": 0.004972520669301351}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.1008418416982058, "sim_physics": 0.05398729003843714, "survival_time": 6.099999999999986, "driven_lanedir": 1.4073823701750394, "sim_render-ego": 0.007122962201227908, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.02121191337460377, "deviation-heading": 1.136300241487579, "set_robot_commands": 0.005099951243791424, "deviation-center-line": 0.15046420756072765, "driven_lanedir_consec": 1.4073823701750394, "sim_compute_sim_state": 0.0029797163165983607, "sim_compute_performance-ego": 0.004030155353858823, "sim_compute_robot_state-ego": 0.005058077515148726}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.1041595455336415, "sim_physics": 0.057178815597383845, "survival_time": 10.15000000000001, "driven_lanedir": 2.402900223054216, "sim_render-ego": 0.007253091323551873, "in-drivable-lane": 1.9500000000000115, "agent_compute-ego": 0.02138157313680414, "deviation-heading": 2.437510552411906, "set_robot_commands": 0.005286327136561201, "deviation-center-line": 0.5384472668870259, "driven_lanedir_consec": 2.402900223054216, "sim_compute_sim_state": 0.0030470035346270782, "sim_compute_performance-ego": 0.004124771785266294, "sim_compute_robot_state-ego": 0.005149457255020517}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.687737320278567, "sim_physics": 0.05462720086765622, "survival_time": 14.350000000000067, "driven_lanedir": 4.479888188833494, "sim_render-ego": 0.006999916315909462, "in-drivable-lane": 0, "agent_compute-ego": 0.020509644252497974, "deviation-heading": 3.847068822207903, "set_robot_commands": 0.005113579254947888, "deviation-center-line": 0.9169407061331248, "driven_lanedir_consec": 4.479888188833494, "sim_compute_sim_state": 0.002915666493804613, "sim_compute_performance-ego": 0.0039995024013187, "sim_compute_robot_state-ego": 0.004971039004442169}}
set_robot_commands_max0.008745373212374175
set_robot_commands_mean0.006554197962938037
set_robot_commands_median0.00611242135365804
set_robot_commands_min0.005099951243791424
sim_compute_performance-ego_max0.006501846843295627
sim_compute_performance-ego_mean0.004982382741543201
sim_compute_performance-ego_median0.004564997355143229
sim_compute_performance-ego_min0.0039718103408813476
sim_compute_robot_state-ego_max0.007948907938870516
sim_compute_robot_state-ego_mean0.0061734189688492265
sim_compute_robot_state-ego_median0.005786603291829427
sim_compute_robot_state-ego_min0.004890061219533284
sim_compute_sim_state_max0.0047223616128016
sim_compute_sim_state_mean0.0036624941640110062
sim_compute_sim_state_median0.0033566904067993163
sim_compute_sim_state_min0.002904687722524007
sim_physics_max0.08682676339760804
sim_physics_mean0.06886652170731229
sim_physics_median0.06202054182688395
sim_physics_min0.05281819979349772
sim_render-ego_max0.011116698534801753
sim_render-ego_mean0.00868865598467946
sim_render-ego_median0.008008267084757487
sim_render-ego_min0.006947351296742757
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.960000000000033
survival_time_min2.9499999999999975
No reset possible
297375949Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.10891072701698
survival_time_median11.55000000000003
deviation-center-line_median0.8525007272382102
in-drivable-lane_median0


other stats
agent_compute-ego_max0.023066707279371174
agent_compute-ego_mean0.02202524631918784
agent_compute-ego_median0.02194422245025635
agent_compute-ego_min0.021294697567268657
deviation-center-line_max1.0343201554759422
deviation-center-line_mean0.7193860452151049
deviation-center-line_min0.2766606079340526
deviation-heading_max3.2936996852447646
deviation-heading_mean2.573619522220743
deviation-heading_median3.0825642753989917
deviation-heading_min1.1693093465443032
driven_any_max4.7197494882516
driven_any_mean3.2754733576319155
driven_any_median3.4747146599697536
driven_any_min1.3926553282151304
driven_lanedir_consec_max4.579375902593487
driven_lanedir_consec_mean3.030303222640536
driven_lanedir_consec_min1.3239657279781465
driven_lanedir_max4.579375902593487
driven_lanedir_mean3.030303222640536
driven_lanedir_median3.10891072701698
driven_lanedir_min1.3239657279781465
in-drivable-lane_max2.4499999999999913
in-drivable-lane_mean0.4899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3926553282151304, "sim_physics": 0.061639293380405594, "survival_time": 4.599999999999992, "driven_lanedir": 1.3239657279781465, "sim_render-ego": 0.007496388062186863, "in-drivable-lane": 0, "agent_compute-ego": 0.023066707279371174, "deviation-heading": 1.1693093465443032, "set_robot_commands": 0.005317146363465682, "deviation-center-line": 0.2766606079340526, "driven_lanedir_consec": 1.3239657279781465, "sim_compute_sim_state": 0.003203798895296843, "sim_compute_performance-ego": 0.004410012908603834, "sim_compute_robot_state-ego": 0.005367618540058966}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4747146599697536, "sim_physics": 0.05899004124580546, "survival_time": 11.750000000000032, "driven_lanedir": 3.3065083376539603, "sim_render-ego": 0.007405077142918363, "in-drivable-lane": 0, "agent_compute-ego": 0.02230804017249574, "deviation-heading": 3.21696700833543, "set_robot_commands": 0.005308495176599381, "deviation-center-line": 0.9308920816656252, "driven_lanedir_consec": 3.3065083376539603, "sim_compute_sim_state": 0.0032216102518933883, "sim_compute_performance-ego": 0.004176226068050303, "sim_compute_robot_state-ego": 0.005305145141926218}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.7197494882516, "sim_physics": 0.057387238343556725, "survival_time": 14.950000000000076, "driven_lanedir": 4.579375902593487, "sim_render-ego": 0.008090993563334148, "in-drivable-lane": 0, "agent_compute-ego": 0.02194422245025635, "deviation-heading": 3.0825642753989917, "set_robot_commands": 0.005422015190124512, "deviation-center-line": 1.0343201554759422, "driven_lanedir_consec": 4.579375902593487, "sim_compute_sim_state": 0.003214269479115804, "sim_compute_performance-ego": 0.004249217510223388, "sim_compute_robot_state-ego": 0.005358165899912517}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.520092277119691, "sim_physics": 0.056482286364943894, "survival_time": 10.800000000000018, "driven_lanedir": 2.832755417960108, "sim_render-ego": 0.007279801147955435, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.021294697567268657, "deviation-heading": 2.1055572955802235, "set_robot_commands": 0.005285019123995745, "deviation-center-line": 0.5025566537616942, "driven_lanedir_consec": 2.832755417960108, "sim_compute_sim_state": 0.0031006832917531333, "sim_compute_performance-ego": 0.004091648039994416, "sim_compute_robot_state-ego": 0.005247231986787584}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.270155034603403, "sim_physics": 0.05650851530430121, "survival_time": 11.55000000000003, "driven_lanedir": 3.10891072701698, "sim_render-ego": 0.007250539152137129, "in-drivable-lane": 0, "agent_compute-ego": 0.02151256412654728, "deviation-heading": 3.2936996852447646, "set_robot_commands": 0.005318333060194404, "deviation-center-line": 0.8525007272382102, "driven_lanedir_consec": 3.10891072701698, "sim_compute_sim_state": 0.003115248370480228, "sim_compute_performance-ego": 0.004110907063339696, "sim_compute_robot_state-ego": 0.005233463270839674}}
set_robot_commands_max0.005422015190124512
set_robot_commands_mean0.005330201782875945
set_robot_commands_median0.005317146363465682
set_robot_commands_min0.005285019123995745
sim_compute_performance-ego_max0.004410012908603834
sim_compute_performance-ego_mean0.004207602318042328
sim_compute_performance-ego_median0.004176226068050303
sim_compute_performance-ego_min0.004091648039994416
sim_compute_robot_state-ego_max0.005367618540058966
sim_compute_robot_state-ego_mean0.005302324967904991
sim_compute_robot_state-ego_median0.005305145141926218
sim_compute_robot_state-ego_min0.005233463270839674
sim_compute_sim_state_max0.0032216102518933883
sim_compute_sim_state_mean0.0031711220577078795
sim_compute_sim_state_median0.003203798895296843
sim_compute_sim_state_min0.0031006832917531333
sim_physics_max0.061639293380405594
sim_physics_mean0.058201474927802574
sim_physics_median0.057387238343556725
sim_physics_min0.056482286364943894
sim_render-ego_max0.008090993563334148
sim_render-ego_mean0.007504559813706388
sim_render-ego_median0.007405077142918363
sim_render-ego_min0.007250539152137129
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.730000000000029
survival_time_min4.599999999999992
No reset possible
297245943Aleksei Shpilman 🇷🇺challenge-aido_LF-baseline-IL-0215aido3-LFV-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:08:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
296935901Robert Moni 🇭🇺lzoltan-03aido3-LFVI-sim-testingstep1-simulationsuccessyesip-172-31-46-148-104920:48:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.98058651232065
survival_time_median13.05000000000005
deviation-center-line_median0.7415356661822887
in-drivable-lane_median0.6000000000000085


other stats
agent_compute-ego_max0.03919880986213684
agent_compute-ego_mean0.03099664578775638
agent_compute-ego_median0.029640097548996193
agent_compute-ego_min0.021879769833151864
deviation-center-line_max0.953586612116149
deviation-center-line_mean0.7058282379444254
deviation-center-line_min0.29415646615258234
deviation-heading_max4.58296783660986
deviation-heading_mean2.791708992723899
deviation-heading_median2.688770511140317
deviation-heading_min1.0838705188157496
driven_any_max5.682459954715777
driven_any_mean4.295300836513699
driven_any_median4.703841526410224
driven_any_min1.9957095183836564
driven_lanedir_consec_max5.105044200509374
driven_lanedir_consec_mean3.724074657571719
driven_lanedir_consec_min1.5501766039025329
driven_lanedir_max5.111871702328926
driven_lanedir_mean3.776767677404854
driven_lanedir_median3.98058651232065
driven_lanedir_min1.6122939072830706
in-drivable-lane_max2.7000000000000224
in-drivable-lane_mean0.8033333333333367
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 3.0882485742809864, "sim_physics": 0.1815964906446395, "survival_time": 9.299999999999995, "driven_lanedir": 2.7808796567611824, "sim_render-ego": 0.01053008597384217, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.03229560134231403, "deviation-heading": 2.3532724472392728, "set_robot_commands": 0.008199461044803742, "deviation-center-line": 0.538469998406593, "driven_lanedir_consec": 2.712315415668955, "sim_compute_sim_state": 0.004338131156018985, "sim_compute_performance-ego": 0.006069267949750347, "sim_compute_robot_state-ego": 0.00746417430139357, "sim_compute_robot_state-npc0": 0.007239094344518518, "sim_compute_robot_state-npc1": 0.007227540016174316, "sim_compute_robot_state-npc2": 0.007188230432489867, "sim_compute_robot_state-npc3": 0.007144710069061607}, "udem1-1-0": {"driven_any": 3.760332933872705, "sim_physics": 0.16330626966872652, "survival_time": 10.350000000000012, "driven_lanedir": 3.62373059651386, "sim_render-ego": 0.00932081425247561, "in-drivable-lane": 0, "agent_compute-ego": 0.029640097548996193, "deviation-heading": 2.32322755156961, "set_robot_commands": 0.007191246834354124, "deviation-center-line": 0.7161059560032665, "driven_lanedir_consec": 3.5958614182209048, "sim_compute_sim_state": 0.0038429907554589607, "sim_compute_performance-ego": 0.005395202821003642, "sim_compute_robot_state-ego": 0.006985028584798177, "sim_compute_robot_state-npc0": 0.006515910660011181, "sim_compute_robot_state-npc1": 0.0063072782783692586, "sim_compute_robot_state-npc2": 0.006411869168857445, "sim_compute_robot_state-npc3": 0.006336304300649155}, "udem1-2-0": {"driven_any": 5.242252646156587, "sim_physics": 0.16363942384719848, "survival_time": 14.950000000000076, "driven_lanedir": 4.285209738018577, "sim_render-ego": 0.009539397557576495, "in-drivable-lane": 1.299999999999998, "agent_compute-ego": 0.029929409027099608, "deviation-heading": 4.58296783660986, "set_robot_commands": 0.007352663675944011, "deviation-center-line": 0.8933169933414599, "driven_lanedir_consec": 4.285209738018577, "sim_compute_sim_state": 0.00397758960723877, "sim_compute_performance-ego": 0.005513591766357422, "sim_compute_robot_state-ego": 0.006985439459482829, "sim_compute_robot_state-npc0": 0.006844124794006348, "sim_compute_robot_state-npc1": 0.006535842418670655, "sim_compute_robot_state-npc2": 0.0066547433535257975, "sim_compute_robot_state-npc3": 0.006562108993530273}, "udem1-3-0": {"driven_any": 5.213393864426375, "sim_physics": 0.16133323431015015, "survival_time": 14.950000000000076, "driven_lanedir": 4.745457571727169, "sim_render-ego": 0.009759058952331544, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.030315441290537516, "deviation-heading": 3.337979328329125, "set_robot_commands": 0.007313220500946045, "deviation-center-line": 0.841917261376976, "driven_lanedir_consec": 4.745457571727169, "sim_compute_sim_state": 0.003994755744934082, "sim_compute_performance-ego": 0.005591638882954915, "sim_compute_robot_state-ego": 0.007060627937316894, "sim_compute_robot_state-npc0": 0.006797587076822917, "sim_compute_robot_state-npc1": 0.006557950178782145, "sim_compute_robot_state-npc2": 0.006571702957153321, "sim_compute_robot_state-npc3": 0.006468188762664795}, "udem1-4-0": {"driven_any": 1.9957095183836564, "sim_physics": 0.23406889637311296, "survival_time": 5.999999999999987, "driven_lanedir": 1.6122939072830706, "sim_render-ego": 0.012553679943084716, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.03919880986213684, "deviation-heading": 1.0838705188157496, "set_robot_commands": 0.00943817694981893, "deviation-center-line": 0.29415646615258234, "driven_lanedir_consec": 1.5501766039025329, "sim_compute_sim_state": 0.004977236191431682, "sim_compute_performance-ego": 0.0072800517082214355, "sim_compute_robot_state-ego": 0.008916258811950684, "sim_compute_robot_state-npc0": 0.008491019407908121, "sim_compute_robot_state-npc1": 0.008250023921330769, "sim_compute_robot_state-npc2": 0.008506468931833903, "sim_compute_robot_state-npc3": 0.008156253894170126}, "udem1-5-0": {"driven_any": 3.2496733331198095, "sim_physics": 0.244103773887911, "survival_time": 9.650000000000002, "driven_lanedir": 3.076314101740711, "sim_render-ego": 0.012371396771366732, "in-drivable-lane": 0, "agent_compute-ego": 0.03801719882945322, "deviation-heading": 2.641733795191002, "set_robot_commands": 0.009744509514131694, "deviation-center-line": 0.5965027810759969, "driven_lanedir_consec": 3.0673256264287785, "sim_compute_sim_state": 0.005141399067300589, "sim_compute_performance-ego": 0.0073136801546719405, "sim_compute_robot_state-ego": 0.009515296609908188, "sim_compute_robot_state-npc0": 0.009223139965472443, "sim_compute_robot_state-npc1": 0.008805423202909954, "sim_compute_robot_state-npc2": 0.008719891464154337, "sim_compute_robot_state-npc3": 0.008773504761216555}, "udem1-6-0": {"driven_any": 5.12266980027082, "sim_physics": 0.21838812828063964, "survival_time": 14.950000000000076, "driven_lanedir": 3.716013112937494, "sim_render-ego": 0.013697205384572348, "in-drivable-lane": 2.7000000000000224, "agent_compute-ego": 0.03703196048736572, "deviation-heading": 2.90601689368343, "set_robot_commands": 0.00948431650797526, "deviation-center-line": 0.7415356661822887, "driven_lanedir_consec": 3.6339018832515513, "sim_compute_sim_state": 0.005065077940622965, "sim_compute_performance-ego": 0.007332278887430827, "sim_compute_robot_state-ego": 0.009408535162607827, "sim_compute_robot_state-npc0": 0.008758548895517986, "sim_compute_robot_state-npc1": 0.008606545130411784, "sim_compute_robot_state-npc2": 0.008536826769510905, "sim_compute_robot_state-npc3": 0.00852432092030843}, "udem1-7-0": {"driven_any": 2.630693266787286, "sim_physics": 0.23341073055525083, "survival_time": 7.399999999999982, "driven_lanedir": 2.5728206450853253, "sim_render-ego": 0.012183331154488228, "in-drivable-lane": 0, "agent_compute-ego": 0.037888559135230815, "deviation-heading": 1.231910051104012, "set_robot_commands": 0.009254189761909278, "deviation-center-line": 0.4134266595220451, "driven_lanedir_consec": 2.3794271845581396, "sim_compute_sim_state": 0.005074157908156111, "sim_compute_performance-ego": 0.0072893145922068, "sim_compute_robot_state-ego": 0.00921031107773652, "sim_compute_robot_state-npc0": 0.008564955479389912, "sim_compute_robot_state-npc1": 0.008216252198090425, "sim_compute_robot_state-npc2": 0.008284483406994794, "sim_compute_robot_state-npc3": 0.00811957024239205}, "udem1-8-0": {"driven_any": 4.006850850572978, "sim_physics": 0.1632626892684342, "survival_time": 11.55000000000003, "driven_lanedir": 3.4643562166127735, "sim_render-ego": 0.00951234499613444, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.02834373222285019, "deviation-heading": 2.688770511140317, "set_robot_commands": 0.006991975751274076, "deviation-center-line": 0.6491218537923187, "driven_lanedir_consec": 3.4643562166127735, "sim_compute_sim_state": 0.003984012645044368, "sim_compute_performance-ego": 0.005452682445575664, "sim_compute_robot_state-ego": 0.0069262104116993035, "sim_compute_robot_state-npc0": 0.0066456887629125026, "sim_compute_robot_state-npc1": 0.006398872895674272, "sim_compute_robot_state-npc2": 0.006382490133310294, "sim_compute_robot_state-npc3": 0.006399957648603431}, "udem1-9-0": {"driven_any": 5.22068257205411, "sim_physics": 0.14923327287038168, "survival_time": 14.950000000000076, "driven_lanedir": 4.54056174773824, "sim_render-ego": 0.008676540056864421, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.0267834210395813, "deviation-heading": 3.238062738527675, "set_robot_commands": 0.006403498649597168, "deviation-center-line": 0.8796371493164619, "driven_lanedir_consec": 4.54056174773824, "sim_compute_sim_state": 0.003656809329986573, "sim_compute_performance-ego": 0.004998939037322998, "sim_compute_robot_state-ego": 0.006378642717997233, "sim_compute_robot_state-npc0": 0.006038813591003418, "sim_compute_robot_state-npc1": 0.005802439053853353, "sim_compute_robot_state-npc2": 0.005792690912882487, "sim_compute_robot_state-npc3": 0.005817267894744873}, "udem1-10-0": {"driven_any": 4.330677492444232, "sim_physics": 0.11408548062788572, "survival_time": 13.05000000000005, "driven_lanedir": 3.98058651232065, "sim_render-ego": 0.007157148529286585, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.021879769833151864, "deviation-heading": 2.5999693356648037, "set_robot_commands": 0.005064070909872822, "deviation-center-line": 0.5825215536994325, "driven_lanedir_consec": 3.98058651232065, "sim_compute_sim_state": 0.0029161670655583056, "sim_compute_performance-ego": 0.004034401356488809, "sim_compute_robot_state-ego": 0.00513309080481986, "sim_compute_robot_state-npc0": 0.004892284386002698, "sim_compute_robot_state-npc1": 0.004735580349333898, "sim_compute_robot_state-npc2": 0.004688371643709497, "sim_compute_robot_state-npc3": 0.004699482314888088}, "udem1-11-0": {"driven_any": 5.2675762525106125, "sim_physics": 0.15976573626200358, "survival_time": 14.950000000000076, "driven_lanedir": 5.111871702328926, "sim_render-ego": 0.009348313013712565, "in-drivable-lane": 0, "agent_compute-ego": 0.029056805769602456, "deviation-heading": 3.315693300919912, "set_robot_commands": 0.007245163122812907, "deviation-center-line": 0.8214319516197446, "driven_lanedir_consec": 5.105044200509374, "sim_compute_sim_state": 0.00380862553914388, "sim_compute_performance-ego": 0.005480360190073649, "sim_compute_robot_state-ego": 0.006852737267812093, "sim_compute_robot_state-npc0": 0.006616087754567465, "sim_compute_robot_state-npc1": 0.006425162156422933, "sim_compute_robot_state-npc2": 0.006388144493103027, "sim_compute_robot_state-npc3": 0.006395519574483236}, "udem1-12-0": {"driven_any": 5.682459954715777, "sim_physics": 0.15009073734283448, "survival_time": 14.950000000000076, "driven_lanedir": 4.340644971643043, "sim_render-ego": 0.010499229431152344, "in-drivable-lane": 2.550000000000008, "agent_compute-ego": 0.027694005171457925, "deviation-heading": 2.84601268845925, "set_robot_commands": 0.007105483214060466, "deviation-center-line": 0.892896733955338, "driven_lanedir_consec": 4.339908489098562, "sim_compute_sim_state": 0.0036264514923095704, "sim_compute_performance-ego": 0.005308770338694255, "sim_compute_robot_state-ego": 0.006535443464914957, "sim_compute_robot_state-npc0": 0.006492515405019124, "sim_compute_robot_state-npc1": 0.006341321468353272, "sim_compute_robot_state-npc2": 0.006056877772013346, "sim_compute_robot_state-npc3": 0.0060696784655253095}, "udem1-13-0": {"driven_any": 4.703841526410224, "sim_physics": 0.16801099835137123, "survival_time": 12.35000000000004, "driven_lanedir": 4.40169992507936, "sim_render-ego": 0.00907287230858436, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.02833926919018209, "deviation-heading": 2.580960217051162, "set_robot_commands": 0.006977942308433625, "deviation-center-line": 0.7727959326057258, "driven_lanedir_consec": 4.336779829320744, "sim_compute_sim_state": 0.0036509037017822266, "sim_compute_performance-ego": 0.0051069558873350325, "sim_compute_robot_state-ego": 0.006444049750262426, "sim_compute_robot_state-npc0": 0.006163178185219707, "sim_compute_robot_state-npc1": 0.0059923237634573875, "sim_compute_robot_state-npc2": 0.005924324275028368, "sim_compute_robot_state-npc3": 0.0059707386773607506}, "udem1-14-0": {"driven_any": 4.914449961699324, "sim_physics": 0.1570827579498291, "survival_time": 14.950000000000076, "driven_lanedir": 4.399074755282426, "sim_render-ego": 0.009193960825602214, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.028535606066385905, "deviation-heading": 4.145187676553304, "set_robot_commands": 0.006757004261016846, "deviation-center-line": 0.953586612116149, "driven_lanedir_consec": 4.1242074261988275, "sim_compute_sim_state": 0.0038353943824768065, "sim_compute_performance-ego": 0.005361800193786621, "sim_compute_robot_state-ego": 0.006604467233022054, "sim_compute_robot_state-npc0": 0.00644782304763794, "sim_compute_robot_state-npc1": 0.006094597975413005, "sim_compute_robot_state-npc2": 0.006190007527669271, "sim_compute_robot_state-npc3": 0.006170055071512858}}
set_robot_commands_max0.009744509514131694
set_robot_commands_mean0.007634861533796733
set_robot_commands_median0.007245163122812907
set_robot_commands_min0.005064070909872822
sim_compute_performance-ego_max0.007332278887430827
sim_compute_performance-ego_mean0.005835262414124959
sim_compute_performance-ego_median0.005480360190073649
sim_compute_performance-ego_min0.004034401356488809
sim_compute_robot_state-ego_max0.009515296609908188
sim_compute_robot_state-ego_mean0.00736135423971484
sim_compute_robot_state-ego_median0.006985028584798177
sim_compute_robot_state-ego_min0.00513309080481986
sim_compute_robot_state-npc0_max0.009223139965472443
sim_compute_robot_state-npc0_mean0.007048718117067352
sim_compute_robot_state-npc0_median0.0066456887629125026
sim_compute_robot_state-npc0_min0.004892284386002698
sim_compute_robot_state-npc1_max0.008805423202909954
sim_compute_robot_state-npc1_mean0.006819810200483162
sim_compute_robot_state-npc1_median0.006425162156422933
sim_compute_robot_state-npc1_min0.004735580349333898
sim_compute_robot_state-npc2_max0.008719891464154337
sim_compute_robot_state-npc2_mean0.00681980821614911
sim_compute_robot_state-npc2_median0.006411869168857445
sim_compute_robot_state-npc2_min0.004688371643709497
sim_compute_robot_state-npc3_max0.008773504761216555
sim_compute_robot_state-npc3_mean0.006773844106074104
sim_compute_robot_state-npc3_median0.006399957648603431
sim_compute_robot_state-npc3_min0.004699482314888088
sim_compute_sim_state_max0.005141399067300589
sim_compute_sim_state_mean0.004125980168497591
sim_compute_sim_state_median0.00397758960723877
sim_compute_sim_state_min0.0029161670655583056
sim_physics_max0.244103773887911
sim_physics_mean0.17742524134935792
sim_physics_median0.16330626966872652
sim_physics_min0.11408548062788572
sim_render-ego_max0.013697205384572348
sim_render-ego_mean0.010227691943404988
sim_render-ego_median0.009539397557576495
sim_render-ego_min0.007157148529286585
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.28666666666671
survival_time_min5.999999999999987
No reset possible
296725915Frank (Chude) Qian 🇨🇦2019-12-09|FrankNet|v3-Patch1aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:17:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2071380436888095
survival_time_median7.79999999999998
deviation-center-line_median0.36752205174818936
in-drivable-lane_median1.9500000000000144


other stats
agent_compute-ego_max0.07064775901265663
agent_compute-ego_mean0.04894772827835924
agent_compute-ego_median0.038206632137298586
agent_compute-ego_min0.03750812565838849
deviation-center-line_max0.8913411965775911
deviation-center-line_mean0.4524392265616715
deviation-center-line_min0.1819927992473306
deviation-heading_max2.976812707549025
deviation-heading_mean1.636835501497182
deviation-heading_median1.354580290647843
deviation-heading_min0.7662934766448629
driven_any_max6.840891839534477
driven_any_mean3.722490510696217
driven_any_median3.049367237925383
driven_any_min1.0428426063552545
driven_lanedir_consec_max4.8651731461365415
driven_lanedir_consec_mean2.628103029384618
driven_lanedir_consec_min0.934773187794128
driven_lanedir_max4.8651731461365415
driven_lanedir_mean2.628103029384618
driven_lanedir_median2.2071380436888095
driven_lanedir_min0.934773187794128
in-drivable-lane_max4.950000000000017
in-drivable-lane_mean2.2566666666666726
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.049367237925383, "sim_physics": 0.1009849386337476, "survival_time": 7.79999999999998, "driven_lanedir": 1.7214731500814573, "sim_render-ego": 0.011469547565166768, "in-drivable-lane": 3.399999999999989, "agent_compute-ego": 0.06520197636041886, "deviation-heading": 1.354580290647843, "set_robot_commands": 0.008861777109977527, "deviation-center-line": 0.3419085528157778, "driven_lanedir_consec": 1.7214731500814573, "sim_compute_sim_state": 0.004714362132243621, "sim_compute_performance-ego": 0.006827313166398268, "sim_compute_robot_state-ego": 0.008618477063301282}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.283258712170809, "sim_physics": 0.1076079784053387, "survival_time": 5.04999999999999, "driven_lanedir": 1.7337221709837276, "sim_render-ego": 0.012992382049560549, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.07064775901265663, "deviation-heading": 0.946824779788936, "set_robot_commands": 0.01071799391567117, "deviation-center-line": 0.30523789099195564, "driven_lanedir_consec": 1.7337221709837276, "sim_compute_sim_state": 0.0051386356353759766, "sim_compute_performance-ego": 0.007736635680245881, "sim_compute_robot_state-ego": 0.009358670451853537}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3877916931949543, "sim_physics": 0.10128575290014984, "survival_time": 5.449999999999989, "driven_lanedir": 2.0860797202199586, "sim_render-ego": 0.015092068855915594, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.06435739884682752, "deviation-heading": 1.0931156803424775, "set_robot_commands": 0.0096941737953676, "deviation-center-line": 0.36523732347868, "driven_lanedir_consec": 2.0860797202199586, "sim_compute_sim_state": 0.005163809575072122, "sim_compute_performance-ego": 0.007385789801221375, "sim_compute_robot_state-ego": 0.00900138190033239}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.8907968927058025, "sim_physics": 0.09288129210472108, "survival_time": 10.800000000000018, "driven_lanedir": 2.612746869803194, "sim_render-ego": 0.012454968911630136, "in-drivable-lane": 4.950000000000017, "agent_compute-ego": 0.06148072746064928, "deviation-heading": 1.7211486706858574, "set_robot_commands": 0.00935204823811849, "deviation-center-line": 0.36752205174818936, "driven_lanedir_consec": 2.612746869803194, "sim_compute_sim_state": 0.004820839122489646, "sim_compute_performance-ego": 0.007044377150358977, "sim_compute_robot_state-ego": 0.008517015863347936}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8194440467576274, "sim_physics": 0.1062940220038096, "survival_time": 5.999999999999987, "driven_lanedir": 2.128148365732841, "sim_render-ego": 0.012591137488683063, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06719196438789368, "deviation-heading": 1.108415114908507, "set_robot_commands": 0.00941688617070516, "deviation-center-line": 0.2715037081416462, "driven_lanedir_consec": 2.128148365732841, "sim_compute_sim_state": 0.005047404766082763, "sim_compute_performance-ego": 0.007440360387166342, "sim_compute_robot_state-ego": 0.00969241460164388}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 6.712994646512863, "sim_physics": 0.08254172563552857, "survival_time": 14.950000000000076, "driven_lanedir": 4.5313247592459795, "sim_render-ego": 0.01011624813079834, "in-drivable-lane": 4.2000000000000375, "agent_compute-ego": 0.057101452350616456, "deviation-heading": 2.976812707549025, "set_robot_commands": 0.008034401734670004, "deviation-center-line": 0.7208841378541134, "driven_lanedir_consec": 4.5313247592459795, "sim_compute_sim_state": 0.004252764383951823, "sim_compute_performance-ego": 0.00599585771560669, "sim_compute_robot_state-ego": 0.007707665761311849}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.657643710516105, "sim_physics": 0.06774507284164429, "survival_time": 10.000000000000009, "driven_lanedir": 3.2185222488197276, "sim_render-ego": 0.00870313286781311, "in-drivable-lane": 2.8499999999999934, "agent_compute-ego": 0.04585119605064392, "deviation-heading": 1.748570965723625, "set_robot_commands": 0.006544042825698853, "deviation-center-line": 0.47641985375686896, "driven_lanedir_consec": 3.2185222488197276, "sim_compute_sim_state": 0.0037407505512237543, "sim_compute_performance-ego": 0.004993635416030884, "sim_compute_robot_state-ego": 0.006272835731506348}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0428426063552545, "sim_physics": 0.05407103502525473, "survival_time": 2.6499999999999986, "driven_lanedir": 0.934773187794128, "sim_render-ego": 0.007333526071512474, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.03791533776049344, "deviation-heading": 0.7662934766448629, "set_robot_commands": 0.005159827898133476, "deviation-center-line": 0.1819927992473306, "driven_lanedir_consec": 0.934773187794128, "sim_compute_sim_state": 0.002997200444059552, "sim_compute_performance-ego": 0.004034771109527012, "sim_compute_robot_state-ego": 0.005143804370232348}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 6.011264674152768, "sim_physics": 0.05632282303763436, "survival_time": 14.300000000000068, "driven_lanedir": 3.978614677952808, "sim_render-ego": 0.007161742323762053, "in-drivable-lane": 4.4500000000000295, "agent_compute-ego": 0.037783436008266634, "deviation-heading": 2.887281016524369, "set_robot_commands": 0.0050781398386388395, "deviation-center-line": 0.7083463918578531, "driven_lanedir_consec": 3.978614677952808, "sim_compute_sim_state": 0.0030067650588242326, "sim_compute_performance-ego": 0.0040750761965771655, "sim_compute_robot_state-ego": 0.00514103315926932}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.2752587730311093, "sim_physics": 0.05620539646882277, "survival_time": 5.1999999999999895, "driven_lanedir": 2.2071380436888095, "sim_render-ego": 0.007247995871763963, "in-drivable-lane": 0, "agent_compute-ego": 0.03787345840380742, "deviation-heading": 1.1864721049315163, "set_robot_commands": 0.004988617621935331, "deviation-center-line": 0.4937122153241554, "driven_lanedir_consec": 2.2071380436888095, "sim_compute_sim_state": 0.003002047538757324, "sim_compute_performance-ego": 0.004015372349665715, "sim_compute_robot_state-ego": 0.005009190394328191}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.06005316600045, "sim_physics": 0.054749621285332575, "survival_time": 8.999999999999993, "driven_lanedir": 3.2116598335820736, "sim_render-ego": 0.007243185573154025, "in-drivable-lane": 1.5500000000000045, "agent_compute-ego": 0.03751412365171644, "deviation-heading": 1.8210292190316009, "set_robot_commands": 0.0051109287473890515, "deviation-center-line": 0.6077918539031298, "driven_lanedir_consec": 3.2116598335820736, "sim_compute_sim_state": 0.003010947174496121, "sim_compute_performance-ego": 0.0040474189652336965, "sim_compute_robot_state-ego": 0.005091109540727404}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.0029499553769785, "sim_physics": 0.05680395938732006, "survival_time": 9.45, "driven_lanedir": 3.08631232457298, "sim_render-ego": 0.0072270940851282195, "in-drivable-lane": 1.9500000000000144, "agent_compute-ego": 0.03750812565838849, "deviation-heading": 2.13746187091612, "set_robot_commands": 0.0051125067251699945, "deviation-center-line": 0.5899798950095662, "driven_lanedir_consec": 3.08631232457298, "sim_compute_sim_state": 0.003066348020361845, "sim_compute_performance-ego": 0.004135882412945783, "sim_compute_robot_state-ego": 0.005151437073157578}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.977431673609814, "sim_physics": 0.055276734884395155, "survival_time": 4.299999999999993, "driven_lanedir": 1.4604983761061494, "sim_render-ego": 0.007190743158029956, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.037940219391223995, "deviation-heading": 1.2013651038044544, "set_robot_commands": 0.005108381426611612, "deviation-center-line": 0.22140245774020917, "driven_lanedir_consec": 1.4604983761061494, "sim_compute_sim_state": 0.003002460612807163, "sim_compute_performance-ego": 0.004014561342638593, "sim_compute_robot_state-ego": 0.005087802576464276}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 6.840891839534477, "sim_physics": 0.0566208012898763, "survival_time": 14.950000000000076, "driven_lanedir": 4.8651731461365415, "sim_render-ego": 0.0070644362767537435, "in-drivable-lane": 3.8000000000000256, "agent_compute-ego": 0.038206632137298586, "deviation-heading": 2.7411213643966694, "set_robot_commands": 0.005071727434794108, "deviation-center-line": 0.8913411965775911, "driven_lanedir_consec": 4.8651731461365415, "sim_compute_sim_state": 0.0030137077967325844, "sim_compute_performance-ego": 0.004085212548573812, "sim_compute_robot_state-ego": 0.005124330520629883}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.8253680325988464, "sim_physics": 0.05565783034923465, "survival_time": 6.449999999999985, "driven_lanedir": 1.645358566048893, "sim_render-ego": 0.00717432554378066, "in-drivable-lane": 2.7499999999999902, "agent_compute-ego": 0.037642116694487346, "deviation-heading": 0.8620401565618678, "set_robot_commands": 0.005031903584798177, "deviation-center-line": 0.2433080699780056, "driven_lanedir_consec": 1.645358566048893, "sim_compute_sim_state": 0.0030040168022924616, "sim_compute_performance-ego": 0.004078449204910633, "sim_compute_robot_state-ego": 0.005066014075464057}}
set_robot_commands_max0.01071799391567117
set_robot_commands_mean0.006885557137845293
set_robot_commands_median0.005159827898133476
set_robot_commands_min0.004988617621935331
sim_compute_performance-ego_max0.007736635680245881
sim_compute_performance-ego_mean0.005327380896473389
sim_compute_performance-ego_median0.004135882412945783
sim_compute_performance-ego_min0.004014561342638593
sim_compute_robot_state-ego_max0.00969241460164388
sim_compute_robot_state-ego_mean0.006665545538904685
sim_compute_robot_state-ego_median0.005151437073157578
sim_compute_robot_state-ego_min0.005009190394328191
sim_compute_sim_state_max0.005163809575072122
sim_compute_sim_state_mean0.0037988039743180662
sim_compute_sim_state_median0.003066348020361845
sim_compute_sim_state_min0.002997200444059552
sim_physics_max0.1076079784053387
sim_physics_mean0.07366993228352067
sim_physics_median0.05680395938732006
sim_physics_min0.05407103502525473
sim_render-ego_max0.015092068855915594
sim_render-ego_mean0.009404168984896844
sim_render-ego_median0.007333526071512474
sim_render-ego_min0.0070644362767537435
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.423333333333344
survival_time_min2.6499999999999986
No reset possible
296575907Robert Moni 🇭🇺lzoltan-04aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:10:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.760853046058541
survival_time_median14.950000000000076
deviation-center-line_median0.7569617718350796
in-drivable-lane_median0.6500000000000092


other stats
agent_compute-ego_max0.028613671461741128
agent_compute-ego_mean0.02453893454869588
agent_compute-ego_median0.02219454526901245
agent_compute-ego_min0.021576427618662516
deviation-center-line_max0.8200666635186535
deviation-center-line_mean0.7575940618517635
deviation-center-line_min0.6702675050682445
deviation-heading_max3.990077694654232
deviation-heading_mean3.248988557267253
deviation-heading_median3.371686972494776
deviation-heading_min2.294730146876511
driven_any_max5.996398849829599
driven_any_mean5.426815985130848
driven_any_median5.456570715558293
driven_any_min4.58541253089274
driven_lanedir_consec_max5.502832969536797
driven_lanedir_consec_mean4.812990040118743
driven_lanedir_consec_min4.291165973315414
driven_lanedir_max5.502832969536797
driven_lanedir_mean4.812990040118743
driven_lanedir_median4.760853046058541
driven_lanedir_min4.291165973315414
in-drivable-lane_max2.05
in-drivable-lane_mean0.9100000000000042
in-drivable-lane_min0.2499999999999991
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.58541253089274, "sim_physics": 0.05624544302622477, "survival_time": 14.950000000000076, "driven_lanedir": 4.291165973315414, "sim_render-ego": 0.008213229974110921, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.02219454526901245, "deviation-heading": 3.990077694654232, "set_robot_commands": 0.005044689178466797, "deviation-center-line": 0.8200666635186535, "driven_lanedir_consec": 4.291165973315414, "sim_compute_sim_state": 0.002927403450012207, "sim_compute_performance-ego": 0.004160367647806804, "sim_compute_robot_state-ego": 0.005155156453450521}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.129388759730001, "sim_physics": 0.05776907046635946, "survival_time": 14.950000000000076, "driven_lanedir": 4.6861600479121925, "sim_render-ego": 0.0071901512145996094, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.02182745297749837, "deviation-heading": 3.5341675354404627, "set_robot_commands": 0.005032804807027181, "deviation-center-line": 0.8044457667277143, "driven_lanedir_consec": 4.6861600479121925, "sim_compute_sim_state": 0.002954115867614746, "sim_compute_performance-ego": 0.004065970579783122, "sim_compute_robot_state-ego": 0.005129085381825765}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.966309069643609, "sim_physics": 0.05612562815348307, "survival_time": 14.950000000000076, "driven_lanedir": 4.8239381637707694, "sim_render-ego": 0.007137198448181153, "in-drivable-lane": 2.05, "agent_compute-ego": 0.021576427618662516, "deviation-heading": 2.294730146876511, "set_robot_commands": 0.00504248301188151, "deviation-center-line": 0.7569617718350796, "driven_lanedir_consec": 4.8239381637707694, "sim_compute_sim_state": 0.0029532774289449054, "sim_compute_performance-ego": 0.004059828122456868, "sim_compute_robot_state-ego": 0.0051006786028544105}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.996398849829599, "sim_physics": 0.08268555402755737, "survival_time": 14.950000000000076, "driven_lanedir": 5.502832969536797, "sim_render-ego": 0.009478715260823568, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.028613671461741128, "deviation-heading": 3.054280436870282, "set_robot_commands": 0.007345378398895264, "deviation-center-line": 0.7362286021091254, "driven_lanedir_consec": 5.502832969536797, "sim_compute_sim_state": 0.004036993185679118, "sim_compute_performance-ego": 0.005529104073842366, "sim_compute_robot_state-ego": 0.006987639268239339}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.456570715558293, "sim_physics": 0.07846470753351847, "survival_time": 14.950000000000076, "driven_lanedir": 4.760853046058541, "sim_render-ego": 0.009388110637664794, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.028482575416564945, "deviation-heading": 3.371686972494776, "set_robot_commands": 0.007095859050750732, "deviation-center-line": 0.6702675050682445, "driven_lanedir_consec": 4.760853046058541, "sim_compute_sim_state": 0.0039226579666137695, "sim_compute_performance-ego": 0.0054444988568623865, "sim_compute_robot_state-ego": 0.006790764331817627}}
set_robot_commands_max0.007345378398895264
set_robot_commands_mean0.005912242889404297
set_robot_commands_median0.005044689178466797
set_robot_commands_min0.005032804807027181
sim_compute_performance-ego_max0.005529104073842366
sim_compute_performance-ego_mean0.004651953856150309
sim_compute_performance-ego_median0.004160367647806804
sim_compute_performance-ego_min0.004059828122456868
sim_compute_robot_state-ego_max0.006987639268239339
sim_compute_robot_state-ego_mean0.005832664807637532
sim_compute_robot_state-ego_median0.005155156453450521
sim_compute_robot_state-ego_min0.0051006786028544105
sim_compute_sim_state_max0.004036993185679118
sim_compute_sim_state_mean0.0033588895797729487
sim_compute_sim_state_median0.002954115867614746
sim_compute_sim_state_min0.002927403450012207
sim_physics_max0.08268555402755737
sim_physics_mean0.06625808064142863
sim_physics_median0.05776907046635946
sim_physics_min0.05612562815348307
sim_render-ego_max0.009478715260823568
sim_render-ego_mean0.00828148110707601
sim_render-ego_median0.008213229974110921
sim_render-ego_min0.007137198448181153
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
296455893Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:12:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.172767829853592
survival_time_median13.900000000000064
deviation-center-line_median0.6049445055323438
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04760111888249715
agent_compute-ego_mean0.04044598431737916
agent_compute-ego_median0.03964785551413512
agent_compute-ego_min0.03484861312373992
deviation-center-line_max1.0545579742216065
deviation-center-line_mean0.6718347353942237
deviation-center-line_min0.318733037701447
deviation-heading_max4.592463540259084
deviation-heading_mean2.675915197201528
deviation-heading_median2.3555175125061165
deviation-heading_min1.2503614194483614
driven_any_max4.814896949689951
driven_any_mean3.706744333199223
driven_any_median4.238220959557723
driven_any_min1.3903349081544163
driven_lanedir_consec_max4.235402886041522
driven_lanedir_consec_mean3.4278200242044874
driven_lanedir_consec_min1.3105916318983402
driven_lanedir_max4.235402886041522
driven_lanedir_mean3.4278200242044874
driven_lanedir_median4.172767829853592
driven_lanedir_min1.3105916318983402
in-drivable-lane_max0.9500000000000002
in-drivable-lane_mean0.3699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3903349081544163, "sim_physics": 0.09104850215296592, "survival_time": 4.6499999999999915, "driven_lanedir": 1.3105916318983402, "sim_render-ego": 0.01189453883837628, "in-drivable-lane": 0, "agent_compute-ego": 0.03484861312373992, "deviation-heading": 1.2503614194483614, "set_robot_commands": 0.008650279814197172, "deviation-center-line": 0.318733037701447, "driven_lanedir_consec": 1.3105916318983402, "sim_compute_sim_state": 0.004885386395198043, "sim_compute_performance-ego": 0.007085318206458963, "sim_compute_robot_state-ego": 0.008560249882359658}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.814896949689951, "sim_physics": 0.12536465565363566, "survival_time": 14.950000000000076, "driven_lanedir": 4.235402886041522, "sim_render-ego": 0.01351462682088216, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.04760111888249715, "deviation-heading": 4.592463540259084, "set_robot_commands": 0.010887087980906167, "deviation-center-line": 1.0545579742216065, "driven_lanedir_consec": 4.235402886041522, "sim_compute_sim_state": 0.00565635363260905, "sim_compute_performance-ego": 0.008077270984649658, "sim_compute_robot_state-ego": 0.010130531787872314}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.238220959557723, "sim_physics": 0.1208601959546407, "survival_time": 14.950000000000076, "driven_lanedir": 4.172767829853592, "sim_render-ego": 0.013912062644958496, "in-drivable-lane": 0, "agent_compute-ego": 0.04412194093068441, "deviation-heading": 2.3555175125061165, "set_robot_commands": 0.010951693058013917, "deviation-center-line": 0.5712148599402447, "driven_lanedir_consec": 4.172767829853592, "sim_compute_sim_state": 0.005401206016540527, "sim_compute_performance-ego": 0.008110613822937011, "sim_compute_robot_state-ego": 0.010116496086120606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.3196249421299076, "sim_physics": 0.11525222338162935, "survival_time": 9.750000000000004, "driven_lanedir": 3.226136050337423, "sim_render-ego": 0.0134247682033441, "in-drivable-lane": 0, "agent_compute-ego": 0.03964785551413512, "deviation-heading": 1.8431801726962789, "set_robot_commands": 0.01060497210575984, "deviation-center-line": 0.6049445055323438, "driven_lanedir_consec": 3.226136050337423, "sim_compute_sim_state": 0.005340759570782001, "sim_compute_performance-ego": 0.007645040903335963, "sim_compute_robot_state-ego": 0.009783561413104717}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.770643906464119, "sim_physics": 0.106085420512467, "survival_time": 13.900000000000064, "driven_lanedir": 4.19420172289156, "sim_render-ego": 0.012202135092920535, "in-drivable-lane": 0.9500000000000002, "agent_compute-ego": 0.03601039313583923, "deviation-heading": 3.3380533410977993, "set_robot_commands": 0.009838476455468924, "deviation-center-line": 0.8097232995754764, "driven_lanedir_consec": 4.19420172289156, "sim_compute_sim_state": 0.005233698611636813, "sim_compute_performance-ego": 0.007332311259756843, "sim_compute_robot_state-ego": 0.00946159414250216}}
set_robot_commands_max0.010951693058013917
set_robot_commands_mean0.010186501882869204
set_robot_commands_median0.01060497210575984
set_robot_commands_min0.008650279814197172
sim_compute_performance-ego_max0.008110613822937011
sim_compute_performance-ego_mean0.007650111035427688
sim_compute_performance-ego_median0.007645040903335963
sim_compute_performance-ego_min0.007085318206458963
sim_compute_robot_state-ego_max0.010130531787872314
sim_compute_robot_state-ego_mean0.009610486662391893
sim_compute_robot_state-ego_median0.009783561413104717
sim_compute_robot_state-ego_min0.008560249882359658
sim_compute_sim_state_max0.00565635363260905
sim_compute_sim_state_mean0.005303480845353287
sim_compute_sim_state_median0.005340759570782001
sim_compute_sim_state_min0.004885386395198043
sim_physics_max0.12536465565363566
sim_physics_mean0.11172219953106773
sim_physics_median0.11525222338162935
sim_physics_min0.09104850215296592
sim_render-ego_max0.013912062644958496
sim_render-ego_mean0.012989626320096318
sim_render-ego_median0.0134247682033441
sim_render-ego_min0.01189453883837628
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.640000000000043
survival_time_min4.6499999999999915
No reset possible
296115876Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:09:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.8452482524267926
survival_time_median14.950000000000076
deviation-center-line_median0.7277263114157869
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.038593920866648354
agent_compute-ego_mean0.03173081841362803
agent_compute-ego_median0.027986037731170657
agent_compute-ego_min0.02688912789026896
deviation-center-line_max1.113262122166747
deviation-center-line_mean0.6075715597025653
deviation-center-line_min0.1097194925930912
deviation-heading_max4.476692982097836
deviation-heading_mean2.2621757599203813
deviation-heading_median2.099441510150553
deviation-heading_min0.47041425176290624
driven_any_max4.810401951214587
driven_any_mean3.31647577488224
driven_any_median3.8887111499717952
driven_any_min1.458156072157328
driven_lanedir_consec_max4.683581042359152
driven_lanedir_consec_mean3.026633788835499
driven_lanedir_consec_min1.1644917118775835
driven_lanedir_max4.683581042359152
driven_lanedir_mean3.026633788835499
driven_lanedir_median3.8452482524267926
driven_lanedir_min1.1644917118775835
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.5299999999999981
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.458156072157328, "sim_physics": 0.11840850790751348, "survival_time": 4.849999999999991, "driven_lanedir": 1.1644917118775835, "sim_render-ego": 0.01320563886583466, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.03813493374696712, "deviation-heading": 1.2809838908290758, "set_robot_commands": 0.010888817384070958, "deviation-center-line": 0.26717448972052393, "driven_lanedir_consec": 1.1644917118775835, "sim_compute_sim_state": 0.0051811626277019065, "sim_compute_performance-ego": 0.007830172469935467, "sim_compute_robot_state-ego": 0.01003775154192423}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.736279152064644, "sim_physics": 0.07209178686141968, "survival_time": 14.950000000000076, "driven_lanedir": 4.146147897976808, "sim_render-ego": 0.009084991614023845, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.027986037731170657, "deviation-heading": 4.476692982097836, "set_robot_commands": 0.007351324558258056, "deviation-center-line": 1.113262122166747, "driven_lanedir_consec": 4.146147897976808, "sim_compute_sim_state": 0.003788243134816488, "sim_compute_performance-ego": 0.005262904167175293, "sim_compute_robot_state-ego": 0.006585897604624431}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8887111499717952, "sim_physics": 0.07011675914128622, "survival_time": 14.950000000000076, "driven_lanedir": 3.8452482524267926, "sim_render-ego": 0.00867267608642578, "in-drivable-lane": 0, "agent_compute-ego": 0.02688912789026896, "deviation-heading": 2.099441510150553, "set_robot_commands": 0.007148688634236654, "deviation-center-line": 0.7277263114157869, "driven_lanedir_consec": 3.8452482524267926, "sim_compute_sim_state": 0.003612861633300782, "sim_compute_performance-ego": 0.005066808064778646, "sim_compute_robot_state-ego": 0.006357505321502686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6888305490028488, "sim_physics": 0.06734463876607466, "survival_time": 4.899999999999991, "driven_lanedir": 1.2937000395371614, "sim_render-ego": 0.008253104832707619, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.02705007183308504, "deviation-heading": 0.47041425176290624, "set_robot_commands": 0.006668450881023796, "deviation-center-line": 0.1097194925930912, "driven_lanedir_consec": 1.2937000395371614, "sim_compute_sim_state": 0.0034994568143572125, "sim_compute_performance-ego": 0.004807250840323312, "sim_compute_robot_state-ego": 0.0059801705029546}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.810401951214587, "sim_physics": 0.1087335483233134, "survival_time": 14.950000000000076, "driven_lanedir": 4.683581042359152, "sim_render-ego": 0.012100853919982913, "in-drivable-lane": 0, "agent_compute-ego": 0.038593920866648354, "deviation-heading": 2.983346164761537, "set_robot_commands": 0.010004049936930338, "deviation-center-line": 0.8199753826166776, "driven_lanedir_consec": 4.683581042359152, "sim_compute_sim_state": 0.005098578135172526, "sim_compute_performance-ego": 0.0071943179766337075, "sim_compute_robot_state-ego": 0.009343016942342122}}
set_robot_commands_max0.010888817384070958
set_robot_commands_mean0.00841226627890396
set_robot_commands_median0.007351324558258056
set_robot_commands_min0.006668450881023796
sim_compute_performance-ego_max0.007830172469935467
sim_compute_performance-ego_mean0.006032290703769285
sim_compute_performance-ego_median0.005262904167175293
sim_compute_performance-ego_min0.004807250840323312
sim_compute_robot_state-ego_max0.01003775154192423
sim_compute_robot_state-ego_mean0.007660868382669614
sim_compute_robot_state-ego_median0.006585897604624431
sim_compute_robot_state-ego_min0.0059801705029546
sim_compute_sim_state_max0.0051811626277019065
sim_compute_sim_state_mean0.004236060469069783
sim_compute_sim_state_median0.003788243134816488
sim_compute_sim_state_min0.0034994568143572125
sim_physics_max0.11840850790751348
sim_physics_mean0.08733904819992148
sim_physics_median0.07209178686141968
sim_physics_min0.06734463876607466
sim_render-ego_max0.01320563886583466
sim_render-ego_mean0.010263453063794965
sim_render-ego_median0.009084991614023845
sim_render-ego_min0.008253104832707619
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.92000000000004
survival_time_min4.849999999999991
No reset possible
295695783Robert Moni 🇭🇺kaland-225210aido3-LF-real-validationeval0-visualizesuccessnoip-172-31-46-148-104920:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.40299991607665975
survival_time4.6667
deviation-center-line0.1579566023932099
in-drivable-lane2.6665999999999994


other stats
deviation-heading0.8937374573692229
driven_any1.4024942935697156
driven_lanedir0.40299991607665975
visualized-eval0-passed1
No reset possible
295585845Soroush Saryazdi 🇨🇦upduckaido3-LFV-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:06:20
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
295325831Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:19:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6811521969367935
survival_time_median4.3499999999999925
deviation-center-line_median0.22232697243784755
in-drivable-lane_median0.9999999999999984


other stats
agent_compute-ego_max0.056262941587538945
agent_compute-ego_mean0.03775899973377607
agent_compute-ego_median0.0422503633319207
agent_compute-ego_min0.01594660074814506
deviation-center-line_max0.9101808353923904
deviation-center-line_mean0.31822301145934057
deviation-center-line_min0.08948258168421798
deviation-heading_max4.330428843147774
deviation-heading_mean1.7220522596399674
deviation-heading_median1.3640276738217751
deviation-heading_min0.42611152286730786
driven_any_max3.931526517507434
driven_any_mean1.6862201495794262
driven_any_median1.1225073737160849
driven_any_min0.4935990385652159
driven_lanedir_consec_max3.1037215317971296
driven_lanedir_consec_mean1.1727630906958528
driven_lanedir_consec_min0.19508257429347564
driven_lanedir_max3.1037215317971296
driven_lanedir_mean1.1826222007351128
driven_lanedir_median0.7339431229602756
driven_lanedir_min0.20767584746129783
in-drivable-lane_max3.7500000000000018
in-drivable-lane_mean1.3266666666666682
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.109197877311188, "sim_physics": 0.07706806029396496, "survival_time": 4.3499999999999925, "driven_lanedir": 0.7339431229602756, "sim_render-ego": 0.009812966160390568, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.022207246429618747, "deviation-heading": 2.6312710968544875, "set_robot_commands": 0.009017771688000909, "deviation-center-line": 0.26008189583038854, "driven_lanedir_consec": 0.6309046621203812, "sim_compute_sim_state": 0.004424854256640905, "sim_compute_performance-ego": 0.006132816446238551, "sim_compute_robot_state-ego": 0.007125591409617457}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1225004918894663, "sim_physics": 0.07425850835339777, "survival_time": 4.3499999999999925, "driven_lanedir": 1.0635824201609043, "sim_render-ego": 0.009714189617113136, "in-drivable-lane": 0, "agent_compute-ego": 0.02079197182052437, "deviation-heading": 1.1824760594726993, "set_robot_commands": 0.009889895888580674, "deviation-center-line": 0.22232697243784755, "driven_lanedir_consec": 1.0635824201609043, "sim_compute_sim_state": 0.004559481280973588, "sim_compute_performance-ego": 0.0057658244823587355, "sim_compute_robot_state-ego": 0.00712498577161767}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.651948774806041, "sim_physics": 0.06311702016574233, "survival_time": 13.400000000000055, "driven_lanedir": 3.1037215317971296, "sim_render-ego": 0.008765377215485074, "in-drivable-lane": 0.9999999999999984, "agent_compute-ego": 0.017949960125026417, "deviation-heading": 4.330428843147774, "set_robot_commands": 0.008087149306909363, "deviation-center-line": 0.9101808353923904, "driven_lanedir_consec": 3.1037215317971296, "sim_compute_sim_state": 0.0037788980042756494, "sim_compute_performance-ego": 0.004762492962737582, "sim_compute_robot_state-ego": 0.006004113759567488}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4936186231584565, "sim_physics": 0.05857332547505697, "survival_time": 2.1000000000000005, "driven_lanedir": 0.20767584746129783, "sim_render-ego": 0.007349014282226563, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.016537586847941082, "deviation-heading": 0.7982709430146607, "set_robot_commands": 0.00759486925034296, "deviation-center-line": 0.08948258168421798, "driven_lanedir_consec": 0.19508257429347564, "sim_compute_sim_state": 0.0031972499120803107, "sim_compute_performance-ego": 0.004071916852678571, "sim_compute_robot_state-ego": 0.005193596794491722}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5495357699623118, "sim_physics": 0.06202579581219217, "survival_time": 2.3, "driven_lanedir": 0.5146686692151854, "sim_render-ego": 0.00745491359544837, "in-drivable-lane": 0, "agent_compute-ego": 0.01594660074814506, "deviation-heading": 0.6773002542387311, "set_robot_commands": 0.007540086041326108, "deviation-center-line": 0.11341916407568273, "driven_lanedir_consec": 0.5146686692151854, "sim_compute_sim_state": 0.003256310587343962, "sim_compute_performance-ego": 0.0042052839113318405, "sim_compute_robot_state-ego": 0.005169277605803117}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.1225073737160849, "sim_physics": 0.11071943688666684, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6811521969367935, "sim_render-ego": 0.012107251704424275, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.029514926603470725, "deviation-heading": 0.7807507900900286, "set_robot_commands": 0.011134917708649031, "deviation-center-line": 0.1584782786988454, "driven_lanedir_consec": 0.6811521969367935, "sim_compute_sim_state": 0.005152735216864224, "sim_compute_performance-ego": 0.00692341519498277, "sim_compute_robot_state-ego": 0.008734916818553004}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.931526517507434, "sim_physics": 0.0972143817279074, "survival_time": 14.40000000000007, "driven_lanedir": 2.5729695507481964, "sim_render-ego": 0.01134308179219564, "in-drivable-lane": 3.7500000000000018, "agent_compute-ego": 0.04248278256919649, "deviation-heading": 4.015826443644352, "set_robot_commands": 0.008805666532781389, "deviation-center-line": 0.71139699602478, "driven_lanedir_consec": 2.569545322914618, "sim_compute_sim_state": 0.004738515449894799, "sim_compute_performance-ego": 0.007107991311285231, "sim_compute_robot_state-ego": 0.008859776788287692}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5976629659377652, "sim_physics": 0.09744100137190384, "survival_time": 6.0499999999999865, "driven_lanedir": 1.235482128740975, "sim_render-ego": 0.01170833642817726, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.041751875365075984, "deviation-heading": 1.4243580803947975, "set_robot_commands": 0.008786723633443029, "deviation-center-line": 0.2935179872732394, "driven_lanedir_consec": 1.235482128740975, "sim_compute_sim_state": 0.004929286389311483, "sim_compute_performance-ego": 0.0068471471140207334, "sim_compute_robot_state-ego": 0.00846873236096595}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.3880450760169112, "sim_physics": 0.09807785502019918, "survival_time": 5.299999999999989, "driven_lanedir": 0.917944722221092, "sim_render-ego": 0.01155557722415564, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.0422503633319207, "deviation-heading": 1.6072761321473292, "set_robot_commands": 0.009245762285196557, "deviation-center-line": 0.2626156000507422, "driven_lanedir_consec": 0.917944722221092, "sim_compute_sim_state": 0.004591696667221357, "sim_compute_performance-ego": 0.006706788854778938, "sim_compute_robot_state-ego": 0.008373379707336426}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.3724949923641496, "sim_physics": 0.13887096124310647, "survival_time": 12.40000000000004, "driven_lanedir": 2.8176500036294003, "sim_render-ego": 0.01457018909915801, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.05008297101143868, "deviation-heading": 3.3130615924265614, "set_robot_commands": 0.01231040685407577, "deviation-center-line": 0.5317669552569153, "driven_lanedir_consec": 2.8176500036294003, "sim_compute_sim_state": 0.005807147872063422, "sim_compute_performance-ego": 0.008462129100676506, "sim_compute_robot_state-ego": 0.010943631972036056}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.2063164303394145, "sim_physics": 0.14688771514482396, "survival_time": 4.6499999999999915, "driven_lanedir": 0.25099765011249553, "sim_render-ego": 0.015710979379633422, "in-drivable-lane": 2.8499999999999943, "agent_compute-ego": 0.05136859032415574, "deviation-heading": 1.3640276738217751, "set_robot_commands": 0.012323223134522795, "deviation-center-line": 0.19049752900512307, "driven_lanedir_consec": 0.25099765011249553, "sim_compute_sim_state": 0.005951345607798587, "sim_compute_performance-ego": 0.008910804666498656, "sim_compute_robot_state-ego": 0.011256430738715717}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4935990385652159, "sim_physics": 0.1560706581388201, "survival_time": 2.1000000000000005, "driven_lanedir": 0.22511594134523472, "sim_render-ego": 0.016790497870672317, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.056262941587538945, "deviation-heading": 0.8020403780091637, "set_robot_commands": 0.013919376191638765, "deviation-center-line": 0.1420086747121414, "driven_lanedir_consec": 0.19830911275687269, "sim_compute_sim_state": 0.006473972683861142, "sim_compute_performance-ego": 0.010306085859026228, "sim_compute_robot_state-ego": 0.011272759664626347}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9268752136469935, "sim_physics": 0.14630052161543336, "survival_time": 3.649999999999995, "driven_lanedir": 0.6080542985865433, "sim_render-ego": 0.015376829121210803, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.053533345052640735, "deviation-heading": 0.8341012182406327, "set_robot_commands": 0.013252650221733196, "deviation-center-line": 0.11495514104957578, "driven_lanedir_consec": 0.6060304384272995, "sim_compute_sim_state": 0.005873595198539839, "sim_compute_performance-ego": 0.009573600063585257, "sim_compute_robot_state-ego": 0.012202079981973726}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.0666315339375787, "sim_physics": 0.1497981462133936, "survival_time": 4.149999999999993, "driven_lanedir": 0.307814027712459, "sim_render-ego": 0.01550135842288833, "in-drivable-lane": 2.6499999999999924, "agent_compute-ego": 0.05101817199982792, "deviation-heading": 0.42611152286730786, "set_robot_commands": 0.012369365577238152, "deviation-center-line": 0.12767851407880895, "driven_lanedir_consec": 0.307814027712459, "sim_compute_sim_state": 0.006326988518956196, "sim_compute_performance-ego": 0.009352474327547005, "sim_compute_robot_state-ego": 0.012552195284740034}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.260841564532383, "sim_physics": 0.15172674655914306, "survival_time": 12.000000000000036, "driven_lanedir": 2.4985608993987105, "sim_render-ego": 0.015479617317517598, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.05468566219011942, "deviation-heading": 1.643482866229213, "set_robot_commands": 0.01290909747282664, "deviation-center-line": 0.6449380463194091, "driven_lanedir_consec": 2.4985608993987105, "sim_compute_sim_state": 0.00626257061958313, "sim_compute_performance-ego": 0.009325276811917622, "sim_compute_robot_state-ego": 0.012106244762738546}}
set_robot_commands_max0.013919376191638765
set_robot_commands_mean0.010479130785817688
set_robot_commands_median0.009889895888580674
set_robot_commands_min0.007540086041326108
sim_compute_performance-ego_max0.010306085859026228
sim_compute_performance-ego_mean0.007230269863977614
sim_compute_performance-ego_median0.00692341519498277
sim_compute_performance-ego_min0.004071916852678571
sim_compute_robot_state-ego_max0.012552195284740034
sim_compute_robot_state-ego_mean0.009025847561404732
sim_compute_robot_state-ego_median0.008734916818553004
sim_compute_robot_state-ego_min0.005169277605803117
sim_compute_sim_state_max0.006473972683861142
sim_compute_sim_state_mean0.0050216432176939056
sim_compute_sim_state_median0.004929286389311483
sim_compute_sim_state_min0.0031972499120803107
sim_physics_max0.1560706581388201
sim_physics_mean0.10854334226811678
sim_physics_median0.09807785502019918
sim_physics_min0.05857332547505697
sim_render-ego_max0.016790497870672317
sim_render-ego_mean0.012216011948713131
sim_render-ego_median0.01170833642817726
sim_render-ego_min0.007349014282226563
simulation-passed1
survival_time_max14.40000000000007
survival_time_mean6.370000000000008
survival_time_min2.1000000000000005
No reset possible
294965812Robert Moni 🇭🇺lzoltan-02aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:29:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.592817571886536
survival_time_median14.950000000000076
deviation-center-line_median0.8078092814474367
in-drivable-lane_median0.9999999999999964


other stats
agent_compute-ego_max0.030618572235107423
agent_compute-ego_mean0.0276400683213633
agent_compute-ego_median0.02741532802581787
agent_compute-ego_min0.02622153361638387
deviation-center-line_max0.9648454922084896
deviation-center-line_mean0.7989354068038101
deviation-center-line_min0.4550511332182306
deviation-heading_max4.204437653909178
deviation-heading_mean3.498330086230282
deviation-heading_median3.671097668843976
deviation-heading_min2.270688685140929
driven_any_max6.027852746852932
driven_any_mean5.192928126598247
driven_any_median5.173351918582768
driven_any_min3.4267276523931645
driven_lanedir_consec_max5.628878357451236
driven_lanedir_consec_mean4.4762800943220356
driven_lanedir_consec_min2.8259858750008453
driven_lanedir_max5.628878357451236
driven_lanedir_mean4.4762800943220356
driven_lanedir_median4.592817571886536
driven_lanedir_min2.8259858750008453
in-drivable-lane_max2.4000000000000012
in-drivable-lane_mean1.0566666666666693
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.47631144670953, "sim_physics": 0.07710973898569742, "survival_time": 14.950000000000076, "driven_lanedir": 4.286294618503956, "sim_render-ego": 0.009562678337097168, "in-drivable-lane": 0, "agent_compute-ego": 0.02878936529159546, "deviation-heading": 3.856387157473187, "set_robot_commands": 0.00680714209874471, "deviation-center-line": 0.7572088485179073, "driven_lanedir_consec": 4.286294618503956, "sim_compute_sim_state": 0.004049794673919678, "sim_compute_performance-ego": 0.005810171763102214, "sim_compute_robot_state-ego": 0.007258075873057048}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.173351918582768, "sim_physics": 0.07654326756795247, "survival_time": 14.950000000000076, "driven_lanedir": 4.592817571886536, "sim_render-ego": 0.009545814196268718, "in-drivable-lane": 0.799999999999998, "agent_compute-ego": 0.028345945676167807, "deviation-heading": 3.552860058203557, "set_robot_commands": 0.006973953247070313, "deviation-center-line": 0.8756483969154172, "driven_lanedir_consec": 4.592817571886536, "sim_compute_sim_state": 0.004101099967956543, "sim_compute_performance-ego": 0.005728295644124349, "sim_compute_robot_state-ego": 0.0069940447807312015}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.98590216507378, "sim_physics": 0.07616487185160319, "survival_time": 14.950000000000076, "driven_lanedir": 4.652234170929701, "sim_render-ego": 0.009485740661621094, "in-drivable-lane": 2.4000000000000012, "agent_compute-ego": 0.027048596541086833, "deviation-heading": 2.558015302875209, "set_robot_commands": 0.006834869384765625, "deviation-center-line": 0.7289483289860809, "driven_lanedir_consec": 4.652234170929701, "sim_compute_sim_state": 0.0040945037206014, "sim_compute_performance-ego": 0.005592671235402425, "sim_compute_robot_state-ego": 0.00697918176651001}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.9970799490850215, "sim_physics": 0.07611051162083944, "survival_time": 14.950000000000076, "driven_lanedir": 5.628878357451236, "sim_render-ego": 0.009607168038686116, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.027727549076080323, "deviation-heading": 3.0642111740636113, "set_robot_commands": 0.006666420300801595, "deviation-center-line": 0.7070756856948744, "driven_lanedir_consec": 5.628878357451236, "sim_compute_sim_state": 0.0040276924769083655, "sim_compute_performance-ego": 0.005455550352732341, "sim_compute_robot_state-ego": 0.006997465292612711}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.635484903338278, "sim_physics": 0.07457897504170735, "survival_time": 14.950000000000076, "driven_lanedir": 5.390353159760194, "sim_render-ego": 0.009555447101593015, "in-drivable-lane": 0, "agent_compute-ego": 0.027877709865570068, "deviation-heading": 3.671097668843976, "set_robot_commands": 0.006859165827433268, "deviation-center-line": 0.9385599070020424, "driven_lanedir_consec": 5.390353159760194, "sim_compute_sim_state": 0.00396561861038208, "sim_compute_performance-ego": 0.00563327153523763, "sim_compute_robot_state-ego": 0.007107299168904622}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.823852824862766, "sim_physics": 0.07431941588719686, "survival_time": 14.950000000000076, "driven_lanedir": 4.086453864604229, "sim_render-ego": 0.00894446055094401, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.028494053681691486, "deviation-heading": 4.042809839397621, "set_robot_commands": 0.006738315423329672, "deviation-center-line": 0.864361251601454, "driven_lanedir_consec": 4.086453864604229, "sim_compute_sim_state": 0.003799154758453369, "sim_compute_performance-ego": 0.005143039226531983, "sim_compute_robot_state-ego": 0.00654645840326945}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 6.027852746852932, "sim_physics": 0.07516229708989461, "survival_time": 14.950000000000076, "driven_lanedir": 5.533517404351127, "sim_render-ego": 0.00892132838567098, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.026406293710072835, "deviation-heading": 3.798601898368059, "set_robot_commands": 0.006587193806966146, "deviation-center-line": 0.9648454922084896, "driven_lanedir_consec": 5.533517404351127, "sim_compute_sim_state": 0.0038416266441345217, "sim_compute_performance-ego": 0.005141090552012125, "sim_compute_robot_state-ego": 0.006570717493693034}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.35979727123481, "sim_physics": 0.07478367567062377, "survival_time": 14.950000000000076, "driven_lanedir": 3.920786571872916, "sim_render-ego": 0.009024561246236166, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.02659740447998047, "deviation-heading": 3.0731550225253907, "set_robot_commands": 0.006636405785878499, "deviation-center-line": 0.6723546213829822, "driven_lanedir_consec": 3.920786571872916, "sim_compute_sim_state": 0.003865962823232015, "sim_compute_performance-ego": 0.005280975500742594, "sim_compute_robot_state-ego": 0.006679361661275228}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.832942921894034, "sim_physics": 0.07380284547805786, "survival_time": 14.950000000000076, "driven_lanedir": 3.4164709966465794, "sim_render-ego": 0.00884458859761556, "in-drivable-lane": 2.3000000000000114, "agent_compute-ego": 0.026669559478759767, "deviation-heading": 4.204437653909178, "set_robot_commands": 0.006459242502848308, "deviation-center-line": 0.7801765803745291, "driven_lanedir_consec": 3.4164709966465794, "sim_compute_sim_state": 0.0037185072898864744, "sim_compute_performance-ego": 0.005148614247639974, "sim_compute_robot_state-ego": 0.00653818686803182}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.637276231428097, "sim_physics": 0.07291808207829793, "survival_time": 14.950000000000076, "driven_lanedir": 3.9193668660476937, "sim_render-ego": 0.008926738897959391, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.02622153361638387, "deviation-heading": 4.131488557033836, "set_robot_commands": 0.006439436276753744, "deviation-center-line": 0.8736484634713201, "driven_lanedir_consec": 3.9193668660476937, "sim_compute_sim_state": 0.00374144713083903, "sim_compute_performance-ego": 0.005135419368743896, "sim_compute_robot_state-ego": 0.006469201246897379}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 5.847917971640991, "sim_physics": 0.07237119436264038, "survival_time": 14.950000000000076, "driven_lanedir": 4.8878879342965815, "sim_render-ego": 0.008982439835866293, "in-drivable-lane": 1.7000000000000082, "agent_compute-ego": 0.026937988599141437, "deviation-heading": 2.98845699777371, "set_robot_commands": 0.006717854340871175, "deviation-center-line": 0.8799516177578225, "driven_lanedir_consec": 4.8878879342965815, "sim_compute_sim_state": 0.0038993501663208007, "sim_compute_performance-ego": 0.0052904113133748374, "sim_compute_robot_state-ego": 0.006791374683380127}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 5.869165319757382, "sim_physics": 0.07605771621068319, "survival_time": 14.950000000000076, "driven_lanedir": 5.081165922968642, "sim_render-ego": 0.009177882671356202, "in-drivable-lane": 1.1499999999999997, "agent_compute-ego": 0.02830891052881877, "deviation-heading": 3.966616902573968, "set_robot_commands": 0.006702984968821208, "deviation-center-line": 0.8790542949651606, "driven_lanedir_consec": 5.081165922968642, "sim_compute_sim_state": 0.003925406138102214, "sim_compute_performance-ego": 0.005266898473103841, "sim_compute_robot_state-ego": 0.0066985686620076495}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 5.0758856797450775, "sim_physics": 0.07504740794499715, "survival_time": 14.950000000000076, "driven_lanedir": 4.06258031181407, "sim_render-ego": 0.009009573459625244, "in-drivable-lane": 1.5000000000000036, "agent_compute-ego": 0.02741532802581787, "deviation-heading": 3.857694989016648, "set_robot_commands": 0.0067526642481486, "deviation-center-line": 0.8078092814474367, "driven_lanedir_consec": 4.06258031181407, "sim_compute_sim_state": 0.0039168262481689455, "sim_compute_performance-ego": 0.005160620212554931, "sim_compute_robot_state-ego": 0.006600617567698161}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.4267276523931645, "sim_physics": 0.07875991882161891, "survival_time": 9.4, "driven_lanedir": 2.8259858750008453, "sim_render-ego": 0.009138149149874424, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.02714221401417509, "deviation-heading": 2.270688685140929, "set_robot_commands": 0.006631427622855978, "deviation-center-line": 0.4550511332182306, "driven_lanedir_consec": 2.8259858750008453, "sim_compute_sim_state": 0.00392189178060978, "sim_compute_performance-ego": 0.005201056916662988, "sim_compute_robot_state-ego": 0.0066304650712520515}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.724372896375054, "sim_physics": 0.08555725574493409, "survival_time": 14.950000000000076, "driven_lanedir": 4.85940778869622, "sim_render-ego": 0.009745818773905436, "in-drivable-lane": 1.3500000000000174, "agent_compute-ego": 0.030618572235107423, "deviation-heading": 3.4384293862553448, "set_robot_commands": 0.007614380518595378, "deviation-center-line": 0.7993371985134058, "driven_lanedir_consec": 4.85940778869622, "sim_compute_sim_state": 0.004147180716196696, "sim_compute_performance-ego": 0.005623428026835123, "sim_compute_robot_state-ego": 0.007115327517191569}}
set_robot_commands_max0.007614380518595378
set_robot_commands_mean0.0067614304235922825
set_robot_commands_median0.006717854340871175
set_robot_commands_min0.006439436276753744
sim_compute_performance-ego_max0.005810171763102214
sim_compute_performance-ego_mean0.005374100957920084
sim_compute_performance-ego_median0.005280975500742594
sim_compute_performance-ego_min0.005135419368743896
sim_compute_robot_state-ego_max0.007258075873057048
sim_compute_robot_state-ego_mean0.006798423070434137
sim_compute_robot_state-ego_median0.0066985686620076495
sim_compute_robot_state-ego_min0.006469201246897379
sim_compute_sim_state_max0.004147180716196696
sim_compute_sim_state_mean0.003934404209714128
sim_compute_sim_state_median0.00392189178060978
sim_compute_sim_state_min0.0037185072898864744
sim_physics_max0.08555725574493409
sim_physics_mean0.07595247829044964
sim_physics_median0.07516229708989461
sim_physics_min0.07237119436264038
sim_render-ego_max0.009745818773905436
sim_render-ego_mean0.009231492660287988
sim_render-ego_median0.009138149149874424
sim_render-ego_min0.00884458859761556
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.580000000000071
survival_time_min9.4
No reset possible
294865800Robert Moni 🇭🇺kaland-225308aido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104920:14:06
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
294545785Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6218965980524436
survival_time_median10.15000000000001
deviation-center-line_median0.4944833788456364
in-drivable-lane_median0.350000000000005


other stats
agent_compute-ego_max0.021730083550138425
agent_compute-ego_mean0.02140790375240003
agent_compute-ego_median0.02144941829499744
agent_compute-ego_min0.02089323759078979
deviation-center-line_max0.983054173878612
deviation-center-line_mean0.5551281324279053
deviation-center-line_min0.20813708683743176
deviation-heading_max4.143709650966206
deviation-heading_mean2.209731485188938
deviation-heading_median2.270936261124675
deviation-heading_min0.7412850446934309
driven_any_max4.2909626237007625
driven_any_mean3.1184051688607264
driven_any_median3.305064269009309
driven_any_min1.1806955273415365
driven_lanedir_consec_max3.892916340031811
driven_lanedir_consec_mean2.738305731091234
driven_lanedir_consec_min1.139940253800474
driven_lanedir_max3.892916340031811
driven_lanedir_mean2.738305731091234
driven_lanedir_median2.6218965980524436
driven_lanedir_min1.139940253800474
in-drivable-lane_max1.9000000000000057
in-drivable-lane_mean0.6400000000000048
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.860129983456346, "sim_physics": 0.05576484661384169, "survival_time": 10.15000000000001, "driven_lanedir": 2.6218965980524436, "sim_render-ego": 0.007213525584178605, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.021730083550138425, "deviation-heading": 1.6137615709670428, "set_robot_commands": 0.00529646990921697, "deviation-center-line": 0.4944833788456364, "driven_lanedir_consec": 2.6218965980524436, "sim_compute_sim_state": 0.0030271372771615464, "sim_compute_performance-ego": 0.004204606774992544, "sim_compute_robot_state-ego": 0.005220067912134631}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1806955273415365, "sim_physics": 0.058128039042154946, "survival_time": 3.149999999999997, "driven_lanedir": 1.139940253800474, "sim_render-ego": 0.0073326655796595985, "in-drivable-lane": 0, "agent_compute-ego": 0.02144941829499744, "deviation-heading": 0.7412850446934309, "set_robot_commands": 0.005290050355214921, "deviation-center-line": 0.20813708683743176, "driven_lanedir_consec": 1.139940253800474, "sim_compute_sim_state": 0.0030213461981879342, "sim_compute_performance-ego": 0.004100489237951854, "sim_compute_robot_state-ego": 0.005168358484903972}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.9551734407956793, "sim_physics": 0.05456627448399862, "survival_time": 14.950000000000076, "driven_lanedir": 3.892916340031811, "sim_render-ego": 0.007148171265920003, "in-drivable-lane": 0, "agent_compute-ego": 0.02089323759078979, "deviation-heading": 2.270936261124675, "set_robot_commands": 0.005284113883972168, "deviation-center-line": 0.7244293854004671, "driven_lanedir_consec": 3.892916340031811, "sim_compute_sim_state": 0.0030442261695861816, "sim_compute_performance-ego": 0.004108289082845052, "sim_compute_robot_state-ego": 0.005246198972066243}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.305064269009309, "sim_physics": 0.056953204046819625, "survival_time": 9.700000000000005, "driven_lanedir": 2.349616241205321, "sim_render-ego": 0.007327093291528446, "in-drivable-lane": 1.9000000000000057, "agent_compute-ego": 0.02132720431101691, "deviation-heading": 2.2789648981933346, "set_robot_commands": 0.005271047660984944, "deviation-center-line": 0.36553663717737905, "driven_lanedir_consec": 2.349616241205321, "sim_compute_sim_state": 0.003126616330490899, "sim_compute_performance-ego": 0.004092394691152671, "sim_compute_robot_state-ego": 0.0052662633129001895}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.2909626237007625, "sim_physics": 0.0573077088310605, "survival_time": 13.65000000000006, "driven_lanedir": 3.687159222366122, "sim_render-ego": 0.007353259530259576, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.021639575015057574, "deviation-heading": 4.143709650966206, "set_robot_commands": 0.005293911629980737, "deviation-center-line": 0.983054173878612, "driven_lanedir_consec": 3.687159222366122, "sim_compute_sim_state": 0.0031085354941231863, "sim_compute_performance-ego": 0.004134985990140028, "sim_compute_robot_state-ego": 0.005282163619995117}}
set_robot_commands_max0.00529646990921697
set_robot_commands_mean0.005287118687873948
set_robot_commands_median0.005290050355214921
set_robot_commands_min0.005271047660984944
sim_compute_performance-ego_max0.004204606774992544
sim_compute_performance-ego_mean0.00412815315541643
sim_compute_performance-ego_median0.004108289082845052
sim_compute_performance-ego_min0.004092394691152671
sim_compute_robot_state-ego_max0.005282163619995117
sim_compute_robot_state-ego_mean0.005236610460400031
sim_compute_robot_state-ego_median0.005246198972066243
sim_compute_robot_state-ego_min0.005168358484903972
sim_compute_sim_state_max0.003126616330490899
sim_compute_sim_state_mean0.0030655722939099492
sim_compute_sim_state_median0.0030442261695861816
sim_compute_sim_state_min0.0030213461981879342
sim_physics_max0.058128039042154946
sim_physics_mean0.056544014603575075
sim_physics_median0.056953204046819625
sim_physics_min0.05456627448399862
sim_render-ego_max0.007353259530259576
sim_render-ego_mean0.007274943050309246
sim_render-ego_median0.007327093291528446
sim_render-ego_min0.007148171265920003
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.32000000000003
survival_time_min3.149999999999997
No reset possible
294475781Robert Moni 🇭🇺kaland-225210aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5291990187192983
survival_time_median8.249999999999982
deviation-center-line_median0.3941207252437889
in-drivable-lane_median0


other stats
agent_compute-ego_max0.024704240175536633
agent_compute-ego_mean0.024184723827390307
agent_compute-ego_median0.024106954805778735
agent_compute-ego_min0.023707653613800696
deviation-center-line_max0.6573091203924832
deviation-center-line_mean0.38624076900990034
deviation-center-line_min0.11395901185142264
deviation-heading_max4.471670899763128
deviation-heading_mean2.354837101509621
deviation-heading_median2.395954310189611
deviation-heading_min0.761842640263812
driven_any_max5.258780718133845
driven_any_mean2.7284747373183516
driven_any_median2.709038573488915
driven_any_min0.5639325603232099
driven_lanedir_consec_max5.05370876417434
driven_lanedir_consec_mean2.3427260954405815
driven_lanedir_consec_min0.49392863868280434
driven_lanedir_max5.05370876417434
driven_lanedir_mean2.3427260954405815
driven_lanedir_median2.5291990187192983
driven_lanedir_min0.49392863868280434
in-drivable-lane_max2.400000000000018
in-drivable-lane_mean0.5000000000000036
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.387924698198765, "sim_physics": 0.0561807248379006, "survival_time": 12.850000000000048, "driven_lanedir": 3.0330343959237167, "sim_render-ego": 0.007309293004789241, "in-drivable-lane": 2.400000000000018, "agent_compute-ego": 0.024704240175536633, "deviation-heading": 4.471670899763128, "set_robot_commands": 0.005072145610467933, "deviation-center-line": 0.6393256527148378, "driven_lanedir_consec": 3.0330343959237167, "sim_compute_sim_state": 0.003026096737338411, "sim_compute_performance-ego": 0.004206174078618506, "sim_compute_robot_state-ego": 0.0052938359256848285}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.709038573488915, "sim_physics": 0.05712625908129143, "survival_time": 8.249999999999982, "driven_lanedir": 2.5291990187192983, "sim_render-ego": 0.007394667827721798, "in-drivable-lane": 0, "agent_compute-ego": 0.024106954805778735, "deviation-heading": 2.395954310189611, "set_robot_commands": 0.005066977125225645, "deviation-center-line": 0.3941207252437889, "driven_lanedir_consec": 2.5291990187192983, "sim_compute_sim_state": 0.0030927007848566227, "sim_compute_performance-ego": 0.004128909833503492, "sim_compute_robot_state-ego": 0.005283273350108753}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7226971364470225, "sim_physics": 0.057228306506542446, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6037596597027477, "sim_render-ego": 0.01304901914393648, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.023707653613800696, "deviation-heading": 0.882119705294186, "set_robot_commands": 0.004946074587233523, "deviation-center-line": 0.11395901185142264, "driven_lanedir_consec": 0.6037596597027477, "sim_compute_sim_state": 0.0030220265084124624, "sim_compute_performance-ego": 0.004127989424035904, "sim_compute_robot_state-ego": 0.005211703320767017}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5639325603232099, "sim_physics": 0.05957127906180717, "survival_time": 1.850000000000001, "driven_lanedir": 0.49392863868280434, "sim_render-ego": 0.0074541311006288274, "in-drivable-lane": 0, "agent_compute-ego": 0.024353910136867215, "deviation-heading": 0.761842640263812, "set_robot_commands": 0.005235330478565113, "deviation-center-line": 0.1264893348469691, "driven_lanedir_consec": 0.49392863868280434, "sim_compute_sim_state": 0.0030886289235707875, "sim_compute_performance-ego": 0.004098789111987964, "sim_compute_robot_state-ego": 0.005294928679595122}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.258780718133845, "sim_physics": 0.05866508642832438, "survival_time": 14.950000000000076, "driven_lanedir": 5.05370876417434, "sim_render-ego": 0.007221204439798991, "in-drivable-lane": 0, "agent_compute-ego": 0.02405086040496826, "deviation-heading": 3.2625979520373662, "set_robot_commands": 0.00507691224416097, "deviation-center-line": 0.6573091203924832, "driven_lanedir_consec": 5.05370876417434, "sim_compute_sim_state": 0.003060481548309326, "sim_compute_performance-ego": 0.004133776028951009, "sim_compute_robot_state-ego": 0.005300424893697103}}
set_robot_commands_max0.005235330478565113
set_robot_commands_mean0.005079488009130638
set_robot_commands_median0.005072145610467933
set_robot_commands_min0.004946074587233523
sim_compute_performance-ego_max0.004206174078618506
sim_compute_performance-ego_mean0.004139127695419374
sim_compute_performance-ego_median0.004128909833503492
sim_compute_performance-ego_min0.004098789111987964
sim_compute_robot_state-ego_max0.005300424893697103
sim_compute_robot_state-ego_mean0.005276833233970565
sim_compute_robot_state-ego_median0.0052938359256848285
sim_compute_robot_state-ego_min0.005211703320767017
sim_compute_sim_state_max0.0030927007848566227
sim_compute_sim_state_mean0.0030579869004975216
sim_compute_sim_state_median0.003060481548309326
sim_compute_sim_state_min0.0030220265084124624
sim_physics_max0.05957127906180717
sim_physics_mean0.05775433118317321
sim_physics_median0.057228306506542446
sim_physics_min0.0561807248379006
sim_render-ego_max0.01304901914393648
sim_render-ego_mean0.008485663103375066
sim_render-ego_median0.007394667827721798
sim_render-ego_min0.007221204439798991
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.050000000000022
survival_time_min1.850000000000001
No reset possible
294345777Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:04:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.178714406374268
survival_time_median8.04999999999998
deviation-center-line_median0.3864848481089538
in-drivable-lane_median0.9000000000000128


other stats
agent_compute-ego_max0.022371023723057337
agent_compute-ego_mean0.02190893319638347
agent_compute-ego_median0.02175747076670329
agent_compute-ego_min0.021538903412309664
deviation-center-line_max0.7003855830961949
deviation-center-line_mean0.4343336555348009
deviation-center-line_min0.24100253870368665
deviation-heading_max4.45320534198297
deviation-heading_mean2.326562219069886
deviation-heading_median1.9808765303466855
deviation-heading_min1.014732740597276
driven_any_max3.8769501308146177
driven_any_mean2.417970877991544
driven_any_median2.5905925960052008
driven_any_min0.995448664130656
driven_lanedir_consec_max3.2571501546296147
driven_lanedir_consec_mean2.0568273246283995
driven_lanedir_consec_min0.8981673349845314
driven_lanedir_max3.2571501546296147
driven_lanedir_mean2.0568273246283995
driven_lanedir_median2.178714406374268
driven_lanedir_min0.8981673349845314
in-drivable-lane_max1.1000000000000083
in-drivable-lane_mean0.6200000000000034
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5905925960052008, "sim_physics": 0.05698739733014787, "survival_time": 8.74999999999999, "driven_lanedir": 2.178714406374268, "sim_render-ego": 0.0072344779968261715, "in-drivable-lane": 1.1000000000000083, "agent_compute-ego": 0.022371023723057337, "deviation-heading": 2.22582406709997, "set_robot_commands": 0.00534543582371303, "deviation-center-line": 0.3659929530849365, "driven_lanedir_consec": 2.178714406374268, "sim_compute_sim_state": 0.003139702933175223, "sim_compute_performance-ego": 0.004220055171421596, "sim_compute_robot_state-ego": 0.005268652779715402}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.995448664130656, "sim_physics": 0.059891366958618165, "survival_time": 2.7499999999999982, "driven_lanedir": 0.8981673349845314, "sim_render-ego": 0.00762182582508434, "in-drivable-lane": 0, "agent_compute-ego": 0.022324158928611063, "deviation-heading": 1.014732740597276, "set_robot_commands": 0.00525243499062278, "deviation-center-line": 0.24100253870368665, "driven_lanedir_consec": 0.8981673349845314, "sim_compute_sim_state": 0.0031571908430619673, "sim_compute_performance-ego": 0.0041167649355801665, "sim_compute_robot_state-ego": 0.005351452393965288}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8769501308146177, "sim_physics": 0.05551984866460164, "survival_time": 14.950000000000076, "driven_lanedir": 3.2571501546296147, "sim_render-ego": 0.007814789613087972, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.02175747076670329, "deviation-heading": 4.45320534198297, "set_robot_commands": 0.0053571168581644695, "deviation-center-line": 0.7003855830961949, "driven_lanedir_consec": 3.2571501546296147, "sim_compute_sim_state": 0.003172134558359782, "sim_compute_performance-ego": 0.004179147084554037, "sim_compute_robot_state-ego": 0.005314300855000814}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.8572614021184712, "sim_physics": 0.056907182894878505, "survival_time": 8.04999999999998, "driven_lanedir": 2.3881722702824986, "sim_render-ego": 0.00725245475769043, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.021553109151236018, "deviation-heading": 1.958172415322528, "set_robot_commands": 0.005218948636736188, "deviation-center-line": 0.4778023546802328, "driven_lanedir_consec": 2.3881722702824986, "sim_compute_sim_state": 0.00307768620319248, "sim_compute_performance-ego": 0.004062516348702567, "sim_compute_robot_state-ego": 0.005163454861374375}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.769601596888773, "sim_physics": 0.05633477331365196, "survival_time": 5.14999999999999, "driven_lanedir": 1.5619324568710842, "sim_render-ego": 0.007407512479615443, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.021538903412309664, "deviation-heading": 1.9808765303466855, "set_robot_commands": 0.0053153778742818, "deviation-center-line": 0.3864848481089538, "driven_lanedir_consec": 1.5619324568710842, "sim_compute_sim_state": 0.0030937634625481172, "sim_compute_performance-ego": 0.0041495434288839695, "sim_compute_robot_state-ego": 0.005319028224759889}}
set_robot_commands_max0.0053571168581644695
set_robot_commands_mean0.005297862836703653
set_robot_commands_median0.0053153778742818
set_robot_commands_min0.005218948636736188
sim_compute_performance-ego_max0.004220055171421596
sim_compute_performance-ego_mean0.004145605393828467
sim_compute_performance-ego_median0.0041495434288839695
sim_compute_performance-ego_min0.004062516348702567
sim_compute_robot_state-ego_max0.005351452393965288
sim_compute_robot_state-ego_mean0.005283377822963153
sim_compute_robot_state-ego_median0.005314300855000814
sim_compute_robot_state-ego_min0.005163454861374375
sim_compute_sim_state_max0.003172134558359782
sim_compute_sim_state_mean0.003128095600067514
sim_compute_sim_state_median0.003139702933175223
sim_compute_sim_state_min0.00307768620319248
sim_physics_max0.059891366958618165
sim_physics_mean0.057128113832379625
sim_physics_median0.056907182894878505
sim_physics_min0.05551984866460164
sim_render-ego_max0.007814789613087972
sim_render-ego_mean0.007466212134460871
sim_render-ego_median0.007407512479615443
sim_render-ego_min0.0072344779968261715
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.930000000000007
survival_time_min2.7499999999999982
No reset possible
294175766Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:14:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.061300902715642
survival_time_median6.749999999999984
deviation-center-line_median0.5142849263226906
in-drivable-lane_median0.3999999999999986


other stats
agent_compute-ego_max0.031361095283342445
agent_compute-ego_mean0.02307035593924746
agent_compute-ego_median0.02149873688107445
agent_compute-ego_min0.020994067192077637
deviation-center-line_max0.887078961585252
deviation-center-line_mean0.48196833092776514
deviation-center-line_min0.11168559029483097
deviation-heading_max4.299195591081555
deviation-heading_mean2.092764431203359
deviation-heading_median1.8408090323652495
deviation-heading_min0.47149379134543695
driven_any_max4.759456628653243
driven_any_mean2.7225459127799847
driven_any_median2.3847697086568447
driven_any_min1.10018829253065
driven_lanedir_consec_max4.362396728896423
driven_lanedir_consec_mean2.376839886405949
driven_lanedir_consec_min0.7301277142272848
driven_lanedir_max4.362396728896423
driven_lanedir_mean2.376839886405949
driven_lanedir_median2.061300902715642
driven_lanedir_min0.7301277142272848
in-drivable-lane_max2.250000000000025
in-drivable-lane_mean0.5800000000000016
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3682254768378983, "sim_physics": 0.077621649140897, "survival_time": 4.599999999999992, "driven_lanedir": 1.3152552358783427, "sim_render-ego": 0.00942388047342715, "in-drivable-lane": 0, "agent_compute-ego": 0.031361095283342445, "deviation-heading": 1.0287207804371, "set_robot_commands": 0.007447022458781366, "deviation-center-line": 0.20660065526576843, "driven_lanedir_consec": 1.3152552358783427, "sim_compute_sim_state": 0.003912586232890253, "sim_compute_performance-ego": 0.005646148453588071, "sim_compute_robot_state-ego": 0.006875102934630021}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.658105282754998, "sim_physics": 0.0823332009492097, "survival_time": 6.749999999999984, "driven_lanedir": 2.520934540156196, "sim_render-ego": 0.010040673503169308, "in-drivable-lane": 0, "agent_compute-ego": 0.029500738779703776, "deviation-heading": 1.8149206518629035, "set_robot_commands": 0.007551011332759151, "deviation-center-line": 0.6179406982386756, "driven_lanedir_consec": 2.520934540156196, "sim_compute_sim_state": 0.004095628526475694, "sim_compute_performance-ego": 0.005555507871839735, "sim_compute_robot_state-ego": 0.007248498775340893}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.327852409529956, "sim_physics": 0.07150338944934663, "survival_time": 7.349999999999982, "driven_lanedir": 2.061300902715642, "sim_render-ego": 0.009161652350912288, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.02767925684143897, "deviation-heading": 1.8408090323652495, "set_robot_commands": 0.007053933176053625, "deviation-center-line": 0.3583334865219615, "driven_lanedir_consec": 2.061300902715642, "sim_compute_sim_state": 0.00386772026010111, "sim_compute_performance-ego": 0.005288260323660714, "sim_compute_robot_state-ego": 0.006706302668772588}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7011776015410494, "sim_physics": 0.056433544945471065, "survival_time": 4.849999999999991, "driven_lanedir": 1.2608374059042955, "sim_render-ego": 0.007316454169676476, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.021812812569215127, "deviation-heading": 0.47149379134543695, "set_robot_commands": 0.005244813014551536, "deviation-center-line": 0.11168559029483097, "driven_lanedir_consec": 1.2608374059042955, "sim_compute_sim_state": 0.0030704060780633357, "sim_compute_performance-ego": 0.0041151562916863825, "sim_compute_robot_state-ego": 0.005199240655014196}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3847697086568447, "sim_physics": 0.05689111622897061, "survival_time": 6.0499999999999865, "driven_lanedir": 1.967121979098632, "sim_render-ego": 0.007280509333965207, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.021914909693820418, "deviation-heading": 1.680272579390054, "set_robot_commands": 0.0052823547489386944, "deviation-center-line": 0.33830257638126726, "driven_lanedir_consec": 1.967121979098632, "sim_compute_sim_state": 0.0031297837407135765, "sim_compute_performance-ego": 0.004076441457448912, "sim_compute_robot_state-ego": 0.005181141136106381}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.10018829253065, "sim_physics": 0.053092801570892335, "survival_time": 3.999999999999994, "driven_lanedir": 0.7301277142272848, "sim_render-ego": 0.007206383347511292, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.020994067192077637, "deviation-heading": 0.7973363027885213, "set_robot_commands": 0.005221119523048401, "deviation-center-line": 0.16179855172149013, "driven_lanedir_consec": 0.7301277142272848, "sim_compute_sim_state": 0.0030169129371643067, "sim_compute_performance-ego": 0.00405484139919281, "sim_compute_robot_state-ego": 0.005107277631759643}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.996670026524655, "sim_physics": 0.05614243045685783, "survival_time": 6.299999999999986, "driven_lanedir": 1.8677987749269105, "sim_render-ego": 0.007219649496532622, "in-drivable-lane": 0, "agent_compute-ego": 0.02149873688107445, "deviation-heading": 1.9680347092434003, "set_robot_commands": 0.005267300303020175, "deviation-center-line": 0.5142849263226906, "driven_lanedir_consec": 1.8677987749269105, "sim_compute_sim_state": 0.003055551695445227, "sim_compute_performance-ego": 0.004080172569032699, "sim_compute_robot_state-ego": 0.0051994891393752326}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.4270310716652075, "sim_physics": 0.05816063178437097, "survival_time": 11.200000000000024, "driven_lanedir": 2.9732730653069943, "sim_render-ego": 0.007295274308749608, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.021339605961527144, "deviation-heading": 3.5281467416432664, "set_robot_commands": 0.005203579153333392, "deviation-center-line": 0.7252650848445111, "driven_lanedir_consec": 2.9732730653069943, "sim_compute_sim_state": 0.003137265997273581, "sim_compute_performance-ego": 0.004163133246558053, "sim_compute_robot_state-ego": 0.0052461134535925725}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4842629203543525, "sim_physics": 0.05597514119641534, "survival_time": 4.3499999999999925, "driven_lanedir": 0.807795036032991, "sim_render-ego": 0.00732743877103959, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.0213368925554999, "deviation-heading": 1.228686564522489, "set_robot_commands": 0.0053090254465738935, "deviation-center-line": 0.18181796236013412, "driven_lanedir_consec": 0.807795036032991, "sim_compute_sim_state": 0.003121663784158641, "sim_compute_performance-ego": 0.0040783471074597585, "sim_compute_robot_state-ego": 0.005208582713686186}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.1965567972978746, "sim_physics": 0.05509789784749349, "survival_time": 12.450000000000042, "driven_lanedir": 2.7313391358401806, "sim_render-ego": 0.007189774608995062, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.02158544341244372, "deviation-heading": 2.97154703774655, "set_robot_commands": 0.0053060380330526204, "deviation-center-line": 0.7005524547475747, "driven_lanedir_consec": 2.7313391358401806, "sim_compute_sim_state": 0.003095406605057927, "sim_compute_performance-ego": 0.004119871131866333, "sim_compute_robot_state-ego": 0.005203444316205251}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.047104333532528, "sim_physics": 0.05699472427368164, "survival_time": 14.950000000000076, "driven_lanedir": 4.003407880435277, "sim_render-ego": 0.007178440093994141, "in-drivable-lane": 0, "agent_compute-ego": 0.02112579107284546, "deviation-heading": 1.9166187785161064, "set_robot_commands": 0.0051170770327250165, "deviation-center-line": 0.5541248281971334, "driven_lanedir_consec": 4.003407880435277, "sim_compute_sim_state": 0.003053124745686849, "sim_compute_performance-ego": 0.0040413443247477214, "sim_compute_robot_state-ego": 0.005161327521006266}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.5185586167986465, "sim_physics": 0.05412990808486939, "survival_time": 14.950000000000076, "driven_lanedir": 4.362396728896423, "sim_render-ego": 0.0071921809514363605, "in-drivable-lane": 0, "agent_compute-ego": 0.021255850791931152, "deviation-heading": 3.306063366740821, "set_robot_commands": 0.005214587847391764, "deviation-center-line": 0.7874276117941013, "driven_lanedir_consec": 4.362396728896423, "sim_compute_sim_state": 0.003092180093129476, "sim_compute_performance-ego": 0.004065768718719482, "sim_compute_robot_state-ego": 0.005180604457855224}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.901875230882852, "sim_physics": 0.05814523563206753, "survival_time": 5.349999999999989, "driven_lanedir": 1.6957928319168143, "sim_render-ego": 0.007393645348949967, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.02191471385064526, "deviation-heading": 1.2548204142724015, "set_robot_commands": 0.005299213890717408, "deviation-center-line": 0.2562495452494377, "driven_lanedir_consec": 1.6957928319168143, "sim_compute_sim_state": 0.0032011259382016192, "sim_compute_performance-ego": 0.004156342176633461, "sim_compute_robot_state-ego": 0.00532903626700428}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.759456628653243, "sim_physics": 0.05642339992190903, "survival_time": 14.350000000000067, "driven_lanedir": 3.5750052791750844, "sim_render-ego": 0.0071397251368399695, "in-drivable-lane": 2.250000000000025, "agent_compute-ego": 0.021424001932974893, "deviation-heading": 4.299195591081555, "set_robot_commands": 0.00521841697161206, "deviation-center-line": 0.887078961585252, "driven_lanedir_consec": 3.5750052791750844, "sim_compute_sim_state": 0.003096814770316413, "sim_compute_performance-ego": 0.004077196951942577, "sim_compute_robot_state-ego": 0.005188599696142748}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.9663542941390095, "sim_physics": 0.05595639676463847, "survival_time": 12.25000000000004, "driven_lanedir": 3.780211785578164, "sim_render-ego": 0.007190461061438736, "in-drivable-lane": 0, "agent_compute-ego": 0.021311422270171496, "deviation-heading": 3.28480012609453, "set_robot_commands": 0.005196520746970663, "deviation-center-line": 0.828062030391647, "driven_lanedir_consec": 3.780211785578164, "sim_compute_sim_state": 0.003076250699101662, "sim_compute_performance-ego": 0.0040878344555290375, "sim_compute_robot_state-ego": 0.005171500420083805}}
set_robot_commands_max0.007551011332759151
set_robot_commands_mean0.0056621342453019845
set_robot_commands_median0.005267300303020175
set_robot_commands_min0.0051170770327250165
sim_compute_performance-ego_max0.005646148453588071
sim_compute_performance-ego_mean0.00437375776532705
sim_compute_performance-ego_median0.0040878344555290375
sim_compute_performance-ego_min0.0040413443247477214
sim_compute_robot_state-ego_max0.007248498775340893
sim_compute_robot_state-ego_mean0.005547084119105019
sim_compute_robot_state-ego_median0.0051994891393752326
sim_compute_robot_state-ego_min0.005107277631759643
sim_compute_sim_state_max0.004095628526475694
sim_compute_sim_state_mean0.0032681614735853115
sim_compute_sim_state_median0.003096814770316413
sim_compute_sim_state_min0.0030169129371643067
sim_physics_max0.0823332009492097
sim_physics_mean0.060326764549806074
sim_physics_median0.056433544945471065
sim_physics_min0.053092801570892335
sim_render-ego_max0.010040673503169308
sim_render-ego_mean0.0077037428637758525
sim_render-ego_median0.007280509333965207
sim_render-ego_min0.0071397251368399695
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.650000000000015
survival_time_min3.999999999999994
No reset possible
293985764Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4033640186484666
survival_time_median9.850000000000003
deviation-center-line_median0.4992585128340692
in-drivable-lane_median0


other stats
agent_compute-ego_max0.035853730845572376
agent_compute-ego_mean0.030954055864977535
agent_compute-ego_median0.03218509600712703
agent_compute-ego_min0.024397185508241045
deviation-center-line_max1.0449801279239068
deviation-center-line_mean0.5179094350080583
deviation-center-line_min0.17919927580254308
deviation-heading_max3.2814406972103844
deviation-heading_mean2.091757461063953
deviation-heading_median2.488196320628202
deviation-heading_min0.8662231536614352
driven_any_max4.450475693382524
driven_any_mean2.699525334885272
driven_any_median2.933872868856894
driven_any_min1.222622326116489
driven_lanedir_consec_max4.281350633853827
driven_lanedir_consec_mean2.39607098603415
driven_lanedir_consec_min1.167216497308173
driven_lanedir_max4.281350633853827
driven_lanedir_mean2.398440329908029
driven_lanedir_median2.415210738017864
driven_lanedir_min1.167216497308173
in-drivable-lane_max1.3500000000000192
in-drivable-lane_mean0.5200000000000061
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.409951620028686, "sim_physics": 0.0663991963609736, "survival_time": 4.699999999999991, "driven_lanedir": 1.3653417422601524, "sim_render-ego": 0.008044055167664873, "in-drivable-lane": 0, "agent_compute-ego": 0.024397185508241045, "deviation-heading": 1.0527731131351103, "set_robot_commands": 0.00600114274532237, "deviation-center-line": 0.17919927580254308, "driven_lanedir_consec": 1.3653417422601524, "sim_compute_sim_state": 0.003325261968247434, "sim_compute_performance-ego": 0.004748192239314952, "sim_compute_robot_state-ego": 0.005717850745992458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.222622326116489, "sim_physics": 0.08991815126859225, "survival_time": 3.2499999999999964, "driven_lanedir": 1.167216497308173, "sim_render-ego": 0.01038194436293382, "in-drivable-lane": 0, "agent_compute-ego": 0.03218509600712703, "deviation-heading": 0.8662231536614352, "set_robot_commands": 0.008356222739586463, "deviation-center-line": 0.2454378837267009, "driven_lanedir_consec": 1.167216497308173, "sim_compute_sim_state": 0.004266874606792743, "sim_compute_performance-ego": 0.005893835654625526, "sim_compute_robot_state-ego": 0.007487726211547851}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.450475693382524, "sim_physics": 0.07509692430496216, "survival_time": 14.950000000000076, "driven_lanedir": 4.281350633853827, "sim_render-ego": 0.010271992683410645, "in-drivable-lane": 0, "agent_compute-ego": 0.029274882475535075, "deviation-heading": 3.2814406972103844, "set_robot_commands": 0.007504460811614991, "deviation-center-line": 1.0449801279239068, "driven_lanedir_consec": 4.281350633853827, "sim_compute_sim_state": 0.004036227067311605, "sim_compute_performance-ego": 0.005624099572499593, "sim_compute_robot_state-ego": 0.007055388291676839}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4807041660417664, "sim_physics": 0.09249090543253168, "survival_time": 9.850000000000003, "driven_lanedir": 2.763082038100128, "sim_render-ego": 0.01083882811105796, "in-drivable-lane": 1.2500000000000115, "agent_compute-ego": 0.035853730845572376, "deviation-heading": 2.488196320628202, "set_robot_commands": 0.00880974077331233, "deviation-center-line": 0.4992585128340692, "driven_lanedir_consec": 2.763082038100128, "sim_compute_sim_state": 0.0044640962242475015, "sim_compute_performance-ego": 0.006312551837282132, "sim_compute_robot_state-ego": 0.007948595860282782}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.933872868856894, "sim_physics": 0.08103562588065998, "survival_time": 11.050000000000022, "driven_lanedir": 2.415210738017864, "sim_render-ego": 0.010259144985837637, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.033059384488412155, "deviation-heading": 2.770154020684632, "set_robot_commands": 0.007744678005373856, "deviation-center-line": 0.6206713747530718, "driven_lanedir_consec": 2.4033640186484666, "sim_compute_sim_state": 0.004210158171157491, "sim_compute_performance-ego": 0.005944967269897461, "sim_compute_robot_state-ego": 0.00731045196498681}}
set_robot_commands_max0.00880974077331233
set_robot_commands_mean0.007683249015042001
set_robot_commands_median0.007744678005373856
set_robot_commands_min0.00600114274532237
sim_compute_performance-ego_max0.006312551837282132
sim_compute_performance-ego_mean0.005704729314723933
sim_compute_performance-ego_median0.005893835654625526
sim_compute_performance-ego_min0.004748192239314952
sim_compute_robot_state-ego_max0.007948595860282782
sim_compute_robot_state-ego_mean0.007104002614897348
sim_compute_robot_state-ego_median0.00731045196498681
sim_compute_robot_state-ego_min0.005717850745992458
sim_compute_sim_state_max0.0044640962242475015
sim_compute_sim_state_mean0.004060523607551355
sim_compute_sim_state_median0.004210158171157491
sim_compute_sim_state_min0.003325261968247434
sim_physics_max0.09249090543253168
sim_physics_mean0.08098816064954394
sim_physics_median0.08103562588065998
sim_physics_min0.0663991963609736
sim_render-ego_max0.01083882811105796
sim_render-ego_mean0.009959193062180984
sim_render-ego_median0.010271992683410645
sim_render-ego_min0.008044055167664873
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.76000000000002
survival_time_min3.2499999999999964
No reset possible
293795750Mikita Sazanovich 🇷🇺chameleon-10-jjluaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:03:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
293565740Robert Moni 🇭🇺almasip-6824aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:09:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6217238301527512
survival_time_median14.950000000000076
deviation-center-line_median0.8925404368703276
in-drivable-lane_median1.8500000000000147


other stats
agent_compute-ego_max0.03748267571131388
agent_compute-ego_mean0.033584437688191734
agent_compute-ego_median0.0326417867342631
agent_compute-ego_min0.032152140935262044
deviation-center-line_max1.172254478139454
deviation-center-line_mean0.8230411325939118
deviation-center-line_min0.18674902489096593
deviation-heading_max10.133227088087676
deviation-heading_mean7.033921942807171
deviation-heading_median8.36125113886661
deviation-heading_min1.556317470492511
driven_any_max1.9457633242796883
driven_any_mean1.6526227272874194
driven_any_median1.9291506605847275
driven_any_min0.5201189752259536
driven_lanedir_consec_max1.1111131799494656
driven_lanedir_consec_mean0.6469441169407373
driven_lanedir_consec_min0.1391746857248506
driven_lanedir_max1.3960121874247569
driven_lanedir_mean0.9630241736015068
driven_lanedir_median1.090583748974898
driven_lanedir_min0.1633257962372212
in-drivable-lane_max4.750000000000022
in-drivable-lane_mean2.220000000000008
in-drivable-lane_min0.7999999999999972
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9457633242796883, "sim_physics": 0.07310777505238851, "survival_time": 14.950000000000076, "driven_lanedir": 1.1874500264967, "sim_render-ego": 0.009160838921864829, "in-drivable-lane": 1.8500000000000147, "agent_compute-ego": 0.0326417867342631, "deviation-heading": 9.00350643178266, "set_robot_commands": 0.006772251923878988, "deviation-center-line": 0.7938240809216721, "driven_lanedir_consec": 0.6217238301527512, "sim_compute_sim_state": 0.003960669835408529, "sim_compute_performance-ego": 0.005471156438191732, "sim_compute_robot_state-ego": 0.006774284839630127}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9291221985752147, "sim_physics": 0.08283091147740682, "survival_time": 14.950000000000076, "driven_lanedir": 1.3960121874247569, "sim_render-ego": 0.0101475723584493, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.03748267571131388, "deviation-heading": 8.36125113886661, "set_robot_commands": 0.008058214982350667, "deviation-center-line": 1.069837642147139, "driven_lanedir_consec": 1.1111131799494656, "sim_compute_sim_state": 0.004330209891001384, "sim_compute_performance-ego": 0.005946478843688965, "sim_compute_robot_state-ego": 0.007390902837117513}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9291506605847275, "sim_physics": 0.07387290716171264, "survival_time": 14.950000000000076, "driven_lanedir": 0.9777491088739576, "sim_render-ego": 0.008970898787180583, "in-drivable-lane": 4.750000000000022, "agent_compute-ego": 0.032152140935262044, "deviation-heading": 6.115307584806401, "set_robot_commands": 0.006951100031534831, "deviation-center-line": 1.172254478139454, "driven_lanedir_consec": 0.7668490079359178, "sim_compute_sim_state": 0.004039125442504883, "sim_compute_performance-ego": 0.00535830815633138, "sim_compute_robot_state-ego": 0.006632575194040934}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5201189752259536, "sim_physics": 0.07280280760356359, "survival_time": 4.199999999999993, "driven_lanedir": 0.1633257962372212, "sim_render-ego": 0.008658644698915027, "in-drivable-lane": 1.999999999999994, "agent_compute-ego": 0.03261806567509969, "deviation-heading": 1.556317470492511, "set_robot_commands": 0.006912887096405029, "deviation-center-line": 0.18674902489096593, "driven_lanedir_consec": 0.1391746857248506, "sim_compute_sim_state": 0.003880452542077927, "sim_compute_performance-ego": 0.004920965149289086, "sim_compute_robot_state-ego": 0.006180107593536377}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9389584777715128, "sim_physics": 0.07390139897664388, "survival_time": 14.950000000000076, "driven_lanedir": 1.090583748974898, "sim_render-ego": 0.00938928524653117, "in-drivable-lane": 1.7000000000000115, "agent_compute-ego": 0.03302751938501994, "deviation-heading": 10.133227088087676, "set_robot_commands": 0.007192957401275635, "deviation-center-line": 0.8925404368703276, "driven_lanedir_consec": 0.5958598809407014, "sim_compute_sim_state": 0.004249577522277832, "sim_compute_performance-ego": 0.005491085847218831, "sim_compute_robot_state-ego": 0.006846091747283936}}
set_robot_commands_max0.008058214982350667
set_robot_commands_mean0.00717748228708903
set_robot_commands_median0.006951100031534831
set_robot_commands_min0.006772251923878988
sim_compute_performance-ego_max0.005946478843688965
sim_compute_performance-ego_mean0.0054375988869439975
sim_compute_performance-ego_median0.005471156438191732
sim_compute_performance-ego_min0.004920965149289086
sim_compute_robot_state-ego_max0.007390902837117513
sim_compute_robot_state-ego_mean0.006764792442321778
sim_compute_robot_state-ego_median0.006774284839630127
sim_compute_robot_state-ego_min0.006180107593536377
sim_compute_sim_state_max0.004330209891001384
sim_compute_sim_state_mean0.004092007046654111
sim_compute_sim_state_median0.004039125442504883
sim_compute_sim_state_min0.003880452542077927
sim_physics_max0.08283091147740682
sim_physics_mean0.0753031600543431
sim_physics_median0.07387290716171264
sim_physics_min0.07280280760356359
sim_render-ego_max0.0101475723584493
sim_render-ego_mean0.00926544800258818
sim_render-ego_median0.009160838921864829
sim_render-ego_min0.008658644698915027
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.800000000000065
survival_time_min4.199999999999993
No reset possible
293475729Robert Moni 🇭🇺almasip-6824aido3-LFV-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:08:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
293455728Robert Moni 🇭🇺almasip-6824aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5482477176564085
survival_time_median14.950000000000076
deviation-center-line_median0.8384086141897953
in-drivable-lane_median1.2000000000000073


other stats
agent_compute-ego_max0.03417217095692952
agent_compute-ego_mean0.03297561888467698
agent_compute-ego_median0.03312832752863566
agent_compute-ego_min0.031064791906447637
deviation-center-line_max1.423031636454494
deviation-center-line_mean0.7410000070007229
deviation-center-line_min0.22212281271910017
deviation-heading_max9.94923634392461
deviation-heading_mean5.2452769943915545
deviation-heading_median2.5315115612093817
deviation-heading_min1.939415514125011
driven_any_max1.9407472089811677
driven_any_mean1.389089532242027
driven_any_median1.929143720451552
driven_any_min0.48615708921995165
driven_lanedir_consec_max1.1209446889393924
driven_lanedir_consec_mean0.5620185724319551
driven_lanedir_consec_min0.1392379920522655
driven_lanedir_max1.2412574457915198
driven_lanedir_mean0.8231132036690212
driven_lanedir_median1.1209446889393924
driven_lanedir_min0.23188529660701085
in-drivable-lane_max5.700000000000009
in-drivable-lane_mean2.130000000000003
in-drivable-lane_min1.149999999999997
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9382472318580848, "sim_physics": 0.06980329910914103, "survival_time": 14.950000000000076, "driven_lanedir": 1.2412574457915198, "sim_render-ego": 0.008360142707824708, "in-drivable-lane": 1.2000000000000073, "agent_compute-ego": 0.03312832752863566, "deviation-heading": 9.406847284209906, "set_robot_commands": 0.006769920190175374, "deviation-center-line": 0.8384086141897953, "driven_lanedir_consec": 0.7053833654358511, "sim_compute_sim_state": 0.003841256300608317, "sim_compute_performance-ego": 0.004987577597300212, "sim_compute_robot_state-ego": 0.006173545519510905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9407472089811677, "sim_physics": 0.07573686520258585, "survival_time": 14.950000000000076, "driven_lanedir": 1.156459297848487, "sim_render-ego": 0.010005905628204343, "in-drivable-lane": 1.4000000000000048, "agent_compute-ego": 0.03417217095692952, "deviation-heading": 9.94923634392461, "set_robot_commands": 0.006891067028045654, "deviation-center-line": 0.971778467249733, "driven_lanedir_consec": 0.5482477176564085, "sim_compute_sim_state": 0.003854759534200032, "sim_compute_performance-ego": 0.005160802205403645, "sim_compute_robot_state-ego": 0.006551249027252197}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.929143720451552, "sim_physics": 0.07228990872701009, "survival_time": 14.950000000000076, "driven_lanedir": 1.1209446889393924, "sim_render-ego": 0.00895180861155192, "in-drivable-lane": 5.700000000000009, "agent_compute-ego": 0.03266028642654419, "deviation-heading": 2.399374268488866, "set_robot_commands": 0.006923759778340657, "deviation-center-line": 1.423031636454494, "driven_lanedir_consec": 1.1209446889393924, "sim_compute_sim_state": 0.0039818215370178225, "sim_compute_performance-ego": 0.005250633557637533, "sim_compute_robot_state-ego": 0.006625220775604248}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.48615708921995165, "sim_physics": 0.07088910341262818, "survival_time": 3.999999999999994, "driven_lanedir": 0.23188529660701085, "sim_render-ego": 0.008643639087677003, "in-drivable-lane": 1.149999999999997, "agent_compute-ego": 0.03385251760482788, "deviation-heading": 1.939415514125011, "set_robot_commands": 0.006731390953063965, "deviation-center-line": 0.22212281271910017, "driven_lanedir_consec": 0.1392379920522655, "sim_compute_sim_state": 0.0035466372966766356, "sim_compute_performance-ego": 0.00493912398815155, "sim_compute_robot_state-ego": 0.006259632110595703}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6511524106993779, "sim_physics": 0.071308810370309, "survival_time": 5.249999999999989, "driven_lanedir": 0.3650192891586961, "sim_render-ego": 0.00941004298982166, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.031064791906447637, "deviation-heading": 2.5315115612093817, "set_robot_commands": 0.006985712051391602, "deviation-center-line": 0.24965850439049175, "driven_lanedir_consec": 0.29627909807585806, "sim_compute_sim_state": 0.003853570847284226, "sim_compute_performance-ego": 0.005476424807593936, "sim_compute_robot_state-ego": 0.006768033618018741}}
set_robot_commands_max0.006985712051391602
set_robot_commands_mean0.00686037000020345
set_robot_commands_median0.006891067028045654
set_robot_commands_min0.006731390953063965
sim_compute_performance-ego_max0.005476424807593936
sim_compute_performance-ego_mean0.005162912431217376
sim_compute_performance-ego_median0.005160802205403645
sim_compute_performance-ego_min0.00493912398815155
sim_compute_robot_state-ego_max0.006768033618018741
sim_compute_robot_state-ego_mean0.006475536210196359
sim_compute_robot_state-ego_median0.006551249027252197
sim_compute_robot_state-ego_min0.006173545519510905
sim_compute_sim_state_max0.0039818215370178225
sim_compute_sim_state_mean0.0038156091031574064
sim_compute_sim_state_median0.003853570847284226
sim_compute_sim_state_min0.0035466372966766356
sim_physics_max0.07573686520258585
sim_physics_mean0.07200559736433483
sim_physics_median0.071308810370309
sim_physics_min0.06980329910914103
sim_render-ego_max0.010005905628204343
sim_render-ego_mean0.009074307805015927
sim_render-ego_median0.00895180861155192
sim_render-ego_min0.008360142707824708
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.820000000000045
survival_time_min3.999999999999994
No reset possible
292315672Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2736718037452257
survival_time_median12.450000000000042
deviation-center-line_median0.47869800645646926
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03175214767456055
agent_compute-ego_mean0.0280550486093236
agent_compute-ego_median0.028197770137863464
agent_compute-ego_min0.025100903077559036
deviation-center-line_max0.943677686717042
deviation-center-line_mean0.5529992664023988
deviation-center-line_min0.23019940016341223
deviation-heading_max4.236418754469099
deviation-heading_mean2.4062232490127897
deviation-heading_median1.9320167852180927
deviation-heading_min0.7943034834911198
driven_any_max4.228446527298262
driven_any_mean3.038431547881422
driven_any_median3.7550262211925607
driven_any_min1.243592825206449
driven_lanedir_consec_max4.040153448204045
driven_lanedir_consec_mean2.8681684374813226
driven_lanedir_consec_min1.1986352937605151
driven_lanedir_max4.040153448204045
driven_lanedir_mean2.8681684374813226
driven_lanedir_median3.2736718037452257
driven_lanedir_min1.1986352937605151
in-drivable-lane_max0.4000000000000057
in-drivable-lane_mean0.08000000000000114
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.7550262211925607, "sim_physics": 0.07405551657619247, "survival_time": 12.450000000000042, "driven_lanedir": 3.2736718037452257, "sim_render-ego": 0.009072187913948274, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.028197770137863464, "deviation-heading": 4.236418754469099, "set_robot_commands": 0.007340435043396241, "deviation-center-line": 0.7605211549717721, "driven_lanedir_consec": 3.2736718037452257, "sim_compute_sim_state": 0.0037539780858051345, "sim_compute_performance-ego": 0.00525837250981465, "sim_compute_robot_state-ego": 0.006868449559652183}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.243592825206449, "sim_physics": 0.06736073710701683, "survival_time": 3.2999999999999963, "driven_lanedir": 1.1986352937605151, "sim_render-ego": 0.008091424450729832, "in-drivable-lane": 0, "agent_compute-ego": 0.025100903077559036, "deviation-heading": 0.7943034834911198, "set_robot_commands": 0.00627519145156398, "deviation-center-line": 0.23019940016341223, "driven_lanedir_consec": 1.1986352937605151, "sim_compute_sim_state": 0.003442493352023038, "sim_compute_performance-ego": 0.004519231391675545, "sim_compute_robot_state-ego": 0.005746971477161755}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.81071027956904, "sim_physics": 0.0779662299156189, "survival_time": 14.950000000000076, "driven_lanedir": 3.773509511516232, "sim_render-ego": 0.009688135782877604, "in-drivable-lane": 0, "agent_compute-ego": 0.03175214767456055, "deviation-heading": 1.9320167852180927, "set_robot_commands": 0.007721610864003499, "deviation-center-line": 0.47869800645646926, "driven_lanedir_consec": 3.773509511516232, "sim_compute_sim_state": 0.004086003303527832, "sim_compute_performance-ego": 0.005569670995076497, "sim_compute_robot_state-ego": 0.0071310671170552575}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.228446527298262, "sim_physics": 0.08035626888275146, "survival_time": 14.950000000000076, "driven_lanedir": 4.040153448204045, "sim_render-ego": 0.010108222166697184, "in-drivable-lane": 0, "agent_compute-ego": 0.02952416737874349, "deviation-heading": 3.575689202029885, "set_robot_commands": 0.008308226267496745, "deviation-center-line": 0.943677686717042, "driven_lanedir_consec": 4.040153448204045, "sim_compute_sim_state": 0.004136932690938314, "sim_compute_performance-ego": 0.005843510627746582, "sim_compute_robot_state-ego": 0.007298285961151123}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1543818861407966, "sim_physics": 0.06961762166656224, "survival_time": 5.649999999999988, "driven_lanedir": 2.0548721301805943, "sim_render-ego": 0.00870246380831288, "in-drivable-lane": 0, "agent_compute-ego": 0.025700254777891444, "deviation-heading": 1.4926880198557526, "set_robot_commands": 0.006986181292913656, "deviation-center-line": 0.35190008370329884, "driven_lanedir_consec": 2.0548721301805943, "sim_compute_sim_state": 0.0035713837210056003, "sim_compute_performance-ego": 0.004876267593518823, "sim_compute_robot_state-ego": 0.006121017236625199}}
set_robot_commands_max0.008308226267496745
set_robot_commands_mean0.007326328983874824
set_robot_commands_median0.007340435043396241
set_robot_commands_min0.00627519145156398
sim_compute_performance-ego_max0.005843510627746582
sim_compute_performance-ego_mean0.00521341062356642
sim_compute_performance-ego_median0.00525837250981465
sim_compute_performance-ego_min0.004519231391675545
sim_compute_robot_state-ego_max0.007298285961151123
sim_compute_robot_state-ego_mean0.006633158270329104
sim_compute_robot_state-ego_median0.006868449559652183
sim_compute_robot_state-ego_min0.005746971477161755
sim_compute_sim_state_max0.004136932690938314
sim_compute_sim_state_mean0.003798158230659984
sim_compute_sim_state_median0.0037539780858051345
sim_compute_sim_state_min0.003442493352023038
sim_physics_max0.08035626888275146
sim_physics_mean0.07387127482962838
sim_physics_median0.07405551657619247
sim_physics_min0.06736073710701683
sim_render-ego_max0.010108222166697184
sim_render-ego_mean0.009132486824513156
sim_render-ego_median0.009072187913948274
sim_render-ego_min0.008091424450729832
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.260000000000035
survival_time_min3.2999999999999963
No reset possible
292255669Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7074358939578467
survival_time_median9.4
deviation-center-line_median0.5850545628987228
in-drivable-lane_median0.3000000000000007


other stats
agent_compute-ego_max0.021302722870035373
agent_compute-ego_mean0.021056185524569872
agent_compute-ego_median0.020957391262054443
agent_compute-ego_min0.020887972248925104
deviation-center-line_max0.719449566096961
deviation-center-line_mean0.5135707606640291
deviation-center-line_min0.21920950708061587
deviation-heading_max3.4207828225839725
deviation-heading_mean2.105287857432548
deviation-heading_median2.384723784112056
deviation-heading_min0.7538091537763429
driven_any_max4.515773417809775
driven_any_mean3.0501689266894205
driven_any_median2.9767355065482013
driven_any_min1.3017983805666578
driven_lanedir_consec_max4.224830598612722
driven_lanedir_consec_mean2.7348023019505976
driven_lanedir_consec_min1.2562178451767456
driven_lanedir_max4.224830598612722
driven_lanedir_mean2.7348023019505976
driven_lanedir_median2.7074358939578467
driven_lanedir_min1.2562178451767456
in-drivable-lane_max1.399999999999995
in-drivable-lane_mean0.5000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9767355065482013, "sim_physics": 0.05704810137444354, "survival_time": 9.4, "driven_lanedir": 2.7074358939578467, "sim_render-ego": 0.007111915882597578, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.021302722870035373, "deviation-heading": 2.384723784112056, "set_robot_commands": 0.005252590838899004, "deviation-center-line": 0.5850545628987228, "driven_lanedir_consec": 2.7074358939578467, "sim_compute_sim_state": 0.002967616345020051, "sim_compute_performance-ego": 0.004199673520757797, "sim_compute_robot_state-ego": 0.005104204441638703}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3017983805666578, "sim_physics": 0.05678815022110939, "survival_time": 3.1999999999999966, "driven_lanedir": 1.2562178451767456, "sim_render-ego": 0.007180631160736084, "in-drivable-lane": 0, "agent_compute-ego": 0.020952459424734116, "deviation-heading": 0.7538091537763429, "set_robot_commands": 0.00515366718173027, "deviation-center-line": 0.21920950708061587, "driven_lanedir_consec": 1.2562178451767456, "sim_compute_sim_state": 0.002905774861574173, "sim_compute_performance-ego": 0.004043813794851303, "sim_compute_robot_state-ego": 0.005074389278888702}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.344928547578672, "sim_physics": 0.05377655559115939, "survival_time": 8.999999999999993, "driven_lanedir": 2.050827802127363, "sim_render-ego": 0.007144392861260308, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.020887972248925104, "deviation-heading": 1.3302312536370255, "set_robot_commands": 0.005294452773200141, "deviation-center-line": 0.3519477533482597, "driven_lanedir_consec": 2.050827802127363, "sim_compute_sim_state": 0.0029350386725531686, "sim_compute_performance-ego": 0.0040328012572394475, "sim_compute_robot_state-ego": 0.005020584000481499}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.515773417809775, "sim_physics": 0.05324247201283773, "survival_time": 14.950000000000076, "driven_lanedir": 4.224830598612722, "sim_render-ego": 0.007073148091634115, "in-drivable-lane": 0.3000000000000007, "agent_compute-ego": 0.020957391262054443, "deviation-heading": 3.4207828225839725, "set_robot_commands": 0.005196351210276286, "deviation-center-line": 0.719449566096961, "driven_lanedir_consec": 4.224830598612722, "sim_compute_sim_state": 0.003007408777872721, "sim_compute_performance-ego": 0.004046503702799479, "sim_compute_robot_state-ego": 0.005074193477630615}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.111608780943799, "sim_physics": 0.05589471981588718, "survival_time": 11.300000000000026, "driven_lanedir": 3.434699369878311, "sim_render-ego": 0.007201515467820969, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.021180381817100323, "deviation-heading": 2.636892273053344, "set_robot_commands": 0.005319462413281466, "deviation-center-line": 0.6921924138955861, "driven_lanedir_consec": 3.434699369878311, "sim_compute_sim_state": 0.0030107107837643245, "sim_compute_performance-ego": 0.0041383736956436025, "sim_compute_robot_state-ego": 0.005155413551668151}}
set_robot_commands_max0.005319462413281466
set_robot_commands_mean0.005243304883477433
set_robot_commands_median0.005252590838899004
set_robot_commands_min0.00515366718173027
sim_compute_performance-ego_max0.004199673520757797
sim_compute_performance-ego_mean0.004092233194258326
sim_compute_performance-ego_median0.004046503702799479
sim_compute_performance-ego_min0.0040328012572394475
sim_compute_robot_state-ego_max0.005155413551668151
sim_compute_robot_state-ego_mean0.005085756950061534
sim_compute_robot_state-ego_median0.005074389278888702
sim_compute_robot_state-ego_min0.005020584000481499
sim_compute_sim_state_max0.0030107107837643245
sim_compute_sim_state_mean0.0029653098881568876
sim_compute_sim_state_median0.002967616345020051
sim_compute_sim_state_min0.002905774861574173
sim_physics_max0.05704810137444354
sim_physics_mean0.05534999980308745
sim_physics_median0.05589471981588718
sim_physics_min0.05324247201283773
sim_render-ego_max0.007201515467820969
sim_render-ego_mean0.007142320692809812
sim_render-ego_median0.007144392861260308
sim_render-ego_min0.007073148091634115
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.570000000000018
survival_time_min3.1999999999999966
No reset possible
292245668Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8048587833835112
survival_time_median5.349999999999989
deviation-center-line_median0.31340166100303324
in-drivable-lane_median0.5500000000000003


other stats
agent_compute-ego_max0.021599467311586653
agent_compute-ego_mean0.021216928111433143
agent_compute-ego_median0.02129733719323811
agent_compute-ego_min0.02078761112305426
deviation-center-line_max0.6546420370588042
deviation-center-line_mean0.34196044164132955
deviation-center-line_min0.16014418538019562
deviation-heading_max2.668260693795835
deviation-heading_mean1.50470517321406
deviation-heading_median1.4079792314954809
deviation-heading_min0.8232322734799902
driven_any_max4.199930169631086
driven_any_mean2.258986672710423
driven_any_median1.9990358085451652
driven_any_min1.0302966773794031
driven_lanedir_consec_max3.103778503788963
driven_lanedir_consec_mean1.8130867385057816
driven_lanedir_consec_min0.7559676848775407
driven_lanedir_max3.103778503788963
driven_lanedir_mean1.8130867385057816
driven_lanedir_median1.8048587833835112
driven_lanedir_min0.7559676848775407
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean0.7800000000000049
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9990358085451652, "sim_physics": 0.057191325125293194, "survival_time": 5.349999999999989, "driven_lanedir": 1.8048587833835112, "sim_render-ego": 0.007215306023570979, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.021410409535203023, "deviation-heading": 1.4079792314954809, "set_robot_commands": 0.005197647576020143, "deviation-center-line": 0.31340166100303324, "driven_lanedir_consec": 1.8048587833835112, "sim_compute_sim_state": 0.0028756155031863773, "sim_compute_performance-ego": 0.004236098761870482, "sim_compute_robot_state-ego": 0.005126788237384546}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1085571191231445, "sim_physics": 0.05749719909259251, "survival_time": 2.799999999999998, "driven_lanedir": 0.7559676848775407, "sim_render-ego": 0.007277829306466239, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.021599467311586653, "deviation-heading": 0.9698417735840704, "set_robot_commands": 0.0052295369761330745, "deviation-center-line": 0.17246415453708086, "driven_lanedir_consec": 0.7559676848775407, "sim_compute_sim_state": 0.0029411486216953824, "sim_compute_performance-ego": 0.004082939454487392, "sim_compute_robot_state-ego": 0.005101195403507778}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.199930169631086, "sim_physics": 0.05406620713972276, "survival_time": 12.40000000000004, "driven_lanedir": 3.103778503788963, "sim_render-ego": 0.007123754870507025, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.02078761112305426, "deviation-heading": 2.668260693795835, "set_robot_commands": 0.005211659977512975, "deviation-center-line": 0.6546420370588042, "driven_lanedir_consec": 3.103778503788963, "sim_compute_sim_state": 0.0029366958525873, "sim_compute_performance-ego": 0.004029310518695462, "sim_compute_robot_state-ego": 0.005081139264568206}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.9571135888733173, "sim_physics": 0.05595848434849789, "survival_time": 7.599999999999981, "driven_lanedir": 2.433995435171944, "sim_render-ego": 0.00730148428364804, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.02129733719323811, "deviation-heading": 1.6542118937149233, "set_robot_commands": 0.005147979447716161, "deviation-center-line": 0.4091501702275338, "driven_lanedir_consec": 2.433995435171944, "sim_compute_sim_state": 0.0029204268204538445, "sim_compute_performance-ego": 0.004041246677699842, "sim_compute_robot_state-ego": 0.005017824863132678}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0302966773794031, "sim_physics": 0.05754703062551993, "survival_time": 2.6999999999999984, "driven_lanedir": 0.9668332853069496, "sim_render-ego": 0.007342775662740071, "in-drivable-lane": 0, "agent_compute-ego": 0.02098981539408366, "deviation-heading": 0.8232322734799902, "set_robot_commands": 0.005219459533691406, "deviation-center-line": 0.16014418538019562, "driven_lanedir_consec": 0.9668332853069496, "sim_compute_sim_state": 0.002955657464486581, "sim_compute_performance-ego": 0.004029485914442275, "sim_compute_robot_state-ego": 0.005075618072792336}}
set_robot_commands_max0.0052295369761330745
set_robot_commands_mean0.005201256702214751
set_robot_commands_median0.005211659977512975
set_robot_commands_min0.005147979447716161
sim_compute_performance-ego_max0.004236098761870482
sim_compute_performance-ego_mean0.0040838162654390905
sim_compute_performance-ego_median0.004041246677699842
sim_compute_performance-ego_min0.004029310518695462
sim_compute_robot_state-ego_max0.005126788237384546
sim_compute_robot_state-ego_mean0.0050805131682771084
sim_compute_robot_state-ego_median0.005081139264568206
sim_compute_robot_state-ego_min0.005017824863132678
sim_compute_sim_state_max0.002955657464486581
sim_compute_sim_state_mean0.0029259088524818968
sim_compute_sim_state_median0.0029366958525873
sim_compute_sim_state_min0.0028756155031863773
sim_physics_max0.05754703062551993
sim_physics_mean0.05645204926632526
sim_physics_median0.057191325125293194
sim_physics_min0.05406620713972276
sim_render-ego_max0.007342775662740071
sim_render-ego_mean0.007252230029386471
sim_render-ego_median0.007277829306466239
sim_render-ego_min0.007123754870507025
simulation-passed1
survival_time_max12.40000000000004
survival_time_mean6.170000000000002
survival_time_min2.6999999999999984
No reset possible
292065645Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|v3aido3-LF-real-validationeval1-videossuccessnoip-172-31-46-148-104920:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
291775663Riza Velioglu 🇩🇪UniBielefeld-#5aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7820981551555044
survival_time_median11.800000000000033
deviation-center-line_median0.6474492325371318
in-drivable-lane_median2.2500000000000124


other stats
agent_compute-ego_max0.09382355432568884
agent_compute-ego_mean0.06962071226176555
agent_compute-ego_median0.06392581939697266
agent_compute-ego_min0.0631047165071642
deviation-center-line_max0.9035688527781912
deviation-center-line_mean0.5897759471864957
deviation-center-line_min0.2183419677017957
deviation-heading_max3.830496472344368
deviation-heading_mean2.3005413876048975
deviation-heading_median2.949649547988274
deviation-heading_min0.6693289277605265
driven_any_max4.704813406318921
driven_any_mean3.3463085593107804
driven_any_median3.791068674249874
driven_any_min1.0795141633386929
driven_lanedir_consec_max3.8836186313607177
driven_lanedir_consec_mean2.5777360217639145
driven_lanedir_consec_min0.9618470164735692
driven_lanedir_max3.8836186313607177
driven_lanedir_mean2.5777360217639145
driven_lanedir_median2.7820981551555044
driven_lanedir_min0.9618470164735692
in-drivable-lane_max4.3500000000000245
in-drivable-lane_mean2.250000000000011
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.376828742250862, "sim_physics": 0.05473694880803426, "survival_time": 14.950000000000076, "driven_lanedir": 2.9188060703081, "sim_render-ego": 0.0069738817214965824, "in-drivable-lane": 4.3500000000000245, "agent_compute-ego": 0.06392581939697266, "deviation-heading": 3.830496472344368, "set_robot_commands": 0.0050431561470031736, "deviation-center-line": 0.9035688527781912, "driven_lanedir_consec": 2.9188060703081, "sim_compute_sim_state": 0.0029952184359232584, "sim_compute_performance-ego": 0.0040781990687052405, "sim_compute_robot_state-ego": 0.004951792558034261}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.791068674249874, "sim_physics": 0.05631069005545923, "survival_time": 11.800000000000033, "driven_lanedir": 2.7820981551555044, "sim_render-ego": 0.007198079157683809, "in-drivable-lane": 2.850000000000022, "agent_compute-ego": 0.06313540369777357, "deviation-heading": 2.949649547988274, "set_robot_commands": 0.00503935349189629, "deviation-center-line": 0.6474492325371318, "driven_lanedir_consec": 2.7820981551555044, "sim_compute_sim_state": 0.002991836960032835, "sim_compute_performance-ego": 0.004026818073402017, "sim_compute_robot_state-ego": 0.004972936743396824}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0795141633386929, "sim_physics": 0.055248196060593065, "survival_time": 3.699999999999995, "driven_lanedir": 0.9618470164735692, "sim_render-ego": 0.007213627969896472, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0631047165071642, "deviation-heading": 0.6693289277605265, "set_robot_commands": 0.005055814175992398, "deviation-center-line": 0.2183419677017957, "driven_lanedir_consec": 0.9618470164735692, "sim_compute_sim_state": 0.0029554560377791123, "sim_compute_performance-ego": 0.004040573094342206, "sim_compute_robot_state-ego": 0.005053703849380081}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.704813406318921, "sim_physics": 0.05543699809011703, "survival_time": 14.45000000000007, "driven_lanedir": 3.8836186313607177, "sim_render-ego": 0.007179098558260908, "in-drivable-lane": 2.2500000000000124, "agent_compute-ego": 0.06411406738122855, "deviation-heading": 3.3068905562932276, "set_robot_commands": 0.005074670983020822, "deviation-center-line": 0.676546254494014, "driven_lanedir_consec": 3.8836186313607177, "sim_compute_sim_state": 0.003009947938490079, "sim_compute_performance-ego": 0.004070576499490177, "sim_compute_robot_state-ego": 0.005015060563400955}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7793178103955527, "sim_physics": 0.07714585146289661, "survival_time": 8.14999999999998, "driven_lanedir": 2.342310235521682, "sim_render-ego": 0.009668076696571395, "in-drivable-lane": 1.3999999999999968, "agent_compute-ego": 0.09382355432568884, "deviation-heading": 0.7463414336380915, "set_robot_commands": 0.006713821844089251, "deviation-center-line": 0.5029734284213464, "driven_lanedir_consec": 2.342310235521682, "sim_compute_sim_state": 0.0039194756490321244, "sim_compute_performance-ego": 0.005558780365926356, "sim_compute_robot_state-ego": 0.006920946156320397}}
set_robot_commands_max0.006713821844089251
set_robot_commands_mean0.005385363328400387
set_robot_commands_median0.005055814175992398
set_robot_commands_min0.00503935349189629
sim_compute_performance-ego_max0.005558780365926356
sim_compute_performance-ego_mean0.0043549894203732
sim_compute_performance-ego_median0.004070576499490177
sim_compute_performance-ego_min0.004026818073402017
sim_compute_robot_state-ego_max0.006920946156320397
sim_compute_robot_state-ego_mean0.005382887974106504
sim_compute_robot_state-ego_median0.005015060563400955
sim_compute_robot_state-ego_min0.004951792558034261
sim_compute_sim_state_max0.0039194756490321244
sim_compute_sim_state_mean0.003174387004251482
sim_compute_sim_state_median0.0029952184359232584
sim_compute_sim_state_min0.0029554560377791123
sim_physics_max0.07714585146289661
sim_physics_mean0.05977573689542004
sim_physics_median0.05543699809011703
sim_physics_min0.05473694880803426
sim_render-ego_max0.009668076696571395
sim_render-ego_mean0.007646552820781834
sim_render-ego_median0.007198079157683809
sim_render-ego_min0.0069738817214965824
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.610000000000031
survival_time_min3.699999999999995
No reset possible
291755555Mikita Sazanovich 🇷🇺chameleon-4aido3-LF-real-validationeval1-visualizesuccessnoip-172-31-46-148-104920:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec6.273130942542531
survival_time48
deviation-center-line3.7436463351435822
in-drivable-lane10.666700000000002


other stats
deviation-heading10.167740925042752
driven_any7.565205641512851
driven_lanedir6.273130942542531
visualized-eval1-passed1
No reset possible
291625555Mikita Sazanovich 🇷🇺chameleon-4aido3-LF-real-validationeval0-videossuccessnoip-172-31-46-148-104920:04:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
291135643Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|v3aido3-LFV-sim-testingstep1-simulationerroryesip-172-31-46-148-104920:43:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
291055628Oliver Widlerchallenge-aido_LF-template-pytorchaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:11:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0787580789485929
survival_time_median5.749999999999988
deviation-center-line_median0.32221993969731005
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.026997815478931778
agent_compute-ego_mean0.025567765208306257
agent_compute-ego_median0.025457834544247143
agent_compute-ego_min0.02463228702545166
deviation-center-line_max1.0596126883380297
deviation-center-line_mean0.39631867285332784
deviation-center-line_min0.16926004327168756
deviation-heading_max2.2789565187524543
deviation-heading_mean1.2548783389312397
deviation-heading_median1.2737062200250766
deviation-heading_min0.5884308913111753
driven_any_max3.085099320764216
driven_any_mean1.5099439222106363
driven_any_median1.273906610995571
driven_any_min0.5095042846200016
driven_lanedir_consec_max3.020210987877258
driven_lanedir_consec_mean1.325444285271172
driven_lanedir_consec_min0.4894521040848323
driven_lanedir_max3.020210987877258
driven_lanedir_mean1.325444285271172
driven_lanedir_median1.0787580789485929
driven_lanedir_min0.4894521040848323
in-drivable-lane_max1.5999999999999943
in-drivable-lane_mean0.5533333333333333
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1563068008188924, "sim_physics": 0.05823027747017997, "survival_time": 5.249999999999989, "driven_lanedir": 1.0787580789485929, "sim_render-ego": 0.007335910342988514, "in-drivable-lane": 0, "agent_compute-ego": 0.025890491122291203, "deviation-heading": 1.649060231988834, "set_robot_commands": 0.005118840081351144, "deviation-center-line": 0.32221993969731005, "driven_lanedir_consec": 1.0787580789485929, "sim_compute_sim_state": 0.002987943376813616, "sim_compute_performance-ego": 0.00430726550874256, "sim_compute_robot_state-ego": 0.005297674451555524}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.391212097330952, "sim_physics": 0.05668356532142276, "survival_time": 10.500000000000014, "driven_lanedir": 2.3428521575111136, "sim_render-ego": 0.0072416407721383235, "in-drivable-lane": 0, "agent_compute-ego": 0.02525840373266311, "deviation-heading": 1.6949619942053578, "set_robot_commands": 0.005207720256987072, "deviation-center-line": 0.5640747118560788, "driven_lanedir_consec": 2.3428521575111136, "sim_compute_sim_state": 0.003067999794369652, "sim_compute_performance-ego": 0.004146314802623931, "sim_compute_robot_state-ego": 0.005269731794084821}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6035943324388783, "sim_physics": 0.06189764368123021, "survival_time": 2.8999999999999977, "driven_lanedir": 0.5833745676654805, "sim_render-ego": 0.007291621175305596, "in-drivable-lane": 0, "agent_compute-ego": 0.02563040831993366, "deviation-heading": 0.6768917276182654, "set_robot_commands": 0.005044336976676151, "deviation-center-line": 0.18704263544299451, "driven_lanedir_consec": 0.5833745676654805, "sim_compute_sim_state": 0.0030891977507492593, "sim_compute_performance-ego": 0.004058940657253923, "sim_compute_robot_state-ego": 0.0052469023342790275}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.603251654808446, "sim_physics": 0.05514458009413072, "survival_time": 7.149999999999983, "driven_lanedir": 1.21581715534589, "sim_render-ego": 0.00831683699067656, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.02511913292891496, "deviation-heading": 1.320896176049439, "set_robot_commands": 0.00514230194625321, "deviation-center-line": 0.33580164780472493, "driven_lanedir_consec": 1.21581715534589, "sim_compute_sim_state": 0.003021670388175058, "sim_compute_performance-ego": 0.004137134218549395, "sim_compute_robot_state-ego": 0.0052339913961770654}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7676062457216197, "sim_physics": 0.05590735880796574, "survival_time": 12.100000000000035, "driven_lanedir": 2.40240470419952, "sim_render-ego": 0.007209533502247708, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.025261846455660732, "deviation-heading": 1.5044079214743062, "set_robot_commands": 0.005105262945506199, "deviation-center-line": 0.7677844229101446, "driven_lanedir_consec": 2.40240470419952, "sim_compute_sim_state": 0.0030573035074659615, "sim_compute_performance-ego": 0.004128551680194445, "sim_compute_robot_state-ego": 0.005246619547694183}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.461772451493388, "sim_physics": 0.05706343165150395, "survival_time": 10.800000000000018, "driven_lanedir": 2.293198611741024, "sim_render-ego": 0.007324535537649084, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.025743870823471633, "deviation-heading": 2.2789565187524543, "set_robot_commands": 0.005114968176241274, "deviation-center-line": 0.587490901905731, "driven_lanedir_consec": 2.293198611741024, "sim_compute_sim_state": 0.003065300208550912, "sim_compute_performance-ego": 0.004126481435917042, "sim_compute_robot_state-ego": 0.0052863845118769895}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.8149298509902467, "sim_physics": 0.058366771070113094, "survival_time": 8.04999999999998, "driven_lanedir": 1.7820362912781145, "sim_render-ego": 0.007305043084280831, "in-drivable-lane": 0, "agent_compute-ego": 0.024713498465022684, "deviation-heading": 1.2737062200250766, "set_robot_commands": 0.005089077149859126, "deviation-center-line": 0.5901593088685786, "driven_lanedir_consec": 1.7820362912781145, "sim_compute_sim_state": 0.0030272229117636355, "sim_compute_performance-ego": 0.004095210792115016, "sim_compute_robot_state-ego": 0.005250063001739313}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6976803877828183, "sim_physics": 0.05781145529313521, "survival_time": 3.2999999999999963, "driven_lanedir": 0.621749580465043, "sim_render-ego": 0.007250236742424242, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.026997815478931778, "deviation-heading": 0.5884308913111753, "set_robot_commands": 0.00516516873330781, "deviation-center-line": 0.1731023716969642, "driven_lanedir_consec": 0.621749580465043, "sim_compute_sim_state": 0.003062125408288204, "sim_compute_performance-ego": 0.004038850466410319, "sim_compute_robot_state-ego": 0.00520146976817738}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0504904386205305, "sim_physics": 0.05767194430033366, "survival_time": 4.799999999999991, "driven_lanedir": 0.619569360207066, "sim_render-ego": 0.007507443428039551, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.025836882491906483, "deviation-heading": 0.83364283982336, "set_robot_commands": 0.005071307222048442, "deviation-center-line": 0.16926004327168756, "driven_lanedir_consec": 0.619569360207066, "sim_compute_sim_state": 0.0030466963847478232, "sim_compute_performance-ego": 0.00416107972462972, "sim_compute_robot_state-ego": 0.0053563192486763}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5095042846200016, "sim_physics": 0.05449332237243652, "survival_time": 2.499999999999999, "driven_lanedir": 0.4894521040848323, "sim_render-ego": 0.007322306632995605, "in-drivable-lane": 0, "agent_compute-ego": 0.02463228702545166, "deviation-heading": 0.6752572703216285, "set_robot_commands": 0.005095324516296387, "deviation-center-line": 0.19579692445292468, "driven_lanedir_consec": 0.4894521040848323, "sim_compute_sim_state": 0.003031153678894043, "sim_compute_performance-ego": 0.004050793647766113, "sim_compute_robot_state-ego": 0.0052450037002563475}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.050476361863455, "sim_physics": 0.055597965915997825, "survival_time": 4.799999999999991, "driven_lanedir": 0.7423544872875063, "sim_render-ego": 0.007287268837292989, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.025436940292517345, "deviation-heading": 0.795590208956636, "set_robot_commands": 0.005275912582874298, "deviation-center-line": 0.27539722495582003, "driven_lanedir_consec": 0.7423544872875063, "sim_compute_sim_state": 0.003058743973573049, "sim_compute_performance-ego": 0.004110813140869141, "sim_compute_robot_state-ego": 0.005239186187585195}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5447862215771575, "sim_physics": 0.05957424865578705, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5184598973105767, "sim_render-ego": 0.00735784926504459, "in-drivable-lane": 0, "agent_compute-ego": 0.02624598539100503, "deviation-heading": 0.6669330548520231, "set_robot_commands": 0.005074190643598449, "deviation-center-line": 0.1803769279918603, "driven_lanedir_consec": 0.5184598973105767, "sim_compute_sim_state": 0.0031013533754168814, "sim_compute_performance-ego": 0.0040633813390191995, "sim_compute_robot_state-ego": 0.005189382805014556}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.6385417733333731, "sim_physics": 0.05353636610997866, "survival_time": 7.299999999999982, "driven_lanedir": 1.2028952812828946, "sim_render-ego": 0.0072450180576272205, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.025457834544247143, "deviation-heading": 0.9747113899808209, "set_robot_commands": 0.005102609934872144, "deviation-center-line": 0.2045910239382228, "driven_lanedir_consec": 1.2028952812828946, "sim_compute_sim_state": 0.0029931770612115728, "sim_compute_performance-ego": 0.004118044082432577, "sim_compute_robot_state-ego": 0.005333678363120719}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.273906610995571, "sim_physics": 0.056523976118668266, "survival_time": 5.749999999999988, "driven_lanedir": 0.9685310138626654, "sim_render-ego": 0.007380553950434146, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.026024799761564837, "deviation-heading": 2.0555790128027276, "set_robot_commands": 0.005242642112400221, "deviation-center-line": 0.332069319668847, "driven_lanedir_consec": 0.9685310138626654, "sim_compute_sim_state": 0.0030532982038414995, "sim_compute_performance-ego": 0.004192557542220406, "sim_compute_robot_state-ego": 0.005287448219631029}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.085099320764216, "sim_physics": 0.05795808352502305, "survival_time": 13.450000000000056, "driven_lanedir": 3.020210987877258, "sim_render-ego": 0.007224375430536093, "in-drivable-lane": 0, "agent_compute-ego": 0.02526628129101154, "deviation-heading": 1.83414962580649, "set_robot_commands": 0.005135003518880965, "deviation-center-line": 1.0596126883380297, "driven_lanedir_consec": 3.020210987877258, "sim_compute_sim_state": 0.0029998667621258025, "sim_compute_performance-ego": 0.0040901788548466, "sim_compute_robot_state-ego": 0.00521736960428798}}
set_robot_commands_max0.005275912582874298
set_robot_commands_mean0.005132311119810193
set_robot_commands_median0.005114968176241274
set_robot_commands_min0.005044336976676151
sim_compute_performance-ego_max0.00430726550874256
sim_compute_performance-ego_mean0.0041217065262393595
sim_compute_performance-ego_median0.004118044082432577
sim_compute_performance-ego_min0.004038850466410319
sim_compute_robot_state-ego_max0.0053563192486763
sim_compute_robot_state-ego_mean0.005260081662277096
sim_compute_robot_state-ego_median0.0052469023342790275
sim_compute_robot_state-ego_min0.005189382805014556
sim_compute_sim_state_max0.0031013533754168814
sim_compute_sim_state_mean0.003044203519065798
sim_compute_sim_state_median0.0030532982038414995
sim_compute_sim_state_min0.002987943376813616
sim_physics_max0.06189764368123021
sim_physics_mean0.057097399359193786
sim_physics_median0.05706343165150395
sim_physics_min0.05353636610997866
sim_render-ego_max0.00831683699067656
sim_render-ego_mean0.007373344916645403
sim_render-ego_median0.007305043084280831
sim_render-ego_min0.007209533502247708
simulation-passed1
survival_time_max13.450000000000056
survival_time_mean6.753333333333336
survival_time_min2.499999999999999
No reset possible
291015626c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.519090291761162
survival_time_median14.950000000000076
deviation-center-line_median0.8116358903744543
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016196025212605793
agent_compute-ego_mean0.016026691595713294
agent_compute-ego_median0.01613433281580607
agent_compute-ego_min0.01563273827234904
deviation-center-line_max1.0692815602038006
deviation-center-line_mean0.8607630708915786
deviation-center-line_min0.7399699308809071
deviation-heading_max4.044544617094773
deviation-heading_mean2.962075560138417
deviation-heading_median2.9808194956954535
deviation-heading_min1.9840011361257048
driven_any_max2.649930890424134
driven_any_mean2.5943043856179147
driven_any_median2.58914286831826
driven_any_min2.5632943081072823
driven_lanedir_consec_max2.6080713511508273
driven_lanedir_consec_mean2.416943839380351
driven_lanedir_consec_min2.129622750503924
driven_lanedir_max2.6080713511508273
driven_lanedir_mean2.416943839380351
driven_lanedir_median2.519090291761162
driven_lanedir_min2.129622750503924
in-drivable-lane_max1.550000000000022
in-drivable-lane_mean0.5100000000000037
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5632943081072823, "sim_physics": 0.057698458035786944, "survival_time": 14.950000000000076, "driven_lanedir": 2.129622750503924, "sim_render-ego": 0.00716930627822876, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.016196025212605793, "deviation-heading": 4.044544617094773, "set_robot_commands": 0.0075295313199361166, "deviation-center-line": 0.8062119537628785, "driven_lanedir_consec": 2.129622750503924, "sim_compute_sim_state": 0.0038299322128295898, "sim_compute_performance-ego": 0.004232727686564128, "sim_compute_robot_state-ego": 0.005268137454986572}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5991405498546487, "sim_physics": 0.05846894900004069, "survival_time": 14.950000000000076, "driven_lanedir": 2.519090291761162, "sim_render-ego": 0.007303027311960856, "in-drivable-lane": 0, "agent_compute-ego": 0.016193437576293945, "deviation-heading": 2.9808194956954535, "set_robot_commands": 0.007423911889394124, "deviation-center-line": 0.8116358903744543, "driven_lanedir_consec": 2.519090291761162, "sim_compute_sim_state": 0.003837266763051351, "sim_compute_performance-ego": 0.004233688513437907, "sim_compute_robot_state-ego": 0.00528666893641154}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.570013311385248, "sim_physics": 0.05772689342498779, "survival_time": 14.950000000000076, "driven_lanedir": 2.302703809093411, "sim_render-ego": 0.007277401288350424, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.01563273827234904, "deviation-heading": 3.063673475703536, "set_robot_commands": 0.007337661584218344, "deviation-center-line": 1.0692815602038006, "driven_lanedir_consec": 2.302703809093411, "sim_compute_sim_state": 0.0036800583203633625, "sim_compute_performance-ego": 0.004140892823537191, "sim_compute_robot_state-ego": 0.005305763085683187}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.58914286831826, "sim_physics": 0.06020049174626668, "survival_time": 14.950000000000076, "driven_lanedir": 2.525230994392432, "sim_render-ego": 0.007314504782358806, "in-drivable-lane": 0, "agent_compute-ego": 0.015976924101511636, "deviation-heading": 2.7373390760726153, "set_robot_commands": 0.00715585470199585, "deviation-center-line": 0.7399699308809071, "driven_lanedir_consec": 2.525230994392432, "sim_compute_sim_state": 0.003911867936452229, "sim_compute_performance-ego": 0.004146287441253662, "sim_compute_robot_state-ego": 0.005291958649953206}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.649930890424134, "sim_physics": 0.059104890028635663, "survival_time": 14.950000000000076, "driven_lanedir": 2.6080713511508273, "sim_render-ego": 0.007285206317901611, "in-drivable-lane": 0, "agent_compute-ego": 0.01613433281580607, "deviation-heading": 1.9840011361257048, "set_robot_commands": 0.007448647022247314, "deviation-center-line": 0.8767160192358517, "driven_lanedir_consec": 2.6080713511508273, "sim_compute_sim_state": 0.003990622361501058, "sim_compute_performance-ego": 0.004121464888254801, "sim_compute_robot_state-ego": 0.005248127778371175}}
set_robot_commands_max0.0075295313199361166
set_robot_commands_mean0.00737912130355835
set_robot_commands_median0.007423911889394124
set_robot_commands_min0.00715585470199585
sim_compute_performance-ego_max0.004233688513437907
sim_compute_performance-ego_mean0.004175012270609538
sim_compute_performance-ego_median0.004146287441253662
sim_compute_performance-ego_min0.004121464888254801
sim_compute_robot_state-ego_max0.005305763085683187
sim_compute_robot_state-ego_mean0.005280131181081136
sim_compute_robot_state-ego_median0.00528666893641154
sim_compute_robot_state-ego_min0.005248127778371175
sim_compute_sim_state_max0.003990622361501058
sim_compute_sim_state_mean0.0038499495188395183
sim_compute_sim_state_median0.003837266763051351
sim_compute_sim_state_min0.0036800583203633625
sim_physics_max0.06020049174626668
sim_physics_mean0.05863993644714356
sim_physics_median0.05846894900004069
sim_physics_min0.057698458035786944
sim_render-ego_max0.007314504782358806
sim_render-ego_mean0.007269889195760092
sim_render-ego_median0.007285206317901611
sim_render-ego_min0.00716930627822876
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
290985625Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.055656614094811
survival_time_median6.0499999999999865
deviation-center-line_median0.4012641003994098
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.03007660627365112
agent_compute-ego_mean0.02796840468889649
agent_compute-ego_median0.02795275809272887
agent_compute-ego_min0.0256772125716758
deviation-center-line_max0.7402948989352974
deviation-center-line_mean0.4398630047073933
deviation-center-line_min0.23365181987322517
deviation-heading_max2.986628825260207
deviation-heading_mean1.6738310514481274
deviation-heading_median1.6940761627709997
deviation-heading_min0.8169757721026268
driven_any_max4.7134612815691375
driven_any_mean2.720353109039246
driven_any_median2.283990938967025
driven_any_min1.279094430852641
driven_lanedir_consec_max4.108737817357051
driven_lanedir_consec_mean2.4175148399419406
driven_lanedir_consec_min1.222602997063887
driven_lanedir_max4.108737817357051
driven_lanedir_mean2.4175148399419406
driven_lanedir_median2.055656614094811
driven_lanedir_min1.222602997063887
in-drivable-lane_max1.0000000000000062
in-drivable-lane_mean0.4400000000000004
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.089997456861781, "sim_physics": 0.07375818835802314, "survival_time": 6.0499999999999865, "driven_lanedir": 1.994147820331825, "sim_render-ego": 0.008730971123561386, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.027651445924743147, "deviation-heading": 1.079978690581206, "set_robot_commands": 0.0068342409843255665, "deviation-center-line": 0.4012641003994098, "driven_lanedir_consec": 1.994147820331825, "sim_compute_sim_state": 0.003570371422885863, "sim_compute_performance-ego": 0.0051632577722722835, "sim_compute_robot_state-ego": 0.006487296632498749}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.279094430852641, "sim_physics": 0.07888541145930214, "survival_time": 3.149999999999997, "driven_lanedir": 1.222602997063887, "sim_render-ego": 0.009893417358398438, "in-drivable-lane": 0, "agent_compute-ego": 0.02795275809272887, "deviation-heading": 0.8169757721026268, "set_robot_commands": 0.007108790533883231, "deviation-center-line": 0.23365181987322517, "driven_lanedir_consec": 1.222602997063887, "sim_compute_sim_state": 0.003898272438654824, "sim_compute_performance-ego": 0.0053597745441255115, "sim_compute_robot_state-ego": 0.007049223733326745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.7134612815691375, "sim_physics": 0.07643288930257161, "survival_time": 14.950000000000076, "driven_lanedir": 4.108737817357051, "sim_render-ego": 0.00934012492497762, "in-drivable-lane": 1.0000000000000062, "agent_compute-ego": 0.03007660627365112, "deviation-heading": 2.986628825260207, "set_robot_commands": 0.007646446228027344, "deviation-center-line": 0.7402948989352974, "driven_lanedir_consec": 4.108737817357051, "sim_compute_sim_state": 0.003919801712036133, "sim_compute_performance-ego": 0.005406315326690674, "sim_compute_robot_state-ego": 0.00678903341293335}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.235221436945645, "sim_physics": 0.075258951476126, "survival_time": 8.249999999999982, "driven_lanedir": 2.7064289508621275, "sim_render-ego": 0.00964042923667214, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.028484000581683537, "deviation-heading": 1.791495806525598, "set_robot_commands": 0.006958270795417555, "deviation-center-line": 0.4355964853078604, "driven_lanedir_consec": 2.7064289508621275, "sim_compute_sim_state": 0.004033455704197739, "sim_compute_performance-ego": 0.005392719037605054, "sim_compute_robot_state-ego": 0.007008613239635121}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.283990938967025, "sim_physics": 0.06946505065512869, "survival_time": 5.649999999999988, "driven_lanedir": 2.055656614094811, "sim_render-ego": 0.008998872959508306, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.0256772125716758, "deviation-heading": 1.6940761627709997, "set_robot_commands": 0.006673392996323847, "deviation-center-line": 0.3885077190211737, "driven_lanedir_consec": 2.055656614094811, "sim_compute_sim_state": 0.0036734500817493, "sim_compute_performance-ego": 0.00512097156153316, "sim_compute_robot_state-ego": 0.006551905015928556}}
set_robot_commands_max0.007646446228027344
set_robot_commands_mean0.0070442283075955086
set_robot_commands_median0.006958270795417555
set_robot_commands_min0.006673392996323847
sim_compute_performance-ego_max0.005406315326690674
sim_compute_performance-ego_mean0.005288607648445336
sim_compute_performance-ego_median0.0053597745441255115
sim_compute_performance-ego_min0.00512097156153316
sim_compute_robot_state-ego_max0.007049223733326745
sim_compute_robot_state-ego_mean0.006777214406864504
sim_compute_robot_state-ego_median0.00678903341293335
sim_compute_robot_state-ego_min0.006487296632498749
sim_compute_sim_state_max0.004033455704197739
sim_compute_sim_state_mean0.003819070271904771
sim_compute_sim_state_median0.003898272438654824
sim_compute_sim_state_min0.003570371422885863
sim_physics_max0.07888541145930214
sim_physics_mean0.07476009825023032
sim_physics_median0.075258951476126
sim_physics_min0.06946505065512869
sim_render-ego_max0.009893417358398438
sim_render-ego_mean0.009320763120623578
sim_render-ego_median0.00934012492497762
sim_render-ego_min0.008730971123561386
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.610000000000008
survival_time_min3.149999999999997
No reset possible
290945623Mikita Sazanovich 🇷🇺chameleon-8-trioaido3-LFVI-sim-testingstep1-simulationerroryesip-172-31-46-148-104920:08:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
290905622Mikita Sazanovich 🇷🇺chameleon-8-trioaido3-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:16:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3905244231723186
survival_time_median14.300000000000068
deviation-center-line_median0.6337916795692888
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.2147742772102356
agent_compute-ego_mean0.201740067144096
agent_compute-ego_median0.20688061280684036
agent_compute-ego_min0.16995267851369364
deviation-center-line_max0.9835159838183368
deviation-center-line_mean0.6365167107447341
deviation-center-line_min0.314336868880555
deviation-heading_max4.5619387002869525
deviation-heading_mean3.1334688715154195
deviation-heading_median4.140768196442768
deviation-heading_min1.3564665224991743
driven_any_max4.737678108745438
driven_any_mean3.529668628730658
driven_any_median3.9425246933050495
driven_any_min2.2319211315497
driven_lanedir_consec_max4.10574814468472
driven_lanedir_consec_mean2.7217501302856206
driven_lanedir_consec_min1.5520456877756883
driven_lanedir_max4.352361840477854
driven_lanedir_mean2.9662717482635843
driven_lanedir_median2.396153972642791
driven_lanedir_min2.069591636267503
in-drivable-lane_max5.500000000000005
in-drivable-lane_mean1.4900000000000038
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.2319211315497, "sim_physics": 0.1643908824120368, "survival_time": 7.149999999999983, "driven_lanedir": 2.1720233206521944, "sim_render-ego": 0.008991458199240944, "in-drivable-lane": 0, "agent_compute-ego": 0.20688061280684036, "deviation-heading": 1.3564665224991743, "set_robot_commands": 0.006978526815667852, "deviation-center-line": 0.314336868880555, "driven_lanedir_consec": 2.1720071041584577, "sim_compute_sim_state": 0.003739323649373088, "sim_compute_performance-ego": 0.005069044086482975, "sim_compute_robot_state-ego": 0.00642181276441454, "sim_compute_robot_state-npc0": 0.006561375998116873, "sim_compute_robot_state-npc1": 0.006162763475538134, "sim_compute_robot_state-npc2": 0.00603383571117908, "sim_compute_robot_state-npc3": 0.0061119319675685645}, "udem1-1-0": {"driven_any": 3.9425246933050495, "sim_physics": 0.1610661013921102, "survival_time": 14.950000000000076, "driven_lanedir": 2.396153972642791, "sim_render-ego": 0.009231403668721517, "in-drivable-lane": 5.500000000000005, "agent_compute-ego": 0.2147742772102356, "deviation-heading": 4.140768196442768, "set_robot_commands": 0.007033436298370361, "deviation-center-line": 0.6337916795692888, "driven_lanedir_consec": 2.3905244231723186, "sim_compute_sim_state": 0.003841079076131185, "sim_compute_performance-ego": 0.005267876784006755, "sim_compute_robot_state-ego": 0.006776916980743408, "sim_compute_robot_state-npc0": 0.006518816153208415, "sim_compute_robot_state-npc1": 0.006285800933837891, "sim_compute_robot_state-npc2": 0.006333870887756348, "sim_compute_robot_state-npc3": 0.0062904588381449385}, "udem1-2-0": {"driven_any": 2.2830283832863927, "sim_physics": 0.13897850146660437, "survival_time": 6.499999999999985, "driven_lanedir": 2.069591636267503, "sim_render-ego": 0.009310010763315054, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.2057816120294424, "deviation-heading": 1.4237224504412644, "set_robot_commands": 0.0072113403907189, "deviation-center-line": 0.3749509932206944, "driven_lanedir_consec": 1.5520456877756883, "sim_compute_sim_state": 0.003714154316828801, "sim_compute_performance-ego": 0.005465896313007062, "sim_compute_robot_state-ego": 0.006795074389531062, "sim_compute_robot_state-npc0": 0.00655823670900785, "sim_compute_robot_state-npc1": 0.006192546624403734, "sim_compute_robot_state-npc2": 0.006105941992539626, "sim_compute_robot_state-npc3": 0.006080190952007587}, "udem1-3-0": {"driven_any": 4.737678108745438, "sim_physics": 0.15059271732966106, "survival_time": 14.950000000000076, "driven_lanedir": 4.352361840477854, "sim_render-ego": 0.00931431770324707, "in-drivable-lane": 0.30000000000000004, "agent_compute-ego": 0.21131115516026816, "deviation-heading": 4.5619387002869525, "set_robot_commands": 0.007091225783030192, "deviation-center-line": 0.9835159838183368, "driven_lanedir_consec": 4.10574814468472, "sim_compute_sim_state": 0.0037551180521647135, "sim_compute_performance-ego": 0.005338145891825358, "sim_compute_robot_state-ego": 0.006707489490509033, "sim_compute_robot_state-npc0": 0.006453255812327067, "sim_compute_robot_state-npc1": 0.006446034908294678, "sim_compute_robot_state-npc2": 0.006167136033376058, "sim_compute_robot_state-npc3": 0.006165539423624675}, "udem1-4-0": {"driven_any": 4.453190826766707, "sim_physics": 0.128401330300978, "survival_time": 14.300000000000068, "driven_lanedir": 3.841227971277581, "sim_render-ego": 0.007110053009086555, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.16995267851369364, "deviation-heading": 4.1844484879069395, "set_robot_commands": 0.0051377019682130615, "deviation-center-line": 0.875988028234796, "driven_lanedir_consec": 3.388425291636918, "sim_compute_sim_state": 0.0029046652200338725, "sim_compute_performance-ego": 0.004025564327106609, "sim_compute_robot_state-ego": 0.005154452123842039, "sim_compute_robot_state-npc0": 0.00500862498383422, "sim_compute_robot_state-npc1": 0.004689623425890516, "sim_compute_robot_state-npc2": 0.004686759068415715, "sim_compute_robot_state-npc3": 0.004661738455712379}}
set_robot_commands_max0.0072113403907189
set_robot_commands_mean0.006690446251200073
set_robot_commands_median0.007033436298370361
set_robot_commands_min0.0051377019682130615
sim_compute_performance-ego_max0.005465896313007062
sim_compute_performance-ego_mean0.005033305480485752
sim_compute_performance-ego_median0.005267876784006755
sim_compute_performance-ego_min0.004025564327106609
sim_compute_robot_state-ego_max0.006795074389531062
sim_compute_robot_state-ego_mean0.006371149149808017
sim_compute_robot_state-ego_median0.006707489490509033
sim_compute_robot_state-ego_min0.005154452123842039
sim_compute_robot_state-npc0_max0.006561375998116873
sim_compute_robot_state-npc0_mean0.006220061931298886
sim_compute_robot_state-npc0_median0.006518816153208415
sim_compute_robot_state-npc0_min0.00500862498383422
sim_compute_robot_state-npc1_max0.006446034908294678
sim_compute_robot_state-npc1_mean0.0059553538735929905
sim_compute_robot_state-npc1_median0.006192546624403734
sim_compute_robot_state-npc1_min0.004689623425890516
sim_compute_robot_state-npc2_max0.006333870887756348
sim_compute_robot_state-npc2_mean0.005865508738653366
sim_compute_robot_state-npc2_median0.006105941992539626
sim_compute_robot_state-npc2_min0.004686759068415715
sim_compute_robot_state-npc3_max0.0062904588381449385
sim_compute_robot_state-npc3_mean0.005861971927411629
sim_compute_robot_state-npc3_median0.0061119319675685645
sim_compute_robot_state-npc3_min0.004661738455712379
sim_compute_sim_state_max0.003841079076131185
sim_compute_sim_state_mean0.003590868062906332
sim_compute_sim_state_median0.003739323649373088
sim_compute_sim_state_min0.0029046652200338725
sim_physics_max0.1643908824120368
sim_physics_mean0.14868590658027808
sim_physics_median0.15059271732966106
sim_physics_min0.128401330300978
sim_render-ego_max0.00931431770324707
sim_render-ego_mean0.008791448668722227
sim_render-ego_median0.009231403668721517
sim_render-ego_min0.007110053009086555
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.57000000000004
survival_time_min6.499999999999985
No reset possible
290635607Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1609910100117462
survival_time_median3.099999999999997
deviation-center-line_median0.23509696218903384
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02248129152482556
agent_compute-ego_mean0.021370739234805404
agent_compute-ego_median0.021432876586914062
agent_compute-ego_min0.02052634412592108
deviation-center-line_max0.41393962435168147
deviation-center-line_mean0.25861516407234125
deviation-center-line_min0.13937860985072698
deviation-heading_max1.6122582259891636
deviation-heading_mean0.9607804039443704
deviation-heading_median0.8689386015834336
deviation-heading_min0.5266120521187152
driven_any_max3.1645279898881347
driven_any_mean1.8185613775362344
driven_any_median1.2056848288509
driven_any_min1.1050124314037066
driven_lanedir_consec_max2.592524521435198
driven_lanedir_consec_mean1.5747814600460166
driven_lanedir_consec_min1.056764728544062
driven_lanedir_max2.592524521435198
driven_lanedir_mean1.5747814600460166
driven_lanedir_median1.1609910100117462
driven_lanedir_min1.056764728544062
in-drivable-lane_max0.849999999999997
in-drivable-lane_mean0.32999999999999885
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1890852188450132, "sim_physics": 0.06144476321435744, "survival_time": 3.099999999999997, "driven_lanedir": 1.1609910100117462, "sim_render-ego": 0.007348725872655068, "in-drivable-lane": 0, "agent_compute-ego": 0.02248129152482556, "deviation-heading": 0.5266120521187152, "set_robot_commands": 0.005251699878323463, "deviation-center-line": 0.14339919119304492, "driven_lanedir_consec": 1.1609910100117462, "sim_compute_sim_state": 0.0029746947749968496, "sim_compute_performance-ego": 0.00427261475593813, "sim_compute_robot_state-ego": 0.005232280300509545}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2056848288509, "sim_physics": 0.060056699646843806, "survival_time": 2.6999999999999984, "driven_lanedir": 1.1113439144711637, "sim_render-ego": 0.007182258146780508, "in-drivable-lane": 0, "agent_compute-ego": 0.021594096113134315, "deviation-heading": 0.8689386015834336, "set_robot_commands": 0.0052972546330204715, "deviation-center-line": 0.23509696218903384, "driven_lanedir_consec": 1.1113439144711637, "sim_compute_sim_state": 0.0030490469049524378, "sim_compute_performance-ego": 0.0039567991539284034, "sim_compute_robot_state-ego": 0.005234563792193377}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4284964186934173, "sim_physics": 0.05624409317970276, "survival_time": 5.999999999999987, "driven_lanedir": 1.9522831257679136, "sim_render-ego": 0.007138983408610026, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.020819087823232017, "deviation-heading": 1.0869424198982978, "set_robot_commands": 0.00514493187268575, "deviation-center-line": 0.36126143277721895, "driven_lanedir_consec": 1.9522831257679136, "sim_compute_sim_state": 0.0030471622943878175, "sim_compute_performance-ego": 0.0039887527624766035, "sim_compute_robot_state-ego": 0.005120672782262166}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.1645279898881347, "sim_physics": 0.05802667901871053, "survival_time": 7.049999999999983, "driven_lanedir": 2.592524521435198, "sim_render-ego": 0.007115881493751039, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.021432876586914062, "deviation-heading": 1.6122582259891636, "set_robot_commands": 0.005172974674414236, "deviation-center-line": 0.41393962435168147, "driven_lanedir_consec": 2.592524521435198, "sim_compute_sim_state": 0.0030784556206236496, "sim_compute_performance-ego": 0.0039789439938592575, "sim_compute_robot_state-ego": 0.005116508362141062}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1050124314037066, "sim_physics": 0.060153228586370296, "survival_time": 2.7499999999999982, "driven_lanedir": 1.056764728544062, "sim_render-ego": 0.007188558578491211, "in-drivable-lane": 0, "agent_compute-ego": 0.02052634412592108, "deviation-heading": 0.7091507201322419, "set_robot_commands": 0.0051189942793412645, "deviation-center-line": 0.13937860985072698, "driven_lanedir_consec": 1.056764728544062, "sim_compute_sim_state": 0.0029859066009521483, "sim_compute_performance-ego": 0.003949043967507102, "sim_compute_robot_state-ego": 0.00503971359946511}}
set_robot_commands_max0.0052972546330204715
set_robot_commands_mean0.005197171067557038
set_robot_commands_median0.005172974674414236
set_robot_commands_min0.0051189942793412645
sim_compute_performance-ego_max0.00427261475593813
sim_compute_performance-ego_mean0.004029230926741899
sim_compute_performance-ego_median0.0039789439938592575
sim_compute_performance-ego_min0.003949043967507102
sim_compute_robot_state-ego_max0.005234563792193377
sim_compute_robot_state-ego_mean0.005148747767314252
sim_compute_robot_state-ego_median0.005120672782262166
sim_compute_robot_state-ego_min0.00503971359946511
sim_compute_sim_state_max0.0030784556206236496
sim_compute_sim_state_mean0.0030270532391825805
sim_compute_sim_state_median0.0030471622943878175
sim_compute_sim_state_min0.0029746947749968496
sim_physics_max0.06144476321435744
sim_physics_mean0.059185092729196975
sim_physics_median0.060056699646843806
sim_physics_min0.05624409317970276
sim_render-ego_max0.007348725872655068
sim_render-ego_mean0.00719488150005757
sim_render-ego_median0.007182258146780508
sim_render-ego_min0.007115881493751039
simulation-passed1
survival_time_max7.049999999999983
survival_time_mean4.319999999999993
survival_time_min2.6999999999999984
No reset possible
290585602Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3863636164329702
survival_time_median3.2999999999999963
deviation-center-line_median0.18578836747830996
in-drivable-lane_median0.8999999999999968


other stats
agent_compute-ego_max0.022487453619639077
agent_compute-ego_mean0.02132166194802075
agent_compute-ego_median0.020961239137722337
agent_compute-ego_min0.02060254903940054
deviation-center-line_max0.3888480919651064
deviation-center-line_mean0.2255247837650824
deviation-center-line_min0.11151713979083246
deviation-heading_max2.124381352355619
deviation-heading_mean0.9957372148488308
deviation-heading_median0.7420553034043277
deviation-heading_min0.5433476544863385
driven_any_max2.4436098319570014
driven_any_mean1.6162369799148102
driven_any_median1.4835323664767484
driven_any_min1.0260119464297444
driven_lanedir_consec_max1.4455286207633131
driven_lanedir_consec_mean1.2301875646744966
driven_lanedir_consec_min0.6741275068426362
driven_lanedir_max1.4455286207633131
driven_lanedir_mean1.2311390279374903
driven_lanedir_median1.3863636164329702
driven_lanedir_min0.6741275068426362
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0260119464297444, "sim_physics": 0.05935544967651367, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6741275068426362, "sim_render-ego": 0.0073533256848653155, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.022487453619639077, "deviation-heading": 0.5433476544863385, "set_robot_commands": 0.005270453294118246, "deviation-center-line": 0.11151713979083246, "driven_lanedir_consec": 0.6741275068426362, "sim_compute_sim_state": 0.0030832807223002117, "sim_compute_performance-ego": 0.004269051551818848, "sim_compute_robot_state-ego": 0.005306458473205567}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4807485204282085, "sim_physics": 0.057921774459607674, "survival_time": 3.2999999999999963, "driven_lanedir": 1.4103146155080164, "sim_render-ego": 0.007213675614559289, "in-drivable-lane": 0, "agent_compute-ego": 0.021860487533338142, "deviation-heading": 0.8873306561188685, "set_robot_commands": 0.005209044976667924, "deviation-center-line": 0.3033751299367994, "driven_lanedir_consec": 1.4103146155080164, "sim_compute_sim_state": 0.0030919999787301727, "sim_compute_performance-ego": 0.004030187924702962, "sim_compute_robot_state-ego": 0.005255507700371019}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4436098319570014, "sim_physics": 0.05407331372035368, "survival_time": 6.549999999999985, "driven_lanedir": 1.3863636164329702, "sim_render-ego": 0.008437085697669109, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.020961239137722337, "deviation-heading": 2.124381352355619, "set_robot_commands": 0.0051681631394015016, "deviation-center-line": 0.3888480919651064, "driven_lanedir_consec": 1.3863636164329702, "sim_compute_sim_state": 0.003006758580681022, "sim_compute_performance-ego": 0.00405041134084454, "sim_compute_robot_state-ego": 0.005176657028780639}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.647282234282349, "sim_physics": 0.05682764947414398, "survival_time": 3.999999999999994, "driven_lanedir": 1.2393607801405164, "sim_render-ego": 0.007130429148674011, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.020696580410003666, "deviation-heading": 0.7420553034043277, "set_robot_commands": 0.0051839321851730345, "deviation-center-line": 0.13809518965436382, "driven_lanedir_consec": 1.2346034638255468, "sim_compute_sim_state": 0.0029948443174362183, "sim_compute_performance-ego": 0.003955131769180298, "sim_compute_robot_state-ego": 0.005072319507598877}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4835323664767484, "sim_physics": 0.05677029903118427, "survival_time": 3.2499999999999964, "driven_lanedir": 1.4455286207633131, "sim_render-ego": 0.00713957273043119, "in-drivable-lane": 0, "agent_compute-ego": 0.02060254903940054, "deviation-heading": 0.6815711078790002, "set_robot_commands": 0.0052075972923865685, "deviation-center-line": 0.18578836747830996, "driven_lanedir_consec": 1.4455286207633131, "sim_compute_sim_state": 0.0029619473677415112, "sim_compute_performance-ego": 0.00395670303931603, "sim_compute_robot_state-ego": 0.00501244618342473}}
set_robot_commands_max0.005270453294118246
set_robot_commands_mean0.005207838177549455
set_robot_commands_median0.0052075972923865685
set_robot_commands_min0.0051681631394015016
sim_compute_performance-ego_max0.004269051551818848
sim_compute_performance-ego_mean0.004052297125172535
sim_compute_performance-ego_median0.004030187924702962
sim_compute_performance-ego_min0.003955131769180298
sim_compute_robot_state-ego_max0.005306458473205567
sim_compute_robot_state-ego_mean0.005164677778676166
sim_compute_robot_state-ego_median0.005176657028780639
sim_compute_robot_state-ego_min0.00501244618342473
sim_compute_sim_state_max0.0030919999787301727
sim_compute_sim_state_mean0.0030277661933778275
sim_compute_sim_state_median0.003006758580681022
sim_compute_sim_state_min0.0029619473677415112
sim_physics_max0.05935544967651367
sim_physics_mean0.056989697272360654
sim_physics_median0.05682764947414398
sim_physics_min0.05407331372035368
sim_render-ego_max0.008437085697669109
sim_render-ego_mean0.007454817775239783
sim_render-ego_median0.007213675614559289
sim_render-ego_min0.007130429148674011
simulation-passed1
survival_time_max6.549999999999985
survival_time_mean4.019999999999994
survival_time_min2.9999999999999973
No reset possible
290535600c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.623783347328048
survival_time_median14.950000000000076
deviation-center-line_median0.4487171140266781
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02408780813217163
agent_compute-ego_mean0.017466710567474363
agent_compute-ego_median0.015741279125213625
agent_compute-ego_min0.015426503817240396
deviation-center-line_max0.6959229937604363
deviation-center-line_mean0.4890707674443904
deviation-center-line_min0.2914026068686066
deviation-heading_max3.4367524430696696
deviation-heading_mean2.184153405405577
deviation-heading_median1.87179756807937
deviation-heading_min1.3355432693226146
driven_any_max2.6555701597984225
driven_any_mean2.653814175220842
driven_any_median2.655558547673174
driven_any_min2.6468433969326917
driven_lanedir_consec_max2.6416523648093353
driven_lanedir_consec_mean2.5428058935520577
driven_lanedir_consec_min2.2339936851743967
driven_lanedir_max2.6416523648093353
driven_lanedir_mean2.5428058935520577
driven_lanedir_median2.623783347328048
driven_lanedir_min2.2339936851743967
in-drivable-lane_max1.6000000000000068
in-drivable-lane_mean0.32000000000000134
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6468433969326917, "sim_physics": 0.05645982424418131, "survival_time": 14.950000000000076, "driven_lanedir": 2.585888280005614, "sim_render-ego": 0.007054800987243652, "in-drivable-lane": 0, "agent_compute-ego": 0.016349016030629476, "deviation-heading": 2.7648814502070276, "set_robot_commands": 0.007262624104817708, "deviation-center-line": 0.609770261003296, "driven_lanedir_consec": 2.585888280005614, "sim_compute_sim_state": 0.00370743989944458, "sim_compute_performance-ego": 0.004157776037851969, "sim_compute_robot_state-ego": 0.005154911677042643}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.655558547673174, "sim_physics": 0.05588054815928141, "survival_time": 14.950000000000076, "driven_lanedir": 2.623783347328048, "sim_render-ego": 0.00714308500289917, "in-drivable-lane": 0, "agent_compute-ego": 0.015728945732116698, "deviation-heading": 1.87179756807937, "set_robot_commands": 0.007203582922617594, "deviation-center-line": 0.4487171140266781, "driven_lanedir_consec": 2.623783347328048, "sim_compute_sim_state": 0.003777769406636556, "sim_compute_performance-ego": 0.004065159956614176, "sim_compute_robot_state-ego": 0.005153200626373291}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.6555295695352306, "sim_physics": 0.05567062536875407, "survival_time": 14.950000000000076, "driven_lanedir": 2.2339936851743967, "sim_render-ego": 0.007142026424407959, "in-drivable-lane": 1.6000000000000068, "agent_compute-ego": 0.015426503817240396, "deviation-heading": 3.4367524430696696, "set_robot_commands": 0.007115475336710612, "deviation-center-line": 0.6959229937604363, "driven_lanedir_consec": 2.2339936851743967, "sim_compute_sim_state": 0.003597094217936198, "sim_compute_performance-ego": 0.0040779630343119305, "sim_compute_robot_state-ego": 0.005205814838409424}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6555701597984225, "sim_physics": 0.05672805865605672, "survival_time": 14.950000000000076, "driven_lanedir": 2.628711790442893, "sim_render-ego": 0.00714354674021403, "in-drivable-lane": 0, "agent_compute-ego": 0.015741279125213625, "deviation-heading": 1.5117922963492034, "set_robot_commands": 0.007177621523539225, "deviation-center-line": 0.399540861562935, "driven_lanedir_consec": 2.628711790442893, "sim_compute_sim_state": 0.003772529760996501, "sim_compute_performance-ego": 0.004037133852640788, "sim_compute_robot_state-ego": 0.005135403474171956}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.655569202164691, "sim_physics": 0.08886631806691488, "survival_time": 14.950000000000076, "driven_lanedir": 2.6416523648093353, "sim_render-ego": 0.010164244174957275, "in-drivable-lane": 0, "agent_compute-ego": 0.02408780813217163, "deviation-heading": 1.3355432693226146, "set_robot_commands": 0.009250438213348387, "deviation-center-line": 0.2914026068686066, "driven_lanedir_consec": 2.6416523648093353, "sim_compute_sim_state": 0.005155041217803955, "sim_compute_performance-ego": 0.0062337271372477215, "sim_compute_robot_state-ego": 0.007759561538696289}}
set_robot_commands_max0.009250438213348387
set_robot_commands_mean0.007601948420206705
set_robot_commands_median0.007203582922617594
set_robot_commands_min0.007115475336710612
sim_compute_performance-ego_max0.0062337271372477215
sim_compute_performance-ego_mean0.004514352003733317
sim_compute_performance-ego_median0.0040779630343119305
sim_compute_performance-ego_min0.004037133852640788
sim_compute_robot_state-ego_max0.007759561538696289
sim_compute_robot_state-ego_mean0.005681778430938721
sim_compute_robot_state-ego_median0.005154911677042643
sim_compute_robot_state-ego_min0.005135403474171956
sim_compute_sim_state_max0.005155041217803955
sim_compute_sim_state_mean0.004001974900563558
sim_compute_sim_state_median0.003772529760996501
sim_compute_sim_state_min0.003597094217936198
sim_physics_max0.08886631806691488
sim_physics_mean0.06272107489903768
sim_physics_median0.05645982424418131
sim_physics_min0.05567062536875407
sim_render-ego_max0.010164244174957275
sim_render-ego_mean0.007729540665944418
sim_render-ego_median0.00714308500289917
sim_render-ego_min0.007054800987243652
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
290465592Mikita Sazanovich 🇷🇺chameleon-7-invaido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104920:06:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
289845557Anastasiya Nikolskaya 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9881302261063496
survival_time_median14.950000000000076
deviation-center-line_median0.8810126600406453
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01829823652903239
agent_compute-ego_mean0.017949772675832112
agent_compute-ego_median0.017939248085021973
agent_compute-ego_min0.01762787183125814
deviation-center-line_max0.98389645957922
deviation-center-line_mean0.8500286652841211
deviation-center-line_min0.6757850189381135
deviation-heading_max4.512462870951504
deviation-heading_mean3.080888275442039
deviation-heading_median3.049670383331806
deviation-heading_min2.3125382817583966
driven_any_max2.042767951361035
driven_any_mean2.0414104637072144
driven_any_median2.042748838420909
driven_any_min2.0360417265903004
driven_lanedir_consec_max2.0044680668937147
driven_lanedir_consec_mean1.878032647483187
driven_lanedir_consec_min1.67361057660711
driven_lanedir_max2.0044680668937147
driven_lanedir_mean1.878032647483187
driven_lanedir_median1.9881302261063496
driven_lanedir_min1.67361057660711
in-drivable-lane_max1.7499999999999938
in-drivable-lane_mean0.6700000000000033
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0360417265903004, "sim_physics": 0.07458516836166382, "survival_time": 14.950000000000076, "driven_lanedir": 1.67361057660711, "sim_render-ego": 0.007416265805562337, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.01829823652903239, "deviation-heading": 4.512462870951504, "set_robot_commands": 0.006636128425598144, "deviation-center-line": 0.8810126600406453, "driven_lanedir_consec": 1.67361057660711, "sim_compute_sim_state": 0.00394334077835083, "sim_compute_performance-ego": 0.004436635971069336, "sim_compute_robot_state-ego": 0.005525658130645752}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0427563548780423, "sim_physics": 0.07316423654556274, "survival_time": 14.950000000000076, "driven_lanedir": 2.0044680668937147, "sim_render-ego": 0.0075697660446166996, "in-drivable-lane": 0, "agent_compute-ego": 0.017939248085021973, "deviation-heading": 2.3125382817583966, "set_robot_commands": 0.006566526095072429, "deviation-center-line": 0.98389645957922, "driven_lanedir_consec": 2.0044680668937147, "sim_compute_sim_state": 0.003963114420572917, "sim_compute_performance-ego": 0.004356823762257894, "sim_compute_robot_state-ego": 0.0055563513437906905}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.042748838420909, "sim_physics": 0.06699130296707154, "survival_time": 14.950000000000076, "driven_lanedir": 1.723819761362654, "sim_render-ego": 0.007490136623382568, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.01762787183125814, "deviation-heading": 3.049670383331806, "set_robot_commands": 0.0062401342391967774, "deviation-center-line": 0.9816214999022076, "driven_lanedir_consec": 1.723819761362654, "sim_compute_sim_state": 0.004072613716125488, "sim_compute_performance-ego": 0.004258760611216227, "sim_compute_robot_state-ego": 0.005415713787078858}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.042737447285786, "sim_physics": 0.07441612243652344, "survival_time": 14.950000000000076, "driven_lanedir": 2.0001346064461063, "sim_render-ego": 0.007532286643981934, "in-drivable-lane": 0, "agent_compute-ego": 0.0178178071975708, "deviation-heading": 2.3677574653691376, "set_robot_commands": 0.006428689956665039, "deviation-center-line": 0.6757850189381135, "driven_lanedir_consec": 2.0001346064461063, "sim_compute_sim_state": 0.0039248204231262206, "sim_compute_performance-ego": 0.004335041046142578, "sim_compute_robot_state-ego": 0.005518353780110677}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.042767951361035, "sim_physics": 0.07681077798207601, "survival_time": 14.950000000000076, "driven_lanedir": 1.9881302261063496, "sim_render-ego": 0.007688655058542888, "in-drivable-lane": 0, "agent_compute-ego": 0.018065699736277262, "deviation-heading": 3.1620123757993506, "set_robot_commands": 0.006623061498006185, "deviation-center-line": 0.7278276879604186, "driven_lanedir_consec": 1.9881302261063496, "sim_compute_sim_state": 0.0039967195192972815, "sim_compute_performance-ego": 0.004388666947682698, "sim_compute_robot_state-ego": 0.005581018924713135}}
set_robot_commands_max0.006636128425598144
set_robot_commands_mean0.006498908042907715
set_robot_commands_median0.006566526095072429
set_robot_commands_min0.0062401342391967774
sim_compute_performance-ego_max0.004436635971069336
sim_compute_performance-ego_mean0.004355185667673746
sim_compute_performance-ego_median0.004356823762257894
sim_compute_performance-ego_min0.004258760611216227
sim_compute_robot_state-ego_max0.005581018924713135
sim_compute_robot_state-ego_mean0.005519419193267823
sim_compute_robot_state-ego_median0.005525658130645752
sim_compute_robot_state-ego_min0.005415713787078858
sim_compute_sim_state_max0.004072613716125488
sim_compute_sim_state_mean0.003980121771494548
sim_compute_sim_state_median0.003963114420572917
sim_compute_sim_state_min0.0039248204231262206
sim_physics_max0.07681077798207601
sim_physics_mean0.07319352165857951
sim_physics_median0.07441612243652344
sim_physics_min0.06699130296707154
sim_render-ego_max0.007688655058542888
sim_render-ego_mean0.0075394220352172844
sim_render-ego_median0.007532286643981934
sim_render-ego_min0.007416265805562337
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
289775554Mikita Sazanovich 🇷🇺chameleon-4aido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104920:19:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
289655545Mikita Sazanovich 🇷🇺chameleon-4aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.717366182481659
survival_time_median14.950000000000076
deviation-center-line_median0.742073926446891
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1723981738090515
agent_compute-ego_mean0.17138783964346938
agent_compute-ego_median0.17114349524180095
agent_compute-ego_min0.17071664412816365
deviation-center-line_max0.893211542390976
deviation-center-line_mean0.7174302447116123
deviation-center-line_min0.3583290475910861
deviation-heading_max4.295504514842567
deviation-heading_mean3.0602750083730075
deviation-heading_median3.0960975210365556
deviation-heading_min1.721468323944096
driven_any_max5.042029904055536
driven_any_mean3.9325432938612623
driven_any_median4.258773424897902
driven_any_min1.9796495200636377
driven_lanedir_consec_max4.878729714289103
driven_lanedir_consec_mean3.657729945583749
driven_lanedir_consec_min1.772739335438383
driven_lanedir_max4.878729714289103
driven_lanedir_mean3.657729945583749
driven_lanedir_median3.717366182481659
driven_lanedir_min1.772739335438383
in-drivable-lane_max2.45
in-drivable-lane_mean0.5499999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9796495200636377, "sim_physics": 0.05545678099647897, "survival_time": 6.099999999999986, "driven_lanedir": 1.772739335438383, "sim_render-ego": 0.007154003518526671, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.17112121816541329, "deviation-heading": 1.721468323944096, "set_robot_commands": 0.00505772379578137, "deviation-center-line": 0.3583290475910861, "driven_lanedir_consec": 1.772739335438383, "sim_compute_sim_state": 0.0029306274945618675, "sim_compute_performance-ego": 0.004205533715545154, "sim_compute_robot_state-ego": 0.005077831080702484}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.258773424897902, "sim_physics": 0.05549433390299479, "survival_time": 14.950000000000076, "driven_lanedir": 3.584804029906403, "sim_render-ego": 0.007002686659495036, "in-drivable-lane": 2.45, "agent_compute-ego": 0.17114349524180095, "deviation-heading": 4.295504514842567, "set_robot_commands": 0.004920098781585693, "deviation-center-line": 0.8869809535729584, "driven_lanedir_consec": 3.584804029906403, "sim_compute_sim_state": 0.0029487013816833496, "sim_compute_performance-ego": 0.003979001045227051, "sim_compute_robot_state-ego": 0.005072989463806152}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.042029904055536, "sim_physics": 0.055944024721781414, "survival_time": 14.950000000000076, "driven_lanedir": 4.878729714289103, "sim_render-ego": 0.007125491301218668, "in-drivable-lane": 0, "agent_compute-ego": 0.1723981738090515, "deviation-heading": 3.11552932557963, "set_robot_commands": 0.005027146339416504, "deviation-center-line": 0.893211542390976, "driven_lanedir_consec": 4.878729714289103, "sim_compute_sim_state": 0.0029872814814249677, "sim_compute_performance-ego": 0.004009722073872884, "sim_compute_robot_state-ego": 0.005137433211008707}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.885331516295515, "sim_physics": 0.05418506811620591, "survival_time": 13.350000000000056, "driven_lanedir": 3.717366182481659, "sim_render-ego": 0.007097748781411389, "in-drivable-lane": 0, "agent_compute-ego": 0.1715596668729175, "deviation-heading": 3.0960975210365556, "set_robot_commands": 0.005004463124364503, "deviation-center-line": 0.7065557535561503, "driven_lanedir_consec": 3.717366182481659, "sim_compute_sim_state": 0.0030126660950621415, "sim_compute_performance-ego": 0.004003517636645599, "sim_compute_robot_state-ego": 0.005105381154835447}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.496932103993719, "sim_physics": 0.055454965432484946, "survival_time": 14.950000000000076, "driven_lanedir": 4.335010465803198, "sim_render-ego": 0.007061607837677002, "in-drivable-lane": 0, "agent_compute-ego": 0.17071664412816365, "deviation-heading": 3.0727753564621896, "set_robot_commands": 0.004967188040415446, "deviation-center-line": 0.742073926446891, "driven_lanedir_consec": 4.335010465803198, "sim_compute_sim_state": 0.0029743226369222005, "sim_compute_performance-ego": 0.003985437552134196, "sim_compute_robot_state-ego": 0.005081578890482585}}
set_robot_commands_max0.00505772379578137
set_robot_commands_mean0.004995324016312703
set_robot_commands_median0.005004463124364503
set_robot_commands_min0.004920098781585693
sim_compute_performance-ego_max0.004205533715545154
sim_compute_performance-ego_mean0.004036642404684977
sim_compute_performance-ego_median0.004003517636645599
sim_compute_performance-ego_min0.003979001045227051
sim_compute_robot_state-ego_max0.005137433211008707
sim_compute_robot_state-ego_mean0.005095042760167076
sim_compute_robot_state-ego_median0.005081578890482585
sim_compute_robot_state-ego_min0.005072989463806152
sim_compute_sim_state_max0.0030126660950621415
sim_compute_sim_state_mean0.002970719817930905
sim_compute_sim_state_median0.0029743226369222005
sim_compute_sim_state_min0.0029306274945618675
sim_physics_max0.055944024721781414
sim_physics_mean0.055307034633989206
sim_physics_median0.05545678099647897
sim_physics_min0.05418506811620591
sim_render-ego_max0.007154003518526671
sim_render-ego_mean0.007088307619665754
sim_render-ego_median0.007097748781411389
sim_render-ego_min0.007002686659495036
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.860000000000053
survival_time_min6.099999999999986
No reset possible
289105542Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:03:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6304967852425585
survival_time_median2.849999999999998
deviation-center-line_median0.14059522635951838
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.020778609646691214
agent_compute-ego_mean0.019721485273879916
agent_compute-ego_median0.019451646538047523
agent_compute-ego_min0.019205381995753237
deviation-center-line_max0.6824388985908697
deviation-center-line_mean0.3034414984554644
deviation-center-line_min0.12437306135117451
deviation-heading_max2.104246655094687
deviation-heading_mean0.7854574724563946
deviation-heading_median0.49385198318219053
deviation-heading_min0.25504732523308754
driven_any_max2.904296151048286
driven_any_mean1.2547513854468506
driven_any_median0.7492231695538154
driven_any_min0.359677185998303
driven_lanedir_consec_max2.472933104814708
driven_lanedir_consec_mean1.0449491936772872
driven_lanedir_consec_min0.3531509326735003
driven_lanedir_max2.472933104814708
driven_lanedir_mean1.0449491936772872
driven_lanedir_median0.6304967852425585
driven_lanedir_min0.3531509326735003
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean0.6400000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.44110419673345413, "sim_physics": 0.05962136056688097, "survival_time": 1.800000000000001, "driven_lanedir": 0.42769223785423616, "sim_render-ego": 0.007449169953664144, "in-drivable-lane": 0, "agent_compute-ego": 0.020778609646691214, "deviation-heading": 0.4407940157884602, "set_robot_commands": 0.005106767018636067, "deviation-center-line": 0.14059522635951838, "driven_lanedir_consec": 0.42769223785423616, "sim_compute_sim_state": 0.003046731154123942, "sim_compute_performance-ego": 0.004394749800364177, "sim_compute_robot_state-ego": 0.005257301860385471}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.359677185998303, "sim_physics": 0.05897311811093931, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3531509326735003, "sim_render-ego": 0.007282089304040979, "in-drivable-lane": 0, "agent_compute-ego": 0.01943187360410337, "deviation-heading": 0.25504732523308754, "set_robot_commands": 0.004947459256207502, "deviation-center-line": 0.13687980667980434, "driven_lanedir_consec": 0.3531509326735003, "sim_compute_sim_state": 0.002909510223953812, "sim_compute_performance-ego": 0.003988981246948242, "sim_compute_robot_state-ego": 0.005256308449639214}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7492231695538154, "sim_physics": 0.056856653146576466, "survival_time": 2.849999999999998, "driven_lanedir": 0.6304967852425585, "sim_render-ego": 0.007168514686718322, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.019205381995753237, "deviation-heading": 0.49385198318219053, "set_robot_commands": 0.004799570953636838, "deviation-center-line": 0.12437306135117451, "driven_lanedir_consec": 0.6304967852425585, "sim_compute_sim_state": 0.0028753698917857386, "sim_compute_performance-ego": 0.003975943515175267, "sim_compute_robot_state-ego": 0.005314132623505174}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.8194562239003935, "sim_physics": 0.05631988365333397, "survival_time": 7.149999999999983, "driven_lanedir": 1.3404729078014332, "sim_render-ego": 0.00722806270305927, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.019451646538047523, "deviation-heading": 0.6333473829835476, "set_robot_commands": 0.0049518788611138615, "deviation-center-line": 0.432920499295955, "driven_lanedir_consec": 1.3404729078014332, "sim_compute_sim_state": 0.0030508741632208126, "sim_compute_performance-ego": 0.004079363562844016, "sim_compute_robot_state-ego": 0.005250829083102567}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.904296151048286, "sim_physics": 0.054824584239238014, "survival_time": 11.100000000000025, "driven_lanedir": 2.472933104814708, "sim_render-ego": 0.007292408126968521, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.019739914584804227, "deviation-heading": 2.104246655094687, "set_robot_commands": 0.005028604387163042, "deviation-center-line": 0.6824388985908697, "driven_lanedir_consec": 2.472933104814708, "sim_compute_sim_state": 0.0030393407151505752, "sim_compute_performance-ego": 0.0040969730497480514, "sim_compute_robot_state-ego": 0.0052034296430982984}}
set_robot_commands_max0.005106767018636067
set_robot_commands_mean0.0049668560953514615
set_robot_commands_median0.0049518788611138615
set_robot_commands_min0.004799570953636838
sim_compute_performance-ego_max0.004394749800364177
sim_compute_performance-ego_mean0.004107202235015951
sim_compute_performance-ego_median0.004079363562844016
sim_compute_performance-ego_min0.003975943515175267
sim_compute_robot_state-ego_max0.005314132623505174
sim_compute_robot_state-ego_mean0.0052564003319461455
sim_compute_robot_state-ego_median0.005256308449639214
sim_compute_robot_state-ego_min0.0052034296430982984
sim_compute_sim_state_max0.0030508741632208126
sim_compute_sim_state_mean0.002984365229646976
sim_compute_sim_state_median0.0030393407151505752
sim_compute_sim_state_min0.0028753698917857386
sim_physics_max0.05962136056688097
sim_physics_mean0.05731911994339375
sim_physics_median0.056856653146576466
sim_physics_min0.054824584239238014
sim_render-ego_max0.007449169953664144
sim_render-ego_mean0.007284048954890247
sim_render-ego_median0.007282089304040979
sim_render-ego_min0.007168514686718322
simulation-passed1
survival_time_max11.100000000000025
survival_time_mean4.8500000000000005
survival_time_min1.3500000000000003
No reset possible
288875535Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-validationstep1-simulationabortedyesip-172-31-46-148-104920:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
288835534Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4082841284840635
survival_time_median14.950000000000076
deviation-center-line_median0.6883330446924795
in-drivable-lane_median0


other stats
agent_compute-ego_max0.019826966126759847
agent_compute-ego_mean0.019427009105682375
agent_compute-ego_median0.01939241965611776
agent_compute-ego_min0.01918284734090169
deviation-center-line_max1.0662083851966475
deviation-center-line_mean0.7705917031862778
deviation-center-line_min0.6017652195970994
deviation-heading_max3.3216015531154173
deviation-heading_mean2.625669850590512
deviation-heading_median2.5254773817718705
deviation-heading_min2.1939427520738275
driven_any_max2.707726928534936
driven_any_mean2.2896299234573996
driven_any_median2.44031351700247
driven_any_min1.6576359507486331
driven_lanedir_consec_max2.6572610592346178
driven_lanedir_consec_mean2.1946608977516995
driven_lanedir_consec_min1.3530934038761555
driven_lanedir_max2.6572610592346178
driven_lanedir_mean2.1946608977516995
driven_lanedir_median2.4082841284840635
driven_lanedir_min1.3530934038761555
in-drivable-lane_max1.4500000000000162
in-drivable-lane_mean0.29000000000000326
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6576359507486331, "sim_physics": 0.05741217056910197, "survival_time": 14.950000000000076, "driven_lanedir": 1.3530934038761555, "sim_render-ego": 0.007095646063486735, "in-drivable-lane": 1.4500000000000162, "agent_compute-ego": 0.01954060951868693, "deviation-heading": 3.3216015531154173, "set_robot_commands": 0.00500883420308431, "deviation-center-line": 0.6854038958195704, "driven_lanedir_consec": 1.3530934038761555, "sim_compute_sim_state": 0.0029677502314249676, "sim_compute_performance-ego": 0.0041213369369506835, "sim_compute_robot_state-ego": 0.005179898738861084}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.44031351700247, "sim_physics": 0.05663461526234945, "survival_time": 14.950000000000076, "driven_lanedir": 2.4082841284840635, "sim_render-ego": 0.007250605424245198, "in-drivable-lane": 0, "agent_compute-ego": 0.01919220288594564, "deviation-heading": 2.1939427520738275, "set_robot_commands": 0.005012177626291911, "deviation-center-line": 1.0662083851966475, "driven_lanedir_consec": 2.4082841284840635, "sim_compute_sim_state": 0.003000077406565348, "sim_compute_performance-ego": 0.004036124547322591, "sim_compute_robot_state-ego": 0.0051829123497009275}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9654579008300752, "sim_physics": 0.05508808453877767, "survival_time": 14.950000000000076, "driven_lanedir": 1.925204828384149, "sim_render-ego": 0.0071217727661132815, "in-drivable-lane": 0, "agent_compute-ego": 0.01918284734090169, "deviation-heading": 2.51403429300226, "set_robot_commands": 0.005025045871734619, "deviation-center-line": 0.6883330446924795, "driven_lanedir_consec": 1.925204828384149, "sim_compute_sim_state": 0.0030191723505655923, "sim_compute_performance-ego": 0.004031234582265218, "sim_compute_robot_state-ego": 0.005186203320821126}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.707726928534936, "sim_physics": 0.058610462347666425, "survival_time": 14.950000000000076, "driven_lanedir": 2.6572610592346178, "sim_render-ego": 0.007165405750274658, "in-drivable-lane": 0, "agent_compute-ego": 0.019826966126759847, "deviation-heading": 2.573293272989187, "set_robot_commands": 0.004975254535675049, "deviation-center-line": 0.6017652195970994, "driven_lanedir_consec": 2.6572610592346178, "sim_compute_sim_state": 0.003058568636576335, "sim_compute_performance-ego": 0.004039352734883627, "sim_compute_robot_state-ego": 0.005217353502909343}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.677015320170883, "sim_physics": 0.058035518328348794, "survival_time": 14.950000000000076, "driven_lanedir": 2.629461068779512, "sim_render-ego": 0.007206039428710937, "in-drivable-lane": 0, "agent_compute-ego": 0.01939241965611776, "deviation-heading": 2.5254773817718705, "set_robot_commands": 0.0049823570251464845, "deviation-center-line": 0.8112479706255916, "driven_lanedir_consec": 2.629461068779512, "sim_compute_sim_state": 0.0030551592508951822, "sim_compute_performance-ego": 0.004062433242797852, "sim_compute_robot_state-ego": 0.0051897549629211425}}
set_robot_commands_max0.005025045871734619
set_robot_commands_mean0.005000733852386475
set_robot_commands_median0.00500883420308431
set_robot_commands_min0.004975254535675049
sim_compute_performance-ego_max0.0041213369369506835
sim_compute_performance-ego_mean0.004058096408843994
sim_compute_performance-ego_median0.004039352734883627
sim_compute_performance-ego_min0.004031234582265218
sim_compute_robot_state-ego_max0.005217353502909343
sim_compute_robot_state-ego_mean0.005191224575042725
sim_compute_robot_state-ego_median0.005186203320821126
sim_compute_robot_state-ego_min0.005179898738861084
sim_compute_sim_state_max0.003058568636576335
sim_compute_sim_state_mean0.003020145575205485
sim_compute_sim_state_median0.0030191723505655923
sim_compute_sim_state_min0.0029677502314249676
sim_physics_max0.058610462347666425
sim_physics_mean0.05715617020924886
sim_physics_median0.05741217056910197
sim_physics_min0.05508808453877767
sim_render-ego_max0.007250605424245198
sim_render-ego_mean0.007167893886566162
sim_render-ego_median0.007165405750274658
sim_render-ego_min0.007095646063486735
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
288615521Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:14:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2490948428596744
survival_time_median11.500000000000028
deviation-center-line_median0.5801255207159007
in-drivable-lane_median1.2500000000000178


other stats
agent_compute-ego_max0.030180521996698698
agent_compute-ego_mean0.028808133893746223
agent_compute-ego_median0.02865425918413245
agent_compute-ego_min0.028450794219970703
deviation-center-line_max0.9451627450723386
deviation-center-line_mean0.5019744300408236
deviation-center-line_min0.09659768290794084
deviation-heading_max3.3743830683185094
deviation-heading_mean1.854978203616375
deviation-heading_median2.1161288596947805
deviation-heading_min0.274543391671895
driven_any_max5.570423439587709
driven_any_mean3.404745550873835
driven_any_median4.314135544330835
driven_any_min0.6017300558086223
driven_lanedir_consec_max5.484490978851953
driven_lanedir_consec_mean2.9210288949113954
driven_lanedir_consec_min0.5912110168027196
driven_lanedir_max5.484490978851953
driven_lanedir_mean2.9210288949113954
driven_lanedir_median3.2490948428596744
driven_lanedir_min0.5912110168027196
in-drivable-lane_max4.1500000000000306
in-drivable-lane_mean1.1733333333333416
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.706312328116584, "sim_physics": 0.05500281252984191, "survival_time": 13.550000000000058, "driven_lanedir": 3.2490948428596744, "sim_render-ego": 0.007079426212944228, "in-drivable-lane": 4.1500000000000306, "agent_compute-ego": 0.030180521996698698, "deviation-heading": 2.6718060337458582, "set_robot_commands": 0.004952648029116247, "deviation-center-line": 0.5801255207159007, "driven_lanedir_consec": 3.2490948428596744, "sim_compute_sim_state": 0.0029479348791481385, "sim_compute_performance-ego": 0.004093840553311844, "sim_compute_robot_state-ego": 0.005105090757137735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.3160058861770825, "sim_physics": 0.05464975357055664, "survival_time": 14.950000000000076, "driven_lanedir": 4.610487521518275, "sim_render-ego": 0.007133300304412842, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.028853980700174968, "deviation-heading": 3.3743830683185094, "set_robot_commands": 0.005001672108968099, "deviation-center-line": 0.9451627450723386, "driven_lanedir_consec": 4.610487521518275, "sim_compute_sim_state": 0.0029942870140075685, "sim_compute_performance-ego": 0.004005197683970133, "sim_compute_robot_state-ego": 0.005090501308441162}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0414802018349891, "sim_physics": 0.05422140422620272, "survival_time": 2.849999999999998, "driven_lanedir": 0.6777794966162887, "sim_render-ego": 0.0071532893599125374, "in-drivable-lane": 0.9499999999999968, "agent_compute-ego": 0.028513276786134953, "deviation-heading": 0.3811110073714766, "set_robot_commands": 0.004974055708500377, "deviation-center-line": 0.13499692313080577, "driven_lanedir_consec": 0.6777794966162887, "sim_compute_sim_state": 0.002948033182244552, "sim_compute_performance-ego": 0.003945626710590564, "sim_compute_robot_state-ego": 0.004911334891068308}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6017300558086223, "sim_physics": 0.057540213360505944, "survival_time": 1.7000000000000008, "driven_lanedir": 0.5912110168027196, "sim_render-ego": 0.007274578599368825, "in-drivable-lane": 0, "agent_compute-ego": 0.028484281371621525, "deviation-heading": 0.274543391671895, "set_robot_commands": 0.005044327062719008, "deviation-center-line": 0.09659768290794084, "driven_lanedir_consec": 0.5912110168027196, "sim_compute_sim_state": 0.0029553525588091683, "sim_compute_performance-ego": 0.004010095315821031, "sim_compute_robot_state-ego": 0.005084037780761719}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.532092175720739, "sim_physics": 0.05577050574282382, "survival_time": 11.750000000000032, "driven_lanedir": 4.017805989518605, "sim_render-ego": 0.007094859062357152, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.028593251045714033, "deviation-heading": 1.7768045348678545, "set_robot_commands": 0.00499236431527645, "deviation-center-line": 0.4572811489454457, "driven_lanedir_consec": 4.017805989518605, "sim_compute_sim_state": 0.0029609183047680145, "sim_compute_performance-ego": 0.0039926518785192615, "sim_compute_robot_state-ego": 0.005030496069725524}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.4801223308648703, "sim_physics": 0.05376665626091979, "survival_time": 10.550000000000017, "driven_lanedir": 2.748381513407654, "sim_render-ego": 0.007136262423619275, "in-drivable-lane": 2.0000000000000133, "agent_compute-ego": 0.02868624660076123, "deviation-heading": 2.3549047851781286, "set_robot_commands": 0.004990611596130082, "deviation-center-line": 0.5938006462572271, "driven_lanedir_consec": 2.748381513407654, "sim_compute_sim_state": 0.002991364465505591, "sim_compute_performance-ego": 0.0039934072449309, "sim_compute_robot_state-ego": 0.005082889755755239}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.503696943519976, "sim_physics": 0.05334239951835191, "survival_time": 12.100000000000035, "driven_lanedir": 3.8430895853360982, "sim_render-ego": 0.007105464777670616, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.028508226733562375, "deviation-heading": 2.1161288596947805, "set_robot_commands": 0.004989650623857482, "deviation-center-line": 0.7495855876766324, "driven_lanedir_consec": 3.8430895853360982, "sim_compute_sim_state": 0.002971052138273381, "sim_compute_performance-ego": 0.003985188224098899, "sim_compute_robot_state-ego": 0.005047699636664273}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.941936499800715, "sim_physics": 0.05394961783935974, "survival_time": 14.300000000000068, "driven_lanedir": 4.291714524525591, "sim_render-ego": 0.007961873407964106, "in-drivable-lane": 1.4500000000000135, "agent_compute-ego": 0.028682502833279697, "deviation-heading": 2.680569540326309, "set_robot_commands": 0.005019793143639198, "deviation-center-line": 0.7520494155246636, "driven_lanedir_consec": 4.291714524525591, "sim_compute_sim_state": 0.0029970374140706095, "sim_compute_performance-ego": 0.004046961977765277, "sim_compute_robot_state-ego": 0.005058557003528088}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.3215254613876606, "sim_physics": 0.05501582564377203, "survival_time": 4.099999999999993, "driven_lanedir": 1.21558279119453, "sim_render-ego": 0.007222207581124655, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.028947725528624, "deviation-heading": 1.018290705046254, "set_robot_commands": 0.004975917862682808, "deviation-center-line": 0.23992563084728744, "driven_lanedir_consec": 1.21558279119453, "sim_compute_sim_state": 0.0029973227803300065, "sim_compute_performance-ego": 0.0040037486611343015, "sim_compute_robot_state-ego": 0.005132241946894948}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0015327960387443, "sim_physics": 0.05483528772989909, "survival_time": 2.9999999999999973, "driven_lanedir": 0.7992653772549199, "sim_render-ego": 0.010771739482879638, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.02851878801981608, "deviation-heading": 0.7372678486664398, "set_robot_commands": 0.005104641119639079, "deviation-center-line": 0.15710916982799802, "driven_lanedir_consec": 0.7992653772549199, "sim_compute_sim_state": 0.003068768978118897, "sim_compute_performance-ego": 0.004063896338144938, "sim_compute_robot_state-ego": 0.0052054524421691895}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0837198600837636, "sim_physics": 0.05581831932067871, "survival_time": 3.049999999999997, "driven_lanedir": 0.7864183386780021, "sim_render-ego": 0.007509661502525454, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.02899585786412974, "deviation-heading": 0.6539709713621787, "set_robot_commands": 0.005078550244941086, "deviation-center-line": 0.23836616737887212, "driven_lanedir_consec": 0.7864183386780021, "sim_compute_sim_state": 0.003094610620717533, "sim_compute_performance-ego": 0.004166528826854268, "sim_compute_robot_state-ego": 0.005250989413652264}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 3.239336669599669, "sim_physics": 0.05464994327442066, "survival_time": 9.249999999999996, "driven_lanedir": 3.145281632336574, "sim_render-ego": 0.007082248378444362, "in-drivable-lane": 0, "agent_compute-ego": 0.029424345171129383, "deviation-heading": 1.990623094179023, "set_robot_commands": 0.005031362739769188, "deviation-center-line": 0.5503617688280622, "driven_lanedir_consec": 3.145281632336574, "sim_compute_sim_state": 0.0029843485033189928, "sim_compute_performance-ego": 0.003992881001652898, "sim_compute_robot_state-ego": 0.0050005887005780195}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.314135544330835, "sim_physics": 0.05420090737550155, "survival_time": 11.500000000000028, "driven_lanedir": 3.572307465948938, "sim_render-ego": 0.0071018996446029, "in-drivable-lane": 1.650000000000012, "agent_compute-ego": 0.02865425918413245, "deviation-heading": 2.4479516820874756, "set_robot_commands": 0.0049370527267456055, "deviation-center-line": 0.5806266615985574, "driven_lanedir_consec": 3.572307465948938, "sim_compute_sim_state": 0.0029787416043488874, "sim_compute_performance-ego": 0.004001400781714398, "sim_compute_robot_state-ego": 0.005094021299610967}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 5.570423439587709, "sim_physics": 0.05399544397989909, "survival_time": 14.950000000000076, "driven_lanedir": 5.484490978851953, "sim_render-ego": 0.007059687773386637, "in-drivable-lane": 0, "agent_compute-ego": 0.028450794219970703, "deviation-heading": 2.5210973552149323, "set_robot_commands": 0.005019338925679525, "deviation-center-line": 0.646477914314688, "driven_lanedir_consec": 5.484490978851953, "sim_compute_sim_state": 0.002980153560638428, "sim_compute_performance-ego": 0.0039966368675231935, "sim_compute_robot_state-ego": 0.0049784715970357255}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.417133070235573, "sim_physics": 0.05529993216196696, "survival_time": 14.950000000000076, "driven_lanedir": 4.782522348821108, "sim_render-ego": 0.007087942759195964, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.02862795035044352, "deviation-heading": 2.8252201765145104, "set_robot_commands": 0.005004370212554931, "deviation-center-line": 0.8071494675859356, "driven_lanedir_consec": 4.782522348821108, "sim_compute_sim_state": 0.0030139891306559244, "sim_compute_performance-ego": 0.004007370471954346, "sim_compute_robot_state-ego": 0.005101191202799479}}
set_robot_commands_max0.005104641119639079
set_robot_commands_mean0.005007757094681278
set_robot_commands_median0.005001672108968099
set_robot_commands_min0.0049370527267456055
sim_compute_performance-ego_max0.004166528826854268
sim_compute_performance-ego_mean0.004020362169199083
sim_compute_performance-ego_median0.0040037486611343015
sim_compute_performance-ego_min0.003945626710590564
sim_compute_robot_state-ego_max0.005250989413652264
sim_compute_robot_state-ego_mean0.005078237587054843
sim_compute_robot_state-ego_median0.005084037780761719
sim_compute_robot_state-ego_min0.004911334891068308
sim_compute_sim_state_max0.003094610620717533
sim_compute_sim_state_mean0.002992261008997047
sim_compute_sim_state_median0.0029843485033189928
sim_compute_sim_state_min0.0029479348791481385
sim_physics_max0.057540213360505944
sim_physics_mean0.0548039348356467
sim_physics_median0.05464994327442066
sim_physics_min0.05334239951835191
sim_render-ego_max0.010771739482879638
sim_render-ego_mean0.00745162941802728
sim_render-ego_median0.007133300304412842
sim_render-ego_min0.007059687773386637
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.503333333333364
survival_time_min1.7000000000000008
No reset possible
288605520Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.550417436596444
survival_time_median5.399999999999989
deviation-center-line_median0.23259737841408115
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.03189425556748002
agent_compute-ego_mean0.02902895711779444
agent_compute-ego_median0.028485384563471647
agent_compute-ego_min0.02787704155093334
deviation-center-line_max0.6354333113519446
deviation-center-line_mean0.29050829258949
deviation-center-line_min0.10141708058834176
deviation-heading_max2.099601320977696
deviation-heading_mean0.9420060809476558
deviation-heading_median0.8963439446332658
deviation-heading_min0.29153843265306867
driven_any_max3.889709474823775
driven_any_mean2.106836177374052
driven_any_median1.8963462233405937
driven_any_min0.6256415846470701
driven_lanedir_consec_max3.336815790307192
driven_lanedir_consec_mean1.904896566152876
driven_lanedir_consec_min0.6140107165569222
driven_lanedir_max3.336815790307192
driven_lanedir_mean1.904896566152876
driven_lanedir_median1.550417436596444
driven_lanedir_min0.6140107165569222
in-drivable-lane_max1.7000000000000242
in-drivable-lane_mean0.560000000000004
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8963462233405937, "sim_physics": 0.05953391393025717, "survival_time": 5.399999999999989, "driven_lanedir": 1.550417436596444, "sim_render-ego": 0.007337168410972312, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.03189425556748002, "deviation-heading": 0.8963439446332658, "set_robot_commands": 0.005007693061122188, "deviation-center-line": 0.23259737841408115, "driven_lanedir_consec": 1.550417436596444, "sim_compute_sim_state": 0.0030319801083317508, "sim_compute_performance-ego": 0.004218289145716914, "sim_compute_robot_state-ego": 0.005217611789703369}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.889709474823775, "sim_physics": 0.058947104268369424, "survival_time": 11.300000000000026, "driven_lanedir": 3.336815790307192, "sim_render-ego": 0.007189525967150663, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.0287708286690501, "deviation-heading": 2.099601320977696, "set_robot_commands": 0.005043037169802506, "deviation-center-line": 0.6354333113519446, "driven_lanedir_consec": 3.336815790307192, "sim_compute_sim_state": 0.003060975960925617, "sim_compute_performance-ego": 0.004048951959188005, "sim_compute_robot_state-ego": 0.00518788384125296}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.080319877492052, "sim_physics": 0.055200365723156536, "survival_time": 3.049999999999997, "driven_lanedir": 1.015277378679844, "sim_render-ego": 0.007208851517223921, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.02787704155093334, "deviation-heading": 0.4265531113837646, "set_robot_commands": 0.005000391944510038, "deviation-center-line": 0.18947708820216652, "driven_lanedir_consec": 1.015277378679844, "sim_compute_sim_state": 0.002998223070238458, "sim_compute_performance-ego": 0.00400233268737793, "sim_compute_robot_state-ego": 0.005011667970751152}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6256415846470701, "sim_physics": 0.05803326879228864, "survival_time": 1.7500000000000009, "driven_lanedir": 0.6140107165569222, "sim_render-ego": 0.007210097994123186, "in-drivable-lane": 0, "agent_compute-ego": 0.028117275238037108, "deviation-heading": 0.29153843265306867, "set_robot_commands": 0.004888343811035156, "deviation-center-line": 0.10141708058834176, "driven_lanedir_consec": 0.6140107165569222, "sim_compute_sim_state": 0.0029749461582728796, "sim_compute_performance-ego": 0.003977353232247489, "sim_compute_robot_state-ego": 0.004928445816040039}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.04216372656677, "sim_physics": 0.055418190540083304, "survival_time": 7.449999999999981, "driven_lanedir": 3.0079615086239766, "sim_render-ego": 0.007081193411910294, "in-drivable-lane": 0, "agent_compute-ego": 0.028485384563471647, "deviation-heading": 0.9959935950904846, "set_robot_commands": 0.004979884064437559, "deviation-center-line": 0.2936166043909159, "driven_lanedir_consec": 3.0079615086239766, "sim_compute_sim_state": 0.0029824132087246684, "sim_compute_performance-ego": 0.003982771163018758, "sim_compute_robot_state-ego": 0.005020989667649237}}
set_robot_commands_max0.005043037169802506
set_robot_commands_mean0.00498387001018149
set_robot_commands_median0.005000391944510038
set_robot_commands_min0.004888343811035156
sim_compute_performance-ego_max0.004218289145716914
sim_compute_performance-ego_mean0.004045939637509819
sim_compute_performance-ego_median0.00400233268737793
sim_compute_performance-ego_min0.003977353232247489
sim_compute_robot_state-ego_max0.005217611789703369
sim_compute_robot_state-ego_mean0.005073319817079352
sim_compute_robot_state-ego_median0.005020989667649237
sim_compute_robot_state-ego_min0.004928445816040039
sim_compute_sim_state_max0.003060975960925617
sim_compute_sim_state_mean0.0030097077012986744
sim_compute_sim_state_median0.002998223070238458
sim_compute_sim_state_min0.0029749461582728796
sim_physics_max0.05953391393025717
sim_physics_mean0.05742656865083101
sim_physics_median0.05803326879228864
sim_physics_min0.055200365723156536
sim_render-ego_max0.007337168410972312
sim_render-ego_mean0.007205367460276074
sim_render-ego_median0.007208851517223921
sim_render-ego_min0.007081193411910294
simulation-passed1
survival_time_max11.300000000000026
survival_time_mean5.789999999999998
survival_time_min1.7500000000000009
No reset possible
288575519Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:13:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1744049639096916
survival_time_median7.099999999999983
deviation-center-line_median0.474146171687852
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.03091690319926799
agent_compute-ego_mean0.028616884886309982
agent_compute-ego_median0.02849340767695986
agent_compute-ego_min0.027994527373203012
deviation-center-line_max0.9799583854889544
deviation-center-line_mean0.4841195297022701
deviation-center-line_min0.1576225042619824
deviation-heading_max3.583802534070456
deviation-heading_mean1.691969571926034
deviation-heading_median1.60858198904838
deviation-heading_min0.4876983713377494
driven_any_max5.731142873142284
driven_any_mean2.868629255249562
driven_any_median2.4870388086639443
driven_any_min0.9626559984856238
driven_lanedir_consec_max5.398540555516094
driven_lanedir_consec_mean2.5531918479196327
driven_lanedir_consec_min0.6994536612258562
driven_lanedir_max5.398540555516094
driven_lanedir_mean2.5531918479196327
driven_lanedir_median2.1744049639096916
driven_lanedir_min0.6994536612258562
in-drivable-lane_max2.3499999999999917
in-drivable-lane_mean0.6066666666666662
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0288191308788925, "sim_physics": 0.058109830407535326, "survival_time": 5.949999999999987, "driven_lanedir": 1.0229345433331338, "sim_render-ego": 0.007054877882244207, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.03091690319926799, "deviation-heading": 1.60858198904838, "set_robot_commands": 0.005098483141730814, "deviation-center-line": 0.2620556803075978, "driven_lanedir_consec": 1.0229345433331338, "sim_compute_sim_state": 0.003005210091085995, "sim_compute_performance-ego": 0.004234131644753849, "sim_compute_robot_state-ego": 0.005066096281804959}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7796148700128263, "sim_physics": 0.058257082959155104, "survival_time": 7.149999999999983, "driven_lanedir": 2.2021001585713424, "sim_render-ego": 0.007054862442550125, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.028445067105593386, "deviation-heading": 1.895577696767902, "set_robot_commands": 0.005022940935788455, "deviation-center-line": 0.4751223104935159, "driven_lanedir_consec": 2.2021001585713424, "sim_compute_sim_state": 0.003012055283659822, "sim_compute_performance-ego": 0.0039691658286781575, "sim_compute_robot_state-ego": 0.005068904036408538}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4870388086639443, "sim_physics": 0.057806293729325414, "survival_time": 7.099999999999983, "driven_lanedir": 2.1744049639096916, "sim_render-ego": 0.007177623224930024, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.02867182039878738, "deviation-heading": 1.2096205370123854, "set_robot_commands": 0.005076782804139903, "deviation-center-line": 0.5726432557788652, "driven_lanedir_consec": 2.1744049639096916, "sim_compute_sim_state": 0.0030855712756304673, "sim_compute_performance-ego": 0.004047778290762028, "sim_compute_robot_state-ego": 0.005156886409705793}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0904106906682487, "sim_physics": 0.05651657755781964, "survival_time": 8.199999999999982, "driven_lanedir": 2.910065065740457, "sim_render-ego": 0.006990889223610483, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02822280657000658, "deviation-heading": 2.147740223711017, "set_robot_commands": 0.005014223296467851, "deviation-center-line": 0.7609603595493764, "driven_lanedir_consec": 2.910065065740457, "sim_compute_sim_state": 0.002996988412810535, "sim_compute_performance-ego": 0.003960828955580548, "sim_compute_robot_state-ego": 0.004957098786423846}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.731142873142284, "sim_physics": 0.05891679048538208, "survival_time": 14.950000000000076, "driven_lanedir": 5.398540555516094, "sim_render-ego": 0.0071123743057250974, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.028731871445973715, "deviation-heading": 2.73346215107574, "set_robot_commands": 0.0050400249163309735, "deviation-center-line": 0.8374424891907942, "driven_lanedir_consec": 5.398540555516094, "sim_compute_sim_state": 0.003042167822519938, "sim_compute_performance-ego": 0.004009794394175211, "sim_compute_robot_state-ego": 0.005151505470275879}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.806845879515326, "sim_physics": 0.054957451025644935, "survival_time": 14.950000000000076, "driven_lanedir": 4.6442422313199945, "sim_render-ego": 0.0069322935740153, "in-drivable-lane": 0, "agent_compute-ego": 0.02851400136947632, "deviation-heading": 3.583802534070456, "set_robot_commands": 0.004978091716766358, "deviation-center-line": 0.9799583854889544, "driven_lanedir_consec": 4.6442422313199945, "sim_compute_sim_state": 0.002989480495452881, "sim_compute_performance-ego": 0.003951272169748942, "sim_compute_robot_state-ego": 0.0050066820780436195}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9626559984856238, "sim_physics": 0.05838125359778311, "survival_time": 2.549999999999999, "driven_lanedir": 0.9400632579645648, "sim_render-ego": 0.007186099594714595, "in-drivable-lane": 0, "agent_compute-ego": 0.028814334495394837, "deviation-heading": 0.4876983713377494, "set_robot_commands": 0.004842739479214537, "deviation-center-line": 0.1592941761145981, "driven_lanedir_consec": 0.9400632579645648, "sim_compute_sim_state": 0.0030628092148724723, "sim_compute_performance-ego": 0.003966065014109892, "sim_compute_robot_state-ego": 0.005144909316418218}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.643326327637758, "sim_physics": 0.058238412539164224, "survival_time": 14.950000000000076, "driven_lanedir": 4.557007876631588, "sim_render-ego": 0.006919184525807699, "in-drivable-lane": 0, "agent_compute-ego": 0.028605430920918783, "deviation-heading": 2.602346322990564, "set_robot_commands": 0.004973217646280925, "deviation-center-line": 0.923035651823632, "driven_lanedir_consec": 4.557007876631588, "sim_compute_sim_state": 0.003029308319091797, "sim_compute_performance-ego": 0.003975866635640462, "sim_compute_robot_state-ego": 0.005064833958943685}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.3277246904667712, "sim_physics": 0.057181884007281567, "survival_time": 4.149999999999993, "driven_lanedir": 1.104262098029225, "sim_render-ego": 0.006999449557568653, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.028102636337280273, "deviation-heading": 1.036429438306249, "set_robot_commands": 0.0049046579613743055, "deviation-center-line": 0.2233550370162401, "driven_lanedir_consec": 1.104262098029225, "sim_compute_sim_state": 0.002989645463874541, "sim_compute_performance-ego": 0.0039279805608542565, "sim_compute_robot_state-ego": 0.004867065383727292}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.285889252930499, "sim_physics": 0.0548311240913332, "survival_time": 6.449999999999985, "driven_lanedir": 1.9289485350229696, "sim_render-ego": 0.006951518761095151, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.027994527373203012, "deviation-heading": 1.2243318791925335, "set_robot_commands": 0.004969807558281477, "deviation-center-line": 0.2844941096517577, "driven_lanedir_consec": 1.9289485350229696, "sim_compute_sim_state": 0.0030024587646011233, "sim_compute_performance-ego": 0.003968288732129474, "sim_compute_robot_state-ego": 0.0049347267594448355}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0124248045067823, "sim_physics": 0.058132593448345475, "survival_time": 3.2499999999999964, "driven_lanedir": 0.6994536612258562, "sim_render-ego": 0.0072809292719914365, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.028685962236844578, "deviation-heading": 0.7430131782678392, "set_robot_commands": 0.005090801532451923, "deviation-center-line": 0.22455609798572151, "driven_lanedir_consec": 0.6994536612258562, "sim_compute_sim_state": 0.0031374087700477013, "sim_compute_performance-ego": 0.004100506122295673, "sim_compute_robot_state-ego": 0.00517120728125939}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.2980319484389948, "sim_physics": 0.05498049418131511, "survival_time": 3.7499999999999942, "driven_lanedir": 1.2696541394103296, "sim_render-ego": 0.0070611349741617835, "in-drivable-lane": 0, "agent_compute-ego": 0.028343416849772134, "deviation-heading": 0.6880686180923252, "set_robot_commands": 0.004908835093180339, "deviation-center-line": 0.19897391503523615, "driven_lanedir_consec": 1.2696541394103296, "sim_compute_sim_state": 0.0029429086049397785, "sim_compute_performance-ego": 0.003902740478515625, "sim_compute_robot_state-ego": 0.004883006413777669}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.920671111558396, "sim_physics": 0.05409787098566691, "survival_time": 5.399999999999989, "driven_lanedir": 1.6819696454921245, "sim_render-ego": 0.006977381529631438, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.0284278878459224, "deviation-heading": 0.814003560202, "set_robot_commands": 0.004996646333623816, "deviation-center-line": 0.1576225042619824, "driven_lanedir_consec": 1.6819696454921245, "sim_compute_sim_state": 0.002947518119105586, "sim_compute_performance-ego": 0.00391483086126822, "sim_compute_robot_state-ego": 0.004923635058932834}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 5.642298564557281, "sim_physics": 0.05354085524876912, "survival_time": 14.950000000000076, "driven_lanedir": 4.852402731624858, "sim_render-ego": 0.00683409849802653, "in-drivable-lane": 1.6500000000000208, "agent_compute-ego": 0.028283199469248455, "deviation-heading": 2.9762061015331955, "set_robot_commands": 0.004924654165903727, "deviation-center-line": 0.728132801147927, "driven_lanedir_consec": 4.852402731624858, "sim_compute_sim_state": 0.00292709747950236, "sim_compute_performance-ego": 0.003921688397725423, "sim_compute_robot_state-ego": 0.004891030788421631}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.0125438772797932, "sim_physics": 0.057826287170936325, "survival_time": 7.249999999999982, "driven_lanedir": 2.9118282550022654, "sim_render-ego": 0.006911332031776165, "in-drivable-lane": 0, "agent_compute-ego": 0.02849340767695986, "deviation-heading": 1.6286609772821692, "set_robot_commands": 0.004900562352147596, "deviation-center-line": 0.474146171687852, "driven_lanedir_consec": 2.9118282550022654, "sim_compute_sim_state": 0.0029077940973742254, "sim_compute_performance-ego": 0.0038964567513301456, "sim_compute_robot_state-ego": 0.004903701256061423}}
set_robot_commands_max0.005098483141730814
set_robot_commands_mean0.0049828312622455335
set_robot_commands_median0.004978091716766358
set_robot_commands_min0.004842739479214537
sim_compute_performance-ego_max0.004234131644753849
sim_compute_performance-ego_mean0.00398315965583786
sim_compute_performance-ego_median0.003966065014109892
sim_compute_performance-ego_min0.0038964567513301456
sim_compute_robot_state-ego_max0.00517120728125939
sim_compute_robot_state-ego_mean0.005012752618643306
sim_compute_robot_state-ego_median0.0050066820780436195
sim_compute_robot_state-ego_min0.004867065383727292
sim_compute_sim_state_max0.0031374087700477013
sim_compute_sim_state_mean0.003005228147637948
sim_compute_sim_state_median0.0030024587646011233
sim_compute_sim_state_min0.0029077940973742254
sim_physics_max0.05891679048538208
sim_physics_mean0.056784986762363834
sim_physics_median0.057806293729325414
sim_physics_min0.05354085524876912
sim_render-ego_max0.0072809292719914365
sim_render-ego_mean0.007029603293189913
sim_render-ego_median0.006999449557568653
sim_render-ego_min0.00683409849802653
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.06666666666668
survival_time_min2.549999999999999
No reset possible
288475516Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:28:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7128116905660615
survival_time_median8.649999999999988
deviation-center-line_median0.5078937747177635
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.0642296060339197
agent_compute-ego_mean0.05359802947880505
agent_compute-ego_median0.05361510515213013
agent_compute-ego_min0.0473916374269079
deviation-center-line_max1.285832659897831
deviation-center-line_mean0.5506030960688456
deviation-center-line_min0.10224419938425836
deviation-heading_max4.12876191520311
deviation-heading_mean2.03542239956554
deviation-heading_median2.123278091619365
deviation-heading_min0.29205830259840826
driven_any_max5.802571216054813
driven_any_mean3.272158000810066
driven_any_median3.0829892036013353
driven_any_min0.5746121613926535
driven_lanedir_consec_max5.305192897168638
driven_lanedir_consec_mean2.933838822463403
driven_lanedir_consec_min0.5630350312235239
driven_lanedir_max5.305192897168638
driven_lanedir_mean2.933838822463403
driven_lanedir_median2.7128116905660615
driven_lanedir_min0.5630350312235239
in-drivable-lane_max1.8000000000000114
in-drivable-lane_mean0.7000000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0829892036013353, "sim_physics": 0.1085131950065738, "survival_time": 9.149999999999997, "driven_lanedir": 2.7128116905660615, "sim_render-ego": 0.01337760784586922, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.05837729068401733, "deviation-heading": 2.6762899358630055, "set_robot_commands": 0.009789713093491852, "deviation-center-line": 0.7363350924933724, "driven_lanedir_consec": 2.7128116905660615, "sim_compute_sim_state": 0.005410043268255849, "sim_compute_performance-ego": 0.007789626147577672, "sim_compute_robot_state-ego": 0.009758381244263365}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.251683377737794, "sim_physics": 0.12358750025431316, "survival_time": 14.950000000000076, "driven_lanedir": 5.017830541898029, "sim_render-ego": 0.013229161103566488, "in-drivable-lane": 0, "agent_compute-ego": 0.05658859332402547, "deviation-heading": 4.12876191520311, "set_robot_commands": 0.011120814482371013, "deviation-center-line": 1.285832659897831, "driven_lanedir_consec": 5.017830541898029, "sim_compute_sim_state": 0.005483744144439698, "sim_compute_performance-ego": 0.008046898047129313, "sim_compute_robot_state-ego": 0.009867735703786214}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0328847584767358, "sim_physics": 0.10121725426345576, "survival_time": 3.049999999999997, "driven_lanedir": 0.6450070813431403, "sim_render-ego": 0.01204940920970479, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.0473916374269079, "deviation-heading": 0.3598590553422167, "set_robot_commands": 0.009251051261776784, "deviation-center-line": 0.10224419938425836, "driven_lanedir_consec": 0.6450070813431403, "sim_compute_sim_state": 0.005368729106715468, "sim_compute_performance-ego": 0.007536344840878346, "sim_compute_robot_state-ego": 0.009733895786473008}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5746121613926535, "sim_physics": 0.14773332050868443, "survival_time": 1.7500000000000009, "driven_lanedir": 0.5630350312235239, "sim_render-ego": 0.015604216711861747, "in-drivable-lane": 0, "agent_compute-ego": 0.05854996953691755, "deviation-heading": 0.29205830259840826, "set_robot_commands": 0.01248840604509626, "deviation-center-line": 0.10339394205840172, "driven_lanedir_consec": 0.5630350312235239, "sim_compute_sim_state": 0.006928396224975586, "sim_compute_performance-ego": 0.009000866753714426, "sim_compute_robot_state-ego": 0.0112384523664202}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.741951077954257, "sim_physics": 0.11717424949010212, "survival_time": 14.950000000000076, "driven_lanedir": 4.807698415699569, "sim_render-ego": 0.012375087738037109, "in-drivable-lane": 1.8000000000000114, "agent_compute-ego": 0.05566103776295979, "deviation-heading": 3.7766175159341704, "set_robot_commands": 0.009745361010233562, "deviation-center-line": 0.9606383009501652, "driven_lanedir_consec": 4.807698415699569, "sim_compute_sim_state": 0.005417068799336751, "sim_compute_performance-ego": 0.00755216121673584, "sim_compute_robot_state-ego": 0.009562691847483318}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.2283913151959351, "sim_physics": 0.13011265729928945, "survival_time": 3.8499999999999943, "driven_lanedir": 1.2077839274196147, "sim_render-ego": 0.012807363039487369, "in-drivable-lane": 0, "agent_compute-ego": 0.0642296060339197, "deviation-heading": 0.5615665944761006, "set_robot_commands": 0.009990689042326691, "deviation-center-line": 0.16690599067524348, "driven_lanedir_consec": 1.2077839274196147, "sim_compute_sim_state": 0.005059335138890651, "sim_compute_performance-ego": 0.007492111874865247, "sim_compute_robot_state-ego": 0.009750332151140486}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 5.802571216054813, "sim_physics": 0.11221691211064656, "survival_time": 14.950000000000076, "driven_lanedir": 5.305192897168638, "sim_render-ego": 0.013176312446594238, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.05361510515213013, "deviation-heading": 2.8989504353158337, "set_robot_commands": 0.009603450298309326, "deviation-center-line": 0.9474109316686676, "driven_lanedir_consec": 5.305192897168638, "sim_compute_sim_state": 0.005450308322906494, "sim_compute_performance-ego": 0.007728861967722575, "sim_compute_robot_state-ego": 0.009412949085235597}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.624270313427626, "sim_physics": 0.10685617605845134, "survival_time": 14.950000000000076, "driven_lanedir": 4.306127824377729, "sim_render-ego": 0.01262725830078125, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.04913983345031738, "deviation-heading": 2.7218833531478857, "set_robot_commands": 0.00908441146214803, "deviation-center-line": 0.7115027131167844, "driven_lanedir_consec": 4.306127824377729, "sim_compute_sim_state": 0.005281366507212321, "sim_compute_performance-ego": 0.007954908212025961, "sim_compute_robot_state-ego": 0.00977668603261312}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 5.186593919471725, "sim_physics": 0.11368107000986737, "survival_time": 14.950000000000076, "driven_lanedir": 4.7287168794162575, "sim_render-ego": 0.012537620862325032, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.05562097231547038, "deviation-heading": 2.858402584324592, "set_robot_commands": 0.009511359532674154, "deviation-center-line": 0.7757053329465036, "driven_lanedir_consec": 4.7287168794162575, "sim_compute_sim_state": 0.0053162940343221025, "sim_compute_performance-ego": 0.007614525953928629, "sim_compute_robot_state-ego": 0.009385112126668297}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.409156547367224, "sim_physics": 0.1051201154203976, "survival_time": 6.799999999999984, "driven_lanedir": 2.032469506184586, "sim_render-ego": 0.012494541266385249, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.04962671679608962, "deviation-heading": 1.2079207445026905, "set_robot_commands": 0.009104364058550666, "deviation-center-line": 0.3082226805825965, "driven_lanedir_consec": 2.032469506184586, "sim_compute_sim_state": 0.005162561641019934, "sim_compute_performance-ego": 0.007716250770232256, "sim_compute_robot_state-ego": 0.009455644032534433}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.128022587406061, "sim_physics": 0.1203277368803282, "survival_time": 3.699999999999995, "driven_lanedir": 0.7622018209856962, "sim_render-ego": 0.012989272942414157, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06024291386475434, "deviation-heading": 0.5421883532820593, "set_robot_commands": 0.009750669066970414, "deviation-center-line": 0.18243336058384385, "driven_lanedir_consec": 0.7622018209856962, "sim_compute_sim_state": 0.005810744053608662, "sim_compute_performance-ego": 0.007630438418001742, "sim_compute_robot_state-ego": 0.009861498265653044}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 3.170796250190629, "sim_physics": 0.10523278864821949, "survival_time": 8.649999999999988, "driven_lanedir": 3.056772258927249, "sim_render-ego": 0.012467520774444404, "in-drivable-lane": 0, "agent_compute-ego": 0.04835296228441889, "deviation-heading": 2.123278091619365, "set_robot_commands": 0.0090632493785351, "deviation-center-line": 0.5078937747177635, "driven_lanedir_consec": 3.056772258927249, "sim_compute_sim_state": 0.005139699561058441, "sim_compute_performance-ego": 0.007594946491925014, "sim_compute_robot_state-ego": 0.008948422580785145}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.9655959021672067, "sim_physics": 0.1024073024965682, "survival_time": 5.299999999999989, "driven_lanedir": 1.6198353517829858, "sim_render-ego": 0.012333932912574624, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.050067143620185134, "deviation-heading": 1.2471507950148728, "set_robot_commands": 0.010018321703065117, "deviation-center-line": 0.20949495444442623, "driven_lanedir_consec": 1.6198353517829858, "sim_compute_sim_state": 0.005238483536918208, "sim_compute_performance-ego": 0.007532394157265717, "sim_compute_robot_state-ego": 0.008991886984627202}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.218988968126595, "sim_physics": 0.1007176375970608, "survival_time": 6.149999999999986, "driven_lanedir": 2.148385258324166, "sim_render-ego": 0.012160797429278614, "in-drivable-lane": 0, "agent_compute-ego": 0.04786336712720918, "deviation-heading": 1.4160196030957253, "set_robot_commands": 0.008838347303188913, "deviation-center-line": 0.3313980834489369, "driven_lanedir_consec": 2.148385258324166, "sim_compute_sim_state": 0.004856225920886528, "sim_compute_performance-ego": 0.00720674623318804, "sim_compute_robot_state-ego": 0.008836238364863202}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.663862413580402, "sim_physics": 0.10796402841304688, "survival_time": 14.850000000000076, "driven_lanedir": 5.093713851633795, "sim_render-ego": 0.012618376349760627, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.04864329280275287, "deviation-heading": 3.720388713763059, "set_robot_commands": 0.00918257758272216, "deviation-center-line": 0.9296344240638886, "driven_lanedir_consec": 5.093713851633795, "sim_compute_sim_state": 0.0051771759585499365, "sim_compute_performance-ego": 0.007620669374562273, "sim_compute_robot_state-ego": 0.009554665498059204}}
set_robot_commands_max0.01248840604509626
set_robot_commands_mean0.009769519021430669
set_robot_commands_median0.009603450298309326
set_robot_commands_min0.008838347303188913
sim_compute_performance-ego_max0.009000866753714426
sim_compute_performance-ego_mean0.007734516697316869
sim_compute_performance-ego_median0.007620669374562273
sim_compute_performance-ego_min0.00720674623318804
sim_compute_robot_state-ego_max0.0112384523664202
sim_compute_robot_state-ego_mean0.009608972804707051
sim_compute_robot_state-ego_median0.009562691847483318
sim_compute_robot_state-ego_min0.008836238364863202
sim_compute_sim_state_max0.006928396224975586
sim_compute_sim_state_mean0.005406678414606442
sim_compute_sim_state_median0.0053162940343221025
sim_compute_sim_state_min0.004856225920886528
sim_physics_max0.14773332050868443
sim_physics_mean0.113524129630467
sim_physics_median0.1085131950065738
sim_physics_min0.1007176375970608
sim_render-ego_max0.015604216711861747
sim_render-ego_mean0.01285656526220566
sim_render-ego_median0.012618376349760627
sim_render-ego_min0.01204940920970479
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.200000000000026
survival_time_min1.7500000000000009
No reset possible
287205499Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8296480829179786
survival_time_median9.299999999999995
deviation-center-line_median0.5405180085567419
in-drivable-lane_median0.10000000000000142


other stats
agent_compute-ego_max0.03655282088688442
agent_compute-ego_mean0.028090227479317893
agent_compute-ego_median0.026525191081467496
agent_compute-ego_min0.022960356303623745
deviation-center-line_max0.972776920435163
deviation-center-line_mean0.5513313883356512
deviation-center-line_min0.07756139853187817
deviation-heading_max4.146682269742546
deviation-heading_mean1.8891941788548725
deviation-heading_median1.0468373823185333
deviation-heading_min0.3700668899017373
driven_any_max3.038944584020319
driven_any_mean1.358381785188552
driven_any_median1.1000364536521248
driven_any_min0.4881065967084066
driven_lanedir_consec_max2.9109560743127534
driven_lanedir_consec_mean1.1978438189233276
driven_lanedir_consec_min0.4697840710924437
driven_lanedir_max2.9109560743127534
driven_lanedir_mean1.1978438189233276
driven_lanedir_median0.8296480829179786
driven_lanedir_min0.4697840710924437
in-drivable-lane_max3.900000000000008
in-drivable-lane_mean0.8700000000000019
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.323900039532862, "sim_physics": 0.07433052878305701, "survival_time": 9.650000000000002, "driven_lanedir": 1.1049591131258882, "sim_render-ego": 0.008935645454288146, "in-drivable-lane": 0.34999999999999964, "agent_compute-ego": 0.02912067378740854, "deviation-heading": 4.146682269742546, "set_robot_commands": 0.0072708735194230946, "deviation-center-line": 0.972776920435163, "driven_lanedir_consec": 1.1049591131258882, "sim_compute_sim_state": 0.003731547242001548, "sim_compute_performance-ego": 0.005250980199309829, "sim_compute_robot_state-ego": 0.006528024228743321}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8409212520290481, "sim_physics": 0.1061203692640577, "survival_time": 2.799999999999998, "driven_lanedir": 0.8296480829179786, "sim_render-ego": 0.012243100575038366, "in-drivable-lane": 0, "agent_compute-ego": 0.03655282088688442, "deviation-heading": 0.42209685908537553, "set_robot_commands": 0.009924794946398054, "deviation-center-line": 0.23411519006966203, "driven_lanedir_consec": 0.8296480829179786, "sim_compute_sim_state": 0.004759013652801514, "sim_compute_performance-ego": 0.006857659135546003, "sim_compute_robot_state-ego": 0.008771274771009172}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1000364536521248, "sim_physics": 0.08017327836764757, "survival_time": 9.299999999999995, "driven_lanedir": 0.6738717531675751, "sim_render-ego": 0.009442121751846808, "in-drivable-lane": 3.900000000000008, "agent_compute-ego": 0.026525191081467496, "deviation-heading": 1.0468373823185333, "set_robot_commands": 0.007358251079436272, "deviation-center-line": 0.5405180085567419, "driven_lanedir_consec": 0.6738717531675751, "sim_compute_sim_state": 0.003981597961918, "sim_compute_performance-ego": 0.005592043681811261, "sim_compute_robot_state-ego": 0.007118146906616867}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4881065967084066, "sim_physics": 0.06639524868556432, "survival_time": 1.7500000000000009, "driven_lanedir": 0.4697840710924437, "sim_render-ego": 0.008033357347760882, "in-drivable-lane": 0, "agent_compute-ego": 0.022960356303623745, "deviation-heading": 0.3700668899017373, "set_robot_commands": 0.006396600178309849, "deviation-center-line": 0.07756139853187817, "driven_lanedir_consec": 0.4697840710924437, "sim_compute_sim_state": 0.003253105708530971, "sim_compute_performance-ego": 0.0045199530465262275, "sim_compute_robot_state-ego": 0.005757468087332589}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.038944584020319, "sim_physics": 0.07103572910978594, "survival_time": 13.100000000000051, "driven_lanedir": 2.9109560743127534, "sim_render-ego": 0.008735724077879927, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.02529209533720526, "deviation-heading": 3.46028749322617, "set_robot_commands": 0.006876124680497264, "deviation-center-line": 0.9316854240848108, "driven_lanedir_consec": 2.9109560743127534, "sim_compute_sim_state": 0.003590585621258685, "sim_compute_performance-ego": 0.005040095052646317, "sim_compute_robot_state-ego": 0.006336714475209476}}
set_robot_commands_max0.009924794946398054
set_robot_commands_mean0.0075653288808129075
set_robot_commands_median0.0072708735194230946
set_robot_commands_min0.006396600178309849
sim_compute_performance-ego_max0.006857659135546003
sim_compute_performance-ego_mean0.0054521462231679274
sim_compute_performance-ego_median0.005250980199309829
sim_compute_performance-ego_min0.0045199530465262275
sim_compute_robot_state-ego_max0.008771274771009172
sim_compute_robot_state-ego_mean0.006902325693782285
sim_compute_robot_state-ego_median0.006528024228743321
sim_compute_robot_state-ego_min0.005757468087332589
sim_compute_sim_state_max0.004759013652801514
sim_compute_sim_state_mean0.003863170037302144
sim_compute_sim_state_median0.003731547242001548
sim_compute_sim_state_min0.003253105708530971
sim_physics_max0.1061203692640577
sim_physics_mean0.07961103084202252
sim_physics_median0.07433052878305701
sim_physics_min0.06639524868556432
sim_render-ego_max0.012243100575038366
sim_render-ego_mean0.009477989841362824
sim_render-ego_median0.008935645454288146
sim_render-ego_min0.008033357347760882
simulation-passed1
survival_time_max13.100000000000051
survival_time_mean7.32000000000001
survival_time_min1.7500000000000009
No reset possible
287145496Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.937416278213983
survival_time_median2.2
deviation-center-line_median0.13178758504898383
in-drivable-lane_median0


other stats
agent_compute-ego_max0.030157971627933464
agent_compute-ego_mean0.025165833712500047
agent_compute-ego_median0.02453792095184326
agent_compute-ego_min0.020245342838520905
deviation-center-line_max0.35743268251454613
deviation-center-line_mean0.16143775158112897
deviation-center-line_min0.05417119912237331
deviation-heading_max1.2681209814374943
deviation-heading_mean0.5554231213154444
deviation-heading_median0.39620129097435497
deviation-heading_min0.2824775456410695
driven_any_max1.2220665267023234
driven_any_mean0.8338969665228854
driven_any_median0.953362115898368
driven_any_min0.4367917110071716
driven_lanedir_consec_max1.1643640562440083
driven_lanedir_consec_mean0.804156418494889
driven_lanedir_consec_min0.4083374249847287
driven_lanedir_max1.1643640562440083
driven_lanedir_mean0.804156418494889
driven_lanedir_median0.937416278213983
driven_lanedir_min0.4083374249847287
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2220665267023234, "sim_physics": 0.07407205375199466, "survival_time": 4.849999999999991, "driven_lanedir": 1.1643640562440083, "sim_render-ego": 0.009396285125889728, "in-drivable-lane": 0, "agent_compute-ego": 0.030157971627933464, "deviation-heading": 1.2681209814374943, "set_robot_commands": 0.00719144909652238, "deviation-center-line": 0.35743268251454613, "driven_lanedir_consec": 1.1643640562440083, "sim_compute_sim_state": 0.003823735050319396, "sim_compute_performance-ego": 0.005607914678829233, "sim_compute_robot_state-ego": 0.00666507494818304}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.953362115898368, "sim_physics": 0.0707757906480269, "survival_time": 2.2, "driven_lanedir": 0.937416278213983, "sim_render-ego": 0.009160654111341995, "in-drivable-lane": 0, "agent_compute-ego": 0.02453792095184326, "deviation-heading": 0.36635076053454346, "set_robot_commands": 0.006061895327134566, "deviation-center-line": 0.16637476006241353, "driven_lanedir_consec": 0.937416278213983, "sim_compute_sim_state": 0.003578142686323686, "sim_compute_performance-ego": 0.0053748000751842155, "sim_compute_robot_state-ego": 0.006627586754885587}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4367917110071716, "sim_physics": 0.07819595703711876, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4083374249847287, "sim_render-ego": 0.008993882399338942, "in-drivable-lane": 0, "agent_compute-ego": 0.026922033383296087, "deviation-heading": 0.39620129097435497, "set_robot_commands": 0.006662827271681566, "deviation-center-line": 0.097422531157328, "driven_lanedir_consec": 0.4083374249847287, "sim_compute_sim_state": 0.0036567908066969658, "sim_compute_performance-ego": 0.005160716863778921, "sim_compute_robot_state-ego": 0.006458649268517127}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5004774853288805, "sim_physics": 0.06730083318857047, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4758258618945117, "sim_render-ego": 0.009327402481665978, "in-drivable-lane": 0, "agent_compute-ego": 0.023965899760906514, "deviation-heading": 0.2824775456410695, "set_robot_commands": 0.0065529071367703955, "deviation-center-line": 0.05417119912237331, "driven_lanedir_consec": 0.4758258618945117, "sim_compute_sim_state": 0.003408395327054538, "sim_compute_performance-ego": 0.004904728669386644, "sim_compute_robot_state-ego": 0.006310490461496206}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0567869936776828, "sim_physics": 0.05431366939933933, "survival_time": 2.4499999999999993, "driven_lanedir": 1.0348384711372125, "sim_render-ego": 0.007172039576939174, "in-drivable-lane": 0, "agent_compute-ego": 0.020245342838520905, "deviation-heading": 0.46396502798975886, "set_robot_commands": 0.0052286848729970505, "deviation-center-line": 0.13178758504898383, "driven_lanedir_consec": 1.0348384711372125, "sim_compute_sim_state": 0.002955096108572824, "sim_compute_performance-ego": 0.004061601599868463, "sim_compute_robot_state-ego": 0.005252001236896126}}
set_robot_commands_max0.00719144909652238
set_robot_commands_mean0.006339552741021192
set_robot_commands_median0.0065529071367703955
set_robot_commands_min0.0052286848729970505
sim_compute_performance-ego_max0.005607914678829233
sim_compute_performance-ego_mean0.005021952377409495
sim_compute_performance-ego_median0.005160716863778921
sim_compute_performance-ego_min0.004061601599868463
sim_compute_robot_state-ego_max0.00666507494818304
sim_compute_robot_state-ego_mean0.006262760533995618
sim_compute_robot_state-ego_median0.006458649268517127
sim_compute_robot_state-ego_min0.005252001236896126
sim_compute_sim_state_max0.003823735050319396
sim_compute_sim_state_mean0.003484431995793482
sim_compute_sim_state_median0.003578142686323686
sim_compute_sim_state_min0.002955096108572824
sim_physics_max0.07819595703711876
sim_physics_mean0.06893166080501004
sim_physics_median0.0707757906480269
sim_physics_min0.05431366939933933
sim_render-ego_max0.009396285125889728
sim_render-ego_mean0.008810052739035163
sim_render-ego_median0.009160654111341995
sim_render-ego_min0.007172039576939174
simulation-passed1
survival_time_max4.849999999999991
survival_time_mean2.419999999999998
survival_time_min1.3000000000000005
No reset possible
286424926Oliver Widlerchallenge-aido_LF-template-pytorchaido3-LF-real-validationeval1-visualizesuccessnoip-172-31-46-148-104920:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.978313621479339
survival_time6
deviation-center-line0.3145017200976271
in-drivable-lane0.6666999999999996


other stats
deviation-heading1.1177180865760796
driven_any1.1988634011265191
driven_lanedir0.978313621479339
visualized-eval1-passed1
No reset possible
286364565Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|Andrew_Activationaido3-LF-real-validationeval1-visualizesuccessnoip-172-31-46-148-104920:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec6.115867989779472
survival_time24.6666
deviation-center-line1.8215264550239116
in-drivable-lane3.999900000000002


other stats
deviation-heading3.576208012178521
driven_any7.17872363942402
driven_lanedir6.115867989779472
visualized-eval1-passed1
No reset possible
286304926Oliver Widlerchallenge-aido_LF-template-pytorchaido3-LF-real-validationeval0-visualizesuccessnoip-172-31-46-148-104920:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.6979995522499092
survival_time8.6667
deviation-center-line0.2541303777641416
in-drivable-lane4.000000000000001


other stats
deviation-heading1.0841674088799196
driven_any1.8541141648662416
driven_lanedir0.6979995522499092
visualized-eval0-passed1
No reset possible
286044238Manfred DiazBaseline-IL-logs-tensorflowaido3-LF-real-validationeval1-videossuccessnoip-172-31-46-148-104920:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
285794543Robert Moni 🇭🇺kaland-22401aido3-LF-real-validationeval2-videossuccessnoip-172-31-46-148-104920:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
285615457c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationabortedyesip-172-31-46-148-104920:06:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
285565454Nikolaus Howechallenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5439651132617462
survival_time_median14.950000000000076
deviation-center-line_median0.5716659376361134
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016290694872538248
agent_compute-ego_mean0.016000201453668785
agent_compute-ego_median0.015960543155670165
agent_compute-ego_min0.015638517538706462
deviation-center-line_max0.9335659961863876
deviation-center-line_mean0.6956831460216653
deviation-center-line_min0.5517871851444414
deviation-heading_max4.1744226739421775
deviation-heading_mean3.717817168346383
deviation-heading_median4.157462071897329
deviation-heading_min2.917204323012701
driven_any_max2.8473632362699384
driven_any_mean2.5309606221020653
driven_any_median2.692986379304544
driven_any_min1.8235537148081
driven_lanedir_consec_max2.77449496500156
driven_lanedir_consec_mean2.3568863363169523
driven_lanedir_consec_min1.4547492629674443
driven_lanedir_max2.77449496500156
driven_lanedir_mean2.3622538176937047
driven_lanedir_median2.5439651132617462
driven_lanedir_min1.481586669851208
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean0.20000000000000284
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5871116134301753, "sim_physics": 0.05919964075088501, "survival_time": 14.950000000000076, "driven_lanedir": 2.449111915348565, "sim_render-ego": 0.007084983189900716, "in-drivable-lane": 0, "agent_compute-ego": 0.016290694872538248, "deviation-heading": 4.1608651586916015, "set_robot_commands": 0.007262004216512044, "deviation-center-line": 0.9335659961863876, "driven_lanedir_consec": 2.449111915348565, "sim_compute_sim_state": 0.003744877179463705, "sim_compute_performance-ego": 0.004156299432118734, "sim_compute_robot_state-ego": 0.005206394990285238}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7037881666975694, "sim_physics": 0.057614880402882894, "survival_time": 14.950000000000076, "driven_lanedir": 2.5621104250054443, "sim_render-ego": 0.007278839747111003, "in-drivable-lane": 0, "agent_compute-ego": 0.016155576705932616, "deviation-heading": 4.157462071897329, "set_robot_commands": 0.0072929827372233075, "deviation-center-line": 0.8590873309776947, "driven_lanedir_consec": 2.5621104250054443, "sim_compute_sim_state": 0.0037223013242085774, "sim_compute_performance-ego": 0.004107936223347982, "sim_compute_robot_state-ego": 0.005220622221628825}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8235537148081, "sim_physics": 0.05764660094548198, "survival_time": 10.300000000000011, "driven_lanedir": 1.481586669851208, "sim_render-ego": 0.007337533154533905, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.015955674995496435, "deviation-heading": 3.1791316141881043, "set_robot_commands": 0.007350363777679147, "deviation-center-line": 0.5623092801636885, "driven_lanedir_consec": 1.4547492629674443, "sim_compute_sim_state": 0.003869231464793381, "sim_compute_performance-ego": 0.004128268621500256, "sim_compute_robot_state-ego": 0.005271217198047823}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.692986379304544, "sim_physics": 0.05654287497202555, "survival_time": 14.950000000000076, "driven_lanedir": 2.5439651132617462, "sim_render-ego": 0.007131446997324625, "in-drivable-lane": 0, "agent_compute-ego": 0.015638517538706462, "deviation-heading": 4.1744226739421775, "set_robot_commands": 0.007131730715433757, "deviation-center-line": 0.5517871851444414, "driven_lanedir_consec": 2.5439651132617462, "sim_compute_sim_state": 0.0035851208368937173, "sim_compute_performance-ego": 0.004069969654083252, "sim_compute_robot_state-ego": 0.005171209971110026}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8473632362699384, "sim_physics": 0.054401793479919434, "survival_time": 14.950000000000076, "driven_lanedir": 2.77449496500156, "sim_render-ego": 0.00715721607208252, "in-drivable-lane": 0, "agent_compute-ego": 0.015960543155670165, "deviation-heading": 2.917204323012701, "set_robot_commands": 0.007352902094523112, "deviation-center-line": 0.5716659376361134, "driven_lanedir_consec": 2.77449496500156, "sim_compute_sim_state": 0.003854820728302002, "sim_compute_performance-ego": 0.004067396322886149, "sim_compute_robot_state-ego": 0.0052101580301920575}}
set_robot_commands_max0.007352902094523112
set_robot_commands_mean0.007277996708274273
set_robot_commands_median0.0072929827372233075
set_robot_commands_min0.007131730715433757
sim_compute_performance-ego_max0.004156299432118734
sim_compute_performance-ego_mean0.004105974050787275
sim_compute_performance-ego_median0.004107936223347982
sim_compute_performance-ego_min0.004067396322886149
sim_compute_robot_state-ego_max0.005271217198047823
sim_compute_robot_state-ego_mean0.005215920482252794
sim_compute_robot_state-ego_median0.0052101580301920575
sim_compute_robot_state-ego_min0.005171209971110026
sim_compute_sim_state_max0.003869231464793381
sim_compute_sim_state_mean0.003755270306732277
sim_compute_sim_state_median0.003744877179463705
sim_compute_sim_state_min0.0035851208368937173
sim_physics_max0.05919964075088501
sim_physics_mean0.05708115811023897
sim_physics_median0.057614880402882894
sim_physics_min0.054401793479919434
sim_render-ego_max0.007337533154533905
sim_render-ego_mean0.007198003832190554
sim_render-ego_median0.00715721607208252
sim_render-ego_min0.007084983189900716
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.020000000000064
survival_time_min10.300000000000011
No reset possible
285255436Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.383867887931829
survival_time_median14.950000000000076
deviation-center-line_median0.751002825300201
in-drivable-lane_median1.500000000000021


other stats
agent_compute-ego_max0.01687058130900065
agent_compute-ego_mean0.016459908326466877
agent_compute-ego_median0.016352174282073976
agent_compute-ego_min0.016298189163208007
deviation-center-line_max0.9320643737942748
deviation-center-line_mean0.7758578295381159
deviation-center-line_min0.6240960215057773
deviation-heading_max5.277791967973537
deviation-heading_mean4.036705022328773
deviation-heading_median3.846932209158376
deviation-heading_min2.7584800299908174
driven_any_max4.8078595628045715
driven_any_mean3.5132085280779095
driven_any_median3.225264300622412
driven_any_min2.676286105131119
driven_lanedir_consec_max4.422344116588862
driven_lanedir_consec_mean2.482762841731921
driven_lanedir_consec_min1.274768208780651
driven_lanedir_max4.422344116588862
driven_lanedir_mean3.1913054621022128
driven_lanedir_median2.879318659280999
driven_lanedir_min2.271968356035624
in-drivable-lane_max2.7000000000000126
in-drivable-lane_mean1.7400000000000166
in-drivable-lane_min0.7499999999999991
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.8167081436166765, "sim_physics": 0.06037963231404622, "survival_time": 14.950000000000076, "driven_lanedir": 2.4997432517318066, "sim_render-ego": 0.007489550908406576, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.01687058130900065, "deviation-heading": 3.846932209158376, "set_robot_commands": 0.007590306599934896, "deviation-center-line": 0.751002825300201, "driven_lanedir_consec": 2.4997432517318066, "sim_compute_sim_state": 0.0040915981928507485, "sim_compute_performance-ego": 0.004411662419637044, "sim_compute_robot_state-ego": 0.005495291550954183}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.676286105131119, "sim_physics": 0.05672077178955078, "survival_time": 14.950000000000076, "driven_lanedir": 2.271968356035624, "sim_render-ego": 0.007557155291239421, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.0164507786432902, "deviation-heading": 5.055904376015555, "set_robot_commands": 0.007389848232269287, "deviation-center-line": 0.6240960215057773, "driven_lanedir_consec": 1.8330907436264563, "sim_compute_sim_state": 0.0040247972806294755, "sim_compute_performance-ego": 0.004282948176066081, "sim_compute_robot_state-ego": 0.005431606769561768}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.8078595628045715, "sim_physics": 0.05807710409164429, "survival_time": 14.950000000000076, "driven_lanedir": 4.422344116588862, "sim_render-ego": 0.00757978359858195, "in-drivable-lane": 2.7000000000000126, "agent_compute-ego": 0.016352174282073976, "deviation-heading": 2.7584800299908174, "set_robot_commands": 0.007384122212727865, "deviation-center-line": 0.7109870599926278, "driven_lanedir_consec": 4.422344116588862, "sim_compute_sim_state": 0.004082849025726318, "sim_compute_performance-ego": 0.004300591150919597, "sim_compute_robot_state-ego": 0.00541757583618164}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.225264300622412, "sim_physics": 0.058032712936401366, "survival_time": 14.950000000000076, "driven_lanedir": 2.879318659280999, "sim_render-ego": 0.007474412123362223, "in-drivable-lane": 1.3500000000000156, "agent_compute-ego": 0.016298189163208007, "deviation-heading": 5.277791967973537, "set_robot_commands": 0.007377123832702637, "deviation-center-line": 0.9320643737942748, "driven_lanedir_consec": 1.274768208780651, "sim_compute_sim_state": 0.004071195920308431, "sim_compute_performance-ego": 0.004259720643361409, "sim_compute_robot_state-ego": 0.005401353041330974}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.03992452821477, "sim_physics": 0.05740915775299072, "survival_time": 14.950000000000076, "driven_lanedir": 3.883152926873772, "sim_render-ego": 0.007598083019256591, "in-drivable-lane": 0.7499999999999991, "agent_compute-ego": 0.016327818234761555, "deviation-heading": 3.244416528505577, "set_robot_commands": 0.007378275394439697, "deviation-center-line": 0.8611388670976985, "driven_lanedir_consec": 2.383867887931829, "sim_compute_sim_state": 0.004109461307525635, "sim_compute_performance-ego": 0.004284858703613281, "sim_compute_robot_state-ego": 0.005439445972442627}}
set_robot_commands_max0.007590306599934896
set_robot_commands_mean0.007423935254414876
set_robot_commands_median0.007384122212727865
set_robot_commands_min0.007377123832702637
sim_compute_performance-ego_max0.004411662419637044
sim_compute_performance-ego_mean0.004307956218719482
sim_compute_performance-ego_median0.004284858703613281
sim_compute_performance-ego_min0.004259720643361409
sim_compute_robot_state-ego_max0.005495291550954183
sim_compute_robot_state-ego_mean0.005437054634094238
sim_compute_robot_state-ego_median0.005431606769561768
sim_compute_robot_state-ego_min0.005401353041330974
sim_compute_sim_state_max0.004109461307525635
sim_compute_sim_state_mean0.004075980345408121
sim_compute_sim_state_median0.004082849025726318
sim_compute_sim_state_min0.0040247972806294755
sim_physics_max0.06037963231404622
sim_physics_mean0.05812387577692668
sim_physics_median0.058032712936401366
sim_physics_min0.05672077178955078
sim_render-ego_max0.007598083019256591
sim_render-ego_mean0.007539796988169353
sim_render-ego_median0.007557155291239421
sim_render-ego_min0.007474412123362223
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
284655399Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:13:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.695000821659384
survival_time_median14.950000000000076
deviation-center-line_median0.7749132355099658
in-drivable-lane_median0.30000000000000426


other stats
agent_compute-ego_max0.05244989554087321
agent_compute-ego_mean0.04794609498977661
agent_compute-ego_median0.05204920768737793
agent_compute-ego_min0.03140591700871786
deviation-center-line_max0.979458658318188
deviation-center-line_mean0.7879887349984817
deviation-center-line_min0.5481261387358084
deviation-heading_max3.784159898822381
deviation-heading_mean2.986334352780216
deviation-heading_median2.8129905955369976
deviation-heading_min2.5852003467890454
driven_any_max4.655994981155916
driven_any_mean4.01596652855731
driven_any_median3.8755547051935046
driven_any_min3.2818267587169108
driven_lanedir_consec_max4.566773551397
driven_lanedir_consec_mean3.8840681389570606
driven_lanedir_consec_min3.1372779525319885
driven_lanedir_max4.566773551397
driven_lanedir_mean3.8840681389570606
driven_lanedir_median3.695000821659384
driven_lanedir_min3.1372779525319885
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.3800000000000011
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2818267587169108, "sim_physics": 0.0589486034711202, "survival_time": 14.950000000000076, "driven_lanedir": 3.1372779525319885, "sim_render-ego": 0.007238430182139079, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.03140591700871786, "deviation-heading": 3.784159898822381, "set_robot_commands": 0.00565669854482015, "deviation-center-line": 0.979458658318188, "driven_lanedir_consec": 3.1372779525319885, "sim_compute_sim_state": 0.0033519506454467774, "sim_compute_performance-ego": 0.004277931849161784, "sim_compute_robot_state-ego": 0.005321931838989258}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.8061500358729465, "sim_physics": 0.11041404167811077, "survival_time": 14.950000000000076, "driven_lanedir": 3.695000821659384, "sim_render-ego": 0.01293383757273356, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.05206008752187093, "deviation-heading": 2.8129905955369976, "set_robot_commands": 0.00991025447845459, "deviation-center-line": 0.7749132355099658, "driven_lanedir_consec": 3.695000821659384, "sim_compute_sim_state": 0.005248727798461914, "sim_compute_performance-ego": 0.007644592920939128, "sim_compute_robot_state-ego": 0.009407021204630536}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8755547051935046, "sim_physics": 0.11173791964848837, "survival_time": 14.950000000000076, "driven_lanedir": 3.6742113813449855, "sim_render-ego": 0.013427268664042155, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.051765367190043134, "deviation-heading": 2.5852003467890454, "set_robot_commands": 0.010312585830688475, "deviation-center-line": 0.9001170257477876, "driven_lanedir_consec": 3.6742113813449855, "sim_compute_sim_state": 0.00573109229405721, "sim_compute_performance-ego": 0.008184887568155925, "sim_compute_robot_state-ego": 0.009818885326385498}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.655994981155916, "sim_physics": 0.12336949427922568, "survival_time": 14.950000000000076, "driven_lanedir": 4.566773551397, "sim_render-ego": 0.013983157475789388, "in-drivable-lane": 0, "agent_compute-ego": 0.05244989554087321, "deviation-heading": 2.653807423686722, "set_robot_commands": 0.010630565484364828, "deviation-center-line": 0.5481261387358084, "driven_lanedir_consec": 4.566773551397, "sim_compute_sim_state": 0.005584168434143067, "sim_compute_performance-ego": 0.00826839526494344, "sim_compute_robot_state-ego": 0.010105500221252442}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.460306161847269, "sim_physics": 0.12968409061431885, "survival_time": 14.950000000000076, "driven_lanedir": 4.347076987851944, "sim_render-ego": 0.013419012228647867, "in-drivable-lane": 0, "agent_compute-ego": 0.05204920768737793, "deviation-heading": 3.0955134990659325, "set_robot_commands": 0.010422895749409994, "deviation-center-line": 0.7373286166806584, "driven_lanedir_consec": 4.347076987851944, "sim_compute_sim_state": 0.005524968306223552, "sim_compute_performance-ego": 0.007993650436401368, "sim_compute_robot_state-ego": 0.009994130929311116}}
set_robot_commands_max0.010630565484364828
set_robot_commands_mean0.009386600017547608
set_robot_commands_median0.010312585830688475
set_robot_commands_min0.00565669854482015
sim_compute_performance-ego_max0.00826839526494344
sim_compute_performance-ego_mean0.00727389160792033
sim_compute_performance-ego_median0.007993650436401368
sim_compute_performance-ego_min0.004277931849161784
sim_compute_robot_state-ego_max0.010105500221252442
sim_compute_robot_state-ego_mean0.00892949390411377
sim_compute_robot_state-ego_median0.009818885326385498
sim_compute_robot_state-ego_min0.005321931838989258
sim_compute_sim_state_max0.00573109229405721
sim_compute_sim_state_mean0.005088181495666503
sim_compute_sim_state_median0.005524968306223552
sim_compute_sim_state_min0.0033519506454467774
sim_physics_max0.12968409061431885
sim_physics_mean0.10683082993825276
sim_physics_median0.11173791964848837
sim_physics_min0.0589486034711202
sim_render-ego_max0.013983157475789388
sim_render-ego_mean0.012200341224670407
sim_render-ego_median0.013419012228647867
sim_render-ego_min0.007238430182139079
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
284505392Basile Dura 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-46-148-104920:03:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 13 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
284325381Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.854008799481763
survival_time_median14.950000000000076
deviation-center-line_median0.6851496028148287
in-drivable-lane_median1.6999999999999975


other stats
agent_compute-ego_max0.02221709171930949
agent_compute-ego_mean0.01752454913492168
agent_compute-ego_median0.01681175708770752
agent_compute-ego_min0.015629943211873373
deviation-center-line_max0.7772895392284931
deviation-center-line_mean0.6448512690275974
deviation-center-line_min0.45112402901314375
deviation-heading_max3.5216236508952456
deviation-heading_mean2.796186589970663
deviation-heading_median3.073552743486541
deviation-heading_min2.1243852577831217
driven_any_max4.7923435486772235
driven_any_mean3.7542857953078017
driven_any_median4.210277907576749
driven_any_min2.2000241921380286
driven_lanedir_consec_max4.53584162528388
driven_lanedir_consec_mean3.478424145440296
driven_lanedir_consec_min1.857540586481756
driven_lanedir_max4.53584162528388
driven_lanedir_mean3.503034589610403
driven_lanedir_median3.9758735409087578
driven_lanedir_min1.8587280659052945
in-drivable-lane_max2.050000000000014
in-drivable-lane_mean1.370000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2298821163744003, "sim_physics": 0.05760932286580404, "survival_time": 14.950000000000076, "driven_lanedir": 2.9270107435789727, "sim_render-ego": 0.00733823299407959, "in-drivable-lane": 2.050000000000014, "agent_compute-ego": 0.01681175708770752, "deviation-heading": 3.5216236508952456, "set_robot_commands": 0.007486217816670735, "deviation-center-line": 0.775367820261123, "driven_lanedir_consec": 2.9270107435789727, "sim_compute_sim_state": 0.0040084163347880045, "sim_compute_performance-ego": 0.00434304157892863, "sim_compute_robot_state-ego": 0.00540310541788737}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2000241921380286, "sim_physics": 0.05980833022149055, "survival_time": 9.099999999999994, "driven_lanedir": 1.8587280659052945, "sim_render-ego": 0.007992705146034996, "in-drivable-lane": 1.950000000000001, "agent_compute-ego": 0.01719609721676334, "deviation-heading": 2.1243852577831217, "set_robot_commands": 0.007730101491068746, "deviation-center-line": 0.45112402901314375, "driven_lanedir_consec": 1.857540586481756, "sim_compute_sim_state": 0.0038641979406168177, "sim_compute_performance-ego": 0.004576219307197319, "sim_compute_robot_state-ego": 0.005724348864712558}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.7923435486772235, "sim_physics": 0.05644396622975667, "survival_time": 14.950000000000076, "driven_lanedir": 4.53584162528388, "sim_render-ego": 0.007285003662109375, "in-drivable-lane": 1.6999999999999975, "agent_compute-ego": 0.01576785643895467, "deviation-heading": 2.1475900982825142, "set_robot_commands": 0.00724697748819987, "deviation-center-line": 0.7772895392284931, "driven_lanedir_consec": 4.53584162528388, "sim_compute_sim_state": 0.0038524643580118817, "sim_compute_performance-ego": 0.00413243850072225, "sim_compute_robot_state-ego": 0.005257062117258708}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.210277907576749, "sim_physics": 0.05715919812520345, "survival_time": 14.950000000000076, "driven_lanedir": 3.9758735409087578, "sim_render-ego": 0.007296477953592936, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.015629943211873373, "deviation-heading": 3.073552743486541, "set_robot_commands": 0.007149074077606201, "deviation-center-line": 0.535325353820398, "driven_lanedir_consec": 3.854008799481763, "sim_compute_sim_state": 0.003857092062632243, "sim_compute_performance-ego": 0.004119694232940674, "sim_compute_robot_state-ego": 0.005269893805185954}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.338901211772605, "sim_physics": 0.0880993930498759, "survival_time": 14.950000000000076, "driven_lanedir": 4.21771897237511, "sim_render-ego": 0.0098525865872701, "in-drivable-lane": 0, "agent_compute-ego": 0.02221709171930949, "deviation-heading": 3.1137811994058917, "set_robot_commands": 0.009712823232014974, "deviation-center-line": 0.6851496028148287, "driven_lanedir_consec": 4.21771897237511, "sim_compute_sim_state": 0.005121472676595052, "sim_compute_performance-ego": 0.005867895285288493, "sim_compute_robot_state-ego": 0.007271289030710856}}
set_robot_commands_max0.009712823232014974
set_robot_commands_mean0.007865038821112105
set_robot_commands_median0.007486217816670735
set_robot_commands_min0.007149074077606201
sim_compute_performance-ego_max0.005867895285288493
sim_compute_performance-ego_mean0.004607857781015473
sim_compute_performance-ego_median0.00434304157892863
sim_compute_performance-ego_min0.004119694232940674
sim_compute_robot_state-ego_max0.007271289030710856
sim_compute_robot_state-ego_mean0.005785139847151089
sim_compute_robot_state-ego_median0.00540310541788737
sim_compute_robot_state-ego_min0.005257062117258708
sim_compute_sim_state_max0.005121472676595052
sim_compute_sim_state_mean0.0041407286745288
sim_compute_sim_state_median0.0038641979406168177
sim_compute_sim_state_min0.0038524643580118817
sim_physics_max0.0880993930498759
sim_physics_mean0.06382404209842611
sim_physics_median0.05760932286580404
sim_physics_min0.05644396622975667
sim_render-ego_max0.0098525865872701
sim_render-ego_mean0.007953001268617399
sim_render-ego_median0.00733823299407959
sim_render-ego_min0.007285003662109375
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.780000000000062
survival_time_min9.099999999999994
No reset possible
284115368c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:01:26
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
283355324Charles Cossette 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5607266005876896
survival_time_median14.950000000000076
deviation-center-line_median0.7485034385904208
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03768903096516927
agent_compute-ego_mean0.03589666715874808
agent_compute-ego_median0.036483819484710696
agent_compute-ego_min0.033861117362976076
deviation-center-line_max0.9113708437476647
deviation-center-line_mean0.7080021542682308
deviation-center-line_min0.4193281633845634
deviation-heading_max5.943023696711899
deviation-heading_mean4.105003214425233
deviation-heading_median4.4812811470402325
deviation-heading_min2.571167976511931
driven_any_max3.5050586699134425
driven_any_mean2.7133000653989994
driven_any_median2.891182300117352
driven_any_min1.7408671262063862
driven_lanedir_consec_max3.410835886772381
driven_lanedir_consec_mean2.515802643191797
driven_lanedir_consec_min1.6137912321587156
driven_lanedir_max3.410835886772381
driven_lanedir_mean2.515802643191797
driven_lanedir_median2.5607266005876896
driven_lanedir_min1.6137912321587156
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9916730985101014, "sim_physics": 0.05764252503712972, "survival_time": 14.950000000000076, "driven_lanedir": 2.795109120142253, "sim_render-ego": 0.007075661023457845, "in-drivable-lane": 0, "agent_compute-ego": 0.033861117362976076, "deviation-heading": 4.4812811470402325, "set_robot_commands": 0.005603636105855306, "deviation-center-line": 0.7485034385904208, "driven_lanedir_consec": 2.795109120142253, "sim_compute_sim_state": 0.003168633778889974, "sim_compute_performance-ego": 0.004160811901092529, "sim_compute_robot_state-ego": 0.005197086334228516}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7408671262063862, "sim_physics": 0.058594326819142985, "survival_time": 7.7499999999999805, "driven_lanedir": 1.6137912321587156, "sim_render-ego": 0.007328048829109438, "in-drivable-lane": 0, "agent_compute-ego": 0.03472914541921308, "deviation-heading": 2.571167976511931, "set_robot_commands": 0.0051801527700116555, "deviation-center-line": 0.4193281633845634, "driven_lanedir_consec": 1.6137912321587156, "sim_compute_sim_state": 0.003115020259734123, "sim_compute_performance-ego": 0.004102214690177671, "sim_compute_robot_state-ego": 0.005278285857169859}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.5050586699134425, "sim_physics": 0.05651646296183268, "survival_time": 14.950000000000076, "driven_lanedir": 3.410835886772381, "sim_render-ego": 0.007210190296173096, "in-drivable-lane": 0, "agent_compute-ego": 0.03768903096516927, "deviation-heading": 2.9468517597923407, "set_robot_commands": 0.005216619968414307, "deviation-center-line": 0.7689423729710342, "driven_lanedir_consec": 3.410835886772381, "sim_compute_sim_state": 0.003146185080210368, "sim_compute_performance-ego": 0.004109583695729574, "sim_compute_robot_state-ego": 0.0052770495414733885}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.891182300117352, "sim_physics": 0.06001591126124064, "survival_time": 14.950000000000076, "driven_lanedir": 2.5607266005876896, "sim_render-ego": 0.007252156734466553, "in-drivable-lane": 0, "agent_compute-ego": 0.036483819484710696, "deviation-heading": 5.943023696711899, "set_robot_commands": 0.005163145065307617, "deviation-center-line": 0.9113708437476647, "driven_lanedir_consec": 2.5607266005876896, "sim_compute_sim_state": 0.00315316120783488, "sim_compute_performance-ego": 0.004096391201019287, "sim_compute_robot_state-ego": 0.005263528823852539}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.437719132247714, "sim_physics": 0.05561833442011966, "survival_time": 11.850000000000032, "driven_lanedir": 2.1985503762979466, "sim_render-ego": 0.007177034007849069, "in-drivable-lane": 0, "agent_compute-ego": 0.03672022256167126, "deviation-heading": 4.58269149206976, "set_robot_commands": 0.005041205933325401, "deviation-center-line": 0.6918659526474707, "driven_lanedir_consec": 2.1985503762979466, "sim_compute_sim_state": 0.00306704074521608, "sim_compute_performance-ego": 0.0040743532060067865, "sim_compute_robot_state-ego": 0.005172667121082419}}
set_robot_commands_max0.005603636105855306
set_robot_commands_mean0.005240951968582858
set_robot_commands_median0.0051801527700116555
set_robot_commands_min0.005041205933325401
sim_compute_performance-ego_max0.004160811901092529
sim_compute_performance-ego_mean0.004108670938805169
sim_compute_performance-ego_median0.004102214690177671
sim_compute_performance-ego_min0.0040743532060067865
sim_compute_robot_state-ego_max0.005278285857169859
sim_compute_robot_state-ego_mean0.005237723535561343
sim_compute_robot_state-ego_median0.005263528823852539
sim_compute_robot_state-ego_min0.005172667121082419
sim_compute_sim_state_max0.003168633778889974
sim_compute_sim_state_mean0.0031300082143770848
sim_compute_sim_state_median0.003146185080210368
sim_compute_sim_state_min0.00306704074521608
sim_physics_max0.06001591126124064
sim_physics_mean0.057677512099893136
sim_physics_median0.05764252503712972
sim_physics_min0.05561833442011966
sim_render-ego_max0.007328048829109438
sim_render-ego_mean0.0072086181782112
sim_render-ego_median0.007210190296173096
sim_render-ego_min0.007075661023457845
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.890000000000049
survival_time_min7.7499999999999805
No reset possible
283305321Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5216411160694605
survival_time_median3.899999999999994
deviation-center-line_median0.1547264316488499
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.2148191031287698
agent_compute-ego_mean0.17748384086624627
agent_compute-ego_median0.1694459597269694
agent_compute-ego_min0.1658316812207622
deviation-center-line_max0.20865907504725664
deviation-center-line_mean0.16397276533975166
deviation-center-line_min0.14286625587173388
deviation-heading_max1.2295663746606913
deviation-heading_mean0.6145069418420636
deviation-heading_median0.5295719593557453
deviation-heading_min0.33587184915977647
driven_any_max1.0946432265725468
driven_any_mean0.7955603886060285
driven_any_median0.9968101617204472
driven_any_min0.3399672391495867
driven_lanedir_consec_max0.8167982600753139
driven_lanedir_consec_mean0.5532982290376407
driven_lanedir_consec_min0.3326871986657356
driven_lanedir_max0.8167982600753139
driven_lanedir_mean0.5532982290376407
driven_lanedir_median0.5216411160694605
driven_lanedir_min0.3326871986657356
in-drivable-lane_max2.199999999999992
in-drivable-lane_mean0.7399999999999973
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.010786079445857, "sim_physics": 0.07986443555807765, "survival_time": 3.949999999999994, "driven_lanedir": 0.6286640792815129, "sim_render-ego": 0.009701798233804824, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.1695686201506023, "deviation-heading": 1.2295663746606913, "set_robot_commands": 0.007270378402516812, "deviation-center-line": 0.20865907504725664, "driven_lanedir_consec": 0.6286640792815129, "sim_compute_sim_state": 0.004309340368343305, "sim_compute_performance-ego": 0.005788953998420812, "sim_compute_robot_state-ego": 0.007065760938427116}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3399672391495867, "sim_physics": 0.07741597390943958, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3326871986657356, "sim_render-ego": 0.01025718258273217, "in-drivable-lane": 0, "agent_compute-ego": 0.1658316812207622, "deviation-heading": 0.33587184915977647, "set_robot_commands": 0.006793960448234312, "deviation-center-line": 0.1465111096227521, "driven_lanedir_consec": 0.3326871986657356, "sim_compute_sim_state": 0.0038700103759765625, "sim_compute_performance-ego": 0.005352589391892956, "sim_compute_robot_state-ego": 0.006876983950215001}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9968101617204472, "sim_physics": 0.08184032562451485, "survival_time": 3.899999999999994, "driven_lanedir": 0.8167982600753139, "sim_render-ego": 0.010162032567537747, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16775384010412756, "deviation-heading": 0.5559397668088346, "set_robot_commands": 0.006799126282716408, "deviation-center-line": 0.1547264316488499, "driven_lanedir_consec": 0.8167982600753139, "sim_compute_sim_state": 0.0043677886327107745, "sim_compute_performance-ego": 0.005824437508216271, "sim_compute_robot_state-ego": 0.007462024688720703}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0946432265725468, "sim_physics": 0.08400089039522059, "survival_time": 4.249999999999993, "driven_lanedir": 0.4667004910961805, "sim_render-ego": 0.009782140395220589, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.2148191031287698, "deviation-heading": 0.42158475922527006, "set_robot_commands": 0.0075875534730799055, "deviation-center-line": 0.14286625587173388, "driven_lanedir_consec": 0.4667004910961805, "sim_compute_sim_state": 0.003960068085614373, "sim_compute_performance-ego": 0.005477462095372817, "sim_compute_robot_state-ego": 0.007069545633652631}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5355952361417047, "sim_physics": 0.08623844782511393, "survival_time": 2.25, "driven_lanedir": 0.5216411160694605, "sim_render-ego": 0.010061205757988825, "in-drivable-lane": 0, "agent_compute-ego": 0.1694459597269694, "deviation-heading": 0.5295719593557453, "set_robot_commands": 0.007553609212239584, "deviation-center-line": 0.1671009545081658, "driven_lanedir_consec": 0.5216411160694605, "sim_compute_sim_state": 0.00439054701063368, "sim_compute_performance-ego": 0.005781210793389215, "sim_compute_robot_state-ego": 0.0071553124321831595}}
set_robot_commands_max0.0075875534730799055
set_robot_commands_mean0.007200925563757404
set_robot_commands_median0.007270378402516812
set_robot_commands_min0.006793960448234312
sim_compute_performance-ego_max0.005824437508216271
sim_compute_performance-ego_mean0.005644930757458414
sim_compute_performance-ego_median0.005781210793389215
sim_compute_performance-ego_min0.005352589391892956
sim_compute_robot_state-ego_max0.007462024688720703
sim_compute_robot_state-ego_mean0.007125925528639722
sim_compute_robot_state-ego_median0.007069545633652631
sim_compute_robot_state-ego_min0.006876983950215001
sim_compute_sim_state_max0.00439054701063368
sim_compute_sim_state_mean0.004179550894655739
sim_compute_sim_state_median0.004309340368343305
sim_compute_sim_state_min0.0038700103759765625
sim_physics_max0.08623844782511393
sim_physics_mean0.08187201466247332
sim_physics_median0.08184032562451485
sim_physics_min0.07741597390943958
sim_render-ego_max0.01025718258273217
sim_render-ego_mean0.009992871907456829
sim_render-ego_median0.010061205757988825
sim_render-ego_min0.009701798233804824
simulation-passed1
survival_time_max4.249999999999993
survival_time_mean3.179999999999996
survival_time_min1.5500000000000007
No reset possible
283045303Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3869802870482797
survival_time_median14.950000000000076
deviation-center-line_median0.8021611884669405
in-drivable-lane_median3.000000000000026


other stats
agent_compute-ego_max0.021618580023447673
agent_compute-ego_mean0.02123689905802409
agent_compute-ego_median0.02110538641611735
agent_compute-ego_min0.02094045639038086
deviation-center-line_max0.891809979345557
deviation-center-line_mean0.7734352611189143
deviation-center-line_min0.6012060180596778
deviation-heading_max4.848174027142177
deviation-heading_mean3.6127129364633697
deviation-heading_median3.934715604095632
deviation-heading_min2.062445902220751
driven_any_max5.195964394547956
driven_any_mean4.243488864997718
driven_any_median4.598690499043159
driven_any_min3.0476386503233703
driven_lanedir_consec_max4.185778755268148
driven_lanedir_consec_mean2.39842300144882
driven_lanedir_consec_min1.3808713372193029
driven_lanedir_max4.907977360736655
driven_lanedir_mean3.8845342085341863
driven_lanedir_median4.185778755268148
driven_lanedir_min2.379705949240385
in-drivable-lane_max4.7000000000000135
in-drivable-lane_mean2.5500000000000043
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0476386503233703, "sim_physics": 0.07801423549652099, "survival_time": 14.950000000000076, "driven_lanedir": 2.379705949240385, "sim_render-ego": 0.009587244192759196, "in-drivable-lane": 4.7000000000000135, "agent_compute-ego": 0.02094045639038086, "deviation-heading": 4.024256641498535, "set_robot_commands": 0.009481889406840006, "deviation-center-line": 0.7654892704717289, "driven_lanedir_consec": 1.4032600574483172, "sim_compute_sim_state": 0.004764560063680013, "sim_compute_performance-ego": 0.005723488330841064, "sim_compute_robot_state-ego": 0.0071334028244018554}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.195964394547956, "sim_physics": 0.07609783252080282, "survival_time": 14.950000000000076, "driven_lanedir": 4.907977360736655, "sim_render-ego": 0.010018262068430582, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.021618580023447673, "deviation-heading": 3.934715604095632, "set_robot_commands": 0.008873636722564698, "deviation-center-line": 0.891809979345557, "driven_lanedir_consec": 2.635224570260054, "sim_compute_sim_state": 0.004548812707265218, "sim_compute_performance-ego": 0.005674732526143392, "sim_compute_robot_state-ego": 0.007084082762400309}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.598690499043159, "sim_physics": 0.0790424092610677, "survival_time": 14.950000000000076, "driven_lanedir": 4.185778755268148, "sim_render-ego": 0.009752697149912516, "in-drivable-lane": 3.09999999999999, "agent_compute-ego": 0.02110538641611735, "deviation-heading": 2.062445902220751, "set_robot_commands": 0.008914890289306641, "deviation-center-line": 0.8065098492506672, "driven_lanedir_consec": 4.185778755268148, "sim_compute_sim_state": 0.004801387786865234, "sim_compute_performance-ego": 0.005695538520812988, "sim_compute_robot_state-ego": 0.0071257654825846355}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.381271517670714, "sim_physics": 0.08260392904281616, "survival_time": 14.950000000000076, "driven_lanedir": 3.088185493096552, "sim_render-ego": 0.009766558011372883, "in-drivable-lane": 3.000000000000026, "agent_compute-ego": 0.021522836685180666, "deviation-heading": 4.848174027142177, "set_robot_commands": 0.008671932220458985, "deviation-center-line": 0.8021611884669405, "driven_lanedir_consec": 1.3808713372193029, "sim_compute_sim_state": 0.0046118346850077315, "sim_compute_performance-ego": 0.005788809458414714, "sim_compute_robot_state-ego": 0.007111834685007731}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.993879263403391, "sim_physics": 0.07463473637898763, "survival_time": 14.950000000000076, "driven_lanedir": 4.861023484329197, "sim_render-ego": 0.009422914187113444, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.020997235774993895, "deviation-heading": 3.193972507359755, "set_robot_commands": 0.008947645823160807, "deviation-center-line": 0.6012060180596778, "driven_lanedir_consec": 2.3869802870482797, "sim_compute_sim_state": 0.004665400187174479, "sim_compute_performance-ego": 0.0053821094830830895, "sim_compute_robot_state-ego": 0.006862067381540935}}
set_robot_commands_max0.009481889406840006
set_robot_commands_mean0.008977998892466229
set_robot_commands_median0.008914890289306641
set_robot_commands_min0.008671932220458985
sim_compute_performance-ego_max0.005788809458414714
sim_compute_performance-ego_mean0.005652935663859051
sim_compute_performance-ego_median0.005695538520812988
sim_compute_performance-ego_min0.0053821094830830895
sim_compute_robot_state-ego_max0.0071334028244018554
sim_compute_robot_state-ego_mean0.007063430627187094
sim_compute_robot_state-ego_median0.007111834685007731
sim_compute_robot_state-ego_min0.006862067381540935
sim_compute_sim_state_max0.004801387786865234
sim_compute_sim_state_mean0.0046783990859985344
sim_compute_sim_state_median0.004665400187174479
sim_compute_sim_state_min0.004548812707265218
sim_physics_max0.08260392904281616
sim_physics_mean0.07807862854003907
sim_physics_median0.07801423549652099
sim_physics_min0.07463473637898763
sim_render-ego_max0.010018262068430582
sim_render-ego_mean0.009709535121917726
sim_render-ego_median0.009752697149912516
sim_render-ego_min0.009422914187113444
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
282285263Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-46-148-104920:08:58
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/ac04687a2c2b5e2de450367c656e45a0a636501c1937d039fd4b446f5a248de2/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
282175257c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:00:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
282135254Dhaivat Bhatt 🇨🇦whattheduckaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
282075251Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-46-148-104920:00:43
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/614b4975466d7bb0533fa9c5d45d44ba6f67b852861b6a7c8e5b92d14a2a7c96/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
281935241Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2205651849078811
survival_time_median14.950000000000076
deviation-center-line_median0.8468606372462375
in-drivable-lane_median1.950000000000002


other stats
agent_compute-ego_max0.015929669539133707
agent_compute-ego_mean0.015773160703945112
agent_compute-ego_median0.015797341776173018
agent_compute-ego_min0.015558140277862549
deviation-center-line_max1.1086760008806678
deviation-center-line_mean0.8404971590651229
deviation-center-line_min0.5443112503456242
deviation-heading_max6.258685330831813
deviation-heading_mean5.367496535675627
deviation-heading_median6.1232995552788
deviation-heading_min2.9067378425634027
driven_any_max3.0103559208213273
driven_any_mean2.4861763789590836
driven_any_median2.712608695144368
driven_any_min1.6275337839774564
driven_lanedir_consec_max2.6856740508833634
driven_lanedir_consec_mean1.5008963065059426
driven_lanedir_consec_min0.7515453851677524
driven_lanedir_max2.6856740508833634
driven_lanedir_mean1.9183449898164109
driven_lanedir_median1.7778405002497764
driven_lanedir_min1.1010215021184724
in-drivable-lane_max3.3000000000000247
in-drivable-lane_mean1.490000000000009
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0103559208213273, "sim_physics": 0.05691233476003011, "survival_time": 14.950000000000076, "driven_lanedir": 2.2741569040644585, "sim_render-ego": 0.00707117239634196, "in-drivable-lane": 2.200000000000019, "agent_compute-ego": 0.015869523684183758, "deviation-heading": 6.1232995552788, "set_robot_commands": 0.007002701759338379, "deviation-center-line": 0.8468606372462375, "driven_lanedir_consec": 1.0688564113209391, "sim_compute_sim_state": 0.00376705805460612, "sim_compute_performance-ego": 0.004136970043182373, "sim_compute_robot_state-ego": 0.005174413522084554}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1012896587827856, "sim_physics": 0.054543921327966406, "survival_time": 12.700000000000044, "driven_lanedir": 1.7778405002497764, "sim_render-ego": 0.0071146394324114945, "in-drivable-lane": 0, "agent_compute-ego": 0.015711128242372526, "deviation-heading": 6.258685330831813, "set_robot_commands": 0.007146189531942052, "deviation-center-line": 0.7485375615344729, "driven_lanedir_consec": 1.7778405002497764, "sim_compute_sim_state": 0.003668687475009227, "sim_compute_performance-ego": 0.0040767436891090214, "sim_compute_robot_state-ego": 0.005147075089882678}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9790938360694788, "sim_physics": 0.054629554748535154, "survival_time": 14.950000000000076, "driven_lanedir": 2.6856740508833634, "sim_render-ego": 0.007056447664896647, "in-drivable-lane": 0, "agent_compute-ego": 0.015558140277862549, "deviation-heading": 5.36897954276713, "set_robot_commands": 0.007014897664388021, "deviation-center-line": 1.1086760008806678, "driven_lanedir_consec": 2.6856740508833634, "sim_compute_sim_state": 0.003622432549794515, "sim_compute_performance-ego": 0.004037261803944906, "sim_compute_robot_state-ego": 0.005156399408976237}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.712608695144368, "sim_physics": 0.05915297349294027, "survival_time": 14.950000000000076, "driven_lanedir": 1.7530319917659856, "sim_render-ego": 0.007206159432729085, "in-drivable-lane": 3.3000000000000247, "agent_compute-ego": 0.015929669539133707, "deviation-heading": 6.179780406936989, "set_robot_commands": 0.007288584709167481, "deviation-center-line": 0.9541003453186118, "driven_lanedir_consec": 1.2205651849078811, "sim_compute_sim_state": 0.003773625691731771, "sim_compute_performance-ego": 0.0040732868512471515, "sim_compute_robot_state-ego": 0.0052385592460632326}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6275337839774564, "sim_physics": 0.05924902464214124, "survival_time": 8.549999999999986, "driven_lanedir": 1.1010215021184724, "sim_render-ego": 0.007199626219900031, "in-drivable-lane": 1.950000000000002, "agent_compute-ego": 0.015797341776173018, "deviation-heading": 2.9067378425634027, "set_robot_commands": 0.007186019629762883, "deviation-center-line": 0.5443112503456242, "driven_lanedir_consec": 0.7515453851677524, "sim_compute_sim_state": 0.003649399294490703, "sim_compute_performance-ego": 0.004042474847090871, "sim_compute_robot_state-ego": 0.005211008919609917}}
set_robot_commands_max0.007288584709167481
set_robot_commands_mean0.007127678658919763
set_robot_commands_median0.007146189531942052
set_robot_commands_min0.007002701759338379
sim_compute_performance-ego_max0.004136970043182373
sim_compute_performance-ego_mean0.004073347446914865
sim_compute_performance-ego_median0.0040732868512471515
sim_compute_performance-ego_min0.004037261803944906
sim_compute_robot_state-ego_max0.0052385592460632326
sim_compute_robot_state-ego_mean0.005185491237323324
sim_compute_robot_state-ego_median0.005174413522084554
sim_compute_robot_state-ego_min0.005147075089882678
sim_compute_sim_state_max0.003773625691731771
sim_compute_sim_state_mean0.003696240613126467
sim_compute_sim_state_median0.003668687475009227
sim_compute_sim_state_min0.003622432549794515
sim_physics_max0.05924902464214124
sim_physics_mean0.056897561794322635
sim_physics_median0.05691233476003011
sim_physics_min0.054543921327966406
sim_render-ego_max0.007206159432729085
sim_render-ego_mean0.007129609029255843
sim_render-ego_median0.0071146394324114945
sim_render-ego_min0.007056447664896647
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.220000000000052
survival_time_min8.549999999999986
No reset possible
281825233Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1993310821473298
survival_time_median3.399999999999996
deviation-center-line_median0.14986765409066416
in-drivable-lane_median0.5999999999999992


other stats
agent_compute-ego_max0.035331169764200844
agent_compute-ego_mean0.030250697327282805
agent_compute-ego_median0.034429038691724465
agent_compute-ego_min0.017062177049352766
deviation-center-line_max0.321664921300238
deviation-center-line_mean0.1861748450113807
deviation-center-line_min0.05033408714999013
deviation-heading_max1.484142541755143
deviation-heading_mean0.7112703835347846
deviation-heading_median0.5437513158728742
deviation-heading_min0.3106828752383554
driven_any_max2.897976810042519
driven_any_mean1.6375981232400365
driven_any_median1.6022268002177693
driven_any_min1.019395338756305
driven_lanedir_consec_max2.4445887328437603
driven_lanedir_consec_mean1.3051212093016047
driven_lanedir_consec_min0.6291589580944417
driven_lanedir_max2.4445887328437603
driven_lanedir_mean1.3051212093016047
driven_lanedir_median1.1993310821473298
driven_lanedir_min0.6291589580944417
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.5799999999999985
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.019395338756305, "sim_physics": 0.06157027914168987, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6291589580944417, "sim_render-ego": 0.007408299344651243, "in-drivable-lane": 0.7499999999999989, "agent_compute-ego": 0.017062177049352766, "deviation-heading": 0.3972993087360611, "set_robot_commands": 0.007434317406187666, "deviation-center-line": 0.05033408714999013, "driven_lanedir_consec": 0.6291589580944417, "sim_compute_sim_state": 0.0039637748231279085, "sim_compute_performance-ego": 0.004390792643770259, "sim_compute_robot_state-ego": 0.005367507325842026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6022268002177693, "sim_physics": 0.0591887446010814, "survival_time": 3.399999999999996, "driven_lanedir": 1.5437749400989464, "sim_render-ego": 0.00730363411061904, "in-drivable-lane": 0, "agent_compute-ego": 0.0292850837988012, "deviation-heading": 0.8204758760714892, "set_robot_commands": 0.005529649117413689, "deviation-center-line": 0.29085139317246494, "driven_lanedir_consec": 1.5437749400989464, "sim_compute_sim_state": 0.0032490386682398177, "sim_compute_performance-ego": 0.004021490321439856, "sim_compute_robot_state-ego": 0.005414812003864962}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0419460039398525, "sim_physics": 0.05595560603671604, "survival_time": 2.25, "driven_lanedir": 0.7087523333235457, "sim_render-ego": 0.007438463634914822, "in-drivable-lane": 0.5999999999999992, "agent_compute-ego": 0.035331169764200844, "deviation-heading": 0.3106828752383554, "set_robot_commands": 0.005010080337524414, "deviation-center-line": 0.11815616934354628, "driven_lanedir_consec": 0.7087523333235457, "sim_compute_sim_state": 0.0031240834130181207, "sim_compute_performance-ego": 0.004105011622111003, "sim_compute_robot_state-ego": 0.005287048551771376}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6264456632437363, "sim_physics": 0.0576106664296743, "survival_time": 3.699999999999995, "driven_lanedir": 1.1993310821473298, "sim_render-ego": 0.007432660541018924, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.03514601733233478, "deviation-heading": 0.5437513158728742, "set_robot_commands": 0.005207986445040317, "deviation-center-line": 0.14986765409066416, "driven_lanedir_consec": 1.1993310821473298, "sim_compute_sim_state": 0.0031023959855775575, "sim_compute_performance-ego": 0.004087080826630464, "sim_compute_robot_state-ego": 0.0052698141819721945}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.897976810042519, "sim_physics": 0.056766858467688926, "survival_time": 5.849999999999987, "driven_lanedir": 2.4445887328437603, "sim_render-ego": 0.007268143515301566, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.034429038691724465, "deviation-heading": 1.484142541755143, "set_robot_commands": 0.005150487280299521, "deviation-center-line": 0.321664921300238, "driven_lanedir_consec": 2.4445887328437603, "sim_compute_sim_state": 0.003072999481462006, "sim_compute_performance-ego": 0.004077463068513788, "sim_compute_robot_state-ego": 0.005235943019899548}}
set_robot_commands_max0.007434317406187666
set_robot_commands_mean0.005666504117293121
set_robot_commands_median0.005207986445040317
set_robot_commands_min0.005010080337524414
sim_compute_performance-ego_max0.004390792643770259
sim_compute_performance-ego_mean0.0041363676964930735
sim_compute_performance-ego_median0.004087080826630464
sim_compute_performance-ego_min0.004021490321439856
sim_compute_robot_state-ego_max0.005414812003864962
sim_compute_robot_state-ego_mean0.005315025016670021
sim_compute_robot_state-ego_median0.005287048551771376
sim_compute_robot_state-ego_min0.005235943019899548
sim_compute_sim_state_max0.0039637748231279085
sim_compute_sim_state_mean0.0033024584742850824
sim_compute_sim_state_median0.0031240834130181207
sim_compute_sim_state_min0.003072999481462006
sim_physics_max0.06157027914168987
sim_physics_mean0.05821843093537011
sim_physics_median0.0576106664296743
sim_physics_min0.05595560603671604
sim_render-ego_max0.007438463634914822
sim_render-ego_mean0.007370240229301118
sim_render-ego_median0.007408299344651243
sim_render-ego_min0.007268143515301566
simulation-passed1
survival_time_max5.849999999999987
survival_time_mean3.5099999999999953
survival_time_min2.25
No reset possible
281495215Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.387625309215813
survival_time_median14.950000000000076
deviation-center-line_median0.7767141711042272
in-drivable-lane_median0


other stats
agent_compute-ego_max0.026735560894012453
agent_compute-ego_mean0.023052962914757107
agent_compute-ego_median0.023222618103027344
agent_compute-ego_min0.01952851057052612
deviation-center-line_max1.0368948211680735
deviation-center-line_mean0.6695992392066143
deviation-center-line_min0.1954923689563202
deviation-heading_max3.1228090666183768
deviation-heading_mean2.1544105788670316
deviation-heading_median2.5161991133556434
deviation-heading_min0.6395931000885905
driven_any_max5.157878707580549
driven_any_mean3.4435833243004623
driven_any_median3.63149681951213
driven_any_min1.1948875246591029
driven_lanedir_consec_max5.04567864385408
driven_lanedir_consec_mean3.309645838020559
driven_lanedir_consec_min1.171270634336994
driven_lanedir_max5.04567864385408
driven_lanedir_mean3.309645838020559
driven_lanedir_median3.387625309215813
driven_lanedir_min1.171270634336994
in-drivable-lane_max0.7500000000000089
in-drivable-lane_mean0.24000000000000185
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.63149681951213, "sim_physics": 0.08340192794799804, "survival_time": 14.950000000000076, "driven_lanedir": 3.387625309215813, "sim_render-ego": 0.01044244368871053, "in-drivable-lane": 0.7500000000000089, "agent_compute-ego": 0.023222618103027344, "deviation-heading": 3.1228090666183768, "set_robot_commands": 0.009934750398000082, "deviation-center-line": 0.8948030598939434, "driven_lanedir_consec": 3.387625309215813, "sim_compute_sim_state": 0.0052629303932189946, "sim_compute_performance-ego": 0.006275338331858317, "sim_compute_robot_state-ego": 0.007850088278452556}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1948875246591029, "sim_physics": 0.0913842657338018, "survival_time": 3.4499999999999957, "driven_lanedir": 1.171270634336994, "sim_render-ego": 0.011433774146480837, "in-drivable-lane": 0, "agent_compute-ego": 0.023775898891946545, "deviation-heading": 0.6395931000885905, "set_robot_commands": 0.010628237240556358, "deviation-center-line": 0.1954923689563202, "driven_lanedir_consec": 1.171270634336994, "sim_compute_sim_state": 0.005650209343951681, "sim_compute_performance-ego": 0.006414112837418266, "sim_compute_robot_state-ego": 0.008171088453652203}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.157878707580549, "sim_physics": 0.08914649804433186, "survival_time": 14.950000000000076, "driven_lanedir": 5.04567864385408, "sim_render-ego": 0.010791763464609782, "in-drivable-lane": 0, "agent_compute-ego": 0.026735560894012453, "deviation-heading": 2.6898961616765846, "set_robot_commands": 0.009971619447072347, "deviation-center-line": 1.0368948211680735, "driven_lanedir_consec": 5.04567864385408, "sim_compute_sim_state": 0.0051115059852600096, "sim_compute_performance-ego": 0.006209221680959066, "sim_compute_robot_state-ego": 0.00787194808324178}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.3404313026465235, "sim_physics": 0.0757478952407837, "survival_time": 14.950000000000076, "driven_lanedir": 4.13027306602283, "sim_render-ego": 0.009138325850168863, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.01952851057052612, "deviation-heading": 2.5161991133556434, "set_robot_commands": 0.008723008632659911, "deviation-center-line": 0.7767141711042272, "driven_lanedir_consec": 4.13027306602283, "sim_compute_sim_state": 0.005052789052327474, "sim_compute_performance-ego": 0.005143459637959798, "sim_compute_robot_state-ego": 0.006914514700571696}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.893222267104005, "sim_physics": 0.08425881713628769, "survival_time": 7.99999999999998, "driven_lanedir": 2.8133815366730768, "sim_render-ego": 0.010400645434856417, "in-drivable-lane": 0, "agent_compute-ego": 0.02200222611427307, "deviation-heading": 1.8035554525959627, "set_robot_commands": 0.00966288298368454, "deviation-center-line": 0.44409177491050694, "driven_lanedir_consec": 2.8133815366730768, "sim_compute_sim_state": 0.00514652281999588, "sim_compute_performance-ego": 0.006011210381984711, "sim_compute_robot_state-ego": 0.007707174122333527}}
set_robot_commands_max0.010628237240556358
set_robot_commands_mean0.00978409974039465
set_robot_commands_median0.009934750398000082
set_robot_commands_min0.008723008632659911
sim_compute_performance-ego_max0.006414112837418266
sim_compute_performance-ego_mean0.0060106685740360325
sim_compute_performance-ego_median0.006209221680959066
sim_compute_performance-ego_min0.005143459637959798
sim_compute_robot_state-ego_max0.008171088453652203
sim_compute_robot_state-ego_mean0.007702962727650352
sim_compute_robot_state-ego_median0.007850088278452556
sim_compute_robot_state-ego_min0.006914514700571696
sim_compute_sim_state_max0.005650209343951681
sim_compute_sim_state_mean0.005244791518950808
sim_compute_sim_state_median0.00514652281999588
sim_compute_sim_state_min0.005052789052327474
sim_physics_max0.0913842657338018
sim_physics_mean0.08478788082064062
sim_physics_median0.08425881713628769
sim_physics_min0.0757478952407837
sim_render-ego_max0.011433774146480837
sim_render-ego_mean0.010441390516965285
sim_render-ego_median0.01044244368871053
sim_render-ego_min0.009138325850168863
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.26000000000004
survival_time_min3.4499999999999957
No reset possible
281305203Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9846611565989367
survival_time_median14.950000000000076
deviation-center-line_median0.7743284972191029
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016596655050913494
agent_compute-ego_mean0.016276068051656087
agent_compute-ego_median0.016323488553365073
agent_compute-ego_min0.016023773352305093
deviation-center-line_max1.1183690152521206
deviation-center-line_mean0.803635348054153
deviation-center-line_min0.6295970160233819
deviation-heading_max4.327320554958342
deviation-heading_mean4.0813116399347535
deviation-heading_median4.1709984359095715
deviation-heading_min3.540201148248945
driven_any_max3.580279488610011
driven_any_mean2.774135485829298
driven_any_median2.966637699538344
driven_any_min2.013292613445832
driven_lanedir_consec_max3.4505787359589224
driven_lanedir_consec_mean2.367731649492305
driven_lanedir_consec_min1.642984280439527
driven_lanedir_max3.4505787359589224
driven_lanedir_mean2.6126199358593816
driven_lanedir_median2.857625998999703
driven_lanedir_min1.902808075464434
in-drivable-lane_max1.3000000000000158
in-drivable-lane_mean0.2600000000000032
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0989167962410957, "sim_physics": 0.0589462153116862, "survival_time": 14.950000000000076, "driven_lanedir": 1.9846611565989367, "sim_render-ego": 0.007123319307963053, "in-drivable-lane": 0, "agent_compute-ego": 0.016596655050913494, "deviation-heading": 4.208035341926603, "set_robot_commands": 0.00730833371480306, "deviation-center-line": 0.6295970160233819, "driven_lanedir_consec": 1.9846611565989367, "sim_compute_sim_state": 0.003966265519460042, "sim_compute_performance-ego": 0.004188796679178874, "sim_compute_robot_state-ego": 0.005291872024536133}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.013292613445832, "sim_physics": 0.057904452482859296, "survival_time": 14.950000000000076, "driven_lanedir": 1.902808075464434, "sim_render-ego": 0.007339062690734863, "in-drivable-lane": 0, "agent_compute-ego": 0.016373290220896404, "deviation-heading": 4.327320554958342, "set_robot_commands": 0.007381275494893392, "deviation-center-line": 0.7743284972191029, "driven_lanedir_consec": 1.902808075464434, "sim_compute_sim_state": 0.0038627862930297858, "sim_compute_performance-ego": 0.004163300196329753, "sim_compute_robot_state-ego": 0.005305273532867432}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.966637699538344, "sim_physics": 0.05603843132654826, "survival_time": 14.950000000000076, "driven_lanedir": 2.857625998999703, "sim_render-ego": 0.00735982338587443, "in-drivable-lane": 0, "agent_compute-ego": 0.016023773352305093, "deviation-heading": 3.540201148248945, "set_robot_commands": 0.007402631441752116, "deviation-center-line": 0.6560751735874897, "driven_lanedir_consec": 2.857625998999703, "sim_compute_sim_state": 0.0038550464312235512, "sim_compute_performance-ego": 0.004154394467671713, "sim_compute_robot_state-ego": 0.005315819581349691}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.580279488610011, "sim_physics": 0.05851685682932536, "survival_time": 14.950000000000076, "driven_lanedir": 3.4505787359589224, "sim_render-ego": 0.007270129521687826, "in-drivable-lane": 0, "agent_compute-ego": 0.016323488553365073, "deviation-heading": 4.160002718630307, "set_robot_commands": 0.007418792247772216, "deviation-center-line": 0.8398070381886694, "driven_lanedir_consec": 3.4505787359589224, "sim_compute_sim_state": 0.003783124287923177, "sim_compute_performance-ego": 0.004115619659423828, "sim_compute_robot_state-ego": 0.00529014507929484}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.2115508313112073, "sim_physics": 0.05599225203196208, "survival_time": 14.950000000000076, "driven_lanedir": 2.867425712274912, "sim_render-ego": 0.007170572280883789, "in-drivable-lane": 1.3000000000000158, "agent_compute-ego": 0.016063133080800374, "deviation-heading": 4.1709984359095715, "set_robot_commands": 0.007174522876739502, "deviation-center-line": 1.1183690152521206, "driven_lanedir_consec": 1.642984280439527, "sim_compute_sim_state": 0.003720630009969075, "sim_compute_performance-ego": 0.004070087273915609, "sim_compute_robot_state-ego": 0.005219802061716716}}
set_robot_commands_max0.007418792247772216
set_robot_commands_mean0.007337111155192057
set_robot_commands_median0.007381275494893392
set_robot_commands_min0.007174522876739502
sim_compute_performance-ego_max0.004188796679178874
sim_compute_performance-ego_mean0.004138439655303956
sim_compute_performance-ego_median0.004154394467671713
sim_compute_performance-ego_min0.004070087273915609
sim_compute_robot_state-ego_max0.005315819581349691
sim_compute_robot_state-ego_mean0.005284582455952963
sim_compute_robot_state-ego_median0.005291872024536133
sim_compute_robot_state-ego_min0.005219802061716716
sim_compute_sim_state_max0.003966265519460042
sim_compute_sim_state_mean0.003837570508321126
sim_compute_sim_state_median0.0038550464312235512
sim_compute_sim_state_min0.003720630009969075
sim_physics_max0.0589462153116862
sim_physics_mean0.05747964159647624
sim_physics_median0.057904452482859296
sim_physics_min0.05599225203196208
sim_render-ego_max0.00735982338587443
sim_render-ego_mean0.007252581437428793
sim_render-ego_median0.007270129521687826
sim_render-ego_min0.007123319307963053
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
281185195Anthony Courchesne 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:03:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.398528725570532
survival_time_median2.6999999999999984
deviation-center-line_median0.18389965504002528
in-drivable-lane_median0


other stats
agent_compute-ego_max0.018414135332460755
agent_compute-ego_mean0.017125454246077434
agent_compute-ego_median0.01725770816330082
agent_compute-ego_min0.016014641406489352
deviation-center-line_max0.5145915890209598
deviation-center-line_mean0.25512378028816635
deviation-center-line_min0.17331708997115514
deviation-heading_max0.858937563350049
deviation-heading_mean0.7142861420169898
deviation-heading_median0.7256050477576846
deviation-heading_min0.4990857099162725
driven_any_max1.5838733247029784
driven_any_mean0.7330703946506467
driven_any_median0.4133632811335052
driven_any_min0.2823391881195516
driven_lanedir_consec_max0.913821070081662
driven_lanedir_consec_mean0.5282823594317024
driven_lanedir_consec_min0.2731456017356313
driven_lanedir_max0.913821070081662
driven_lanedir_mean0.5282823594317024
driven_lanedir_median0.398528725570532
driven_lanedir_min0.2731456017356313
in-drivable-lane_max3.8000000000000105
in-drivable-lane_mean1.090000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4133632811335052, "sim_physics": 0.06324532296922472, "survival_time": 2.6999999999999984, "driven_lanedir": 0.398528725570532, "sim_render-ego": 0.007818275027804904, "in-drivable-lane": 0, "agent_compute-ego": 0.018414135332460755, "deviation-heading": 0.7256050477576846, "set_robot_commands": 0.005068416948671694, "deviation-center-line": 0.18389965504002528, "driven_lanedir_consec": 0.398528725570532, "sim_compute_sim_state": 0.003102510063736527, "sim_compute_performance-ego": 0.004459924168056912, "sim_compute_robot_state-ego": 0.005332999759250217}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2823391881195516, "sim_physics": 0.06450854203639886, "survival_time": 1.950000000000001, "driven_lanedir": 0.2731456017356313, "sim_render-ego": 0.007523842346973908, "in-drivable-lane": 0, "agent_compute-ego": 0.01620175288273738, "deviation-heading": 0.4990857099162725, "set_robot_commands": 0.00524133290999975, "deviation-center-line": 0.18360087025864377, "driven_lanedir_consec": 0.2731456017356313, "sim_compute_sim_state": 0.0032588029519105568, "sim_compute_performance-ego": 0.004255838883228791, "sim_compute_robot_state-ego": 0.005428705459985978}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9986182680833204, "sim_physics": 0.05678922282762764, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6894987963322738, "sim_render-ego": 0.007812681276936177, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.01725770816330082, "deviation-heading": 0.858937563350049, "set_robot_commands": 0.005040509641663102, "deviation-center-line": 0.22020969715004776, "driven_lanedir_consec": 0.6894987963322738, "sim_compute_sim_state": 0.003014992091281355, "sim_compute_performance-ego": 0.004301916469227184, "sim_compute_robot_state-ego": 0.005394634136483689}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5838733247029784, "sim_physics": 0.05658789518031669, "survival_time": 9.4, "driven_lanedir": 0.913821070081662, "sim_render-ego": 0.007616473005173054, "in-drivable-lane": 3.8000000000000105, "agent_compute-ego": 0.017739033445398858, "deviation-heading": 0.6493359205535003, "set_robot_commands": 0.005151398638461499, "deviation-center-line": 0.5145915890209598, "driven_lanedir_consec": 0.913821070081662, "sim_compute_sim_state": 0.0030950066891122373, "sim_compute_performance-ego": 0.00420773409782572, "sim_compute_robot_state-ego": 0.005296854262656354}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.387157911213878, "sim_physics": 0.05924611933091107, "survival_time": 2.549999999999999, "driven_lanedir": 0.3664176034384132, "sim_render-ego": 0.007252136866251628, "in-drivable-lane": 0, "agent_compute-ego": 0.016014641406489352, "deviation-heading": 0.8384664685074426, "set_robot_commands": 0.005060724183624866, "deviation-center-line": 0.17331708997115514, "driven_lanedir_consec": 0.3664176034384132, "sim_compute_sim_state": 0.00305014498093549, "sim_compute_performance-ego": 0.004094334209666532, "sim_compute_robot_state-ego": 0.005296613655838312}}
set_robot_commands_max0.00524133290999975
set_robot_commands_mean0.005112476464484182
set_robot_commands_median0.005068416948671694
set_robot_commands_min0.005040509641663102
sim_compute_performance-ego_max0.004459924168056912
sim_compute_performance-ego_mean0.004263949565601028
sim_compute_performance-ego_median0.004255838883228791
sim_compute_performance-ego_min0.004094334209666532
sim_compute_robot_state-ego_max0.005428705459985978
sim_compute_robot_state-ego_mean0.00534996145484291
sim_compute_robot_state-ego_median0.005332999759250217
sim_compute_robot_state-ego_min0.005296613655838312
sim_compute_sim_state_max0.0032588029519105568
sim_compute_sim_state_mean0.0031042913553952335
sim_compute_sim_state_median0.0030950066891122373
sim_compute_sim_state_min0.003014992091281355
sim_physics_max0.06450854203639886
sim_physics_mean0.06007542046889579
sim_physics_median0.05924611933091107
sim_physics_min0.05658789518031669
sim_render-ego_max0.007818275027804904
sim_render-ego_mean0.007604681704627934
sim_render-ego_median0.007616473005173054
sim_render-ego_min0.007252136866251628
simulation-passed1
survival_time_max9.4
survival_time_mean4.529999999999997
survival_time_min1.950000000000001
No reset possible
280965179Robert Moni 🇭🇺almasip-6824aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.35547479499125223
survival_time_median1.900000000000001
deviation-center-line_median0.06773642087779448
in-drivable-lane_median0.8500000000000006


other stats
agent_compute-ego_max0.025553847352663677
agent_compute-ego_mean0.02355273035872598
agent_compute-ego_median0.02312623352563682
agent_compute-ego_min0.022845094268386427
deviation-center-line_max0.31040970211277985
deviation-center-line_mean0.1125769610347028
deviation-center-line_min0.04493815552713458
deviation-heading_max1.0818347921786753
deviation-heading_mean0.4848722694436623
deviation-heading_median0.3263053094058743
deviation-heading_min0.3013183312772058
driven_any_max2.8228482531033965
driven_any_mean1.1925635086409758
driven_any_median0.748751967484826
driven_any_min0.630389723239485
driven_lanedir_consec_max1.326118960894052
driven_lanedir_consec_mean0.5579279950825432
driven_lanedir_consec_min0.2133519070279859
driven_lanedir_max1.326118960894052
driven_lanedir_mean0.5579279950825432
driven_lanedir_median0.35547479499125223
driven_lanedir_min0.2133519070279859
in-drivable-lane_max2.7999999999999945
in-drivable-lane_mean1.229999999999999
in-drivable-lane_min0.7000000000000006
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0267209834978075, "sim_physics": 0.05965427060921987, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5458305402591922, "sim_render-ego": 0.007318730155626933, "in-drivable-lane": 0.9999999999999988, "agent_compute-ego": 0.025553847352663677, "deviation-heading": 0.3071507408006298, "set_robot_commands": 0.005139003197352092, "deviation-center-line": 0.08094552365620544, "driven_lanedir_consec": 0.5458305402591922, "sim_compute_sim_state": 0.0030393004417419434, "sim_compute_performance-ego": 0.004338964819908142, "sim_compute_robot_state-ego": 0.005279054244359334}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7341066158793643, "sim_physics": 0.059202825700914535, "survival_time": 1.850000000000001, "driven_lanedir": 0.3488637722402339, "sim_render-ego": 0.007340392550906619, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.022845094268386427, "deviation-heading": 0.4077521735559265, "set_robot_commands": 0.005007157454619536, "deviation-center-line": 0.06773642087779448, "driven_lanedir_consec": 0.3488637722402339, "sim_compute_sim_state": 0.0032823987909265467, "sim_compute_performance-ego": 0.004051202052348369, "sim_compute_robot_state-ego": 0.0053225659035347605}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.8228482531033965, "sim_physics": 0.05647390429713145, "survival_time": 5.949999999999987, "driven_lanedir": 1.326118960894052, "sim_render-ego": 0.007173960950194287, "in-drivable-lane": 2.7999999999999945, "agent_compute-ego": 0.02312623352563682, "deviation-heading": 1.0818347921786753, "set_robot_commands": 0.005209079309671866, "deviation-center-line": 0.31040970211277985, "driven_lanedir_consec": 1.326118960894052, "sim_compute_sim_state": 0.003083046744851505, "sim_compute_performance-ego": 0.004042505216197807, "sim_compute_robot_state-ego": 0.005177175297456629}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.630389723239485, "sim_physics": 0.058472703484927904, "survival_time": 1.7000000000000008, "driven_lanedir": 0.2133519070279859, "sim_render-ego": 0.007529398974250345, "in-drivable-lane": 0.8500000000000006, "agent_compute-ego": 0.02314911169164321, "deviation-heading": 0.3013183312772058, "set_robot_commands": 0.005389150451211368, "deviation-center-line": 0.04493815552713458, "driven_lanedir_consec": 0.2133519070279859, "sim_compute_sim_state": 0.003102849511539235, "sim_compute_performance-ego": 0.0040319386650534235, "sim_compute_robot_state-ego": 0.005246365771574133}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.748751967484826, "sim_physics": 0.06084407630719637, "survival_time": 1.900000000000001, "driven_lanedir": 0.35547479499125223, "sim_render-ego": 0.007233048740186189, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.023089364955299774, "deviation-heading": 0.3263053094058743, "set_robot_commands": 0.004942718305085835, "deviation-center-line": 0.05885500299959956, "driven_lanedir_consec": 0.35547479499125223, "sim_compute_sim_state": 0.0030444985941836707, "sim_compute_performance-ego": 0.003954473294709858, "sim_compute_robot_state-ego": 0.005138667006241648}}
set_robot_commands_max0.005389150451211368
set_robot_commands_mean0.0051374217435881395
set_robot_commands_median0.005139003197352092
set_robot_commands_min0.004942718305085835
sim_compute_performance-ego_max0.004338964819908142
sim_compute_performance-ego_mean0.00408381680964352
sim_compute_performance-ego_median0.004042505216197807
sim_compute_performance-ego_min0.003954473294709858
sim_compute_robot_state-ego_max0.0053225659035347605
sim_compute_robot_state-ego_mean0.005232765644633301
sim_compute_robot_state-ego_median0.005246365771574133
sim_compute_robot_state-ego_min0.005138667006241648
sim_compute_sim_state_max0.0032823987909265467
sim_compute_sim_state_mean0.00311041881664858
sim_compute_sim_state_median0.003083046744851505
sim_compute_sim_state_min0.0030393004417419434
sim_physics_max0.06084407630719637
sim_physics_mean0.05892955607987802
sim_physics_median0.059202825700914535
sim_physics_min0.05647390429713145
sim_render-ego_max0.007529398974250345
sim_render-ego_mean0.007319106274232874
sim_render-ego_median0.007318730155626933
sim_render-ego_min0.007173960950194287
simulation-passed1
survival_time_max5.949999999999987
survival_time_mean2.7599999999999976
survival_time_min1.7000000000000008
No reset possible
280925177Anthony Courchesne 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-46-148-104920:02:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
280835170Fabrice Normandin 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-46-148-104920:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
280445135Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LFV-sim-testingstep1-simulationsuccessyesip-172-31-46-148-104920:28:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8011824022648197
survival_time_median8.349999999999984
deviation-center-line_median0.2942139199925689
in-drivable-lane_median2.299999999999992


other stats
agent_compute-ego_max0.040999130632892344
agent_compute-ego_mean0.024054953814357943
agent_compute-ego_median0.024494998157024384
agent_compute-ego_min0.01841384313237949
deviation-center-line_max1.1264786146892392
deviation-center-line_mean0.4015015342457694
deviation-center-line_min0.12145291682656852
deviation-heading_max2.2845893158642276
deviation-heading_mean1.3663788896007258
deviation-heading_median1.6887823896529564
deviation-heading_min0.27964246193019443
driven_any_max3.1290236939533855
driven_any_mean1.69649109591584
driven_any_median1.5448946093752731
driven_any_min0.4140294945840282
driven_lanedir_consec_max2.875225275631822
driven_lanedir_consec_mean1.2164013878521631
driven_lanedir_consec_min0.4093496852076206
driven_lanedir_max2.875225275631822
driven_lanedir_mean1.2164013878521631
driven_lanedir_median0.8011824022648197
driven_lanedir_min0.4093496852076206
in-drivable-lane_max10.450000000000085
in-drivable-lane_mean2.8633333333333395
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.192838124304875, "sim_physics": 0.14191312653025942, "survival_time": 10.450000000000014, "driven_lanedir": 1.4522291106390723, "sim_render-ego": 0.009033831683072176, "in-drivable-lane": 3.5500000000000025, "agent_compute-ego": 0.027081953851800216, "deviation-heading": 1.8912280880065884, "set_robot_commands": 0.006714213978160511, "deviation-center-line": 0.38648181895186184, "driven_lanedir_consec": 1.4522291106390723, "sim_compute_sim_state": 0.003737944735294324, "sim_compute_performance-ego": 0.005290504847987417, "sim_compute_robot_state-ego": 0.00655918372304816, "sim_compute_robot_state-npc0": 0.006322647395886873, "sim_compute_robot_state-npc1": 0.005979374835365697, "sim_compute_robot_state-npc2": 0.0060717774350107, "sim_compute_robot_state-npc3": 0.005992645281924015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.078284323396122, "sim_physics": 0.14530290146263278, "survival_time": 4.899999999999991, "driven_lanedir": 0.656535750369474, "sim_render-ego": 0.009808671717741052, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.02489846823166828, "deviation-heading": 0.3455810689946756, "set_robot_commands": 0.007230221008767887, "deviation-center-line": 0.12318975427961718, "driven_lanedir_consec": 0.656535750369474, "sim_compute_sim_state": 0.003979060114646445, "sim_compute_performance-ego": 0.005521720769454022, "sim_compute_robot_state-ego": 0.007132710242757992, "sim_compute_robot_state-npc0": 0.006527119753312091, "sim_compute_robot_state-npc1": 0.006517103740147182, "sim_compute_robot_state-npc2": 0.006434280045178472, "sim_compute_robot_state-npc3": 0.006289097727561484}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9844829838844584, "sim_physics": 0.14318958709114477, "survival_time": 9.5, "driven_lanedir": 1.6999840811444056, "sim_render-ego": 0.009682196064999229, "in-drivable-lane": 1.5500000000000205, "agent_compute-ego": 0.02560224407597592, "deviation-heading": 1.8868968761090903, "set_robot_commands": 0.006986395936263235, "deviation-center-line": 0.5864525193765489, "driven_lanedir_consec": 1.6999840811444056, "sim_compute_sim_state": 0.003976195736935264, "sim_compute_performance-ego": 0.005659553879185727, "sim_compute_robot_state-ego": 0.0070290866651033105, "sim_compute_robot_state-npc0": 0.006689523395739104, "sim_compute_robot_state-npc1": 0.006463744765833805, "sim_compute_robot_state-npc2": 0.006478159051192434, "sim_compute_robot_state-npc3": 0.006359979980870297}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.200765006500376, "sim_physics": 0.13968673676096333, "survival_time": 9.55, "driven_lanedir": 1.3169663294728997, "sim_render-ego": 0.009425033449502516, "in-drivable-lane": 3.950000000000011, "agent_compute-ego": 0.02539924177199758, "deviation-heading": 1.842247983211154, "set_robot_commands": 0.006912392471473254, "deviation-center-line": 0.2711872760032548, "driven_lanedir_consec": 1.3169663294728997, "sim_compute_sim_state": 0.003741009697240061, "sim_compute_performance-ego": 0.005308430856435086, "sim_compute_robot_state-ego": 0.006733659674359866, "sim_compute_robot_state-npc0": 0.006585325870214332, "sim_compute_robot_state-npc1": 0.0064371680714072985, "sim_compute_robot_state-npc2": 0.006233078022901925, "sim_compute_robot_state-npc3": 0.006350811863444863}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6939752013929728, "sim_physics": 0.14478206491755868, "survival_time": 8.349999999999984, "driven_lanedir": 0.6989071182608007, "sim_render-ego": 0.009776676486352246, "in-drivable-lane": 5.2999999999999865, "agent_compute-ego": 0.026496714460635618, "deviation-heading": 0.7182782284700634, "set_robot_commands": 0.007722117943678074, "deviation-center-line": 0.15143033530452832, "driven_lanedir_consec": 0.6989071182608007, "sim_compute_sim_state": 0.00409134847675255, "sim_compute_performance-ego": 0.00570634310830853, "sim_compute_robot_state-ego": 0.007093937811023461, "sim_compute_robot_state-npc0": 0.006860892929716738, "sim_compute_robot_state-npc1": 0.006646003551825792, "sim_compute_robot_state-npc2": 0.00669607145343712, "sim_compute_robot_state-npc3": 0.0066763069815264494}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5448946093752731, "sim_physics": 0.22317684071618807, "survival_time": 7.94999999999998, "driven_lanedir": 0.6991828036819915, "sim_render-ego": 0.012752919826867446, "in-drivable-lane": 3.5499999999999874, "agent_compute-ego": 0.040999130632892344, "deviation-heading": 1.7480093248820936, "set_robot_commands": 0.009679467423157125, "deviation-center-line": 0.24772352544389745, "driven_lanedir_consec": 0.6991828036819915, "sim_compute_sim_state": 0.005251893457376732, "sim_compute_performance-ego": 0.007587240926874509, "sim_compute_robot_state-ego": 0.009306955637421998, "sim_compute_robot_state-npc0": 0.00873271774196025, "sim_compute_robot_state-npc1": 0.008900676883241665, "sim_compute_robot_state-npc2": 0.008709169783682193, "sim_compute_robot_state-npc3": 0.008802547394854468}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.4846194205063494, "sim_physics": 0.1490565335309064, "survival_time": 6.749999999999984, "driven_lanedir": 0.6836283565315389, "sim_render-ego": 0.00930530760023329, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.026012000331172236, "deviation-heading": 1.8082015286729105, "set_robot_commands": 0.007100398452193649, "deviation-center-line": 0.2942139199925689, "driven_lanedir_consec": 0.6836283565315389, "sim_compute_sim_state": 0.003811926311916775, "sim_compute_performance-ego": 0.0052880110564055265, "sim_compute_robot_state-ego": 0.006962961620754666, "sim_compute_robot_state-npc0": 0.006500690954702871, "sim_compute_robot_state-npc1": 0.006307024425930447, "sim_compute_robot_state-npc2": 0.006210918779726382, "sim_compute_robot_state-npc3": 0.006262184072423864}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.006240457454601, "sim_physics": 0.14483412355184555, "survival_time": 4.799999999999991, "driven_lanedir": 0.6176976765890844, "sim_render-ego": 0.00936682273944219, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.024494998157024384, "deviation-heading": 0.4980867949671237, "set_robot_commands": 0.006887746353944142, "deviation-center-line": 0.12145291682656852, "driven_lanedir_consec": 0.6176976765890844, "sim_compute_sim_state": 0.003717454771200816, "sim_compute_performance-ego": 0.005385051170984904, "sim_compute_robot_state-ego": 0.006829251845677693, "sim_compute_robot_state-npc0": 0.006498090922832489, "sim_compute_robot_state-npc1": 0.006328868369261424, "sim_compute_robot_state-npc2": 0.006228191157182057, "sim_compute_robot_state-npc3": 0.006302850941816966}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8874895049751232, "sim_physics": 0.12271546125411988, "survival_time": 14.950000000000076, "driven_lanedir": 0.8011824022648197, "sim_render-ego": 0.00919549862543742, "in-drivable-lane": 10.450000000000085, "agent_compute-ego": 0.024363388220469157, "deviation-heading": 1.071412752198612, "set_robot_commands": 0.006770087877909343, "deviation-center-line": 0.3026482405467322, "driven_lanedir_consec": 0.8011824022648197, "sim_compute_sim_state": 0.003801706631978353, "sim_compute_performance-ego": 0.0053036697705586755, "sim_compute_robot_state-ego": 0.006829517682393392, "sim_compute_robot_state-npc0": 0.00652007261912028, "sim_compute_robot_state-npc1": 0.00619599183400472, "sim_compute_robot_state-npc2": 0.0062116710344950355, "sim_compute_robot_state-npc3": 0.006069472630818685}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.019413522248234, "sim_physics": 0.09353603276991308, "survival_time": 6.649999999999984, "driven_lanedir": 0.8378715739419758, "sim_render-ego": 0.0069826169121534306, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.02062105773983145, "deviation-heading": 1.321567361116391, "set_robot_commands": 0.004800593942627871, "deviation-center-line": 0.4035727866285515, "driven_lanedir_consec": 0.8378715739419758, "sim_compute_sim_state": 0.0028235535872609993, "sim_compute_performance-ego": 0.003825166171654722, "sim_compute_robot_state-ego": 0.0049967066685956225, "sim_compute_robot_state-npc0": 0.004753940983822471, "sim_compute_robot_state-npc1": 0.004469772926846841, "sim_compute_robot_state-npc2": 0.004467516017139406, "sim_compute_robot_state-npc3": 0.004459648204029054}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.030733375853534, "sim_physics": 0.09373311461689315, "survival_time": 5.349999999999989, "driven_lanedir": 0.7700807667366978, "sim_render-ego": 0.006928789281399451, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.018912578297552662, "deviation-heading": 0.8784685891517936, "set_robot_commands": 0.004781295205945167, "deviation-center-line": 0.17449541229669463, "driven_lanedir_consec": 0.7700807667366978, "sim_compute_sim_state": 0.0027673400451089735, "sim_compute_performance-ego": 0.003802898888276002, "sim_compute_robot_state-ego": 0.004966989855899989, "sim_compute_robot_state-npc0": 0.004666985752426575, "sim_compute_robot_state-npc1": 0.004459147141358563, "sim_compute_robot_state-npc2": 0.004413032086096077, "sim_compute_robot_state-npc3": 0.004408903211076683}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.9664753448489507, "sim_physics": 0.10418490139213768, "survival_time": 11.100000000000025, "driven_lanedir": 2.875225275631822, "sim_render-ego": 0.006782822780780964, "in-drivable-lane": 0, "agent_compute-ego": 0.0187264025748313, "deviation-heading": 2.2845893158642276, "set_robot_commands": 0.004689642974922249, "deviation-center-line": 0.8487862240867107, "driven_lanedir_consec": 2.875225275631822, "sim_compute_sim_state": 0.002769915907232611, "sim_compute_performance-ego": 0.003782621375075332, "sim_compute_robot_state-ego": 0.004940069473541535, "sim_compute_robot_state-npc0": 0.004631767401824126, "sim_compute_robot_state-npc1": 0.00441094024761303, "sim_compute_robot_state-npc2": 0.0043910956597542974, "sim_compute_robot_state-npc3": 0.004397903476749455}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.814101375459318, "sim_physics": 0.10500675674498552, "survival_time": 12.700000000000044, "driven_lanedir": 2.5516660216511227, "sim_render-ego": 0.00689941316139041, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.01841384313237949, "deviation-heading": 1.6887823896529564, "set_robot_commands": 0.00479037461318369, "deviation-center-line": 0.7653602772753851, "driven_lanedir_consec": 2.5516660216511227, "sim_compute_sim_state": 0.002809303013358529, "sim_compute_performance-ego": 0.003860119759567141, "sim_compute_robot_state-ego": 0.00499651938911498, "sim_compute_robot_state-npc0": 0.004723477551317591, "sim_compute_robot_state-npc1": 0.004496558444706473, "sim_compute_robot_state-npc2": 0.004455251956549216, "sim_compute_robot_state-npc3": 0.004467148480452891}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.1290236939533855, "sim_physics": 0.10190850337346397, "survival_time": 14.950000000000076, "driven_lanedir": 2.1755138656591217, "sim_render-ego": 0.00686188538869222, "in-drivable-lane": 3.550000000000007, "agent_compute-ego": 0.01857080618540446, "deviation-heading": 2.2326905807830144, "set_robot_commands": 0.004747308890024821, "deviation-center-line": 1.1264786146892392, "driven_lanedir_consec": 2.1755138656591217, "sim_compute_sim_state": 0.002789053916931152, "sim_compute_performance-ego": 0.00383214791615804, "sim_compute_robot_state-ego": 0.004978042443593343, "sim_compute_robot_state-npc0": 0.004698521296183269, "sim_compute_robot_state-npc1": 0.004466972351074219, "sim_compute_robot_state-npc2": 0.004430169264475504, "sim_compute_robot_state-npc3": 0.004441639582316081}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.4140294945840282, "sim_physics": 0.13012967458585414, "survival_time": 2.0500000000000007, "driven_lanedir": 0.4093496852076206, "sim_render-ego": 0.00741632391766804, "in-drivable-lane": 0, "agent_compute-ego": 0.020231479551733995, "deviation-heading": 0.27964246193019443, "set_robot_commands": 0.004927565411823552, "deviation-center-line": 0.2190493919843832, "driven_lanedir_consec": 0.4093496852076206, "sim_compute_sim_state": 0.0029179410236637765, "sim_compute_performance-ego": 0.0039479732513427734, "sim_compute_robot_state-ego": 0.005195960765931665, "sim_compute_robot_state-npc0": 0.004851160979852444, "sim_compute_robot_state-npc1": 0.00456147659115675, "sim_compute_robot_state-npc2": 0.00452731876838498, "sim_compute_robot_state-npc3": 0.00456928625339415}}
set_robot_commands_max0.009679467423157125
set_robot_commands_mean0.0063159881656049705
set_robot_commands_median0.006770087877909343
set_robot_commands_min0.004689642974922249
sim_compute_performance-ego_max0.007587240926874509
sim_compute_performance-ego_mean0.004940096916551228
sim_compute_performance-ego_median0.005290504847987417
sim_compute_performance-ego_min0.003782621375075332
sim_compute_robot_state-ego_max0.009306955637421998
sim_compute_robot_state-ego_mean0.006303436899947845
sim_compute_robot_state-ego_median0.006733659674359866
sim_compute_robot_state-ego_min0.004940069473541535
sim_compute_robot_state-npc0_max0.00873271774196025
sim_compute_robot_state-npc0_mean0.005970862369927434
sim_compute_robot_state-npc0_median0.006498090922832489
sim_compute_robot_state-npc0_min0.004631767401824126
sim_compute_robot_state-npc1_max0.008900676883241665
sim_compute_robot_state-npc1_mean0.005776054945318261
sim_compute_robot_state-npc1_median0.00619599183400472
sim_compute_robot_state-npc1_min0.00441094024761303
sim_compute_robot_state-npc2_max0.008709169783682193
sim_compute_robot_state-npc2_mean0.0057305133676803875
sim_compute_robot_state-npc2_median0.006210918779726382
sim_compute_robot_state-npc2_min0.0043910956597542974
sim_compute_robot_state-npc3_max0.008802547394854468
sim_compute_robot_state-npc3_mean0.00572336173888396
sim_compute_robot_state-npc3_median0.006069472630818685
sim_compute_robot_state-npc3_min0.004397903476749455
sim_compute_sim_state_max0.005251893457376732
sim_compute_sim_state_mean0.0035323764951264913
sim_compute_sim_state_median0.003737944735294324
sim_compute_sim_state_min0.0027673400451089735
sim_physics_max0.22317684071618807
sim_physics_mean0.13221042395325774
sim_physics_median0.13968673676096333
sim_physics_min0.09353603276991308
sim_render-ego_max0.012752919826867446
sim_render-ego_mean0.008681253975715472
sim_render-ego_median0.00919549862543742
sim_render-ego_min0.006782822780780964
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.666666666666677
survival_time_min2.0500000000000007
No reset possible
280325139Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7738703506175961
survival_time_median4.199999999999993
deviation-center-line_median0.15507420143171857
in-drivable-lane_median1.2999999999999954


other stats
agent_compute-ego_max0.10887149402073452
agent_compute-ego_mean0.1039521507360084
agent_compute-ego_median0.1033468423066316
agent_compute-ego_min0.10066174893152148
deviation-center-line_max0.2513952862112988
deviation-center-line_mean0.1794115010827276
deviation-center-line_min0.1064300393891516
deviation-heading_max0.9255393258704254
deviation-heading_mean0.7637694070194493
deviation-heading_median0.8287617932876593
deviation-heading_min0.4348833608492356
driven_any_max1.192467813285462
driven_any_mean1.058299292901044
driven_any_median1.0806627544616412
driven_any_min0.8011389746052172
driven_lanedir_consec_max1.013981764221104
driven_lanedir_consec_mean0.7075299905990403
driven_lanedir_consec_min0.3488532955593695
driven_lanedir_max1.013981764221104
driven_lanedir_mean0.7075299905990403
driven_lanedir_median0.7738703506175961
driven_lanedir_min0.3488532955593695
in-drivable-lane_max1.5499999999999958
in-drivable-lane_mean1.0999999999999963
in-drivable-lane_min0.09999999999999964
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0387350079940367, "sim_physics": 0.05758444468180338, "survival_time": 4.049999999999994, "driven_lanedir": 0.621506574281696, "sim_render-ego": 0.007234058262389384, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.1033468423066316, "deviation-heading": 0.9255393258704254, "set_robot_commands": 0.005066606733534072, "deviation-center-line": 0.14080272890261294, "driven_lanedir_consec": 0.621506574281696, "sim_compute_sim_state": 0.0030268769205352404, "sim_compute_performance-ego": 0.0042101512720555435, "sim_compute_robot_state-ego": 0.005175614062650704}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1784919141588632, "sim_physics": 0.05693569288148985, "survival_time": 4.549999999999992, "driven_lanedir": 0.7738703506175961, "sim_render-ego": 0.00718513425889906, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.10887149402073452, "deviation-heading": 0.8287617932876593, "set_robot_commands": 0.004933234099503402, "deviation-center-line": 0.24335524947885612, "driven_lanedir_consec": 0.7738703506175961, "sim_compute_sim_state": 0.0029477942120897903, "sim_compute_performance-ego": 0.003954834990449004, "sim_compute_robot_state-ego": 0.005159862748869173}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0806627544616412, "sim_physics": 0.055924688066755025, "survival_time": 4.199999999999993, "driven_lanedir": 1.013981764221104, "sim_render-ego": 0.007280920233045306, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.10066174893152148, "deviation-heading": 0.7950235638305992, "set_robot_commands": 0.005010562283652169, "deviation-center-line": 0.2513952862112988, "driven_lanedir_consec": 1.013981764221104, "sim_compute_sim_state": 0.0029886790684291293, "sim_compute_performance-ego": 0.004004543735867455, "sim_compute_robot_state-ego": 0.005176853565942673}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8011389746052172, "sim_physics": 0.056822918355464935, "survival_time": 3.1999999999999966, "driven_lanedir": 0.3488532955593695, "sim_render-ego": 0.007273409515619278, "in-drivable-lane": 1.5499999999999958, "agent_compute-ego": 0.10083182528614998, "deviation-heading": 0.4348833608492356, "set_robot_commands": 0.0050351545214653015, "deviation-center-line": 0.1064300393891516, "driven_lanedir_consec": 0.3488532955593695, "sim_compute_sim_state": 0.0029646456241607666, "sim_compute_performance-ego": 0.003996606916189194, "sim_compute_robot_state-ego": 0.005174547433853149}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.192467813285462, "sim_physics": 0.05602273215418276, "survival_time": 4.599999999999992, "driven_lanedir": 0.779437968315436, "sim_render-ego": 0.007169671680616296, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.10604884313500446, "deviation-heading": 0.8346389912593272, "set_robot_commands": 0.004896905111229938, "deviation-center-line": 0.15507420143171857, "driven_lanedir_consec": 0.779437968315436, "sim_compute_sim_state": 0.0029662951179172683, "sim_compute_performance-ego": 0.003951103790946629, "sim_compute_robot_state-ego": 0.0051152265590170155}}
set_robot_commands_max0.005066606733534072
set_robot_commands_mean0.004988492549876976
set_robot_commands_median0.005010562283652169
set_robot_commands_min0.004896905111229938
sim_compute_performance-ego_max0.0042101512720555435
sim_compute_performance-ego_mean0.004023448141101565
sim_compute_performance-ego_median0.003996606916189194
sim_compute_performance-ego_min0.003951103790946629
sim_compute_robot_state-ego_max0.005176853565942673
sim_compute_robot_state-ego_mean0.005160420874066543
sim_compute_robot_state-ego_median0.005174547433853149
sim_compute_robot_state-ego_min0.0051152265590170155
sim_compute_sim_state_max0.0030268769205352404
sim_compute_sim_state_mean0.002978858188626439
sim_compute_sim_state_median0.0029662951179172683
sim_compute_sim_state_min0.0029477942120897903
sim_physics_max0.05758444468180338
sim_physics_mean0.05665809522793919
sim_physics_median0.056822918355464935
sim_physics_min0.055924688066755025
sim_render-ego_max0.007280920233045306
sim_render-ego_mean0.007228638790113864
sim_render-ego_median0.007234058262389384
sim_render-ego_min0.007169671680616296
simulation-passed1
survival_time_max4.599999999999992
survival_time_mean4.119999999999993
survival_time_min3.1999999999999966
No reset possible
279975110Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.872898854635725
survival_time_median8.549999999999986
deviation-center-line_median0.42827974602228447
in-drivable-lane_median0.6500000000000006


other stats
agent_compute-ego_max0.047153388833724
agent_compute-ego_mean0.03892205364374099
agent_compute-ego_median0.04111377965836298
agent_compute-ego_min0.029338544674133982
deviation-center-line_max0.8396371903084382
deviation-center-line_mean0.4279887614478892
deviation-center-line_min0.09281115283608272
deviation-heading_max3.922788516018864
deviation-heading_mean2.3865618480166892
deviation-heading_median2.5500844635412925
deviation-heading_min0.8732576324174612
driven_any_max4.085240235958015
driven_any_mean2.067372199931722
driven_any_median2.296507374211965
driven_any_min0.49361712629696225
driven_lanedir_consec_max3.3567638044729007
driven_lanedir_consec_mean1.6668956375880302
driven_lanedir_consec_min0.19433432588614852
driven_lanedir_max3.3567638044729007
driven_lanedir_mean1.6953532232341282
driven_lanedir_median1.8775902848503092
driven_lanedir_min0.20958907488047585
in-drivable-lane_max1.799999999999996
in-drivable-lane_mean0.6900000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1371538760623296, "sim_physics": 0.10902591501728871, "survival_time": 4.449999999999992, "driven_lanedir": 0.8015465497872555, "sim_render-ego": 0.01263526048553124, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.029338544674133982, "deviation-heading": 2.5500844635412925, "set_robot_commands": 0.011013896277781285, "deviation-center-line": 0.26924852242184555, "driven_lanedir_consec": 0.6792048007656782, "sim_compute_sim_state": 0.005323423428481884, "sim_compute_performance-ego": 0.007522325837210323, "sim_compute_robot_state-ego": 0.009339787986841095}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3243423871293394, "sim_physics": 0.10879457479267451, "survival_time": 8.649999999999988, "driven_lanedir": 1.8775902848503092, "sim_render-ego": 0.013046068952262744, "in-drivable-lane": 0.850000000000005, "agent_compute-ego": 0.047153388833724, "deviation-heading": 2.8737501923861197, "set_robot_commands": 0.010549197996282853, "deviation-center-line": 0.42827974602228447, "driven_lanedir_consec": 1.872898854635725, "sim_compute_sim_state": 0.005104034622280584, "sim_compute_performance-ego": 0.007732662851410794, "sim_compute_robot_state-ego": 0.00986295766224062}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.085240235958015, "sim_physics": 0.11222321192423504, "survival_time": 14.950000000000076, "driven_lanedir": 3.3567638044729007, "sim_render-ego": 0.01310935099919637, "in-drivable-lane": 1.799999999999996, "agent_compute-ego": 0.04447902123133341, "deviation-heading": 3.922788516018864, "set_robot_commands": 0.010518399079640708, "deviation-center-line": 0.8396371903084382, "driven_lanedir_consec": 3.3567638044729007, "sim_compute_sim_state": 0.005393341382344563, "sim_compute_performance-ego": 0.00770661989847819, "sim_compute_robot_state-ego": 0.00959792931874593}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.49361712629696225, "sim_physics": 0.09237580639975412, "survival_time": 2.1000000000000005, "driven_lanedir": 0.20958907488047585, "sim_render-ego": 0.011084477106730144, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.04111377965836298, "deviation-heading": 0.8732576324174612, "set_robot_commands": 0.008255237624758766, "deviation-center-line": 0.09281115283608272, "driven_lanedir_consec": 0.19433432588614852, "sim_compute_sim_state": 0.0047402722494942805, "sim_compute_performance-ego": 0.007184425989786784, "sim_compute_robot_state-ego": 0.008031742913382394}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.296507374211965, "sim_physics": 0.06697347568489655, "survival_time": 8.549999999999986, "driven_lanedir": 2.231276402179699, "sim_render-ego": 0.008347463886640226, "in-drivable-lane": 0, "agent_compute-ego": 0.03252553382115057, "deviation-heading": 1.7129284357197068, "set_robot_commands": 0.005933471590454815, "deviation-center-line": 0.5099671956507951, "driven_lanedir_consec": 2.231276402179699, "sim_compute_sim_state": 0.0035889511219939292, "sim_compute_performance-ego": 0.004737968333283363, "sim_compute_robot_state-ego": 0.00610678656059399}}
set_robot_commands_max0.011013896277781285
set_robot_commands_mean0.009254040513783684
set_robot_commands_median0.010518399079640708
set_robot_commands_min0.005933471590454815
sim_compute_performance-ego_max0.007732662851410794
sim_compute_performance-ego_mean0.00697680058203389
sim_compute_performance-ego_median0.007522325837210323
sim_compute_performance-ego_min0.004737968333283363
sim_compute_robot_state-ego_max0.00986295766224062
sim_compute_robot_state-ego_mean0.008587840888360804
sim_compute_robot_state-ego_median0.009339787986841095
sim_compute_robot_state-ego_min0.00610678656059399
sim_compute_sim_state_max0.005393341382344563
sim_compute_sim_state_mean0.004830004560919048
sim_compute_sim_state_median0.005104034622280584
sim_compute_sim_state_min0.0035889511219939292
sim_physics_max0.11222321192423504
sim_physics_mean0.09787859676376978
sim_physics_median0.10879457479267451
sim_physics_min0.06697347568489655
sim_render-ego_max0.01310935099919637
sim_render-ego_mean0.011644524286072143
sim_render-ego_median0.01263526048553124
sim_render-ego_min0.008347463886640226
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.740000000000009
survival_time_min2.1000000000000005
No reset possible
279255072Dong Wang 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9063375143143717
survival_time_median13.80000000000006
deviation-center-line_median0.8227612413083848
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05860914627710978
agent_compute-ego_mean0.03862931876762645
agent_compute-ego_median0.03414999402087668
agent_compute-ego_min0.023149673562300833
deviation-center-line_max1.0129503186845323
deviation-center-line_mean0.706594949165468
deviation-center-line_min0.15244074712608446
deviation-heading_max4.844309011901852
deviation-heading_mean1.8465037042722712
deviation-heading_median1.1886669461348784
deviation-heading_min0.9024405198219236
driven_any_max2.3491584725324195
driven_any_mean1.8975411657888988
driven_any_median2.1641062080166713
driven_any_min0.7020915835987597
driven_lanedir_consec_max2.3413774120148365
driven_lanedir_consec_mean1.7208135348194076
driven_lanedir_consec_min0.639980657330883
driven_lanedir_max2.3413774120148365
driven_lanedir_mean1.786146932377345
driven_lanedir_median1.9063375143143717
driven_lanedir_min0.639980657330883
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean0.27000000000000346
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7020915835987597, "sim_physics": 0.08244838212665759, "survival_time": 4.749999999999991, "driven_lanedir": 0.639980657330883, "sim_render-ego": 0.009557437896728516, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.023149673562300833, "deviation-heading": 1.1076691956947513, "set_robot_commands": 0.009035878432424444, "deviation-center-line": 0.15244074712608446, "driven_lanedir_consec": 0.639980657330883, "sim_compute_sim_state": 0.004448765202572471, "sim_compute_performance-ego": 0.005839265020270097, "sim_compute_robot_state-ego": 0.006946024141813579}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9232060894318623, "sim_physics": 0.117298399529806, "survival_time": 12.30000000000004, "driven_lanedir": 1.9063375143143717, "sim_render-ego": 0.012699320064327582, "in-drivable-lane": 0, "agent_compute-ego": 0.028234454674449395, "deviation-heading": 1.1894328478079503, "set_robot_commands": 0.011705494508510682, "deviation-center-line": 0.7115805775256612, "driven_lanedir_consec": 1.9063375143143717, "sim_compute_sim_state": 0.005753314592004791, "sim_compute_performance-ego": 0.007314309841249048, "sim_compute_robot_state-ego": 0.009345390932346749}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.1641062080166713, "sim_physics": 0.09850070441978565, "survival_time": 13.80000000000006, "driven_lanedir": 1.7092584888145432, "sim_render-ego": 0.011787592500880144, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.03414999402087668, "deviation-heading": 4.844309011901852, "set_robot_commands": 0.010575650394826696, "deviation-center-line": 0.8227612413083848, "driven_lanedir_consec": 1.3825915010248582, "sim_compute_sim_state": 0.005225000174149223, "sim_compute_performance-ego": 0.006763059159983759, "sim_compute_robot_state-ego": 0.008800674175870592}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.34914347536478, "sim_physics": 0.1004179048538208, "survival_time": 14.950000000000076, "driven_lanedir": 2.3337805894120898, "sim_render-ego": 0.01235523541768392, "in-drivable-lane": 0, "agent_compute-ego": 0.04900332530339559, "deviation-heading": 1.1886669461348784, "set_robot_commands": 0.009665876229604086, "deviation-center-line": 1.0129503186845323, "driven_lanedir_consec": 2.3337805894120898, "sim_compute_sim_state": 0.005063176949818929, "sim_compute_performance-ego": 0.007301470438639323, "sim_compute_robot_state-ego": 0.008899621963500977}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491584725324195, "sim_physics": 0.11655184030532836, "survival_time": 14.950000000000076, "driven_lanedir": 2.3413774120148365, "sim_render-ego": 0.01263509750366211, "in-drivable-lane": 0, "agent_compute-ego": 0.05860914627710978, "deviation-heading": 0.9024405198219236, "set_robot_commands": 0.010268646081288656, "deviation-center-line": 0.8332418611826771, "driven_lanedir_consec": 2.3413774120148365, "sim_compute_sim_state": 0.005493114789326986, "sim_compute_performance-ego": 0.007492853800455729, "sim_compute_robot_state-ego": 0.00973515510559082}}
set_robot_commands_max0.011705494508510682
set_robot_commands_mean0.010250309129330911
set_robot_commands_median0.010268646081288656
set_robot_commands_min0.009035878432424444
sim_compute_performance-ego_max0.007492853800455729
sim_compute_performance-ego_mean0.006942191652119592
sim_compute_performance-ego_median0.007301470438639323
sim_compute_performance-ego_min0.005839265020270097
sim_compute_robot_state-ego_max0.00973515510559082
sim_compute_robot_state-ego_mean0.008745373263824543
sim_compute_robot_state-ego_median0.008899621963500977
sim_compute_robot_state-ego_min0.006946024141813579
sim_compute_sim_state_max0.005753314592004791
sim_compute_sim_state_mean0.005196674341574481
sim_compute_sim_state_median0.005225000174149223
sim_compute_sim_state_min0.004448765202572471
sim_physics_max0.117298399529806
sim_physics_mean0.10304344624707969
sim_physics_median0.1004179048538208
sim_physics_min0.08244838212665759
sim_render-ego_max0.012699320064327582
sim_render-ego_mean0.011806936676656454
sim_render-ego_median0.01235523541768392
sim_render-ego_min0.009557437896728516
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.150000000000048
survival_time_min4.749999999999991
No reset possible
278605034Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.744660976365596
survival_time_median14.950000000000076
deviation-center-line_median0.8863889462838344
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.015697805086771648
agent_compute-ego_mean0.015554506551651729
agent_compute-ego_median0.015551025526864187
agent_compute-ego_min0.01540073315302531
deviation-center-line_max1.233558588403223
deviation-center-line_mean0.8288630048000091
deviation-center-line_min0.09010189209181188
deviation-heading_max5.25234669296015
deviation-heading_mean3.251332372159478
deviation-heading_median4.055167487847364
deviation-heading_min0.20969011807046223
driven_any_max6.043615947900503
driven_any_mean4.109331811942618
driven_any_median4.528862185158816
driven_any_min0.3736282667331102
driven_lanedir_consec_max5.610193234950836
driven_lanedir_consec_mean2.6415689094449
driven_lanedir_consec_min0.3668279858398795
driven_lanedir_max5.645368063419123
driven_lanedir_mean3.790349172927054
driven_lanedir_median4.190808173672191
driven_lanedir_min0.3668279858398795
in-drivable-lane_max2.0500000000000203
in-drivable-lane_mean0.6400000000000048
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.528862185158816, "sim_physics": 0.05600199540456136, "survival_time": 14.950000000000076, "driven_lanedir": 4.190808173672191, "sim_render-ego": 0.006936101118723551, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.015697805086771648, "deviation-heading": 4.055167487847364, "set_robot_commands": 0.007364622751871745, "deviation-center-line": 1.0693664386586803, "driven_lanedir_consec": 3.115063888010941, "sim_compute_sim_state": 0.0039486153920491535, "sim_compute_performance-ego": 0.004067048231760661, "sim_compute_robot_state-ego": 0.005106500784556071}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3736282667331102, "sim_physics": 0.060636627674102786, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3668279858398795, "sim_render-ego": 0.007442581653594971, "in-drivable-lane": 0, "agent_compute-ego": 0.015677285194396973, "deviation-heading": 0.20969011807046223, "set_robot_commands": 0.007774531841278076, "deviation-center-line": 0.09010189209181188, "driven_lanedir_consec": 0.3668279858398795, "sim_compute_sim_state": 0.004481947422027588, "sim_compute_performance-ego": 0.003994500637054444, "sim_compute_robot_state-ego": 0.0050471782684326175}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.73624990490956, "sim_physics": 0.055775277614593506, "survival_time": 14.950000000000076, "driven_lanedir": 5.610193234950836, "sim_render-ego": 0.0070025436083475745, "in-drivable-lane": 0, "agent_compute-ego": 0.01540073315302531, "deviation-heading": 2.682681966840246, "set_robot_commands": 0.007214928468068441, "deviation-center-line": 1.233558588403223, "driven_lanedir_consec": 5.610193234950836, "sim_compute_sim_state": 0.003879881699879964, "sim_compute_performance-ego": 0.004015909830729167, "sim_compute_robot_state-ego": 0.005042378107706706}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.864302755011102, "sim_physics": 0.05744891762733459, "survival_time": 14.000000000000064, "driven_lanedir": 3.138548406753242, "sim_render-ego": 0.006997509513582502, "in-drivable-lane": 2.0500000000000203, "agent_compute-ego": 0.015551025526864187, "deviation-heading": 5.25234669296015, "set_robot_commands": 0.007267730576651437, "deviation-center-line": 0.8863889462838344, "driven_lanedir_consec": 1.3710984620572495, "sim_compute_sim_state": 0.004015207290649414, "sim_compute_performance-ego": 0.003982973098754883, "sim_compute_robot_state-ego": 0.005060966525759015}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 6.043615947900503, "sim_physics": 0.05784302234649658, "survival_time": 14.950000000000076, "driven_lanedir": 5.645368063419123, "sim_render-ego": 0.0070586212476094565, "in-drivable-lane": 0.6500000000000057, "agent_compute-ego": 0.01544568379720052, "deviation-heading": 4.056775595079167, "set_robot_commands": 0.007157476743062338, "deviation-center-line": 0.8648991585624957, "driven_lanedir_consec": 2.744660976365596, "sim_compute_sim_state": 0.003980244795481364, "sim_compute_performance-ego": 0.004003694057464599, "sim_compute_robot_state-ego": 0.005081030527750651}}
set_robot_commands_max0.007774531841278076
set_robot_commands_mean0.007355858076186407
set_robot_commands_median0.007267730576651437
set_robot_commands_min0.007157476743062338
sim_compute_performance-ego_max0.004067048231760661
sim_compute_performance-ego_mean0.004012825171152751
sim_compute_performance-ego_median0.004003694057464599
sim_compute_performance-ego_min0.003982973098754883
sim_compute_robot_state-ego_max0.005106500784556071
sim_compute_robot_state-ego_mean0.005067610842841012
sim_compute_robot_state-ego_median0.005060966525759015
sim_compute_robot_state-ego_min0.005042378107706706
sim_compute_sim_state_max0.004481947422027588
sim_compute_sim_state_mean0.004061179320017497
sim_compute_sim_state_median0.003980244795481364
sim_compute_sim_state_min0.003879881699879964
sim_physics_max0.060636627674102786
sim_physics_mean0.05754116813341777
sim_physics_median0.05744891762733459
sim_physics_min0.055775277614593506
sim_render-ego_max0.007442581653594971
sim_render-ego_mean0.007087471428371611
sim_render-ego_median0.0070025436083475745
sim_render-ego_min0.006936101118723551
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.97000000000006
survival_time_min1.0000000000000002
No reset possible
278485027Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.465476166982261
survival_time_median14.950000000000076
deviation-center-line_median0.7657667602922041
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01594157854715983
agent_compute-ego_mean0.01567346461613973
agent_compute-ego_median0.015635386308034262
agent_compute-ego_min0.01554835081100464
deviation-center-line_max0.8831991892577035
deviation-center-line_mean0.7847377874313771
deviation-center-line_min0.7024798975698976
deviation-heading_max4.8050978716663355
deviation-heading_mean4.0001870040261265
deviation-heading_median3.956669599105634
deviation-heading_min3.129418203539607
driven_any_max4.508421786198214
driven_any_mean3.413870998382174
driven_any_median3.636337634247226
driven_any_min2.323628042496487
driven_lanedir_consec_max4.383331241499343
driven_lanedir_consec_mean3.1961809865889763
driven_lanedir_consec_min2.130935522433573
driven_lanedir_max4.383331241499343
driven_lanedir_mean3.1961809865889763
driven_lanedir_median3.465476166982261
driven_lanedir_min2.130935522433573
in-drivable-lane_max2.450000000000007
in-drivable-lane_mean0.4900000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.323628042496487, "sim_physics": 0.056048454443613685, "survival_time": 14.950000000000076, "driven_lanedir": 2.130935522433573, "sim_render-ego": 0.006895232200622559, "in-drivable-lane": 0, "agent_compute-ego": 0.01594157854715983, "deviation-heading": 4.8050978716663355, "set_robot_commands": 0.007046101093292237, "deviation-center-line": 0.8649214944598204, "driven_lanedir_consec": 2.130935522433573, "sim_compute_sim_state": 0.0036509291330973303, "sim_compute_performance-ego": 0.0040640838940938315, "sim_compute_robot_state-ego": 0.005044782161712646}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.636337634247226, "sim_physics": 0.05505236307779948, "survival_time": 14.950000000000076, "driven_lanedir": 3.465476166982261, "sim_render-ego": 0.007069354852040609, "in-drivable-lane": 0, "agent_compute-ego": 0.015582120418548584, "deviation-heading": 3.649421900336011, "set_robot_commands": 0.007063422997792562, "deviation-center-line": 0.7657667602922041, "driven_lanedir_consec": 3.465476166982261, "sim_compute_sim_state": 0.0036223578453063966, "sim_compute_performance-ego": 0.003969946702321371, "sim_compute_robot_state-ego": 0.00500578244527181}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.8900591116285463, "sim_physics": 0.05393004020055135, "survival_time": 14.950000000000076, "driven_lanedir": 2.4018884860942853, "sim_render-ego": 0.007037777900695801, "in-drivable-lane": 2.450000000000007, "agent_compute-ego": 0.01554835081100464, "deviation-heading": 4.460327445483046, "set_robot_commands": 0.007047186692555746, "deviation-center-line": 0.8831991892577035, "driven_lanedir_consec": 2.4018884860942853, "sim_compute_sim_state": 0.003633734385172526, "sim_compute_performance-ego": 0.00399689515431722, "sim_compute_robot_state-ego": 0.005047133763631185}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.508421786198214, "sim_physics": 0.05524791797002157, "survival_time": 14.950000000000076, "driven_lanedir": 4.383331241499343, "sim_render-ego": 0.006991555690765381, "in-drivable-lane": 0, "agent_compute-ego": 0.015659886995951333, "deviation-heading": 3.129418203539607, "set_robot_commands": 0.007165931860605876, "deviation-center-line": 0.7073215955772603, "driven_lanedir_consec": 4.383331241499343, "sim_compute_sim_state": 0.0035891373952229816, "sim_compute_performance-ego": 0.0039995900789896646, "sim_compute_robot_state-ego": 0.005031889279683431}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.7109084173403986, "sim_physics": 0.05665812969207764, "survival_time": 14.950000000000076, "driven_lanedir": 3.599273515935419, "sim_render-ego": 0.007059313456217448, "in-drivable-lane": 0, "agent_compute-ego": 0.015635386308034262, "deviation-heading": 3.956669599105634, "set_robot_commands": 0.0070469323794047035, "deviation-center-line": 0.7024798975698976, "driven_lanedir_consec": 3.599273515935419, "sim_compute_sim_state": 0.003672801653544108, "sim_compute_performance-ego": 0.0039860955874125165, "sim_compute_robot_state-ego": 0.005025091965993245}}
set_robot_commands_max0.007165931860605876
set_robot_commands_mean0.007073915004730225
set_robot_commands_median0.007047186692555746
set_robot_commands_min0.007046101093292237
sim_compute_performance-ego_max0.0040640838940938315
sim_compute_performance-ego_mean0.00400332228342692
sim_compute_performance-ego_median0.00399689515431722
sim_compute_performance-ego_min0.003969946702321371
sim_compute_robot_state-ego_max0.005047133763631185
sim_compute_robot_state-ego_mean0.005030935923258464
sim_compute_robot_state-ego_median0.005031889279683431
sim_compute_robot_state-ego_min0.00500578244527181
sim_compute_sim_state_max0.003672801653544108
sim_compute_sim_state_mean0.003633792082468669
sim_compute_sim_state_median0.003633734385172526
sim_compute_sim_state_min0.0035891373952229816
sim_physics_max0.05665812969207764
sim_physics_mean0.05538738107681275
sim_physics_median0.05524791797002157
sim_physics_min0.05393004020055135
sim_render-ego_max0.007069354852040609
sim_render-ego_mean0.00701064682006836
sim_render-ego_median0.007037777900695801
sim_render-ego_min0.006895232200622559
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
278385020Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:14:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.815367349410104
survival_time_median14.950000000000076
deviation-center-line_median0.698108940364851
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05153892596562704
agent_compute-ego_mean0.050218924840291335
agent_compute-ego_median0.04997446060180664
agent_compute-ego_min0.04905416568120321
deviation-center-line_max0.7666735327063943
deviation-center-line_mean0.6922632118735079
deviation-center-line_min0.5757948893997622
deviation-heading_max3.9834810046616744
deviation-heading_mean3.3027996909356374
deviation-heading_median3.569766967596125
deviation-heading_min2.514087446293116
driven_any_max4.185652857491303
driven_any_mean3.703417125387244
driven_any_median4.107081588734527
driven_any_min2.8453531808378676
driven_lanedir_consec_max4.030300183693614
driven_lanedir_consec_mean3.5211172264521124
driven_lanedir_consec_min2.72920368435152
driven_lanedir_max4.030300183693614
driven_lanedir_mean3.530696579318466
driven_lanedir_median3.863264113741875
driven_lanedir_min2.72920368435152
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.4300000000000013
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2154325318290664, "sim_physics": 0.1164366579055786, "survival_time": 14.950000000000076, "driven_lanedir": 3.0889521695715634, "sim_render-ego": 0.012582488059997558, "in-drivable-lane": 0, "agent_compute-ego": 0.049555724461873375, "deviation-heading": 3.9834810046616744, "set_robot_commands": 0.011036661465962728, "deviation-center-line": 0.7666735327063943, "driven_lanedir_consec": 3.0889521695715634, "sim_compute_sim_state": 0.0053788956006368, "sim_compute_performance-ego": 0.00768095334370931, "sim_compute_robot_state-ego": 0.009670131206512451}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.8453531808378676, "sim_physics": 0.11280605236689248, "survival_time": 14.950000000000076, "driven_lanedir": 2.72920368435152, "sim_render-ego": 0.012582061290740966, "in-drivable-lane": 0, "agent_compute-ego": 0.05153892596562704, "deviation-heading": 3.569766967596125, "set_robot_commands": 0.009895331859588625, "deviation-center-line": 0.732911038047225, "driven_lanedir_consec": 2.72920368435152, "sim_compute_sim_state": 0.005071426232655843, "sim_compute_performance-ego": 0.007427599430084229, "sim_compute_robot_state-ego": 0.00942766269048055}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.185652857491303, "sim_physics": 0.1085441740353902, "survival_time": 14.950000000000076, "driven_lanedir": 3.9417627452337594, "sim_render-ego": 0.0136903977394104, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.05097134749094645, "deviation-heading": 2.514087446293116, "set_robot_commands": 0.010349667072296145, "deviation-center-line": 0.6878276588493071, "driven_lanedir_consec": 3.9417627452337594, "sim_compute_sim_state": 0.005293917655944824, "sim_compute_performance-ego": 0.0074193477630615234, "sim_compute_robot_state-ego": 0.00945106585820516}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.163565468043456, "sim_physics": 0.10062674283981324, "survival_time": 14.950000000000076, "driven_lanedir": 3.863264113741875, "sim_render-ego": 0.012005615234375, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.04997446060180664, "deviation-heading": 3.8925923263932978, "set_robot_commands": 0.009662965933481852, "deviation-center-line": 0.5757948893997622, "driven_lanedir_consec": 3.815367349410104, "sim_compute_sim_state": 0.005030161539713542, "sim_compute_performance-ego": 0.007220104535420735, "sim_compute_robot_state-ego": 0.009082427024841308}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.107081588734527, "sim_physics": 0.10074647188186646, "survival_time": 14.950000000000076, "driven_lanedir": 4.030300183693614, "sim_render-ego": 0.01183333953221639, "in-drivable-lane": 0, "agent_compute-ego": 0.04905416568120321, "deviation-heading": 2.5540707097339777, "set_robot_commands": 0.009329345226287842, "deviation-center-line": 0.698108940364851, "driven_lanedir_consec": 4.030300183693614, "sim_compute_sim_state": 0.004972060521443685, "sim_compute_performance-ego": 0.006962494055430094, "sim_compute_robot_state-ego": 0.008834693431854248}}
set_robot_commands_max0.011036661465962728
set_robot_commands_mean0.010054794311523438
set_robot_commands_median0.009895331859588625
set_robot_commands_min0.009329345226287842
sim_compute_performance-ego_max0.00768095334370931
sim_compute_performance-ego_mean0.007342099825541179
sim_compute_performance-ego_median0.0074193477630615234
sim_compute_performance-ego_min0.006962494055430094
sim_compute_robot_state-ego_max0.009670131206512451
sim_compute_robot_state-ego_mean0.009293196042378745
sim_compute_robot_state-ego_median0.00942766269048055
sim_compute_robot_state-ego_min0.008834693431854248
sim_compute_sim_state_max0.0053788956006368
sim_compute_sim_state_mean0.005149292310078939
sim_compute_sim_state_median0.005071426232655843
sim_compute_sim_state_min0.004972060521443685
sim_physics_max0.1164366579055786
sim_physics_mean0.1078320198059082
sim_physics_median0.1085441740353902
sim_physics_min0.10062674283981324
sim_render-ego_max0.0136903977394104
sim_render-ego_mean0.012538780371348065
sim_render-ego_median0.012582061290740966
sim_render-ego_min0.01183333953221639
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
278265014Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.519309271755138
survival_time_median14.950000000000076
deviation-center-line_median0.8307644918232278
in-drivable-lane_median1.2999999999999998


other stats
agent_compute-ego_max0.02253643751144409
agent_compute-ego_mean0.019669725100199383
agent_compute-ego_median0.020747234026590983
agent_compute-ego_min0.015221978028615316
deviation-center-line_max1.1316588247302473
deviation-center-line_mean0.8276046474751775
deviation-center-line_min0.6228434570879181
deviation-heading_max4.567879285530279
deviation-heading_mean3.7754743668601294
deviation-heading_median3.704308636397408
deviation-heading_min3.132805840375968
driven_any_max4.46224723195534
driven_any_mean3.637543269241013
driven_any_median3.572490132795074
driven_any_min3.012422607235822
driven_lanedir_consec_max3.053189403080188
driven_lanedir_consec_mean2.41554008754656
driven_lanedir_consec_min1.6615637046905278
driven_lanedir_max4.200852718602098
driven_lanedir_mean3.286563059164747
driven_lanedir_median3.053189403080188
driven_lanedir_min2.704249409876047
in-drivable-lane_max3.150000000000019
in-drivable-lane_mean1.7000000000000006
in-drivable-lane_min1.1999999999999955
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.368957564567264, "sim_physics": 0.07715720415115357, "survival_time": 14.950000000000076, "driven_lanedir": 3.053189403080188, "sim_render-ego": 0.00938784122467041, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.022436572710673015, "deviation-heading": 3.8983212913004577, "set_robot_commands": 0.009008913040161132, "deviation-center-line": 0.8307644918232278, "driven_lanedir_consec": 3.053189403080188, "sim_compute_sim_state": 0.004699624379475911, "sim_compute_performance-ego": 0.0056385429700215655, "sim_compute_robot_state-ego": 0.006983990669250488}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.012422607235822, "sim_physics": 0.0767744755744934, "survival_time": 14.950000000000076, "driven_lanedir": 2.704249409876047, "sim_render-ego": 0.01091097593307495, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.02253643751144409, "deviation-heading": 4.567879285530279, "set_robot_commands": 0.009457352956136068, "deviation-center-line": 1.1316588247302473, "driven_lanedir_consec": 1.6615637046905278, "sim_compute_sim_state": 0.004403239091237386, "sim_compute_performance-ego": 0.005854802926381429, "sim_compute_robot_state-ego": 0.007239888509114584}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.572490132795074, "sim_physics": 0.07479072491327922, "survival_time": 14.950000000000076, "driven_lanedir": 2.925231892409953, "sim_render-ego": 0.009454012711842857, "in-drivable-lane": 3.150000000000019, "agent_compute-ego": 0.020747234026590983, "deviation-heading": 3.5740567806965347, "set_robot_commands": 0.00909791151682536, "deviation-center-line": 0.6598137937431, "driven_lanedir_consec": 2.925231892409953, "sim_compute_sim_state": 0.004449257850646973, "sim_compute_performance-ego": 0.0055309565862019855, "sim_compute_robot_state-ego": 0.006908167997996012}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.7715988096515662, "sim_physics": 0.061271293958028154, "survival_time": 14.950000000000076, "driven_lanedir": 3.5492918718554485, "sim_render-ego": 0.007762018044789632, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.017406403223673504, "deviation-heading": 3.704308636397408, "set_robot_commands": 0.00779681921005249, "deviation-center-line": 0.8929426699913938, "driven_lanedir_consec": 1.9184061657969955, "sim_compute_sim_state": 0.003952733675638835, "sim_compute_performance-ego": 0.0044321076075236, "sim_compute_robot_state-ego": 0.005652946631113688}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.46224723195534, "sim_physics": 0.05508339166641235, "survival_time": 14.950000000000076, "driven_lanedir": 4.200852718602098, "sim_render-ego": 0.007014428774515788, "in-drivable-lane": 1.2999999999999998, "agent_compute-ego": 0.015221978028615316, "deviation-heading": 3.132805840375968, "set_robot_commands": 0.006865053176879883, "deviation-center-line": 0.6228434570879181, "driven_lanedir_consec": 2.519309271755138, "sim_compute_sim_state": 0.0035489265124003092, "sim_compute_performance-ego": 0.003998998006184896, "sim_compute_robot_state-ego": 0.005063552856445313}}
set_robot_commands_max0.009457352956136068
set_robot_commands_mean0.008445209980010988
set_robot_commands_median0.009008913040161132
set_robot_commands_min0.006865053176879883
sim_compute_performance-ego_max0.005854802926381429
sim_compute_performance-ego_mean0.005091081619262696
sim_compute_performance-ego_median0.0055309565862019855
sim_compute_performance-ego_min0.003998998006184896
sim_compute_robot_state-ego_max0.007239888509114584
sim_compute_robot_state-ego_mean0.006369709332784017
sim_compute_robot_state-ego_median0.006908167997996012
sim_compute_robot_state-ego_min0.005063552856445313
sim_compute_sim_state_max0.004699624379475911
sim_compute_sim_state_mean0.0042107563018798835
sim_compute_sim_state_median0.004403239091237386
sim_compute_sim_state_min0.0035489265124003092
sim_physics_max0.07715720415115357
sim_physics_mean0.06901541805267333
sim_physics_median0.07479072491327922
sim_physics_min0.05508339166641235
sim_render-ego_max0.01091097593307495
sim_render-ego_mean0.008905855337778728
sim_render-ego_median0.00938784122467041
sim_render-ego_min0.007014428774515788
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
277965002Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-46-148-104920:13:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1563, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1619, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission5002/step1-simulation-ip-172-31-46-148-10492-job27796/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-4-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
277684994Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:10:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.05176134582984
survival_time_median14.950000000000076
deviation-center-line_median0.7520257227123401
in-drivable-lane_median1.1999999999999955


other stats
agent_compute-ego_max0.027657748063405353
agent_compute-ego_mean0.01888131793340047
agent_compute-ego_median0.01624879519144694
agent_compute-ego_min0.015466290314992267
deviation-center-line_max0.9292734266083048
deviation-center-line_mean0.7032467266546101
deviation-center-line_min0.4531849249973181
deviation-heading_max5.334994767290096
deviation-heading_mean3.518151436817636
deviation-heading_median3.03166833698295
deviation-heading_min2.722773540596461
driven_any_max3.859186493375805
driven_any_mean3.331291571578138
driven_any_median3.240542030684956
driven_any_min2.913542034980038
driven_lanedir_consec_max3.612434498122273
driven_lanedir_consec_mean2.857943006992931
driven_lanedir_consec_min1.2622280322817203
driven_lanedir_max3.612434498122273
driven_lanedir_mean3.107388670501286
driven_lanedir_median3.05176134582984
driven_lanedir_min2.509456349823494
in-drivable-lane_max2.100000000000013
in-drivable-lane_mean0.9900000000000052
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.240542030684956, "sim_physics": 0.056008710861206054, "survival_time": 14.950000000000076, "driven_lanedir": 2.9035511877132767, "sim_render-ego": 0.006887400150299072, "in-drivable-lane": 2.100000000000013, "agent_compute-ego": 0.01624879519144694, "deviation-heading": 3.699259652334654, "set_robot_commands": 0.007156836191813151, "deviation-center-line": 0.7520257227123401, "driven_lanedir_consec": 2.9035511877132767, "sim_compute_sim_state": 0.003847053050994873, "sim_compute_performance-ego": 0.004049086570739746, "sim_compute_robot_state-ego": 0.005089298089345296}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.526798325144535, "sim_physics": 0.05636672496795654, "survival_time": 14.950000000000076, "driven_lanedir": 3.459739971017544, "sim_render-ego": 0.0070193600654602055, "in-drivable-lane": 0, "agent_compute-ego": 0.015513799985249837, "deviation-heading": 2.722773540596461, "set_robot_commands": 0.006948902606964112, "deviation-center-line": 0.544252638002298, "driven_lanedir_consec": 3.459739971017544, "sim_compute_sim_state": 0.0036997278531392414, "sim_compute_performance-ego": 0.003965802987416585, "sim_compute_robot_state-ego": 0.0050922791163126625}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.859186493375805, "sim_physics": 0.05422144810358683, "survival_time": 14.950000000000076, "driven_lanedir": 3.612434498122273, "sim_render-ego": 0.007023286819458008, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.015466290314992267, "deviation-heading": 3.03166833698295, "set_robot_commands": 0.006885990301767985, "deviation-center-line": 0.8374969209527889, "driven_lanedir_consec": 3.612434498122273, "sim_compute_sim_state": 0.00372513214747111, "sim_compute_performance-ego": 0.003982896010080973, "sim_compute_robot_state-ego": 0.005087991555531819}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.913542034980038, "sim_physics": 0.06590032895406087, "survival_time": 14.950000000000076, "driven_lanedir": 2.509456349823494, "sim_render-ego": 0.008815852006276449, "in-drivable-lane": 1.6500000000000172, "agent_compute-ego": 0.01951995611190796, "deviation-heading": 5.334994767290096, "set_robot_commands": 0.008627124627431234, "deviation-center-line": 0.9292734266083048, "driven_lanedir_consec": 1.2622280322817203, "sim_compute_sim_state": 0.004199328422546386, "sim_compute_performance-ego": 0.005164351463317871, "sim_compute_robot_state-ego": 0.00653017520904541}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1163889737053574, "sim_physics": 0.12200043360392251, "survival_time": 14.950000000000076, "driven_lanedir": 3.05176134582984, "sim_render-ego": 0.012969640096028646, "in-drivable-lane": 0, "agent_compute-ego": 0.027657748063405353, "deviation-heading": 2.802060886884017, "set_robot_commands": 0.012314660549163818, "deviation-center-line": 0.4531849249973181, "driven_lanedir_consec": 3.05176134582984, "sim_compute_sim_state": 0.005917273362477621, "sim_compute_performance-ego": 0.007867052555084228, "sim_compute_robot_state-ego": 0.00992234230041504}}
set_robot_commands_max0.012314660549163818
set_robot_commands_mean0.00838670285542806
set_robot_commands_median0.007156836191813151
set_robot_commands_min0.006885990301767985
sim_compute_performance-ego_max0.007867052555084228
sim_compute_performance-ego_mean0.005005837917327881
sim_compute_performance-ego_median0.004049086570739746
sim_compute_performance-ego_min0.003965802987416585
sim_compute_robot_state-ego_max0.00992234230041504
sim_compute_robot_state-ego_mean0.006344417254130046
sim_compute_robot_state-ego_median0.0050922791163126625
sim_compute_robot_state-ego_min0.005087991555531819
sim_compute_sim_state_max0.005917273362477621
sim_compute_sim_state_mean0.004277702967325847
sim_compute_sim_state_median0.003847053050994873
sim_compute_sim_state_min0.0036997278531392414
sim_physics_max0.12200043360392251
sim_physics_mean0.07089952929814657
sim_physics_median0.05636672496795654
sim_physics_min0.05422144810358683
sim_render-ego_max0.012969640096028646
sim_render-ego_mean0.008543107827504476
sim_render-ego_median0.007023286819458008
sim_render-ego_min0.006887400150299072
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
277654991Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4794621641457562
survival_time_median14.950000000000076
deviation-center-line_median0.7989886761662253
in-drivable-lane_median0.5500000000000078


other stats
agent_compute-ego_max0.01563817898432414
agent_compute-ego_mean0.015522989908854168
agent_compute-ego_median0.015545465151468912
agent_compute-ego_min0.015411068598429362
deviation-center-line_max1.1603226156973097
deviation-center-line_mean0.8320499173515945
deviation-center-line_min0.5849899269214937
deviation-heading_max5.015962444747468
deviation-heading_mean4.402876465966659
deviation-heading_median4.93381507640707
deviation-heading_min3.459781672692396
driven_any_max3.8836264618864287
driven_any_mean3.242066706110625
driven_any_median3.3076091496055566
driven_any_min2.721659030609029
driven_lanedir_consec_max3.708214804178361
driven_lanedir_consec_mean2.1770029860130165
driven_lanedir_consec_min1.1375120282396618
driven_lanedir_max3.708214804178361
driven_lanedir_mean2.975609373526343
driven_lanedir_median3.060638800832794
driven_lanedir_min2.1637045625480225
in-drivable-lane_max3.600000000000012
in-drivable-lane_mean1.2900000000000025
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.721659030609029, "sim_physics": 0.055015514691670736, "survival_time": 14.950000000000076, "driven_lanedir": 2.1637045625480225, "sim_render-ego": 0.006954201062520345, "in-drivable-lane": 3.600000000000012, "agent_compute-ego": 0.01563817898432414, "deviation-heading": 5.015962444747468, "set_robot_commands": 0.007037350336710612, "deviation-center-line": 0.5849899269214937, "driven_lanedir_consec": 1.1375120282396618, "sim_compute_sim_state": 0.003606176376342774, "sim_compute_performance-ego": 0.004093952178955078, "sim_compute_robot_state-ego": 0.005071826775868734}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.848024226113468, "sim_physics": 0.05421345074971517, "survival_time": 14.950000000000076, "driven_lanedir": 2.6989485120186183, "sim_render-ego": 0.007075634002685547, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.015411068598429362, "deviation-heading": 4.944265054321189, "set_robot_commands": 0.0070235268274943035, "deviation-center-line": 1.1603226156973097, "driven_lanedir_consec": 1.4794621641457562, "sim_compute_sim_state": 0.0035912322998046873, "sim_compute_performance-ego": 0.004001730283101399, "sim_compute_robot_state-ego": 0.005091070334116618}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8836264618864287, "sim_physics": 0.0547384778658549, "survival_time": 14.950000000000076, "driven_lanedir": 3.708214804178361, "sim_render-ego": 0.007085963884989421, "in-drivable-lane": 0, "agent_compute-ego": 0.0154498823483785, "deviation-heading": 3.660558081665172, "set_robot_commands": 0.006966099739074707, "deviation-center-line": 0.9216948771440848, "driven_lanedir_consec": 3.708214804178361, "sim_compute_sim_state": 0.003684639135996501, "sim_compute_performance-ego": 0.0040161538124084475, "sim_compute_robot_state-ego": 0.005137059688568115}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.3076091496055566, "sim_physics": 0.054043560822804766, "survival_time": 14.950000000000076, "driven_lanedir": 3.060638800832794, "sim_render-ego": 0.007066731452941895, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.015570354461669924, "deviation-heading": 3.459781672692396, "set_robot_commands": 0.006992150147755941, "deviation-center-line": 0.6942534908288582, "driven_lanedir_consec": 1.313285745447386, "sim_compute_sim_state": 0.003841884930928548, "sim_compute_performance-ego": 0.00401270866394043, "sim_compute_robot_state-ego": 0.005112470785776774}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.4494146623386435, "sim_physics": 0.05340145270029704, "survival_time": 14.950000000000076, "driven_lanedir": 3.246540188053918, "sim_render-ego": 0.007058122158050537, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.015545465151468912, "deviation-heading": 4.93381507640707, "set_robot_commands": 0.007023673852284749, "deviation-center-line": 0.7989886761662253, "driven_lanedir_consec": 3.246540188053918, "sim_compute_sim_state": 0.0036526226997375486, "sim_compute_performance-ego": 0.00399875005086263, "sim_compute_robot_state-ego": 0.005070645014444987}}
set_robot_commands_max0.007037350336710612
set_robot_commands_mean0.007008560180664062
set_robot_commands_median0.0070235268274943035
set_robot_commands_min0.006966099739074707
sim_compute_performance-ego_max0.004093952178955078
sim_compute_performance-ego_mean0.004024658997853597
sim_compute_performance-ego_median0.00401270866394043
sim_compute_performance-ego_min0.00399875005086263
sim_compute_robot_state-ego_max0.005137059688568115
sim_compute_robot_state-ego_mean0.005096614519755046
sim_compute_robot_state-ego_median0.005091070334116618
sim_compute_robot_state-ego_min0.005070645014444987
sim_compute_sim_state_max0.003841884930928548
sim_compute_sim_state_mean0.003675311088562011
sim_compute_sim_state_median0.0036526226997375486
sim_compute_sim_state_min0.0035912322998046873
sim_physics_max0.055015514691670736
sim_physics_mean0.05428249136606852
sim_physics_median0.05421345074971517
sim_physics_min0.05340145270029704
sim_render-ego_max0.007085963884989421
sim_render-ego_mean0.007048130512237549
sim_render-ego_median0.007066731452941895
sim_render-ego_min0.006954201062520345
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
277514981Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.212422745874185
survival_time_median14.950000000000076
deviation-center-line_median0.7494215710572206
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016087035447853046
agent_compute-ego_mean0.015643932841320284
agent_compute-ego_median0.01553695281346639
agent_compute-ego_min0.015303442478179932
deviation-center-line_max0.7904936723556608
deviation-center-line_mean0.6837420365745247
deviation-center-line_min0.3722200576273591
deviation-heading_max4.184860283735635
deviation-heading_mean2.710246184634435
deviation-heading_median2.658180743173278
deviation-heading_min1.4636577602054026
driven_any_max4.732551231874295
driven_any_mean3.909053540662188
driven_any_median3.875265553661589
driven_any_min3.0949904766271734
driven_lanedir_consec_max4.621740690303337
driven_lanedir_consec_mean3.6912500244984527
driven_lanedir_consec_min3.039680841830914
driven_lanedir_max4.621740690303337
driven_lanedir_mean3.6912500244984527
driven_lanedir_median3.212422745874185
driven_lanedir_min3.039680841830914
in-drivable-lane_max2.3500000000000085
in-drivable-lane_mean0.4700000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.296320085957994, "sim_physics": 0.05563632090886434, "survival_time": 14.950000000000076, "driven_lanedir": 3.212422745874185, "sim_render-ego": 0.006944111982981364, "in-drivable-lane": 0, "agent_compute-ego": 0.01588136037190755, "deviation-heading": 2.658180743173278, "set_robot_commands": 0.007096147537231446, "deviation-center-line": 0.7494215710572206, "driven_lanedir_consec": 3.212422745874185, "sim_compute_sim_state": 0.003992274602254231, "sim_compute_performance-ego": 0.004064386685689291, "sim_compute_robot_state-ego": 0.0049857823053995765}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.875265553661589, "sim_physics": 0.05587459961573283, "survival_time": 14.950000000000076, "driven_lanedir": 3.1324408190147452, "sim_render-ego": 0.0071275528271993, "in-drivable-lane": 2.3500000000000085, "agent_compute-ego": 0.01553695281346639, "deviation-heading": 4.184860283735635, "set_robot_commands": 0.007220175266265869, "deviation-center-line": 0.777979275524995, "driven_lanedir_consec": 3.1324408190147452, "sim_compute_sim_state": 0.003983858426411946, "sim_compute_performance-ego": 0.0040016611417134605, "sim_compute_robot_state-ego": 0.0050724101066589354}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.546140355189889, "sim_physics": 0.054657378991444905, "survival_time": 14.950000000000076, "driven_lanedir": 4.449965025469082, "sim_render-ego": 0.006971666812896729, "in-drivable-lane": 0, "agent_compute-ego": 0.015303442478179932, "deviation-heading": 2.475558770944112, "set_robot_commands": 0.0072303318977355955, "deviation-center-line": 0.7904936723556608, "driven_lanedir_consec": 4.449965025469082, "sim_compute_sim_state": 0.003949735959370931, "sim_compute_performance-ego": 0.003977065086364746, "sim_compute_robot_state-ego": 0.004985512892405192}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.732551231874295, "sim_physics": 0.05515230814615885, "survival_time": 14.950000000000076, "driven_lanedir": 4.621740690303337, "sim_render-ego": 0.006946711540222168, "in-drivable-lane": 0, "agent_compute-ego": 0.015410873095194498, "deviation-heading": 2.7689733651137503, "set_robot_commands": 0.007195564111073812, "deviation-center-line": 0.7285956063073878, "driven_lanedir_consec": 4.621740690303337, "sim_compute_sim_state": 0.0040194876988728844, "sim_compute_performance-ego": 0.003978165785471598, "sim_compute_robot_state-ego": 0.004988937377929687}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0949904766271734, "sim_physics": 0.05834268074667915, "survival_time": 9.049999999999994, "driven_lanedir": 3.039680841830914, "sim_render-ego": 0.007184451456228014, "in-drivable-lane": 0, "agent_compute-ego": 0.016087035447853046, "deviation-heading": 1.4636577602054026, "set_robot_commands": 0.007479443734522024, "deviation-center-line": 0.3722200576273591, "driven_lanedir_consec": 3.039680841830914, "sim_compute_sim_state": 0.0041035631084969035, "sim_compute_performance-ego": 0.004061074546687511, "sim_compute_robot_state-ego": 0.005233517009250367}}
set_robot_commands_max0.007479443734522024
set_robot_commands_mean0.007244332509365748
set_robot_commands_median0.007220175266265869
set_robot_commands_min0.007096147537231446
sim_compute_performance-ego_max0.004064386685689291
sim_compute_performance-ego_mean0.004016470649185322
sim_compute_performance-ego_median0.0040016611417134605
sim_compute_performance-ego_min0.003977065086364746
sim_compute_robot_state-ego_max0.005233517009250367
sim_compute_robot_state-ego_mean0.0050532319383287515
sim_compute_robot_state-ego_median0.004988937377929687
sim_compute_robot_state-ego_min0.004985512892405192
sim_compute_sim_state_max0.0041035631084969035
sim_compute_sim_state_mean0.004009783959081379
sim_compute_sim_state_median0.003992274602254231
sim_compute_sim_state_min0.003949735959370931
sim_physics_max0.05834268074667915
sim_physics_mean0.05593265768177601
sim_physics_median0.05563632090886434
sim_physics_min0.054657378991444905
sim_render-ego_max0.007184451456228014
sim_render-ego_mean0.007034898923905515
sim_render-ego_median0.006971666812896729
sim_render-ego_min0.006944111982981364
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.770000000000062
survival_time_min9.049999999999994
No reset possible
277424977Dhaivat Bhatt 🇨🇦whattheduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5956376395570033
survival_time_median8.349999999999984
deviation-center-line_median0.7096072853294325
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.024062706629435222
agent_compute-ego_mean0.02042469203252
agent_compute-ego_median0.020597859223683675
agent_compute-ego_min0.016724048999317905
deviation-center-line_max1.0659962538607566
deviation-center-line_mean0.6870345124979693
deviation-center-line_min0.25356290037148693
deviation-heading_max5.172916986122488
deviation-heading_mean2.754872850785205
deviation-heading_median1.8568826167268584
deviation-heading_min0.5373690368093303
driven_any_max4.361669457418989
driven_any_mean3.071714042267671
driven_any_median2.7019982652249217
driven_any_min2.195910113817541
driven_lanedir_consec_max3.619571211913888
driven_lanedir_consec_mean2.5607761531133084
driven_lanedir_consec_min1.82662767654204
driven_lanedir_max3.619571211913888
driven_lanedir_mean2.5607761531133084
driven_lanedir_median2.5956376395570033
driven_lanedir_min1.82662767654204
in-drivable-lane_max3.20000000000001
in-drivable-lane_mean1.5799999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.7750631044653846, "sim_physics": 0.08260144313176473, "survival_time": 14.950000000000076, "driven_lanedir": 2.6189905364394823, "sim_render-ego": 0.01013710339864095, "in-drivable-lane": 3.20000000000001, "agent_compute-ego": 0.024062706629435222, "deviation-heading": 5.046032982235923, "set_robot_commands": 0.009444185892740884, "deviation-center-line": 0.9199955643867764, "driven_lanedir_consec": 2.6189905364394823, "sim_compute_sim_state": 0.004499967892964681, "sim_compute_performance-ego": 0.006142170429229737, "sim_compute_robot_state-ego": 0.007515936692555745}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.323929270411518, "sim_physics": 0.07428960350976474, "survival_time": 6.8999999999999835, "driven_lanedir": 1.82662767654204, "sim_render-ego": 0.009471762007561285, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.019592729167661804, "deviation-heading": 0.5373690368093303, "set_robot_commands": 0.008634451506794363, "deviation-center-line": 0.25356290037148693, "driven_lanedir_consec": 1.82662767654204, "sim_compute_sim_state": 0.004083481387815614, "sim_compute_performance-ego": 0.005566553793091705, "sim_compute_robot_state-ego": 0.0066962034805961275}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.361669457418989, "sim_physics": 0.07337093035380046, "survival_time": 14.950000000000076, "driven_lanedir": 3.619571211913888, "sim_render-ego": 0.00944091240564982, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.020597859223683675, "deviation-heading": 5.172916986122488, "set_robot_commands": 0.008713084061940511, "deviation-center-line": 1.0659962538607566, "driven_lanedir_consec": 3.619571211913888, "sim_compute_sim_state": 0.004274661540985107, "sim_compute_performance-ego": 0.005592184861501058, "sim_compute_robot_state-ego": 0.006959734757741292}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.7019982652249217, "sim_physics": 0.07819021818880549, "survival_time": 8.349999999999984, "driven_lanedir": 2.5956376395570033, "sim_render-ego": 0.009420786075249404, "in-drivable-lane": 0, "agent_compute-ego": 0.021146116142501375, "deviation-heading": 1.8568826167268584, "set_robot_commands": 0.008727706121113486, "deviation-center-line": 0.7096072853294325, "driven_lanedir_consec": 2.5956376395570033, "sim_compute_sim_state": 0.004696062225067687, "sim_compute_performance-ego": 0.005517785420674764, "sim_compute_robot_state-ego": 0.0069521387180168474}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.195910113817541, "sim_physics": 0.059053352004603335, "survival_time": 5.699999999999988, "driven_lanedir": 2.1430537011141273, "sim_render-ego": 0.007469982431645979, "in-drivable-lane": 0, "agent_compute-ego": 0.016724048999317905, "deviation-heading": 1.1611626320314232, "set_robot_commands": 0.006809795111940618, "deviation-center-line": 0.48601055854139374, "driven_lanedir_consec": 2.1430537011141273, "sim_compute_sim_state": 0.0036957452171727232, "sim_compute_performance-ego": 0.0043082174501921, "sim_compute_robot_state-ego": 0.00530393918355306}}
set_robot_commands_max0.009444185892740884
set_robot_commands_mean0.008465844538905972
set_robot_commands_median0.008713084061940511
set_robot_commands_min0.006809795111940618
sim_compute_performance-ego_max0.006142170429229737
sim_compute_performance-ego_mean0.0054253823909378735
sim_compute_performance-ego_median0.005566553793091705
sim_compute_performance-ego_min0.0043082174501921
sim_compute_robot_state-ego_max0.007515936692555745
sim_compute_robot_state-ego_mean0.006685590566492615
sim_compute_robot_state-ego_median0.0069521387180168474
sim_compute_robot_state-ego_min0.00530393918355306
sim_compute_sim_state_max0.004696062225067687
sim_compute_sim_state_mean0.004249983652801163
sim_compute_sim_state_median0.004274661540985107
sim_compute_sim_state_min0.0036957452171727232
sim_physics_max0.08260144313176473
sim_physics_mean0.07350110943774775
sim_physics_median0.07428960350976474
sim_physics_min0.059053352004603335
sim_render-ego_max0.01013710339864095
sim_render-ego_mean0.009188109263749487
sim_render-ego_median0.00944091240564982
sim_render-ego_min0.007469982431645979
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.17000000000002
survival_time_min5.699999999999988
No reset possible
277164959Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-46-148-104920:03:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
277114955Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.848904000875473
survival_time_median14.950000000000076
deviation-center-line_median1.070912614880156
in-drivable-lane_median1.9499999999999948


other stats
agent_compute-ego_max0.01564450979232788
agent_compute-ego_mean0.015386745465107456
agent_compute-ego_median0.015368678569793702
agent_compute-ego_min0.015070718129475911
deviation-center-line_max1.1067292830044704
deviation-center-line_mean0.8778588625966434
deviation-center-line_min0.19079799426577332
deviation-heading_max4.1539971514239715
deviation-heading_mean3.2552108003673914
deviation-heading_median3.943382284208505
deviation-heading_min1.7902996500848662
driven_any_max5.207664524239881
driven_any_mean3.5588110770335666
driven_any_median3.868337372630814
driven_any_min1.7306327442615563
driven_lanedir_consec_max4.806952076318697
driven_lanedir_consec_mean2.490458642279653
driven_lanedir_consec_min1.222422236863819
driven_lanedir_max4.806952076318697
driven_lanedir_mean3.1490245421261087
driven_lanedir_median3.500947341686909
driven_lanedir_min1.3459833808435335
in-drivable-lane_max4.050000000000008
in-drivable-lane_mean2.3000000000000007
in-drivable-lane_min1.5499999999999945
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.021099070563144, "sim_physics": 0.056036330858866376, "survival_time": 14.950000000000076, "driven_lanedir": 2.383137710942415, "sim_render-ego": 0.006813759009043375, "in-drivable-lane": 4.050000000000008, "agent_compute-ego": 0.015356028079986572, "deviation-heading": 4.1539971514239715, "set_robot_commands": 0.006985339323679606, "deviation-center-line": 1.095449286140842, "driven_lanedir_consec": 1.3820518755462423, "sim_compute_sim_state": 0.0034510151545206705, "sim_compute_performance-ego": 0.004049357573191325, "sim_compute_robot_state-ego": 0.004899994532267252}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.868337372630814, "sim_physics": 0.05805325508117676, "survival_time": 14.950000000000076, "driven_lanedir": 3.500947341686909, "sim_render-ego": 0.007125425338745117, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.015368678569793702, "deviation-heading": 3.943382284208505, "set_robot_commands": 0.006906880537668864, "deviation-center-line": 1.1067292830044704, "driven_lanedir_consec": 1.848904000875473, "sim_compute_sim_state": 0.003601195812225342, "sim_compute_performance-ego": 0.0041021434466044105, "sim_compute_robot_state-ego": 0.005177136262257894}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.207664524239881, "sim_physics": 0.054238173166910805, "survival_time": 14.950000000000076, "driven_lanedir": 4.806952076318697, "sim_render-ego": 0.006935698986053467, "in-drivable-lane": 1.9499999999999948, "agent_compute-ego": 0.015070718129475911, "deviation-heading": 2.252114248020443, "set_robot_commands": 0.0069781645139058435, "deviation-center-line": 1.070912614880156, "driven_lanedir_consec": 4.806952076318697, "sim_compute_sim_state": 0.0035977141062418618, "sim_compute_performance-ego": 0.003975478013356527, "sim_compute_robot_state-ego": 0.004948130448659261}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7306327442615563, "sim_physics": 0.05533178219428429, "survival_time": 6.499999999999985, "driven_lanedir": 1.3459833808435335, "sim_render-ego": 0.007050983722393329, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.0154937927539532, "deviation-heading": 1.7902996500848662, "set_robot_commands": 0.006858966900752141, "deviation-center-line": 0.19079799426577332, "driven_lanedir_consec": 1.222422236863819, "sim_compute_sim_state": 0.0034883682544414813, "sim_compute_performance-ego": 0.00398101623241718, "sim_compute_robot_state-ego": 0.004962523166949932}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.9663216734724394, "sim_physics": 0.055079105695088705, "survival_time": 14.950000000000076, "driven_lanedir": 3.708102200838988, "sim_render-ego": 0.007038531303405762, "in-drivable-lane": 1.9000000000000128, "agent_compute-ego": 0.01564450979232788, "deviation-heading": 4.136260668099171, "set_robot_commands": 0.007192124525705973, "deviation-center-line": 0.9254051346919756, "driven_lanedir_consec": 3.191963021794035, "sim_compute_sim_state": 0.003689227104187012, "sim_compute_performance-ego": 0.004020531177520752, "sim_compute_robot_state-ego": 0.005074196656545003}}
set_robot_commands_max0.007192124525705973
set_robot_commands_mean0.0069842951603424856
set_robot_commands_median0.0069781645139058435
set_robot_commands_min0.006858966900752141
sim_compute_performance-ego_max0.0041021434466044105
sim_compute_performance-ego_mean0.004025705288618038
sim_compute_performance-ego_median0.004020531177520752
sim_compute_performance-ego_min0.003975478013356527
sim_compute_robot_state-ego_max0.005177136262257894
sim_compute_robot_state-ego_mean0.005012396213335869
sim_compute_robot_state-ego_median0.004962523166949932
sim_compute_robot_state-ego_min0.004899994532267252
sim_compute_sim_state_max0.003689227104187012
sim_compute_sim_state_mean0.0035655040863232733
sim_compute_sim_state_median0.0035977141062418618
sim_compute_sim_state_min0.0034510151545206705
sim_physics_max0.05805325508117676
sim_physics_mean0.05574772939926539
sim_physics_median0.05533178219428429
sim_physics_min0.054238173166910805
sim_render-ego_max0.007125425338745117
sim_render-ego_mean0.00699287967192821
sim_render-ego_median0.007038531303405762
sim_render-ego_min0.006813759009043375
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.260000000000058
survival_time_min6.499999999999985
No reset possible
277064242Manfred DiazBaseline-IL-logs-tensorflowaido3-LFV-sim-testingstep1-simulationerroryesip-172-31-46-148-104920:20:25
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
277004162Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48611255447189494
survival_time_median1.7000000000000008
deviation-center-line_median0.10101439590455022
in-drivable-lane_median0


other stats
agent_compute-ego_max0.025977694988250737
agent_compute-ego_mean0.021865332099071245
agent_compute-ego_median0.022533973058064777
agent_compute-ego_min0.017329220771789552
deviation-center-line_max0.19589592119445745
deviation-center-line_mean0.11025851893599528
deviation-center-line_min0.07065220523066396
deviation-heading_max0.9402670403014723
deviation-heading_mean0.3832222935577303
deviation-heading_median0.29149367303980006
deviation-heading_min0.17153462772254277
driven_any_max1.224736399271231
driven_any_mean0.6876615645125427
driven_any_median0.6334906616120762
driven_any_min0.2841993449458318
driven_lanedir_consec_max0.8132966599904798
driven_lanedir_consec_mean0.5048115966955915
driven_lanedir_consec_min0.2774109133160376
driven_lanedir_max0.8132966599904798
driven_lanedir_mean0.5048115966955915
driven_lanedir_median0.48611255447189494
driven_lanedir_min0.2774109133160376
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.336666666666666
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.09031918415656456, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.010852538622342624, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.02282075698559101, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.008671691784491906, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.0045594893969022315, "sim_compute_performance-ego": 0.00651629612996028, "sim_compute_robot_state-ego": 0.007560321917900672}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.16441155672073365, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.015407609939575196, "in-drivable-lane": 0, "agent_compute-ego": 0.025977694988250737, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.011523497104644776, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.0057508587837219235, "sim_compute_performance-ego": 0.009863734245300291, "sim_compute_robot_state-ego": 0.010867273807525637}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.10999344376956716, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.012004705036387724, "in-drivable-lane": 0, "agent_compute-ego": 0.021811197785770193, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.008462800699121812, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.004798110793618595, "sim_compute_performance-ego": 0.007558310733121984, "sim_compute_robot_state-ego": 0.010161336730508244}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.1088632911932273, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.012049964216888929, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.021845950454962057, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.00900943943711578, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.005556192554411341, "sim_compute_performance-ego": 0.007359578961231669, "sim_compute_robot_state-ego": 0.008547380322315654}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.1152168945832686, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.012918147173794832, "in-drivable-lane": 0, "agent_compute-ego": 0.022931694984436035, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.010364218191667036, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.005273602225563743, "sim_compute_performance-ego": 0.007735414938493209, "sim_compute_robot_state-ego": 0.00980213555422696}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0062179466080066, "sim_physics": 0.06969126224517823, "survival_time": 2.499999999999999, "driven_lanedir": 0.6586852059987791, "sim_render-ego": 0.012646355628967286, "in-drivable-lane": 0.6999999999999982, "agent_compute-ego": 0.017329220771789552, "deviation-heading": 0.25169758667532327, "set_robot_commands": 0.006623387336730957, "deviation-center-line": 0.1137461200952672, "driven_lanedir_consec": 0.6586852059987791, "sim_compute_sim_state": 0.0038747596740722656, "sim_compute_performance-ego": 0.005459327697753907, "sim_compute_robot_state-ego": 0.006781492233276367}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.2841993449458318, "sim_physics": 0.08419100046157837, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2774109133160376, "sim_render-ego": 0.009555184841156006, "in-drivable-lane": 0, "agent_compute-ego": 0.017815375328063966, "deviation-heading": 0.19587785298032775, "set_robot_commands": 0.006803679466247559, "deviation-center-line": 0.10497752500051792, "driven_lanedir_consec": 0.2774109133160376, "sim_compute_sim_state": 0.003913581371307373, "sim_compute_performance-ego": 0.005423009395599365, "sim_compute_robot_state-ego": 0.006395077705383301}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.027241242618096, "sim_physics": 0.08724852708669809, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8132966599904798, "sim_render-ego": 0.009982232864086444, "in-drivable-lane": 0.24999999999999975, "agent_compute-ego": 0.018470892539391152, "deviation-heading": 0.9402670403014723, "set_robot_commands": 0.008240773127629207, "deviation-center-line": 0.19589592119445745, "driven_lanedir_consec": 0.8132966599904798, "sim_compute_sim_state": 0.004581281772026649, "sim_compute_performance-ego": 0.005819426133082463, "sim_compute_robot_state-ego": 0.007661897402543288}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.4672460505320347, "sim_physics": 0.10885094713281702, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4576897394291573, "sim_render-ego": 0.012295970210322627, "in-drivable-lane": 0, "agent_compute-ego": 0.022533973058064777, "deviation-heading": 0.2092997274947602, "set_robot_commands": 0.008690003995542173, "deviation-center-line": 0.09743914215852548, "driven_lanedir_consec": 0.4576897394291573, "sim_compute_sim_state": 0.004831658469306098, "sim_compute_performance-ego": 0.006686360747725876, "sim_compute_robot_state-ego": 0.009003171214350947}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.42713409018769993, "sim_physics": 0.0915750631919274, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4032294466005179, "sim_render-ego": 0.011151543030372031, "in-drivable-lane": 0, "agent_compute-ego": 0.02006832452920767, "deviation-heading": 0.42404383669091195, "set_robot_commands": 0.0094298766209529, "deviation-center-line": 0.08796742718876373, "driven_lanedir_consec": 0.4032294466005179, "sim_compute_sim_state": 0.004112472900977502, "sim_compute_performance-ego": 0.0071747027910672705, "sim_compute_robot_state-ego": 0.008602096484257625}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0242232298894105, "sim_physics": 0.08956366894291896, "survival_time": 2.549999999999999, "driven_lanedir": 0.4896796009145352, "sim_render-ego": 0.014717022577921547, "in-drivable-lane": 0.9500000000000004, "agent_compute-ego": 0.021558574601715685, "deviation-heading": 0.7534458465181271, "set_robot_commands": 0.009231497259701, "deviation-center-line": 0.17314128807410795, "driven_lanedir_consec": 0.4896796009145352, "sim_compute_sim_state": 0.005002512651331285, "sim_compute_performance-ego": 0.006960653791240617, "sim_compute_robot_state-ego": 0.00886696460200291}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.003195249205676, "sim_physics": 0.10709597550186456, "survival_time": 2.549999999999999, "driven_lanedir": 0.588925357679403, "sim_render-ego": 0.013068708718991746, "in-drivable-lane": 0.8999999999999981, "agent_compute-ego": 0.02318100368275362, "deviation-heading": 0.17153462772254277, "set_robot_commands": 0.01002812853046492, "deviation-center-line": 0.15354304756144124, "driven_lanedir_consec": 0.588925357679403, "sim_compute_sim_state": 0.005346457163492839, "sim_compute_performance-ego": 0.007704435610303692, "sim_compute_robot_state-ego": 0.009358565012613932}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6668294214506597, "sim_physics": 0.11484395133124456, "survival_time": 1.800000000000001, "driven_lanedir": 0.6529078028331062, "sim_render-ego": 0.012709041436513266, "in-drivable-lane": 0, "agent_compute-ego": 0.02318674325942993, "deviation-heading": 0.2810863403039844, "set_robot_commands": 0.009559399551815458, "deviation-center-line": 0.08798716228583042, "driven_lanedir_consec": 0.6529078028331062, "sim_compute_sim_state": 0.005115972624884712, "sim_compute_performance-ego": 0.008504854308234321, "sim_compute_robot_state-ego": 0.008890522850884331}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.5071551953554377, "sim_physics": 0.10929425557454428, "survival_time": 1.5000000000000009, "driven_lanedir": 0.48611255447189494, "sim_render-ego": 0.013345281283060707, "in-drivable-lane": 0, "agent_compute-ego": 0.023197865486145015, "deviation-heading": 0.4280271222650965, "set_robot_commands": 0.008816234270731608, "deviation-center-line": 0.10217572521174138, "driven_lanedir_consec": 0.48611255447189494, "sim_compute_sim_state": 0.0051253318786621095, "sim_compute_performance-ego": 0.006906763712565104, "sim_compute_robot_state-ego": 0.009743158022562664}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.4006405523125222, "sim_physics": 0.1289792756239573, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3926815410728177, "sim_render-ego": 0.013241718212763468, "in-drivable-lane": 0, "agent_compute-ego": 0.02525071303049723, "deviation-heading": 0.21942208267354324, "set_robot_commands": 0.009921838839848837, "deviation-center-line": 0.10101439590455022, "driven_lanedir_consec": 0.3926815410728177, "sim_compute_sim_state": 0.0049460530281066895, "sim_compute_performance-ego": 0.0071699221928914385, "sim_compute_robot_state-ego": 0.009175519148508709}}
set_robot_commands_max0.011523497104644776
set_robot_commands_mean0.009025097747780398
set_robot_commands_median0.00900943943711578
set_robot_commands_min0.006623387336730957
sim_compute_performance-ego_max0.009863734245300291
sim_compute_performance-ego_mean0.0071228527592380984
sim_compute_performance-ego_median0.0071699221928914385
sim_compute_performance-ego_min0.005423009395599365
sim_compute_robot_state-ego_max0.010867273807525637
sim_compute_robot_state-ego_mean0.008761127533924083
sim_compute_robot_state-ego_median0.008890522850884331
sim_compute_robot_state-ego_min0.006395077705383301
sim_compute_sim_state_max0.0057508587837219235
sim_compute_sim_state_mean0.0048525556858923565
sim_compute_sim_state_median0.0049460530281066895
sim_compute_sim_state_min0.0038747596740722656
sim_physics_max0.16441155672073365
sim_physics_mean0.10534255316773931
sim_physics_median0.10885094713281702
sim_physics_min0.06969126224517823
sim_render-ego_max0.015407609939575196
sim_render-ego_mean0.012396401586209627
sim_render-ego_median0.012646355628967286
sim_render-ego_min0.009555184841156006
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.853333333333333
survival_time_min1.0000000000000002
No reset possible
276584265Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6611618254311505
survival_time_median4.6499999999999915
deviation-center-line_median0.23383737083828407
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06294418705834283
agent_compute-ego_mean0.05449071558286428
agent_compute-ego_median0.05747094850861625
agent_compute-ego_min0.037733728235418144
deviation-center-line_max0.3999317684956824
deviation-center-line_mean0.2408790959963596
deviation-center-line_min0.13582935272837296
deviation-heading_max1.247227661180608
deviation-heading_mean1.07271443970094
deviation-heading_median1.065487023782893
deviation-heading_min0.8356832557005439
driven_any_max1.2240637087253077
driven_any_mean0.7966096306580452
driven_any_median0.6936554903465381
driven_any_min0.6615386685718582
driven_lanedir_consec_max1.156382035675678
driven_lanedir_consec_mean0.7506815242146929
driven_lanedir_consec_min0.626348435078905
driven_lanedir_max1.156382035675678
driven_lanedir_mean0.7506815242146929
driven_lanedir_median0.6611618254311505
driven_lanedir_min0.626348435078905
in-drivable-lane_max0.2499999999999991
in-drivable-lane_mean0.08999999999999968
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7342216029123471, "sim_physics": 0.25024899569424713, "survival_time": 4.94999999999999, "driven_lanedir": 0.6611618254311505, "sim_render-ego": 0.014733555341007731, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.037733728235418144, "deviation-heading": 1.065487023782893, "set_robot_commands": 0.011961337291833126, "deviation-center-line": 0.13582935272837296, "driven_lanedir_consec": 0.6611618254311505, "sim_compute_sim_state": 0.0060334952190668895, "sim_compute_performance-ego": 0.008773639948681147, "sim_compute_robot_state-ego": 0.010655439261234167, "sim_compute_robot_state-npc0": 0.0106439445957993, "sim_compute_robot_state-npc1": 0.010888448869339144, "sim_compute_robot_state-npc2": 0.010296563909511374, "sim_compute_robot_state-npc3": 0.009992043177286783}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6695686827341757, "sim_physics": 0.2357829968134562, "survival_time": 4.499999999999992, "driven_lanedir": 0.6475731296860362, "sim_render-ego": 0.014385657840304903, "in-drivable-lane": 0, "agent_compute-ego": 0.06294418705834283, "deviation-heading": 0.8356832557005439, "set_robot_commands": 0.011216367615593805, "deviation-center-line": 0.2643330602069071, "driven_lanedir_consec": 0.6475731296860362, "sim_compute_sim_state": 0.0058064513736301, "sim_compute_performance-ego": 0.008502478069729275, "sim_compute_robot_state-ego": 0.011415831247965497, "sim_compute_robot_state-npc0": 0.010285928514268664, "sim_compute_robot_state-npc1": 0.010011272960238987, "sim_compute_robot_state-npc2": 0.010178828239440918, "sim_compute_robot_state-npc3": 0.009952722655402289}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2240637087253077, "sim_physics": 0.2238737847070274, "survival_time": 7.94999999999998, "driven_lanedir": 1.156382035675678, "sim_render-ego": 0.013295287606101366, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.05615155651884259, "deviation-heading": 1.247227661180608, "set_robot_commands": 0.009848731118927962, "deviation-center-line": 0.3999317684956824, "driven_lanedir_consec": 1.156382035675678, "sim_compute_sim_state": 0.005527854715503237, "sim_compute_performance-ego": 0.007969833769888248, "sim_compute_robot_state-ego": 0.00969215159146291, "sim_compute_robot_state-npc0": 0.00942440152918018, "sim_compute_robot_state-npc1": 0.0093405951493941, "sim_compute_robot_state-npc2": 0.009580028881816744, "sim_compute_robot_state-npc3": 0.009033592991858908}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6615386685718582, "sim_physics": 0.22660777542028537, "survival_time": 4.449999999999992, "driven_lanedir": 0.626348435078905, "sim_render-ego": 0.013148623905824813, "in-drivable-lane": 0, "agent_compute-ego": 0.05747094850861625, "deviation-heading": 1.0327810353312168, "set_robot_commands": 0.009873840246307716, "deviation-center-line": 0.1704639277125512, "driven_lanedir_consec": 0.626348435078905, "sim_compute_sim_state": 0.00575395112627008, "sim_compute_performance-ego": 0.007936911636523986, "sim_compute_robot_state-ego": 0.009851865554123785, "sim_compute_robot_state-npc0": 0.009432452448298422, "sim_compute_robot_state-npc1": 0.009077709712339252, "sim_compute_robot_state-npc2": 0.009126237269197956, "sim_compute_robot_state-npc3": 0.00951339957419406}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6936554903465381, "sim_physics": 0.2141436197424448, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6619421952016946, "sim_render-ego": 0.01332036397790396, "in-drivable-lane": 0, "agent_compute-ego": 0.058153157593101586, "deviation-heading": 1.182393222509439, "set_robot_commands": 0.0107500732585948, "deviation-center-line": 0.23383737083828407, "driven_lanedir_consec": 0.6619421952016946, "sim_compute_sim_state": 0.00520979973577684, "sim_compute_performance-ego": 0.00759649533097462, "sim_compute_robot_state-ego": 0.009685603521203482, "sim_compute_robot_state-npc0": 0.009539370895713889, "sim_compute_robot_state-npc1": 0.008928229731898154, "sim_compute_robot_state-npc2": 0.008779300156460014, "sim_compute_robot_state-npc3": 0.00887557255324497}}
set_robot_commands_max0.011961337291833126
set_robot_commands_mean0.010730069906251482
set_robot_commands_median0.0107500732585948
set_robot_commands_min0.009848731118927962
sim_compute_performance-ego_max0.008773639948681147
sim_compute_performance-ego_mean0.008155871751159454
sim_compute_performance-ego_median0.007969833769888248
sim_compute_performance-ego_min0.00759649533097462
sim_compute_robot_state-ego_max0.011415831247965497
sim_compute_robot_state-ego_mean0.010260178235197969
sim_compute_robot_state-ego_median0.009851865554123785
sim_compute_robot_state-ego_min0.009685603521203482
sim_compute_robot_state-npc0_max0.0106439445957993
sim_compute_robot_state-npc0_mean0.00986521959665209
sim_compute_robot_state-npc0_median0.009539370895713889
sim_compute_robot_state-npc0_min0.00942440152918018
sim_compute_robot_state-npc1_max0.010888448869339144
sim_compute_robot_state-npc1_mean0.00964925128464193
sim_compute_robot_state-npc1_median0.0093405951493941
sim_compute_robot_state-npc1_min0.008928229731898154
sim_compute_robot_state-npc2_max0.010296563909511374
sim_compute_robot_state-npc2_mean0.0095921916912854
sim_compute_robot_state-npc2_median0.009580028881816744
sim_compute_robot_state-npc2_min0.008779300156460014
sim_compute_robot_state-npc3_max0.009992043177286783
sim_compute_robot_state-npc3_mean0.009473466190397404
sim_compute_robot_state-npc3_median0.00951339957419406
sim_compute_robot_state-npc3_min0.00887557255324497
sim_compute_sim_state_max0.0060334952190668895
sim_compute_sim_state_mean0.005666310434049428
sim_compute_sim_state_median0.00575395112627008
sim_compute_sim_state_min0.00520979973577684
sim_physics_max0.25024899569424713
sim_physics_mean0.2301314344754922
sim_physics_median0.22660777542028537
sim_physics_min0.2141436197424448
sim_render-ego_max0.014733555341007731
sim_render-ego_mean0.013776697734228554
sim_render-ego_median0.01332036397790396
sim_render-ego_min0.013148623905824813
simulation-passed1
survival_time_max7.94999999999998
survival_time_mean5.299999999999989
survival_time_min4.449999999999992
No reset possible
276204948Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.992339740624996
survival_time_median14.950000000000076
deviation-center-line_median0.6328896255871176
in-drivable-lane_median0


other stats
agent_compute-ego_max0.048521833419799806
agent_compute-ego_mean0.04140013027191162
agent_compute-ego_median0.045872041384379066
agent_compute-ego_min0.02266684055328369
deviation-center-line_max0.7026986637147884
deviation-center-line_mean0.5655394793210812
deviation-center-line_min0.33321988131512953
deviation-heading_max4.060344535350675
deviation-heading_mean2.9798992890022777
deviation-heading_median2.908022198176303
deviation-heading_min1.910464220176005
driven_any_max4.607218363905998
driven_any_mean3.6673803365009334
driven_any_median4.048450566355143
driven_any_min2.702518031300541
driven_lanedir_consec_max4.446930194565708
driven_lanedir_consec_mean3.5355340019880934
driven_lanedir_consec_min2.452217818580975
driven_lanedir_max4.446930194565708
driven_lanedir_mean3.5355340019880934
driven_lanedir_median3.992339740624996
driven_lanedir_min2.452217818580975
in-drivable-lane_max1.8500000000000192
in-drivable-lane_mean0.4800000000000054
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.702518031300541, "sim_physics": 0.08915998220443726, "survival_time": 14.950000000000076, "driven_lanedir": 2.452217818580975, "sim_render-ego": 0.010761655966440836, "in-drivable-lane": 1.8500000000000192, "agent_compute-ego": 0.02266684055328369, "deviation-heading": 3.5926176507758605, "set_robot_commands": 0.009424825509389242, "deviation-center-line": 0.6738535756608381, "driven_lanedir_consec": 2.452217818580975, "sim_compute_sim_state": 0.005222249031066895, "sim_compute_performance-ego": 0.006206769148508708, "sim_compute_robot_state-ego": 0.007760830720265706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7471455865359853, "sim_physics": 0.10815845251083374, "survival_time": 14.950000000000076, "driven_lanedir": 2.5992786761180313, "sim_render-ego": 0.0116514786084493, "in-drivable-lane": 0, "agent_compute-ego": 0.04592207590738932, "deviation-heading": 4.060344535350675, "set_robot_commands": 0.00937881628672282, "deviation-center-line": 0.6328896255871176, "driven_lanedir_consec": 2.5992786761180313, "sim_compute_sim_state": 0.004875691731770834, "sim_compute_performance-ego": 0.006853502591451009, "sim_compute_robot_state-ego": 0.008674898147583009}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.607218363905998, "sim_physics": 0.08999380509058634, "survival_time": 14.950000000000076, "driven_lanedir": 4.446930194565708, "sim_render-ego": 0.010875085194905598, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.045872041384379066, "deviation-heading": 2.908022198176303, "set_robot_commands": 0.0086246124903361, "deviation-center-line": 0.7026986637147884, "driven_lanedir_consec": 4.446930194565708, "sim_compute_sim_state": 0.004497980276743571, "sim_compute_performance-ego": 0.006351703802744547, "sim_compute_robot_state-ego": 0.00823276917139689}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.048450566355143, "sim_physics": 0.09530190149943034, "survival_time": 14.950000000000076, "driven_lanedir": 3.992339740624996, "sim_render-ego": 0.011259838740030923, "in-drivable-lane": 0, "agent_compute-ego": 0.048521833419799806, "deviation-heading": 2.428047840532547, "set_robot_commands": 0.0083881147702535, "deviation-center-line": 0.33321988131512953, "driven_lanedir_consec": 3.992339740624996, "sim_compute_sim_state": 0.00458865483601888, "sim_compute_performance-ego": 0.00719779094060262, "sim_compute_robot_state-ego": 0.01070029338200887}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.231569134407001, "sim_physics": 0.08555415948232015, "survival_time": 14.950000000000076, "driven_lanedir": 4.186903580050758, "sim_render-ego": 0.01021894613901774, "in-drivable-lane": 0, "agent_compute-ego": 0.044017860094706214, "deviation-heading": 1.910464220176005, "set_robot_commands": 0.007857262293497721, "deviation-center-line": 0.48503565032753265, "driven_lanedir_consec": 4.186903580050758, "sim_compute_sim_state": 0.004309709072113037, "sim_compute_performance-ego": 0.006014899412790934, "sim_compute_robot_state-ego": 0.007558443546295166}}
set_robot_commands_max0.009424825509389242
set_robot_commands_mean0.008734726270039878
set_robot_commands_median0.0086246124903361
set_robot_commands_min0.007857262293497721
sim_compute_performance-ego_max0.00719779094060262
sim_compute_performance-ego_mean0.006524933179219564
sim_compute_performance-ego_median0.006351703802744547
sim_compute_performance-ego_min0.006014899412790934
sim_compute_robot_state-ego_max0.01070029338200887
sim_compute_robot_state-ego_mean0.008585446993509927
sim_compute_robot_state-ego_median0.00823276917139689
sim_compute_robot_state-ego_min0.007558443546295166
sim_compute_sim_state_max0.005222249031066895
sim_compute_sim_state_mean0.004698856989542643
sim_compute_sim_state_median0.00458865483601888
sim_compute_sim_state_min0.004309709072113037
sim_physics_max0.10815845251083374
sim_physics_mean0.09363366015752156
sim_physics_median0.08999380509058634
sim_physics_min0.08555415948232015
sim_render-ego_max0.0116514786084493
sim_render-ego_mean0.01095340092976888
sim_render-ego_median0.010875085194905598
sim_render-ego_min0.01021894613901774
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
276034948Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:09:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
275724376Frank (Chude) Qian 🇨🇦Frank Raw Test 2aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:15:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6507754475687807
survival_time_median4.549999999999992
deviation-center-line_median0.2018638256435331
in-drivable-lane_median0.9999999999999968


other stats
agent_compute-ego_max0.030407956668308804
agent_compute-ego_mean0.026614182886843044
agent_compute-ego_median0.02704292605904972
agent_compute-ego_min0.019212058420931356
deviation-center-line_max0.35413673965968584
deviation-center-line_mean0.19930012255702312
deviation-center-line_min0.08645758972396798
deviation-heading_max2.217764153042558
deviation-heading_mean1.065973149935036
deviation-heading_median1.108991569573296
deviation-heading_min0.3831626821135121
driven_any_max2.9193563677025502
driven_any_mean1.6232016481467384
driven_any_median1.626165523833239
driven_any_min0.3988214404055884
driven_lanedir_consec_max2.348984799352644
driven_lanedir_consec_mean0.8592460575513456
driven_lanedir_consec_min0.3727825205076254
driven_lanedir_max2.348984799352644
driven_lanedir_mean0.95758852388632
driven_lanedir_median0.9181347332026444
driven_lanedir_min0.3727825205076254
in-drivable-lane_max4.549999999999984
in-drivable-lane_mean1.5266666666666622
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9707924466113589, "sim_physics": 0.09215662262656472, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9181347332026444, "sim_render-ego": 0.01083573428067294, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.02562961144880815, "deviation-heading": 1.4011703179447037, "set_robot_commands": 0.007857125455682928, "deviation-center-line": 0.2120112206659931, "driven_lanedir_consec": 0.6363125350556895, "sim_compute_sim_state": 0.004289453679865057, "sim_compute_performance-ego": 0.006588983535766602, "sim_compute_robot_state-ego": 0.008126594803550026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.658590865419398, "sim_physics": 0.09759957449776786, "survival_time": 4.549999999999992, "driven_lanedir": 1.2722437190661589, "sim_render-ego": 0.011394836090423247, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0267837283375499, "deviation-heading": 1.1495264888842605, "set_robot_commands": 0.009283974930480289, "deviation-center-line": 0.3042816805648035, "driven_lanedir_consec": 1.2722437190661589, "sim_compute_sim_state": 0.00516441890171596, "sim_compute_performance-ego": 0.007011641512860309, "sim_compute_robot_state-ego": 0.008223221852229191}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6360037416290946, "sim_physics": 0.11248841739836192, "survival_time": 2.1000000000000005, "driven_lanedir": 0.5965561488814339, "sim_render-ego": 0.013348511287144251, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.029135488328479585, "deviation-heading": 0.4293177756195492, "set_robot_commands": 0.010156092189607164, "deviation-center-line": 0.12198844519103053, "driven_lanedir_consec": 0.5965561488814339, "sim_compute_sim_state": 0.005394753955659412, "sim_compute_performance-ego": 0.007787324133373443, "sim_compute_robot_state-ego": 0.009657485144478934}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.886243167084589, "sim_physics": 0.09893999739391048, "survival_time": 8.199999999999982, "driven_lanedir": 1.5857778372082392, "sim_render-ego": 0.011589182586204717, "in-drivable-lane": 3.04999999999999, "agent_compute-ego": 0.0259207472568605, "deviation-heading": 1.809033958554172, "set_robot_commands": 0.00921329347098746, "deviation-center-line": 0.3107926396495207, "driven_lanedir_consec": 1.2171416368029986, "sim_compute_sim_state": 0.004683119494740556, "sim_compute_performance-ego": 0.0068715476408237365, "sim_compute_robot_state-ego": 0.008878684625393006}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.854950135533352, "sim_physics": 0.1166325721865386, "survival_time": 7.649999999999981, "driven_lanedir": 2.348984799352644, "sim_render-ego": 0.012782472411012338, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.028090654634961895, "deviation-heading": 1.1702992328371289, "set_robot_commands": 0.010064167134902055, "deviation-center-line": 0.35413673965968584, "driven_lanedir_consec": 2.348984799352644, "sim_compute_sim_state": 0.0053020302766288805, "sim_compute_performance-ego": 0.007520940568712022, "sim_compute_robot_state-ego": 0.009535175522947624}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.9193563677025502, "sim_physics": 0.1047758228638593, "survival_time": 8.499999999999986, "driven_lanedir": 1.084539171378145, "sim_render-ego": 0.012485310610602884, "in-drivable-lane": 4.549999999999984, "agent_compute-ego": 0.02704292605904972, "deviation-heading": 2.217764153042558, "set_robot_commands": 0.009570719214046702, "deviation-center-line": 0.24812446678204975, "driven_lanedir_consec": 0.6520637655935562, "sim_compute_sim_state": 0.0050448908525354726, "sim_compute_performance-ego": 0.007327743137584013, "sim_compute_robot_state-ego": 0.009111792900983025}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.30050558673855, "sim_physics": 0.11195960252181344, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7346258076459978, "sim_render-ego": 0.012501796086629232, "in-drivable-lane": 0.9999999999999968, "agent_compute-ego": 0.027151384215424023, "deviation-heading": 1.108991569573296, "set_robot_commands": 0.009366536485976068, "deviation-center-line": 0.2018638256435331, "driven_lanedir_consec": 0.7346258076459978, "sim_compute_sim_state": 0.00520703066950259, "sim_compute_performance-ego": 0.007262399231178173, "sim_compute_robot_state-ego": 0.009458586789559627}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8648711659475172, "sim_physics": 0.1103553869286362, "survival_time": 2.4499999999999993, "driven_lanedir": 0.37809792221187655, "sim_render-ego": 0.013377525368515324, "in-drivable-lane": 0.8, "agent_compute-ego": 0.02683101868142887, "deviation-heading": 1.0499154140899072, "set_robot_commands": 0.009588660026083188, "deviation-center-line": 0.12084396700229512, "driven_lanedir_consec": 0.37809792221187655, "sim_compute_sim_state": 0.005077722121258171, "sim_compute_performance-ego": 0.008031543420285595, "sim_compute_robot_state-ego": 0.009931369703643176}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.4245262354156254, "sim_physics": 0.09693224928272304, "survival_time": 6.699999999999984, "driven_lanedir": 0.6152583917174923, "sim_render-ego": 0.012054064380588815, "in-drivable-lane": 4.399999999999986, "agent_compute-ego": 0.02723899706086116, "deviation-heading": 1.1680256441427146, "set_robot_commands": 0.009441425551229447, "deviation-center-line": 0.1421175070842826, "driven_lanedir_consec": 0.6152583917174923, "sim_compute_sim_state": 0.005064078231356037, "sim_compute_performance-ego": 0.007160702748085136, "sim_compute_robot_state-ego": 0.008929875359606387}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5249166831054102, "sim_physics": 0.06634797900915146, "survival_time": 1.6000000000000008, "driven_lanedir": 0.5077574265418092, "sim_render-ego": 0.00897853821516037, "in-drivable-lane": 0, "agent_compute-ego": 0.02073296904563904, "deviation-heading": 0.42428691103150834, "set_robot_commands": 0.006882965564727783, "deviation-center-line": 0.10887630323696472, "driven_lanedir_consec": 0.5077574265418092, "sim_compute_sim_state": 0.003555484116077423, "sim_compute_performance-ego": 0.004978634417057037, "sim_compute_robot_state-ego": 0.0062811970710754395}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.686624283263704, "sim_physics": 0.11543258598872594, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6059425955453552, "sim_render-ego": 0.013226179849533807, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.030407956668308804, "deviation-heading": 0.5431615869269074, "set_robot_commands": 0.010950616427830288, "deviation-center-line": 0.1516460992754765, "driven_lanedir_consec": 0.6059425955453552, "sim_compute_sim_state": 0.005541148639860607, "sim_compute_performance-ego": 0.007662829898652576, "sim_compute_robot_state-ego": 0.009709545544215612}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.013941830738716, "sim_physics": 0.11060854029064336, "survival_time": 6.0499999999999865, "driven_lanedir": 1.0429786382566155, "sim_render-ego": 0.014194390005316616, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.02881535025667553, "deviation-heading": 1.5848600083340438, "set_robot_commands": 0.009752423310082806, "deviation-center-line": 0.2456735978812127, "driven_lanedir_consec": 0.6507754475687807, "sim_compute_sim_state": 0.005332332012081935, "sim_compute_performance-ego": 0.007597755794682778, "sim_compute_robot_state-ego": 0.0097565493307823}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.626165523833239, "sim_physics": 0.10656621167947958, "survival_time": 4.549999999999992, "driven_lanedir": 1.1761279917484444, "sim_render-ego": 0.013097941220461666, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.029246807098388672, "deviation-heading": 0.3831626821135121, "set_robot_commands": 0.01017409628564185, "deviation-center-line": 0.1356835194426339, "driven_lanedir_consec": 1.1761279917484444, "sim_compute_sim_state": 0.00522131710262089, "sim_compute_performance-ego": 0.007616795026339018, "sim_compute_robot_state-ego": 0.009769672875875955}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3988214404055884, "sim_physics": 0.1044018451984112, "survival_time": 1.3000000000000005, "driven_lanedir": 0.3727825205076254, "sim_render-ego": 0.012592801680931678, "in-drivable-lane": 0, "agent_compute-ego": 0.02697304578927847, "deviation-heading": 0.44893337398864713, "set_robot_commands": 0.009193658828735352, "deviation-center-line": 0.08645758972396798, "driven_lanedir_consec": 0.3727825205076254, "sim_compute_sim_state": 0.005371506397540753, "sim_compute_performance-ego": 0.007014907323397123, "sim_compute_robot_state-ego": 0.00919474088228666}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.581715248772378, "sim_physics": 0.06618838363818907, "survival_time": 4.449999999999992, "driven_lanedir": 1.1240201550303182, "sim_render-ego": 0.007748745800404066, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.019212058420931356, "deviation-heading": 1.1011481319426313, "set_robot_commands": 0.00572632939628001, "deviation-center-line": 0.24500423655189624, "driven_lanedir_consec": 1.1240201550303182, "sim_compute_sim_state": 0.0032531920443759875, "sim_compute_performance-ego": 0.004396915435791016, "sim_compute_robot_state-ego": 0.005536759837289874}}
set_robot_commands_max0.010950616427830288
set_robot_commands_mean0.009148138951486228
set_robot_commands_median0.009441425551229447
set_robot_commands_min0.00572632939628001
sim_compute_performance-ego_max0.008031543420285595
sim_compute_performance-ego_mean0.00698871092163924
sim_compute_performance-ego_median0.007262399231178173
sim_compute_performance-ego_min0.004396915435791016
sim_compute_robot_state-ego_max0.009931369703643176
sim_compute_robot_state-ego_mean0.008806750149594457
sim_compute_robot_state-ego_median0.00919474088228666
sim_compute_robot_state-ego_min0.005536759837289874
sim_compute_sim_state_max0.005541148639860607
sim_compute_sim_state_mean0.004900165233054648
sim_compute_sim_state_median0.00516441890171596
sim_compute_sim_state_min0.0032531920443759875
sim_physics_max0.1166325721865386
sim_physics_mean0.1007590527669851
sim_physics_median0.1047758228638593
sim_physics_min0.06618838363818907
sim_render-ego_max0.014194390005316616
sim_render-ego_mean0.012013868658240131
sim_render-ego_median0.012501796086629232
sim_render-ego_min0.007748745800404066
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean4.609999999999991
survival_time_min1.3000000000000005
No reset possible
275324943Andrea Daniele 🇮🇹challenge-aido_LF-template-ros - Template solution using ROSaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5728900130190617
survival_time_median3.049999999999997
deviation-center-line_median0.1287081573255118
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.02529191189124936
agent_compute-ego_mean0.020034821850402815
agent_compute-ego_median0.01894979334589261
agent_compute-ego_min0.015195094622098485
deviation-center-line_max0.36443765592383554
deviation-center-line_mean0.1588742978783914
deviation-center-line_min0.08393700821326386
deviation-heading_max1.0316671781452431
deviation-heading_mean0.5356514512770911
deviation-heading_median0.46418759639345647
deviation-heading_min0.2008327977683927
driven_any_max1.0990919961264012
driven_any_mean0.7035676322925487
driven_any_median0.7833781665871041
driven_any_min0.21586906071648584
driven_lanedir_consec_max1.0280875807340986
driven_lanedir_consec_mean0.5474505695862126
driven_lanedir_consec_min0.19811047289692163
driven_lanedir_max1.0280875807340986
driven_lanedir_mean0.5474505695862126
driven_lanedir_median0.5728900130190617
driven_lanedir_min0.19811047289692163
in-drivable-lane_max1.399999999999995
in-drivable-lane_mean0.4166666666666652
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.029569969954737, "sim_physics": 0.09650667072975472, "survival_time": 3.649999999999995, "driven_lanedir": 0.5728900130190617, "sim_render-ego": 0.012107558446387725, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.024001085594908832, "deviation-heading": 0.46418759639345647, "set_robot_commands": 0.009207748386957874, "deviation-center-line": 0.16420485117826172, "driven_lanedir_consec": 0.5728900130190617, "sim_compute_sim_state": 0.004952871636168597, "sim_compute_performance-ego": 0.007174214271649922, "sim_compute_robot_state-ego": 0.008910757221587717}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21586906071648584, "sim_physics": 0.07283228635787964, "survival_time": 1.0000000000000002, "driven_lanedir": 0.19811047289692163, "sim_render-ego": 0.008032619953155518, "in-drivable-lane": 0, "agent_compute-ego": 0.02040994167327881, "deviation-heading": 0.35358071986381573, "set_robot_commands": 0.005638980865478515, "deviation-center-line": 0.08492450847657326, "driven_lanedir_consec": 0.19811047289692163, "sim_compute_sim_state": 0.003190755844116211, "sim_compute_performance-ego": 0.004597997665405274, "sim_compute_robot_state-ego": 0.00577249526977539}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0285461590131229, "sim_physics": 0.13759897528467951, "survival_time": 3.699999999999995, "driven_lanedir": 0.9241157643596049, "sim_render-ego": 0.014321227331419249, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.02504087461007608, "deviation-heading": 0.7204674568635022, "set_robot_commands": 0.011966251038216255, "deviation-center-line": 0.12663250504026446, "driven_lanedir_consec": 0.9241157643596049, "sim_compute_sim_state": 0.006549136058704273, "sim_compute_performance-ego": 0.008534669876098633, "sim_compute_robot_state-ego": 0.01139710078368316}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7833781665871041, "sim_physics": 0.1143861325060735, "survival_time": 3.049999999999997, "driven_lanedir": 0.7738646695799877, "sim_render-ego": 0.01320529374919954, "in-drivable-lane": 0, "agent_compute-ego": 0.02529191189124936, "deviation-heading": 0.3999540773760856, "set_robot_commands": 0.01036559558305584, "deviation-center-line": 0.22820877647883453, "driven_lanedir_consec": 0.7738646695799877, "sim_compute_sim_state": 0.005604579800465068, "sim_compute_performance-ego": 0.00806544647842157, "sim_compute_robot_state-ego": 0.009893589332455497}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36430896900879234, "sim_physics": 0.08351779729127884, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3193916254754976, "sim_render-ego": 0.0094309002161026, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.017880454659461975, "deviation-heading": 0.618182945554115, "set_robot_commands": 0.007022134959697723, "deviation-center-line": 0.1026554262752819, "driven_lanedir_consec": 0.3193916254754976, "sim_compute_sim_state": 0.003994181752204895, "sim_compute_performance-ego": 0.005548641085624695, "sim_compute_robot_state-ego": 0.006931297481060028}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0127346981029353, "sim_physics": 0.0717013913231927, "survival_time": 3.699999999999995, "driven_lanedir": 0.664699798794147, "sim_render-ego": 0.009240672395036028, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.018322377591519744, "deviation-heading": 0.6957245682129789, "set_robot_commands": 0.00673618509962752, "deviation-center-line": 0.12805471035650365, "driven_lanedir_consec": 0.664699798794147, "sim_compute_sim_state": 0.00375566933606122, "sim_compute_performance-ego": 0.0051981597333341035, "sim_compute_robot_state-ego": 0.006596942205686827}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5787661712418932, "sim_physics": 0.0716208579928376, "survival_time": 2.1500000000000004, "driven_lanedir": 0.5755780495920495, "sim_render-ego": 0.009280271308366644, "in-drivable-lane": 0, "agent_compute-ego": 0.017399765724359556, "deviation-heading": 0.2008327977683927, "set_robot_commands": 0.0071269911389018215, "deviation-center-line": 0.2232664765139516, "driven_lanedir_consec": 0.5755780495920495, "sim_compute_sim_state": 0.003610638685004656, "sim_compute_performance-ego": 0.005193288936171421, "sim_compute_robot_state-ego": 0.006548088650370753}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0990919961264012, "sim_physics": 0.06704857442286108, "survival_time": 3.8499999999999943, "driven_lanedir": 1.0280875807340986, "sim_render-ego": 0.00858876302644804, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.016671843342966848, "deviation-heading": 1.0316671781452431, "set_robot_commands": 0.006140879222324916, "deviation-center-line": 0.25301109796403, "driven_lanedir_consec": 1.0280875807340986, "sim_compute_sim_state": 0.0035001674255767425, "sim_compute_performance-ego": 0.0050058798356489706, "sim_compute_robot_state-ego": 0.00632650511605399}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.34198065118955295, "sim_physics": 0.07805716580358045, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3296055640738418, "sim_render-ego": 0.008740046928668845, "in-drivable-lane": 0, "agent_compute-ego": 0.017589651305100013, "deviation-heading": 0.2910852191740013, "set_robot_commands": 0.006754538108562601, "deviation-center-line": 0.10276020650779565, "driven_lanedir_consec": 0.3296055640738418, "sim_compute_sim_state": 0.0038311152622617526, "sim_compute_performance-ego": 0.005176240000231513, "sim_compute_robot_state-ego": 0.0063458722213218955}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.30168509044195024, "sim_physics": 0.06528217058915359, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2398637996379982, "sim_render-ego": 0.008700022330650916, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.015195094622098485, "deviation-heading": 0.6213263219174483, "set_robot_commands": 0.005952174846942608, "deviation-center-line": 0.08393700821326386, "driven_lanedir_consec": 0.2398637996379982, "sim_compute_sim_state": 0.003333155925457294, "sim_compute_performance-ego": 0.004696268301743727, "sim_compute_robot_state-ego": 0.005870360594529372}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.046691039627755, "sim_physics": 0.09016296151396516, "survival_time": 3.8499999999999943, "driven_lanedir": 0.7353781713772528, "sim_render-ego": 0.01109094743604784, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.019925259924554205, "deviation-heading": 1.022159846748188, "set_robot_commands": 0.00796321150544402, "deviation-center-line": 0.36443765592383554, "driven_lanedir_consec": 0.7353781713772528, "sim_compute_sim_state": 0.004643198731657747, "sim_compute_performance-ego": 0.00644590018631576, "sim_compute_robot_state-ego": 0.008100079251574232}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0281134464550938, "sim_physics": 0.07076475653849856, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6131669992313173, "sim_render-ego": 0.008985032497997016, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.01737312531807053, "deviation-heading": 0.3935283064502115, "set_robot_commands": 0.006542414007052569, "deviation-center-line": 0.13238951415004194, "driven_lanedir_consec": 0.6131669992313173, "sim_compute_sim_state": 0.0036709745165327905, "sim_compute_performance-ego": 0.0052385766741255635, "sim_compute_robot_state-ego": 0.006380547939891547}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9401367212800152, "sim_physics": 0.08209922064596148, "survival_time": 3.349999999999996, "driven_lanedir": 0.4881946546804131, "sim_render-ego": 0.009940752342565737, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.01894979334589261, "deviation-heading": 0.32326847163084654, "set_robot_commands": 0.006962765508623265, "deviation-center-line": 0.114696662336249, "driven_lanedir_consec": 0.4881946546804131, "sim_compute_sim_state": 0.0038561749814161614, "sim_compute_performance-ego": 0.0057525563595899895, "sim_compute_robot_state-ego": 0.006945318250513788}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4273559741287285, "sim_physics": 0.08925120489937918, "survival_time": 1.7500000000000009, "driven_lanedir": 0.4020208579940019, "sim_render-ego": 0.01092803818838937, "in-drivable-lane": 0, "agent_compute-ego": 0.021589231491088868, "deviation-heading": 0.5828627869444176, "set_robot_commands": 0.00813993045261928, "deviation-center-line": 0.1287081573255118, "driven_lanedir_consec": 0.4020208579940019, "sim_compute_sim_state": 0.004292488098144531, "sim_compute_performance-ego": 0.0062949384961809435, "sim_compute_robot_state-ego": 0.007979529244559152}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.3552863705136616, "sim_physics": 0.14927547208724484, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3467905223469958, "sim_render-ego": 0.012842193726570377, "in-drivable-lane": 0, "agent_compute-ego": 0.024881916661416332, "deviation-heading": 0.31594347611366247, "set_robot_commands": 0.010783541587091262, "deviation-center-line": 0.1452269114354725, "driven_lanedir_consec": 0.3467905223469958, "sim_compute_sim_state": 0.0055036775527461885, "sim_compute_performance-ego": 0.00814304813261955, "sim_compute_robot_state-ego": 0.0120759702497913}}
set_robot_commands_max0.011966251038216255
set_robot_commands_mean0.007820222820706404
set_robot_commands_median0.007022134959697723
set_robot_commands_min0.005638980865478515
sim_compute_performance-ego_max0.008534669876098633
sim_compute_performance-ego_mean0.0060710550688774425
sim_compute_performance-ego_median0.005548641085624695
sim_compute_performance-ego_min0.004597997665405274
sim_compute_robot_state-ego_max0.0120759702497913
sim_compute_robot_state-ego_mean0.007738296920856976
sim_compute_robot_state-ego_median0.006931297481060028
sim_compute_robot_state-ego_min0.00577249526977539
sim_compute_sim_state_max0.006549136058704273
sim_compute_sim_state_mean0.004285919040434542
sim_compute_sim_state_median0.0038561749814161614
sim_compute_sim_state_min0.003190755844116211
sim_physics_max0.14927547208724484
sim_physics_mean0.08934037586575606
sim_physics_median0.08209922064596148
sim_physics_min0.06528217058915359
sim_render-ego_max0.014321227331419249
sim_render-ego_mean0.010362289325133693
sim_render-ego_median0.0094309002161026
sim_render-ego_min0.008032619953155518
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean2.63333333333333
survival_time_min1.0000000000000002
No reset possible
275234388Soroush Saryazdi 🇨🇦bluejayaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-46-148-104920:03:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 84 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
275044485Frank (Chude) Qian 🇨🇦In duckietown we do not endorse DUI...aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:19:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.44491574229678976
survival_time_median4.499999999999992
deviation-center-line_median0.2939481396299065
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.029154792428016663
agent_compute-ego_mean0.027259926997101915
agent_compute-ego_median0.027553156444004603
agent_compute-ego_min0.023445356637239456
deviation-center-line_max1.2177724658031523
deviation-center-line_mean0.4504006432014605
deviation-center-line_min0.08731821742992579
deviation-heading_max5.3930373475550155
deviation-heading_mean2.5061964537412984
deviation-heading_median1.940326307300336
deviation-heading_min0.7168311320812575
driven_any_max2.226207435539945
driven_any_mean0.8999324695077561
driven_any_median0.600468686100291
driven_any_min0.1091234883315202
driven_lanedir_consec_max1.351217258947764
driven_lanedir_consec_mean0.5997109649497598
driven_lanedir_consec_min0.08608674412950057
driven_lanedir_max1.3799776748571075
driven_lanedir_mean0.6395965910306863
driven_lanedir_median0.44491574229678976
driven_lanedir_min0.08608674412950057
in-drivable-lane_max5.400000000000071
in-drivable-lane_mean1.0933333333333384
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.45749539784139326, "sim_physics": 0.10570486289698904, "survival_time": 4.099999999999993, "driven_lanedir": 0.36915550590380986, "sim_render-ego": 0.0123494078473347, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.02909798156924364, "deviation-heading": 1.9929116147722532, "set_robot_commands": 0.009823432782801188, "deviation-center-line": 0.34601890723376516, "driven_lanedir_consec": 0.36915550590380986, "sim_compute_sim_state": 0.0052721703924783845, "sim_compute_performance-ego": 0.007555598165930771, "sim_compute_robot_state-ego": 0.00888614247484905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.16883456647992, "sim_physics": 0.10923773845036824, "survival_time": 14.950000000000076, "driven_lanedir": 1.3799776748571075, "sim_render-ego": 0.011630924542744954, "in-drivable-lane": 5.400000000000071, "agent_compute-ego": 0.027040650844573976, "deviation-heading": 3.5535503874527445, "set_robot_commands": 0.009212351640065512, "deviation-center-line": 0.9957751770208328, "driven_lanedir_consec": 1.3034358902129888, "sim_compute_sim_state": 0.004803614616394043, "sim_compute_performance-ego": 0.0070926260948181155, "sim_compute_robot_state-ego": 0.008862709999084473}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6293707049216465, "sim_physics": 0.1051200012584309, "survival_time": 4.549999999999992, "driven_lanedir": 0.5484477149122187, "sim_render-ego": 0.012329368800907344, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02840650212633741, "deviation-heading": 1.940326307300336, "set_robot_commands": 0.009129110273424086, "deviation-center-line": 0.19752449365770175, "driven_lanedir_consec": 0.5484477149122187, "sim_compute_sim_state": 0.005308664762056791, "sim_compute_performance-ego": 0.007171696358984643, "sim_compute_robot_state-ego": 0.00939748051402333}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.226207435539945, "sim_physics": 0.1068565583229065, "survival_time": 14.950000000000076, "driven_lanedir": 1.3618356673823615, "sim_render-ego": 0.012523018519083658, "in-drivable-lane": 4.250000000000003, "agent_compute-ego": 0.027660988171895343, "deviation-heading": 5.253469884002034, "set_robot_commands": 0.009443293412526447, "deviation-center-line": 0.8389443138504565, "driven_lanedir_consec": 1.351217258947764, "sim_compute_sim_state": 0.005012502670288086, "sim_compute_performance-ego": 0.007328171730041504, "sim_compute_robot_state-ego": 0.008971248467763265}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.46463039215513185, "sim_physics": 0.09150962705736036, "survival_time": 3.8499999999999943, "driven_lanedir": 0.43082266757088306, "sim_render-ego": 0.010365421121770683, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.024739881614585978, "deviation-heading": 1.2134441087957328, "set_robot_commands": 0.008357980034568092, "deviation-center-line": 0.3361261189925881, "driven_lanedir_consec": 0.43082266757088306, "sim_compute_sim_state": 0.004492700874031364, "sim_compute_performance-ego": 0.006019158796830611, "sim_compute_robot_state-ego": 0.007725508182079761}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.6142672176876541, "sim_physics": 0.12072572178310818, "survival_time": 4.499999999999992, "driven_lanedir": 0.4771741551483832, "sim_render-ego": 0.01279293696085612, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.028175600369771323, "deviation-heading": 2.0578453985909757, "set_robot_commands": 0.009989719920688206, "deviation-center-line": 0.26587149794996534, "driven_lanedir_consec": 0.4771741551483832, "sim_compute_sim_state": 0.005643285645378961, "sim_compute_performance-ego": 0.007517464955647786, "sim_compute_robot_state-ego": 0.009745799170600044}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1091234883315202, "sim_physics": 0.14049608890826887, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08608674412950057, "sim_render-ego": 0.01165911784538856, "in-drivable-lane": 0, "agent_compute-ego": 0.028510377957270697, "deviation-heading": 0.7168311320812575, "set_robot_commands": 0.00938858435704158, "deviation-center-line": 0.14781017359256066, "driven_lanedir_consec": 0.08608674412950057, "sim_compute_sim_state": 0.0048285722732543945, "sim_compute_performance-ego": 0.006727273647601788, "sim_compute_robot_state-ego": 0.009115081567030689}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1571945345173561, "sim_physics": 0.12209753692150116, "survival_time": 1.6000000000000008, "driven_lanedir": 0.12066854365821422, "sim_render-ego": 0.011994905769824982, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.029154792428016663, "deviation-heading": 0.8137018514167599, "set_robot_commands": 0.010214000940322876, "deviation-center-line": 0.15425414028009307, "driven_lanedir_consec": 0.12066854365821422, "sim_compute_sim_state": 0.004790082573890686, "sim_compute_performance-ego": 0.006921008229255676, "sim_compute_robot_state-ego": 0.009019695222377775}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.3432956211174498, "sim_physics": 0.1023730720792498, "survival_time": 2.799999999999998, "driven_lanedir": 0.26266171364807733, "sim_render-ego": 0.011483758687973022, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.026855128152029856, "deviation-heading": 1.0101693152265565, "set_robot_commands": 0.008445837668010167, "deviation-center-line": 0.08731821742992579, "driven_lanedir_consec": 0.26266171364807733, "sim_compute_sim_state": 0.004888321672167096, "sim_compute_performance-ego": 0.006796836853027344, "sim_compute_robot_state-ego": 0.00886138847896031}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.481990795909478, "sim_physics": 0.09665814951846474, "survival_time": 9.5, "driven_lanedir": 1.0836600411085922, "sim_render-ego": 0.01095479915016576, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.026162462485463996, "deviation-heading": 4.84007594779616, "set_robot_commands": 0.008693899606403552, "deviation-center-line": 0.7717754423644604, "driven_lanedir_consec": 0.829073418753614, "sim_compute_sim_state": 0.004614319299396715, "sim_compute_performance-ego": 0.006919253499884355, "sim_compute_robot_state-ego": 0.008536181951823988}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5416564771795724, "sim_physics": 0.12110777241843088, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4108743619900128, "sim_render-ego": 0.012297565596444264, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.027553156444004603, "deviation-heading": 1.6602191265435815, "set_robot_commands": 0.010212336267743791, "deviation-center-line": 0.19104013771101017, "driven_lanedir_consec": 0.4108743619900128, "sim_compute_sim_state": 0.005082082748413086, "sim_compute_performance-ego": 0.00744260379246303, "sim_compute_robot_state-ego": 0.009077889578683036}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.7219783367399697, "sim_physics": 0.10714177420881928, "survival_time": 12.200000000000038, "driven_lanedir": 1.0827037432226103, "sim_render-ego": 0.012190905750774946, "in-drivable-lane": 3.799999999999997, "agent_compute-ego": 0.027690378368877975, "deviation-heading": 3.980478775087254, "set_robot_commands": 0.009411889021513893, "deviation-center-line": 0.7410163861039433, "driven_lanedir_consec": 0.8261661674424081, "sim_compute_sim_state": 0.004847234389821037, "sim_compute_performance-ego": 0.0071874094791099675, "sim_compute_robot_state-ego": 0.00923616768883877}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.5495485865038034, "sim_physics": 0.1043214916688278, "survival_time": 12.050000000000036, "driven_lanedir": 1.1593624208876516, "sim_render-ego": 0.01130225153879506, "in-drivable-lane": 1.1500000000000083, "agent_compute-ego": 0.02694737564973317, "deviation-heading": 5.3930373475550155, "set_robot_commands": 0.008883954083771132, "deviation-center-line": 1.2177724658031523, "driven_lanedir_consec": 1.1593624208876516, "sim_compute_sim_state": 0.004803918703957712, "sim_compute_performance-ego": 0.006699611537189404, "sim_compute_robot_state-ego": 0.00844519069085972}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.600468686100291, "sim_physics": 0.12010831623286992, "survival_time": 4.549999999999992, "driven_lanedir": 0.44491574229678976, "sim_render-ego": 0.0125949828179328, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.027458272137484703, "deviation-heading": 1.8977334922419904, "set_robot_commands": 0.009802255001696913, "deviation-center-line": 0.2939481396299065, "driven_lanedir_consec": 0.44491574229678976, "sim_compute_sim_state": 0.004852614559970059, "sim_compute_performance-ego": 0.007231159524603205, "sim_compute_robot_state-ego": 0.009327891108753915}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.43292480159120966, "sim_physics": 0.0892535150051117, "survival_time": 3.1999999999999966, "driven_lanedir": 0.3756021687440825, "sim_render-ego": 0.010849978774785995, "in-drivable-lane": 0, "agent_compute-ego": 0.023445356637239456, "deviation-heading": 1.2691521172568347, "set_robot_commands": 0.00827852264046669, "deviation-center-line": 0.1708140364015459, "driven_lanedir_consec": 0.3756021687440825, "sim_compute_sim_state": 0.004687473177909851, "sim_compute_performance-ego": 0.006029833108186722, "sim_compute_robot_state-ego": 0.007677875459194183}}
set_robot_commands_max0.010214000940322876
set_robot_commands_mean0.009285811176736276
set_robot_commands_median0.00938858435704158
set_robot_commands_min0.00827852264046669
sim_compute_performance-ego_max0.007555598165930771
sim_compute_performance-ego_mean0.006975980384904995
sim_compute_performance-ego_median0.0070926260948181155
sim_compute_performance-ego_min0.006019158796830611
sim_compute_robot_state-ego_max0.009745799170600044
sim_compute_robot_state-ego_mean0.008859083370328154
sim_compute_robot_state-ego_median0.008971248467763265
sim_compute_robot_state-ego_min0.007677875459194183
sim_compute_sim_state_max0.005643285645378961
sim_compute_sim_state_mean0.004928503890627217
sim_compute_sim_state_median0.004847234389821037
sim_compute_sim_state_min0.004492700874031364
sim_physics_max0.14049608890826887
sim_physics_mean0.1095141484487138
sim_physics_median0.1068565583229065
sim_physics_min0.0892535150051117
sim_render-ego_max0.01279293696085612
sim_render-ego_mean0.011821289581652189
sim_render-ego_median0.011994905769824982
sim_render-ego_min0.010365421121770683
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.506666666666679
survival_time_min1.3000000000000005
No reset possible
274914498András Kalaposreinforcement-learning-2240saido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104920:03:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
274654464András Kalaposreinforcement-learning-2217aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:21:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.640172163827146
survival_time_median6.449999999999985
deviation-center-line_median0.3699829003904804
in-drivable-lane_median1.549999999999999


other stats
agent_compute-ego_max0.04160827766230077
agent_compute-ego_mean0.03877472079498094
agent_compute-ego_median0.038525110662239306
agent_compute-ego_min0.03580799969759854
deviation-center-line_max1.0313445147493336
deviation-center-line_mean0.41147593355581097
deviation-center-line_min0.08716606602928968
deviation-heading_max4.258797129379705
deviation-heading_mean2.0777563055441184
deviation-heading_median1.5140462262540284
deviation-heading_min0.2368253490015032
driven_any_max5.793830560179979
driven_any_mean2.78743788083376
driven_any_median2.2814506853978216
driven_any_min1.0658643483090289
driven_lanedir_consec_max5.0953953064927395
driven_lanedir_consec_mean1.780275458862578
driven_lanedir_consec_min0.20610274207331025
driven_lanedir_max5.0953953064927395
driven_lanedir_mean1.7813960310003862
driven_lanedir_median1.640172163827146
driven_lanedir_min0.20610274207331025
in-drivable-lane_max6.450000000000052
in-drivable-lane_mean2.016666666666671
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.290883022363241, "sim_physics": 0.1072428601853391, "survival_time": 11.750000000000032, "driven_lanedir": 2.6819003468249716, "sim_render-ego": 0.011878450880659388, "in-drivable-lane": 3.250000000000009, "agent_compute-ego": 0.04077941204639191, "deviation-heading": 3.2008446760388027, "set_robot_commands": 0.009320331127085585, "deviation-center-line": 0.5630209518674825, "driven_lanedir_consec": 2.6819003468249716, "sim_compute_sim_state": 0.0050767726086555645, "sim_compute_performance-ego": 0.0073762741494686045, "sim_compute_robot_state-ego": 0.009151982246561254}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2814506853978216, "sim_physics": 0.1035129894581876, "survival_time": 6.449999999999985, "driven_lanedir": 1.640172163827146, "sim_render-ego": 0.011510582857353742, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.038956085840861, "deviation-heading": 1.5140462262540284, "set_robot_commands": 0.008601452953131625, "deviation-center-line": 0.3699829003904804, "driven_lanedir_consec": 1.640172163827146, "sim_compute_sim_state": 0.004908038664233777, "sim_compute_performance-ego": 0.006642214087552802, "sim_compute_robot_state-ego": 0.008345149284185366}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.5672998154041675, "sim_physics": 0.1089587124188741, "survival_time": 14.950000000000076, "driven_lanedir": 5.0953953064927395, "sim_render-ego": 0.012010223865509031, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.03960150321324667, "deviation-heading": 4.258797129379705, "set_robot_commands": 0.00960211674372355, "deviation-center-line": 1.0313445147493336, "driven_lanedir_consec": 5.0953953064927395, "sim_compute_sim_state": 0.005173650582631429, "sim_compute_performance-ego": 0.0074024613698323565, "sim_compute_robot_state-ego": 0.009322683016459148}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.787751261196829, "sim_physics": 0.11009731562632435, "survival_time": 13.250000000000052, "driven_lanedir": 3.413972687668966, "sim_render-ego": 0.012509090495559405, "in-drivable-lane": 2.5500000000000176, "agent_compute-ego": 0.04026751428280237, "deviation-heading": 4.096803158218439, "set_robot_commands": 0.009387569607428784, "deviation-center-line": 0.8309354608241363, "driven_lanedir_consec": 3.413972687668966, "sim_compute_sim_state": 0.005310485048114129, "sim_compute_performance-ego": 0.007228823427884084, "sim_compute_robot_state-ego": 0.009519191058176868}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0042040652667303, "sim_physics": 0.10123371513637563, "survival_time": 8.449999999999985, "driven_lanedir": 2.1117377147728806, "sim_render-ego": 0.01203839877653404, "in-drivable-lane": 1.549999999999999, "agent_compute-ego": 0.03744862488741, "deviation-heading": 2.8593491612265263, "set_robot_commands": 0.008935902951031747, "deviation-center-line": 0.4478069453430264, "driven_lanedir_consec": 2.1021470939507103, "sim_compute_sim_state": 0.005165860497739893, "sim_compute_performance-ego": 0.007305959272666796, "sim_compute_robot_state-ego": 0.008829468100734011}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.083910279320352, "sim_physics": 0.0911170821036062, "survival_time": 3.099999999999997, "driven_lanedir": 0.3929708473566822, "sim_render-ego": 0.01121664047241211, "in-drivable-lane": 1.4999999999999962, "agent_compute-ego": 0.03643729994373937, "deviation-heading": 0.6511718687872979, "set_robot_commands": 0.008512320057038338, "deviation-center-line": 0.08716606602928968, "driven_lanedir_consec": 0.3929708473566822, "sim_compute_sim_state": 0.004620859699864541, "sim_compute_performance-ego": 0.006810918931038149, "sim_compute_robot_state-ego": 0.008203848715751402}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.711699688110942, "sim_physics": 0.1103904924894634, "survival_time": 4.749999999999991, "driven_lanedir": 0.8578379725952205, "sim_render-ego": 0.012406931425395763, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.04065435309159128, "deviation-heading": 0.9876509373979484, "set_robot_commands": 0.009545035111276728, "deviation-center-line": 0.18375093503936377, "driven_lanedir_consec": 0.8578379725952205, "sim_compute_sim_state": 0.00483576122083162, "sim_compute_performance-ego": 0.007542908819098222, "sim_compute_robot_state-ego": 0.009064832486604389}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.404212098767158, "sim_physics": 0.10607064756235682, "survival_time": 6.649999999999984, "driven_lanedir": 2.013628124936232, "sim_render-ego": 0.0119806590833162, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.037517622897499485, "deviation-heading": 1.9142822025464583, "set_robot_commands": 0.008670814055249207, "deviation-center-line": 0.5230104712272189, "driven_lanedir_consec": 2.013628124936232, "sim_compute_sim_state": 0.0049258927653606675, "sim_compute_performance-ego": 0.007193110042944886, "sim_compute_robot_state-ego": 0.009243149506418328}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0658643483090289, "sim_physics": 0.11824567439192432, "survival_time": 2.9499999999999975, "driven_lanedir": 0.635157531917697, "sim_render-ego": 0.01578854706327794, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.04123957682464082, "deviation-heading": 1.3058092688877798, "set_robot_commands": 0.009698863756858696, "deviation-center-line": 0.14872836461763092, "driven_lanedir_consec": 0.6279395706727429, "sim_compute_sim_state": 0.004997043286339711, "sim_compute_performance-ego": 0.007120193061182055, "sim_compute_robot_state-ego": 0.009126065141063624}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 5.793830560179979, "sim_physics": 0.10644752661387126, "survival_time": 14.950000000000076, "driven_lanedir": 2.8184033659966636, "sim_render-ego": 0.0112500262260437, "in-drivable-lane": 6.450000000000052, "agent_compute-ego": 0.03837059815724691, "deviation-heading": 3.5347534463149923, "set_robot_commands": 0.008903348445892334, "deviation-center-line": 0.6828451532766824, "driven_lanedir_consec": 2.8184033659966636, "sim_compute_sim_state": 0.0049602270126342775, "sim_compute_performance-ego": 0.007086884180704752, "sim_compute_robot_state-ego": 0.008692038853963217}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.1284290999250328, "sim_physics": 0.10827825530882804, "survival_time": 3.099999999999997, "driven_lanedir": 0.20610274207331025, "sim_render-ego": 0.011593307218243998, "in-drivable-lane": 2.249999999999997, "agent_compute-ego": 0.03735013931028305, "deviation-heading": 0.2368253490015032, "set_robot_commands": 0.008955094122117566, "deviation-center-line": 0.09404121664642628, "driven_lanedir_consec": 0.20610274207331025, "sim_compute_sim_state": 0.0045759793250791485, "sim_compute_performance-ego": 0.00676819585984753, "sim_compute_robot_state-ego": 0.008651902598719443}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.1472971028618295, "sim_physics": 0.09434901945518726, "survival_time": 3.2999999999999963, "driven_lanedir": 0.5416604069688368, "sim_render-ego": 0.011838132684881037, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.03580799969759854, "deviation-heading": 1.017791437904623, "set_robot_commands": 0.009155901995572176, "deviation-center-line": 0.17613721417512496, "driven_lanedir_consec": 0.5416604069688368, "sim_compute_sim_state": 0.004783167983546402, "sim_compute_performance-ego": 0.007282986785426285, "sim_compute_robot_state-ego": 0.009603381156921388}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.9617078540203008, "sim_physics": 0.10129641372466756, "survival_time": 5.349999999999989, "driven_lanedir": 0.5672747709711795, "sim_render-ego": 0.01135644288820641, "in-drivable-lane": 3.049999999999992, "agent_compute-ego": 0.03705669340686264, "deviation-heading": 1.1793126178763504, "set_robot_commands": 0.009262606362316095, "deviation-center-line": 0.124503192913197, "driven_lanedir_consec": 0.5672747709711795, "sim_compute_sim_state": 0.004794201004170925, "sim_compute_performance-ego": 0.006732624267863336, "sim_compute_robot_state-ego": 0.008548865808504764}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.4550969019027502, "sim_physics": 0.11914117836657866, "survival_time": 4.049999999999994, "driven_lanedir": 1.1475865365002906, "sim_render-ego": 0.011979376828228984, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.04160827766230077, "deviation-heading": 1.081891612153285, "set_robot_commands": 0.00999948419170615, "deviation-center-line": 0.2830265404076558, "driven_lanedir_consec": 1.1475865365002906, "sim_compute_sim_state": 0.005109136487230843, "sim_compute_performance-ego": 0.007403553268055857, "sim_compute_robot_state-ego": 0.009050772513872311}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.127931429480231, "sim_physics": 0.10179968043969936, "survival_time": 11.65000000000003, "driven_lanedir": 2.5971399461029767, "sim_render-ego": 0.011727184696770534, "in-drivable-lane": 3.3000000000000247, "agent_compute-ego": 0.038525110662239306, "deviation-heading": 3.3270154911740395, "set_robot_commands": 0.009058739494356474, "deviation-center-line": 0.6258390758301166, "driven_lanedir_consec": 2.5971399461029767, "sim_compute_sim_state": 0.004860960874434704, "sim_compute_performance-ego": 0.00708737189166024, "sim_compute_robot_state-ego": 0.008631954888929113}}
set_robot_commands_max0.00999948419170615
set_robot_commands_mean0.00917397206498567
set_robot_commands_median0.009155901995572176
set_robot_commands_min0.008512320057038338
sim_compute_performance-ego_max0.007542908819098222
sim_compute_performance-ego_mean0.007132298627681732
sim_compute_performance-ego_median0.007193110042944886
sim_compute_performance-ego_min0.006642214087552802
sim_compute_robot_state-ego_max0.009603381156921388
sim_compute_robot_state-ego_mean0.008932352358457641
sim_compute_robot_state-ego_median0.009050772513872311
sim_compute_robot_state-ego_min0.008203848715751402
sim_compute_sim_state_max0.005310485048114129
sim_compute_sim_state_mean0.004939869137391176
sim_compute_sim_state_median0.0049258927653606675
sim_compute_sim_state_min0.0045759793250791485
sim_physics_max0.11914117836657866
sim_physics_mean0.1058787708854189
sim_physics_median0.10644752661387126
sim_physics_min0.0911170821036062
sim_render-ego_max0.01578854706327794
sim_render-ego_mean0.012072266364159484
sim_render-ego_median0.011878450880659388
sim_render-ego_min0.01121664047241211
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.64666666666668
survival_time_min2.9499999999999975
No reset possible
274284444Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:12:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8607371819402831
survival_time_median12.050000000000036
deviation-center-line_median0.4973823577996475
in-drivable-lane_median0


other stats
agent_compute-ego_max0.058050349553426105
agent_compute-ego_mean0.04027737290975859
agent_compute-ego_median0.034042043685913084
agent_compute-ego_min0.027891832763228673
deviation-center-line_max0.9466767998994136
deviation-center-line_mean0.5181316294043842
deviation-center-line_min0.1543437782082445
deviation-heading_max4.172291454901385
deviation-heading_mean1.9229663884501988
deviation-heading_median1.3252345158500622
deviation-heading_min1.044089598220788
driven_any_max2.34914072675637
driven_any_mean1.727193545730644
driven_any_median1.8830454098453135
driven_any_min0.7583365735900698
driven_lanedir_consec_max2.3139470758516647
driven_lanedir_consec_mean1.6739429300037372
driven_lanedir_consec_min0.7232080722247146
driven_lanedir_max2.3139470758516647
driven_lanedir_mean1.6739429300037372
driven_lanedir_median1.8607371819402831
driven_lanedir_min0.7232080722247146
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7583365735900698, "sim_physics": 0.1205341605579152, "survival_time": 5.09999999999999, "driven_lanedir": 0.7232080722247146, "sim_render-ego": 0.013779443853041706, "in-drivable-lane": 0, "agent_compute-ego": 0.03256329368142521, "deviation-heading": 1.044089598220788, "set_robot_commands": 0.012618347710254146, "deviation-center-line": 0.1543437782082445, "driven_lanedir_consec": 0.7232080722247146, "sim_compute_sim_state": 0.006013902963376513, "sim_compute_performance-ego": 0.008270754533655503, "sim_compute_robot_state-ego": 0.009864704281676047}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8830454098453135, "sim_physics": 0.12274807023804216, "survival_time": 12.050000000000036, "driven_lanedir": 1.8607371819402831, "sim_render-ego": 0.01317911721858741, "in-drivable-lane": 0, "agent_compute-ego": 0.027891832763228673, "deviation-heading": 1.3252345158500622, "set_robot_commands": 0.011175521676471125, "deviation-center-line": 0.613342000121982, "driven_lanedir_consec": 1.8607371819402831, "sim_compute_sim_state": 0.005848987468545367, "sim_compute_performance-ego": 0.008055059741641475, "sim_compute_robot_state-ego": 0.010067394660221591}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490610444846185, "sim_physics": 0.11623956282933554, "survival_time": 14.950000000000076, "driven_lanedir": 2.1933954121747745, "sim_render-ego": 0.013925552368164062, "in-drivable-lane": 0, "agent_compute-ego": 0.034042043685913084, "deviation-heading": 4.172291454901385, "set_robot_commands": 0.011871128877003988, "deviation-center-line": 0.9466767998994136, "driven_lanedir_consec": 2.1933954121747745, "sim_compute_sim_state": 0.005732263724009196, "sim_compute_performance-ego": 0.008142066796620688, "sim_compute_robot_state-ego": 0.01014306624730428}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2963839739768477, "sim_physics": 0.1009342869122823, "survival_time": 8.399999999999984, "driven_lanedir": 1.2784269078272492, "sim_render-ego": 0.011506028118587676, "in-drivable-lane": 0, "agent_compute-ego": 0.048839344864799863, "deviation-heading": 1.0960726197153758, "set_robot_commands": 0.008764150596800305, "deviation-center-line": 0.378913210992633, "driven_lanedir_consec": 1.2784269078272492, "sim_compute_sim_state": 0.004879727250053769, "sim_compute_performance-ego": 0.006871768406459263, "sim_compute_robot_state-ego": 0.008681859288896834}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.34914072675637, "sim_physics": 0.11628028551737468, "survival_time": 14.950000000000076, "driven_lanedir": 2.3139470758516647, "sim_render-ego": 0.012815005779266355, "in-drivable-lane": 0, "agent_compute-ego": 0.058050349553426105, "deviation-heading": 1.977143753563382, "set_robot_commands": 0.009967905680338542, "deviation-center-line": 0.4973823577996475, "driven_lanedir_consec": 2.3139470758516647, "sim_compute_sim_state": 0.005262148380279541, "sim_compute_performance-ego": 0.007594759464263916, "sim_compute_robot_state-ego": 0.009815080165863035}}
set_robot_commands_max0.012618347710254146
set_robot_commands_mean0.010879410908173622
set_robot_commands_median0.011175521676471125
set_robot_commands_min0.008764150596800305
sim_compute_performance-ego_max0.008270754533655503
sim_compute_performance-ego_mean0.007786881788528171
sim_compute_performance-ego_median0.008055059741641475
sim_compute_performance-ego_min0.006871768406459263
sim_compute_robot_state-ego_max0.01014306624730428
sim_compute_robot_state-ego_mean0.00971442092879236
sim_compute_robot_state-ego_median0.009864704281676047
sim_compute_robot_state-ego_min0.008681859288896834
sim_compute_sim_state_max0.006013902963376513
sim_compute_sim_state_mean0.005547405957252878
sim_compute_sim_state_median0.005732263724009196
sim_compute_sim_state_min0.004879727250053769
sim_physics_max0.12274807023804216
sim_physics_mean0.11534727321098996
sim_physics_median0.11628028551737468
sim_physics_min0.1009342869122823
sim_render-ego_max0.013925552368164062
sim_render-ego_mean0.01304102946752944
sim_render-ego_median0.01317911721858741
sim_render-ego_min0.011506028118587676
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.090000000000035
survival_time_min5.09999999999999
No reset possible
274074471Mikita Sazanovich 🇷🇺chameleonaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4532853278613724
survival_time_median4.199999999999993
deviation-center-line_median0.45311573392486126
in-drivable-lane_median1.2999999999999965


other stats
agent_compute-ego_max0.0713063052722386
agent_compute-ego_mean0.0633599703388287
agent_compute-ego_median0.06278717517852783
agent_compute-ego_min0.05137380393775734
deviation-center-line_max0.49616093208884865
deviation-center-line_mean0.33339062255144847
deviation-center-line_min0.12182070992819166
deviation-heading_max1.9600803034269407
deviation-heading_mean1.3163123960361196
deviation-heading_median1.2741638287945771
deviation-heading_min0.43468279120441183
driven_any_max2.975033171214036
driven_any_mean1.9681766350370495
driven_any_median1.5815807724738424
driven_any_min1.094940780443924
driven_lanedir_consec_max1.980671960837458
driven_lanedir_consec_mean1.441760773078501
driven_lanedir_consec_min0.7923645541204307
driven_lanedir_max1.980671960837458
driven_lanedir_mean1.441760773078501
driven_lanedir_median1.4532853278613724
driven_lanedir_min0.7923645541204307
in-drivable-lane_max3.300000000000007
in-drivable-lane_mean1.459999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.252807568330493, "sim_physics": 0.08126849741549105, "survival_time": 3.699999999999995, "driven_lanedir": 0.7923645541204307, "sim_render-ego": 0.00958498748573097, "in-drivable-lane": 1.2999999999999965, "agent_compute-ego": 0.05137380393775734, "deviation-heading": 1.0484861926560478, "set_robot_commands": 0.007460507186683449, "deviation-center-line": 0.12182070992819166, "driven_lanedir_consec": 0.7923645541204307, "sim_compute_sim_state": 0.0039036016206483583, "sim_compute_performance-ego": 0.005730632189157847, "sim_compute_robot_state-ego": 0.007168963148787215}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.936520882722952, "sim_physics": 0.11188724582180656, "survival_time": 8.14999999999998, "driven_lanedir": 1.9442701468185015, "sim_render-ego": 0.012692027296756676, "in-drivable-lane": 2.5499999999999927, "agent_compute-ego": 0.06972072607169122, "deviation-heading": 1.8641488640986197, "set_robot_commands": 0.009846147584037549, "deviation-center-line": 0.49616093208884865, "driven_lanedir_consec": 1.9442701468185015, "sim_compute_sim_state": 0.005576145429552698, "sim_compute_performance-ego": 0.007609955372254541, "sim_compute_robot_state-ego": 0.009193385305580186}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.094940780443924, "sim_physics": 0.1165758797100612, "survival_time": 2.799999999999998, "driven_lanedir": 1.0382118757547425, "sim_render-ego": 0.012383644069944109, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.0713063052722386, "deviation-heading": 0.43468279120441183, "set_robot_commands": 0.009981581142970496, "deviation-center-line": 0.13406600242989974, "driven_lanedir_consec": 1.0382118757547425, "sim_compute_sim_state": 0.00541089688028608, "sim_compute_performance-ego": 0.007348690714154925, "sim_compute_robot_state-ego": 0.009226373263767788}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5815807724738424, "sim_physics": 0.09803520497821626, "survival_time": 4.199999999999993, "driven_lanedir": 1.4532853278613724, "sim_render-ego": 0.011609188147953578, "in-drivable-lane": 0, "agent_compute-ego": 0.06278717517852783, "deviation-heading": 1.2741638287945771, "set_robot_commands": 0.008620994431631905, "deviation-center-line": 0.45311573392486126, "driven_lanedir_consec": 1.4532853278613724, "sim_compute_sim_state": 0.004511821837652297, "sim_compute_performance-ego": 0.006446074871789841, "sim_compute_robot_state-ego": 0.00816504160563151}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.975033171214036, "sim_physics": 0.09767753086733016, "survival_time": 8.899999999999991, "driven_lanedir": 1.980671960837458, "sim_render-ego": 0.011201366949617191, "in-drivable-lane": 3.300000000000007, "agent_compute-ego": 0.06161184123392855, "deviation-heading": 1.9600803034269407, "set_robot_commands": 0.008748465709471971, "deviation-center-line": 0.4617897343854412, "driven_lanedir_consec": 1.980671960837458, "sim_compute_sim_state": 0.004657892698652289, "sim_compute_performance-ego": 0.006552891784839416, "sim_compute_robot_state-ego": 0.008301429534226322}}
set_robot_commands_max0.009981581142970496
set_robot_commands_mean0.008931539210959074
set_robot_commands_median0.008748465709471971
set_robot_commands_min0.007460507186683449
sim_compute_performance-ego_max0.007609955372254541
sim_compute_performance-ego_mean0.006737648986439314
sim_compute_performance-ego_median0.006552891784839416
sim_compute_performance-ego_min0.005730632189157847
sim_compute_robot_state-ego_max0.009226373263767788
sim_compute_robot_state-ego_mean0.008411038571598603
sim_compute_robot_state-ego_median0.008301429534226322
sim_compute_robot_state-ego_min0.007168963148787215
sim_compute_sim_state_max0.005576145429552698
sim_compute_sim_state_mean0.004812071693358345
sim_compute_sim_state_median0.004657892698652289
sim_compute_sim_state_min0.0039036016206483583
sim_physics_max0.1165758797100612
sim_physics_mean0.10108887175858106
sim_physics_median0.09803520497821626
sim_physics_min0.08126849741549105
sim_render-ego_max0.012692027296756676
sim_render-ego_mean0.011494242790000506
sim_render-ego_median0.011609188147953578
sim_render-ego_min0.00958498748573097
simulation-passed1
survival_time_max8.899999999999991
survival_time_mean5.549999999999992
survival_time_min2.799999999999998
No reset possible
273734516Robert Moni 🇭🇺almasipaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:12:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.113036502568851
survival_time_median14.950000000000076
deviation-center-line_median0.6597965706278184
in-drivable-lane_median0.8500000000000121


other stats
agent_compute-ego_max0.037629508177439375
agent_compute-ego_mean0.03647401913240844
agent_compute-ego_median0.03686518430709839
agent_compute-ego_min0.03487105667591095
deviation-center-line_max1.305781567918319
deviation-center-line_mean0.6956195891971995
deviation-center-line_min0.1268878936934431
deviation-heading_max3.760180288033381
deviation-heading_mean2.634506016195572
deviation-heading_median3.019110021803392
deviation-heading_min0.7557407612244001
driven_any_max3.009421194231503
driven_any_mean2.392701418029775
driven_any_median2.986966155731575
driven_any_min0.4236092990548779
driven_lanedir_consec_max2.6783002923773664
driven_lanedir_consec_mean1.9083026617593477
driven_lanedir_consec_min0.3926982860869144
driven_lanedir_max2.6783002923773664
driven_lanedir_mean1.9083026617593477
driven_lanedir_median2.113036502568851
driven_lanedir_min0.3926982860869144
in-drivable-lane_max4.350000000000028
in-drivable-lane_mean1.8500000000000143
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.009421194231503, "sim_physics": 0.10390866200129192, "survival_time": 14.950000000000076, "driven_lanedir": 2.113036502568851, "sim_render-ego": 0.01192756493886312, "in-drivable-lane": 4.000000000000032, "agent_compute-ego": 0.037629508177439375, "deviation-heading": 2.0581660177610375, "set_robot_commands": 0.009589136441548666, "deviation-center-line": 1.305781567918319, "driven_lanedir_consec": 2.113036502568851, "sim_compute_sim_state": 0.005205271244049073, "sim_compute_performance-ego": 0.007635788122812907, "sim_compute_robot_state-ego": 0.008999102115631104}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.991607889034438, "sim_physics": 0.096813174088796, "survival_time": 14.950000000000076, "driven_lanedir": 2.6783002923773664, "sim_render-ego": 0.011942721207936604, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.03686518430709839, "deviation-heading": 3.5793329921556496, "set_robot_commands": 0.009252878030141194, "deviation-center-line": 0.6472433325622348, "driven_lanedir_consec": 2.6783002923773664, "sim_compute_sim_state": 0.005054977734883627, "sim_compute_performance-ego": 0.00713191827138265, "sim_compute_robot_state-ego": 0.008884967962900798}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.986966155731575, "sim_physics": 0.09715309460957844, "survival_time": 14.950000000000076, "driven_lanedir": 1.9719816393891825, "sim_render-ego": 0.012100334962209063, "in-drivable-lane": 4.350000000000028, "agent_compute-ego": 0.03687805732091268, "deviation-heading": 3.019110021803392, "set_robot_commands": 0.009136832555135092, "deviation-center-line": 0.7383885811841826, "driven_lanedir_consec": 1.9719816393891825, "sim_compute_sim_state": 0.005149774551391602, "sim_compute_performance-ego": 0.0075472497940063474, "sim_compute_robot_state-ego": 0.008990087509155274}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.551902552096481, "sim_physics": 0.10309190563127106, "survival_time": 12.750000000000046, "driven_lanedir": 2.385496588374425, "sim_render-ego": 0.011812580333036535, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.036126289180680816, "deviation-heading": 3.760180288033381, "set_robot_commands": 0.009154542287190755, "deviation-center-line": 0.6597965706278184, "driven_lanedir_consec": 2.385496588374425, "sim_compute_sim_state": 0.005226551317701153, "sim_compute_performance-ego": 0.007262253293804094, "sim_compute_robot_state-ego": 0.009186946644502527}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4236092990548779, "sim_physics": 0.10742778082688648, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3926982860869144, "sim_render-ego": 0.011713768045107525, "in-drivable-lane": 0, "agent_compute-ego": 0.03487105667591095, "deviation-heading": 0.7557407612244001, "set_robot_commands": 0.008612950642903646, "deviation-center-line": 0.1268878936934431, "driven_lanedir_consec": 0.3926982860869144, "sim_compute_sim_state": 0.004632929960886638, "sim_compute_performance-ego": 0.006682539979616801, "sim_compute_robot_state-ego": 0.008554364244143168}}
set_robot_commands_max0.009589136441548666
set_robot_commands_mean0.00914926799138387
set_robot_commands_median0.009154542287190755
set_robot_commands_min0.008612950642903646
sim_compute_performance-ego_max0.007635788122812907
sim_compute_performance-ego_mean0.00725194989232456
sim_compute_performance-ego_median0.007262253293804094
sim_compute_performance-ego_min0.006682539979616801
sim_compute_robot_state-ego_max0.009186946644502527
sim_compute_robot_state-ego_mean0.008923093695266573
sim_compute_robot_state-ego_median0.008990087509155274
sim_compute_robot_state-ego_min0.008554364244143168
sim_compute_sim_state_max0.005226551317701153
sim_compute_sim_state_mean0.0050539009617824185
sim_compute_sim_state_median0.005149774551391602
sim_compute_sim_state_min0.004632929960886638
sim_physics_max0.10742778082688648
sim_physics_mean0.1016789234315648
sim_physics_median0.10309190563127106
sim_physics_min0.096813174088796
sim_render-ego_max0.012100334962209063
sim_render-ego_mean0.01189939389743057
sim_render-ego_median0.01192756493886312
sim_render-ego_min0.011713768045107525
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.000000000000057
survival_time_min2.3999999999999995
No reset possible
273714576Abderrahim Khalifa 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-46-148-104920:00:10
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling evaluator      ... 
stderr | Pulling simulator      ... done
stderr | 
stderr | ERROR: for solution  manifest for ai404/aido-submissions:2019_11_27_00_01_45 not found
stderr | manifest for ai404/aido-submissions:2019_11_27_00_01_45 not found
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
273284557Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|Andrew_Actaido3-LF-sim-validationstep1-simulationabortedyesip-172-31-46-148-104920:13:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272864602Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8395213403420014
survival_time_median2.25
deviation-center-line_median0.1587540743957801
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.06388344764709472
agent_compute-ego_mean0.04002982257105078
agent_compute-ego_median0.03688980893390935
agent_compute-ego_min0.028338863736107237
deviation-center-line_max0.4412515472559679
deviation-center-line_mean0.18880057851781343
deviation-center-line_min0.040337282570416993
deviation-heading_max1.1502303391598672
deviation-heading_mean0.7224726620424053
deviation-heading_median0.7774541602603647
deviation-heading_min0.29618236046788937
driven_any_max3.1238988371202705
driven_any_mean1.2776684866686754
driven_any_median0.9142679669415038
driven_any_min0.33829605316811356
driven_lanedir_consec_max3.0418140183147067
driven_lanedir_consec_mean1.1769874003732348
driven_lanedir_consec_min0.2804700183868971
driven_lanedir_max3.0418140183147067
driven_lanedir_mean1.1769874003732348
driven_lanedir_median0.8395213403420014
driven_lanedir_min0.2804700183868971
in-drivable-lane_max0.34999999999999876
in-drivable-lane_mean0.08999999999999972
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1438953463295796, "sim_physics": 0.08441981722096928, "survival_time": 3.049999999999997, "driven_lanedir": 0.8895307614233483, "sim_render-ego": 0.010322387101220304, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.03203519836800997, "deviation-heading": 1.1502303391598672, "set_robot_commands": 0.00728154182434082, "deviation-center-line": 0.1850117750028389, "driven_lanedir_consec": 0.8895307614233483, "sim_compute_sim_state": 0.004596964257662413, "sim_compute_performance-ego": 0.006136933311087186, "sim_compute_robot_state-ego": 0.007886003275386622}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8679842297839099, "sim_physics": 0.12045160735525735, "survival_time": 2.0500000000000007, "driven_lanedir": 0.8395213403420014, "sim_render-ego": 0.013289980772064952, "in-drivable-lane": 0, "agent_compute-ego": 0.03688980893390935, "deviation-heading": 0.4398860476497006, "set_robot_commands": 0.010239653471039565, "deviation-center-line": 0.11864821336406337, "driven_lanedir_consec": 0.8395213403420014, "sim_compute_sim_state": 0.005387370179339153, "sim_compute_performance-ego": 0.00700903520351503, "sim_compute_robot_state-ego": 0.009361389206676948}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1238988371202705, "sim_physics": 0.09656915218710042, "survival_time": 6.949999999999983, "driven_lanedir": 3.0418140183147067, "sim_render-ego": 0.011015588431049592, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.03900179417013264, "deviation-heading": 0.9486104026742052, "set_robot_commands": 0.008291700761095226, "deviation-center-line": 0.4412515472559679, "driven_lanedir_consec": 3.0418140183147067, "sim_compute_sim_state": 0.005002261923371459, "sim_compute_performance-ego": 0.006629660832796165, "sim_compute_robot_state-ego": 0.009260258228658773}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.33829605316811356, "sim_physics": 0.08573093868437268, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2804700183868971, "sim_render-ego": 0.00952843257359096, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.028338863736107237, "deviation-heading": 0.29618236046788937, "set_robot_commands": 0.00730941409156436, "deviation-center-line": 0.040337282570416993, "driven_lanedir_consec": 0.2804700183868971, "sim_compute_sim_state": 0.003915082840692429, "sim_compute_performance-ego": 0.005902619588942755, "sim_compute_robot_state-ego": 0.007377000082106818}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9142679669415038, "sim_physics": 0.12719476487901477, "survival_time": 2.25, "driven_lanedir": 0.8336008633992207, "sim_render-ego": 0.016755522622002497, "in-drivable-lane": 0, "agent_compute-ego": 0.06388344764709472, "deviation-heading": 0.7774541602603647, "set_robot_commands": 0.011473931206597222, "deviation-center-line": 0.1587540743957801, "driven_lanedir_consec": 0.8336008633992207, "sim_compute_sim_state": 0.005583333969116211, "sim_compute_performance-ego": 0.008551375071207682, "sim_compute_robot_state-ego": 0.01006002426147461}}
set_robot_commands_max0.011473931206597222
set_robot_commands_mean0.008919248270927438
set_robot_commands_median0.008291700761095226
set_robot_commands_min0.00728154182434082
sim_compute_performance-ego_max0.008551375071207682
sim_compute_performance-ego_mean0.006845924801509765
sim_compute_performance-ego_median0.006629660832796165
sim_compute_performance-ego_min0.005902619588942755
sim_compute_robot_state-ego_max0.01006002426147461
sim_compute_robot_state-ego_mean0.008788935010860754
sim_compute_robot_state-ego_median0.009260258228658773
sim_compute_robot_state-ego_min0.007377000082106818
sim_compute_sim_state_max0.005583333969116211
sim_compute_sim_state_mean0.004897002634036333
sim_compute_sim_state_median0.005002261923371459
sim_compute_sim_state_min0.003915082840692429
sim_physics_max0.12719476487901477
sim_physics_mean0.10287325606534292
sim_physics_median0.09656915218710042
sim_physics_min0.08441981722096928
sim_render-ego_max0.016755522622002497
sim_render-ego_mean0.012182382299985662
sim_render-ego_median0.011015588431049592
sim_render-ego_min0.00952843257359096
simulation-passed1
survival_time_max6.949999999999983
survival_time_mean3.0699999999999963
survival_time_min1.0500000000000005
No reset possible
272614616Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-46-148-104920:03:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 13 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272544622César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:00:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272494627César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272424629César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-46-148-104920:00:28
Error while running [...]

stderr | Pulling scenario_maker ... 
stderr | Pulling simulator      ... 
stderr | Pulling solution       ... 
stderr | Pulling evaluator      ... error
stderr | 
stderr | ERROR: for evaluator  received unexpected HTTP status: 500 Internal Server Error
stderr | received unexpected HTTP status: 500 Internal Server Error
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272114655Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:09:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8254229586729855
survival_time_median11.750000000000032
deviation-center-line_median0.7305043406672928
in-drivable-lane_median1.7000000000000035


other stats
agent_compute-ego_max0.047051979700724285
agent_compute-ego_mean0.0351949562705155
agent_compute-ego_median0.03693724632263184
agent_compute-ego_min0.02215757966041565
deviation-center-line_max1.0948730469654968
deviation-center-line_mean0.6309906877260195
deviation-center-line_min0.0730331098682712
deviation-heading_max3.826046946373106
deviation-heading_mean2.0795349852596376
deviation-heading_median2.6249592066262526
deviation-heading_min0.3003313317727009
driven_any_max5.247024386236346
driven_any_mean3.202473648432563
driven_any_median3.244246460543666
driven_any_min0.4333400113033066
driven_lanedir_consec_max4.716059387628709
driven_lanedir_consec_mean2.1498652573884107
driven_lanedir_consec_min0.4204167360530505
driven_lanedir_max4.716059387628709
driven_lanedir_mean2.8339254936109843
driven_lanedir_median2.9101285614533596
driven_lanedir_min0.4204167360530505
in-drivable-lane_max3.0500000000000185
in-drivable-lane_mean1.6200000000000023
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4333400113033066, "sim_physics": 0.07717323303222656, "survival_time": 1.2000000000000004, "driven_lanedir": 0.4204167360530505, "sim_render-ego": 0.010027984778086344, "in-drivable-lane": 0, "agent_compute-ego": 0.02215757966041565, "deviation-heading": 0.3003313317727009, "set_robot_commands": 0.009430418411890663, "deviation-center-line": 0.0730331098682712, "driven_lanedir_consec": 0.4204167360530505, "sim_compute_sim_state": 0.004480898380279541, "sim_compute_performance-ego": 0.005941311518351237, "sim_compute_robot_state-ego": 0.007081041733423869}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.168821145740443, "sim_physics": 0.11265997886657717, "survival_time": 4.99999999999999, "driven_lanedir": 1.8254229586729855, "sim_render-ego": 0.012374823093414306, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.02767735242843628, "deviation-heading": 0.4685216963039093, "set_robot_commands": 0.01160224199295044, "deviation-center-line": 0.1674602995417341, "driven_lanedir_consec": 1.8254229586729855, "sim_compute_sim_state": 0.005354304313659668, "sim_compute_performance-ego": 0.0077407932281494144, "sim_compute_robot_state-ego": 0.009664387702941894}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.247024386236346, "sim_physics": 0.11808930317560833, "survival_time": 14.950000000000076, "driven_lanedir": 4.716059387628709, "sim_render-ego": 0.012774356206258138, "in-drivable-lane": 2.249999999999994, "agent_compute-ego": 0.03693724632263184, "deviation-heading": 2.6249592066262526, "set_robot_commands": 0.011118175983428956, "deviation-center-line": 1.0948730469654968, "driven_lanedir_consec": 4.716059387628709, "sim_compute_sim_state": 0.005508950551350911, "sim_compute_performance-ego": 0.00761653741200765, "sim_compute_robot_state-ego": 0.009662119547526042}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.244246460543666, "sim_physics": 0.0805006686677324, "survival_time": 11.750000000000032, "driven_lanedir": 2.9101285614533596, "sim_render-ego": 0.010119976895920774, "in-drivable-lane": 1.7000000000000035, "agent_compute-ego": 0.04215062324036943, "deviation-heading": 3.17781574522222, "set_robot_commands": 0.007315995845388859, "deviation-center-line": 0.7305043406672928, "driven_lanedir_consec": 1.348027909422783, "sim_compute_sim_state": 0.004352583783738157, "sim_compute_performance-ego": 0.006084579102536465, "sim_compute_robot_state-ego": 0.007647224182778216}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.918936238339054, "sim_physics": 0.10026764710744222, "survival_time": 14.950000000000076, "driven_lanedir": 4.297599824246815, "sim_render-ego": 0.012075579166412354, "in-drivable-lane": 3.0500000000000185, "agent_compute-ego": 0.047051979700724285, "deviation-heading": 3.826046946373106, "set_robot_commands": 0.009553476174672443, "deviation-center-line": 1.0890826415873027, "driven_lanedir_consec": 2.439399295164525, "sim_compute_sim_state": 0.004961896737416586, "sim_compute_performance-ego": 0.00696649154027303, "sim_compute_robot_state-ego": 0.008888529141743979}}
set_robot_commands_max0.01160224199295044
set_robot_commands_mean0.009804061681666271
set_robot_commands_median0.009553476174672443
set_robot_commands_min0.007315995845388859
sim_compute_performance-ego_max0.0077407932281494144
sim_compute_performance-ego_mean0.00686994256026356
sim_compute_performance-ego_median0.00696649154027303
sim_compute_performance-ego_min0.005941311518351237
sim_compute_robot_state-ego_max0.009664387702941894
sim_compute_robot_state-ego_mean0.0085886604616828
sim_compute_robot_state-ego_median0.008888529141743979
sim_compute_robot_state-ego_min0.007081041733423869
sim_compute_sim_state_max0.005508950551350911
sim_compute_sim_state_mean0.004931726753288973
sim_compute_sim_state_median0.004961896737416586
sim_compute_sim_state_min0.004352583783738157
sim_physics_max0.11808930317560833
sim_physics_mean0.09773816616991736
sim_physics_median0.10026764710744222
sim_physics_min0.07717323303222656
sim_render-ego_max0.012774356206258138
sim_render-ego_mean0.011474544028018384
sim_render-ego_median0.012075579166412354
sim_render-ego_min0.010027984778086344
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.570000000000036
survival_time_min1.2000000000000004
No reset possible
271904672Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8264871290029956
survival_time_median14.950000000000076
deviation-center-line_median0.8252904492570514
in-drivable-lane_median2.6000000000000174


other stats
agent_compute-ego_max0.05545009601683844
agent_compute-ego_mean0.04681956525076003
agent_compute-ego_median0.049012953440348304
agent_compute-ego_min0.032180504004160566
deviation-center-line_max1.1580804072022175
deviation-center-line_mean0.7290506472612294
deviation-center-line_min0.27366947610100306
deviation-heading_max4.442215991429434
deviation-heading_mean2.418998950386563
deviation-heading_median2.5702186766609025
deviation-heading_min0.7751821830867419
driven_any_max4.987139380542215
driven_any_mean2.9694364236239457
driven_any_median3.0589340677757337
driven_any_min1.3343027912888117
driven_lanedir_consec_max4.35806254117464
driven_lanedir_consec_mean2.2991501628725137
driven_lanedir_consec_min1.2819548388160042
driven_lanedir_max4.35806254117464
driven_lanedir_mean2.603615630778436
driven_lanedir_median2.6132325218496293
driven_lanedir_min1.2819548388160042
in-drivable-lane_max3.04999999999999
in-drivable-lane_mean1.7300000000000009
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0589340677757337, "sim_physics": 0.1116090186436971, "survival_time": 14.950000000000076, "driven_lanedir": 2.6132325218496293, "sim_render-ego": 0.012702519098917644, "in-drivable-lane": 2.6000000000000174, "agent_compute-ego": 0.032180504004160566, "deviation-heading": 3.3269089245411188, "set_robot_commands": 0.01186262845993042, "deviation-center-line": 1.1580804072022175, "driven_lanedir_consec": 2.6132325218496293, "sim_compute_sim_state": 0.005871952374776205, "sim_compute_performance-ego": 0.0079459015528361, "sim_compute_robot_state-ego": 0.009459375540415446}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4525145412925309, "sim_physics": 0.11879703544435048, "survival_time": 4.199999999999993, "driven_lanedir": 1.4160137835193016, "sim_render-ego": 0.01332250095549084, "in-drivable-lane": 0, "agent_compute-ego": 0.05545009601683844, "deviation-heading": 0.7751821830867419, "set_robot_commands": 0.01075510751633417, "deviation-center-line": 0.31005294936872163, "driven_lanedir_consec": 1.4160137835193016, "sim_compute_sim_state": 0.005614354496910458, "sim_compute_performance-ego": 0.00802238214583624, "sim_compute_robot_state-ego": 0.010131478309631348}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.987139380542215, "sim_physics": 0.12707425038019815, "survival_time": 14.950000000000076, "driven_lanedir": 4.35806254117464, "sim_render-ego": 0.013838016986846923, "in-drivable-lane": 3.04999999999999, "agent_compute-ego": 0.049037346045176185, "deviation-heading": 2.5702186766609025, "set_robot_commands": 0.011289931933085124, "deviation-center-line": 1.0781599543771536, "driven_lanedir_consec": 4.35806254117464, "sim_compute_sim_state": 0.005521953105926514, "sim_compute_performance-ego": 0.007940957546234131, "sim_compute_robot_state-ego": 0.010529454549153643}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.014291337220436, "sim_physics": 0.10669187307357789, "survival_time": 14.950000000000076, "driven_lanedir": 3.3488144685326073, "sim_render-ego": 0.01232383092244466, "in-drivable-lane": 2.9999999999999964, "agent_compute-ego": 0.049012953440348304, "deviation-heading": 4.442215991429434, "set_robot_commands": 0.009960546493530271, "deviation-center-line": 0.8252904492570514, "driven_lanedir_consec": 1.8264871290029956, "sim_compute_sim_state": 0.005293128490447998, "sim_compute_performance-ego": 0.007222280502319336, "sim_compute_robot_state-ego": 0.00910548448562622}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3343027912888117, "sim_physics": 0.12149954125994727, "survival_time": 4.199999999999993, "driven_lanedir": 1.2819548388160042, "sim_render-ego": 0.012807091077168785, "in-drivable-lane": 0, "agent_compute-ego": 0.04841692674727667, "deviation-heading": 0.980468976214616, "set_robot_commands": 0.010895513352893647, "deviation-center-line": 0.27366947610100306, "driven_lanedir_consec": 1.2819548388160042, "sim_compute_sim_state": 0.005054786091759091, "sim_compute_performance-ego": 0.007485753013974144, "sim_compute_robot_state-ego": 0.009621966452825636}}
set_robot_commands_max0.01186262845993042
set_robot_commands_mean0.010952745551154728
set_robot_commands_median0.010895513352893647
set_robot_commands_min0.009960546493530271
sim_compute_performance-ego_max0.00802238214583624
sim_compute_performance-ego_mean0.007723454952239991
sim_compute_performance-ego_median0.007940957546234131
sim_compute_performance-ego_min0.007222280502319336
sim_compute_robot_state-ego_max0.010529454549153643
sim_compute_robot_state-ego_mean0.00976955186753046
sim_compute_robot_state-ego_median0.009621966452825636
sim_compute_robot_state-ego_min0.00910548448562622
sim_compute_sim_state_max0.005871952374776205
sim_compute_sim_state_mean0.005471234911964053
sim_compute_sim_state_median0.005521953105926514
sim_compute_sim_state_min0.005054786091759091
sim_physics_max0.12707425038019815
sim_physics_mean0.11713434376035416
sim_physics_median0.11879703544435048
sim_physics_min0.10669187307357789
sim_render-ego_max0.013838016986846923
sim_render-ego_mean0.01299879180817377
sim_render-ego_median0.012807091077168785
sim_render-ego_min0.01232383092244466
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.650000000000045
survival_time_min4.199999999999993
No reset possible
271424709Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:13:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.595092136706368
survival_time_median14.950000000000076
deviation-center-line_median0.909150501351795
in-drivable-lane_median0


other stats
agent_compute-ego_max0.030402812163035076
agent_compute-ego_mean0.026884836196899416
agent_compute-ego_median0.02656628211339315
agent_compute-ego_min0.024660292466481527
deviation-center-line_max1.2560449067979045
deviation-center-line_mean0.971665867448966
deviation-center-line_min0.8325807810704505
deviation-heading_max4.175183992030466
deviation-heading_mean3.481486390555633
deviation-heading_median3.5525139668959076
deviation-heading_min2.933927597425719
driven_any_max5.224341965559798
driven_any_mean4.617871752912315
driven_any_median4.707780514302181
driven_any_min3.910394324608256
driven_lanedir_consec_max5.063659316275378
driven_lanedir_consec_mean4.249152715524356
driven_lanedir_consec_min3.385154303875475
driven_lanedir_max5.063659316275378
driven_lanedir_mean4.249152715524356
driven_lanedir_median4.595092136706368
driven_lanedir_min3.385154303875475
in-drivable-lane_max2.3000000000000087
in-drivable-lane_mean0.7800000000000056
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.910394324608256, "sim_physics": 0.12184271335601808, "survival_time": 14.950000000000076, "driven_lanedir": 3.385154303875475, "sim_render-ego": 0.01310137907663981, "in-drivable-lane": 1.6000000000000192, "agent_compute-ego": 0.030402812163035076, "deviation-heading": 3.6259471388698783, "set_robot_commands": 0.012189062436421712, "deviation-center-line": 0.9947525169573584, "driven_lanedir_consec": 3.385154303875475, "sim_compute_sim_state": 0.006591885089874267, "sim_compute_performance-ego": 0.008048657576243083, "sim_compute_robot_state-ego": 0.009998935063680011}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.707780514302181, "sim_physics": 0.10976389328638712, "survival_time": 14.950000000000076, "driven_lanedir": 4.608550755196734, "sim_render-ego": 0.012484450340270997, "in-drivable-lane": 0, "agent_compute-ego": 0.02656628211339315, "deviation-heading": 2.933927597425719, "set_robot_commands": 0.011621679464975993, "deviation-center-line": 0.8658006310673216, "driven_lanedir_consec": 4.608550755196734, "sim_compute_sim_state": 0.005818867683410644, "sim_compute_performance-ego": 0.007279934088389079, "sim_compute_robot_state-ego": 0.009121105670928956}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.224341965559798, "sim_physics": 0.10309334516525268, "survival_time": 14.950000000000076, "driven_lanedir": 5.063659316275378, "sim_render-ego": 0.011355497837066651, "in-drivable-lane": 0, "agent_compute-ego": 0.024660292466481527, "deviation-heading": 3.119859257556191, "set_robot_commands": 0.01061072587966919, "deviation-center-line": 1.2560449067979045, "driven_lanedir_consec": 5.063659316275378, "sim_compute_sim_state": 0.0055853978792826334, "sim_compute_performance-ego": 0.006477449735005697, "sim_compute_robot_state-ego": 0.008444666862487793}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.465031423136952, "sim_physics": 0.13281530300776165, "survival_time": 14.950000000000076, "driven_lanedir": 3.593307065567825, "sim_render-ego": 0.013376770814259848, "in-drivable-lane": 2.3000000000000087, "agent_compute-ego": 0.027621129353841145, "deviation-heading": 4.175183992030466, "set_robot_commands": 0.01178912321726481, "deviation-center-line": 0.8325807810704505, "driven_lanedir_consec": 3.593307065567825, "sim_compute_sim_state": 0.005699272950490316, "sim_compute_performance-ego": 0.007546878655751546, "sim_compute_robot_state-ego": 0.00976207733154297}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.781810536954386, "sim_physics": 0.09030192057291668, "survival_time": 14.950000000000076, "driven_lanedir": 4.595092136706368, "sim_render-ego": 0.011139354705810546, "in-drivable-lane": 0, "agent_compute-ego": 0.025173664887746177, "deviation-heading": 3.5525139668959076, "set_robot_commands": 0.010365557670593262, "deviation-center-line": 0.909150501351795, "driven_lanedir_consec": 4.595092136706368, "sim_compute_sim_state": 0.0052086997032165525, "sim_compute_performance-ego": 0.006517674922943115, "sim_compute_robot_state-ego": 0.008060612678527833}}
set_robot_commands_max0.012189062436421712
set_robot_commands_mean0.011315229733784992
set_robot_commands_median0.011621679464975993
set_robot_commands_min0.010365557670593262
sim_compute_performance-ego_max0.008048657576243083
sim_compute_performance-ego_mean0.007174118995666503
sim_compute_performance-ego_median0.007279934088389079
sim_compute_performance-ego_min0.006477449735005697
sim_compute_robot_state-ego_max0.009998935063680011
sim_compute_robot_state-ego_mean0.009077479521433512
sim_compute_robot_state-ego_median0.009121105670928956
sim_compute_robot_state-ego_min0.008060612678527833
sim_compute_sim_state_max0.006591885089874267
sim_compute_sim_state_mean0.005780824661254883
sim_compute_sim_state_median0.005699272950490316
sim_compute_sim_state_min0.0052086997032165525
sim_physics_max0.13281530300776165
sim_physics_mean0.11156343507766724
sim_physics_median0.10976389328638712
sim_physics_min0.09030192057291668
sim_render-ego_max0.013376770814259848
sim_render-ego_mean0.012291490554809572
sim_render-ego_median0.012484450340270997
sim_render-ego_min0.011139354705810546
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
271134734Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:11:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
270874755Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7667409322399896
survival_time_median14.950000000000076
deviation-center-line_median0.8318825446594341
in-drivable-lane_median1.5999999999999943


other stats
agent_compute-ego_max0.05110940138498942
agent_compute-ego_mean0.049052473341066015
agent_compute-ego_median0.04906946537541408
agent_compute-ego_min0.04698776026241115
deviation-center-line_max1.1125606409339863
deviation-center-line_mean0.6580261540455267
deviation-center-line_min0.08371145737377483
deviation-heading_max4.09342014209562
deviation-heading_mean2.487273580678002
deviation-heading_median2.7428652767931214
deviation-heading_min0.5811135929036674
driven_any_max5.415605837090368
driven_any_mean3.421830761497138
driven_any_median4.001368340960156
driven_any_min0.9962358841318542
driven_lanedir_consec_max4.757291952052401
driven_lanedir_consec_mean2.5500172811082047
driven_lanedir_consec_min0.6557686849542506
driven_lanedir_max4.757291952052401
driven_lanedir_mean2.9964890231967045
driven_lanedir_median3.6557808617045024
driven_lanedir_min0.6557686849542506
in-drivable-lane_max3.0999999999999908
in-drivable-lane_mean1.7200000000000046
in-drivable-lane_min0.9499999999999966
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9962358841318542, "sim_physics": 0.12077982699284788, "survival_time": 3.049999999999997, "driven_lanedir": 0.6557686849542506, "sim_render-ego": 0.013031502239039688, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04698776026241115, "deviation-heading": 0.5811135929036674, "set_robot_commands": 0.01131269970878226, "deviation-center-line": 0.08371145737377483, "driven_lanedir_consec": 0.6557686849542506, "sim_compute_sim_state": 0.005303359422527376, "sim_compute_performance-ego": 0.008168243971027311, "sim_compute_robot_state-ego": 0.0096302188810755}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.001368340960156, "sim_physics": 0.11260736465454102, "survival_time": 14.950000000000076, "driven_lanedir": 3.6557808617045024, "sim_render-ego": 0.01287766933441162, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.05110940138498942, "deviation-heading": 4.09342014209562, "set_robot_commands": 0.010859510898590089, "deviation-center-line": 1.1125606409339863, "driven_lanedir_consec": 2.7667409322399896, "sim_compute_sim_state": 0.005448519388834635, "sim_compute_performance-ego": 0.007426173686981201, "sim_compute_robot_state-ego": 0.009757797718048095}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.415605837090368, "sim_physics": 0.11447834968566896, "survival_time": 14.950000000000076, "driven_lanedir": 4.757291952052401, "sim_render-ego": 0.013158443768819174, "in-drivable-lane": 3.0999999999999908, "agent_compute-ego": 0.04889357089996338, "deviation-heading": 2.7428652767931214, "set_robot_commands": 0.010801923274993895, "deviation-center-line": 0.9820424660147652, "driven_lanedir_consec": 4.757291952052401, "sim_compute_sim_state": 0.005396842161814372, "sim_compute_performance-ego": 0.007803481419881185, "sim_compute_robot_state-ego": 0.009917085965474446}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6101370981465684, "sim_physics": 0.13351353243285535, "survival_time": 5.09999999999999, "driven_lanedir": 1.2828113252728994, "sim_render-ego": 0.014182153870077692, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.04906946537541408, "deviation-heading": 0.9634218855529346, "set_robot_commands": 0.01145617634642358, "deviation-center-line": 0.27993366124567276, "driven_lanedir_consec": 1.2827366423606117, "sim_compute_sim_state": 0.005802369585224227, "sim_compute_performance-ego": 0.007886652852974687, "sim_compute_robot_state-ego": 0.009715769805160224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.085806647156741, "sim_physics": 0.11423784573872885, "survival_time": 14.950000000000076, "driven_lanedir": 4.63079229199947, "sim_render-ego": 0.01268361488978068, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.04920216878255208, "deviation-heading": 4.055547006044672, "set_robot_commands": 0.010072252750396728, "deviation-center-line": 0.8318825446594341, "driven_lanedir_consec": 3.287548193933769, "sim_compute_sim_state": 0.005157903830210368, "sim_compute_performance-ego": 0.007536627451578776, "sim_compute_robot_state-ego": 0.009630502065022788}}
set_robot_commands_max0.01145617634642358
set_robot_commands_mean0.01090051259583731
set_robot_commands_median0.010859510898590089
set_robot_commands_min0.010072252750396728
sim_compute_performance-ego_max0.008168243971027311
sim_compute_performance-ego_mean0.007764235876488631
sim_compute_performance-ego_median0.007803481419881185
sim_compute_performance-ego_min0.007426173686981201
sim_compute_robot_state-ego_max0.009917085965474446
sim_compute_robot_state-ego_mean0.00973027488695621
sim_compute_robot_state-ego_median0.009715769805160224
sim_compute_robot_state-ego_min0.0096302188810755
sim_compute_sim_state_max0.005802369585224227
sim_compute_sim_state_mean0.0054217988777221955
sim_compute_sim_state_median0.005396842161814372
sim_compute_sim_state_min0.005157903830210368
sim_physics_max0.13351353243285535
sim_physics_mean0.1191233839009284
sim_physics_median0.11447834968566896
sim_physics_min0.11260736465454102
sim_render-ego_max0.014182153870077692
sim_render-ego_mean0.013186676820425772
sim_render-ego_median0.013031502239039688
sim_render-ego_min0.01268361488978068
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.600000000000042
survival_time_min3.049999999999997
No reset possible
270744765Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:08:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7028396498153473
survival_time_median6.499999999999985
deviation-center-line_median0.3545922204063042
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04379815568206131
agent_compute-ego_mean0.03622358218628001
agent_compute-ego_median0.03762324412663778
agent_compute-ego_min0.02804642021656036
deviation-center-line_max0.8301700514653735
deviation-center-line_mean0.39257907218274335
deviation-center-line_min0.20056412505879304
deviation-heading_max3.893501301373253
deviation-heading_mean1.5598290265349235
deviation-heading_median1.107137387232689
deviation-heading_min0.35097079942645
driven_any_max3.0302679931595544
driven_any_mean2.0078469434108164
driven_any_median1.7601636496199815
driven_any_min1.0549532564206066
driven_lanedir_consec_max2.344103807377118
driven_lanedir_consec_mean1.746610556084907
driven_lanedir_consec_min1.0473987399614189
driven_lanedir_max2.344103807377118
driven_lanedir_mean1.746610556084907
driven_lanedir_median1.7028396498153473
driven_lanedir_min1.0473987399614189
in-drivable-lane_max3.900000000000035
in-drivable-lane_mean1.0000000000000062
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0302679931595544, "sim_physics": 0.12104452610015869, "survival_time": 14.950000000000076, "driven_lanedir": 2.136760232138952, "sim_render-ego": 0.012766440709431968, "in-drivable-lane": 3.900000000000035, "agent_compute-ego": 0.03762324412663778, "deviation-heading": 3.893501301373253, "set_robot_commands": 0.010234873294830322, "deviation-center-line": 0.8301700514653735, "driven_lanedir_consec": 2.136760232138952, "sim_compute_sim_state": 0.005199530124664307, "sim_compute_performance-ego": 0.007890850702921549, "sim_compute_robot_state-ego": 0.009852142333984374}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0549532564206066, "sim_physics": 0.1077034640730473, "survival_time": 2.849999999999998, "driven_lanedir": 1.0473987399614189, "sim_render-ego": 0.013106183001869604, "in-drivable-lane": 0, "agent_compute-ego": 0.031768414012172765, "deviation-heading": 0.35097079942645, "set_robot_commands": 0.008883145817539148, "deviation-center-line": 0.20056412505879304, "driven_lanedir_consec": 1.0473987399614189, "sim_compute_sim_state": 0.00497092280471534, "sim_compute_performance-ego": 0.007636229197184245, "sim_compute_robot_state-ego": 0.009229693496436405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7601636496199815, "sim_physics": 0.11909975638756386, "survival_time": 6.499999999999985, "driven_lanedir": 1.7028396498153473, "sim_render-ego": 0.013013760860149676, "in-drivable-lane": 0, "agent_compute-ego": 0.03988167689396785, "deviation-heading": 1.107137387232689, "set_robot_commands": 0.010207634705763595, "deviation-center-line": 0.357413655941577, "driven_lanedir_consec": 1.7028396498153473, "sim_compute_sim_state": 0.005275717148414025, "sim_compute_performance-ego": 0.00820922668163593, "sim_compute_robot_state-ego": 0.009847165988041804}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6567774067590495, "sim_physics": 0.1225844608840122, "survival_time": 9.299999999999995, "driven_lanedir": 2.344103807377118, "sim_render-ego": 0.01313935043991253, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.04379815568206131, "deviation-heading": 1.6665138306581355, "set_robot_commands": 0.01071833666934762, "deviation-center-line": 0.3545922204063042, "driven_lanedir_consec": 2.344103807377118, "sim_compute_sim_state": 0.005832719546492382, "sim_compute_performance-ego": 0.008124109237424789, "sim_compute_robot_state-ego": 0.010273161754813246}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.53707241109489, "sim_physics": 0.09419663548469544, "survival_time": 3.999999999999994, "driven_lanedir": 1.5019503511316985, "sim_render-ego": 0.01140897572040558, "in-drivable-lane": 0, "agent_compute-ego": 0.02804642021656036, "deviation-heading": 0.781021813984092, "set_robot_commands": 0.00824870765209198, "deviation-center-line": 0.2201553080416691, "driven_lanedir_consec": 1.5019503511316985, "sim_compute_sim_state": 0.0049249142408370975, "sim_compute_performance-ego": 0.0068225771188735965, "sim_compute_robot_state-ego": 0.00852573812007904}}
set_robot_commands_max0.01071833666934762
set_robot_commands_mean0.009658539627914532
set_robot_commands_median0.010207634705763595
set_robot_commands_min0.00824870765209198
sim_compute_performance-ego_max0.00820922668163593
sim_compute_performance-ego_mean0.007736598587608022
sim_compute_performance-ego_median0.007890850702921549
sim_compute_performance-ego_min0.0068225771188735965
sim_compute_robot_state-ego_max0.010273161754813246
sim_compute_robot_state-ego_mean0.009545580338670976
sim_compute_robot_state-ego_median0.009847165988041804
sim_compute_robot_state-ego_min0.00852573812007904
sim_compute_sim_state_max0.005832719546492382
sim_compute_sim_state_mean0.00524076077302463
sim_compute_sim_state_median0.005199530124664307
sim_compute_sim_state_min0.0049249142408370975
sim_physics_max0.1225844608840122
sim_physics_mean0.1129257685858955
sim_physics_median0.11909975638756386
sim_physics_min0.09419663548469544
sim_render-ego_max0.01313935043991253
sim_render-ego_mean0.012686942146353871
sim_render-ego_median0.013013760860149676
sim_render-ego_min0.01140897572040558
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.52000000000001
survival_time_min2.849999999999998
No reset possible
270474781Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:12:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.445899736162247
survival_time_median14.950000000000076
deviation-center-line_median0.6158077349151498
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.03804584344228109
agent_compute-ego_mean0.03502500343322754
agent_compute-ego_median0.03505132993062337
agent_compute-ego_min0.0323508365948995
deviation-center-line_max0.719209580814589
deviation-center-line_mean0.5546011960850123
deviation-center-line_min0.3255062781697012
deviation-heading_max2.8336997407823272
deviation-heading_mean1.860274531654752
deviation-heading_median2.0148223049723257
deviation-heading_min0.35078036885323527
driven_any_max3.2469319804069676
driven_any_mean2.443979945431682
driven_any_median2.889290365271304
driven_any_min0.9548779178223712
driven_lanedir_consec_max2.96262214792187
driven_lanedir_consec_mean2.264162074789428
driven_lanedir_consec_min0.9505302866974346
driven_lanedir_max2.96262214792187
driven_lanedir_mean2.264162074789428
driven_lanedir_median2.445899736162247
driven_lanedir_min0.9505302866974346
in-drivable-lane_max3.000000000000042
in-drivable-lane_mean0.8900000000000103
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1710090965472055, "sim_physics": 0.12519529263178508, "survival_time": 14.950000000000076, "driven_lanedir": 2.0497636416281786, "sim_render-ego": 0.01268368403116862, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.03804584344228109, "deviation-heading": 2.8336997407823272, "set_robot_commands": 0.010019080638885498, "deviation-center-line": 0.719209580814589, "driven_lanedir_consec": 2.0497636416281786, "sim_compute_sim_state": 0.005220897197723388, "sim_compute_performance-ego": 0.007995202541351318, "sim_compute_robot_state-ego": 0.009650053183237712}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9548779178223712, "sim_physics": 0.13016419092814127, "survival_time": 3.7499999999999942, "driven_lanedir": 0.9505302866974346, "sim_render-ego": 0.014626280466715496, "in-drivable-lane": 0, "agent_compute-ego": 0.03505132993062337, "deviation-heading": 0.35078036885323527, "set_robot_commands": 0.010977369944254555, "deviation-center-line": 0.3255062781697012, "driven_lanedir_consec": 0.9505302866974346, "sim_compute_sim_state": 0.005509821573893229, "sim_compute_performance-ego": 0.008163801829020182, "sim_compute_robot_state-ego": 0.010260435740152994}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9577903671105608, "sim_physics": 0.10982614676157632, "survival_time": 14.950000000000076, "driven_lanedir": 2.911994561537408, "sim_render-ego": 0.01257951577504476, "in-drivable-lane": 0, "agent_compute-ego": 0.03409854173660278, "deviation-heading": 2.0148223049723257, "set_robot_commands": 0.009758319060007733, "deviation-center-line": 0.6953463687550961, "driven_lanedir_consec": 2.911994561537408, "sim_compute_sim_state": 0.005389304161071778, "sim_compute_performance-ego": 0.00743210236231486, "sim_compute_robot_state-ego": 0.009523481527964272}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.2469319804069676, "sim_physics": 0.11614370028177898, "survival_time": 14.950000000000076, "driven_lanedir": 2.96262214792187, "sim_render-ego": 0.01303850809733073, "in-drivable-lane": 1.20000000000001, "agent_compute-ego": 0.035578465461730956, "deviation-heading": 2.464154604533709, "set_robot_commands": 0.010079373518625897, "deviation-center-line": 0.6158077349151498, "driven_lanedir_consec": 2.96262214792187, "sim_compute_sim_state": 0.005473149617513021, "sim_compute_performance-ego": 0.00800835132598877, "sim_compute_robot_state-ego": 0.010209507942199708}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.889290365271304, "sim_physics": 0.1104218586285909, "survival_time": 14.950000000000076, "driven_lanedir": 2.445899736162247, "sim_render-ego": 0.012438418865203858, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.0323508365948995, "deviation-heading": 1.637915639132162, "set_robot_commands": 0.00946737289428711, "deviation-center-line": 0.4171360177705254, "driven_lanedir_consec": 2.445899736162247, "sim_compute_sim_state": 0.0048972900708516435, "sim_compute_performance-ego": 0.007211391925811768, "sim_compute_robot_state-ego": 0.009064696629842122}}
set_robot_commands_max0.010977369944254555
set_robot_commands_mean0.010060303211212158
set_robot_commands_median0.010019080638885498
set_robot_commands_min0.00946737289428711
sim_compute_performance-ego_max0.008163801829020182
sim_compute_performance-ego_mean0.007762169996897379
sim_compute_performance-ego_median0.007995202541351318
sim_compute_performance-ego_min0.007211391925811768
sim_compute_robot_state-ego_max0.010260435740152994
sim_compute_robot_state-ego_mean0.00974163500467936
sim_compute_robot_state-ego_median0.009650053183237712
sim_compute_robot_state-ego_min0.009064696629842122
sim_compute_sim_state_max0.005509821573893229
sim_compute_sim_state_mean0.0052980925242106115
sim_compute_sim_state_median0.005389304161071778
sim_compute_sim_state_min0.0048972900708516435
sim_physics_max0.13016419092814127
sim_physics_mean0.11835023784637452
sim_physics_median0.11614370028177898
sim_physics_min0.10982614676157632
sim_render-ego_max0.014626280466715496
sim_render-ego_mean0.013073281447092692
sim_render-ego_median0.01268368403116862
sim_render-ego_min0.012438418865203858
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.71000000000006
survival_time_min3.7499999999999942
No reset possible
270284798Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6498182615599927
survival_time_median1.950000000000001
deviation-center-line_median0.12845400113201808
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05545488381997133
agent_compute-ego_mean0.04308127508353469
agent_compute-ego_median0.04903039717136469
agent_compute-ego_min0.026380930095911023
deviation-center-line_max0.8790996062473425
deviation-center-line_mean0.4110125453525937
deviation-center-line_min0.08025603417860377
deviation-heading_max3.981820997136519
deviation-heading_mean1.5800326869933643
deviation-heading_median0.3795181359053787
deviation-heading_min0.26405366493377613
driven_any_max4.234183714472475
driven_any_mean1.9762144032117228
driven_any_median0.6595784313737564
driven_any_min0.42454943240054455
driven_lanedir_consec_max2.406435440076134
driven_lanedir_consec_mean1.149786512138474
driven_lanedir_consec_min0.41149451509386514
driven_lanedir_max3.4646557596425462
driven_lanedir_mean1.6045920109124552
driven_lanedir_median0.6498182615599927
driven_lanedir_min0.41149451509386514
in-drivable-lane_max3.850000000000008
in-drivable-lane_mean1.260000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.42454943240054455, "sim_physics": 0.14099671363830563, "survival_time": 1.2500000000000004, "driven_lanedir": 0.41149451509386514, "sim_render-ego": 0.015871496200561525, "in-drivable-lane": 0, "agent_compute-ego": 0.035324602127075194, "deviation-heading": 0.31277791982115555, "set_robot_commands": 0.01296841621398926, "deviation-center-line": 0.08025603417860377, "driven_lanedir_consec": 0.41149451509386514, "sim_compute_sim_state": 0.0058104610443115235, "sim_compute_performance-ego": 0.008327960968017578, "sim_compute_robot_state-ego": 0.010790624618530274}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.07913918783628, "sim_physics": 0.11081225145608188, "survival_time": 12.800000000000049, "driven_lanedir": 3.03146116148922, "sim_render-ego": 0.012712362222373486, "in-drivable-lane": 3.850000000000008, "agent_compute-ego": 0.026380930095911023, "deviation-heading": 2.9619927171699936, "set_robot_commands": 0.011681980453431606, "deviation-center-line": 0.8790845196295685, "driven_lanedir_consec": 1.8156539871857271, "sim_compute_sim_state": 0.0057400306686758995, "sim_compute_performance-ego": 0.007429328747093677, "sim_compute_robot_state-ego": 0.009566139429807665}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4836212499755568, "sim_physics": 0.12617825760560877, "survival_time": 1.7000000000000008, "driven_lanedir": 0.465530356776652, "sim_render-ego": 0.014298691469080308, "in-drivable-lane": 0, "agent_compute-ego": 0.04921556220335119, "deviation-heading": 0.3795181359053787, "set_robot_commands": 0.011272241087520824, "deviation-center-line": 0.12845400113201808, "driven_lanedir_consec": 0.465530356776652, "sim_compute_sim_state": 0.005362700013553395, "sim_compute_performance-ego": 0.007826966397902545, "sim_compute_robot_state-ego": 0.00998074166914996}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6595784313737564, "sim_physics": 0.1357110280257005, "survival_time": 1.950000000000001, "driven_lanedir": 0.6498182615599927, "sim_render-ego": 0.014441337340917343, "in-drivable-lane": 0, "agent_compute-ego": 0.05545488381997133, "deviation-heading": 0.26405366493377613, "set_robot_commands": 0.01189549152667706, "deviation-center-line": 0.08816856557543559, "driven_lanedir_consec": 0.6498182615599927, "sim_compute_sim_state": 0.005772651770176032, "sim_compute_performance-ego": 0.008214632670084635, "sim_compute_robot_state-ego": 0.011214806483342098}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.234183714472475, "sim_physics": 0.1037902007425638, "survival_time": 13.300000000000054, "driven_lanedir": 3.4646557596425462, "sim_render-ego": 0.012526196644718483, "in-drivable-lane": 2.450000000000026, "agent_compute-ego": 0.04903039717136469, "deviation-heading": 3.981820997136519, "set_robot_commands": 0.009756825920334436, "deviation-center-line": 0.8790996062473425, "driven_lanedir_consec": 2.406435440076134, "sim_compute_sim_state": 0.004997987496225457, "sim_compute_performance-ego": 0.007377680979276958, "sim_compute_robot_state-ego": 0.00929305338321772}}
set_robot_commands_max0.01296841621398926
set_robot_commands_mean0.011514991040390636
set_robot_commands_median0.011681980453431606
set_robot_commands_min0.009756825920334436
sim_compute_performance-ego_max0.008327960968017578
sim_compute_performance-ego_mean0.007835313952475078
sim_compute_performance-ego_median0.007826966397902545
sim_compute_performance-ego_min0.007377680979276958
sim_compute_robot_state-ego_max0.011214806483342098
sim_compute_robot_state-ego_mean0.010169073116809542
sim_compute_robot_state-ego_median0.00998074166914996
sim_compute_robot_state-ego_min0.00929305338321772
sim_compute_sim_state_max0.0058104610443115235
sim_compute_sim_state_mean0.005536766198588461
sim_compute_sim_state_median0.0057400306686758995
sim_compute_sim_state_min0.004997987496225457
sim_physics_max0.14099671363830563
sim_physics_mean0.12349769029365214
sim_physics_median0.12617825760560877
sim_physics_min0.1037902007425638
sim_render-ego_max0.015871496200561525
sim_render-ego_mean0.013970016775530229
sim_render-ego_median0.014298691469080308
sim_render-ego_min0.012526196644718483
simulation-passed1
survival_time_max13.300000000000054
survival_time_mean6.200000000000021
survival_time_min1.2500000000000004
No reset possible
270184805Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3978790491137377
survival_time_median2.3499999999999996
deviation-center-line_median0.1586883547843581
in-drivable-lane_median0


other stats
agent_compute-ego_max0.051435687325217506
agent_compute-ego_mean0.043566685931815986
agent_compute-ego_median0.04769925276438395
agent_compute-ego_min0.030739484949314846
deviation-center-line_max0.4245200320546667
deviation-center-line_mean0.2155024371521044
deviation-center-line_min0.1490676459305046
deviation-heading_max0.7367738673701665
deviation-heading_mean0.6143561122977816
deviation-heading_median0.6315451341594664
deviation-heading_min0.43510036249110934
driven_any_max1.5861827213789987
driven_any_mean0.735134859371904
driven_any_median0.4126896392673619
driven_any_min0.28640618699974296
driven_lanedir_consec_max0.9091739287950288
driven_lanedir_consec_mean0.5297728564478729
driven_lanedir_consec_min0.2770791476196546
driven_lanedir_max0.9091739287950288
driven_lanedir_mean0.5297728564478729
driven_lanedir_median0.3978790491137377
driven_lanedir_min0.2770791476196546
in-drivable-lane_max3.1999999999999886
in-drivable-lane_mean0.9099999999999968
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4126896392673619, "sim_physics": 0.1237931657344737, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3978790491137377, "sim_render-ego": 0.01212922562944128, "in-drivable-lane": 0, "agent_compute-ego": 0.030739484949314846, "deviation-heading": 0.6315451341594664, "set_robot_commands": 0.011966776340565782, "deviation-center-line": 0.15391860923814824, "driven_lanedir_consec": 0.3978790491137377, "sim_compute_sim_state": 0.006399093790257231, "sim_compute_performance-ego": 0.007673628786776928, "sim_compute_robot_state-ego": 0.009896988564349236}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.28640618699974296, "sim_physics": 0.13795681560740752, "survival_time": 1.7000000000000008, "driven_lanedir": 0.2770791476196546, "sim_render-ego": 0.014015436172485352, "in-drivable-lane": 0, "agent_compute-ego": 0.03756230718949262, "deviation-heading": 0.43510036249110934, "set_robot_commands": 0.012030243873596191, "deviation-center-line": 0.1586883547843581, "driven_lanedir_consec": 0.2770791476196546, "sim_compute_sim_state": 0.005804784157696892, "sim_compute_performance-ego": 0.00810262034921085, "sim_compute_robot_state-ego": 0.011161453583661248}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9991805846720684, "sim_physics": 0.11507049261354932, "survival_time": 5.09999999999999, "driven_lanedir": 0.694475101481177, "sim_render-ego": 0.013132943826563218, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.04769925276438395, "deviation-heading": 0.7367738673701665, "set_robot_commands": 0.011452464496388155, "deviation-center-line": 0.19131754375284424, "driven_lanedir_consec": 0.694475101481177, "sim_compute_sim_state": 0.00558167579127293, "sim_compute_performance-ego": 0.007675607999165853, "sim_compute_robot_state-ego": 0.010007823214811437}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5861827213789987, "sim_physics": 0.10764506798756274, "survival_time": 7.89999999999998, "driven_lanedir": 0.9091739287950288, "sim_render-ego": 0.013881862918032875, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.05039669743067102, "deviation-heading": 0.5449783618931165, "set_robot_commands": 0.009705222105678124, "deviation-center-line": 0.4245200320546667, "driven_lanedir_consec": 0.9091739287950288, "sim_compute_sim_state": 0.005156025101866903, "sim_compute_performance-ego": 0.007375964635535132, "sim_compute_robot_state-ego": 0.009360550325128097}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3912151645413477, "sim_physics": 0.1347112709825689, "survival_time": 2.2, "driven_lanedir": 0.3702570552297666, "sim_render-ego": 0.014705538749694824, "in-drivable-lane": 0, "agent_compute-ego": 0.051435687325217506, "deviation-heading": 0.723382835575049, "set_robot_commands": 0.010949167338284578, "deviation-center-line": 0.1490676459305046, "driven_lanedir_consec": 0.3702570552297666, "sim_compute_sim_state": 0.006044962189414285, "sim_compute_performance-ego": 0.008132414384321733, "sim_compute_robot_state-ego": 0.010435830463062632}}
set_robot_commands_max0.012030243873596191
set_robot_commands_mean0.011220774830902568
set_robot_commands_median0.011452464496388155
set_robot_commands_min0.009705222105678124
sim_compute_performance-ego_max0.008132414384321733
sim_compute_performance-ego_mean0.007792047231002098
sim_compute_performance-ego_median0.007675607999165853
sim_compute_performance-ego_min0.007375964635535132
sim_compute_robot_state-ego_max0.011161453583661248
sim_compute_robot_state-ego_mean0.010172529230202532
sim_compute_robot_state-ego_median0.010007823214811437
sim_compute_robot_state-ego_min0.009360550325128097
sim_compute_sim_state_max0.006399093790257231
sim_compute_sim_state_mean0.005797308206101648
sim_compute_sim_state_median0.005804784157696892
sim_compute_sim_state_min0.005156025101866903
sim_physics_max0.13795681560740752
sim_physics_mean0.12383536258511244
sim_physics_median0.1237931657344737
sim_physics_min0.10764506798756274
sim_render-ego_max0.014705538749694824
sim_render-ego_mean0.01357300145924351
sim_render-ego_median0.013881862918032875
sim_render-ego_min0.01212922562944128
simulation-passed1
survival_time_max7.89999999999998
survival_time_mean3.8499999999999943
survival_time_min1.7000000000000008
No reset possible
269854834Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-46-148-104920:11:14
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
269684844Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8466534715617928
survival_time_median4.699999999999991
deviation-center-line_median0.26281622004732386
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03819591522216797
agent_compute-ego_mean0.03435061788826381
agent_compute-ego_median0.03605301836703686
agent_compute-ego_min0.027820228735605877
deviation-center-line_max0.7751236927588447
deviation-center-line_mean0.30213691262390274
deviation-center-line_min0.06296071748925121
deviation-heading_max3.1872235860278972
deviation-heading_mean1.1035131147025807
deviation-heading_median0.5840654033543656
deviation-heading_min0.28337077283594475
driven_any_max3.7955538640537103
driven_any_mean1.456705814415488
driven_any_median1.040671299116811
driven_any_min0.4014214637882988
driven_lanedir_consec_max3.27014370900425
driven_lanedir_consec_mean1.295632516775252
driven_lanedir_consec_min0.38375620170508906
driven_lanedir_max3.27014370900425
driven_lanedir_mean1.295632516775252
driven_lanedir_median0.8466534715617928
driven_lanedir_min0.38375620170508906
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean0.7300000000000052
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.206775266350252, "sim_physics": 0.10214848267404655, "survival_time": 5.699999999999988, "driven_lanedir": 1.1599612135720951, "sim_render-ego": 0.011937536691364489, "in-drivable-lane": 0, "agent_compute-ego": 0.032463646771615014, "deviation-heading": 1.052889818381654, "set_robot_commands": 0.008945274771305552, "deviation-center-line": 0.26281622004732386, "driven_lanedir_consec": 1.1599612135720951, "sim_compute_sim_state": 0.004817849711367958, "sim_compute_performance-ego": 0.007322932544507478, "sim_compute_robot_state-ego": 0.008773609211570338}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8391071787683688, "sim_physics": 0.11354349880683712, "survival_time": 2.0500000000000007, "driven_lanedir": 0.8176479880330338, "sim_render-ego": 0.01248679509977015, "in-drivable-lane": 0, "agent_compute-ego": 0.037220280344893296, "deviation-heading": 0.4100159929130428, "set_robot_commands": 0.008762615482981613, "deviation-center-line": 0.1015577784609178, "driven_lanedir_consec": 0.8176479880330338, "sim_compute_sim_state": 0.004927443294990353, "sim_compute_performance-ego": 0.006823906084386314, "sim_compute_robot_state-ego": 0.008592745152915396}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.040671299116811, "sim_physics": 0.1144255171430872, "survival_time": 4.699999999999991, "driven_lanedir": 0.8466534715617928, "sim_render-ego": 0.01244076262129114, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.03605301836703686, "deviation-heading": 0.5840654033543656, "set_robot_commands": 0.010360613782355126, "deviation-center-line": 0.30822615436317585, "driven_lanedir_consec": 0.8466534715617928, "sim_compute_sim_state": 0.005796214367480988, "sim_compute_performance-ego": 0.007767821880097085, "sim_compute_robot_state-ego": 0.009779093113351376}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4014214637882988, "sim_physics": 0.1403889274597168, "survival_time": 1.2500000000000004, "driven_lanedir": 0.38375620170508906, "sim_render-ego": 0.012210521697998048, "in-drivable-lane": 0, "agent_compute-ego": 0.03819591522216797, "deviation-heading": 0.28337077283594475, "set_robot_commands": 0.010309791564941408, "deviation-center-line": 0.06296071748925121, "driven_lanedir_consec": 0.38375620170508906, "sim_compute_sim_state": 0.005344247817993164, "sim_compute_performance-ego": 0.0071685791015625, "sim_compute_robot_state-ego": 0.010114850997924803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.7955538640537103, "sim_physics": 0.08161580562591553, "survival_time": 14.950000000000076, "driven_lanedir": 3.27014370900425, "sim_render-ego": 0.009594338734944662, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.027820228735605877, "deviation-heading": 3.1872235860278972, "set_robot_commands": 0.007242244879404704, "deviation-center-line": 0.7751236927588447, "driven_lanedir_consec": 3.27014370900425, "sim_compute_sim_state": 0.004039537111918131, "sim_compute_performance-ego": 0.005779662926991781, "sim_compute_robot_state-ego": 0.007179867426554362}}
set_robot_commands_max0.010360613782355126
set_robot_commands_mean0.00912410809619768
set_robot_commands_median0.008945274771305552
set_robot_commands_min0.007242244879404704
sim_compute_performance-ego_max0.007767821880097085
sim_compute_performance-ego_mean0.006972580507509032
sim_compute_performance-ego_median0.0071685791015625
sim_compute_performance-ego_min0.005779662926991781
sim_compute_robot_state-ego_max0.010114850997924803
sim_compute_robot_state-ego_mean0.008888033180463255
sim_compute_robot_state-ego_median0.008773609211570338
sim_compute_robot_state-ego_min0.007179867426554362
sim_compute_sim_state_max0.005796214367480988
sim_compute_sim_state_mean0.004985058460750119
sim_compute_sim_state_median0.004927443294990353
sim_compute_sim_state_min0.004039537111918131
sim_physics_max0.1403889274597168
sim_physics_mean0.11042444634192064
sim_physics_median0.11354349880683712
sim_physics_min0.08161580562591553
sim_render-ego_max0.01248679509977015
sim_render-ego_mean0.011733990969073698
sim_render-ego_median0.012210521697998048
sim_render-ego_min0.009594338734944662
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.730000000000011
survival_time_min1.2500000000000004
No reset possible
269534854Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:07:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.163884672240677
survival_time_median6.799999999999984
deviation-center-line_median0.3941806941821665
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.03502780766714187
agent_compute-ego_mean0.03105180562128575
agent_compute-ego_median0.030352248520147604
agent_compute-ego_min0.02682731081457699
deviation-center-line_max0.6248065979484739
deviation-center-line_mean0.35471989203823295
deviation-center-line_min0.15119945118918263
deviation-heading_max3.989266822836264
deviation-heading_mean1.7610878809132535
deviation-heading_median1.7857250466153578
deviation-heading_min0.4616948298535891
driven_any_max3.449979897387751
driven_any_mean1.9102924041289784
driven_any_median1.7152778887032265
driven_any_min0.9416554296333092
driven_lanedir_consec_max2.8857429944839827
driven_lanedir_consec_mean1.503644023060965
driven_lanedir_consec_min0.7136283807507002
driven_lanedir_max2.8857429944839827
driven_lanedir_mean1.503644023060965
driven_lanedir_median1.163884672240677
driven_lanedir_min0.7136283807507002
in-drivable-lane_max2.10000000000003
in-drivable-lane_mean1.3500000000000028
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.7152778887032265, "sim_physics": 0.07881456788848429, "survival_time": 6.799999999999984, "driven_lanedir": 1.003010742478946, "sim_render-ego": 0.0097751284346861, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.02682731081457699, "deviation-heading": 1.7857250466153578, "set_robot_commands": 0.007328327964333927, "deviation-center-line": 0.3941806941821665, "driven_lanedir_consec": 1.003010742478946, "sim_compute_sim_state": 0.003943569519940545, "sim_compute_performance-ego": 0.006095470751033109, "sim_compute_robot_state-ego": 0.007229061687693876}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.17779822165494, "sim_physics": 0.09887411946155986, "survival_time": 3.049999999999997, "driven_lanedir": 1.163884672240677, "sim_render-ego": 0.01212975236236072, "in-drivable-lane": 0, "agent_compute-ego": 0.030352248520147604, "deviation-heading": 0.4616948298535891, "set_robot_commands": 0.009901234360991933, "deviation-center-line": 0.19401573739435188, "driven_lanedir_consec": 1.163884672240677, "sim_compute_sim_state": 0.005008017430539991, "sim_compute_performance-ego": 0.0070786554305279845, "sim_compute_robot_state-ego": 0.009107832048760086}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9416554296333092, "sim_physics": 0.11020277227674212, "survival_time": 4.199999999999993, "driven_lanedir": 0.7136283807507002, "sim_render-ego": 0.012547336873554048, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.03502780766714187, "deviation-heading": 0.7656141100968016, "set_robot_commands": 0.009818386463891892, "deviation-center-line": 0.15119945118918263, "driven_lanedir_consec": 0.7136283807507002, "sim_compute_sim_state": 0.005565685885293143, "sim_compute_performance-ego": 0.007438546135312035, "sim_compute_robot_state-ego": 0.00929951100122361}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.266750583265665, "sim_physics": 0.12605319540184665, "survival_time": 8.299999999999983, "driven_lanedir": 1.7519533253505166, "sim_render-ego": 0.011996853782469967, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.03300605480929455, "deviation-heading": 1.803138595164255, "set_robot_commands": 0.009297536080142102, "deviation-center-line": 0.4093969794769896, "driven_lanedir_consec": 1.7519533253505166, "sim_compute_sim_state": 0.005091470408152385, "sim_compute_performance-ego": 0.007003211113343756, "sim_compute_robot_state-ego": 0.009391873715871787}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.449979897387751, "sim_physics": 0.09117347955703736, "survival_time": 14.950000000000076, "driven_lanedir": 2.8857429944839827, "sim_render-ego": 0.01097727139790853, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.03004560629526774, "deviation-heading": 3.989266822836264, "set_robot_commands": 0.008087000846862792, "deviation-center-line": 0.6248065979484739, "driven_lanedir_consec": 2.8857429944839827, "sim_compute_sim_state": 0.004391441345214844, "sim_compute_performance-ego": 0.006544020175933838, "sim_compute_robot_state-ego": 0.007995572090148926}}
set_robot_commands_max0.009901234360991933
set_robot_commands_mean0.00888649714324453
set_robot_commands_median0.009297536080142102
set_robot_commands_min0.007328327964333927
sim_compute_performance-ego_max0.007438546135312035
sim_compute_performance-ego_mean0.006831980721230145
sim_compute_performance-ego_median0.007003211113343756
sim_compute_performance-ego_min0.006095470751033109
sim_compute_robot_state-ego_max0.009391873715871787
sim_compute_robot_state-ego_mean0.008604770108739657
sim_compute_robot_state-ego_median0.009107832048760086
sim_compute_robot_state-ego_min0.007229061687693876
sim_compute_sim_state_max0.005565685885293143
sim_compute_sim_state_mean0.004800036917828182
sim_compute_sim_state_median0.005008017430539991
sim_compute_sim_state_min0.003943569519940545
sim_physics_max0.12605319540184665
sim_physics_mean0.10102362691713404
sim_physics_median0.09887411946155986
sim_physics_min0.07881456788848429
sim_render-ego_max0.012547336873554048
sim_render-ego_mean0.011485268570195871
sim_render-ego_median0.011996853782469967
sim_render-ego_min0.0097751284346861
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.460000000000006
survival_time_min3.049999999999997
No reset possible
269394866Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8029711402424475
survival_time_median8.499999999999986
deviation-center-line_median0.46638149983231125
in-drivable-lane_median1.0000000000000142


other stats
agent_compute-ego_max0.02744009278037331
agent_compute-ego_mean0.023227236114707065
agent_compute-ego_median0.023204670078428833
agent_compute-ego_min0.019414362999109123
deviation-center-line_max1.1306414193279746
deviation-center-line_mean0.5713982330968987
deviation-center-line_min0.18416564857910928
deviation-heading_max4.0699978803335
deviation-heading_mean2.317499888110921
deviation-heading_median2.499807236549077
deviation-heading_min0.8575808874130258
driven_any_max4.422881520606586
driven_any_mean2.2337323545338768
driven_any_median2.2770137305905656
driven_any_min1.0178000883695892
driven_lanedir_consec_max3.8834476911454137
driven_lanedir_consec_mean1.9165657437736383
driven_lanedir_consec_min0.6552359917551721
driven_lanedir_max3.8834476911454137
driven_lanedir_mean1.9165657437736383
driven_lanedir_median1.8029711402424475
driven_lanedir_min0.6552359917551721
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean0.9800000000000024
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0178000883695892, "sim_physics": 0.05455178939379179, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6552359917551721, "sim_render-ego": 0.006963768830666175, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.019414362999109123, "deviation-heading": 0.8575808874130258, "set_robot_commands": 0.004967189752138578, "deviation-center-line": 0.27634669207628415, "driven_lanedir_consec": 0.6552359917551721, "sim_compute_sim_state": 0.002767989268669715, "sim_compute_performance-ego": 0.0041815409293541545, "sim_compute_robot_state-ego": 0.004981536131638747}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2770137305905656, "sim_physics": 0.059612218071432674, "survival_time": 8.499999999999986, "driven_lanedir": 1.8029711402424475, "sim_render-ego": 0.00767671641181497, "in-drivable-lane": 1.8000000000000016, "agent_compute-ego": 0.0220382900799022, "deviation-heading": 2.499807236549077, "set_robot_commands": 0.005876787971047794, "deviation-center-line": 0.46638149983231125, "driven_lanedir_consec": 1.8029711402424475, "sim_compute_sim_state": 0.00311585594626034, "sim_compute_performance-ego": 0.004300312434925752, "sim_compute_robot_state-ego": 0.0055286169052124025}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.418816879801837, "sim_physics": 0.06979493737745915, "survival_time": 11.350000000000026, "driven_lanedir": 2.275960600640762, "sim_render-ego": 0.008788465928401192, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.023204670078428833, "deviation-heading": 3.109113255748206, "set_robot_commands": 0.00641871338898915, "deviation-center-line": 0.7994559056688147, "driven_lanedir_consec": 2.275960600640762, "sim_compute_sim_state": 0.0035793067075082386, "sim_compute_performance-ego": 0.00497445661065862, "sim_compute_robot_state-ego": 0.006344859295479527}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0321495533008056, "sim_physics": 0.09145505139321992, "survival_time": 3.2999999999999963, "driven_lanedir": 0.965213295084398, "sim_render-ego": 0.010533480933218292, "in-drivable-lane": 0, "agent_compute-ego": 0.02744009278037331, "deviation-heading": 1.0510001805107976, "set_robot_commands": 0.007883129697857481, "deviation-center-line": 0.18416564857910928, "driven_lanedir_consec": 0.965213295084398, "sim_compute_sim_state": 0.004190997643904252, "sim_compute_performance-ego": 0.006211049628980232, "sim_compute_robot_state-ego": 0.007513002915815873}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.422881520606586, "sim_physics": 0.07486432711283365, "survival_time": 14.950000000000076, "driven_lanedir": 3.8834476911454137, "sim_render-ego": 0.009456814924875896, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.024038764635721844, "deviation-heading": 4.0699978803335, "set_robot_commands": 0.006612287362416585, "deviation-center-line": 1.1306414193279746, "driven_lanedir_consec": 3.8834476911454137, "sim_compute_sim_state": 0.00400087038675944, "sim_compute_performance-ego": 0.005373315016428629, "sim_compute_robot_state-ego": 0.00693859338760376}}
set_robot_commands_max0.007883129697857481
set_robot_commands_mean0.006351621634489918
set_robot_commands_median0.00641871338898915
set_robot_commands_min0.004967189752138578
sim_compute_performance-ego_max0.006211049628980232
sim_compute_performance-ego_mean0.005008134924069477
sim_compute_performance-ego_median0.00497445661065862
sim_compute_performance-ego_min0.0041815409293541545
sim_compute_robot_state-ego_max0.007513002915815873
sim_compute_robot_state-ego_mean0.006261321727150061
sim_compute_robot_state-ego_median0.006344859295479527
sim_compute_robot_state-ego_min0.004981536131638747
sim_compute_sim_state_max0.004190997643904252
sim_compute_sim_state_mean0.003531003990620398
sim_compute_sim_state_median0.0035793067075082386
sim_compute_sim_state_min0.002767989268669715
sim_physics_max0.09145505139321992
sim_physics_mean0.07005566466974743
sim_physics_median0.06979493737745915
sim_physics_min0.05455178939379179
sim_render-ego_max0.010533480933218292
sim_render-ego_mean0.008683849405795304
sim_render-ego_median0.008788465928401192
sim_render-ego_min0.006963768830666175
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.660000000000014
survival_time_min3.2999999999999963
No reset possible
269284874Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5007353335859865
survival_time_median14.950000000000076
deviation-center-line_median0.6914148181431956
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04264428456624349
agent_compute-ego_mean0.029572761376698807
agent_compute-ego_median0.023668138980865477
agent_compute-ego_min0.02064919074376424
deviation-center-line_max0.8289877606705015
deviation-center-line_mean0.664110525800042
deviation-center-line_min0.4732639613863232
deviation-heading_max4.6124841185656456
deviation-heading_mean3.578438863705105
deviation-heading_median3.2154228176662727
deviation-heading_min2.8234749369135956
driven_any_max3.0363022700136715
driven_any_mean2.415039476045024
driven_any_median2.5802688969189087
driven_any_min1.6390413950061438
driven_lanedir_consec_max2.959126886884218
driven_lanedir_consec_mean2.3276701122956633
driven_lanedir_consec_min1.5386372615438864
driven_lanedir_max2.959126886884218
driven_lanedir_mean2.3276701122956633
driven_lanedir_median2.5007353335859865
driven_lanedir_min1.5386372615438864
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8167634871045824, "sim_physics": 0.08003201802571615, "survival_time": 14.950000000000076, "driven_lanedir": 1.709533176383042, "sim_render-ego": 0.009635475476582844, "in-drivable-lane": 0, "agent_compute-ego": 0.021571903228759765, "deviation-heading": 4.039779429810943, "set_robot_commands": 0.0090523632367452, "deviation-center-line": 0.4732639613863232, "driven_lanedir_consec": 1.709533176383042, "sim_compute_sim_state": 0.004507555961608887, "sim_compute_performance-ego": 0.005802636941274007, "sim_compute_robot_state-ego": 0.007222592035929362}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6390413950061438, "sim_physics": 0.07657560269037883, "survival_time": 14.950000000000076, "driven_lanedir": 1.5386372615438864, "sim_render-ego": 0.009440311590830483, "in-drivable-lane": 0, "agent_compute-ego": 0.02064919074376424, "deviation-heading": 4.6124841185656456, "set_robot_commands": 0.008710047403971355, "deviation-center-line": 0.8289877606705015, "driven_lanedir_consec": 1.5386372615438864, "sim_compute_sim_state": 0.004358997344970703, "sim_compute_performance-ego": 0.005366499423980713, "sim_compute_robot_state-ego": 0.0068759425481160485}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5802688969189087, "sim_physics": 0.06548559824625651, "survival_time": 14.950000000000076, "driven_lanedir": 2.5007353335859865, "sim_render-ego": 0.008822879791259765, "in-drivable-lane": 0, "agent_compute-ego": 0.023668138980865477, "deviation-heading": 3.2010330155690667, "set_robot_commands": 0.008334487279256186, "deviation-center-line": 0.7493249770306195, "driven_lanedir_consec": 2.5007353335859865, "sim_compute_sim_state": 0.0040394186973571776, "sim_compute_performance-ego": 0.005184497038523356, "sim_compute_robot_state-ego": 0.006377330621083577}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0363022700136715, "sim_physics": 0.07142881631851196, "survival_time": 14.950000000000076, "driven_lanedir": 2.959126886884218, "sim_render-ego": 0.009025246302286785, "in-drivable-lane": 0, "agent_compute-ego": 0.039330289363861085, "deviation-heading": 3.2154228176662727, "set_robot_commands": 0.0067370263735453285, "deviation-center-line": 0.6914148181431956, "driven_lanedir_consec": 2.959126886884218, "sim_compute_sim_state": 0.003856612841288249, "sim_compute_performance-ego": 0.005231048266092936, "sim_compute_robot_state-ego": 0.00659407377243042}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.002821331181813, "sim_physics": 0.07852025032043457, "survival_time": 14.950000000000076, "driven_lanedir": 2.9303179030811837, "sim_render-ego": 0.009949569702148437, "in-drivable-lane": 0, "agent_compute-ego": 0.04264428456624349, "deviation-heading": 2.8234749369135956, "set_robot_commands": 0.00732608159383138, "deviation-center-line": 0.5775611117695705, "driven_lanedir_consec": 2.9303179030811837, "sim_compute_sim_state": 0.004129339059193929, "sim_compute_performance-ego": 0.005763754049936931, "sim_compute_robot_state-ego": 0.007202658653259277}}
set_robot_commands_max0.0090523632367452
set_robot_commands_mean0.00803200117746989
set_robot_commands_median0.008334487279256186
set_robot_commands_min0.0067370263735453285
sim_compute_performance-ego_max0.005802636941274007
sim_compute_performance-ego_mean0.005469687143961589
sim_compute_performance-ego_median0.005366499423980713
sim_compute_performance-ego_min0.005184497038523356
sim_compute_robot_state-ego_max0.007222592035929362
sim_compute_robot_state-ego_mean0.006854519526163737
sim_compute_robot_state-ego_median0.0068759425481160485
sim_compute_robot_state-ego_min0.006377330621083577
sim_compute_sim_state_max0.004507555961608887
sim_compute_sim_state_mean0.00417838478088379
sim_compute_sim_state_median0.004129339059193929
sim_compute_sim_state_min0.003856612841288249
sim_physics_max0.08003201802571615
sim_physics_mean0.07440845712025959
sim_physics_median0.07657560269037883
sim_physics_min0.06548559824625651
sim_render-ego_max0.009949569702148437
sim_render-ego_mean0.009374696572621662
sim_render-ego_median0.009440311590830483
sim_render-ego_min0.008822879791259765
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
269124885Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0843407130909646
survival_time_median4.099999999999993
deviation-center-line_median0.2152129123019889
in-drivable-lane_median0


other stats
agent_compute-ego_max0.028321793738831865
agent_compute-ego_mean0.025464788450997384
agent_compute-ego_median0.02572933663713171
agent_compute-ego_min0.02257727995151427
deviation-center-line_max0.7435008390355367
deviation-center-line_mean0.3085160373074486
deviation-center-line_min0.16529001130002563
deviation-heading_max3.887975654544346
deviation-heading_mean1.4177190856588475
deviation-heading_median0.8439566867083012
deviation-heading_min0.3134814834075397
driven_any_max4.397598481553062
driven_any_mean1.8377766261399509
driven_any_median1.1543956267527031
driven_any_min0.9157482082948128
driven_lanedir_consec_max3.508624004523242
driven_lanedir_consec_mean1.6117042396366883
driven_lanedir_consec_min0.883067137493484
driven_lanedir_max3.508624004523242
driven_lanedir_mean1.6117042396366883
driven_lanedir_median1.0843407130909646
driven_lanedir_min0.883067137493484
in-drivable-lane_max3.100000000000004
in-drivable-lane_mean0.7300000000000004
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1543956267527031, "sim_physics": 0.08122179609663943, "survival_time": 4.699999999999991, "driven_lanedir": 1.0843407130909646, "sim_render-ego": 0.009755626637884911, "in-drivable-lane": 0, "agent_compute-ego": 0.028321793738831865, "deviation-heading": 1.261846132948151, "set_robot_commands": 0.00742532344574624, "deviation-center-line": 0.20255594545737576, "driven_lanedir_consec": 1.0843407130909646, "sim_compute_sim_state": 0.003887409859515251, "sim_compute_performance-ego": 0.005756730728961052, "sim_compute_robot_state-ego": 0.007004380226135254}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9157482082948128, "sim_physics": 0.06725347295720527, "survival_time": 2.3499999999999996, "driven_lanedir": 0.9077083397403702, "sim_render-ego": 0.00801451155479918, "in-drivable-lane": 0, "agent_compute-ego": 0.02572933663713171, "deviation-heading": 0.3134814834075397, "set_robot_commands": 0.006049191698114922, "deviation-center-line": 0.16529001130002563, "driven_lanedir_consec": 0.9077083397403702, "sim_compute_sim_state": 0.0032690433745688583, "sim_compute_performance-ego": 0.004361091776097075, "sim_compute_robot_state-ego": 0.005596881217144905}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0105560692280708, "sim_physics": 0.07346937391493055, "survival_time": 4.049999999999994, "driven_lanedir": 0.883067137493484, "sim_render-ego": 0.01002871843031895, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.023784719867470824, "deviation-heading": 0.8439566867083012, "set_robot_commands": 0.006809058012785735, "deviation-center-line": 0.2152129123019889, "driven_lanedir_consec": 0.883067137493484, "sim_compute_sim_state": 0.004186759760350357, "sim_compute_performance-ego": 0.005585040575192299, "sim_compute_robot_state-ego": 0.0070190135343575185}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.397598481553062, "sim_physics": 0.07929889678955078, "survival_time": 14.950000000000076, "driven_lanedir": 3.508624004523242, "sim_render-ego": 0.009436310132344564, "in-drivable-lane": 3.100000000000004, "agent_compute-ego": 0.026910812060038248, "deviation-heading": 3.887975654544346, "set_robot_commands": 0.00744530995686849, "deviation-center-line": 0.7435008390355367, "driven_lanedir_consec": 3.508624004523242, "sim_compute_sim_state": 0.003911728064219157, "sim_compute_performance-ego": 0.00549392302831014, "sim_compute_robot_state-ego": 0.0070241109530131025}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7105847448711045, "sim_physics": 0.06981572872254907, "survival_time": 4.099999999999993, "driven_lanedir": 1.6747810033353807, "sim_render-ego": 0.00860293027831287, "in-drivable-lane": 0, "agent_compute-ego": 0.02257727995151427, "deviation-heading": 0.7813354706859, "set_robot_commands": 0.006502939433586307, "deviation-center-line": 0.2160204784423161, "driven_lanedir_consec": 1.6747810033353807, "sim_compute_sim_state": 0.0034910120615145057, "sim_compute_performance-ego": 0.004922174825900938, "sim_compute_robot_state-ego": 0.006298065185546875}}
set_robot_commands_max0.00744530995686849
set_robot_commands_mean0.006846364509420338
set_robot_commands_median0.006809058012785735
set_robot_commands_min0.006049191698114922
sim_compute_performance-ego_max0.005756730728961052
sim_compute_performance-ego_mean0.005223792186892301
sim_compute_performance-ego_median0.00549392302831014
sim_compute_performance-ego_min0.004361091776097075
sim_compute_robot_state-ego_max0.0070241109530131025
sim_compute_robot_state-ego_mean0.006588490223239531
sim_compute_robot_state-ego_median0.007004380226135254
sim_compute_robot_state-ego_min0.005596881217144905
sim_compute_sim_state_max0.004186759760350357
sim_compute_sim_state_mean0.0037491906240336263
sim_compute_sim_state_median0.003887409859515251
sim_compute_sim_state_min0.0032690433745688583
sim_physics_max0.08122179609663943
sim_physics_mean0.07421185369617503
sim_physics_median0.07346937391493055
sim_physics_min0.06725347295720527
sim_render-ego_max0.01002871843031895
sim_render-ego_mean0.009167619406732094
sim_render-ego_median0.009436310132344564
sim_render-ego_min0.00801451155479918
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.030000000000011
survival_time_min2.3499999999999996
No reset possible
268944902Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8361221550934452
survival_time_median14.950000000000076
deviation-center-line_median0.7273856584368082
in-drivable-lane_median1.550000000000007


other stats
agent_compute-ego_max0.03251574675242106
agent_compute-ego_mean0.023797203540802003
agent_compute-ego_median0.021711014906565348
agent_compute-ego_min0.02110474427541097
deviation-center-line_max0.9932612393729022
deviation-center-line_mean0.7742528178704999
deviation-center-line_min0.5808677049407465
deviation-heading_max5.118004629402737
deviation-heading_mean4.124144846357073
deviation-heading_median3.7095456800195414
deviation-heading_min3.552692639678045
driven_any_max3.7236366657088222
driven_any_mean3.4321238757590846
driven_any_median3.5995667871185404
driven_any_min2.7354738507394702
driven_lanedir_consec_max3.198725408317246
driven_lanedir_consec_mean2.647366396601746
driven_lanedir_consec_min1.4896439650374735
driven_lanedir_max3.299073911125813
driven_lanedir_mean3.0285529604809405
driven_lanedir_median3.198725408317246
driven_lanedir_min2.547311319826438
in-drivable-lane_max4.150000000000024
in-drivable-lane_mean1.5700000000000112
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.7236366657088222, "sim_physics": 0.07634576797485351, "survival_time": 14.950000000000076, "driven_lanedir": 2.8361221550934452, "sim_render-ego": 0.009338005383809408, "in-drivable-lane": 4.150000000000024, "agent_compute-ego": 0.02151875654856364, "deviation-heading": 3.7095456800195414, "set_robot_commands": 0.008783332506815593, "deviation-center-line": 0.5808677049407465, "driven_lanedir_consec": 2.8361221550934452, "sim_compute_sim_state": 0.004436805248260498, "sim_compute_performance-ego": 0.005734118620554606, "sim_compute_robot_state-ego": 0.007149964173634847}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7354738507394702, "sim_physics": 0.07734486182530721, "survival_time": 14.950000000000076, "driven_lanedir": 2.547311319826438, "sim_render-ego": 0.009720728397369384, "in-drivable-lane": 0, "agent_compute-ego": 0.02110474427541097, "deviation-heading": 4.542013712336976, "set_robot_commands": 0.00880154053370158, "deviation-center-line": 0.9593040093075086, "driven_lanedir_consec": 2.547311319826438, "sim_compute_sim_state": 0.0045135219891866045, "sim_compute_performance-ego": 0.005758267243703206, "sim_compute_robot_state-ego": 0.007169509728749593}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.5995667871185404, "sim_physics": 0.07398542881011963, "survival_time": 14.950000000000076, "driven_lanedir": 3.198725408317246, "sim_render-ego": 0.010722068150838216, "in-drivable-lane": 1.550000000000007, "agent_compute-ego": 0.021711014906565348, "deviation-heading": 3.6984675703480607, "set_robot_commands": 0.008867331345876058, "deviation-center-line": 0.9932612393729022, "driven_lanedir_consec": 3.198725408317246, "sim_compute_sim_state": 0.00446955919265747, "sim_compute_performance-ego": 0.0056680083274841305, "sim_compute_robot_state-ego": 0.0071366540590922034}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.631057192448373, "sim_physics": 0.07448848485946655, "survival_time": 14.950000000000076, "driven_lanedir": 3.299073911125813, "sim_render-ego": 0.00948371966679891, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.02213575522104899, "deviation-heading": 5.118004629402737, "set_robot_commands": 0.008855272928873698, "deviation-center-line": 0.6104454772945338, "driven_lanedir_consec": 1.4896439650374735, "sim_compute_sim_state": 0.004380856355031331, "sim_compute_performance-ego": 0.005620375474294026, "sim_compute_robot_state-ego": 0.006999269326527913}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.47088488278022, "sim_physics": 0.07316220283508301, "survival_time": 14.950000000000076, "driven_lanedir": 3.2615320080417596, "sim_render-ego": 0.00906303564707438, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.03251574675242106, "deviation-heading": 3.552692639678045, "set_robot_commands": 0.007651263872782389, "deviation-center-line": 0.7273856584368082, "driven_lanedir_consec": 3.165029134734127, "sim_compute_sim_state": 0.004158260822296142, "sim_compute_performance-ego": 0.0053702386220296225, "sim_compute_robot_state-ego": 0.006662412484486898}}
set_robot_commands_max0.008867331345876058
set_robot_commands_mean0.008591748237609862
set_robot_commands_median0.00880154053370158
set_robot_commands_min0.007651263872782389
sim_compute_performance-ego_max0.005758267243703206
sim_compute_performance-ego_mean0.005630201657613118
sim_compute_performance-ego_median0.0056680083274841305
sim_compute_performance-ego_min0.0053702386220296225
sim_compute_robot_state-ego_max0.007169509728749593
sim_compute_robot_state-ego_mean0.007023561954498292
sim_compute_robot_state-ego_median0.0071366540590922034
sim_compute_robot_state-ego_min0.006662412484486898
sim_compute_sim_state_max0.0045135219891866045
sim_compute_sim_state_mean0.004391800721486408
sim_compute_sim_state_median0.004436805248260498
sim_compute_sim_state_min0.004158260822296142
sim_physics_max0.07734486182530721
sim_physics_mean0.07506534926096599
sim_physics_median0.07448848485946655
sim_physics_min0.07316220283508301
sim_render-ego_max0.010722068150838216
sim_render-ego_mean0.00966551144917806
sim_render-ego_median0.00948371966679891
sim_render-ego_min0.00906303564707438
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
268824341Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-testingstep1-simulationerroryesip-172-31-46-148-104920:10:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
268654918Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-46-148-104920:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5827186892130505
survival_time_median14.950000000000076
deviation-center-line_median0.7925861474893204
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0216117525100708
agent_compute-ego_mean0.02083777586619059
agent_compute-ego_median0.02099111318588257
agent_compute-ego_min0.019498892625172935
deviation-center-line_max1.1999533187988776
deviation-center-line_mean0.8522054081130657
deviation-center-line_min0.6293598985467093
deviation-heading_max7.08905927308708
deviation-heading_mean4.127501394178948
deviation-heading_median3.11664675175845
deviation-heading_min2.952224207266102
driven_any_max4.121869354369903
driven_any_mean3.6216074011178434
driven_any_median3.892293264571461
driven_any_min2.356533437690784
driven_lanedir_consec_max4.03620986798649
driven_lanedir_consec_mean3.1363622451783213
driven_lanedir_consec_min0.7321970394818004
driven_lanedir_max4.03620986798649
driven_lanedir_mean3.3891980447610033
driven_lanedir_median3.5827186892130505
driven_lanedir_min1.9963760373952095
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.6000000000000011
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.356533437690784, "sim_physics": 0.0747347108523051, "survival_time": 14.950000000000076, "driven_lanedir": 1.9963760373952095, "sim_render-ego": 0.009290084044138593, "in-drivable-lane": 1.2000000000000115, "agent_compute-ego": 0.0209147047996521, "deviation-heading": 7.08905927308708, "set_robot_commands": 0.008572874069213867, "deviation-center-line": 0.7925861474893204, "driven_lanedir_consec": 0.7321970394818004, "sim_compute_sim_state": 0.004369811216990153, "sim_compute_performance-ego": 0.005606369177500407, "sim_compute_robot_state-ego": 0.0069290455182393395}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.768918757774238, "sim_physics": 0.07728185415267945, "survival_time": 14.950000000000076, "driven_lanedir": 3.520571423153682, "sim_render-ego": 0.009488110542297364, "in-drivable-lane": 0, "agent_compute-ego": 0.02117241621017456, "deviation-heading": 4.468201143434052, "set_robot_commands": 0.008813073635101318, "deviation-center-line": 1.1999533187988776, "driven_lanedir_consec": 3.520571423153682, "sim_compute_sim_state": 0.0045175814628601076, "sim_compute_performance-ego": 0.00557898759841919, "sim_compute_robot_state-ego": 0.00706199328104655}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.968422191182833, "sim_physics": 0.06985066334406535, "survival_time": 14.950000000000076, "driven_lanedir": 3.5827186892130505, "sim_render-ego": 0.008706912994384766, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.019498892625172935, "deviation-heading": 3.11664675175845, "set_robot_commands": 0.008551934560139973, "deviation-center-line": 0.7669328508217257, "driven_lanedir_consec": 3.5827186892130505, "sim_compute_sim_state": 0.004300878842671712, "sim_compute_performance-ego": 0.005093661944071451, "sim_compute_robot_state-ego": 0.006408914724985759}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.892293264571461, "sim_physics": 0.07568548202514648, "survival_time": 14.950000000000076, "driven_lanedir": 3.810114206056584, "sim_render-ego": 0.009437702496846516, "in-drivable-lane": 0, "agent_compute-ego": 0.02099111318588257, "deviation-heading": 3.0113755953490515, "set_robot_commands": 0.009466699759165446, "deviation-center-line": 0.8721948249086956, "driven_lanedir_consec": 3.810114206056584, "sim_compute_sim_state": 0.004671599864959717, "sim_compute_performance-ego": 0.0056346702575683595, "sim_compute_robot_state-ego": 0.007040956815083822}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.121869354369903, "sim_physics": 0.08289965152740479, "survival_time": 14.950000000000076, "driven_lanedir": 4.03620986798649, "sim_render-ego": 0.00961502472559611, "in-drivable-lane": 0, "agent_compute-ego": 0.0216117525100708, "deviation-heading": 2.952224207266102, "set_robot_commands": 0.009315557479858398, "deviation-center-line": 0.6293598985467093, "driven_lanedir_consec": 4.03620986798649, "sim_compute_sim_state": 0.004983688195546468, "sim_compute_performance-ego": 0.005726813475290934, "sim_compute_robot_state-ego": 0.0071219468116760255}}
set_robot_commands_max0.009466699759165446
set_robot_commands_mean0.0089440279006958
set_robot_commands_median0.008813073635101318
set_robot_commands_min0.008551934560139973
sim_compute_performance-ego_max0.005726813475290934
sim_compute_performance-ego_mean0.005528100490570069
sim_compute_performance-ego_median0.005606369177500407
sim_compute_performance-ego_min0.005093661944071451
sim_compute_robot_state-ego_max0.0071219468116760255
sim_compute_robot_state-ego_mean0.006912571430206299
sim_compute_robot_state-ego_median0.007040956815083822
sim_compute_robot_state-ego_min0.006408914724985759
sim_compute_sim_state_max0.004983688195546468
sim_compute_sim_state_mean0.004568711916605631
sim_compute_sim_state_median0.0045175814628601076
sim_compute_sim_state_min0.004300878842671712
sim_physics_max0.08289965152740479
sim_physics_mean0.07609047238032024
sim_physics_median0.07568548202514648
sim_physics_min0.06985066334406535
sim_render-ego_max0.00961502472559611
sim_render-ego_mean0.009307566960652668
sim_render-ego_median0.009437702496846516
sim_render-ego_min0.008706912994384766
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
268354933Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:12:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.847259988071276
survival_time_median14.950000000000076
deviation-center-line_median0.7257842969795026
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05345916271209717
agent_compute-ego_mean0.04308078702290853
agent_compute-ego_median0.04271095911661784
agent_compute-ego_min0.034170329570770264
deviation-center-line_max0.7927097301152974
deviation-center-line_mean0.6945800150194417
deviation-center-line_min0.5251169284237954
deviation-heading_max4.4385935631198326
deviation-heading_mean3.349281627698756
deviation-heading_median3.1033596370318017
deviation-heading_min2.7422769753998923
driven_any_max4.4047203340789505
driven_any_mean3.777039180245363
driven_any_median3.92698925751277
driven_any_min2.572051117099031
driven_lanedir_consec_max4.250410376705449
driven_lanedir_consec_mean3.392426705239962
driven_lanedir_consec_min1.132538088637349
driven_lanedir_max4.250410376705449
driven_lanedir_mean3.622951368767192
driven_lanedir_median3.847259988071276
driven_lanedir_min2.285161406273502
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.2600000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.572051117099031, "sim_physics": 0.09179730653762816, "survival_time": 14.950000000000076, "driven_lanedir": 2.285161406273502, "sim_render-ego": 0.01096138079961141, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.04271095911661784, "deviation-heading": 4.4385935631198326, "set_robot_commands": 0.009022220770517984, "deviation-center-line": 0.7632125226102396, "driven_lanedir_consec": 1.132538088637349, "sim_compute_sim_state": 0.004497286478678386, "sim_compute_performance-ego": 0.006497115294138591, "sim_compute_robot_state-ego": 0.008213380972544352}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.92698925751277, "sim_physics": 0.09039458910624186, "survival_time": 14.950000000000076, "driven_lanedir": 3.847259988071276, "sim_render-ego": 0.012031737963358562, "in-drivable-lane": 0, "agent_compute-ego": 0.044172705809275306, "deviation-heading": 2.7831752993201575, "set_robot_commands": 0.008684754371643066, "deviation-center-line": 0.666076596968373, "driven_lanedir_consec": 3.847259988071276, "sim_compute_sim_state": 0.004448416233062744, "sim_compute_performance-ego": 0.006247007846832275, "sim_compute_robot_state-ego": 0.007929087479909261}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.326390497714553, "sim_physics": 0.05633942445119222, "survival_time": 14.950000000000076, "driven_lanedir": 4.184070874996944, "sim_render-ego": 0.007079887390136719, "in-drivable-lane": 0, "agent_compute-ego": 0.034170329570770264, "deviation-heading": 3.1033596370318017, "set_robot_commands": 0.005025186538696289, "deviation-center-line": 0.7927097301152974, "driven_lanedir_consec": 4.184070874996944, "sim_compute_sim_state": 0.00300841490427653, "sim_compute_performance-ego": 0.0039946818351745605, "sim_compute_robot_state-ego": 0.005092748800913493}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.655044694821513, "sim_physics": 0.10174722194671632, "survival_time": 14.950000000000076, "driven_lanedir": 3.5478541977887925, "sim_render-ego": 0.012255886395772296, "in-drivable-lane": 0, "agent_compute-ego": 0.05345916271209717, "deviation-heading": 3.679002663622098, "set_robot_commands": 0.009842185179392495, "deviation-center-line": 0.7257842969795026, "driven_lanedir_consec": 3.5478541977887925, "sim_compute_sim_state": 0.004951975345611572, "sim_compute_performance-ego": 0.007276724179585775, "sim_compute_robot_state-ego": 0.009137681325276693}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.4047203340789505, "sim_physics": 0.07421351671218872, "survival_time": 14.950000000000076, "driven_lanedir": 4.250410376705449, "sim_render-ego": 0.009186236063639323, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.040890777905782064, "deviation-heading": 2.7422769753998923, "set_robot_commands": 0.0067704431215922034, "deviation-center-line": 0.5251169284237954, "driven_lanedir_consec": 4.250410376705449, "sim_compute_sim_state": 0.003936930497487386, "sim_compute_performance-ego": 0.005331860383351644, "sim_compute_robot_state-ego": 0.006605188846588134}}
set_robot_commands_max0.009842185179392495
set_robot_commands_mean0.007868957996368409
set_robot_commands_median0.008684754371643066
set_robot_commands_min0.005025186538696289
sim_compute_performance-ego_max0.007276724179585775
sim_compute_performance-ego_mean0.005869477907816569
sim_compute_performance-ego_median0.006247007846832275
sim_compute_performance-ego_min0.0039946818351745605
sim_compute_robot_state-ego_max0.009137681325276693
sim_compute_robot_state-ego_mean0.007395617485046387
sim_compute_robot_state-ego_median0.007929087479909261
sim_compute_robot_state-ego_min0.005092748800913493
sim_compute_sim_state_max0.004951975345611572
sim_compute_sim_state_mean0.004168604691823324
sim_compute_sim_state_median0.004448416233062744
sim_compute_sim_state_min0.00300841490427653
sim_physics_max0.10174722194671632
sim_physics_mean0.08289841175079346
sim_physics_median0.09039458910624186
sim_physics_min0.05633942445119222
sim_render-ego_max0.012255886395772296
sim_render-ego_mean0.010303025722503663
sim_render-ego_median0.01096138079961141
sim_render-ego_min0.007079887390136719
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
268134565Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|Andrew_Activationaido3-LF-real-validationeval0-visualizesuccessnoip-172-31-46-148-104920:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.6450190526399977
survival_time8
deviation-center-line0.2008332720420325
in-drivable-lane4.6667


other stats
deviation-heading0.3715738054640251
driven_any1.3934287486317396
driven_lanedir0.6450190526399977
visualized-eval0-passed1
No reset possible
268024923Oliver Widlerchallenge-aido_LF-template-pytorchaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:11:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7638792351264406
survival_time_median5.14999999999999
deviation-center-line_median0.22891629944234385
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.02205188274383545
agent_compute-ego_mean0.02016073768638996
agent_compute-ego_median0.020064674647508468
agent_compute-ego_min0.019315063089564228
deviation-center-line_max0.8914603938038732
deviation-center-line_mean0.30166573152125253
deviation-center-line_min0.13027601228409433
deviation-heading_max2.5890323314243595
deviation-heading_mean1.1880143541629102
deviation-heading_median1.01533329725991
deviation-heading_min0.4099339054190128
driven_any_max1.991358664437875
driven_any_mean1.230819452136604
driven_any_median1.1328256543738202
driven_any_min0.3918993461688365
driven_lanedir_consec_max1.9318137256398464
driven_lanedir_consec_mean0.9142013778120828
driven_lanedir_consec_min0.36594382154222194
driven_lanedir_max1.9318137256398464
driven_lanedir_mean0.9142013778120828
driven_lanedir_median0.7638792351264406
driven_lanedir_min0.36594382154222194
in-drivable-lane_max3.049999999999989
in-drivable-lane_mean1.0066666666666635
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3914977158662198, "sim_physics": 0.055629594802856445, "survival_time": 6.249999999999986, "driven_lanedir": 0.751279224106819, "sim_render-ego": 0.007001264572143555, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.02060202980041504, "deviation-heading": 1.839375756699132, "set_robot_commands": 0.00497429084777832, "deviation-center-line": 0.17787039603321794, "driven_lanedir_consec": 0.751279224106819, "sim_compute_sim_state": 0.0028050098419189454, "sim_compute_performance-ego": 0.004137966156005859, "sim_compute_robot_state-ego": 0.004965034484863282}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2504341747840828, "sim_physics": 0.05600165265851316, "survival_time": 5.649999999999988, "driven_lanedir": 1.2083524226535098, "sim_render-ego": 0.007058639441971231, "in-drivable-lane": 0, "agent_compute-ego": 0.020064674647508468, "deviation-heading": 1.3104574976231491, "set_robot_commands": 0.005066799906502783, "deviation-center-line": 0.38274095482384585, "driven_lanedir_consec": 1.2083524226535098, "sim_compute_sim_state": 0.002907185427910459, "sim_compute_performance-ego": 0.003946905642484142, "sim_compute_robot_state-ego": 0.005044337922492913}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9799388884462836, "sim_physics": 0.05595931477016873, "survival_time": 4.499999999999992, "driven_lanedir": 0.7250240787627158, "sim_render-ego": 0.00713512102762858, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.020086699061923556, "deviation-heading": 0.9108859916377235, "set_robot_commands": 0.004996805720859103, "deviation-center-line": 0.22572606191194008, "driven_lanedir_consec": 0.7250240787627158, "sim_compute_sim_state": 0.0029485676023695206, "sim_compute_performance-ego": 0.003948521614074707, "sim_compute_robot_state-ego": 0.005097773340013292}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0505121881097643, "sim_physics": 0.05839239557584127, "survival_time": 4.799999999999991, "driven_lanedir": 1.0376180626032947, "sim_render-ego": 0.0070539141694704694, "in-drivable-lane": 0, "agent_compute-ego": 0.02091974765062332, "deviation-heading": 0.6466625502479003, "set_robot_commands": 0.00519443800052007, "deviation-center-line": 0.2193409893131198, "driven_lanedir_consec": 1.0376180626032947, "sim_compute_sim_state": 0.0028457045555114746, "sim_compute_performance-ego": 0.003942176699638367, "sim_compute_robot_state-ego": 0.0049647366007169085}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9443482705472184, "sim_physics": 0.05591921196427456, "survival_time": 8.599999999999987, "driven_lanedir": 1.9318137256398464, "sim_render-ego": 0.007040248360744742, "in-drivable-lane": 0, "agent_compute-ego": 0.020152227823124376, "deviation-heading": 0.6737557240464708, "set_robot_commands": 0.0049673055493554405, "deviation-center-line": 0.8914603938038732, "driven_lanedir_consec": 1.9318137256398464, "sim_compute_sim_state": 0.002822096957716831, "sim_compute_performance-ego": 0.003990519878476165, "sim_compute_robot_state-ego": 0.004922381667203681}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5091034801379708, "sim_physics": 0.05475955539279514, "survival_time": 6.749999999999984, "driven_lanedir": 0.7224067688705144, "sim_render-ego": 0.008852794435289172, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.02059375445048014, "deviation-heading": 0.9343709883872852, "set_robot_commands": 0.004991171095106337, "deviation-center-line": 0.19104847529593816, "driven_lanedir_consec": 0.7224067688705144, "sim_compute_sim_state": 0.002859935054072627, "sim_compute_performance-ego": 0.003962559170193143, "sim_compute_robot_state-ego": 0.004964821426956742}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0152293866011453, "sim_physics": 0.056534495404971546, "survival_time": 4.6499999999999915, "driven_lanedir": 1.0109582639581824, "sim_render-ego": 0.006988510008781187, "in-drivable-lane": 0, "agent_compute-ego": 0.020034484965826875, "deviation-heading": 0.4099339054190128, "set_robot_commands": 0.00490662359422253, "deviation-center-line": 0.45908069854416467, "driven_lanedir_consec": 1.0109582639581824, "sim_compute_sim_state": 0.00281642585672358, "sim_compute_performance-ego": 0.003907362620035808, "sim_compute_robot_state-ego": 0.004871001807592248}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8505617865055999, "sim_physics": 0.05443911914584003, "survival_time": 3.949999999999994, "driven_lanedir": 0.6615561014252438, "sim_render-ego": 0.007191093662117101, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.020395831216739706, "deviation-heading": 1.274314682046494, "set_robot_commands": 0.00507930260670336, "deviation-center-line": 0.22891629944234385, "driven_lanedir_consec": 0.6615561014252438, "sim_compute_sim_state": 0.0028536380091799965, "sim_compute_performance-ego": 0.003971914701823947, "sim_compute_robot_state-ego": 0.0049011496048939375}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.544412999523628, "sim_physics": 0.054679428321727806, "survival_time": 6.8999999999999835, "driven_lanedir": 0.7197247100761501, "sim_render-ego": 0.00705553310504858, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.019315063089564228, "deviation-heading": 1.209270627034549, "set_robot_commands": 0.004915413649185844, "deviation-center-line": 0.20268956611565428, "driven_lanedir_consec": 0.7197247100761501, "sim_compute_sim_state": 0.0027855893839960513, "sim_compute_performance-ego": 0.003948659136675406, "sim_compute_robot_state-ego": 0.004856641741766446}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0387390715957392, "sim_physics": 0.05343252985100997, "survival_time": 4.749999999999991, "driven_lanedir": 0.7856251643211847, "sim_render-ego": 0.006890128788195158, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.019600140421014083, "deviation-heading": 1.01533329725991, "set_robot_commands": 0.004904327894511976, "deviation-center-line": 0.13027601228409433, "driven_lanedir_consec": 0.7856251643211847, "sim_compute_sim_state": 0.0027786480753045333, "sim_compute_performance-ego": 0.003889497957731548, "sim_compute_robot_state-ego": 0.004801609641627262}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0269799836333315, "sim_physics": 0.054223780936383185, "survival_time": 4.699999999999991, "driven_lanedir": 0.6726083640499873, "sim_render-ego": 0.007006411856793343, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.01947994942360736, "deviation-heading": 0.8292478358825333, "set_robot_commands": 0.00512513962197811, "deviation-center-line": 0.26408599183635706, "driven_lanedir_consec": 0.6726083640499873, "sim_compute_sim_state": 0.0028393801222456262, "sim_compute_performance-ego": 0.003986769534171896, "sim_compute_robot_state-ego": 0.004900052192363333}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.344450171317544, "sim_physics": 0.05316715201070486, "survival_time": 6.0499999999999865, "driven_lanedir": 0.7638792351264406, "sim_render-ego": 0.00829525230344662, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.019477660990943592, "deviation-heading": 2.2660608899489967, "set_robot_commands": 0.0048016240774107375, "deviation-center-line": 0.2931446608028769, "driven_lanedir_consec": 0.7638792351264406, "sim_compute_sim_state": 0.002760603408182948, "sim_compute_performance-ego": 0.003868384794755415, "sim_compute_robot_state-ego": 0.004730474850362982}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.991358664437875, "sim_physics": 0.053939981894059616, "survival_time": 8.79999999999999, "driven_lanedir": 1.2654004114333135, "sim_render-ego": 0.006850379434498874, "in-drivable-lane": 2.000000000000001, "agent_compute-ego": 0.019649738615209408, "deviation-heading": 2.5890323314243595, "set_robot_commands": 0.004905257712710987, "deviation-center-line": 0.3895864042361204, "driven_lanedir_consec": 1.2654004114333135, "sim_compute_sim_state": 0.002809738570993597, "sim_compute_performance-ego": 0.003900285471569408, "sim_compute_robot_state-ego": 0.004808332432400097}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3918993461688365, "sim_physics": 0.061397552490234375, "survival_time": 2.000000000000001, "driven_lanedir": 0.36594382154222194, "sim_render-ego": 0.007331371307373047, "in-drivable-lane": 0, "agent_compute-ego": 0.02205188274383545, "deviation-heading": 0.7048034984886531, "set_robot_commands": 0.004802936315536499, "deviation-center-line": 0.14153624672289625, "driven_lanedir_consec": 0.36594382154222194, "sim_compute_sim_state": 0.0030556440353393553, "sim_compute_performance-ego": 0.0041631519794464115, "sim_compute_robot_state-ego": 0.005030858516693115}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.1328256543738202, "sim_physics": 0.0546133032122862, "survival_time": 5.14999999999999, "driven_lanedir": 1.0908303126118206, "sim_render-ego": 0.006821014348743031, "in-drivable-lane": 0, "agent_compute-ego": 0.019987180395033752, "deviation-heading": 1.206709736297488, "set_robot_commands": 0.004748386086769475, "deviation-center-line": 0.32748282165234466, "driven_lanedir_consec": 1.0908303126118206, "sim_compute_sim_state": 0.0027399456616744255, "sim_compute_performance-ego": 0.003850610510816852, "sim_compute_robot_state-ego": 0.004720206399565762}}
set_robot_commands_max0.00519443800052007
set_robot_commands_mean0.004958654845276771
set_robot_commands_median0.0049673055493554405
set_robot_commands_min0.004748386086769475
sim_compute_performance-ego_max0.0041631519794464115
sim_compute_performance-ego_mean0.003961019057859938
sim_compute_performance-ego_median0.003948521614074707
sim_compute_performance-ego_min0.003850610510816852
sim_compute_robot_state-ego_max0.005097773340013292
sim_compute_robot_state-ego_mean0.004905294175300801
sim_compute_robot_state-ego_median0.0049011496048939375
sim_compute_robot_state-ego_min0.004720206399565762
sim_compute_sim_state_max0.0030556440353393553
sim_compute_sim_state_mean0.0028418741708759977
sim_compute_sim_state_median0.002822096957716831
sim_compute_sim_state_min0.0027399456616744255
sim_physics_max0.061397552490234375
sim_physics_mean0.05553927122877779
sim_physics_median0.05475955539279514
sim_physics_min0.05316715201070486
sim_render-ego_max0.008852794435289172
sim_render-ego_mean0.0072381117881496464
sim_render-ego_median0.0070539141694704694
sim_render-ego_min0.006821014348743031
simulation-passed1
survival_time_max8.79999999999999
survival_time_mean5.566666666666657
survival_time_min2.000000000000001
No reset possible
267774513Frank (Chude) Qian 🇨🇦2019-11-19|FrankNetaido3-LF-real-validationeval1-visualizesuccessnoip-172-31-46-148-104920:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec9.245154103031163
survival_time44.6666
deviation-center-line2.6913375767615735
in-drivable-lane11.3333


other stats
deviation-heading8.052753132222668
driven_any12.707775213854374
driven_lanedir9.245154103031163
visualized-eval1-passed1
No reset possible
267734513Frank (Chude) Qian 🇨🇦2019-11-19|FrankNetaido3-LF-real-validationeval0-videossuccessnoip-172-31-46-148-104920:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
267594540Robert Moni 🇭🇺kaland-22405aido3-LF-real-validationeval1-videossuccessnoip-172-31-46-148-104920:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
267034904Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:14:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.81847629225373
survival_time_median14.950000000000076
deviation-center-line_median0.7426618690032458
in-drivable-lane_median0.6000000000000085


other stats
agent_compute-ego_max0.04409645160039266
agent_compute-ego_mean0.04211834796269735
agent_compute-ego_median0.04232332626978556
agent_compute-ego_min0.03877069632212321
deviation-center-line_max0.99892873728551
deviation-center-line_mean0.7889424543793759
deviation-center-line_min0.6815218169535228
deviation-heading_max4.144156972575981
deviation-heading_mean3.3871896815586098
deviation-heading_median3.737191072324753
deviation-heading_min2.1408820529641517
driven_any_max5.339819749039294
driven_any_mean4.144099333464256
driven_any_median3.999065878917827
driven_any_min3.275961554626194
driven_lanedir_consec_max4.99110076645296
driven_lanedir_consec_mean3.6588539475377657
driven_lanedir_consec_min2.4769037394437845
driven_lanedir_max4.99110076645296
driven_lanedir_mean3.9168955902730622
driven_lanedir_median3.81847629225373
driven_lanedir_min2.9913430825814307
in-drivable-lane_max2.1000000000000085
in-drivable-lane_mean0.7800000000000026
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.275961554626194, "sim_physics": 0.08141160090764364, "survival_time": 14.950000000000076, "driven_lanedir": 2.9913430825814307, "sim_render-ego": 0.009629957675933838, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.03877069632212321, "deviation-heading": 4.144156972575981, "set_robot_commands": 0.007962778409322102, "deviation-center-line": 0.8058813004775377, "driven_lanedir_consec": 2.9913430825814307, "sim_compute_sim_state": 0.004481000105539958, "sim_compute_performance-ego": 0.005770915349324544, "sim_compute_robot_state-ego": 0.007128970623016357}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.110040821326191, "sim_physics": 0.07631810665130616, "survival_time": 14.950000000000076, "driven_lanedir": 4.016445856956919, "sim_render-ego": 0.009763492743174234, "in-drivable-lane": 0, "agent_compute-ego": 0.04197011788686116, "deviation-heading": 2.816255217057236, "set_robot_commands": 0.006950076421101888, "deviation-center-line": 0.7157185481770635, "driven_lanedir_consec": 4.016445856956919, "sim_compute_sim_state": 0.004167232513427734, "sim_compute_performance-ego": 0.005662116209665934, "sim_compute_robot_state-ego": 0.007137881914774577}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.339819749039294, "sim_physics": 0.08149611870447794, "survival_time": 14.950000000000076, "driven_lanedir": 4.99110076645296, "sim_render-ego": 0.010102445284525554, "in-drivable-lane": 2.1000000000000085, "agent_compute-ego": 0.04232332626978556, "deviation-heading": 2.1408820529641517, "set_robot_commands": 0.007409235636393229, "deviation-center-line": 0.6815218169535228, "driven_lanedir_consec": 4.99110076645296, "sim_compute_sim_state": 0.004313066005706787, "sim_compute_performance-ego": 0.00581174373626709, "sim_compute_robot_state-ego": 0.007315251032511393}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.9956086634117742, "sim_physics": 0.08389742851257324, "survival_time": 14.950000000000076, "driven_lanedir": 3.81847629225373, "sim_render-ego": 0.010407665570576983, "in-drivable-lane": 0, "agent_compute-ego": 0.04343114773432414, "deviation-heading": 3.737191072324753, "set_robot_commands": 0.008302709261576335, "deviation-center-line": 0.99892873728551, "driven_lanedir_consec": 3.81847629225373, "sim_compute_sim_state": 0.00452528715133667, "sim_compute_performance-ego": 0.0061670009295145675, "sim_compute_robot_state-ego": 0.007731122175852458}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.999065878917827, "sim_physics": 0.0889250389734904, "survival_time": 14.950000000000076, "driven_lanedir": 3.767111953120272, "sim_render-ego": 0.010815733273824056, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.04409645160039266, "deviation-heading": 4.097463092870926, "set_robot_commands": 0.00820022424062093, "deviation-center-line": 0.7426618690032458, "driven_lanedir_consec": 2.4769037394437845, "sim_compute_sim_state": 0.004512066046396891, "sim_compute_performance-ego": 0.006335120201110839, "sim_compute_robot_state-ego": 0.007801263332366943}}
set_robot_commands_max0.008302709261576335
set_robot_commands_mean0.007765004793802897
set_robot_commands_median0.007962778409322102
set_robot_commands_min0.006950076421101888
sim_compute_performance-ego_max0.006335120201110839
sim_compute_performance-ego_mean0.005949379285176595
sim_compute_performance-ego_median0.00581174373626709
sim_compute_performance-ego_min0.005662116209665934
sim_compute_robot_state-ego_max0.007801263332366943
sim_compute_robot_state-ego_mean0.007422897815704345
sim_compute_robot_state-ego_median0.007315251032511393
sim_compute_robot_state-ego_min0.007128970623016357
sim_compute_sim_state_max0.00452528715133667
sim_compute_sim_state_mean0.004399730364481608
sim_compute_sim_state_median0.004481000105539958
sim_compute_sim_state_min0.004167232513427734
sim_physics_max0.0889250389734904
sim_physics_mean0.08240965874989828
sim_physics_median0.08149611870447794
sim_physics_min0.07631810665130616
sim_render-ego_max0.010815733273824056
sim_render-ego_mean0.010143858909606934
sim_render-ego_median0.010102445284525554
sim_render-ego_min0.009629957675933838
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
265944835Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8308203883246198
survival_time_median4.399999999999992
deviation-center-line_median0.3455100610231335
in-drivable-lane_median0


other stats
agent_compute-ego_max0.017598603452954973
agent_compute-ego_mean0.016225841051158228
agent_compute-ego_median0.015969712683495056
agent_compute-ego_min0.01555280133980472
deviation-center-line_max0.3525715495812492
deviation-center-line_mean0.29667864439026326
deviation-center-line_min0.09030124926724496
deviation-heading_max1.357625295390702
deviation-heading_mean0.7399006507703957
deviation-heading_median0.7351239851087018
deviation-heading_min0.33401060796718124
driven_any_max1.275119798679112
driven_any_mean0.9714815421695088
driven_any_median1.1065931850168156
driven_any_min0.4615946021217474
driven_lanedir_consec_max1.249037520185024
driven_lanedir_consec_mean0.8661604654363352
driven_lanedir_consec_min0.4491191051756772
driven_lanedir_max1.249037520185024
driven_lanedir_mean0.8661604654363352
driven_lanedir_median0.8308203883246198
driven_lanedir_min0.4491191051756772
in-drivable-lane_max2.249999999999992
in-drivable-lane_mean0.4499999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4615946021217474, "sim_physics": 0.06113037041255406, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4491191051756772, "sim_render-ego": 0.007515098367418561, "in-drivable-lane": 0, "agent_compute-ego": 0.017598603452954973, "deviation-heading": 0.33401060796718124, "set_robot_commands": 0.0071473632540021625, "deviation-center-line": 0.09030124926724496, "driven_lanedir_consec": 0.4491191051756772, "sim_compute_sim_state": 0.003911937986101423, "sim_compute_performance-ego": 0.004338366644723075, "sim_compute_robot_state-ego": 0.005254949842180524}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1582440024698877, "sim_physics": 0.05802502950032552, "survival_time": 3.7499999999999942, "driven_lanedir": 1.1480732217739928, "sim_render-ego": 0.00717341423034668, "in-drivable-lane": 0, "agent_compute-ego": 0.015881579717000327, "deviation-heading": 0.48573414076511634, "set_robot_commands": 0.0070641422271728515, "deviation-center-line": 0.3455100610231335, "driven_lanedir_consec": 1.1480732217739928, "sim_compute_sim_state": 0.003578799565633138, "sim_compute_performance-ego": 0.003915494283040365, "sim_compute_robot_state-ego": 0.005217151641845703}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1065931850168156, "sim_physics": 0.05423443171442771, "survival_time": 7.349999999999982, "driven_lanedir": 0.653752091722362, "sim_render-ego": 0.007045945342706174, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.01555280133980472, "deviation-heading": 1.357625295390702, "set_robot_commands": 0.006944743954405493, "deviation-center-line": 0.3498129776136335, "driven_lanedir_consec": 0.653752091722362, "sim_compute_sim_state": 0.003660260414590641, "sim_compute_performance-ego": 0.003945478776685235, "sim_compute_robot_state-ego": 0.00508620463260988}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8558561225599819, "sim_physics": 0.05592027577486905, "survival_time": 4.399999999999992, "driven_lanedir": 0.8308203883246198, "sim_render-ego": 0.007293283939361572, "in-drivable-lane": 0, "agent_compute-ego": 0.016126508062536068, "deviation-heading": 0.7351239851087018, "set_robot_commands": 0.006995160471309315, "deviation-center-line": 0.3451973844660553, "driven_lanedir_consec": 0.8308203883246198, "sim_compute_sim_state": 0.003883020444349809, "sim_compute_performance-ego": 0.00403550538149747, "sim_compute_robot_state-ego": 0.005213835022666238}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.275119798679112, "sim_physics": 0.05591376030698736, "survival_time": 4.699999999999991, "driven_lanedir": 1.249037520185024, "sim_render-ego": 0.0071758970301202, "in-drivable-lane": 0, "agent_compute-ego": 0.015969712683495056, "deviation-heading": 0.7870092246202774, "set_robot_commands": 0.006752937398058303, "deviation-center-line": 0.3525715495812492, "driven_lanedir_consec": 1.249037520185024, "sim_compute_sim_state": 0.003528922162157424, "sim_compute_performance-ego": 0.0039865133610177544, "sim_compute_robot_state-ego": 0.005118088519319575}}
set_robot_commands_max0.0071473632540021625
set_robot_commands_mean0.006980869460989625
set_robot_commands_median0.006995160471309315
set_robot_commands_min0.006752937398058303
sim_compute_performance-ego_max0.004338366644723075
sim_compute_performance-ego_mean0.00404427168939278
sim_compute_performance-ego_median0.0039865133610177544
sim_compute_performance-ego_min0.003915494283040365
sim_compute_robot_state-ego_max0.005254949842180524
sim_compute_robot_state-ego_mean0.005178045931724384
sim_compute_robot_state-ego_median0.005213835022666238
sim_compute_robot_state-ego_min0.00508620463260988
sim_compute_sim_state_max0.003911937986101423
sim_compute_sim_state_mean0.0037125881145664862
sim_compute_sim_state_median0.003660260414590641
sim_compute_sim_state_min0.003528922162157424
sim_physics_max0.06113037041255406
sim_physics_mean0.05704477354183274
sim_physics_median0.05592027577486905
sim_physics_min0.05423443171442771
sim_render-ego_max0.007515098367418561
sim_render-ego_mean0.007240727781990637
sim_render-ego_median0.0071758970301202
sim_render-ego_min0.007045945342706174
simulation-passed1
survival_time_max7.349999999999982
survival_time_mean4.319999999999992
survival_time_min1.4000000000000006
No reset possible
265914833Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:10:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4270295427589064
survival_time_median14.950000000000076
deviation-center-line_median0.8319972688697284
in-drivable-lane_median2.300000000000007


other stats
agent_compute-ego_max0.03580770254135132
agent_compute-ego_mean0.03426092020670573
agent_compute-ego_median0.03507365147272746
agent_compute-ego_min0.02994876543680827
deviation-center-line_max1.0749541567500531
deviation-center-line_mean0.8600046439025772
deviation-center-line_min0.6884412040918613
deviation-heading_max5.396944136317613
deviation-heading_mean3.777231638710462
deviation-heading_median3.399832228049954
deviation-heading_min2.332028306049972
driven_any_max5.333334698050547
driven_any_mean4.456721996450812
driven_any_median4.502129540665608
driven_any_min3.541480101596032
driven_lanedir_consec_max4.275905170921265
driven_lanedir_consec_mean2.6421419694125228
driven_lanedir_consec_min1.739932050411949
driven_lanedir_max5.20628258711576
driven_lanedir_mean4.093969436982343
driven_lanedir_median4.21879099365358
driven_lanedir_min3.260378321461147
in-drivable-lane_max3.2499999999999885
in-drivable-lane_mean2.040000000000007
in-drivable-lane_min1.0499999999999965
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.0584647443815545, "sim_physics": 0.05625319798787435, "survival_time": 14.950000000000076, "driven_lanedir": 3.5084901117599636, "sim_render-ego": 0.007021904786427816, "in-drivable-lane": 2.400000000000028, "agent_compute-ego": 0.02994876543680827, "deviation-heading": 4.855958174896702, "set_robot_commands": 0.005599716504414876, "deviation-center-line": 1.0749541567500531, "driven_lanedir_consec": 2.4270295427589064, "sim_compute_sim_state": 0.003206451733907064, "sim_compute_performance-ego": 0.004152913093566895, "sim_compute_robot_state-ego": 0.005205031236012777}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.502129540665608, "sim_physics": 0.055899070103963215, "survival_time": 14.950000000000076, "driven_lanedir": 4.21879099365358, "sim_render-ego": 0.007102952003479004, "in-drivable-lane": 2.300000000000007, "agent_compute-ego": 0.03507365147272746, "deviation-heading": 3.399832228049954, "set_robot_commands": 0.0050443077087402345, "deviation-center-line": 0.6884412040918613, "driven_lanedir_consec": 2.2771060965848786, "sim_compute_sim_state": 0.0030074477195739745, "sim_compute_performance-ego": 0.004013760089874268, "sim_compute_robot_state-ego": 0.0051266193389892575}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.848200897560319, "sim_physics": 0.05545853932698568, "survival_time": 14.950000000000076, "driven_lanedir": 4.275905170921265, "sim_render-ego": 0.007178924083709717, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.035419031778971356, "deviation-heading": 2.332028306049972, "set_robot_commands": 0.005047757625579834, "deviation-center-line": 0.8319972688697284, "driven_lanedir_consec": 4.275905170921265, "sim_compute_sim_state": 0.003058056036631266, "sim_compute_performance-ego": 0.004038223425547282, "sim_compute_robot_state-ego": 0.005195181369781494}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.541480101596032, "sim_physics": 0.05551291783650717, "survival_time": 14.950000000000076, "driven_lanedir": 3.260378321461147, "sim_render-ego": 0.007181940078735352, "in-drivable-lane": 1.2000000000000144, "agent_compute-ego": 0.03580770254135132, "deviation-heading": 5.396944136317613, "set_robot_commands": 0.005107836723327637, "deviation-center-line": 0.9911405763092483, "driven_lanedir_consec": 1.739932050411949, "sim_compute_sim_state": 0.0031148378054300942, "sim_compute_performance-ego": 0.004075744946797689, "sim_compute_robot_state-ego": 0.00528865655263265}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.333334698050547, "sim_physics": 0.054409877459208174, "survival_time": 14.950000000000076, "driven_lanedir": 5.20628258711576, "sim_render-ego": 0.00712238629659017, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.03505544980367025, "deviation-heading": 2.9013953482380694, "set_robot_commands": 0.005098365147908529, "deviation-center-line": 0.7134900134919948, "driven_lanedir_consec": 2.4907369863856132, "sim_compute_sim_state": 0.0030806485811869302, "sim_compute_performance-ego": 0.004031763871510823, "sim_compute_robot_state-ego": 0.005165246327718099}}
set_robot_commands_max0.005599716504414876
set_robot_commands_mean0.005179596741994223
set_robot_commands_median0.005098365147908529
set_robot_commands_min0.0050443077087402345
sim_compute_performance-ego_max0.004152913093566895
sim_compute_performance-ego_mean0.004062481085459391
sim_compute_performance-ego_median0.004038223425547282
sim_compute_performance-ego_min0.004013760089874268
sim_compute_robot_state-ego_max0.00528865655263265
sim_compute_robot_state-ego_mean0.005196146965026856
sim_compute_robot_state-ego_median0.005195181369781494
sim_compute_robot_state-ego_min0.0051266193389892575
sim_compute_sim_state_max0.003206451733907064
sim_compute_sim_state_mean0.003093488375345866
sim_compute_sim_state_median0.0030806485811869302
sim_compute_sim_state_min0.0030074477195739745
sim_physics_max0.05625319798787435
sim_physics_mean0.055506720542907714
sim_physics_median0.05551291783650717
sim_physics_min0.054409877459208174
sim_render-ego_max0.007181940078735352
sim_render-ego_mean0.007121621449788411
sim_render-ego_median0.00712238629659017
sim_render-ego_min0.007021904786427816
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
265804826Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:09:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3500428801298754
survival_time_median14.950000000000076
deviation-center-line_median0.7611357157212174
in-drivable-lane_median1.8500000000000263


other stats
agent_compute-ego_max0.035203360716501875
agent_compute-ego_mean0.03411646525065104
agent_compute-ego_median0.03487759192784627
agent_compute-ego_min0.0315298326810201
deviation-center-line_max0.8569375094832867
deviation-center-line_mean0.742162819178606
deviation-center-line_min0.6133761237743692
deviation-heading_max3.539775365744026
deviation-heading_mean2.8360981633654543
deviation-heading_median2.9792837464761615
deviation-heading_min1.4583743654775072
driven_any_max4.555384289822205
driven_any_mean3.957509350935382
driven_any_median4.065701855500892
driven_any_min3.020421371881856
driven_lanedir_consec_max4.325193983488113
driven_lanedir_consec_mean3.220511867763502
driven_lanedir_consec_min2.0528429744025307
driven_lanedir_max4.325193983488113
driven_lanedir_mean3.676229083903421
driven_lanedir_median3.8379703680026287
driven_lanedir_min2.536509132794361
in-drivable-lane_max3.150000000000028
in-drivable-lane_mean1.7600000000000129
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.020421371881856, "sim_physics": 0.05677963495254516, "survival_time": 14.950000000000076, "driven_lanedir": 2.536509132794361, "sim_render-ego": 0.007014558315277099, "in-drivable-lane": 3.150000000000028, "agent_compute-ego": 0.0315298326810201, "deviation-heading": 3.32735042861486, "set_robot_commands": 0.005729340712229411, "deviation-center-line": 0.7611357157212174, "driven_lanedir_consec": 2.536509132794361, "sim_compute_sim_state": 0.003219629923502604, "sim_compute_performance-ego": 0.00410954475402832, "sim_compute_robot_state-ego": 0.005166177749633789}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.235362998505288, "sim_physics": 0.05481081485748291, "survival_time": 14.950000000000076, "driven_lanedir": 4.024223250189348, "sim_render-ego": 0.0070873077710469565, "in-drivable-lane": 2.20000000000001, "agent_compute-ego": 0.03487759192784627, "deviation-heading": 2.9792837464761615, "set_robot_commands": 0.0050040976206461585, "deviation-center-line": 0.8393075860746344, "driven_lanedir_consec": 2.0528429744025307, "sim_compute_sim_state": 0.003004345893859863, "sim_compute_performance-ego": 0.003988275527954102, "sim_compute_robot_state-ego": 0.005104325612386068}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.555384289822205, "sim_physics": 0.054208593368530275, "survival_time": 14.950000000000076, "driven_lanedir": 4.325193983488113, "sim_render-ego": 0.007060791651407878, "in-drivable-lane": 1.6000000000000014, "agent_compute-ego": 0.035203360716501875, "deviation-heading": 1.4583743654775072, "set_robot_commands": 0.0050023953119913735, "deviation-center-line": 0.8569375094832867, "driven_lanedir_consec": 4.325193983488113, "sim_compute_sim_state": 0.0030218791961669923, "sim_compute_performance-ego": 0.003980953693389893, "sim_compute_robot_state-ego": 0.005090822378794352}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.91067623896667, "sim_physics": 0.056954137484232586, "survival_time": 14.950000000000076, "driven_lanedir": 3.8379703680026287, "sim_render-ego": 0.007004659175872802, "in-drivable-lane": 0, "agent_compute-ego": 0.03501384973526001, "deviation-heading": 2.875706910514717, "set_robot_commands": 0.004958406289418538, "deviation-center-line": 0.6400571608395226, "driven_lanedir_consec": 3.8379703680026287, "sim_compute_sim_state": 0.0029753541946411135, "sim_compute_performance-ego": 0.0039701493581136066, "sim_compute_robot_state-ego": 0.005054019292195638}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.065701855500892, "sim_physics": 0.05465174754460653, "survival_time": 14.950000000000076, "driven_lanedir": 3.657248685042654, "sim_render-ego": 0.006968069076538086, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.033957691192626954, "deviation-heading": 3.539775365744026, "set_robot_commands": 0.004925832748413086, "deviation-center-line": 0.6133761237743692, "driven_lanedir_consec": 3.3500428801298754, "sim_compute_sim_state": 0.0029740238189697264, "sim_compute_performance-ego": 0.003950929641723633, "sim_compute_robot_state-ego": 0.005049920876820882}}
set_robot_commands_max0.005729340712229411
set_robot_commands_mean0.005124014536539713
set_robot_commands_median0.0050023953119913735
set_robot_commands_min0.004925832748413086
sim_compute_performance-ego_max0.00410954475402832
sim_compute_performance-ego_mean0.003999970595041912
sim_compute_performance-ego_median0.003980953693389893
sim_compute_performance-ego_min0.003950929641723633
sim_compute_robot_state-ego_max0.005166177749633789
sim_compute_robot_state-ego_mean0.0050930531819661454
sim_compute_robot_state-ego_median0.005090822378794352
sim_compute_robot_state-ego_min0.005049920876820882
sim_compute_sim_state_max0.003219629923502604
sim_compute_sim_state_mean0.00303904660542806
sim_compute_sim_state_median0.003004345893859863
sim_compute_sim_state_min0.0029740238189697264
sim_physics_max0.056954137484232586
sim_physics_mean0.0554809856414795
sim_physics_median0.05481081485748291
sim_physics_min0.054208593368530275
sim_render-ego_max0.0070873077710469565
sim_render-ego_mean0.007027077198028564
sim_render-ego_median0.007014558315277099
sim_render-ego_min0.006968069076538086
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
265704820Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.21287616205262
survival_time_median14.950000000000076
deviation-center-line_median0.6896647502027862
in-drivable-lane_median1.2499999999999956


other stats
agent_compute-ego_max0.024609422454467185
agent_compute-ego_mean0.02277368369846862
agent_compute-ego_median0.022504972009097828
agent_compute-ego_min0.02146931012471517
deviation-center-line_max0.7912995410119169
deviation-center-line_mean0.6229651793387442
deviation-center-line_min0.17757568216835729
deviation-heading_max3.646866760313162
deviation-heading_mean2.7700200502747596
deviation-heading_median3.1038232195315567
deviation-heading_min1.046779003860749
driven_any_max4.554605284327112
driven_any_mean3.1750086916150737
driven_any_median3.473950941137471
driven_any_min1.0098841238792484
driven_lanedir_consec_max4.204478734316313
driven_lanedir_consec_mean2.453935961762798
driven_lanedir_consec_min0.6663577918763235
driven_lanedir_max4.204478734316313
driven_lanedir_mean2.806818165415035
driven_lanedir_median3.1295794335713536
driven_lanedir_min0.6663577918763235
in-drivable-lane_max3.999999999999994
in-drivable-lane_mean1.9100000000000037
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0098841238792484, "sim_physics": 0.08342668869916131, "survival_time": 4.249999999999993, "driven_lanedir": 0.6663577918763235, "sim_render-ego": 0.009808941448436064, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.022504972009097828, "deviation-heading": 1.046779003860749, "set_robot_commands": 0.009355539434096392, "deviation-center-line": 0.17757568216835729, "driven_lanedir_consec": 0.6663577918763235, "sim_compute_sim_state": 0.004674311245188994, "sim_compute_performance-ego": 0.0060322032255284925, "sim_compute_robot_state-ego": 0.007340624753166648}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3545520909052957, "sim_physics": 0.09033388472520389, "survival_time": 10.400000000000013, "driven_lanedir": 2.21287616205262, "sim_render-ego": 0.011375811237555284, "in-drivable-lane": 0, "agent_compute-ego": 0.024609422454467185, "deviation-heading": 3.1038232195315567, "set_robot_commands": 0.010244666383816646, "deviation-center-line": 0.6896647502027862, "driven_lanedir_consec": 2.21287616205262, "sim_compute_sim_state": 0.005177118457280672, "sim_compute_performance-ego": 0.006632506847381592, "sim_compute_robot_state-ego": 0.008334142657426687}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.554605284327112, "sim_physics": 0.07737566788991292, "survival_time": 14.950000000000076, "driven_lanedir": 3.820798705258565, "sim_render-ego": 0.009581935405731202, "in-drivable-lane": 3.999999999999994, "agent_compute-ego": 0.02146931012471517, "deviation-heading": 2.6802022302787916, "set_robot_commands": 0.009285139242808023, "deviation-center-line": 0.7847241814870689, "driven_lanedir_consec": 3.820798705258565, "sim_compute_sim_state": 0.004707551797231038, "sim_compute_performance-ego": 0.00561373233795166, "sim_compute_robot_state-ego": 0.007013760407765707}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.473950941137471, "sim_physics": 0.08065199772516886, "survival_time": 14.950000000000076, "driven_lanedir": 3.1295794335713536, "sim_render-ego": 0.01125089963277181, "in-drivable-lane": 3.100000000000012, "agent_compute-ego": 0.02191251834233602, "deviation-heading": 3.646866760313162, "set_robot_commands": 0.009498050212860107, "deviation-center-line": 0.6715617418235916, "driven_lanedir_consec": 1.3651684153101684, "sim_compute_sim_state": 0.0050132139523824054, "sim_compute_performance-ego": 0.005766293207804362, "sim_compute_robot_state-ego": 0.007392783959706624}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.482051017826242, "sim_physics": 0.07979209184646606, "survival_time": 14.950000000000076, "driven_lanedir": 4.204478734316313, "sim_render-ego": 0.009769586722056071, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.02337219556172689, "deviation-heading": 3.3724290373895394, "set_robot_commands": 0.009784703254699706, "deviation-center-line": 0.7912995410119169, "driven_lanedir_consec": 4.204478734316313, "sim_compute_sim_state": 0.004877721468607585, "sim_compute_performance-ego": 0.005695651372273763, "sim_compute_robot_state-ego": 0.0072031076749165856}}
set_robot_commands_max0.010244666383816646
set_robot_commands_mean0.009633619705656174
set_robot_commands_median0.009498050212860107
set_robot_commands_min0.009285139242808023
sim_compute_performance-ego_max0.006632506847381592
sim_compute_performance-ego_mean0.0059480773981879734
sim_compute_performance-ego_median0.005766293207804362
sim_compute_performance-ego_min0.00561373233795166
sim_compute_robot_state-ego_max0.008334142657426687
sim_compute_robot_state-ego_mean0.007456883890596451
sim_compute_robot_state-ego_median0.007340624753166648
sim_compute_robot_state-ego_min0.007013760407765707
sim_compute_sim_state_max0.005177118457280672
sim_compute_sim_state_mean0.0048899833841381385
sim_compute_sim_state_median0.004877721468607585
sim_compute_sim_state_min0.004674311245188994
sim_physics_max0.09033388472520389
sim_physics_mean0.0823160661771826
sim_physics_median0.08065199772516886
sim_physics_min0.07737566788991292
sim_render-ego_max0.011375811237555284
sim_render-ego_mean0.010357434889310086
sim_render-ego_median0.009808941448436064
sim_render-ego_min0.009581935405731202
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.900000000000048
survival_time_min4.249999999999993
No reset possible
265574811Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:07:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3563694912250224
survival_time_median14.950000000000076
deviation-center-line_median0.7145935570900769
in-drivable-lane_median2.8999999999999897


other stats
agent_compute-ego_max0.015855098565419515
agent_compute-ego_mean0.015679575667305788
agent_compute-ego_median0.015770090421040852
agent_compute-ego_min0.015484357844887442
deviation-center-line_max0.9976369226903532
deviation-center-line_mean0.6439386576834926
deviation-center-line_min0.224625728556432
deviation-heading_max4.36137291809262
deviation-heading_mean2.538432251512244
deviation-heading_median2.2953121318863507
deviation-heading_min1.120661082906622
driven_any_max5.164667794012435
driven_any_mean3.0846842204149674
driven_any_median2.913498279297789
driven_any_min1.7135367133187185
driven_lanedir_consec_max2.7279962526779116
driven_lanedir_consec_mean2.034846806338504
driven_lanedir_consec_min1.3085851903755414
driven_lanedir_max5.057464484702477
driven_lanedir_mean2.7604731381133214
driven_lanedir_median2.7279962526779116
driven_lanedir_min1.3085851903755414
in-drivable-lane_max4.550000000000004
in-drivable-lane_mean2.4599999999999973
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.748667269903116, "sim_physics": 0.05735498428344726, "survival_time": 14.950000000000076, "driven_lanedir": 3.338397363575401, "sim_render-ego": 0.006956470012664795, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.015770090421040852, "deviation-heading": 3.753774337748061, "set_robot_commands": 0.006910002231597901, "deviation-center-line": 0.8221995813088615, "driven_lanedir_consec": 2.3563694912250224, "sim_compute_sim_state": 0.003715134461720785, "sim_compute_performance-ego": 0.00407756487528483, "sim_compute_robot_state-ego": 0.005155339241027832}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.913498279297789, "sim_physics": 0.05547664006551107, "survival_time": 14.950000000000076, "driven_lanedir": 2.7279962526779116, "sim_render-ego": 0.007183197339375814, "in-drivable-lane": 0, "agent_compute-ego": 0.015855098565419515, "deviation-heading": 4.36137291809262, "set_robot_commands": 0.007022597789764404, "deviation-center-line": 0.9976369226903532, "driven_lanedir_consec": 2.7279962526779116, "sim_compute_sim_state": 0.003966481685638428, "sim_compute_performance-ego": 0.004032548268636068, "sim_compute_robot_state-ego": 0.005142682393391927}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8830510455427791, "sim_physics": 0.0571300296679787, "survival_time": 9.199999999999996, "driven_lanedir": 1.3085851903755414, "sim_render-ego": 0.007066784993461941, "in-drivable-lane": 4.550000000000004, "agent_compute-ego": 0.015802698290866356, "deviation-heading": 1.120661082906622, "set_robot_commands": 0.007070146177126014, "deviation-center-line": 0.4606374987717388, "driven_lanedir_consec": 1.3085851903755414, "sim_compute_sim_state": 0.00378058267676312, "sim_compute_performance-ego": 0.0039628575677457065, "sim_compute_robot_state-ego": 0.005103965168413909}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7135367133187185, "sim_physics": 0.055106215394301224, "survival_time": 8.649999999999988, "driven_lanedir": 1.3699223992352745, "sim_render-ego": 0.007116450050662707, "in-drivable-lane": 3.3999999999999986, "agent_compute-ego": 0.015484357844887442, "deviation-heading": 1.1610407869275676, "set_robot_commands": 0.006838065351364929, "deviation-center-line": 0.224625728556432, "driven_lanedir_consec": 1.3699223992352745, "sim_compute_sim_state": 0.0036300634373130137, "sim_compute_performance-ego": 0.003944252267738298, "sim_compute_robot_state-ego": 0.005051344116299139}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.164667794012435, "sim_physics": 0.054876271883646646, "survival_time": 14.950000000000076, "driven_lanedir": 5.057464484702477, "sim_render-ego": 0.007047522862752279, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.015485633214314778, "deviation-heading": 2.2953121318863507, "set_robot_commands": 0.006950627168019613, "deviation-center-line": 0.7145935570900769, "driven_lanedir_consec": 2.4113606981787696, "sim_compute_sim_state": 0.0036548590660095215, "sim_compute_performance-ego": 0.003950002193450927, "sim_compute_robot_state-ego": 0.005049746036529541}}
set_robot_commands_max0.007070146177126014
set_robot_commands_mean0.006958287743574572
set_robot_commands_median0.006950627168019613
set_robot_commands_min0.006838065351364929
sim_compute_performance-ego_max0.00407756487528483
sim_compute_performance-ego_mean0.003993445034571165
sim_compute_performance-ego_median0.0039628575677457065
sim_compute_performance-ego_min0.003944252267738298
sim_compute_robot_state-ego_max0.005155339241027832
sim_compute_robot_state-ego_mean0.0051006153911324695
sim_compute_robot_state-ego_median0.005103965168413909
sim_compute_robot_state-ego_min0.005049746036529541
sim_compute_sim_state_max0.003966481685638428
sim_compute_sim_state_mean0.0037494242654889736
sim_compute_sim_state_median0.003715134461720785
sim_compute_sim_state_min0.0036300634373130137
sim_physics_max0.05735498428344726
sim_physics_mean0.055988828258976976
sim_physics_median0.05547664006551107
sim_physics_min0.054876271883646646
sim_render-ego_max0.007183197339375814
sim_render-ego_mean0.007074085051783507
sim_render-ego_median0.007066784993461941
sim_render-ego_min0.006956470012664795
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.540000000000044
survival_time_min8.649999999999988
No reset possible
265544810Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:06:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
265334797Abderrahim Khalifa 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:10:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.676871985575632
survival_time_median14.950000000000076
deviation-center-line_median0.45409359611205086
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01669386386871338
agent_compute-ego_mean0.016509405771891274
agent_compute-ego_median0.016539191404978434
agent_compute-ego_min0.016224300066630046
deviation-center-line_max0.7580607238495035
deviation-center-line_mean0.4766599097799489
deviation-center-line_min0.2111633746872564
deviation-heading_max3.673980256100536
deviation-heading_mean2.396909114350327
deviation-heading_median2.342972317041325
deviation-heading_min0.9997369954466016
driven_any_max2.7301916114209925
driven_any_mean2.6795812954391556
driven_any_median2.7096807200754425
driven_any_min2.541682262718391
driven_lanedir_consec_max2.710801572983404
driven_lanedir_consec_mean2.6153350405533917
driven_lanedir_consec_min2.432461247725398
driven_lanedir_max2.710801572983404
driven_lanedir_mean2.6153350405533917
driven_lanedir_median2.676871985575632
driven_lanedir_min2.432461247725398
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.541682262718391, "sim_physics": 0.05999227364857992, "survival_time": 14.950000000000076, "driven_lanedir": 2.432461247725398, "sim_render-ego": 0.007389233112335205, "in-drivable-lane": 0, "agent_compute-ego": 0.01669386386871338, "deviation-heading": 3.532905740340706, "set_robot_commands": 0.00728821595509847, "deviation-center-line": 0.6789614254454573, "driven_lanedir_consec": 2.432461247725398, "sim_compute_sim_state": 0.004026519457499186, "sim_compute_performance-ego": 0.004401873747507731, "sim_compute_robot_state-ego": 0.005515352884928385}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7301916114209925, "sim_physics": 0.05985323190689087, "survival_time": 14.950000000000076, "driven_lanedir": 2.676871985575632, "sim_render-ego": 0.007440876960754394, "in-drivable-lane": 0, "agent_compute-ego": 0.016539191404978434, "deviation-heading": 2.342972317041325, "set_robot_commands": 0.007117687066396077, "deviation-center-line": 0.45409359611205086, "driven_lanedir_consec": 2.676871985575632, "sim_compute_sim_state": 0.003980750242869059, "sim_compute_performance-ego": 0.004211421807607015, "sim_compute_robot_state-ego": 0.005408611297607422}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7096807200754425, "sim_physics": 0.05769722938537598, "survival_time": 14.950000000000076, "driven_lanedir": 2.578440366019301, "sim_render-ego": 0.007465967337290446, "in-drivable-lane": 0, "agent_compute-ego": 0.01657455523808797, "deviation-heading": 3.673980256100536, "set_robot_commands": 0.0072923366228739425, "deviation-center-line": 0.7580607238495035, "driven_lanedir_consec": 2.578440366019301, "sim_compute_sim_state": 0.003977180322011312, "sim_compute_performance-ego": 0.004166019757588704, "sim_compute_robot_state-ego": 0.0053345847129821775}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.7198700536503693, "sim_physics": 0.05791494448979696, "survival_time": 14.950000000000076, "driven_lanedir": 2.710801572983404, "sim_render-ego": 0.007497884432474772, "in-drivable-lane": 0, "agent_compute-ego": 0.01651511828104655, "deviation-heading": 0.9997369954466016, "set_robot_commands": 0.007259547710418701, "deviation-center-line": 0.2111633746872564, "driven_lanedir_consec": 2.710801572983404, "sim_compute_sim_state": 0.003998048305511474, "sim_compute_performance-ego": 0.004246148268381754, "sim_compute_robot_state-ego": 0.005365871588389079}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6964818293305814, "sim_physics": 0.059322757720947264, "survival_time": 14.950000000000076, "driven_lanedir": 2.6781000304632254, "sim_render-ego": 0.007366805871327718, "in-drivable-lane": 0, "agent_compute-ego": 0.016224300066630046, "deviation-heading": 1.4349502628224655, "set_robot_commands": 0.007038273016611735, "deviation-center-line": 0.2810204288054765, "driven_lanedir_consec": 2.6781000304632254, "sim_compute_sim_state": 0.00410296360651652, "sim_compute_performance-ego": 0.004149711132049561, "sim_compute_robot_state-ego": 0.005338040987650553}}
set_robot_commands_max0.0072923366228739425
set_robot_commands_mean0.007199212074279785
set_robot_commands_median0.007259547710418701
set_robot_commands_min0.007038273016611735
sim_compute_performance-ego_max0.004401873747507731
sim_compute_performance-ego_mean0.0042350349426269526
sim_compute_performance-ego_median0.004211421807607015
sim_compute_performance-ego_min0.004149711132049561
sim_compute_robot_state-ego_max0.005515352884928385
sim_compute_robot_state-ego_mean0.0053924922943115235
sim_compute_robot_state-ego_median0.005365871588389079
sim_compute_robot_state-ego_min0.0053345847129821775
sim_compute_sim_state_max0.00410296360651652
sim_compute_sim_state_mean0.00401709238688151
sim_compute_sim_state_median0.003998048305511474
sim_compute_sim_state_min0.003977180322011312
sim_physics_max0.05999227364857992
sim_physics_mean0.058956087430318195
sim_physics_median0.059322757720947264
sim_physics_min0.05769722938537598
sim_render-ego_max0.007497884432474772
sim_render-ego_mean0.007432153542836507
sim_render-ego_median0.007440876960754394
sim_render-ego_min0.007366805871327718
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
265284793Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:03:18
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
265254790Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:08:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3062391978366903
survival_time_median14.950000000000076
deviation-center-line_median1.18863484383355
in-drivable-lane_median1.2999999999999954


other stats
agent_compute-ego_max0.016261530717213948
agent_compute-ego_mean0.015966523457926214
agent_compute-ego_median0.01601931651433309
agent_compute-ego_min0.015512106266427548
deviation-center-line_max1.224123997652663
deviation-center-line_mean1.0746002136624242
deviation-center-line_min0.7616373010853071
deviation-heading_max5.316387283986056
deviation-heading_mean4.140788310940296
deviation-heading_median4.172912606142142
deviation-heading_min3.0795262539952333
driven_any_max4.283550800262207
driven_any_mean3.954526910461565
driven_any_median4.03172415122128
driven_any_min3.587696970144336
driven_lanedir_consec_max3.8369601435687177
driven_lanedir_consec_mean3.44698091657595
driven_lanedir_consec_min3.1661118891264177
driven_lanedir_max3.8369601435687177
driven_lanedir_mean3.554012213690837
driven_lanedir_median3.6407065923567337
driven_lanedir_min3.2848867599911946
in-drivable-lane_max2.5999999999999908
in-drivable-lane_mean1.3300000000000038
in-drivable-lane_min0.34999999999999876
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.587696970144336, "sim_physics": 0.05826985756556193, "survival_time": 14.950000000000076, "driven_lanedir": 3.3062391978366903, "sim_render-ego": 0.007026944160461426, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.016261530717213948, "deviation-heading": 4.614584717433915, "set_robot_commands": 0.007274503707885742, "deviation-center-line": 1.18863484383355, "driven_lanedir_consec": 3.3062391978366903, "sim_compute_sim_state": 0.004053213596343994, "sim_compute_performance-ego": 0.004100007216135661, "sim_compute_robot_state-ego": 0.005215002695719401}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.283550800262207, "sim_physics": 0.05755380074183146, "survival_time": 14.950000000000076, "driven_lanedir": 3.8369601435687177, "sim_render-ego": 0.007252484162648519, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.016037253538767497, "deviation-heading": 3.520530693144133, "set_robot_commands": 0.007191658020019531, "deviation-center-line": 0.7616373010853071, "driven_lanedir_consec": 3.8369601435687177, "sim_compute_sim_state": 0.004012137254079183, "sim_compute_performance-ego": 0.004087647596995036, "sim_compute_robot_state-ego": 0.005258739789326986}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.806588536894543, "sim_physics": 0.05677505080581557, "survival_time": 14.100000000000064, "driven_lanedir": 3.2848867599911946, "sim_render-ego": 0.007158462882887387, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.015512106266427548, "deviation-heading": 3.0795262539952333, "set_robot_commands": 0.00708424115011878, "deviation-center-line": 1.224123997652663, "driven_lanedir_consec": 3.2848867599911946, "sim_compute_sim_state": 0.003759713037639645, "sim_compute_performance-ego": 0.004056268549980002, "sim_compute_robot_state-ego": 0.005223997941253879}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.03172415122128, "sim_physics": 0.0578514568010966, "survival_time": 14.950000000000076, "driven_lanedir": 3.6407065923567337, "sim_render-ego": 0.007227092583974202, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.01601931651433309, "deviation-heading": 4.172912606142142, "set_robot_commands": 0.007008078893025716, "deviation-center-line": 1.2084669128975762, "driven_lanedir_consec": 3.6407065923567337, "sim_compute_sim_state": 0.0038494571050008137, "sim_compute_performance-ego": 0.004070428212483724, "sim_compute_robot_state-ego": 0.0052591816584269205}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.063074093785459, "sim_physics": 0.05503087361653646, "survival_time": 14.950000000000076, "driven_lanedir": 3.701268374700852, "sim_render-ego": 0.007144316037495931, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.016002410252888996, "deviation-heading": 5.316387283986056, "set_robot_commands": 0.007111423015594483, "deviation-center-line": 0.9901380128430244, "driven_lanedir_consec": 3.1661118891264177, "sim_compute_sim_state": 0.003962029616038004, "sim_compute_performance-ego": 0.004049929777781168, "sim_compute_robot_state-ego": 0.005213402112325033}}
set_robot_commands_max0.007274503707885742
set_robot_commands_mean0.007133980957328851
set_robot_commands_median0.007111423015594483
set_robot_commands_min0.007008078893025716
sim_compute_performance-ego_max0.004100007216135661
sim_compute_performance-ego_mean0.004072856270675118
sim_compute_performance-ego_median0.004070428212483724
sim_compute_performance-ego_min0.004049929777781168
sim_compute_robot_state-ego_max0.0052591816584269205
sim_compute_robot_state-ego_mean0.005234064839410444
sim_compute_robot_state-ego_median0.005223997941253879
sim_compute_robot_state-ego_min0.005213402112325033
sim_compute_sim_state_max0.004053213596343994
sim_compute_sim_state_mean0.003927310121820328
sim_compute_sim_state_median0.003962029616038004
sim_compute_sim_state_min0.003759713037639645
sim_physics_max0.05826985756556193
sim_physics_mean0.05709620790616841
sim_physics_median0.05755380074183146
sim_physics_min0.05503087361653646
sim_render-ego_max0.007252484162648519
sim_render-ego_mean0.007161859965493493
sim_render-ego_median0.007158462882887387
sim_render-ego_min0.007026944160461426
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.780000000000076
survival_time_min14.100000000000064
No reset possible
265244789Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.638452774376698
survival_time_median14.950000000000076
deviation-center-line_median0.94934845721638
in-drivable-lane_median0.9999999999999964


other stats
agent_compute-ego_max0.01619608004887899
agent_compute-ego_mean0.015614846722423636
agent_compute-ego_median0.015477635860443116
agent_compute-ego_min0.015424203077952068
deviation-center-line_max1.393849463264868
deviation-center-line_mean0.8847929081979723
deviation-center-line_min0.4338397249555804
deviation-heading_max3.734188610818608
deviation-heading_mean2.5510823366404876
deviation-heading_median2.3136919394716573
deviation-heading_min1.422700923941168
driven_any_max5.138071660640622
driven_any_mean3.7782856691871833
driven_any_median3.743802454927742
driven_any_min2.2175543095499
driven_lanedir_consec_max4.361474948149988
driven_lanedir_consec_mean2.8142339596054495
driven_lanedir_consec_min1.844891472666905
driven_lanedir_max4.748751117159984
driven_lanedir_mean3.2838924911665615
driven_lanedir_median2.825892143479234
driven_lanedir_min1.844891472666905
in-drivable-lane_max4.4000000000000155
in-drivable-lane_mean1.970000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.743802454927742, "sim_physics": 0.05645626783370972, "survival_time": 14.950000000000076, "driven_lanedir": 2.825892143479234, "sim_render-ego": 0.006996265252431234, "in-drivable-lane": 4.4000000000000155, "agent_compute-ego": 0.01619608004887899, "deviation-heading": 3.7009988877757904, "set_robot_commands": 0.007291904290517171, "deviation-center-line": 0.94934845721638, "driven_lanedir_consec": 2.825892143479234, "sim_compute_sim_state": 0.003808140754699707, "sim_compute_performance-ego": 0.0040935945510864255, "sim_compute_robot_state-ego": 0.005136559804280599}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2175543095499, "sim_physics": 0.0567998060091274, "survival_time": 6.349999999999985, "driven_lanedir": 1.844891472666905, "sim_render-ego": 0.007184818973691445, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.015425601343470296, "deviation-heading": 1.5838313211952126, "set_robot_commands": 0.006800873073067252, "deviation-center-line": 0.4338397249555804, "driven_lanedir_consec": 1.844891472666905, "sim_compute_sim_state": 0.003615715372280812, "sim_compute_performance-ego": 0.00399998229319655, "sim_compute_robot_state-ego": 0.005098048157579317}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.080189526370448, "sim_physics": 0.05592529853185018, "survival_time": 14.950000000000076, "driven_lanedir": 4.361474948149988, "sim_render-ego": 0.006971900463104248, "in-drivable-lane": 3.5499999999999954, "agent_compute-ego": 0.015424203077952068, "deviation-heading": 2.3136919394716573, "set_robot_commands": 0.007061595916748047, "deviation-center-line": 1.065628197105629, "driven_lanedir_consec": 4.361474948149988, "sim_compute_sim_state": 0.0035477399826049803, "sim_compute_performance-ego": 0.004003870487213135, "sim_compute_robot_state-ego": 0.005116092363993327}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.711810394447203, "sim_physics": 0.05681807286030537, "survival_time": 7.399999999999982, "driven_lanedir": 2.638452774376698, "sim_render-ego": 0.0070668023985785405, "in-drivable-lane": 0, "agent_compute-ego": 0.01555071328137372, "deviation-heading": 1.422700923941168, "set_robot_commands": 0.006990463347048373, "deviation-center-line": 0.5812986984474043, "driven_lanedir_consec": 2.638452774376698, "sim_compute_sim_state": 0.0038420171351046177, "sim_compute_performance-ego": 0.004008277042492016, "sim_compute_robot_state-ego": 0.005173734716466955}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.138071660640622, "sim_physics": 0.05294103225072225, "survival_time": 14.950000000000076, "driven_lanedir": 4.748751117159984, "sim_render-ego": 0.006951576073964437, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.015477635860443116, "deviation-heading": 3.734188610818608, "set_robot_commands": 0.0069184088706970214, "deviation-center-line": 1.393849463264868, "driven_lanedir_consec": 2.4004584593544234, "sim_compute_sim_state": 0.0035879198710123696, "sim_compute_performance-ego": 0.003944141864776611, "sim_compute_robot_state-ego": 0.005018808046976725}}
set_robot_commands_max0.007291904290517171
set_robot_commands_mean0.007012649099615573
set_robot_commands_median0.006990463347048373
set_robot_commands_min0.006800873073067252
sim_compute_performance-ego_max0.0040935945510864255
sim_compute_performance-ego_mean0.0040099732477529475
sim_compute_performance-ego_median0.004003870487213135
sim_compute_performance-ego_min0.003944141864776611
sim_compute_robot_state-ego_max0.005173734716466955
sim_compute_robot_state-ego_mean0.005108648617859384
sim_compute_robot_state-ego_median0.005116092363993327
sim_compute_robot_state-ego_min0.005018808046976725
sim_compute_sim_state_max0.0038420171351046177
sim_compute_sim_state_mean0.0036803066231404975
sim_compute_sim_state_median0.003615715372280812
sim_compute_sim_state_min0.0035477399826049803
sim_physics_max0.05681807286030537
sim_physics_mean0.05578809549714299
sim_physics_median0.05645626783370972
sim_physics_min0.05294103225072225
sim_render-ego_max0.007184818973691445
sim_render-ego_mean0.007034272632353981
sim_render-ego_median0.006996265252431234
sim_render-ego_min0.006951576073964437
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.72000000000004
survival_time_min6.349999999999985
No reset possible
265234788Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:06:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
264844762Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0032132824391302
survival_time_median3.4999999999999956
deviation-center-line_median0.1393096748038641
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.041063868269628406
agent_compute-ego_mean0.03633182308591057
agent_compute-ego_median0.0357778271039327
agent_compute-ego_min0.03237067084563406
deviation-center-line_max0.21470168394840183
deviation-center-line_mean0.15737952184266185
deviation-center-line_min0.11627814627007038
deviation-heading_max0.959255894362388
deviation-heading_mean0.6784940963578678
deviation-heading_median0.5668769378595191
deviation-heading_min0.49163039208077847
driven_any_max1.6345453939194
driven_any_mean1.1507803016151434
driven_any_median1.0467720104643856
driven_any_min0.9979929190600206
driven_lanedir_consec_max1.2625473746849665
driven_lanedir_consec_mean0.9476285533790424
driven_lanedir_consec_min0.6219972746096386
driven_lanedir_max1.2625473746849665
driven_lanedir_mean0.9476285533790424
driven_lanedir_median1.0032132824391302
driven_lanedir_min0.6219972746096386
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.6499999999999977
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0467720104643856, "sim_physics": 0.10458391904830933, "survival_time": 3.7999999999999945, "driven_lanedir": 0.6219972746096386, "sim_render-ego": 0.012162632063815468, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.03237067084563406, "deviation-heading": 0.5668769378595191, "set_robot_commands": 0.00873779623132003, "deviation-center-line": 0.11627814627007038, "driven_lanedir_consec": 0.6219972746096386, "sim_compute_sim_state": 0.005333812613236277, "sim_compute_performance-ego": 0.007538560189698872, "sim_compute_robot_state-ego": 0.009197959774418882}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0274569547739147, "sim_physics": 0.13417485782078334, "survival_time": 2.4499999999999993, "driven_lanedir": 1.0032132824391302, "sim_render-ego": 0.01305108167687241, "in-drivable-lane": 0, "agent_compute-ego": 0.041063868269628406, "deviation-heading": 0.49163039208077847, "set_robot_commands": 0.010723887657632634, "deviation-center-line": 0.13656047356886294, "driven_lanedir_consec": 1.0032132824391302, "sim_compute_sim_state": 0.005984622604992925, "sim_compute_performance-ego": 0.00743340472785794, "sim_compute_robot_state-ego": 0.011188074034087512}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9979929190600206, "sim_physics": 0.12596100398472376, "survival_time": 3.4999999999999956, "driven_lanedir": 0.8368346959109265, "sim_render-ego": 0.012706003870282857, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.03711354732513428, "deviation-heading": 0.8160208437928237, "set_robot_commands": 0.01034344264439174, "deviation-center-line": 0.21470168394840183, "driven_lanedir_consec": 0.8368346959109265, "sim_compute_sim_state": 0.0058577707835606166, "sim_compute_performance-ego": 0.007591366767883301, "sim_compute_robot_state-ego": 0.009684876033238005}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6345453939194, "sim_physics": 0.11709096908569336, "survival_time": 4.99999999999999, "driven_lanedir": 1.2625473746849665, "sim_render-ego": 0.013296854496002198, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.03533320188522339, "deviation-heading": 0.959255894362388, "set_robot_commands": 0.009982326030731202, "deviation-center-line": 0.18004763062210996, "driven_lanedir_consec": 1.2625473746849665, "sim_compute_sim_state": 0.006092314720153809, "sim_compute_performance-ego": 0.008143532276153564, "sim_compute_robot_state-ego": 0.009957211017608644}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0471342298579964, "sim_physics": 0.11685973405838011, "survival_time": 2.3999999999999995, "driven_lanedir": 1.0135501392505506, "sim_render-ego": 0.013277634978294373, "in-drivable-lane": 0, "agent_compute-ego": 0.0357778271039327, "deviation-heading": 0.5586864136938303, "set_robot_commands": 0.009503131111462912, "deviation-center-line": 0.1393096748038641, "driven_lanedir_consec": 1.0135501392505506, "sim_compute_sim_state": 0.005338991681734721, "sim_compute_performance-ego": 0.008070603013038635, "sim_compute_robot_state-ego": 0.010726953546206156}}
set_robot_commands_max0.010723887657632634
set_robot_commands_mean0.009858116735107704
set_robot_commands_median0.009982326030731202
set_robot_commands_min0.00873779623132003
sim_compute_performance-ego_max0.008143532276153564
sim_compute_performance-ego_mean0.007755493394926464
sim_compute_performance-ego_median0.007591366767883301
sim_compute_performance-ego_min0.00743340472785794
sim_compute_robot_state-ego_max0.011188074034087512
sim_compute_robot_state-ego_mean0.01015101488111184
sim_compute_robot_state-ego_median0.009957211017608644
sim_compute_robot_state-ego_min0.009197959774418882
sim_compute_sim_state_max0.006092314720153809
sim_compute_sim_state_mean0.00572150248073567
sim_compute_sim_state_median0.0058577707835606166
sim_compute_sim_state_min0.005333812613236277
sim_physics_max0.13417485782078334
sim_physics_mean0.119734096799578
sim_physics_median0.11709096908569336
sim_physics_min0.10458391904830933
sim_render-ego_max0.013296854496002198
sim_render-ego_mean0.01289884141705346
sim_render-ego_median0.01305108167687241
sim_render-ego_min0.012162632063815468
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.4299999999999953
survival_time_min2.3999999999999995
No reset possible
264754757Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|New_Dataaido3-LF-sim-testingstep1-simulationabortednoip-172-31-46-148-104920:13:57
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
264714755Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:06:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1732557987600627
survival_time_median6.999999999999983
deviation-center-line_median0.5799427079059366
in-drivable-lane_median0.5499999999999998


other stats
agent_compute-ego_max0.016229449966807426
agent_compute-ego_mean0.01579876391274889
agent_compute-ego_median0.01575901800272416
agent_compute-ego_min0.015523156097957066
deviation-center-line_max0.7910362516842379
deviation-center-line_mean0.5633672858078831
deviation-center-line_min0.14662153135631828
deviation-heading_max3.000627291372028
deviation-heading_mean1.8949413285037964
deviation-heading_median1.73072549305765
deviation-heading_min0.8477702014998912
driven_any_max5.494761905596924
driven_any_mean2.7679851093156542
driven_any_median2.241443447491798
driven_any_min1.0181004439680146
driven_lanedir_consec_max4.868853346857284
driven_lanedir_consec_mean2.483799138770318
driven_lanedir_consec_min0.6673041336407499
driven_lanedir_max4.868853346857284
driven_lanedir_mean2.4838421652640323
driven_lanedir_median2.1732557987600627
driven_lanedir_min0.6675192661093201
in-drivable-lane_max2.55
in-drivable-lane_mean0.9199999999999988
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0181004439680146, "sim_physics": 0.05717415574156208, "survival_time": 4.049999999999994, "driven_lanedir": 0.6675192661093201, "sim_render-ego": 0.007179707656671972, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.016229449966807426, "deviation-heading": 0.8477702014998912, "set_robot_commands": 0.007479290903350453, "deviation-center-line": 0.14662153135631828, "driven_lanedir_consec": 0.6673041336407499, "sim_compute_sim_state": 0.003610637452867296, "sim_compute_performance-ego": 0.004215673164085105, "sim_compute_robot_state-ego": 0.005103334968472704}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.241443447491798, "sim_physics": 0.05903842430988341, "survival_time": 6.549999999999985, "driven_lanedir": 2.1732557987600627, "sim_render-ego": 0.007165843293867038, "in-drivable-lane": 0, "agent_compute-ego": 0.015533915002837436, "deviation-heading": 1.3984408605929393, "set_robot_commands": 0.006978457210628131, "deviation-center-line": 0.509318593330244, "driven_lanedir_consec": 2.1732557987600627, "sim_compute_sim_state": 0.0037082588399639568, "sim_compute_performance-ego": 0.003994985391165464, "sim_compute_robot_state-ego": 0.0051723327345520485}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.494761905596924, "sim_physics": 0.05660347143809, "survival_time": 14.950000000000076, "driven_lanedir": 4.868853346857284, "sim_render-ego": 0.0070733785629272464, "in-drivable-lane": 2.55, "agent_compute-ego": 0.015948280493418374, "deviation-heading": 2.497142795996474, "set_robot_commands": 0.006805225213368734, "deviation-center-line": 0.7899173447626788, "driven_lanedir_consec": 4.868853346857284, "sim_compute_sim_state": 0.003553589185078939, "sim_compute_performance-ego": 0.003984330495198567, "sim_compute_robot_state-ego": 0.005107607841491699}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9961682622895225, "sim_physics": 0.05664813688823155, "survival_time": 6.999999999999983, "driven_lanedir": 1.8202263026293692, "sim_render-ego": 0.0071199076516287665, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.015523156097957066, "deviation-heading": 1.73072549305765, "set_robot_commands": 0.007015207835606167, "deviation-center-line": 0.5799427079059366, "driven_lanedir_consec": 1.8202263026293692, "sim_compute_sim_state": 0.003663103921072823, "sim_compute_performance-ego": 0.004023936816624232, "sim_compute_robot_state-ego": 0.005087063993726458}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.089451487232012, "sim_physics": 0.056091765968167055, "survival_time": 9.800000000000004, "driven_lanedir": 2.8893561119641262, "sim_render-ego": 0.0071004969733101985, "in-drivable-lane": 0, "agent_compute-ego": 0.01575901800272416, "deviation-heading": 3.000627291372028, "set_robot_commands": 0.007151507601446035, "deviation-center-line": 0.7910362516842379, "driven_lanedir_consec": 2.8893561119641262, "sim_compute_sim_state": 0.0037592746773544624, "sim_compute_performance-ego": 0.003997280889627885, "sim_compute_robot_state-ego": 0.005103094237191337}}
set_robot_commands_max0.007479290903350453
set_robot_commands_mean0.007085937752879903
set_robot_commands_median0.007015207835606167
set_robot_commands_min0.006805225213368734
sim_compute_performance-ego_max0.004215673164085105
sim_compute_performance-ego_mean0.004043241351340251
sim_compute_performance-ego_median0.003997280889627885
sim_compute_performance-ego_min0.003984330495198567
sim_compute_robot_state-ego_max0.0051723327345520485
sim_compute_robot_state-ego_mean0.005114686755086849
sim_compute_robot_state-ego_median0.005103334968472704
sim_compute_robot_state-ego_min0.005087063993726458
sim_compute_sim_state_max0.0037592746773544624
sim_compute_sim_state_mean0.003658972815267496
sim_compute_sim_state_median0.003663103921072823
sim_compute_sim_state_min0.003553589185078939
sim_physics_max0.05903842430988341
sim_physics_mean0.057111190869186826
sim_physics_median0.05664813688823155
sim_physics_min0.056091765968167055
sim_render-ego_max0.007179707656671972
sim_render-ego_mean0.007127866827681045
sim_render-ego_median0.0071199076516287665
sim_render-ego_min0.0070733785629272464
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.47000000000001
survival_time_min4.049999999999994
No reset possible
264674752Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.180231319385676
survival_time_median14.950000000000076
deviation-center-line_median0.7564121048381124
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.04532279729843139
agent_compute-ego_mean0.041557462568406936
agent_compute-ego_median0.04102721611658732
agent_compute-ego_min0.03881568619699189
deviation-center-line_max0.9924867540766492
deviation-center-line_mean0.6358213882518158
deviation-center-line_min0.29353187358378796
deviation-heading_max3.2548039114891454
deviation-heading_mean2.3182264843222717
deviation-heading_median2.833477470899634
deviation-heading_min1.1635929105729153
driven_any_max4.92044567220622
driven_any_mean3.4876908303798095
driven_any_median3.6292162746654726
driven_any_min2.3328508847775455
driven_lanedir_consec_max4.816113544542033
driven_lanedir_consec_mean3.1813103551063557
driven_lanedir_consec_min1.9096843577199192
driven_lanedir_max4.816113544542033
driven_lanedir_mean3.1813103551063557
driven_lanedir_median3.180231319385676
driven_lanedir_min1.9096843577199192
in-drivable-lane_max2.0999999999999925
in-drivable-lane_mean1.1100000000000083
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.6292162746654726, "sim_physics": 0.08455021301905315, "survival_time": 14.950000000000076, "driven_lanedir": 3.180231319385676, "sim_render-ego": 0.01015424648920695, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.04102721611658732, "deviation-heading": 3.2548039114891454, "set_robot_commands": 0.008410193125406902, "deviation-center-line": 0.9924867540766492, "driven_lanedir_consec": 3.180231319385676, "sim_compute_sim_state": 0.0044592634836832686, "sim_compute_performance-ego": 0.006190032958984375, "sim_compute_robot_state-ego": 0.007789489428202311}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.1346649378627225, "sim_physics": 0.0964745052655538, "survival_time": 14.950000000000076, "driven_lanedir": 3.725949509994065, "sim_render-ego": 0.010979321002960203, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.04532279729843139, "deviation-heading": 2.94498759029194, "set_robot_commands": 0.009088151454925536, "deviation-center-line": 0.7564121048381124, "driven_lanedir_consec": 3.725949509994065, "sim_compute_sim_state": 0.0047201784451802575, "sim_compute_performance-ego": 0.006454241275787353, "sim_compute_robot_state-ego": 0.008043220043182373}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4212763823870884, "sim_physics": 0.07592482315866571, "survival_time": 6.649999999999984, "driven_lanedir": 1.9096843577199192, "sim_render-ego": 0.009613103436348134, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.03972581454685757, "deviation-heading": 1.1635929105729153, "set_robot_commands": 0.007018442440750007, "deviation-center-line": 0.32973160869267415, "driven_lanedir_consec": 1.9096843577199192, "sim_compute_sim_state": 0.004112704355913894, "sim_compute_performance-ego": 0.005406793795133892, "sim_compute_robot_state-ego": 0.006977251597813198}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.92044567220622, "sim_physics": 0.08329338947931926, "survival_time": 14.950000000000076, "driven_lanedir": 4.816113544542033, "sim_render-ego": 0.01020050048828125, "in-drivable-lane": 0, "agent_compute-ego": 0.0428957986831665, "deviation-heading": 2.833477470899634, "set_robot_commands": 0.0076422031720479325, "deviation-center-line": 0.8069446000678551, "driven_lanedir_consec": 4.816113544542033, "sim_compute_sim_state": 0.004167072772979737, "sim_compute_performance-ego": 0.0059440708160400394, "sim_compute_robot_state-ego": 0.007580075263977051}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3328508847775455, "sim_physics": 0.07031305269761519, "survival_time": 6.5999999999999845, "driven_lanedir": 2.2745730438900837, "sim_render-ego": 0.008792844685641203, "in-drivable-lane": 0, "agent_compute-ego": 0.03881568619699189, "deviation-heading": 1.3942705383577243, "set_robot_commands": 0.006482593940966057, "deviation-center-line": 0.29353187358378796, "driven_lanedir_consec": 2.2745730438900837, "sim_compute_sim_state": 0.003733616886716901, "sim_compute_performance-ego": 0.004973050319787228, "sim_compute_robot_state-ego": 0.00637655547170928}}
set_robot_commands_max0.009088151454925536
set_robot_commands_mean0.007728316826819287
set_robot_commands_median0.0076422031720479325
set_robot_commands_min0.006482593940966057
sim_compute_performance-ego_max0.006454241275787353
sim_compute_performance-ego_mean0.005793637833146578
sim_compute_performance-ego_median0.0059440708160400394
sim_compute_performance-ego_min0.004973050319787228
sim_compute_robot_state-ego_max0.008043220043182373
sim_compute_robot_state-ego_mean0.007353318360976843
sim_compute_robot_state-ego_median0.007580075263977051
sim_compute_robot_state-ego_min0.00637655547170928
sim_compute_sim_state_max0.0047201784451802575
sim_compute_sim_state_mean0.004238567188894812
sim_compute_sim_state_median0.004167072772979737
sim_compute_sim_state_min0.003733616886716901
sim_physics_max0.0964745052655538
sim_physics_mean0.08211119672404141
sim_physics_median0.08329338947931926
sim_physics_min0.07031305269761519
sim_render-ego_max0.010979321002960203
sim_render-ego_mean0.009948003220487549
sim_render-ego_median0.01015424648920695
sim_render-ego_min0.008792844685641203
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.62000000000004
survival_time_min6.5999999999999845
No reset possible
264664751Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:06:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6536108756007648
survival_time_median6.149999999999986
deviation-center-line_median0.3971105178635427
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.01619782098909704
agent_compute-ego_mean0.01572621523146083
agent_compute-ego_median0.01568207639328977
agent_compute-ego_min0.015258579923395525
deviation-center-line_max0.6023610549845185
deviation-center-line_mean0.41034291741694745
deviation-center-line_min0.20718551620134296
deviation-heading_max2.429329936052752
deviation-heading_mean1.6566461990476646
deviation-heading_median1.982670104995317
deviation-heading_min0.6903437197926351
driven_any_max4.78864099340019
driven_any_mean2.6498883900715393
driven_any_median1.8583853231173568
driven_any_min1.1067424962447143
driven_lanedir_consec_max4.3809586040380335
driven_lanedir_consec_mean2.3518628747822548
driven_lanedir_consec_min0.96232422451049
driven_lanedir_max4.3809586040380335
driven_lanedir_mean2.3539855114519765
driven_lanedir_median1.6536108756007648
driven_lanedir_min0.96232422451049
in-drivable-lane_max1.8000000000000256
in-drivable-lane_mean1.080000000000008
in-drivable-lane_min0.549999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8583853231173568, "sim_physics": 0.05648852169998293, "survival_time": 6.149999999999986, "driven_lanedir": 1.6536108756007648, "sim_render-ego": 0.007053043784164801, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.01619782098909704, "deviation-heading": 0.9544743289060292, "set_robot_commands": 0.007041268232392102, "deviation-center-line": 0.20718551620134296, "driven_lanedir_consec": 1.6536108756007648, "sim_compute_sim_state": 0.003581425038779654, "sim_compute_performance-ego": 0.004165715318385179, "sim_compute_robot_state-ego": 0.00540566832069459}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.83913223642863, "sim_physics": 0.05665077148599828, "survival_time": 11.750000000000032, "driven_lanedir": 3.462668807128324, "sim_render-ego": 0.007087224595090176, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.01568207639328977, "deviation-heading": 2.226412905491591, "set_robot_commands": 0.007004699301212392, "deviation-center-line": 0.5561571909700553, "driven_lanedir_consec": 3.462668807128324, "sim_compute_sim_state": 0.0037072252719960314, "sim_compute_performance-ego": 0.004016681427651264, "sim_compute_robot_state-ego": 0.005087963063666161}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1067424962447143, "sim_physics": 0.05562739690144857, "survival_time": 3.7499999999999942, "driven_lanedir": 0.96232422451049, "sim_render-ego": 0.007279138565063476, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.015585635503133138, "deviation-heading": 0.6903437197926351, "set_robot_commands": 0.006716210047403972, "deviation-center-line": 0.28890030706527775, "driven_lanedir_consec": 0.96232422451049, "sim_compute_sim_state": 0.003517436981201172, "sim_compute_performance-ego": 0.004001948038736979, "sim_compute_robot_state-ego": 0.005148296356201172}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6565409011668062, "sim_physics": 0.05257795358958997, "survival_time": 5.699999999999988, "driven_lanedir": 1.3103650459822702, "sim_render-ego": 0.007205105664437278, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.015258579923395525, "deviation-heading": 2.429329936052752, "set_robot_commands": 0.006839438488608913, "deviation-center-line": 0.3971105178635427, "driven_lanedir_consec": 1.2997518626336615, "sim_compute_sim_state": 0.003653490752504583, "sim_compute_performance-ego": 0.0039790115858379166, "sim_compute_robot_state-ego": 0.005108553066588284}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.78864099340019, "sim_physics": 0.05632116476694743, "survival_time": 14.950000000000076, "driven_lanedir": 4.3809586040380335, "sim_render-ego": 0.007031384309132894, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.015906963348388672, "deviation-heading": 1.982670104995317, "set_robot_commands": 0.007085177103678385, "deviation-center-line": 0.6023610549845185, "driven_lanedir_consec": 4.3809586040380335, "sim_compute_sim_state": 0.0038320350646972655, "sim_compute_performance-ego": 0.003955294291178385, "sim_compute_robot_state-ego": 0.005043418407440186}}
set_robot_commands_max0.007085177103678385
set_robot_commands_mean0.006937358634659152
set_robot_commands_median0.007004699301212392
set_robot_commands_min0.006716210047403972
sim_compute_performance-ego_max0.004165715318385179
sim_compute_performance-ego_mean0.004023730132357945
sim_compute_performance-ego_median0.004001948038736979
sim_compute_performance-ego_min0.003955294291178385
sim_compute_robot_state-ego_max0.00540566832069459
sim_compute_robot_state-ego_mean0.00515877984291808
sim_compute_robot_state-ego_median0.005108553066588284
sim_compute_robot_state-ego_min0.005043418407440186
sim_compute_sim_state_max0.0038320350646972655
sim_compute_sim_state_mean0.003658322621835741
sim_compute_sim_state_median0.003653490752504583
sim_compute_sim_state_min0.003517436981201172
sim_physics_max0.05665077148599828
sim_physics_mean0.05553316168879343
sim_physics_median0.05632116476694743
sim_physics_min0.05257795358958997
sim_render-ego_max0.007279138565063476
sim_render-ego_mean0.007131179383577725
sim_render-ego_median0.007087224595090176
sim_render-ego_min0.007031384309132894
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.460000000000017
survival_time_min3.7499999999999942
No reset possible
264614749Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:05:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.276778906996244
survival_time_median8.04999999999998
deviation-center-line_median0.5164513478396517
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.03587841177449643
agent_compute-ego_mean0.032413277692123356
agent_compute-ego_median0.03424700680157996
agent_compute-ego_min0.024761231865469864
deviation-center-line_max0.6384673952901011
deviation-center-line_mean0.45873313763317025
deviation-center-line_min0.2715152496021592
deviation-heading_max2.255464485444501
deviation-heading_mean1.618608062749768
deviation-heading_median1.695214513146692
deviation-heading_min1.038254477871197
driven_any_max4.4592230106293025
driven_any_mean3.019154195678957
driven_any_median2.5279906954239624
driven_any_min1.9218900625715176
driven_lanedir_consec_max4.104781762807063
driven_lanedir_consec_mean2.658770210530728
driven_lanedir_consec_min1.6950137208155571
driven_lanedir_max4.104781762807063
driven_lanedir_mean2.658770210530728
driven_lanedir_median2.276778906996244
driven_lanedir_min1.6950137208155571
in-drivable-lane_max3.699999999999988
in-drivable-lane_mean1.2700000000000022
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9218900625715176, "sim_physics": 0.056840292112095146, "survival_time": 6.349999999999985, "driven_lanedir": 1.7182417640789198, "sim_render-ego": 0.0071200310714601535, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.024761231865469864, "deviation-heading": 1.038254477871197, "set_robot_commands": 0.006292521484254852, "deviation-center-line": 0.31903170760723537, "driven_lanedir_consec": 1.7182417640789198, "sim_compute_sim_state": 0.003373200499166654, "sim_compute_performance-ego": 0.0042016487421951895, "sim_compute_robot_state-ego": 0.005156503887627069}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.751410002378659, "sim_physics": 0.05636193567109339, "survival_time": 10.300000000000011, "driven_lanedir": 3.499034897955856, "sim_render-ego": 0.007144358551617965, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.03587841177449643, "deviation-heading": 1.695214513146692, "set_robot_commands": 0.00503688877068677, "deviation-center-line": 0.5164513478396517, "driven_lanedir_consec": 3.499034897955856, "sim_compute_sim_state": 0.0030434629292164033, "sim_compute_performance-ego": 0.0040076022009247715, "sim_compute_robot_state-ego": 0.005162913822433324}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5279906954239624, "sim_physics": 0.05364433726908998, "survival_time": 8.04999999999998, "driven_lanedir": 1.6950137208155571, "sim_render-ego": 0.007137856868483265, "in-drivable-lane": 3.699999999999988, "agent_compute-ego": 0.03223378910041003, "deviation-heading": 1.042719642727164, "set_robot_commands": 0.005045456915908719, "deviation-center-line": 0.2715152496021592, "driven_lanedir_consec": 1.6950137208155571, "sim_compute_sim_state": 0.0029977537830423863, "sim_compute_performance-ego": 0.004001790692347177, "sim_compute_robot_state-ego": 0.005110314173728043}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4352572073913437, "sim_physics": 0.05618837969192606, "survival_time": 7.549999999999981, "driven_lanedir": 2.276778906996244, "sim_render-ego": 0.0071767687008080895, "in-drivable-lane": 0, "agent_compute-ego": 0.03424700680157996, "deviation-heading": 2.255464485444501, "set_robot_commands": 0.005017763731495434, "deviation-center-line": 0.6384673952901011, "driven_lanedir_consec": 2.276778906996244, "sim_compute_sim_state": 0.003075403882967715, "sim_compute_performance-ego": 0.004015362025886182, "sim_compute_robot_state-ego": 0.005178419959466189}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.4592230106293025, "sim_physics": 0.056769788966459386, "survival_time": 12.750000000000046, "driven_lanedir": 4.104781762807063, "sim_render-ego": 0.007117767894969267, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.03494594891866048, "deviation-heading": 2.0613871945592868, "set_robot_commands": 0.005041692771163641, "deviation-center-line": 0.5481999878267041, "driven_lanedir_consec": 4.104781762807063, "sim_compute_sim_state": 0.003051473580154718, "sim_compute_performance-ego": 0.00401922861735026, "sim_compute_robot_state-ego": 0.005185602225509344}}
set_robot_commands_max0.006292521484254852
set_robot_commands_mean0.005286864734701883
set_robot_commands_median0.005041692771163641
set_robot_commands_min0.005017763731495434
sim_compute_performance-ego_max0.0042016487421951895
sim_compute_performance-ego_mean0.004049126455740716
sim_compute_performance-ego_median0.004015362025886182
sim_compute_performance-ego_min0.004001790692347177
sim_compute_robot_state-ego_max0.005185602225509344
sim_compute_robot_state-ego_mean0.005158750813752794
sim_compute_robot_state-ego_median0.005162913822433324
sim_compute_robot_state-ego_min0.005110314173728043
sim_compute_sim_state_max0.003373200499166654
sim_compute_sim_state_mean0.0031082589349095756
sim_compute_sim_state_median0.003051473580154718
sim_compute_sim_state_min0.0029977537830423863
sim_physics_max0.056840292112095146
sim_physics_mean0.05596094674213279
sim_physics_median0.05636193567109339
sim_physics_min0.05364433726908998
sim_render-ego_max0.0071767687008080895
sim_render-ego_mean0.007139356617467748
sim_render-ego_median0.007137856868483265
sim_render-ego_min0.007117767894969267
simulation-passed1
survival_time_max12.750000000000046
survival_time_mean9
survival_time_min6.349999999999985
No reset possible
264494742Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:08:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
264444739Nikolaus Howechallenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:07:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.686473218527503
survival_time_median11.400000000000029
deviation-center-line_median0.5578495892384109
in-drivable-lane_median0


other stats
agent_compute-ego_max0.017319574534335982
agent_compute-ego_mean0.01653243600881108
agent_compute-ego_median0.016640054552178634
agent_compute-ego_min0.015851098696390786
deviation-center-line_max1.004634571231995
deviation-center-line_mean0.5618060644838161
deviation-center-line_min0.1473651847621907
deviation-heading_max3.8866087142928714
deviation-heading_mean1.957732571271185
deviation-heading_median1.4187190527164038
deviation-heading_min1.139194646978012
driven_any_max2.349155715045775
driven_any_mean1.7127354906165628
driven_any_median1.77857731889237
driven_any_min0.7984899584819327
driven_lanedir_consec_max2.315161173721691
driven_lanedir_consec_mean1.6453445225690153
driven_lanedir_consec_min0.7493019083219123
driven_lanedir_max2.315161173721691
driven_lanedir_mean1.6453445225690153
driven_lanedir_median1.686473218527503
driven_lanedir_min0.7493019083219123
in-drivable-lane_max0.30000000000000426
in-drivable-lane_mean0.06000000000000085
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7984899584819327, "sim_physics": 0.06233717125152873, "survival_time": 5.349999999999989, "driven_lanedir": 0.7493019083219123, "sim_render-ego": 0.007445199467311396, "in-drivable-lane": 0, "agent_compute-ego": 0.017319574534335982, "deviation-heading": 1.211066952507355, "set_robot_commands": 0.0071011570012458015, "deviation-center-line": 0.1473651847621907, "driven_lanedir_consec": 0.7493019083219123, "sim_compute_sim_state": 0.003876220400088301, "sim_compute_performance-ego": 0.0044903866598539266, "sim_compute_robot_state-ego": 0.0055234320809908}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.77857731889237, "sim_physics": 0.05917060270644071, "survival_time": 11.400000000000029, "driven_lanedir": 1.686473218527503, "sim_render-ego": 0.007528651178928844, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.016640054552178634, "deviation-heading": 1.4187190527164038, "set_robot_commands": 0.007140984660700748, "deviation-center-line": 0.5578495892384109, "driven_lanedir_consec": 1.686473218527503, "sim_compute_sim_state": 0.0038162794029503538, "sim_compute_performance-ego": 0.004212577092020135, "sim_compute_robot_state-ego": 0.005407093909748814}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490918058255765, "sim_physics": 0.05729347944259643, "survival_time": 14.950000000000076, "driven_lanedir": 2.206701418964404, "sim_render-ego": 0.00720439354578654, "in-drivable-lane": 0, "agent_compute-ego": 0.015851098696390786, "deviation-heading": 3.8866087142928714, "set_robot_commands": 0.006997727553049724, "deviation-center-line": 1.004634571231995, "driven_lanedir_consec": 2.206701418964404, "sim_compute_sim_state": 0.003659071127573649, "sim_compute_performance-ego": 0.004121566613515218, "sim_compute_robot_state-ego": 0.0053321329752604165}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2883626548371605, "sim_physics": 0.05778942707769885, "survival_time": 8.349999999999984, "driven_lanedir": 1.2690848933095655, "sim_render-ego": 0.007355759957593358, "in-drivable-lane": 0, "agent_compute-ego": 0.016117935409089047, "deviation-heading": 1.139194646978012, "set_robot_commands": 0.007196259355830575, "deviation-center-line": 0.42792785777316406, "driven_lanedir_consec": 1.2690848933095655, "sim_compute_sim_state": 0.003860880514818751, "sim_compute_performance-ego": 0.0041348534429858546, "sim_compute_robot_state-ego": 0.005181913604279478}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349155715045775, "sim_physics": 0.0602147118250529, "survival_time": 14.950000000000076, "driven_lanedir": 2.315161173721691, "sim_render-ego": 0.007474188804626465, "in-drivable-lane": 0, "agent_compute-ego": 0.016733516852060953, "deviation-heading": 2.133073489861284, "set_robot_commands": 0.007124343713124593, "deviation-center-line": 0.6712531194133194, "driven_lanedir_consec": 2.315161173721691, "sim_compute_sim_state": 0.0040346844991048176, "sim_compute_performance-ego": 0.004248290061950683, "sim_compute_robot_state-ego": 0.005451822280883789}}
set_robot_commands_max0.007196259355830575
set_robot_commands_mean0.007112094456790288
set_robot_commands_median0.007124343713124593
set_robot_commands_min0.006997727553049724
sim_compute_performance-ego_max0.0044903866598539266
sim_compute_performance-ego_mean0.004241534774065163
sim_compute_performance-ego_median0.004212577092020135
sim_compute_performance-ego_min0.004121566613515218
sim_compute_robot_state-ego_max0.0055234320809908
sim_compute_robot_state-ego_mean0.005379278970232659
sim_compute_robot_state-ego_median0.005407093909748814
sim_compute_robot_state-ego_min0.005181913604279478
sim_compute_sim_state_max0.0040346844991048176
sim_compute_sim_state_mean0.0038494271889071745
sim_compute_sim_state_median0.003860880514818751
sim_compute_sim_state_min0.003659071127573649
sim_physics_max0.06233717125152873
sim_physics_mean0.05936107846066353
sim_physics_median0.05917060270644071
sim_physics_min0.05729347944259643
sim_render-ego_max0.007528651178928844
sim_render-ego_mean0.00740163859084932
sim_render-ego_median0.007445199467311396
sim_render-ego_min0.00720439354578654
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.000000000000032
survival_time_min5.349999999999989
No reset possible
264384734Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:03:42
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
264244725Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:04:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
264204723Nikolaus Howechallenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:07:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8704563634205569
survival_time_median12.100000000000035
deviation-center-line_median0.7378947054142359
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01723567396402359
agent_compute-ego_mean0.016536228033957732
agent_compute-ego_median0.016340767253528943
agent_compute-ego_min0.016226194699605307
deviation-center-line_max0.8695444976128545
deviation-center-line_mean0.5816232602175959
deviation-center-line_min0.17683967171038625
deviation-heading_max3.742413992237288
deviation-heading_mean1.831680707228183
deviation-heading_median1.4250423406665096
deviation-heading_min1.066176985332147
driven_any_max2.3491511426695904
driven_any_mean1.7143385449180355
driven_any_median1.891070107459486
driven_any_min0.7101227567332122
driven_lanedir_consec_max2.319650288893772
driven_lanedir_consec_mean1.6489009546377205
driven_lanedir_consec_min0.6491449155646886
driven_lanedir_max2.319650288893772
driven_lanedir_mean1.6489009546377205
driven_lanedir_median1.8704563634205569
driven_lanedir_min0.6491449155646886
in-drivable-lane_max0.34999999999999876
in-drivable-lane_mean0.09999999999999964
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7101227567332122, "sim_physics": 0.06081900745630264, "survival_time": 4.799999999999991, "driven_lanedir": 0.6491449155646886, "sim_render-ego": 0.007520509262879689, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.01723567396402359, "deviation-heading": 1.066176985332147, "set_robot_commands": 0.007345698773860931, "deviation-center-line": 0.17683967171038625, "driven_lanedir_consec": 0.6491449155646886, "sim_compute_sim_state": 0.003782664736111959, "sim_compute_performance-ego": 0.0044547344247500105, "sim_compute_robot_state-ego": 0.005392750104268392}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.891070107459486, "sim_physics": 0.06025023992396583, "survival_time": 12.100000000000035, "driven_lanedir": 1.8704563634205569, "sim_render-ego": 0.007410623810508035, "in-drivable-lane": 0, "agent_compute-ego": 0.016302316642004596, "deviation-heading": 1.2714111358903906, "set_robot_commands": 0.007144152625533175, "deviation-center-line": 0.7394973826998698, "driven_lanedir_consec": 1.8704563634205569, "sim_compute_sim_state": 0.0037948996567529094, "sim_compute_performance-ego": 0.0042273121431839365, "sim_compute_robot_state-ego": 0.005465271059146597}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.349074595584367, "sim_physics": 0.058191854953765866, "survival_time": 14.950000000000076, "driven_lanedir": 2.1617553792773223, "sim_render-ego": 0.00751406192779541, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.016226194699605307, "deviation-heading": 3.742413992237288, "set_robot_commands": 0.007028626600901286, "deviation-center-line": 0.8695444976128545, "driven_lanedir_consec": 2.1617553792773223, "sim_compute_sim_state": 0.0038004215558369954, "sim_compute_performance-ego": 0.004249619642893473, "sim_compute_robot_state-ego": 0.005447328090667725}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.272274122143524, "sim_physics": 0.060281233354048294, "survival_time": 8.249999999999982, "driven_lanedir": 1.243497826032263, "sim_render-ego": 0.007448233980121035, "in-drivable-lane": 0, "agent_compute-ego": 0.016340767253528943, "deviation-heading": 1.4250423406665096, "set_robot_commands": 0.006996033408425071, "deviation-center-line": 0.384340043650633, "driven_lanedir_consec": 1.243497826032263, "sim_compute_sim_state": 0.00390514460476962, "sim_compute_performance-ego": 0.004231564203898112, "sim_compute_robot_state-ego": 0.005354074998335405}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491511426695904, "sim_physics": 0.05920612573623657, "survival_time": 14.950000000000076, "driven_lanedir": 2.319650288893772, "sim_render-ego": 0.007419118086496989, "in-drivable-lane": 0, "agent_compute-ego": 0.016576187610626222, "deviation-heading": 1.6533590820145827, "set_robot_commands": 0.007167611916859945, "deviation-center-line": 0.7378947054142359, "driven_lanedir_consec": 2.319650288893772, "sim_compute_sim_state": 0.003920021851857503, "sim_compute_performance-ego": 0.004327418804168701, "sim_compute_robot_state-ego": 0.005427412986755371}}
set_robot_commands_max0.007345698773860931
set_robot_commands_mean0.007136424665116081
set_robot_commands_median0.007144152625533175
set_robot_commands_min0.006996033408425071
sim_compute_performance-ego_max0.0044547344247500105
sim_compute_performance-ego_mean0.004298129843778847
sim_compute_performance-ego_median0.004249619642893473
sim_compute_performance-ego_min0.0042273121431839365
sim_compute_robot_state-ego_max0.005465271059146597
sim_compute_robot_state-ego_mean0.0054173674478346975
sim_compute_robot_state-ego_median0.005427412986755371
sim_compute_robot_state-ego_min0.005354074998335405
sim_compute_sim_state_max0.003920021851857503
sim_compute_sim_state_mean0.0038406304810657977
sim_compute_sim_state_median0.0038004215558369954
sim_compute_sim_state_min0.003782664736111959
sim_physics_max0.06081900745630264
sim_physics_mean0.05974969228486384
sim_physics_median0.06025023992396583
sim_physics_min0.058191854953765866
sim_render-ego_max0.007520509262879689
sim_render-ego_mean0.007462509413560231
sim_render-ego_median0.007448233980121035
sim_render-ego_min0.007410623810508035
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.010000000000034
survival_time_min4.799999999999991
No reset possible
264164720Nikolaus Howechallenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:05:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
264134718Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:05:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30263376647737616
survival_time_median4.6499999999999915
deviation-center-line_median0.36398684049182384
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11166070684601988
agent_compute-ego_mean0.10275137777722657
agent_compute-ego_median0.10039683054852228
agent_compute-ego_min0.09840960912807012
deviation-center-line_max0.5225072131467805
deviation-center-line_mean0.3969430075190281
deviation-center-line_min0.3316079016089587
deviation-heading_max1.9747532586969172
deviation-heading_mean1.713590514238425
deviation-heading_median1.8542584291074349
deviation-heading_min1.1110297443400146
driven_any_max0.869138768304522
driven_any_mean0.45027092980025785
driven_any_median0.3257426722730581
driven_any_min0.2502710008873628
driven_lanedir_consec_max0.8523147843322575
driven_lanedir_consec_mean0.4291941965248469
driven_lanedir_consec_min0.23825852954247195
driven_lanedir_max0.8523147843322575
driven_lanedir_mean0.4291941965248469
driven_lanedir_median0.30263376647737616
driven_lanedir_min0.23825852954247195
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.32574264949924187, "sim_physics": 0.05718620618184408, "survival_time": 4.6499999999999915, "driven_lanedir": 0.30263376647737616, "sim_render-ego": 0.0071842285894578506, "in-drivable-lane": 0, "agent_compute-ego": 0.10039683054852228, "deviation-heading": 1.7022704028643072, "set_robot_commands": 0.005042809312061597, "deviation-center-line": 0.3316079016089587, "driven_lanedir_consec": 0.30263376647737616, "sim_compute_sim_state": 0.002943082522320491, "sim_compute_performance-ego": 0.004201122509535923, "sim_compute_robot_state-ego": 0.005219664624942246}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2502710008873628, "sim_physics": 0.05732437682478395, "survival_time": 3.649999999999995, "driven_lanedir": 0.23825852954247195, "sim_render-ego": 0.007106006961979278, "in-drivable-lane": 0, "agent_compute-ego": 0.09877289811225788, "deviation-heading": 1.1110297443400146, "set_robot_commands": 0.004943929306448322, "deviation-center-line": 0.36398684049182384, "driven_lanedir_consec": 0.23825852954247195, "sim_compute_sim_state": 0.002924791754108586, "sim_compute_performance-ego": 0.003921691685506742, "sim_compute_robot_state-ego": 0.0051000118255615234}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4804595580371048, "sim_physics": 0.055667852287861835, "survival_time": 6.699999999999984, "driven_lanedir": 0.45586266075786686, "sim_render-ego": 0.007091168147414478, "in-drivable-lane": 0, "agent_compute-ego": 0.1045168442512626, "deviation-heading": 1.9747532586969172, "set_robot_commands": 0.004947738860970113, "deviation-center-line": 0.4323748643984328, "driven_lanedir_consec": 0.45586266075786686, "sim_compute_sim_state": 0.0029316998239773424, "sim_compute_performance-ego": 0.003943487779418034, "sim_compute_robot_state-ego": 0.005067570885615562}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.869138768304522, "sim_physics": 0.052828410506751466, "survival_time": 11.850000000000032, "driven_lanedir": 0.8523147843322575, "sim_render-ego": 0.007071028278849799, "in-drivable-lane": 0, "agent_compute-ego": 0.11166070684601988, "deviation-heading": 1.8542584291074349, "set_robot_commands": 0.004960489675465515, "deviation-center-line": 0.5225072131467805, "driven_lanedir_consec": 0.8523147843322575, "sim_compute_sim_state": 0.0029393479793886597, "sim_compute_performance-ego": 0.003962025863711844, "sim_compute_robot_state-ego": 0.005077962633929675}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3257426722730581, "sim_physics": 0.05560836227991248, "survival_time": 4.6499999999999915, "driven_lanedir": 0.296901241514262, "sim_render-ego": 0.007116797149822276, "in-drivable-lane": 0, "agent_compute-ego": 0.09840960912807012, "deviation-heading": 1.9256407361834489, "set_robot_commands": 0.004973865324451077, "deviation-center-line": 0.33423821794914477, "driven_lanedir_consec": 0.296901241514262, "sim_compute_sim_state": 0.0029419904114097676, "sim_compute_performance-ego": 0.003951067565589822, "sim_compute_robot_state-ego": 0.005077479988016108}}
set_robot_commands_max0.005042809312061597
set_robot_commands_mean0.004973766495879326
set_robot_commands_median0.004960489675465515
set_robot_commands_min0.004943929306448322
sim_compute_performance-ego_max0.004201122509535923
sim_compute_performance-ego_mean0.003995879080752473
sim_compute_performance-ego_median0.003951067565589822
sim_compute_performance-ego_min0.003921691685506742
sim_compute_robot_state-ego_max0.005219664624942246
sim_compute_robot_state-ego_mean0.005108537991613023
sim_compute_robot_state-ego_median0.005077962633929675
sim_compute_robot_state-ego_min0.005067570885615562
sim_compute_sim_state_max0.002943082522320491
sim_compute_sim_state_mean0.002936182498240969
sim_compute_sim_state_median0.0029393479793886597
sim_compute_sim_state_min0.002924791754108586
sim_physics_max0.05732437682478395
sim_physics_mean0.05572304161623076
sim_physics_median0.055667852287861835
sim_physics_min0.052828410506751466
sim_render-ego_max0.0071842285894578506
sim_render-ego_mean0.007113845825504736
sim_render-ego_median0.007106006961979278
sim_render-ego_min0.007071028278849799
simulation-passed1
survival_time_max11.850000000000032
survival_time_mean6.299999999999999
survival_time_min3.649999999999995
No reset possible
264074715Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4388584665717872
survival_time_median1.950000000000001
deviation-center-line_median0.12819145569744891
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11476839505709134
agent_compute-ego_mean0.10446719160439596
agent_compute-ego_median0.09932314958728727
agent_compute-ego_min0.09809270586286271
deviation-center-line_max0.25235857251367166
deviation-center-line_mean0.1551437118060746
deviation-center-line_min0.1143981257605448
deviation-heading_max0.5590143056061156
deviation-heading_mean0.47235735111280414
deviation-heading_median0.4764764965977753
deviation-heading_min0.34533969548933086
driven_any_max1.6117654009210771
driven_any_mean0.750850143173565
driven_any_median0.4517426541007419
driven_any_min0.29808489874630034
driven_lanedir_consec_max0.7515131841253101
driven_lanedir_consec_mean0.5105873496008475
driven_lanedir_consec_min0.2892964986537614
driven_lanedir_max0.7515131841253101
driven_lanedir_mean0.5105873496008475
driven_lanedir_median0.4388584665717872
driven_lanedir_min0.2892964986537614
in-drivable-lane_max3.049999999999989
in-drivable-lane_mean0.8099999999999972
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4517426541007419, "sim_physics": 0.05911845427293043, "survival_time": 1.950000000000001, "driven_lanedir": 0.4388584665717872, "sim_render-ego": 0.007329115500816932, "in-drivable-lane": 0, "agent_compute-ego": 0.11476839505709134, "deviation-heading": 0.4764764965977753, "set_robot_commands": 0.004985876572437775, "deviation-center-line": 0.12812703204769765, "driven_lanedir_consec": 0.4388584665717872, "sim_compute_sim_state": 0.0030058102729992988, "sim_compute_performance-ego": 0.004301719176463592, "sim_compute_robot_state-ego": 0.005229075749715169}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.29808489874630034, "sim_physics": 0.059641667774745395, "survival_time": 1.4000000000000006, "driven_lanedir": 0.2892964986537614, "sim_render-ego": 0.007206508091517857, "in-drivable-lane": 0, "agent_compute-ego": 0.09858494997024536, "deviation-heading": 0.34533969548933086, "set_robot_commands": 0.00493438754762922, "deviation-center-line": 0.12819145569744891, "driven_lanedir_consec": 0.2892964986537614, "sim_compute_sim_state": 0.0029816201754978727, "sim_compute_performance-ego": 0.003921057496752057, "sim_compute_robot_state-ego": 0.0051966990743364605}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9968108632872804, "sim_physics": 0.056717646427643605, "survival_time": 3.899999999999994, "driven_lanedir": 0.6970475300212535, "sim_render-ego": 0.007102296902583196, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.11156675754449306, "deviation-heading": 0.5590143056061156, "set_robot_commands": 0.005013413918324006, "deviation-center-line": 0.15264337301101008, "driven_lanedir_consec": 0.6970475300212535, "sim_compute_sim_state": 0.002993345260620117, "sim_compute_performance-ego": 0.003929948195433006, "sim_compute_robot_state-ego": 0.0052103446080134464}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6117654009210771, "sim_physics": 0.0563823082407967, "survival_time": 6.099999999999986, "driven_lanedir": 0.7515131841253101, "sim_render-ego": 0.007030719616374031, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.09932314958728727, "deviation-heading": 0.42279268353727606, "set_robot_commands": 0.004757715053245669, "deviation-center-line": 0.25235857251367166, "driven_lanedir_consec": 0.7515131841253101, "sim_compute_sim_state": 0.0029547800783251152, "sim_compute_performance-ego": 0.003912403935291728, "sim_compute_robot_state-ego": 0.005027941015900158}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3958468988124253, "sim_physics": 0.0595444815499442, "survival_time": 1.7500000000000009, "driven_lanedir": 0.37622106863212545, "sim_render-ego": 0.007197979518345424, "in-drivable-lane": 0, "agent_compute-ego": 0.09809270586286271, "deviation-heading": 0.5581635743335231, "set_robot_commands": 0.004919099807739258, "deviation-center-line": 0.1143981257605448, "driven_lanedir_consec": 0.37622106863212545, "sim_compute_sim_state": 0.002976349421909878, "sim_compute_performance-ego": 0.003911127362932478, "sim_compute_robot_state-ego": 0.005096748897007533}}
set_robot_commands_max0.005013413918324006
set_robot_commands_mean0.004922098579875186
set_robot_commands_median0.00493438754762922
set_robot_commands_min0.004757715053245669
sim_compute_performance-ego_max0.004301719176463592
sim_compute_performance-ego_mean0.003995251233374572
sim_compute_performance-ego_median0.003921057496752057
sim_compute_performance-ego_min0.003911127362932478
sim_compute_robot_state-ego_max0.005229075749715169
sim_compute_robot_state-ego_mean0.005152161868994553
sim_compute_robot_state-ego_median0.0051966990743364605
sim_compute_robot_state-ego_min0.005027941015900158
sim_compute_sim_state_max0.0030058102729992988
sim_compute_sim_state_mean0.0029823810418704564
sim_compute_sim_state_median0.0029816201754978727
sim_compute_sim_state_min0.0029547800783251152
sim_physics_max0.059641667774745395
sim_physics_mean0.058280911653212066
sim_physics_median0.05911845427293043
sim_physics_min0.0563823082407967
sim_render-ego_max0.007329115500816932
sim_render-ego_mean0.007173323925927488
sim_render-ego_median0.007197979518345424
sim_render-ego_min0.007030719616374031
simulation-passed1
survival_time_max6.099999999999986
survival_time_mean3.019999999999997
survival_time_min1.4000000000000006
No reset possible
264014711Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7408002868977004
survival_time_median9.5
deviation-center-line_median0.5744638946033098
in-drivable-lane_median0.70000000000001


other stats
agent_compute-ego_max0.02169908123251833
agent_compute-ego_mean0.01945852691052292
agent_compute-ego_median0.01934015564620495
agent_compute-ego_min0.01612083535445364
deviation-center-line_max1.35269747963319
deviation-center-line_mean0.7028013078255129
deviation-center-line_min0.33044520837328356
deviation-heading_max3.70173281877917
deviation-heading_mean2.542223265400495
deviation-heading_median2.916156912691451
deviation-heading_min1.201803342082269
driven_any_max5.380767241348604
driven_any_mean3.459706312973668
driven_any_median3.15980240578875
driven_any_min2.091782093233998
driven_lanedir_consec_max5.184040368549669
driven_lanedir_consec_mean3.127224163043331
driven_lanedir_consec_min2.0401443858296804
driven_lanedir_max5.184040368549669
driven_lanedir_mean3.13985483625574
driven_lanedir_median2.802437834500293
driven_lanedir_min2.0401443858296804
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.6700000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.775220916330747, "sim_physics": 0.05954285383224487, "survival_time": 14.950000000000076, "driven_lanedir": 3.1417474789560376, "sim_render-ego": 0.007248272895812988, "in-drivable-lane": 1.3000000000000034, "agent_compute-ego": 0.01917059103647868, "deviation-heading": 3.3872345136120865, "set_robot_commands": 0.007020543416341146, "deviation-center-line": 0.8816203864068076, "driven_lanedir_consec": 3.1417474789560376, "sim_compute_sim_state": 0.004264828364054362, "sim_compute_performance-ego": 0.004313243230183919, "sim_compute_robot_state-ego": 0.005345931053161621}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.15980240578875, "sim_physics": 0.05800705959922389, "survival_time": 9.5, "driven_lanedir": 2.802437834500293, "sim_render-ego": 0.0074381414212678605, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.01612083535445364, "deviation-heading": 2.916156912691451, "set_robot_commands": 0.00741914197018272, "deviation-center-line": 0.5744638946033098, "driven_lanedir_consec": 2.7408002868977004, "sim_compute_sim_state": 0.004377904691194233, "sim_compute_performance-ego": 0.0041847492519177885, "sim_compute_robot_state-ego": 0.005274409996835809}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.380767241348604, "sim_physics": 0.07625023285547892, "survival_time": 14.950000000000076, "driven_lanedir": 5.184040368549669, "sim_render-ego": 0.009640672206878665, "in-drivable-lane": 0, "agent_compute-ego": 0.020961971282958985, "deviation-heading": 3.70173281877917, "set_robot_commands": 0.009687148729960123, "deviation-center-line": 1.35269747963319, "driven_lanedir_consec": 5.184040368549669, "sim_compute_sim_state": 0.004917174975077311, "sim_compute_performance-ego": 0.0057748985290527344, "sim_compute_robot_state-ego": 0.007108109792073568}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.091782093233998, "sim_physics": 0.07065460458397865, "survival_time": 6.399999999999985, "driven_lanedir": 2.0401443858296804, "sim_render-ego": 0.00905432552099228, "in-drivable-lane": 0, "agent_compute-ego": 0.01934015564620495, "deviation-heading": 1.201803342082269, "set_robot_commands": 0.009573820978403091, "deviation-center-line": 0.33044520837328356, "driven_lanedir_consec": 2.0401443858296804, "sim_compute_sim_state": 0.004834551364183426, "sim_compute_performance-ego": 0.005346581339836121, "sim_compute_robot_state-ego": 0.006504291668534279}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8909589081662412, "sim_physics": 0.0768890012929469, "survival_time": 8.09999999999998, "driven_lanedir": 2.530904113443019, "sim_render-ego": 0.010232941603954928, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02169908123251833, "deviation-heading": 1.5041887398374971, "set_robot_commands": 0.00913662674986286, "deviation-center-line": 0.3747795701109733, "driven_lanedir_consec": 2.529388294983567, "sim_compute_sim_state": 0.00524165012218334, "sim_compute_performance-ego": 0.006093765482490445, "sim_compute_robot_state-ego": 0.007366888317061059}}
set_robot_commands_max0.009687148729960123
set_robot_commands_mean0.008567456368949988
set_robot_commands_median0.00913662674986286
set_robot_commands_min0.007020543416341146
sim_compute_performance-ego_max0.006093765482490445
sim_compute_performance-ego_mean0.0051426475666962014
sim_compute_performance-ego_median0.005346581339836121
sim_compute_performance-ego_min0.0041847492519177885
sim_compute_robot_state-ego_max0.007366888317061059
sim_compute_robot_state-ego_mean0.006319926165533267
sim_compute_robot_state-ego_median0.006504291668534279
sim_compute_robot_state-ego_min0.005274409996835809
sim_compute_sim_state_max0.00524165012218334
sim_compute_sim_state_mean0.004727221903338534
sim_compute_sim_state_median0.004834551364183426
sim_compute_sim_state_min0.004264828364054362
sim_physics_max0.0768890012929469
sim_physics_mean0.06826875043277465
sim_physics_median0.07065460458397865
sim_physics_min0.05800705959922389
sim_render-ego_max0.010232941603954928
sim_render-ego_mean0.008722870729781344
sim_render-ego_median0.00905432552099228
sim_render-ego_min0.007248272895812988
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.780000000000024
survival_time_min6.399999999999985
No reset possible
263994710Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:09:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.790778679236674
survival_time_median14.950000000000076
deviation-center-line_median0.7310226575532021
in-drivable-lane_median0.05000000000000071


other stats
agent_compute-ego_max0.01676743427912394
agent_compute-ego_mean0.01599068674368736
agent_compute-ego_median0.01580620527267456
agent_compute-ego_min0.015625207470013544
deviation-center-line_max1.010514967655496
deviation-center-line_mean0.7463504745396846
deviation-center-line_min0.514359011476507
deviation-heading_max3.786442074423767
deviation-heading_mean3.0016068299693845
deviation-heading_median3.2681800731972026
deviation-heading_min1.955856272253208
driven_any_max5.011333200046496
driven_any_mean4.186535512493334
driven_any_median4.436298697898124
driven_any_min3.1125496553689183
driven_lanedir_consec_max4.918704556721701
driven_lanedir_consec_mean3.914263679863232
driven_lanedir_consec_min2.7037508981984275
driven_lanedir_max4.918704556721701
driven_lanedir_mean3.932603125004394
driven_lanedir_median3.790778679236674
driven_lanedir_min2.7954481239042344
in-drivable-lane_max1.8500000000000263
in-drivable-lane_mean0.490000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5164195246076995, "sim_physics": 0.05792067925135295, "survival_time": 14.950000000000076, "driven_lanedir": 3.3790406784407665, "sim_render-ego": 0.007173385620117188, "in-drivable-lane": 0, "agent_compute-ego": 0.01676743427912394, "deviation-heading": 3.786442074423767, "set_robot_commands": 0.007373860677083333, "deviation-center-line": 1.010514967655496, "driven_lanedir_consec": 3.3790406784407665, "sim_compute_sim_state": 0.004510226249694824, "sim_compute_performance-ego": 0.004195396900177002, "sim_compute_robot_state-ego": 0.0052927764256795245}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1125496553689183, "sim_physics": 0.058942753535050615, "survival_time": 10.400000000000013, "driven_lanedir": 2.7954481239042344, "sim_render-ego": 0.007259273758301368, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.015625207470013544, "deviation-heading": 3.2681800731972026, "set_robot_commands": 0.007003362362201397, "deviation-center-line": 0.514359011476507, "driven_lanedir_consec": 2.7037508981984275, "sim_compute_sim_state": 0.004168032453610347, "sim_compute_performance-ego": 0.004047094629361079, "sim_compute_robot_state-ego": 0.0052085736623177165}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.011333200046496, "sim_physics": 0.056697493394215905, "survival_time": 14.950000000000076, "driven_lanedir": 4.918704556721701, "sim_render-ego": 0.007952107588450113, "in-drivable-lane": 0, "agent_compute-ego": 0.015727957089742024, "deviation-heading": 2.471133539347276, "set_robot_commands": 0.007212204933166504, "deviation-center-line": 0.936896108518434, "driven_lanedir_consec": 4.918704556721701, "sim_compute_sim_state": 0.004198400179545084, "sim_compute_performance-ego": 0.004027055104573568, "sim_compute_robot_state-ego": 0.005195733706156413}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.85607648454543, "sim_physics": 0.058531608581542965, "survival_time": 14.950000000000076, "driven_lanedir": 4.779043586718592, "sim_render-ego": 0.007130277951558431, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.016026629606882732, "deviation-heading": 1.955856272253208, "set_robot_commands": 0.007342277367909749, "deviation-center-line": 0.5389596274947845, "driven_lanedir_consec": 4.779043586718592, "sim_compute_sim_state": 0.004282662868499756, "sim_compute_performance-ego": 0.004054591655731201, "sim_compute_robot_state-ego": 0.005205698808034261}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.436298697898124, "sim_physics": 0.05918785095214844, "survival_time": 14.950000000000076, "driven_lanedir": 3.790778679236674, "sim_render-ego": 0.0070259618759155274, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.01580620527267456, "deviation-heading": 3.526422190625469, "set_robot_commands": 0.00711328109105428, "deviation-center-line": 0.7310226575532021, "driven_lanedir_consec": 3.790778679236674, "sim_compute_sim_state": 0.004162911574045817, "sim_compute_performance-ego": 0.00396133025487264, "sim_compute_robot_state-ego": 0.0050914510091145835}}
set_robot_commands_max0.007373860677083333
set_robot_commands_mean0.007208997286283052
set_robot_commands_median0.007212204933166504
set_robot_commands_min0.007003362362201397
sim_compute_performance-ego_max0.004195396900177002
sim_compute_performance-ego_mean0.004057093708943098
sim_compute_performance-ego_median0.004047094629361079
sim_compute_performance-ego_min0.00396133025487264
sim_compute_robot_state-ego_max0.0052927764256795245
sim_compute_robot_state-ego_mean0.0051988467222605
sim_compute_robot_state-ego_median0.005205698808034261
sim_compute_robot_state-ego_min0.0050914510091145835
sim_compute_sim_state_max0.004510226249694824
sim_compute_sim_state_mean0.004264446665079165
sim_compute_sim_state_median0.004198400179545084
sim_compute_sim_state_min0.004162911574045817
sim_physics_max0.05918785095214844
sim_physics_mean0.05825607714286217
sim_physics_median0.058531608581542965
sim_physics_min0.056697493394215905
sim_render-ego_max0.007952107588450113
sim_render-ego_mean0.007308201358868525
sim_render-ego_median0.007173385620117188
sim_render-ego_min0.0070259618759155274
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.040000000000065
survival_time_min10.400000000000013
No reset possible
263914705Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationabortednoip-172-31-46-148-104920:02:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
263834701Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailednoip-172-31-46-148-104920:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 43, in compute_action
               ||     observation = self.preprocessor.preprocess(observation)
               ||   File "/workspace/wrappers.py", line 19, in preprocess
               ||     observation = cv2.resize((observation * 255).astype(np.uint8), self.shape[0:2])
               || AttributeError: 'Tensor' object has no attribute 'astype'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
263804700Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailednoip-172-31-46-148-104920:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 300, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/PIL/Image.py", line 2645, in fromarray
               ||     mode, rawmode = _fromarray_typemap[typekey]
               || KeyError: ((1, 1, 3), '<f4')
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 39, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 21, in preprocess
               ||     observation = Image.fromarray(observation)
               ||   File "/usr/local/lib/python3.7/site-packages/PIL/Image.py", line 2647, in fromarray
               ||     raise TypeError("Cannot handle this data type")
               || TypeError: Cannot handle this data type
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
               || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method PytorchRLTemplateAgent.on_received_observations of <__main__.PytorchRLTemplateAgent object at 0x7f6fe3b4d110>>.
               || │       f: instance of method:
               || │          <bound method PytorchRLTemplateAgent.on_received_observations of <__main__.PytorchRLTemplateAgent object at 0x7f6fe3b4d110>>
               || │    args: dict
               || │          │ data: Duckiebot1Observations(camera=JPGImage(jpg_data=58255 bytes b'\xff\xd8\xff\xe0\x00\x10JFIF'))
               || │ argspec: <class 'inspect.FullArgSpec'>
               || │          #0 [`self`, `data`]
               || │          #1 None
               || │          #2 None
               || │          #3 None
               || │          #4 []
               || │          #5 None
               || │          #6 dict
               || │             │ data:
               || │             │ dataclass aido_schemas.schemas.Duckiebot1Observations
               || │             │  field camera : dataclass aido_schemas.schemas.JPGImage 
               || │             │                  field jpg_data : bytes                 
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
263794699Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailednoip-172-31-46-148-104920:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 43, in compute_action
               ||     observation = self.preprocessor.preprocess(observation)
               ||   File "/workspace/wrappers.py", line 18, in preprocess
               ||     observation = cv2.resize(observation, self.shape[0:2])
               || TypeError: Expected cv::UMat for argument 'src'
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
               || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7fe3f34b1110>>.
               || │       f: instance of method:
               || │          <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7fe3f34b1110>>
               || │    args: dict
               || │          │ context:
               || │          │ instance of ConcreteContext:
               || │          │ <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fe3889e2850>
               || │ argspec: <class 'inspect.FullArgSpec'>
               || │          #0 [`self`, `context`]
               || │          #1 None
               || │          #2 None
               || │          #3 None
               || │          #4 []
               || │          #5 None
               || │          #6 dict
               || │             │ context: <class 'zuper_nodes_wrapper.interface.Context'>
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
263754697Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6360997067961869
survival_time_median2.3
deviation-center-line_median0.14372728802436863
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.02166213353474935
agent_compute-ego_mean0.02120225874494392
agent_compute-ego_median0.021183112393254815
agent_compute-ego_min0.020693170613255995
deviation-center-line_max0.28866317094516875
deviation-center-line_mean0.15106227921097554
deviation-center-line_min0.04302146368229905
deviation-heading_max1.256838519865154
deviation-heading_mean0.6050507088590319
deviation-heading_median0.5541047006007359
deviation-heading_min0.2087431422699759
driven_any_max2.3924984473750093
driven_any_mean1.1594851965683053
driven_any_median0.9578023191140856
driven_any_min0.3660980221552506
driven_lanedir_consec_max2.268904348962969
driven_lanedir_consec_mean0.9429764729630762
driven_lanedir_consec_min0.31314705783966956
driven_lanedir_max2.268904348962969
driven_lanedir_mean0.9429764729630762
driven_lanedir_median0.6360997067961869
driven_lanedir_min0.31314705783966956
in-drivable-lane_max1.4999999999999951
in-drivable-lane_mean0.3499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4710905408673214, "sim_physics": 0.059469108581542966, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6360997067961869, "sim_render-ego": 0.007250785827636719, "in-drivable-lane": 1.4999999999999951, "agent_compute-ego": 0.02166213353474935, "deviation-heading": 1.256838519865154, "set_robot_commands": 0.004987691243489583, "deviation-center-line": 0.13126811679476613, "driven_lanedir_consec": 0.6360997067961869, "sim_compute_sim_state": 0.002896575927734375, "sim_compute_performance-ego": 0.00426307996114095, "sim_compute_robot_state-ego": 0.005127223332722982}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6099366533298585, "sim_physics": 0.05925097958794955, "survival_time": 1.4500000000000006, "driven_lanedir": 0.604360038238329, "sim_render-ego": 0.007259640200384732, "in-drivable-lane": 0, "agent_compute-ego": 0.020693170613255995, "deviation-heading": 0.2087431422699759, "set_robot_commands": 0.005041985676206392, "deviation-center-line": 0.14372728802436863, "driven_lanedir_consec": 0.604360038238329, "sim_compute_sim_state": 0.002897714746409449, "sim_compute_performance-ego": 0.004018092977589574, "sim_compute_robot_state-ego": 0.0052921114296748725}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3924984473750093, "sim_physics": 0.05456635187257011, "survival_time": 5.299999999999989, "driven_lanedir": 2.268904348962969, "sim_render-ego": 0.007083616166744592, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.021463540365111153, "deviation-heading": 0.5541047006007359, "set_robot_commands": 0.004914807823469054, "deviation-center-line": 0.28866317094516875, "driven_lanedir_consec": 2.268904348962969, "sim_compute_sim_state": 0.002885771247575868, "sim_compute_performance-ego": 0.003972314438729916, "sim_compute_robot_state-ego": 0.005128950442907945}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3660980221552506, "sim_physics": 0.059131047942421654, "survival_time": 1.1000000000000003, "driven_lanedir": 0.31314705783966956, "sim_render-ego": 0.0073565786535089665, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02100933681834828, "deviation-heading": 0.28679392752346955, "set_robot_commands": 0.00498575514013117, "deviation-center-line": 0.04302146368229905, "driven_lanedir_consec": 0.31314705783966956, "sim_compute_sim_state": 0.0029579617760398173, "sim_compute_performance-ego": 0.003977147015658292, "sim_compute_robot_state-ego": 0.005197915163907138}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9578023191140856, "sim_physics": 0.060377582259800125, "survival_time": 2.3, "driven_lanedir": 0.8923712129782262, "sim_render-ego": 0.010810955711033032, "in-drivable-lane": 0, "agent_compute-ego": 0.021183112393254815, "deviation-heading": 0.718773254035824, "set_robot_commands": 0.005009081052697223, "deviation-center-line": 0.14863135660827506, "driven_lanedir_consec": 0.8923712129782262, "sim_compute_sim_state": 0.0029214776080587635, "sim_compute_performance-ego": 0.003967684248219366, "sim_compute_robot_state-ego": 0.005181887875432553}}
set_robot_commands_max0.005041985676206392
set_robot_commands_mean0.004987864187198685
set_robot_commands_median0.004987691243489583
set_robot_commands_min0.004914807823469054
sim_compute_performance-ego_max0.00426307996114095
sim_compute_performance-ego_mean0.0040396637282676204
sim_compute_performance-ego_median0.003977147015658292
sim_compute_performance-ego_min0.003967684248219366
sim_compute_robot_state-ego_max0.0052921114296748725
sim_compute_robot_state-ego_mean0.005185617648929098
sim_compute_robot_state-ego_median0.005181887875432553
sim_compute_robot_state-ego_min0.005127223332722982
sim_compute_sim_state_max0.0029579617760398173
sim_compute_sim_state_mean0.0029119002611636548
sim_compute_sim_state_median0.002897714746409449
sim_compute_sim_state_min0.002885771247575868
sim_physics_max0.060377582259800125
sim_physics_mean0.05855901404885688
sim_physics_median0.05925097958794955
sim_physics_min0.05456635187257011
sim_render-ego_max0.010810955711033032
sim_render-ego_mean0.00795231531186161
sim_render-ego_median0.007259640200384732
sim_render-ego_min0.007083616166744592
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean2.7799999999999967
survival_time_min1.1000000000000003
No reset possible
263424565Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|Andrew_Activationaido3-LF-real-validationeval1-visualizesuccessnoip-172-31-46-148-104920:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec5.171676016842344
survival_time24
deviation-center-line1.256312572371143
in-drivable-lane7.333399999999996


other stats
deviation-heading3.1184390456143216
driven_any7.275620485627301
driven_lanedir5.171676016842344
visualized-eval1-passed1
No reset possible
263394565Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|Andrew_Activationaido3-LF-real-validationeval0-videossuccessnoip-172-31-46-148-104920:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
262384631César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationfailednoip-172-31-46-148-104920:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 137, in on_received_get_commands
               ||     if math.fabs(s_angle)<=10 and math.fabs(s_angle)>0:
               || NameError: name 's_angle' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
262234621César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
262094614Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7536796816441469
survival_time_median1.850000000000001
deviation-center-line_median0.11405960084693136
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0235117773214976
agent_compute-ego_mean0.022216724941919848
agent_compute-ego_median0.022409549399987978
agent_compute-ego_min0.02117782831192017
deviation-center-line_max0.17723387917582736
deviation-center-line_mean0.11505628789950596
deviation-center-line_min0.04376175547063839
deviation-heading_max1.4591516210701467
deviation-heading_mean0.5327300289032024
deviation-heading_median0.31446864773708677
deviation-heading_min0.2623901021669374
driven_any_max1.2474142760515623
driven_any_mean0.7935519093784582
driven_any_median0.8462204709833995
driven_any_min0.39313321778987487
driven_lanedir_consec_max1.0132441340473612
driven_lanedir_consec_mean0.6805846610208279
driven_lanedir_consec_min0.3687251037890211
driven_lanedir_max1.0132441340473612
driven_lanedir_mean0.6805846610208279
driven_lanedir_median0.7536796816441469
driven_lanedir_min0.3687251037890211
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.1399999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2474142760515623, "sim_physics": 0.06106823237974252, "survival_time": 3.349999999999996, "driven_lanedir": 0.7536796816441469, "sim_render-ego": 0.007249166716390581, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.022409549399987978, "deviation-heading": 1.4591516210701467, "set_robot_commands": 0.005068778991699219, "deviation-center-line": 0.17723387917582736, "driven_lanedir_consec": 0.7536796816441469, "sim_compute_sim_state": 0.002897130909250743, "sim_compute_performance-ego": 0.004182537989829903, "sim_compute_robot_state-ego": 0.005177586825925912}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0248791390738976, "sim_physics": 0.05484401095997204, "survival_time": 2.2, "driven_lanedir": 1.0132441340473612, "sim_render-ego": 0.007032416083595969, "in-drivable-lane": 0, "agent_compute-ego": 0.02117782831192017, "deviation-heading": 0.31446864773708677, "set_robot_commands": 0.004858894781632857, "deviation-center-line": 0.16703837143109346, "driven_lanedir_consec": 1.0132441340473612, "sim_compute_sim_state": 0.002846533601934259, "sim_compute_performance-ego": 0.00388601151379672, "sim_compute_robot_state-ego": 0.0051176818934353914}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4561124429935566, "sim_physics": 0.06116255124409994, "survival_time": 1.2000000000000004, "driven_lanedir": 0.43042483871585446, "sim_render-ego": 0.007325520118077596, "in-drivable-lane": 0, "agent_compute-ego": 0.0235117773214976, "deviation-heading": 0.31575367731390264, "set_robot_commands": 0.005197187264760335, "deviation-center-line": 0.07318783257303918, "driven_lanedir_consec": 0.43042483871585446, "sim_compute_sim_state": 0.002926756938298543, "sim_compute_performance-ego": 0.003961523373921712, "sim_compute_robot_state-ego": 0.005123396714528401}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39313321778987487, "sim_physics": 0.059140563011169434, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3687251037890211, "sim_render-ego": 0.007218057459050959, "in-drivable-lane": 0, "agent_compute-ego": 0.021251277490095657, "deviation-heading": 0.2623901021669374, "set_robot_commands": 0.0047550526532259855, "deviation-center-line": 0.04376175547063839, "driven_lanedir_consec": 0.3687251037890211, "sim_compute_sim_state": 0.0027796463532881303, "sim_compute_performance-ego": 0.003872535445473411, "sim_compute_robot_state-ego": 0.004978212443265048}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8462204709833995, "sim_physics": 0.05658794738150932, "survival_time": 1.850000000000001, "driven_lanedir": 0.8368495469077557, "sim_render-ego": 0.007127961596927127, "in-drivable-lane": 0, "agent_compute-ego": 0.02273319218609784, "deviation-heading": 0.31188609622793845, "set_robot_commands": 0.004897169164709143, "deviation-center-line": 0.11405960084693136, "driven_lanedir_consec": 0.8368495469077557, "sim_compute_sim_state": 0.002843573286726668, "sim_compute_performance-ego": 0.003921592557752454, "sim_compute_robot_state-ego": 0.0051394539910393795}}
set_robot_commands_max0.005197187264760335
set_robot_commands_mean0.004955416571205508
set_robot_commands_median0.004897169164709143
set_robot_commands_min0.0047550526532259855
sim_compute_performance-ego_max0.004182537989829903
sim_compute_performance-ego_mean0.00396484017615484
sim_compute_performance-ego_median0.003921592557752454
sim_compute_performance-ego_min0.003872535445473411
sim_compute_robot_state-ego_max0.005177586825925912
sim_compute_robot_state-ego_mean0.005107266373638826
sim_compute_robot_state-ego_median0.005123396714528401
sim_compute_robot_state-ego_min0.004978212443265048
sim_compute_sim_state_max0.002926756938298543
sim_compute_sim_state_mean0.0028587282178996693
sim_compute_sim_state_median0.002846533601934259
sim_compute_sim_state_min0.0027796463532881303
sim_physics_max0.06116255124409994
sim_physics_mean0.05856066099529865
sim_physics_median0.059140563011169434
sim_physics_min0.05484401095997204
sim_render-ego_max0.007325520118077596
sim_render-ego_mean0.007190624394808447
sim_render-ego_median0.007218057459050959
sim_render-ego_min0.007032416083595969
simulation-passed1
survival_time_max3.349999999999996
survival_time_mean1.9399999999999995
survival_time_min1.1000000000000003
No reset possible
261924443Bea Baselines 🐤straightaido3-LFV-real-validationeval2-videoserrornoip-172-31-46-148-104920:01:08
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
261854610César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:00:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
261394588Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.292032517074681
survival_time_median12.450000000000042
deviation-center-line_median0.6144636134122302
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04560996850331624
agent_compute-ego_mean0.0293851303548927
agent_compute-ego_median0.024404863709384956
agent_compute-ego_min0.02316547014627112
deviation-center-line_max0.7631759338168734
deviation-center-line_mean0.5275051591152805
deviation-center-line_min0.1355529992820428
deviation-heading_max4.797262055985006
deviation-heading_mean2.0349851035903326
deviation-heading_median1.5036466307174114
deviation-heading_min1.011142957725623
driven_any_max2.3491485119958906
driven_any_mean1.6757301000849203
driven_any_median1.9472899969113917
driven_any_min0.7663586683208788
driven_lanedir_consec_max2.3383897770745454
driven_lanedir_consec_mean1.4962139428251822
driven_lanedir_consec_min0.7295801767679011
driven_lanedir_max2.3383897770745454
driven_lanedir_mean1.5695142905233546
driven_lanedir_median1.6585342555655431
driven_lanedir_min0.7295801767679011
in-drivable-lane_max1.0500000000000096
in-drivable-lane_mean0.2100000000000019
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7663586683208788, "sim_physics": 0.09321648171804484, "survival_time": 5.14999999999999, "driven_lanedir": 0.7295801767679011, "sim_render-ego": 0.010676333047811268, "in-drivable-lane": 0, "agent_compute-ego": 0.024404863709384956, "deviation-heading": 1.011142957725623, "set_robot_commands": 0.010369319360233048, "deviation-center-line": 0.1355529992820428, "driven_lanedir_consec": 0.7295801767679011, "sim_compute_sim_state": 0.005183094913519702, "sim_compute_performance-ego": 0.0065334537654247096, "sim_compute_robot_state-ego": 0.008358182258976317}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9472899969113917, "sim_physics": 0.0942550155532408, "survival_time": 12.450000000000042, "driven_lanedir": 1.9112162840999305, "sim_render-ego": 0.010567402743910211, "in-drivable-lane": 0, "agent_compute-ego": 0.02316547014627112, "deviation-heading": 1.732967292883198, "set_robot_commands": 0.009754708493091017, "deviation-center-line": 0.6144636134122302, "driven_lanedir_consec": 1.9112162840999305, "sim_compute_sim_state": 0.005031178754017535, "sim_compute_performance-ego": 0.006206968223234736, "sim_compute_robot_state-ego": 0.007910437373272386}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.067679372676814, "sim_physics": 0.0906498170260227, "survival_time": 13.200000000000053, "driven_lanedir": 1.6585342555655431, "sim_render-ego": 0.01117147911678661, "in-drivable-lane": 1.0500000000000096, "agent_compute-ego": 0.023839097131382336, "deviation-heading": 4.797262055985006, "set_robot_commands": 0.009378293246933908, "deviation-center-line": 0.7631759338168734, "driven_lanedir_consec": 1.292032517074681, "sim_compute_sim_state": 0.005002539266239513, "sim_compute_performance-ego": 0.006474512996095599, "sim_compute_robot_state-ego": 0.008208409403309677}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2481739505196268, "sim_physics": 0.102592447657644, "survival_time": 8.09999999999998, "driven_lanedir": 1.2098509591088529, "sim_render-ego": 0.011507686273551282, "in-drivable-lane": 0, "agent_compute-ego": 0.029906252284108856, "deviation-heading": 1.5036466307174114, "set_robot_commands": 0.009938781644091194, "deviation-center-line": 0.38726931926638264, "driven_lanedir_consec": 1.2098509591088529, "sim_compute_sim_state": 0.004970151701091248, "sim_compute_performance-ego": 0.0067504129292052465, "sim_compute_robot_state-ego": 0.008692363162099578}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491485119958906, "sim_physics": 0.08986181735992432, "survival_time": 14.950000000000076, "driven_lanedir": 2.3383897770745454, "sim_render-ego": 0.01037019729614258, "in-drivable-lane": 0, "agent_compute-ego": 0.04560996850331624, "deviation-heading": 1.1299065806404247, "set_robot_commands": 0.007965102990468343, "deviation-center-line": 0.7370639297988734, "driven_lanedir_consec": 2.3383897770745454, "sim_compute_sim_state": 0.004489665826161703, "sim_compute_performance-ego": 0.006205190022786459, "sim_compute_robot_state-ego": 0.008047769864400228}}
set_robot_commands_max0.010369319360233048
set_robot_commands_mean0.009481241146963502
set_robot_commands_median0.009754708493091017
set_robot_commands_min0.007965102990468343
sim_compute_performance-ego_max0.0067504129292052465
sim_compute_performance-ego_mean0.006434107587349349
sim_compute_performance-ego_median0.006474512996095599
sim_compute_performance-ego_min0.006205190022786459
sim_compute_robot_state-ego_max0.008692363162099578
sim_compute_robot_state-ego_mean0.008243432412411638
sim_compute_robot_state-ego_median0.008208409403309677
sim_compute_robot_state-ego_min0.007910437373272386
sim_compute_sim_state_max0.005183094913519702
sim_compute_sim_state_mean0.00493532609220594
sim_compute_sim_state_median0.005002539266239513
sim_compute_sim_state_min0.004489665826161703
sim_physics_max0.102592447657644
sim_physics_mean0.09411511586297534
sim_physics_median0.09321648171804484
sim_physics_min0.08986181735992432
sim_render-ego_max0.011507686273551282
sim_render-ego_mean0.010858619695640387
sim_render-ego_median0.010676333047811268
sim_render-ego_min0.01037019729614258
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.770000000000028
survival_time_min5.14999999999999
No reset possible
260464238Manfred DiazBaseline-IL-logs-tensorflowaido3-LF-real-validationeval1-visualizesuccessnoip-172-31-46-148-104920:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0
survival_time29.3333
deviation-center-line0
in-drivable-lane29.3333


other stats
deviation-heading0
driven_any0.07730056307974578
driven_lanedir0
visualized-eval1-passed1
No reset possible
260084563Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|Andrew_Activationaido3-LFV-sim-testingstep1-simulationabortednoip-172-31-46-148-104920:15:11
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
259404533Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:10:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2883552698120448
survival_time_median12.40000000000004
deviation-center-line_median0.5262699529067875
in-drivable-lane_median0


other stats
agent_compute-ego_max0.017042920944538523
agent_compute-ego_mean0.016295635975303858
agent_compute-ego_median0.016142263412475585
agent_compute-ego_min0.016011276188686755
deviation-center-line_max1.047277675153565
deviation-center-line_mean0.5950886356456577
deviation-center-line_min0.19867963241843903
deviation-heading_max4.565863120595896
deviation-heading_mean2.4594621670700927
deviation-heading_median1.485133056169894
deviation-heading_min1.091510210683413
driven_any_max2.3490536822039823
driven_any_mean1.727158198335849
driven_any_median1.9392702302178015
driven_any_min0.6940669484731095
driven_lanedir_consec_max2.198001091465135
driven_lanedir_consec_mean1.45736468887598
driven_lanedir_consec_min0.6578596871351504
driven_lanedir_max2.198001091465135
driven_lanedir_mean1.6013533383436915
driven_lanedir_median1.907947250514556
driven_lanedir_min0.6578596871351504
in-drivable-lane_max1.3500000000000068
in-drivable-lane_mean0.27000000000000135
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6940669484731095, "sim_physics": 0.059012068078873006, "survival_time": 4.699999999999991, "driven_lanedir": 0.6578596871351504, "sim_render-ego": 0.007393626456565046, "in-drivable-lane": 0, "agent_compute-ego": 0.017042920944538523, "deviation-heading": 1.1988146856929516, "set_robot_commands": 0.007001640948843449, "deviation-center-line": 0.19867963241843903, "driven_lanedir_consec": 0.6578596871351504, "sim_compute_sim_state": 0.003910630307299026, "sim_compute_performance-ego": 0.004278708011546033, "sim_compute_robot_state-ego": 0.005321969377233627}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9392702302178015, "sim_physics": 0.058235570307700865, "survival_time": 12.40000000000004, "driven_lanedir": 1.907947250514556, "sim_render-ego": 0.007365753573756064, "in-drivable-lane": 0, "agent_compute-ego": 0.016016021851570375, "deviation-heading": 1.485133056169894, "set_robot_commands": 0.006852228795328448, "deviation-center-line": 0.5262699529067875, "driven_lanedir_consec": 1.907947250514556, "sim_compute_sim_state": 0.0036288595968677153, "sim_compute_performance-ego": 0.004186190905109528, "sim_compute_robot_state-ego": 0.005360243781920402}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490536822039823, "sim_physics": 0.05665397564570109, "survival_time": 14.950000000000076, "driven_lanedir": 2.198001091465135, "sim_render-ego": 0.007397348880767822, "in-drivable-lane": 0, "agent_compute-ego": 0.016142263412475585, "deviation-heading": 3.9559897622083096, "set_robot_commands": 0.006950342655181884, "deviation-center-line": 1.047277675153565, "driven_lanedir_consec": 2.198001091465135, "sim_compute_sim_state": 0.003674421310424805, "sim_compute_performance-ego": 0.004254907766977946, "sim_compute_robot_state-ego": 0.005424282550811768}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3044217882949516, "sim_physics": 0.05744389246201374, "survival_time": 8.449999999999985, "driven_lanedir": 1.2883552698120448, "sim_render-ego": 0.007530978445470686, "in-drivable-lane": 0, "agent_compute-ego": 0.016011276188686755, "deviation-heading": 1.091510210683413, "set_robot_commands": 0.006941717757275824, "deviation-center-line": 0.4340667732964963, "driven_lanedir_consec": 1.2883552698120448, "sim_compute_sim_state": 0.003740756469365408, "sim_compute_performance-ego": 0.004255095882528632, "sim_compute_robot_state-ego": 0.0054487321503769014}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3489783424894006, "sim_physics": 0.06021101156870524, "survival_time": 14.950000000000076, "driven_lanedir": 1.954603392791572, "sim_render-ego": 0.007312708695729573, "in-drivable-lane": 1.3500000000000068, "agent_compute-ego": 0.016265697479248047, "deviation-heading": 4.565863120595896, "set_robot_commands": 0.006810017426808675, "deviation-center-line": 0.7691491444530008, "driven_lanedir_consec": 1.2346601454530148, "sim_compute_sim_state": 0.0036397377649943032, "sim_compute_performance-ego": 0.004109954833984375, "sim_compute_robot_state-ego": 0.0052607512474060055}}
set_robot_commands_max0.007001640948843449
set_robot_commands_mean0.006911189516687656
set_robot_commands_median0.006941717757275824
set_robot_commands_min0.006810017426808675
sim_compute_performance-ego_max0.004278708011546033
sim_compute_performance-ego_mean0.004216971480029303
sim_compute_performance-ego_median0.004254907766977946
sim_compute_performance-ego_min0.004109954833984375
sim_compute_robot_state-ego_max0.0054487321503769014
sim_compute_robot_state-ego_mean0.005363195821549741
sim_compute_robot_state-ego_median0.005360243781920402
sim_compute_robot_state-ego_min0.0052607512474060055
sim_compute_sim_state_max0.003910630307299026
sim_compute_sim_state_mean0.003718881089790251
sim_compute_sim_state_median0.003674421310424805
sim_compute_sim_state_min0.0036288595968677153
sim_physics_max0.06021101156870524
sim_physics_mean0.058311303612598786
sim_physics_median0.058235570307700865
sim_physics_min0.05665397564570109
sim_render-ego_max0.007530978445470686
sim_render-ego_mean0.007400083210457838
sim_render-ego_median0.007393626456565046
sim_render-ego_min0.007312708695729573
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.090000000000035
survival_time_min4.699999999999991
No reset possible
259114526Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:10:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.80748406277242
survival_time_median11.900000000000034
deviation-center-line_median0.6646723955829995
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01721999770716617
agent_compute-ego_mean0.016722219300442064
agent_compute-ego_median0.016573224067687988
agent_compute-ego_min0.016245440274727446
deviation-center-line_max0.925273494684358
deviation-center-line_mean0.571953362969424
deviation-center-line_min0.12821406682927275
deviation-heading_max4.048363215132173
deviation-heading_mean1.9430859438905173
deviation-heading_median1.48444925528445
deviation-heading_min1.203209426940271
driven_any_max2.3491468877878017
driven_any_mean1.7127286583650865
driven_any_median1.8589341874003864
driven_any_min0.7020918754251628
driven_lanedir_consec_max2.325541491885891
driven_lanedir_consec_mean1.6394973452039707
driven_lanedir_consec_min0.5921887814393392
driven_lanedir_max2.325541491885891
driven_lanedir_mean1.6394973452039707
driven_lanedir_median1.80748406277242
driven_lanedir_min0.5921887814393392
in-drivable-lane_max0.34999999999999876
in-drivable-lane_mean0.09000000000000004
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7020918754251628, "sim_physics": 0.05988299219231857, "survival_time": 4.749999999999991, "driven_lanedir": 0.5921887814393392, "sim_render-ego": 0.007585051185206363, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.01721999770716617, "deviation-heading": 1.203209426940271, "set_robot_commands": 0.007091617584228516, "deviation-center-line": 0.12821406682927275, "driven_lanedir_consec": 0.5921887814393392, "sim_compute_sim_state": 0.003952503204345703, "sim_compute_performance-ego": 0.00456133390727796, "sim_compute_robot_state-ego": 0.005706608922857987}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8589341874003864, "sim_physics": 0.05825944808350891, "survival_time": 11.900000000000034, "driven_lanedir": 1.80748406277242, "sim_render-ego": 0.007460872666174624, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.016245440274727446, "deviation-heading": 1.48444925528445, "set_robot_commands": 0.007099882895205201, "deviation-center-line": 0.6646723955829995, "driven_lanedir_consec": 1.80748406277242, "sim_compute_sim_state": 0.0039497754153083355, "sim_compute_performance-ego": 0.004221786971853561, "sim_compute_robot_state-ego": 0.005458560310491994}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490612505234507, "sim_physics": 0.060612080891927086, "survival_time": 14.950000000000076, "driven_lanedir": 2.1912207892186024, "sim_render-ego": 0.007620373566945394, "in-drivable-lane": 0, "agent_compute-ego": 0.01656952460606893, "deviation-heading": 4.048363215132173, "set_robot_commands": 0.00732463280359904, "deviation-center-line": 0.925273494684358, "driven_lanedir_consec": 2.1912207892186024, "sim_compute_sim_state": 0.003883057435353597, "sim_compute_performance-ego": 0.004342632293701172, "sim_compute_robot_state-ego": 0.00561492125193278}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3044090906886314, "sim_physics": 0.05775346135246683, "survival_time": 8.449999999999985, "driven_lanedir": 1.2810516007036, "sim_render-ego": 0.0077103284689096305, "in-drivable-lane": 0, "agent_compute-ego": 0.017002909846559784, "deviation-heading": 1.2649587768311648, "set_robot_commands": 0.007388893669173563, "deviation-center-line": 0.45847049845093424, "driven_lanedir_consec": 1.2810516007036, "sim_compute_sim_state": 0.003999494236601881, "sim_compute_performance-ego": 0.004332652458777795, "sim_compute_robot_state-ego": 0.005549917559651934}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491468877878017, "sim_physics": 0.060912145773569744, "survival_time": 14.950000000000076, "driven_lanedir": 2.325541491885891, "sim_render-ego": 0.007482032775878906, "in-drivable-lane": 0, "agent_compute-ego": 0.016573224067687988, "deviation-heading": 1.7144490452645271, "set_robot_commands": 0.007327144940694173, "deviation-center-line": 0.6831363592995557, "driven_lanedir_consec": 2.325541491885891, "sim_compute_sim_state": 0.0040546568234761556, "sim_compute_performance-ego": 0.004241987864176433, "sim_compute_robot_state-ego": 0.005480496088663737}}
set_robot_commands_max0.007388893669173563
set_robot_commands_mean0.007246434378580099
set_robot_commands_median0.00732463280359904
set_robot_commands_min0.007091617584228516
sim_compute_performance-ego_max0.00456133390727796
sim_compute_performance-ego_mean0.004340078699157385
sim_compute_performance-ego_median0.004332652458777795
sim_compute_performance-ego_min0.004221786971853561
sim_compute_robot_state-ego_max0.005706608922857987
sim_compute_robot_state-ego_mean0.005562100826719687
sim_compute_robot_state-ego_median0.005549917559651934
sim_compute_robot_state-ego_min0.005458560310491994
sim_compute_sim_state_max0.0040546568234761556
sim_compute_sim_state_mean0.003967897423017135
sim_compute_sim_state_median0.003952503204345703
sim_compute_sim_state_min0.003883057435353597
sim_physics_max0.060912145773569744
sim_physics_mean0.05948402565875823
sim_physics_median0.05988299219231857
sim_physics_min0.05775346135246683
sim_render-ego_max0.0077103284689096305
sim_render-ego_mean0.007571731732622983
sim_render-ego_median0.007585051185206363
sim_render-ego_min0.007460872666174624
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.000000000000034
survival_time_min4.749999999999991
No reset possible
258944191Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:12:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4378933478955715
survival_time_median3.099999999999997
deviation-center-line_median0.13908903563608688
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.018360269480738146
agent_compute-ego_mean0.015412186796723324
agent_compute-ego_median0.01522166975613298
agent_compute-ego_min0.014525059730775896
deviation-center-line_max0.532746324399545
deviation-center-line_mean0.18169206884848385
deviation-center-line_min0.0681161462163248
deviation-heading_max1.1901827219312813
deviation-heading_mean0.6415543546915703
deviation-heading_median0.5031825547422055
deviation-heading_min0.2060429950224342
driven_any_max1.8488671355040076
driven_any_mean0.8309001857913937
driven_any_median0.8893644944837463
driven_any_min0.22794626361561687
driven_lanedir_consec_max1.3664896815564729
driven_lanedir_consec_mean0.5839463445625489
driven_lanedir_consec_min0.1749357963148559
driven_lanedir_max1.807834195793656
driven_lanedir_mean0.6154689923102642
driven_lanedir_median0.4378933478955715
driven_lanedir_min0.1749357963148559
in-drivable-lane_max2.199999999999996
in-drivable-lane_mean0.5766666666666651
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2152514395156324, "sim_physics": 0.15847976454373064, "survival_time": 4.3499999999999925, "driven_lanedir": 1.1458081801121476, "sim_render-ego": 0.008452171566842616, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.018360269480738146, "deviation-heading": 1.1461887665248496, "set_robot_commands": 0.006349755429673469, "deviation-center-line": 0.3196271163955538, "driven_lanedir_consec": 1.1457079084309494, "sim_compute_sim_state": 0.003318981192577844, "sim_compute_performance-ego": 0.004779489561059009, "sim_compute_robot_state-ego": 0.006029644231686647, "sim_compute_robot_state-npc0": 0.005638610357525705, "sim_compute_robot_state-npc1": 0.005534859909408394, "sim_compute_robot_state-npc2": 0.005566791556347376, "sim_compute_robot_state-npc3": 0.005407114138548401}, "udem1-1-0": {"driven_any": 1.181685992599853, "sim_physics": 0.11730773477669222, "survival_time": 4.149999999999993, "driven_lanedir": 0.6522619080269556, "sim_render-ego": 0.007118472133774355, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.014872257968029344, "deviation-heading": 0.36240222968987695, "set_robot_commands": 0.004958618118102292, "deviation-center-line": 0.16820559038086544, "driven_lanedir_consec": 0.6522619080269556, "sim_compute_sim_state": 0.002807824008436088, "sim_compute_performance-ego": 0.00394721490791045, "sim_compute_robot_state-ego": 0.005121162138789533, "sim_compute_robot_state-npc0": 0.004845679524433182, "sim_compute_robot_state-npc1": 0.004623082746942359, "sim_compute_robot_state-npc2": 0.0046055948877909095, "sim_compute_robot_state-npc3": 0.004569616662450583}, "udem1-2-0": {"driven_any": 1.0118081524117453, "sim_physics": 0.10611080156790244, "survival_time": 3.699999999999995, "driven_lanedir": 0.9004425545660449, "sim_render-ego": 0.007057756990999789, "in-drivable-lane": 0, "agent_compute-ego": 0.014907234423869363, "deviation-heading": 1.152229849649838, "set_robot_commands": 0.004886047260181324, "deviation-center-line": 0.2913214072499907, "driven_lanedir_consec": 0.8690476242686972, "sim_compute_sim_state": 0.0027856665688592032, "sim_compute_performance-ego": 0.003901075672458958, "sim_compute_robot_state-ego": 0.005002018567678091, "sim_compute_robot_state-npc0": 0.004742619153615591, "sim_compute_robot_state-npc1": 0.004576222316638843, "sim_compute_robot_state-npc2": 0.004535842586208034, "sim_compute_robot_state-npc3": 0.004529166865993191}, "udem1-3-0": {"driven_any": 0.22794626361561687, "sim_physics": 0.13947765032450357, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1749357963148559, "sim_render-ego": 0.007302681605021159, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.015563060839970907, "deviation-heading": 0.6100530204931127, "set_robot_commands": 0.004987667004267375, "deviation-center-line": 0.0681161462163248, "driven_lanedir_consec": 0.1749357963148559, "sim_compute_sim_state": 0.002752929925918579, "sim_compute_performance-ego": 0.003943433364232381, "sim_compute_robot_state-ego": 0.005043834447860718, "sim_compute_robot_state-npc0": 0.004715631405512492, "sim_compute_robot_state-npc1": 0.004630059003829956, "sim_compute_robot_state-npc2": 0.004626760880152385, "sim_compute_robot_state-npc3": 0.00461841622988383}, "udem1-4-0": {"driven_any": 1.8488671355040076, "sim_physics": 0.12933287194104698, "survival_time": 6.149999999999986, "driven_lanedir": 1.807834195793656, "sim_render-ego": 0.0071127395319744826, "in-drivable-lane": 0, "agent_compute-ego": 0.015796335732064595, "deviation-heading": 1.1901827219312813, "set_robot_commands": 0.004927392897567128, "deviation-center-line": 0.532746324399545, "driven_lanedir_consec": 1.3664896815564729, "sim_compute_sim_state": 0.0027822323930941947, "sim_compute_performance-ego": 0.0039241197632580264, "sim_compute_robot_state-ego": 0.005048150938700854, "sim_compute_robot_state-npc0": 0.004781945934140585, "sim_compute_robot_state-npc1": 0.00458150181343885, "sim_compute_robot_state-npc2": 0.004526855499763799, "sim_compute_robot_state-npc3": 0.004497177232571733}, "udem1-5-0": {"driven_any": 0.8893644944837463, "sim_physics": 0.10254902608932988, "survival_time": 3.099999999999997, "driven_lanedir": 0.4378933478955715, "sim_render-ego": 0.006973543474751134, "in-drivable-lane": 1.399999999999996, "agent_compute-ego": 0.01472033223798198, "deviation-heading": 0.413983013659317, "set_robot_commands": 0.004833732881853657, "deviation-center-line": 0.10744428364584496, "driven_lanedir_consec": 0.4378933478955715, "sim_compute_sim_state": 0.002705735545004568, "sim_compute_performance-ego": 0.003856193634771532, "sim_compute_robot_state-ego": 0.004939948358843403, "sim_compute_robot_state-npc0": 0.004673065677765877, "sim_compute_robot_state-npc1": 0.004522785063712827, "sim_compute_robot_state-npc2": 0.004498470214105422, "sim_compute_robot_state-npc3": 0.004471898078918457}, "udem1-6-0": {"driven_any": 0.3217568213058035, "sim_physics": 0.11527252197265624, "survival_time": 1.4500000000000006, "driven_lanedir": 0.31142877744438513, "sim_render-ego": 0.007016757438922751, "in-drivable-lane": 0, "agent_compute-ego": 0.01522166975613298, "deviation-heading": 0.3179105481386682, "set_robot_commands": 0.004801569313838564, "deviation-center-line": 0.12787653843572008, "driven_lanedir_consec": 0.31142877744438513, "sim_compute_sim_state": 0.0026751633348136112, "sim_compute_performance-ego": 0.0038586813828040815, "sim_compute_robot_state-ego": 0.004869535051543137, "sim_compute_robot_state-npc0": 0.0046101685228018925, "sim_compute_robot_state-npc1": 0.0044345855712890625, "sim_compute_robot_state-npc2": 0.004415092797114931, "sim_compute_robot_state-npc3": 0.00440590134982405}, "udem1-7-0": {"driven_any": 0.422564670739684, "sim_physics": 0.15964847803115845, "survival_time": 1.800000000000001, "driven_lanedir": 0.41237875627155907, "sim_render-ego": 0.007174829641977946, "in-drivable-lane": 0, "agent_compute-ego": 0.01592286427815755, "deviation-heading": 0.2968053239062273, "set_robot_commands": 0.004872149891323513, "deviation-center-line": 0.13908903563608688, "driven_lanedir_consec": 0.41237875627155907, "sim_compute_sim_state": 0.0027330716451009116, "sim_compute_performance-ego": 0.003880884912278917, "sim_compute_robot_state-ego": 0.004990975062052409, "sim_compute_robot_state-npc0": 0.004779636859893799, "sim_compute_robot_state-npc1": 0.004507700602213542, "sim_compute_robot_state-npc2": 0.004485461446974013, "sim_compute_robot_state-npc3": 0.0045064025455051}, "udem1-8-0": {"driven_any": 1.0869893500063008, "sim_physics": 0.11778232786390516, "survival_time": 4.049999999999994, "driven_lanedir": 0.7141335869056502, "sim_render-ego": 0.006951329148845908, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.01521937052408854, "deviation-heading": 0.878889826365967, "set_robot_commands": 0.004952557292985328, "deviation-center-line": 0.20474526161428125, "driven_lanedir_consec": 0.7141335869056502, "sim_compute_sim_state": 0.0027533401677637924, "sim_compute_performance-ego": 0.003881445637455693, "sim_compute_robot_state-ego": 0.00499113400777181, "sim_compute_robot_state-npc0": 0.004707948661144869, "sim_compute_robot_state-npc1": 0.00449448455998927, "sim_compute_robot_state-npc2": 0.004478778368161049, "sim_compute_robot_state-npc3": 0.004516622166574737}, "udem1-9-0": {"driven_any": 1.1424631314529632, "sim_physics": 0.136883608902557, "survival_time": 3.949999999999994, "driven_lanedir": 0.3199264085960296, "sim_render-ego": 0.007014564321010928, "in-drivable-lane": 2.199999999999996, "agent_compute-ego": 0.015615143353426003, "deviation-heading": 1.1128298423206882, "set_robot_commands": 0.0048150684260114835, "deviation-center-line": 0.17094642867950188, "driven_lanedir_consec": 0.3199264085960296, "sim_compute_sim_state": 0.002735714369182345, "sim_compute_performance-ego": 0.0038307467593422418, "sim_compute_robot_state-ego": 0.004940986633300781, "sim_compute_robot_state-npc0": 0.00470215761208836, "sim_compute_robot_state-npc1": 0.004470964021320584, "sim_compute_robot_state-npc2": 0.00444856172875513, "sim_compute_robot_state-npc3": 0.004440120503872256}, "udem1-10-0": {"driven_any": 1.0711610669051304, "sim_physics": 0.10866902987162272, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3955395433982156, "sim_render-ego": 0.006948270797729492, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.014748986562093098, "deviation-heading": 0.49052382077367057, "set_robot_commands": 0.004824151992797851, "deviation-center-line": 0.07933265713998794, "driven_lanedir_consec": 0.3955395433982156, "sim_compute_sim_state": 0.0027002684275309243, "sim_compute_performance-ego": 0.003822164535522461, "sim_compute_robot_state-ego": 0.004916324615478516, "sim_compute_robot_state-npc0": 0.0046646563212076825, "sim_compute_robot_state-npc1": 0.004490925470987956, "sim_compute_robot_state-npc2": 0.004452823003133138, "sim_compute_robot_state-npc3": 0.004447924296061198}, "udem1-11-0": {"driven_any": 0.8244210104658632, "sim_physics": 0.12400398715849846, "survival_time": 3.099999999999997, "driven_lanedir": 0.7829043398589945, "sim_render-ego": 0.006890858373334331, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.014525059730775896, "deviation-heading": 0.5031825547422055, "set_robot_commands": 0.0046689202708582725, "deviation-center-line": 0.13572815870526408, "driven_lanedir_consec": 0.7829043398589945, "sim_compute_sim_state": 0.0026802862844159526, "sim_compute_performance-ego": 0.003765294628758585, "sim_compute_robot_state-ego": 0.004886273414857926, "sim_compute_robot_state-npc0": 0.004600517211421844, "sim_compute_robot_state-npc1": 0.004421411022063225, "sim_compute_robot_state-npc2": 0.004400595541923276, "sim_compute_robot_state-npc3": 0.004391877881942257}, "udem1-12-0": {"driven_any": 0.563788053121494, "sim_physics": 0.1251815974712372, "survival_time": 2.000000000000001, "driven_lanedir": 0.5531138948568208, "sim_render-ego": 0.006982177495956421, "in-drivable-lane": 0, "agent_compute-ego": 0.015252387523651123, "deviation-heading": 0.3358737235304561, "set_robot_commands": 0.004800647497177124, "deviation-center-line": 0.14005637483483965, "driven_lanedir_consec": 0.5531138948568208, "sim_compute_sim_state": 0.002720773220062256, "sim_compute_performance-ego": 0.003814834356307984, "sim_compute_robot_state-ego": 0.004888761043548584, "sim_compute_robot_state-npc0": 0.004673373699188232, "sim_compute_robot_state-npc1": 0.004468274116516113, "sim_compute_robot_state-npc2": 0.0044486403465271, "sim_compute_robot_state-npc3": 0.004485023021697998}, "udem1-13-0": {"driven_any": 0.36238025749644254, "sim_physics": 0.14005901596762918, "survival_time": 1.6500000000000008, "driven_lanedir": 0.33545904027107065, "sim_render-ego": 0.0070419383771491775, "in-drivable-lane": 0, "agent_compute-ego": 0.015004931074200254, "deviation-heading": 0.6062170836249625, "set_robot_commands": 0.004759434497717655, "deviation-center-line": 0.10444971478734522, "driven_lanedir_consec": 0.33545904027107065, "sim_compute_sim_state": 0.002704866004712654, "sim_compute_performance-ego": 0.003838076735987808, "sim_compute_robot_state-ego": 0.004936471129908707, "sim_compute_robot_state-npc0": 0.004646330168752959, "sim_compute_robot_state-npc1": 0.0044451048879912405, "sim_compute_robot_state-npc2": 0.004458897041551994, "sim_compute_robot_state-npc3": 0.004431392207290187}, "udem1-14-0": {"driven_any": 0.2930549472466218, "sim_physics": 0.15074770267193133, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2879745543420047, "sim_render-ego": 0.00703134903540978, "in-drivable-lane": 0, "agent_compute-ego": 0.015452898465670072, "deviation-heading": 0.2060429950224342, "set_robot_commands": 0.004818026836101825, "deviation-center-line": 0.135695994606106, "driven_lanedir_consec": 0.2879745543420047, "sim_compute_sim_state": 0.0027020986263568583, "sim_compute_performance-ego": 0.003813624382019043, "sim_compute_robot_state-ego": 0.004922215755169208, "sim_compute_robot_state-npc0": 0.004646750596853403, "sim_compute_robot_state-npc1": 0.004491815200218787, "sim_compute_robot_state-npc2": 0.004564707095806415, "sim_compute_robot_state-npc3": 0.00446772575378418}}
set_robot_commands_max0.006349755429673469
set_robot_commands_mean0.004950382640697124
set_robot_commands_median0.004833732881853657
set_robot_commands_min0.0046689202708582725
sim_compute_performance-ego_max0.004779489561059009
sim_compute_performance-ego_mean0.003923818682277812
sim_compute_performance-ego_median0.0038586813828040815
sim_compute_performance-ego_min0.003765294628758585
sim_compute_robot_state-ego_max0.006029644231686647
sim_compute_robot_state-ego_mean0.005035162359812689
sim_compute_robot_state-ego_median0.004940986633300781
sim_compute_robot_state-ego_min0.004869535051543137
sim_compute_robot_state-npc0_max0.005638610357525705
sim_compute_robot_state-npc0_mean0.004761939447089764
sim_compute_robot_state-npc0_median0.00470215761208836
sim_compute_robot_state-npc0_min0.004600517211421844
sim_compute_robot_state-npc1_max0.005534859909408394
sim_compute_robot_state-npc1_mean0.004579585087104068
sim_compute_robot_state-npc1_median0.00449448455998927
sim_compute_robot_state-npc1_min0.004421411022063225
sim_compute_robot_state-npc2_max0.005566791556347376
sim_compute_robot_state-npc2_mean0.004567591532954331
sim_compute_robot_state-npc2_median0.004485461446974013
sim_compute_robot_state-npc2_min0.004400595541923276
sim_compute_robot_state-npc3_max0.005407114138548401
sim_compute_robot_state-npc3_mean0.004545758595661211
sim_compute_robot_state-npc3_median0.004485023021697998
sim_compute_robot_state-npc3_min0.004391877881942257
sim_compute_sim_state_max0.003318981192577844
sim_compute_sim_state_mean0.0027705967809219852
sim_compute_sim_state_median0.0027330716451009116
sim_compute_sim_state_min0.0026751633348136112
sim_physics_max0.15964847803115845
sim_physics_mean0.1287670746102934
sim_physics_median0.1251815974712372
sim_physics_min0.10254902608932988
sim_render-ego_max0.008452171566842616
sim_render-ego_mean0.007137962662246685
sim_render-ego_median0.00703134903540978
sim_render-ego_min0.006890858373334331
simulation-passed1
survival_time_max6.149999999999986
survival_time_mean3.046666666666662
survival_time_min1.2000000000000004
No reset possible
258804203Manfred Diazchallenge-aido_LF-template-tensorflowaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-46-148-104920:04:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
258664483András Kalaposreinforcement-learning-2235aido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104920:07:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
257814405Alex Deliyannischallenge-aido_LF-template-tensorflowaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:06:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.23376610268605924
survival_time_median1.1000000000000003
deviation-center-line_median0.05984624657474097
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03485838933424516
agent_compute-ego_mean0.029965166337562337
agent_compute-ego_median0.03017501831054687
agent_compute-ego_min0.026170988877614335
deviation-center-line_max0.09488235355124044
deviation-center-line_mean0.06251198202108146
deviation-center-line_min0.03755168872686187
deviation-heading_max0.6757863183572528
deviation-heading_mean0.4835243189160384
deviation-heading_median0.4745209033939965
deviation-heading_min0.35093244988472844
driven_any_max0.3576631599755468
driven_any_mean0.305092192586247
driven_any_median0.3099966876056398
driven_any_min0.25726747692865204
driven_lanedir_consec_max0.3368736652205778
driven_lanedir_consec_mean0.24733344361252993
driven_lanedir_consec_min0.19119718824838208
driven_lanedir_max0.3368736652205778
driven_lanedir_mean0.24733344361252993
driven_lanedir_median0.23376610268605924
driven_lanedir_min0.19119718824838208
in-drivable-lane_max0.04999999999999993
in-drivable-lane_mean0.009999999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3576631599755468, "sim_physics": 0.25008767301386053, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3368736652205778, "sim_render-ego": 0.011978409507057884, "in-drivable-lane": 0, "agent_compute-ego": 0.03485838933424516, "deviation-heading": 0.35093244988472844, "set_robot_commands": 0.01054251194000244, "deviation-center-line": 0.06327659326190019, "driven_lanedir_consec": 0.3368736652205778, "sim_compute_sim_state": 0.0052087740464644, "sim_compute_performance-ego": 0.0074422359466552734, "sim_compute_robot_state-ego": 0.009567575021223587, "sim_compute_robot_state-npc0": 0.009605331854386764, "sim_compute_robot_state-npc1": 0.008767442269758745, "sim_compute_robot_state-npc2": 0.009801723740317604, "sim_compute_robot_state-npc3": 0.00848589160225608}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.25726747692865204, "sim_physics": 0.23637490272521972, "survival_time": 1.0000000000000002, "driven_lanedir": 0.19119718824838208, "sim_render-ego": 0.013695108890533448, "in-drivable-lane": 0, "agent_compute-ego": 0.028330564498901367, "deviation-heading": 0.4745209033939965, "set_robot_commands": 0.01160571575164795, "deviation-center-line": 0.05984624657474097, "driven_lanedir_consec": 0.19119718824838208, "sim_compute_sim_state": 0.005398416519165039, "sim_compute_performance-ego": 0.007030320167541504, "sim_compute_robot_state-ego": 0.008708560466766357, "sim_compute_robot_state-npc0": 0.00926809310913086, "sim_compute_robot_state-npc1": 0.009211623668670654, "sim_compute_robot_state-npc2": 0.008727800846099854, "sim_compute_robot_state-npc3": 0.0081872820854187}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3099966876056398, "sim_physics": 0.22046239177385965, "survival_time": 1.2000000000000004, "driven_lanedir": 0.21009656351767325, "sim_render-ego": 0.011289616425832111, "in-drivable-lane": 0, "agent_compute-ego": 0.026170988877614335, "deviation-heading": 0.6757863183572528, "set_robot_commands": 0.008599976698557535, "deviation-center-line": 0.09488235355124044, "driven_lanedir_consec": 0.21009656351767325, "sim_compute_sim_state": 0.004533300797144572, "sim_compute_performance-ego": 0.006757368644078572, "sim_compute_robot_state-ego": 0.008063515027364096, "sim_compute_robot_state-npc0": 0.007855147123336792, "sim_compute_robot_state-npc1": 0.007392734289169312, "sim_compute_robot_state-npc2": 0.007097075382868449, "sim_compute_robot_state-npc3": 0.006955593824386597}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2796649146117178, "sim_physics": 0.2327730655670166, "survival_time": 1.0000000000000002, "driven_lanedir": 0.23376610268605924, "sim_render-ego": 0.012956571578979491, "in-drivable-lane": 0.04999999999999993, "agent_compute-ego": 0.03017501831054687, "deviation-heading": 0.4026229252198767, "set_robot_commands": 0.009057652950286866, "deviation-center-line": 0.057003027990663875, "driven_lanedir_consec": 0.23376610268605924, "sim_compute_sim_state": 0.005120289325714111, "sim_compute_performance-ego": 0.007472717761993408, "sim_compute_robot_state-ego": 0.00948019027709961, "sim_compute_robot_state-npc0": 0.008481752872467042, "sim_compute_robot_state-npc1": 0.007554197311401367, "sim_compute_robot_state-npc2": 0.007931673526763916, "sim_compute_robot_state-npc3": 0.00854867696762085}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3208687238096784, "sim_physics": 0.22337034225463867, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2647336983899573, "sim_render-ego": 0.012766332626342773, "in-drivable-lane": 0, "agent_compute-ego": 0.030290870666503905, "deviation-heading": 0.5137589977243375, "set_robot_commands": 0.010413131713867188, "deviation-center-line": 0.03755168872686187, "driven_lanedir_consec": 0.2647336983899573, "sim_compute_sim_state": 0.005713186264038086, "sim_compute_performance-ego": 0.006894807815551757, "sim_compute_robot_state-ego": 0.009418163299560548, "sim_compute_robot_state-npc0": 0.009574003219604492, "sim_compute_robot_state-npc1": 0.00886127471923828, "sim_compute_robot_state-npc2": 0.008079004287719727, "sim_compute_robot_state-npc3": 0.009007930755615234}}
set_robot_commands_max0.01160571575164795
set_robot_commands_mean0.010043797810872394
set_robot_commands_median0.010413131713867188
set_robot_commands_min0.008599976698557535
sim_compute_performance-ego_max0.007472717761993408
sim_compute_performance-ego_mean0.007119490067164102
sim_compute_performance-ego_median0.007030320167541504
sim_compute_performance-ego_min0.006757368644078572
sim_compute_robot_state-ego_max0.009567575021223587
sim_compute_robot_state-ego_mean0.00904760081840284
sim_compute_robot_state-ego_median0.009418163299560548
sim_compute_robot_state-ego_min0.008063515027364096
sim_compute_robot_state-npc0_max0.009605331854386764
sim_compute_robot_state-npc0_mean0.00895686563578519
sim_compute_robot_state-npc0_median0.00926809310913086
sim_compute_robot_state-npc0_min0.007855147123336792
sim_compute_robot_state-npc1_max0.009211623668670654
sim_compute_robot_state-npc1_mean0.008357454451647673
sim_compute_robot_state-npc1_median0.008767442269758745
sim_compute_robot_state-npc1_min0.007392734289169312
sim_compute_robot_state-npc2_max0.009801723740317604
sim_compute_robot_state-npc2_mean0.00832745555675391
sim_compute_robot_state-npc2_median0.008079004287719727
sim_compute_robot_state-npc2_min0.007097075382868449
sim_compute_robot_state-npc3_max0.009007930755615234
sim_compute_robot_state-npc3_mean0.008237075047059492
sim_compute_robot_state-npc3_median0.00848589160225608
sim_compute_robot_state-npc3_min0.006955593824386597
sim_compute_sim_state_max0.005713186264038086
sim_compute_sim_state_mean0.0051947933905052415
sim_compute_sim_state_median0.0052087740464644
sim_compute_sim_state_min0.004533300797144572
sim_physics_max0.25008767301386053
sim_physics_mean0.23261367506691905
sim_physics_median0.2327730655670166
sim_physics_min0.22046239177385965
sim_render-ego_max0.013695108890533448
sim_render-ego_mean0.012537207805749144
sim_render-ego_median0.012766332626342773
sim_render-ego_min0.011289616425832111
simulation-passed1
survival_time_max1.2500000000000004
survival_time_mean1.11
survival_time_min1.0000000000000002
No reset possible
257684508Frank (Chude) Qian 🇨🇦2019-11-19|FrankNetaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:19:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.652324375183392
survival_time_median14.950000000000076
deviation-center-line_median0.9177777936287648
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04225749254226684
agent_compute-ego_mean0.041170945485432944
agent_compute-ego_median0.042235315640767414
agent_compute-ego_min0.03820755004882812
deviation-center-line_max1.0254339686774012
deviation-center-line_mean0.9172220719489084
deviation-center-line_min0.77397900717752
deviation-heading_max3.0327414793857224
deviation-heading_mean2.839104178770868
deviation-heading_median2.760584028613146
deviation-heading_min2.743342750078342
driven_any_max4.51252858696543
driven_any_mean3.9444683750757066
driven_any_median3.738587066917137
driven_any_min3.677413495582162
driven_lanedir_consec_max4.3378393342093435
driven_lanedir_consec_mean3.8399106066763697
driven_lanedir_consec_min3.6041661317936846
driven_lanedir_max4.3378393342093435
driven_lanedir_mean3.8399106066763697
driven_lanedir_median3.652324375183392
driven_lanedir_min3.6041661317936846
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.677413495582162, "sim_physics": 0.1392552344004313, "survival_time": 14.950000000000076, "driven_lanedir": 3.6041661317936846, "sim_render-ego": 0.009548802375793456, "in-drivable-lane": 0, "agent_compute-ego": 0.042235315640767414, "deviation-heading": 2.756485311429248, "set_robot_commands": 0.00774263858795166, "deviation-center-line": 0.8437961016038003, "driven_lanedir_consec": 3.6041661317936846, "sim_compute_sim_state": 0.003887240886688233, "sim_compute_performance-ego": 0.005602575143178304, "sim_compute_robot_state-ego": 0.007126555442810058, "sim_compute_robot_state-npc0": 0.0068981218338012695, "sim_compute_robot_state-npc1": 0.006608802477518718, "sim_compute_robot_state-npc2": 0.0066415850321451825, "sim_compute_robot_state-npc3": 0.006534819602966309}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.738587066917137, "sim_physics": 0.15451606432596843, "survival_time": 14.950000000000076, "driven_lanedir": 3.652324375183392, "sim_render-ego": 0.009956945578257242, "in-drivable-lane": 0, "agent_compute-ego": 0.04090306599934896, "deviation-heading": 3.0327414793857224, "set_robot_commands": 0.007731793721516927, "deviation-center-line": 1.0251234886570548, "driven_lanedir_consec": 3.652324375183392, "sim_compute_sim_state": 0.004346144994099935, "sim_compute_performance-ego": 0.005875020027160644, "sim_compute_robot_state-ego": 0.007404116789499918, "sim_compute_robot_state-npc0": 0.007212708791097006, "sim_compute_robot_state-npc1": 0.007034248510996501, "sim_compute_robot_state-npc2": 0.00696548859278361, "sim_compute_robot_state-npc3": 0.006953908602396647}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.51252858696543, "sim_physics": 0.13415797551472983, "survival_time": 14.950000000000076, "driven_lanedir": 4.3378393342093435, "sim_render-ego": 0.009240279197692871, "in-drivable-lane": 0, "agent_compute-ego": 0.03820755004882812, "deviation-heading": 2.743342750078342, "set_robot_commands": 0.006852846145629882, "deviation-center-line": 0.9177777936287648, "driven_lanedir_consec": 4.3378393342093435, "sim_compute_sim_state": 0.003821949164072672, "sim_compute_performance-ego": 0.0053301819165547685, "sim_compute_robot_state-ego": 0.006786371072133382, "sim_compute_robot_state-npc0": 0.006650404135386149, "sim_compute_robot_state-npc1": 0.006519142786661784, "sim_compute_robot_state-npc2": 0.0063316249847412106, "sim_compute_robot_state-npc3": 0.0063170703252156575}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.7207923546023833, "sim_physics": 0.14463200171788534, "survival_time": 14.950000000000076, "driven_lanedir": 3.628639272338157, "sim_render-ego": 0.009948398272196452, "in-drivable-lane": 0, "agent_compute-ego": 0.04225749254226684, "deviation-heading": 2.9023673243478836, "set_robot_commands": 0.008011163075764974, "deviation-center-line": 0.77397900717752, "driven_lanedir_consec": 3.628639272338157, "sim_compute_sim_state": 0.003961143493652344, "sim_compute_performance-ego": 0.005756744543711344, "sim_compute_robot_state-ego": 0.007347972393035889, "sim_compute_robot_state-npc0": 0.007170762221018473, "sim_compute_robot_state-npc1": 0.006818507512410482, "sim_compute_robot_state-npc2": 0.006777142683664958, "sim_compute_robot_state-npc3": 0.006788548628489177}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.07302037131142, "sim_physics": 0.1579648184776306, "survival_time": 14.950000000000076, "driven_lanedir": 3.976583919857268, "sim_render-ego": 0.010101722876230877, "in-drivable-lane": 0, "agent_compute-ego": 0.04225130319595337, "deviation-heading": 2.760584028613146, "set_robot_commands": 0.0082098388671875, "deviation-center-line": 1.0254339686774012, "driven_lanedir_consec": 3.976583919857268, "sim_compute_sim_state": 0.004236209392547608, "sim_compute_performance-ego": 0.005940240224202474, "sim_compute_robot_state-ego": 0.007494834264119466, "sim_compute_robot_state-npc0": 0.007363837560017903, "sim_compute_robot_state-npc1": 0.0070987478892008465, "sim_compute_robot_state-npc2": 0.007097117900848389, "sim_compute_robot_state-npc3": 0.006939295927683512}}
set_robot_commands_max0.0082098388671875
set_robot_commands_mean0.007709656079610189
set_robot_commands_median0.00774263858795166
set_robot_commands_min0.006852846145629882
sim_compute_performance-ego_max0.005940240224202474
sim_compute_performance-ego_mean0.005700952370961507
sim_compute_performance-ego_median0.005756744543711344
sim_compute_performance-ego_min0.0053301819165547685
sim_compute_robot_state-ego_max0.007494834264119466
sim_compute_robot_state-ego_mean0.007231969992319743
sim_compute_robot_state-ego_median0.007347972393035889
sim_compute_robot_state-ego_min0.006786371072133382
sim_compute_robot_state-npc0_max0.007363837560017903
sim_compute_robot_state-npc0_mean0.00705916690826416
sim_compute_robot_state-npc0_median0.007170762221018473
sim_compute_robot_state-npc0_min0.006650404135386149
sim_compute_robot_state-npc1_max0.0070987478892008465
sim_compute_robot_state-npc1_mean0.006815889835357666
sim_compute_robot_state-npc1_median0.006818507512410482
sim_compute_robot_state-npc1_min0.006519142786661784
sim_compute_robot_state-npc2_max0.007097117900848389
sim_compute_robot_state-npc2_mean0.00676259183883667
sim_compute_robot_state-npc2_median0.006777142683664958
sim_compute_robot_state-npc2_min0.0063316249847412106
sim_compute_robot_state-npc3_max0.006953908602396647
sim_compute_robot_state-npc3_mean0.006706728617350261
sim_compute_robot_state-npc3_median0.006788548628489177
sim_compute_robot_state-npc3_min0.0063170703252156575
sim_compute_sim_state_max0.004346144994099935
sim_compute_sim_state_mean0.004050537586212158
sim_compute_sim_state_median0.003961143493652344
sim_compute_sim_state_min0.003821949164072672
sim_physics_max0.1579648184776306
sim_physics_mean0.14610521888732914
sim_physics_median0.14463200171788534
sim_physics_min0.13415797551472983
sim_render-ego_max0.010101722876230877
sim_render-ego_mean0.009759229660034178
sim_render-ego_median0.009948398272196452
sim_render-ego_min0.009240279197692871
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
257334497András Kalaposreinforcement-learning-2240saido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:11:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.658231530881845
survival_time_median14.950000000000076
deviation-center-line_median0.7127892525266702
in-drivable-lane_median0


other stats
agent_compute-ego_max0.023953930536905924
agent_compute-ego_mean0.023659962702198188
agent_compute-ego_median0.023552250067392984
agent_compute-ego_min0.02345073938369751
deviation-center-line_max0.7669847296848407
deviation-center-line_mean0.6070973221787321
deviation-center-line_min0.25385508710511756
deviation-heading_max3.8719015002408
deviation-heading_mean3.11275376279483
deviation-heading_median3.761426180810299
deviation-heading_min1.3160634200100263
driven_any_max4.337187330472709
driven_any_mean3.6508125502554862
driven_any_median4.104318466228731
driven_any_min1.584877330080616
driven_lanedir_consec_max4.227994946208349
driven_lanedir_consec_mean3.3608070730927935
driven_lanedir_consec_min1.5242275578565168
driven_lanedir_max4.227994946208349
driven_lanedir_mean3.3608070730927935
driven_lanedir_median3.658231530881845
driven_lanedir_min1.5242275578565168
in-drivable-lane_max1.1500000000000163
in-drivable-lane_mean0.4500000000000025
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.225724446375141, "sim_physics": 0.055331273078918455, "survival_time": 14.950000000000076, "driven_lanedir": 3.658231530881845, "sim_render-ego": 0.006953533490498861, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.023953930536905924, "deviation-heading": 3.846203454946555, "set_robot_commands": 0.004939085642496745, "deviation-center-line": 0.7473582522457123, "driven_lanedir_consec": 3.658231530881845, "sim_compute_sim_state": 0.002853736082712809, "sim_compute_performance-ego": 0.003983712991078694, "sim_compute_robot_state-ego": 0.005000033378601074}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.104318466228731, "sim_physics": 0.05472254196802775, "survival_time": 14.950000000000076, "driven_lanedir": 3.571005934006551, "sim_render-ego": 0.007900294462839762, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.02345073938369751, "deviation-heading": 3.8719015002408, "set_robot_commands": 0.004984446366628011, "deviation-center-line": 0.7127892525266702, "driven_lanedir_consec": 3.571005934006551, "sim_compute_sim_state": 0.002905747890472412, "sim_compute_performance-ego": 0.003953110376993815, "sim_compute_robot_state-ego": 0.005068523089090983}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.337187330472709, "sim_physics": 0.055128541787465415, "survival_time": 14.950000000000076, "driven_lanedir": 4.227994946208349, "sim_render-ego": 0.007065739631652832, "in-drivable-lane": 0, "agent_compute-ego": 0.023552250067392984, "deviation-heading": 2.7681742579664705, "set_robot_commands": 0.004998445510864258, "deviation-center-line": 0.5544992893313195, "driven_lanedir_consec": 4.227994946208349, "sim_compute_sim_state": 0.002953968048095703, "sim_compute_performance-ego": 0.003964888254801432, "sim_compute_robot_state-ego": 0.0051644190152486166}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.584877330080616, "sim_physics": 0.057913585871207617, "survival_time": 5.949999999999987, "driven_lanedir": 1.5242275578565168, "sim_render-ego": 0.007151319199249524, "in-drivable-lane": 0, "agent_compute-ego": 0.023816948177433815, "deviation-heading": 1.3160634200100263, "set_robot_commands": 0.005094405983676429, "deviation-center-line": 0.25385508710511756, "driven_lanedir_consec": 1.5242275578565168, "sim_compute_sim_state": 0.0029638594939929096, "sim_compute_performance-ego": 0.00395373536759064, "sim_compute_robot_state-ego": 0.00512635607679351}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.001955178120234, "sim_physics": 0.05574402252833049, "survival_time": 14.950000000000076, "driven_lanedir": 3.8225753965107065, "sim_render-ego": 0.006983951727549235, "in-drivable-lane": 0, "agent_compute-ego": 0.023525945345560708, "deviation-heading": 3.761426180810299, "set_robot_commands": 0.004988447825113932, "deviation-center-line": 0.7669847296848407, "driven_lanedir_consec": 3.8225753965107065, "sim_compute_sim_state": 0.0029141608874003093, "sim_compute_performance-ego": 0.003947820663452149, "sim_compute_robot_state-ego": 0.005083316167195638}}
set_robot_commands_max0.005094405983676429
set_robot_commands_mean0.005000966265755875
set_robot_commands_median0.004988447825113932
set_robot_commands_min0.004939085642496745
sim_compute_performance-ego_max0.003983712991078694
sim_compute_performance-ego_mean0.003960653530783346
sim_compute_performance-ego_median0.00395373536759064
sim_compute_performance-ego_min0.003947820663452149
sim_compute_robot_state-ego_max0.0051644190152486166
sim_compute_robot_state-ego_mean0.005088529545385964
sim_compute_robot_state-ego_median0.005083316167195638
sim_compute_robot_state-ego_min0.005000033378601074
sim_compute_sim_state_max0.0029638594939929096
sim_compute_sim_state_mean0.002918294480534829
sim_compute_sim_state_median0.0029141608874003093
sim_compute_sim_state_min0.002853736082712809
sim_physics_max0.057913585871207617
sim_physics_mean0.05576799304678994
sim_physics_median0.055331273078918455
sim_physics_min0.05472254196802775
sim_render-ego_max0.007900294462839762
sim_render-ego_mean0.007210967702358043
sim_render-ego_median0.007065739631652832
sim_render-ego_min0.006953533490498861
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.15000000000006
survival_time_min5.949999999999987
No reset possible
257004478Zoltán L?rinczLF_IDPLaido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-46-148-104920:03:20
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 894, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1277, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 306, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 287, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4478/step1-simulation-ip-172-31-46-148-10492-job25700': '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4478/step1-simulation-ip-172-31-46-148-10492-job25700'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
256974343Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:34:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2936911092686696
survival_time_median14.950000000000076
deviation-center-line_median0.6458927111703605
in-drivable-lane_median0


other stats
agent_compute-ego_max0.017457199891408284
agent_compute-ego_mean0.01679326516771522
agent_compute-ego_median0.016955004533131916
agent_compute-ego_min0.01609442154566447
deviation-center-line_max1.3390395454470394
deviation-center-line_mean0.6670912557141407
deviation-center-line_min0.1613606947644751
deviation-heading_max4.98795635733484
deviation-heading_mean2.4719076904646533
deviation-heading_median2.434138711520347
deviation-heading_min0.923595153537317
driven_any_max2.3491387033440625
driven_any_mean1.671924716038304
driven_any_median2.3413362358851932
driven_any_min0.48472869270977254
driven_lanedir_consec_max1.918764399948572
driven_lanedir_consec_mean1.1832794725542286
driven_lanedir_consec_min0.3442983023289712
driven_lanedir_max2.3150621535147295
driven_lanedir_mean1.5612602794123638
driven_lanedir_median2.073434212599558
driven_lanedir_min0.4416049043292265
in-drivable-lane_max0.5999999999999979
in-drivable-lane_mean0.11666666666666684
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.3413362358851932, "sim_physics": 0.12590962251027424, "survival_time": 14.950000000000076, "driven_lanedir": 2.073434212599558, "sim_render-ego": 0.007411978244781494, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.017011493841807047, "deviation-heading": 4.98795635733484, "set_robot_commands": 0.007052044868469238, "deviation-center-line": 0.7554048564695477, "driven_lanedir_consec": 1.3448922518636688, "sim_compute_sim_state": 0.003088709513346354, "sim_compute_performance-ego": 0.004246884187062581, "sim_compute_robot_state-ego": 0.005453042189280192, "sim_compute_robot_state-npc0": 0.006146535078684489, "sim_compute_robot_state-npc1": 0.005007530053456624, "sim_compute_robot_state-npc2": 0.004929343064626058, "sim_compute_robot_state-npc3": 0.004880389372507731}, "udem1-1-0": {"driven_any": 1.320483152244456, "sim_physics": 0.1286004760809112, "survival_time": 8.549999999999986, "driven_lanedir": 1.2936911092686696, "sim_render-ego": 0.007472519288983261, "in-drivable-lane": 0, "agent_compute-ego": 0.01648247172260842, "deviation-heading": 1.18865991434161, "set_robot_commands": 0.007143604825114646, "deviation-center-line": 0.4267932763962911, "driven_lanedir_consec": 1.2936911092686696, "sim_compute_sim_state": 0.002965117058558771, "sim_compute_performance-ego": 0.004233443946169133, "sim_compute_robot_state-ego": 0.005460458889342191, "sim_compute_robot_state-npc0": 0.005979459885268184, "sim_compute_robot_state-npc1": 0.004999839771560758, "sim_compute_robot_state-npc2": 0.004897933257253547, "sim_compute_robot_state-npc3": 0.004782591646874858}, "udem1-2-0": {"driven_any": 0.48472869270977254, "sim_physics": 0.1176031774549342, "survival_time": 3.349999999999996, "driven_lanedir": 0.4416049043292265, "sim_render-ego": 0.00771721085505699, "in-drivable-lane": 0, "agent_compute-ego": 0.017362605279950954, "deviation-heading": 1.1922322677816726, "set_robot_commands": 0.00729399296774793, "deviation-center-line": 0.2784698184538532, "driven_lanedir_consec": 0.4416049043292265, "sim_compute_sim_state": 0.0030553518836177996, "sim_compute_performance-ego": 0.004302697395210836, "sim_compute_robot_state-ego": 0.005479374928260917, "sim_compute_robot_state-npc0": 0.006758334031745569, "sim_compute_robot_state-npc1": 0.005537894234728457, "sim_compute_robot_state-npc2": 0.005027340419256865, "sim_compute_robot_state-npc3": 0.004881766305040957}, "udem1-3-0": {"driven_any": 2.349079487056939, "sim_physics": 0.1290277624130249, "survival_time": 14.950000000000076, "driven_lanedir": 2.2341684253312755, "sim_render-ego": 0.007391393979390462, "in-drivable-lane": 0, "agent_compute-ego": 0.017457199891408284, "deviation-heading": 3.2562685693220774, "set_robot_commands": 0.00729629119237264, "deviation-center-line": 1.0570097533015503, "driven_lanedir_consec": 1.37505406284151, "sim_compute_sim_state": 0.0030231706301371256, "sim_compute_performance-ego": 0.0042284385363260905, "sim_compute_robot_state-ego": 0.005497105916341146, "sim_compute_robot_state-npc0": 0.006089574495951335, "sim_compute_robot_state-npc1": 0.00496237834294637, "sim_compute_robot_state-npc2": 0.004845308462778727, "sim_compute_robot_state-npc3": 0.004792316754659017}, "udem1-4-0": {"driven_any": 2.3491387033440625, "sim_physics": 0.12531702836354577, "survival_time": 14.950000000000076, "driven_lanedir": 2.3150621535147295, "sim_render-ego": 0.007469162940979004, "in-drivable-lane": 0, "agent_compute-ego": 0.017252097924550375, "deviation-heading": 1.9116851660094731, "set_robot_commands": 0.007022051016489664, "deviation-center-line": 0.6458927111703605, "driven_lanedir_consec": 1.847778421283635, "sim_compute_sim_state": 0.003002785841623942, "sim_compute_performance-ego": 0.0041576615969340005, "sim_compute_robot_state-ego": 0.005386865139007569, "sim_compute_robot_state-npc0": 0.006056402524312337, "sim_compute_robot_state-npc1": 0.004929188092549642, "sim_compute_robot_state-npc2": 0.0048763656616210935, "sim_compute_robot_state-npc3": 0.0048752228418986005}, "udem1-5-0": {"driven_any": 0.7820298681113009, "sim_physics": 0.11744533593838032, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7388963202331451, "sim_render-ego": 0.0074160236578721265, "in-drivable-lane": 0, "agent_compute-ego": 0.016679630829737738, "deviation-heading": 1.1064721996353946, "set_robot_commands": 0.007365765479894785, "deviation-center-line": 0.1613606947644751, "driven_lanedir_consec": 0.7388963202331451, "sim_compute_sim_state": 0.002920460242491502, "sim_compute_performance-ego": 0.004157854960514949, "sim_compute_robot_state-ego": 0.005375135403413039, "sim_compute_robot_state-npc0": 0.006011050481062669, "sim_compute_robot_state-npc1": 0.004954810325915997, "sim_compute_robot_state-npc2": 0.0048179580615117, "sim_compute_robot_state-npc3": 0.004801614926411555}, "udem1-6-0": {"driven_any": 2.349029889783031, "sim_physics": 0.113863205909729, "survival_time": 14.950000000000076, "driven_lanedir": 2.2059036931188083, "sim_render-ego": 0.00734359343846639, "in-drivable-lane": 0, "agent_compute-ego": 0.016968791484832765, "deviation-heading": 4.209180490704574, "set_robot_commands": 0.006936275164286296, "deviation-center-line": 1.0086301079835192, "driven_lanedir_consec": 1.65028458793303, "sim_compute_sim_state": 0.0029820839564005533, "sim_compute_performance-ego": 0.004152920246124268, "sim_compute_robot_state-ego": 0.005301411946614583, "sim_compute_robot_state-npc0": 0.006058890024820964, "sim_compute_robot_state-npc1": 0.0051421475410461425, "sim_compute_robot_state-npc2": 0.004918226401011149, "sim_compute_robot_state-npc3": 0.004835093816121419}, "udem1-7-0": {"driven_any": 2.349124549703718, "sim_physics": 0.12036609093348186, "survival_time": 14.950000000000076, "driven_lanedir": 2.281838371327781, "sim_render-ego": 0.007399269739786784, "in-drivable-lane": 0, "agent_compute-ego": 0.016955004533131916, "deviation-heading": 2.5079075214877307, "set_robot_commands": 0.007002971967061361, "deviation-center-line": 1.1105077369416616, "driven_lanedir_consec": 1.7723512663203798, "sim_compute_sim_state": 0.0030013593037923176, "sim_compute_performance-ego": 0.004191959698994954, "sim_compute_robot_state-ego": 0.005369113286336263, "sim_compute_robot_state-npc0": 0.005966444810231526, "sim_compute_robot_state-npc1": 0.004947404066721599, "sim_compute_robot_state-npc2": 0.004857533772786458, "sim_compute_robot_state-npc3": 0.004774927298227946}, "udem1-8-0": {"driven_any": 2.349054382261254, "sim_physics": 0.12717569669087728, "survival_time": 14.950000000000076, "driven_lanedir": 2.17456323203177, "sim_render-ego": 0.0073106519381205244, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.017110117276509604, "deviation-heading": 3.588017815043434, "set_robot_commands": 0.007253630956013998, "deviation-center-line": 0.8086118646053106, "driven_lanedir_consec": 1.5296003149964732, "sim_compute_sim_state": 0.003020376364390055, "sim_compute_performance-ego": 0.004160141944885254, "sim_compute_robot_state-ego": 0.005341808001200358, "sim_compute_robot_state-npc0": 0.0061453962326049804, "sim_compute_robot_state-npc1": 0.004978905518849691, "sim_compute_robot_state-npc2": 0.00485018253326416, "sim_compute_robot_state-npc3": 0.0048394362131754555}, "udem1-9-0": {"driven_any": 1.0230223750780896, "sim_physics": 0.12836870862476862, "survival_time": 6.699999999999984, "driven_lanedir": 0.7357346213420879, "sim_render-ego": 0.007453283267234688, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.017038724315700245, "deviation-heading": 3.2767144878329164, "set_robot_commands": 0.007045187167267301, "deviation-center-line": 0.4445003036438153, "driven_lanedir_consec": 0.3442983023289712, "sim_compute_sim_state": 0.002930860021221104, "sim_compute_performance-ego": 0.004137747323335107, "sim_compute_robot_state-ego": 0.005267264238044397, "sim_compute_robot_state-npc0": 0.0062708000638591705, "sim_compute_robot_state-npc1": 0.005382041432964268, "sim_compute_robot_state-npc2": 0.004965801737201747, "sim_compute_robot_state-npc3": 0.004822912500865424}, "udem1-10-0": {"driven_any": 0.7338397293005492, "sim_physics": 0.11951445803350332, "survival_time": 4.899999999999991, "driven_lanedir": 0.7120397661269756, "sim_render-ego": 0.007310227471954969, "in-drivable-lane": 0, "agent_compute-ego": 0.01659679412841797, "deviation-heading": 0.9996394001250816, "set_robot_commands": 0.006852113470739248, "deviation-center-line": 0.2082370681652969, "driven_lanedir_consec": 0.7120397661269756, "sim_compute_sim_state": 0.0029571591591348455, "sim_compute_performance-ego": 0.004152767512263084, "sim_compute_robot_state-ego": 0.005296685257736518, "sim_compute_robot_state-npc0": 0.006122175528078663, "sim_compute_robot_state-npc1": 0.005106152320394711, "sim_compute_robot_state-npc2": 0.004824779471572564, "sim_compute_robot_state-npc3": 0.0047531152258113935}, "udem1-11-0": {"driven_any": 1.2722783806716391, "sim_physics": 0.1230848673618201, "survival_time": 8.249999999999982, "driven_lanedir": 1.191477445445449, "sim_render-ego": 0.007201914353804155, "in-drivable-lane": 0.25000000000000266, "agent_compute-ego": 0.016126184752493194, "deviation-heading": 1.350842833558761, "set_robot_commands": 0.006941571380152847, "deviation-center-line": 0.3792664301486427, "driven_lanedir_consec": 1.191477445445449, "sim_compute_sim_state": 0.0029113408290978634, "sim_compute_performance-ego": 0.004097071560946378, "sim_compute_robot_state-ego": 0.00523102500221946, "sim_compute_robot_state-npc0": 0.005749542062932795, "sim_compute_robot_state-npc1": 0.0048629226106585875, "sim_compute_robot_state-npc2": 0.004766292283029268, "sim_compute_robot_state-npc3": 0.004716153578324752}, "udem1-12-0": {"driven_any": 2.3491378678139263, "sim_physics": 0.11972328980763754, "survival_time": 14.950000000000076, "driven_lanedir": 2.277174081646064, "sim_render-ego": 0.007122960885365804, "in-drivable-lane": 0, "agent_compute-ego": 0.01609442154566447, "deviation-heading": 2.434138711520347, "set_robot_commands": 0.006831119855244955, "deviation-center-line": 1.105180510422192, "driven_lanedir_consec": 1.918764399948572, "sim_compute_sim_state": 0.0029161707560221356, "sim_compute_performance-ego": 0.004067357381184896, "sim_compute_robot_state-ego": 0.005196394125620524, "sim_compute_robot_state-npc0": 0.00586560328801473, "sim_compute_robot_state-npc1": 0.004861169656117757, "sim_compute_robot_state-npc2": 0.004721848964691162, "sim_compute_robot_state-npc3": 0.004707315762837728}, "udem1-13-0": {"driven_any": 0.6775975375286137, "sim_physics": 0.1320182726933406, "survival_time": 4.549999999999992, "driven_lanedir": 0.6578885955042126, "sim_render-ego": 0.007238296362069936, "in-drivable-lane": 0, "agent_compute-ego": 0.016144736782535092, "deviation-heading": 0.923595153537317, "set_robot_commands": 0.007112311792897654, "deviation-center-line": 0.2774641577985551, "driven_lanedir_consec": 0.6578173477786682, "sim_compute_sim_state": 0.002963692277342409, "sim_compute_performance-ego": 0.003987907053350092, "sim_compute_robot_state-ego": 0.005161780577439528, "sim_compute_robot_state-npc0": 0.005999968602107122, "sim_compute_robot_state-npc1": 0.004750513768458104, "sim_compute_robot_state-npc2": 0.00466157839848445, "sim_compute_robot_state-npc3": 0.004695970933515947}, "udem1-14-0": {"driven_any": 2.3489898890820147, "sim_physics": 0.1211696211496989, "survival_time": 14.950000000000076, "driven_lanedir": 2.0854272593657126, "sim_render-ego": 0.007193085352579753, "in-drivable-lane": 0.4000000000000039, "agent_compute-ego": 0.016618703206380207, "deviation-heading": 4.145304468734573, "set_robot_commands": 0.006816442807515462, "deviation-center-line": 1.3390395454470394, "driven_lanedir_consec": 0.930641587615058, "sim_compute_sim_state": 0.0029324698448181153, "sim_compute_performance-ego": 0.004049065113067627, "sim_compute_robot_state-ego": 0.0051851654052734375, "sim_compute_robot_state-npc0": 0.005882278283437093, "sim_compute_robot_state-npc1": 0.004935536384582519, "sim_compute_robot_state-npc2": 0.004779604276021322, "sim_compute_robot_state-npc3": 0.004810241858164469}}
set_robot_commands_max0.007365765479894785
set_robot_commands_mean0.007064358327417869
set_robot_commands_median0.007045187167267301
set_robot_commands_min0.006816442807515462
sim_compute_performance-ego_max0.004302697395210836
sim_compute_performance-ego_mean0.004154927897091284
sim_compute_performance-ego_median0.0041576615969340005
sim_compute_performance-ego_min0.003987907053350092
sim_compute_robot_state-ego_max0.005497105916341146
sim_compute_robot_state-ego_mean0.005333508687075341
sim_compute_robot_state-ego_median0.005341808001200358
sim_compute_robot_state-ego_min0.005161780577439528
sim_compute_robot_state-npc0_max0.006758334031745569
sim_compute_robot_state-npc0_mean0.006073497026207441
sim_compute_robot_state-npc0_median0.006056402524312337
sim_compute_robot_state-npc0_min0.005749542062932795
sim_compute_robot_state-npc1_max0.005537894234728457
sim_compute_robot_state-npc1_mean0.005023895608063415
sim_compute_robot_state-npc1_median0.00496237834294637
sim_compute_robot_state-npc1_min0.004750513768458104
sim_compute_robot_state-npc2_max0.005027340419256865
sim_compute_robot_state-npc2_mean0.0048493397843406855
sim_compute_robot_state-npc2_median0.00485018253326416
sim_compute_robot_state-npc2_min0.00466157839848445
sim_compute_robot_state-npc3_max0.004881766305040957
sim_compute_robot_state-npc3_mean0.004797937935629149
sim_compute_robot_state-npc3_median0.004801614926411555
sim_compute_robot_state-npc3_min0.004695970933515947
sim_compute_sim_state_max0.003088709513346354
sim_compute_sim_state_mean0.002978073845466326
sim_compute_sim_state_median0.002965117058558771
sim_compute_sim_state_min0.0029113408290978634
sim_physics_max0.1320182726933406
sim_physics_mean0.1232791742643952
sim_physics_median0.1230848673618201
sim_physics_min0.113863205909729
sim_render-ego_max0.00771721085505699
sim_render-ego_mean0.0073634381184297555
sim_render-ego_median0.007391393979390462
sim_render-ego_min0.007122960885365804
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.740000000000036
survival_time_min3.349999999999996
No reset possible
256944267Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LFVI-sim-validationstep1-simulationerrornoip-172-31-46-148-104920:09:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
256864190Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24509646022130271
survival_time_median2.5999999999999988
deviation-center-line_median0.1102550226967659
in-drivable-lane_median1.399999999999995


other stats
agent_compute-ego_max0.024377030985695977
agent_compute-ego_mean0.022837970705180323
agent_compute-ego_median0.024022680741769296
agent_compute-ego_min0.0208013286957374
deviation-center-line_max0.16420485117826172
deviation-center-line_mean0.11073567159630056
deviation-center-line_min0.07065331237272693
deviation-heading_max0.586908120134486
deviation-heading_mean0.4563328899543674
deviation-heading_median0.46418759639345647
deviation-heading_min0.3144035683599862
driven_any_max1.029569969954737
driven_any_mean0.6523120620071737
driven_any_median0.676320777519435
driven_any_min0.28966334503214825
driven_lanedir_consec_max0.5728900130190617
driven_lanedir_consec_mean0.3427697821915853
driven_lanedir_consec_min0.19101417073511717
driven_lanedir_max0.5728900130190617
driven_lanedir_mean0.3427697821915853
driven_lanedir_median0.24509646022130271
driven_lanedir_min0.19101417073511717
in-drivable-lane_max1.5499999999999985
in-drivable-lane_mean0.9099999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.029569969954737, "sim_physics": 0.1448915527291494, "survival_time": 3.649999999999995, "driven_lanedir": 0.5728900130190617, "sim_render-ego": 0.01004238977824172, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.020855514970544265, "deviation-heading": 0.46418759639345647, "set_robot_commands": 0.007613573988823042, "deviation-center-line": 0.16420485117826172, "driven_lanedir_consec": 0.5728900130190617, "sim_compute_sim_state": 0.00375513834496067, "sim_compute_performance-ego": 0.005637250534475666, "sim_compute_robot_state-ego": 0.007500592976400297, "sim_compute_robot_state-npc0": 0.006715885580402531, "sim_compute_robot_state-npc1": 0.006656901477134391, "sim_compute_robot_state-npc2": 0.006471761285442195, "sim_compute_robot_state-npc3": 0.006347888136563236}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4854069732029952, "sim_physics": 0.19255249367819893, "survival_time": 1.800000000000001, "driven_lanedir": 0.4655139107766719, "sim_render-ego": 0.011564506424797906, "in-drivable-lane": 0, "agent_compute-ego": 0.024133298132154677, "deviation-heading": 0.4301190528543047, "set_robot_commands": 0.009131266011132134, "deviation-center-line": 0.1102550226967659, "driven_lanedir_consec": 0.4655139107766719, "sim_compute_sim_state": 0.004303912321726481, "sim_compute_performance-ego": 0.006543656190236409, "sim_compute_robot_state-ego": 0.008234527375962999, "sim_compute_robot_state-npc0": 0.007818069722917344, "sim_compute_robot_state-npc1": 0.007905675305260552, "sim_compute_robot_state-npc2": 0.0077355967627631295, "sim_compute_robot_state-npc3": 0.0076873037550184466}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.676320777519435, "sim_physics": 0.1595134184910701, "survival_time": 2.5999999999999988, "driven_lanedir": 0.19101417073511717, "sim_render-ego": 0.010230912612034723, "in-drivable-lane": 1.5499999999999985, "agent_compute-ego": 0.0208013286957374, "deviation-heading": 0.3144035683599862, "set_robot_commands": 0.007093209486741286, "deviation-center-line": 0.11974981095625696, "driven_lanedir_consec": 0.19101417073511717, "sim_compute_sim_state": 0.0038099747437697193, "sim_compute_performance-ego": 0.005709350109100342, "sim_compute_robot_state-ego": 0.007188691542698787, "sim_compute_robot_state-npc0": 0.006805965533623328, "sim_compute_robot_state-npc1": 0.006643556631528414, "sim_compute_robot_state-npc2": 0.006628022744105413, "sim_compute_robot_state-npc3": 0.006389154837681697}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.28966334503214825, "sim_physics": 0.2051036102431161, "survival_time": 1.4000000000000006, "driven_lanedir": 0.24509646022130271, "sim_render-ego": 0.011849394866398402, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.024377030985695977, "deviation-heading": 0.586908120134486, "set_robot_commands": 0.00894205059323992, "deviation-center-line": 0.08881536077749116, "driven_lanedir_consec": 0.24509646022130271, "sim_compute_sim_state": 0.004634814602988107, "sim_compute_performance-ego": 0.007658830710819789, "sim_compute_robot_state-ego": 0.008836907999856132, "sim_compute_robot_state-npc0": 0.008619453225817, "sim_compute_robot_state-npc1": 0.007828295230865479, "sim_compute_robot_state-npc2": 0.008198465619768416, "sim_compute_robot_state-npc3": 0.008000229086194719}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7805992443265533, "sim_physics": 0.1746908293830024, "survival_time": 2.6999999999999984, "driven_lanedir": 0.23933435620577304, "sim_render-ego": 0.011469770360876012, "in-drivable-lane": 1.549999999999998, "agent_compute-ego": 0.024022680741769296, "deviation-heading": 0.4860461120296032, "set_robot_commands": 0.009421017434861925, "deviation-center-line": 0.07065331237272693, "driven_lanedir_consec": 0.23933435620577304, "sim_compute_sim_state": 0.0045148443292688445, "sim_compute_performance-ego": 0.0064718590842352975, "sim_compute_robot_state-ego": 0.008292847209506564, "sim_compute_robot_state-npc0": 0.00793782869974772, "sim_compute_robot_state-npc1": 0.007870400393450702, "sim_compute_robot_state-npc2": 0.007857508129543729, "sim_compute_robot_state-npc3": 0.007865331791065357}}
set_robot_commands_max0.009421017434861925
set_robot_commands_mean0.008440223502959662
set_robot_commands_median0.00894205059323992
set_robot_commands_min0.007093209486741286
sim_compute_performance-ego_max0.007658830710819789
sim_compute_performance-ego_mean0.0064041893257735
sim_compute_performance-ego_median0.0064718590842352975
sim_compute_performance-ego_min0.005637250534475666
sim_compute_robot_state-ego_max0.008836907999856132
sim_compute_robot_state-ego_mean0.008010713420884956
sim_compute_robot_state-ego_median0.008234527375962999
sim_compute_robot_state-ego_min0.007188691542698787
sim_compute_robot_state-npc0_max0.008619453225817
sim_compute_robot_state-npc0_mean0.007579440552501584
sim_compute_robot_state-npc0_median0.007818069722917344
sim_compute_robot_state-npc0_min0.006715885580402531
sim_compute_robot_state-npc1_max0.007905675305260552
sim_compute_robot_state-npc1_mean0.0073809658076479075
sim_compute_robot_state-npc1_median0.007828295230865479
sim_compute_robot_state-npc1_min0.006643556631528414
sim_compute_robot_state-npc2_max0.008198465619768416
sim_compute_robot_state-npc2_mean0.007378270908324577
sim_compute_robot_state-npc2_median0.0077355967627631295
sim_compute_robot_state-npc2_min0.006471761285442195
sim_compute_robot_state-npc3_max0.008000229086194719
sim_compute_robot_state-npc3_mean0.007257981521304691
sim_compute_robot_state-npc3_median0.0076873037550184466
sim_compute_robot_state-npc3_min0.006347888136563236
sim_compute_sim_state_max0.004634814602988107
sim_compute_sim_state_mean0.004203736868542765
sim_compute_sim_state_median0.004303912321726481
sim_compute_sim_state_min0.00375513834496067
sim_physics_max0.2051036102431161
sim_physics_mean0.17535038090490737
sim_physics_median0.1746908293830024
sim_physics_min0.1448915527291494
sim_render-ego_max0.011849394866398402
sim_render-ego_mean0.011031394808469751
sim_render-ego_median0.011469770360876012
sim_render-ego_min0.01004238977824172
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean2.4299999999999984
survival_time_min1.4000000000000006
No reset possible
256174439Bea Baselines 🐤straightaido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:35:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4492677000931018
survival_time_median6.449999999999985
deviation-center-line_median0.4322287119720577
in-drivable-lane_median1.1000000000000156


other stats
agent_compute-ego_max0.024744180115786465
agent_compute-ego_mean0.02209197738683951
agent_compute-ego_median0.022028709280079807
agent_compute-ego_min0.01900305580254176
deviation-center-line_max1.1589124464474256
deviation-center-line_mean0.4029709889257216
deviation-center-line_min0.154710721708956
deviation-heading_max3.0190289833883304
deviation-heading_mean1.3474439162107843
deviation-heading_median0.8582960495748903
deviation-heading_min0.4705644729064003
driven_any_max2.17282819078691
driven_any_mean1.0539936570104351
driven_any_median1.0130038366165683
driven_any_min0.2919647685860048
driven_lanedir_consec_max1.665835597891082
driven_lanedir_consec_mean0.6895205195375026
driven_lanedir_consec_min0.28355176286572537
driven_lanedir_max1.91556473235392
driven_lanedir_mean0.7367596857725889
driven_lanedir_median0.48758407159543826
driven_lanedir_min0.28355176286572537
in-drivable-lane_max5.099999999999982
in-drivable-lane_mean1.526666666666668
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.4329892855289166, "sim_physics": 0.2521252470501399, "survival_time": 2.9499999999999975, "driven_lanedir": 0.4189537512520374, "sim_render-ego": 0.011764635473994886, "in-drivable-lane": 0, "agent_compute-ego": 0.023217944775597524, "deviation-heading": 0.7560843063940643, "set_robot_commands": 0.009012456667625296, "deviation-center-line": 0.197647523211923, "driven_lanedir_consec": 0.4189537512520374, "sim_compute_sim_state": 0.0045491719650009935, "sim_compute_performance-ego": 0.006807311106536348, "sim_compute_robot_state-ego": 0.008983894930047504, "sim_compute_robot_state-npc0": 0.008230152776685812, "sim_compute_robot_state-npc1": 0.007699235010955293, "sim_compute_robot_state-npc2": 0.00757416224075576, "sim_compute_robot_state-npc3": 0.008021184953592591}, "udem1-1-0": {"driven_any": 1.5792469758435803, "sim_physics": 0.18405601231738777, "survival_time": 9.900000000000006, "driven_lanedir": 1.2330803887754185, "sim_render-ego": 0.011058649631461711, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.021159799412043406, "deviation-heading": 1.7826747970058252, "set_robot_commands": 0.008605525951192837, "deviation-center-line": 0.4322287119720577, "driven_lanedir_consec": 1.2330803887754185, "sim_compute_sim_state": 0.004415304973872021, "sim_compute_performance-ego": 0.0064618731990005035, "sim_compute_robot_state-ego": 0.008300032278504035, "sim_compute_robot_state-npc0": 0.007660661080870965, "sim_compute_robot_state-npc1": 0.00743844894447712, "sim_compute_robot_state-npc2": 0.007370762150697034, "sim_compute_robot_state-npc3": 0.007486038737826877}, "udem1-2-0": {"driven_any": 1.0207210663188353, "sim_physics": 0.18858415346879223, "survival_time": 6.499999999999985, "driven_lanedir": 0.45272169318330424, "sim_render-ego": 0.01122750502366286, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.02149379069988544, "deviation-heading": 2.1723642844930007, "set_robot_commands": 0.00913110512953538, "deviation-center-line": 0.4335538765593932, "driven_lanedir_consec": 0.4492677000931018, "sim_compute_sim_state": 0.004774614480825571, "sim_compute_performance-ego": 0.006550732025733361, "sim_compute_robot_state-ego": 0.008383393287658691, "sim_compute_robot_state-npc0": 0.007932294332064115, "sim_compute_robot_state-npc1": 0.007697699620173528, "sim_compute_robot_state-npc2": 0.007785861308758075, "sim_compute_robot_state-npc3": 0.007578251912043645}, "udem1-3-0": {"driven_any": 0.3098024087492814, "sim_physics": 0.24731126698580655, "survival_time": 2.2, "driven_lanedir": 0.2911602594904128, "sim_render-ego": 0.012268093499270352, "in-drivable-lane": 0, "agent_compute-ego": 0.024744180115786465, "deviation-heading": 0.7663028002247165, "set_robot_commands": 0.00944198803468184, "deviation-center-line": 0.154710721708956, "driven_lanedir_consec": 0.2911602594904128, "sim_compute_sim_state": 0.004795697602358731, "sim_compute_performance-ego": 0.006872025403109464, "sim_compute_robot_state-ego": 0.008729078552939674, "sim_compute_robot_state-npc0": 0.008540110154585405, "sim_compute_robot_state-npc1": 0.008286356925964355, "sim_compute_robot_state-npc2": 0.008238944140347567, "sim_compute_robot_state-npc3": 0.008039870045401833}, "udem1-4-0": {"driven_any": 1.215587491559389, "sim_physics": 0.24209930215563097, "survival_time": 7.699999999999981, "driven_lanedir": 0.35446915630098297, "sim_render-ego": 0.011834766957666968, "in-drivable-lane": 5.099999999999982, "agent_compute-ego": 0.022595684249679764, "deviation-heading": 0.8418481412128709, "set_robot_commands": 0.009267370422165116, "deviation-center-line": 0.1979060328893373, "driven_lanedir_consec": 0.35446915630098297, "sim_compute_sim_state": 0.00485686512736531, "sim_compute_performance-ego": 0.006849663598196847, "sim_compute_robot_state-ego": 0.009246974796443793, "sim_compute_robot_state-npc0": 0.008109905503012917, "sim_compute_robot_state-npc1": 0.007927831117208902, "sim_compute_robot_state-npc2": 0.007915979856020444, "sim_compute_robot_state-npc3": 0.0079314120404132}, "udem1-5-0": {"driven_any": 1.0130038366165683, "sim_physics": 0.14893080652222151, "survival_time": 6.449999999999985, "driven_lanedir": 0.5525173154397738, "sim_render-ego": 0.010638379311376765, "in-drivable-lane": 2.6999999999999904, "agent_compute-ego": 0.020284652709960938, "deviation-heading": 0.7603717650737841, "set_robot_commands": 0.007977188095565914, "deviation-center-line": 0.2608817551070215, "driven_lanedir_consec": 0.5525173154397738, "sim_compute_sim_state": 0.004051337870516519, "sim_compute_performance-ego": 0.006018921386363895, "sim_compute_robot_state-ego": 0.007524484811827194, "sim_compute_robot_state-npc0": 0.007139000781746798, "sim_compute_robot_state-npc1": 0.006966640782910724, "sim_compute_robot_state-npc2": 0.006898295971774316, "sim_compute_robot_state-npc3": 0.007102990335272264}, "udem1-6-0": {"driven_any": 0.2919647685860048, "sim_physics": 0.1824307498477754, "survival_time": 2.1000000000000005, "driven_lanedir": 0.28355176286572537, "sim_render-ego": 0.011722485224405924, "in-drivable-lane": 0, "agent_compute-ego": 0.021681779906863256, "deviation-heading": 0.4917790367249191, "set_robot_commands": 0.008457598232087634, "deviation-center-line": 0.2063789557976393, "driven_lanedir_consec": 0.28355176286572537, "sim_compute_sim_state": 0.004039628165108817, "sim_compute_performance-ego": 0.006398501850309826, "sim_compute_robot_state-ego": 0.008502114386785598, "sim_compute_robot_state-npc0": 0.008167329288664319, "sim_compute_robot_state-npc1": 0.007069025720868792, "sim_compute_robot_state-npc2": 0.0069773878370012555, "sim_compute_robot_state-npc3": 0.00664233026050386}, "udem1-7-0": {"driven_any": 2.163462294718305, "sim_physics": 0.22278158967174705, "survival_time": 13.400000000000055, "driven_lanedir": 1.91556473235392, "sim_render-ego": 0.01157119825704774, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.02224131217643396, "deviation-heading": 1.399456352311515, "set_robot_commands": 0.009042430279859856, "deviation-center-line": 0.4345804021364813, "driven_lanedir_consec": 1.620400434094304, "sim_compute_sim_state": 0.004730716570099788, "sim_compute_performance-ego": 0.006694744771985866, "sim_compute_robot_state-ego": 0.008659000716992278, "sim_compute_robot_state-npc0": 0.008085021332128723, "sim_compute_robot_state-npc1": 0.007936122702128852, "sim_compute_robot_state-npc2": 0.007967239885187861, "sim_compute_robot_state-npc3": 0.007842511383455191}, "udem1-8-0": {"driven_any": 0.9902488356085234, "sim_physics": 0.2240969775215028, "survival_time": 6.299999999999986, "driven_lanedir": 0.8123707705109183, "sim_render-ego": 0.01328074742877294, "in-drivable-lane": 0, "agent_compute-ego": 0.024356717155093237, "deviation-heading": 2.3986430505646417, "set_robot_commands": 0.010046196362328908, "deviation-center-line": 0.5439779726996199, "driven_lanedir_consec": 0.8112549718480385, "sim_compute_sim_state": 0.0050014787250094945, "sim_compute_performance-ego": 0.007267291583712139, "sim_compute_robot_state-ego": 0.009655386682540653, "sim_compute_robot_state-npc0": 0.008452672806997148, "sim_compute_robot_state-npc1": 0.00871341758304172, "sim_compute_robot_state-npc2": 0.008631545399862623, "sim_compute_robot_state-npc3": 0.008437497275216239}, "udem1-9-0": {"driven_any": 1.2595430501299905, "sim_physics": 0.22722010942375137, "survival_time": 7.94999999999998, "driven_lanedir": 0.48758407159543826, "sim_render-ego": 0.011769783571831083, "in-drivable-lane": 3.4499999999999877, "agent_compute-ego": 0.02278622441321799, "deviation-heading": 3.0190289833883304, "set_robot_commands": 0.008922947277812837, "deviation-center-line": 0.470314872816476, "driven_lanedir_consec": 0.332323832154034, "sim_compute_sim_state": 0.005042151085235788, "sim_compute_performance-ego": 0.006859289025360683, "sim_compute_robot_state-ego": 0.008736225044202505, "sim_compute_robot_state-npc0": 0.008603664314222036, "sim_compute_robot_state-npc1": 0.00814801941877641, "sim_compute_robot_state-npc2": 0.008073166481353951, "sim_compute_robot_state-npc3": 0.00810607724219748}, "udem1-10-0": {"driven_any": 0.35478078634718124, "sim_physics": 0.2492246866226196, "survival_time": 2.499999999999999, "driven_lanedir": 0.34034868686217346, "sim_render-ego": 0.01188063621520996, "in-drivable-lane": 0, "agent_compute-ego": 0.022632193565368653, "deviation-heading": 0.7119095801113112, "set_robot_commands": 0.009406633377075197, "deviation-center-line": 0.18406520042014887, "driven_lanedir_consec": 0.34034868686217346, "sim_compute_sim_state": 0.0050532293319702146, "sim_compute_performance-ego": 0.00714202880859375, "sim_compute_robot_state-ego": 0.008955893516540527, "sim_compute_robot_state-npc0": 0.008678903579711914, "sim_compute_robot_state-npc1": 0.008421564102172851, "sim_compute_robot_state-npc2": 0.008243861198425293, "sim_compute_robot_state-npc3": 0.00837982177734375}, "udem1-11-0": {"driven_any": 1.5896376676826622, "sim_physics": 0.15722866393812937, "survival_time": 9.950000000000006, "driven_lanedir": 0.9481619417501348, "sim_render-ego": 0.01006821771362918, "in-drivable-lane": 3.85000000000002, "agent_compute-ego": 0.01900305580254176, "deviation-heading": 0.4705644729064003, "set_robot_commands": 0.007817999202402393, "deviation-center-line": 0.6490698473210302, "driven_lanedir_consec": 0.9481619417501348, "sim_compute_sim_state": 0.004109815137470188, "sim_compute_performance-ego": 0.005822409337489449, "sim_compute_robot_state-ego": 0.007433461184477686, "sim_compute_robot_state-npc0": 0.006902093264325779, "sim_compute_robot_state-npc1": 0.006743638359721581, "sim_compute_robot_state-npc2": 0.006733392351236774, "sim_compute_robot_state-npc3": 0.0069100748953507775}, "udem1-12-0": {"driven_any": 2.17282819078691, "sim_physics": 0.2141649493464717, "survival_time": 13.500000000000057, "driven_lanedir": 1.9009021334547016, "sim_render-ego": 0.011988072042111997, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.02196684236879702, "deviation-heading": 2.3263143885818947, "set_robot_commands": 0.00937022191506845, "deviation-center-line": 1.1589124464474256, "driven_lanedir_consec": 1.665835597891082, "sim_compute_sim_state": 0.004941833460772479, "sim_compute_performance-ego": 0.006889779479415328, "sim_compute_robot_state-ego": 0.008984660219263148, "sim_compute_robot_state-npc0": 0.008483941466720015, "sim_compute_robot_state-npc1": 0.008380654123094347, "sim_compute_robot_state-npc2": 0.008360541308367693, "sim_compute_robot_state-npc3": 0.00825931672696714}, "udem1-13-0": {"driven_any": 0.4233878134921607, "sim_physics": 0.2210349831087836, "survival_time": 2.8999999999999977, "driven_lanedir": 0.40515771130165046, "sim_render-ego": 0.011380594352196002, "in-drivable-lane": 0, "agent_compute-ego": 0.022028709280079807, "deviation-heading": 0.8582960495748903, "set_robot_commands": 0.009106767588648302, "deviation-center-line": 0.19844220811743105, "driven_lanedir_consec": 0.40515771130165046, "sim_compute_sim_state": 0.00622670814908784, "sim_compute_performance-ego": 0.00645719314443654, "sim_compute_robot_state-ego": 0.007978377671077334, "sim_compute_robot_state-npc0": 0.007837213318923423, "sim_compute_robot_state-npc1": 0.007811887510891618, "sim_compute_robot_state-npc2": 0.007875635706145188, "sim_compute_robot_state-npc3": 0.0076185711498918205}, "udem1-14-0": {"driven_any": 0.9927003831882222, "sim_physics": 0.211216061134038, "survival_time": 6.349999999999985, "driven_lanedir": 0.6548509114522414, "sim_render-ego": 0.011148223726768191, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.021186774171243504, "deviation-heading": 1.456020734593601, "set_robot_commands": 0.008573710449098602, "deviation-center-line": 0.5218943066808839, "driven_lanedir_consec": 0.6363242829436704, "sim_compute_sim_state": 0.004481923861766424, "sim_compute_performance-ego": 0.006007096898837353, "sim_compute_robot_state-ego": 0.008156765164352778, "sim_compute_robot_state-npc0": 0.007831883242749792, "sim_compute_robot_state-npc1": 0.007782115711001899, "sim_compute_robot_state-npc2": 0.007146698283398245, "sim_compute_robot_state-npc3": 0.007283648168008159}}
set_robot_commands_max0.010046196362328908
set_robot_commands_mean0.008945342599009904
set_robot_commands_median0.009042430279859856
set_robot_commands_min0.007817999202402393
sim_compute_performance-ego_max0.007267291583712139
sim_compute_performance-ego_mean0.006606590774605425
sim_compute_performance-ego_median0.006694744771985866
sim_compute_performance-ego_min0.005822409337489449
sim_compute_robot_state-ego_max0.009655386682540653
sim_compute_robot_state-ego_mean0.008548649549576893
sim_compute_robot_state-ego_median0.008659000716992278
sim_compute_robot_state-ego_min0.007433461184477686
sim_compute_robot_state-npc0_max0.008678903579711914
sim_compute_robot_state-npc0_mean0.008043656482893945
sim_compute_robot_state-npc0_median0.008109905503012917
sim_compute_robot_state-npc0_min0.006902093264325779
sim_compute_robot_state-npc1_max0.00871341758304172
sim_compute_robot_state-npc1_mean0.007801510508892533
sim_compute_robot_state-npc1_median0.007811887510891618
sim_compute_robot_state-npc1_min0.006743638359721581
sim_compute_robot_state-npc2_max0.008631545399862623
sim_compute_robot_state-npc2_mean0.007719564941288805
sim_compute_robot_state-npc2_median0.007875635706145188
sim_compute_robot_state-npc2_min0.006733392351236774
sim_compute_robot_state-npc3_max0.008437497275216239
sim_compute_robot_state-npc3_mean0.007709306460232322
sim_compute_robot_state-npc3_median0.007842511383455191
sim_compute_robot_state-npc3_min0.00664233026050386
sim_compute_sim_state_max0.00622670814908784
sim_compute_sim_state_mean0.004738031767097345
sim_compute_sim_state_median0.004774614480825571
sim_compute_sim_state_min0.004039628165108817
sim_physics_max0.2521252470501399
sim_physics_mean0.21150037060765317
sim_physics_median0.2210349831087836
sim_physics_min0.14893080652222151
sim_render-ego_max0.01328074742877294
sim_render-ego_mean0.011573465895293771
sim_render-ego_median0.011722485224405924
sim_render-ego_min0.01006821771362918
simulation-passed1
survival_time_max13.500000000000057
survival_time_mean6.71
survival_time_min2.1000000000000005
No reset possible
255974437Bea Baselines 🐤straightaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.37391419923137703
survival_time_median6.349999999999985
deviation-center-line_median0.19764810458264365
in-drivable-lane_median1.649999999999994


other stats
agent_compute-ego_max0.023746345925518848
agent_compute-ego_mean0.022730713465134812
agent_compute-ego_median0.02282899542699886
agent_compute-ego_min0.02074996100531684
deviation-center-line_max0.2288047809259315
deviation-center-line_mean0.1947036061363592
deviation-center-line_min0.1612683272550955
deviation-heading_max1.1654096008330035
deviation-heading_mean0.8034065091365459
deviation-heading_median0.7840179475951651
deviation-heading_min0.46823944403892
driven_any_max1.249688872261276
driven_any_mean0.807618792736822
driven_any_median0.9928463432572194
driven_any_min0.31768933230030155
driven_lanedir_consec_max0.6672388924780033
driven_lanedir_consec_mean0.4003386446527264
driven_lanedir_consec_min0.24305756068667503
driven_lanedir_max0.6672388924780033
driven_lanedir_mean0.4003386446527264
driven_lanedir_median0.37391419923137703
driven_lanedir_min0.24305756068667503
in-drivable-lane_max6.049999999999979
in-drivable-lane_mean2.329999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4329892855289159, "sim_physics": 0.12704859749745517, "survival_time": 2.9499999999999975, "driven_lanedir": 0.41895655267034937, "sim_render-ego": 0.010713940959865763, "in-drivable-lane": 0, "agent_compute-ego": 0.023667335510253903, "deviation-heading": 0.7560843063940643, "set_robot_commands": 0.005227400084673348, "deviation-center-line": 0.19764810458264365, "driven_lanedir_consec": 0.41895655267034937, "sim_compute_sim_state": 0.0028913869696148373, "sim_compute_performance-ego": 0.004118567806179241, "sim_compute_robot_state-ego": 0.0054311590679621295, "sim_compute_robot_state-npc0": 0.0130770327681202, "sim_compute_robot_state-npc1": 0.0048346923569501455, "sim_compute_robot_state-npc2": 0.004829596664945958, "sim_compute_robot_state-npc3": 0.0047515812566724875}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9928463432572194, "sim_physics": 0.16604211199002003, "survival_time": 6.349999999999985, "driven_lanedir": 0.6672388924780033, "sim_render-ego": 0.012642462422528604, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.023746345925518848, "deviation-heading": 1.1654096008330035, "set_robot_commands": 0.008791623153085784, "deviation-center-line": 0.17732720098681884, "driven_lanedir_consec": 0.6672388924780033, "sim_compute_sim_state": 0.004675305734469196, "sim_compute_performance-ego": 0.006666367448221041, "sim_compute_robot_state-ego": 0.008428276993158295, "sim_compute_robot_state-npc0": 0.008086613782747524, "sim_compute_robot_state-npc1": 0.007775190308338075, "sim_compute_robot_state-npc2": 0.007589124319121594, "sim_compute_robot_state-npc3": 0.007676306671983614}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.249688872261276, "sim_physics": 0.2175595579268057, "survival_time": 7.89999999999998, "driven_lanedir": 0.24305756068667503, "sim_render-ego": 0.011808256559734102, "in-drivable-lane": 6.049999999999979, "agent_compute-ego": 0.02282899542699886, "deviation-heading": 0.46823944403892, "set_robot_commands": 0.009290287766275529, "deviation-center-line": 0.2288047809259315, "driven_lanedir_consec": 0.24305756068667503, "sim_compute_sim_state": 0.004598597936992404, "sim_compute_performance-ego": 0.007102551339547845, "sim_compute_robot_state-ego": 0.00917669640311712, "sim_compute_robot_state-npc0": 0.008379439764384981, "sim_compute_robot_state-npc1": 0.008265104474900644, "sim_compute_robot_state-npc2": 0.007878686808332612, "sim_compute_robot_state-npc3": 0.007965450045428698}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.31768933230030155, "sim_physics": 0.22209687232971193, "survival_time": 2.25, "driven_lanedir": 0.2985260181972271, "sim_render-ego": 0.01206337610880534, "in-drivable-lane": 0, "agent_compute-ego": 0.02074996100531684, "deviation-heading": 0.7840179475951651, "set_robot_commands": 0.008984110090467665, "deviation-center-line": 0.1612683272550955, "driven_lanedir_consec": 0.2985260181972271, "sim_compute_sim_state": 0.004553598827785916, "sim_compute_performance-ego": 0.006665960947672526, "sim_compute_robot_state-ego": 0.008603058920966255, "sim_compute_robot_state-npc0": 0.008237303627861872, "sim_compute_robot_state-npc1": 0.008189137776692708, "sim_compute_robot_state-npc2": 0.008146487341986763, "sim_compute_robot_state-npc3": 0.007485257254706489}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0448801303363977, "sim_physics": 0.1964122747120104, "survival_time": 6.649999999999984, "driven_lanedir": 0.37391419923137703, "sim_render-ego": 0.011445248037352598, "in-drivable-lane": 3.949999999999986, "agent_compute-ego": 0.022660929457585615, "deviation-heading": 0.8432812468215765, "set_robot_commands": 0.008549860545567103, "deviation-center-line": 0.20846961693130656, "driven_lanedir_consec": 0.37391419923137703, "sim_compute_sim_state": 0.004322489401451627, "sim_compute_performance-ego": 0.0066082907798595, "sim_compute_robot_state-ego": 0.008751831556621351, "sim_compute_robot_state-npc0": 0.007851636499390566, "sim_compute_robot_state-npc1": 0.0075385946976511105, "sim_compute_robot_state-npc2": 0.007650723134664665, "sim_compute_robot_state-npc3": 0.007403680256434849}}
set_robot_commands_max0.009290287766275529
set_robot_commands_mean0.008168656328013887
set_robot_commands_median0.008791623153085784
set_robot_commands_min0.005227400084673348
sim_compute_performance-ego_max0.007102551339547845
sim_compute_performance-ego_mean0.006232347664296031
sim_compute_performance-ego_median0.006665960947672526
sim_compute_performance-ego_min0.004118567806179241
sim_compute_robot_state-ego_max0.00917669640311712
sim_compute_robot_state-ego_mean0.008078204588365029
sim_compute_robot_state-ego_median0.008603058920966255
sim_compute_robot_state-ego_min0.0054311590679621295
sim_compute_robot_state-npc0_max0.0130770327681202
sim_compute_robot_state-npc0_mean0.00912640528850103
sim_compute_robot_state-npc0_median0.008237303627861872
sim_compute_robot_state-npc0_min0.007851636499390566
sim_compute_robot_state-npc1_max0.008265104474900644
sim_compute_robot_state-npc1_mean0.007320543922906537
sim_compute_robot_state-npc1_median0.007775190308338075
sim_compute_robot_state-npc1_min0.0048346923569501455
sim_compute_robot_state-npc2_max0.008146487341986763
sim_compute_robot_state-npc2_mean0.007218923653810318
sim_compute_robot_state-npc2_median0.007650723134664665
sim_compute_robot_state-npc2_min0.004829596664945958
sim_compute_robot_state-npc3_max0.007965450045428698
sim_compute_robot_state-npc3_mean0.007056455097045227
sim_compute_robot_state-npc3_median0.007485257254706489
sim_compute_robot_state-npc3_min0.0047515812566724875
sim_compute_sim_state_max0.004675305734469196
sim_compute_sim_state_mean0.004208275774062796
sim_compute_sim_state_median0.004553598827785916
sim_compute_sim_state_min0.0028913869696148373
sim_physics_max0.22209687232971193
sim_physics_mean0.18583188289120064
sim_physics_median0.1964122747120104
sim_physics_min0.12704859749745517
sim_render-ego_max0.012642462422528604
sim_render-ego_mean0.011734656817657282
sim_render-ego_median0.011808256559734102
sim_render-ego_min0.010713940959865763
simulation-passed1
survival_time_max7.89999999999998
survival_time_mean5.21999999999999
survival_time_min2.25
No reset possible
255524447Bea Baselines 🐤challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:16:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7148565183510631
survival_time_median11.800000000000033
deviation-center-line_median0.3503055429299765
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.05769154071807861
agent_compute-ego_mean0.044597288333840926
agent_compute-ego_median0.0526839575153187
agent_compute-ego_min0.0295733276166414
deviation-center-line_max1.0149350000369186
deviation-center-line_mean0.5218057897473418
deviation-center-line_min0.12590235370386435
deviation-heading_max3.2444623369163996
deviation-heading_mean1.766806170500944
deviation-heading_median1.384226238316845
deviation-heading_min1.1311341804170347
driven_any_max2.3491463124419627
driven_any_mean1.699887820054212
driven_any_median1.842856967720964
driven_any_min0.7020894511343392
driven_lanedir_consec_max2.330304452432999
driven_lanedir_consec_mean1.6236466564125778
driven_lanedir_consec_min0.6056256065398914
driven_lanedir_max2.330304452432999
driven_lanedir_mean1.6236466564125778
driven_lanedir_median1.7148565183510631
driven_lanedir_min0.6056256065398914
in-drivable-lane_max0.4500000000000064
in-drivable-lane_mean0.18000000000000096
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7020894511343392, "sim_physics": 0.10990511743645918, "survival_time": 4.749999999999991, "driven_lanedir": 0.6056256065398914, "sim_render-ego": 0.012424714941727488, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0295733276166414, "deviation-heading": 1.1311341804170347, "set_robot_commands": 0.01093691022772538, "deviation-center-line": 0.12590235370386435, "driven_lanedir_consec": 0.6056256065398914, "sim_compute_sim_state": 0.005745210145649157, "sim_compute_performance-ego": 0.007018249913265831, "sim_compute_robot_state-ego": 0.008840932344135485}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.842856967720964, "sim_physics": 0.1282735386137235, "survival_time": 11.800000000000033, "driven_lanedir": 1.7148565183510631, "sim_render-ego": 0.013461146314265364, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.03011007329164925, "deviation-heading": 1.7409315644536865, "set_robot_commands": 0.011929147324319614, "deviation-center-line": 0.3273307149079201, "driven_lanedir_consec": 1.7148565183510631, "sim_compute_sim_state": 0.005765506776712708, "sim_compute_performance-ego": 0.007931033433493922, "sim_compute_robot_state-ego": 0.010573066897311452}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.349138842004312, "sim_physics": 0.1284965221087138, "survival_time": 14.950000000000076, "driven_lanedir": 2.24104059716558, "sim_render-ego": 0.013843674659729004, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05292754252751669, "deviation-heading": 3.2444623369163996, "set_robot_commands": 0.011720015207926432, "deviation-center-line": 1.0149350000369186, "driven_lanedir_consec": 2.24104059716558, "sim_compute_sim_state": 0.0058550445238749185, "sim_compute_performance-ego": 0.008378734588623047, "sim_compute_robot_state-ego": 0.010530576705932618}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.256207526969482, "sim_physics": 0.10851700466834696, "survival_time": 8.14999999999998, "driven_lanedir": 1.226406107573355, "sim_render-ego": 0.01248817502355283, "in-drivable-lane": 0, "agent_compute-ego": 0.0526839575153187, "deviation-heading": 1.384226238316845, "set_robot_commands": 0.009579962747960002, "deviation-center-line": 0.3503055429299765, "driven_lanedir_consec": 1.226406107573355, "sim_compute_sim_state": 0.005107575399012653, "sim_compute_performance-ego": 0.007181170527920402, "sim_compute_robot_state-ego": 0.008919945523782741}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491463124419627, "sim_physics": 0.13000757058461507, "survival_time": 14.950000000000076, "driven_lanedir": 2.330304452432999, "sim_render-ego": 0.013496536413828532, "in-drivable-lane": 0, "agent_compute-ego": 0.05769154071807861, "deviation-heading": 1.3332765324007538, "set_robot_commands": 0.010966731707255045, "deviation-center-line": 0.7905553371580295, "driven_lanedir_consec": 2.330304452432999, "sim_compute_sim_state": 0.005554003715515137, "sim_compute_performance-ego": 0.008135810693105061, "sim_compute_robot_state-ego": 0.010305006504058838}}
set_robot_commands_max0.011929147324319614
set_robot_commands_mean0.011026553443037296
set_robot_commands_median0.010966731707255045
set_robot_commands_min0.009579962747960002
sim_compute_performance-ego_max0.008378734588623047
sim_compute_performance-ego_mean0.007728999831281652
sim_compute_performance-ego_median0.007931033433493922
sim_compute_performance-ego_min0.007018249913265831
sim_compute_robot_state-ego_max0.010573066897311452
sim_compute_robot_state-ego_mean0.00983390559504423
sim_compute_robot_state-ego_median0.010305006504058838
sim_compute_robot_state-ego_min0.008840932344135485
sim_compute_sim_state_max0.0058550445238749185
sim_compute_sim_state_mean0.005605468112152914
sim_compute_sim_state_median0.005745210145649157
sim_compute_sim_state_min0.005107575399012653
sim_physics_max0.13000757058461507
sim_physics_mean0.1210399506823717
sim_physics_median0.1282735386137235
sim_physics_min0.10851700466834696
sim_render-ego_max0.013843674659729004
sim_render-ego_mean0.013142849470620645
sim_render-ego_median0.013461146314265364
sim_render-ego_min0.012424714941727488
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.920000000000034
survival_time_min4.749999999999991
No reset possible
255204471Mikita Sazanovich 🇷🇺chameleonaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:09:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.222183742516201
survival_time_median7.79999999999998
deviation-center-line_median0.5418592393970151
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.04007871890890187
agent_compute-ego_mean0.03913200664058679
agent_compute-ego_median0.039155344341112217
agent_compute-ego_min0.0382547416384258
deviation-center-line_max0.7384643489976741
deviation-center-line_mean0.5693875701772263
deviation-center-line_min0.41910075682244624
deviation-heading_max3.6391367285993654
deviation-heading_mean2.6095373487574345
deviation-heading_median2.571411752190271
deviation-heading_min1.7064172888715743
driven_any_max4.526958025958797
driven_any_mean2.677687647984208
driven_any_median2.4818814925581147
driven_any_min1.5394457561435864
driven_lanedir_consec_max3.545532336307428
driven_lanedir_consec_mean2.2683870626964784
driven_lanedir_consec_min1.4409614359421803
driven_lanedir_max3.545532336307428
driven_lanedir_mean2.2683870626964784
driven_lanedir_median2.222183742516201
driven_lanedir_min1.4409614359421803
in-drivable-lane_max2.3000000000000114
in-drivable-lane_mean0.8700000000000054
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9558253617495625, "sim_physics": 0.0597333940966376, "survival_time": 7.249999999999982, "driven_lanedir": 1.7301933757797732, "sim_render-ego": 0.007142501041806977, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04007871890890187, "deviation-heading": 2.657023782546328, "set_robot_commands": 0.0050755780318687705, "deviation-center-line": 0.5006299804461526, "driven_lanedir_consec": 1.7301933757797732, "sim_compute_sim_state": 0.002992210717036806, "sim_compute_performance-ego": 0.004123427950102707, "sim_compute_robot_state-ego": 0.00516203682998131}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5394457561435864, "sim_physics": 0.058302261518395466, "survival_time": 5.749999999999988, "driven_lanedir": 1.4409614359421803, "sim_render-ego": 0.007118892669677734, "in-drivable-lane": 0, "agent_compute-ego": 0.039155344341112217, "deviation-heading": 1.7064172888715743, "set_robot_commands": 0.004888609181279722, "deviation-center-line": 0.41910075682244624, "driven_lanedir_consec": 1.4409614359421803, "sim_compute_sim_state": 0.0029533220374065895, "sim_compute_performance-ego": 0.0039147667262865145, "sim_compute_robot_state-ego": 0.005115055001300314}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4818814925581147, "sim_physics": 0.054486267077617154, "survival_time": 7.79999999999998, "driven_lanedir": 2.222183742516201, "sim_render-ego": 0.007201503484677046, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.039586195578941934, "deviation-heading": 2.473697191579633, "set_robot_commands": 0.005020593985533103, "deviation-center-line": 0.646883525222843, "driven_lanedir_consec": 2.222183742516201, "sim_compute_sim_state": 0.0029918582011491824, "sim_compute_performance-ego": 0.003965918834392841, "sim_compute_robot_state-ego": 0.0051761040320763224}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.526958025958797, "sim_physics": 0.05620238655491879, "survival_time": 13.300000000000054, "driven_lanedir": 3.545532336307428, "sim_render-ego": 0.007069370800391175, "in-drivable-lane": 2.3000000000000114, "agent_compute-ego": 0.038585032735552104, "deviation-heading": 3.6391367285993654, "set_robot_commands": 0.004959419257658765, "deviation-center-line": 0.7384643489976741, "driven_lanedir_consec": 3.545532336307428, "sim_compute_sim_state": 0.002970345934530846, "sim_compute_performance-ego": 0.003937228281695144, "sim_compute_robot_state-ego": 0.005116284341740429}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.884327603510979, "sim_physics": 0.055901652290707544, "survival_time": 9.45, "driven_lanedir": 2.403064422936807, "sim_render-ego": 0.007045267750977208, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.0382547416384258, "deviation-heading": 2.571411752190271, "set_robot_commands": 0.004900459259275406, "deviation-center-line": 0.5418592393970151, "driven_lanedir_consec": 2.403064422936807, "sim_compute_sim_state": 0.002881183826103412, "sim_compute_performance-ego": 0.003900506509044183, "sim_compute_robot_state-ego": 0.004966561756436787}}
set_robot_commands_max0.0050755780318687705
set_robot_commands_mean0.004968931943123154
set_robot_commands_median0.004959419257658765
set_robot_commands_min0.004888609181279722
sim_compute_performance-ego_max0.004123427950102707
sim_compute_performance-ego_mean0.003968369660304278
sim_compute_performance-ego_median0.003937228281695144
sim_compute_performance-ego_min0.003900506509044183
sim_compute_robot_state-ego_max0.0051761040320763224
sim_compute_robot_state-ego_mean0.005107208392307033
sim_compute_robot_state-ego_median0.005116284341740429
sim_compute_robot_state-ego_min0.004966561756436787
sim_compute_sim_state_max0.002992210717036806
sim_compute_sim_state_mean0.002957784143245367
sim_compute_sim_state_median0.002970345934530846
sim_compute_sim_state_min0.002881183826103412
sim_physics_max0.0597333940966376
sim_physics_mean0.05692519230765532
sim_physics_median0.05620238655491879
sim_physics_min0.054486267077617154
sim_render-ego_max0.007201503484677046
sim_render-ego_mean0.007115507149506028
sim_render-ego_median0.007118892669677734
sim_render-ego_min0.007045267750977208
simulation-passed1
survival_time_max13.300000000000054
survival_time_mean8.710000000000003
survival_time_min5.749999999999988
No reset possible
255084467YUNG-CHIEN CHOU 🇹🇼challenge-aido_LF-template-tensorflowaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:05:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.29326285843671807
survival_time_median1.3000000000000005
deviation-center-line_median0.08201912430086522
in-drivable-lane_median0


other stats
agent_compute-ego_max0.019176910320917766
agent_compute-ego_mean0.017240452755612125
agent_compute-ego_median0.016787281742802373
agent_compute-ego_min0.016640507257901706
deviation-center-line_max0.16732967076499078
deviation-center-line_mean0.09716018803580388
deviation-center-line_min0.04909966206600688
deviation-heading_max1.0531550996153385
deviation-heading_mean0.5741604758769461
deviation-heading_median0.5128121334325793
deviation-heading_min0.3249651997234724
driven_any_max1.0314552321230417
driven_any_mean0.4423188509094548
driven_any_median0.3290977420539398
driven_any_min0.20818008711998504
driven_lanedir_consec_max0.5284810366391195
driven_lanedir_consec_mean0.31498625649017126
driven_lanedir_consec_min0.1498872555734554
driven_lanedir_max0.5284810366391195
driven_lanedir_mean0.31498625649017126
driven_lanedir_median0.29326285843671807
driven_lanedir_min0.1498872555734554
in-drivable-lane_max1.1499999999999986
in-drivable-lane_mean0.2299999999999997
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.34060890107115016, "sim_physics": 0.06340104341506958, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3122350895193018, "sim_render-ego": 0.007485101620356242, "in-drivable-lane": 0, "agent_compute-ego": 0.019176910320917766, "deviation-heading": 0.4427393887407755, "set_robot_commands": 0.00519445538520813, "deviation-center-line": 0.07847470610280845, "driven_lanedir_consec": 0.3122350895193018, "sim_compute_sim_state": 0.003087083498636882, "sim_compute_performance-ego": 0.004296114047368367, "sim_compute_robot_state-ego": 0.005571146806081136}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3022522921791578, "sim_physics": 0.05759814152350792, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2910650422822616, "sim_render-ego": 0.007206229063180776, "in-drivable-lane": 0, "agent_compute-ego": 0.016640507257901706, "deviation-heading": 0.3249651997234724, "set_robot_commands": 0.004900528834416316, "deviation-center-line": 0.10887777694434804, "driven_lanedir_consec": 0.2910650422822616, "sim_compute_sim_state": 0.0028033806727482723, "sim_compute_performance-ego": 0.003890321804926946, "sim_compute_robot_state-ego": 0.0049632604305560775}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3290977420539398, "sim_physics": 0.05473001797993978, "survival_time": 1.3500000000000003, "driven_lanedir": 0.29326285843671807, "sim_render-ego": 0.007196444052237051, "in-drivable-lane": 0, "agent_compute-ego": 0.016787281742802373, "deviation-heading": 0.5128121334325793, "set_robot_commands": 0.005096638644183123, "deviation-center-line": 0.08201912430086522, "driven_lanedir_consec": 0.29326285843671807, "sim_compute_sim_state": 0.002842108408610026, "sim_compute_performance-ego": 0.0039395491282145185, "sim_compute_robot_state-ego": 0.00508817919978389}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0314552321230417, "sim_physics": 0.05406045913696289, "survival_time": 3.2999999999999963, "driven_lanedir": 0.5284810366391195, "sim_render-ego": 0.00701336788408684, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.01668305108041474, "deviation-heading": 1.0531550996153385, "set_robot_commands": 0.004971948536959561, "deviation-center-line": 0.16732967076499078, "driven_lanedir_consec": 0.5284810366391195, "sim_compute_sim_state": 0.0027752247723666105, "sim_compute_performance-ego": 0.003949017235727021, "sim_compute_robot_state-ego": 0.004978476148663145}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20818008711998504, "sim_physics": 0.05913759602440728, "survival_time": 0.9000000000000002, "driven_lanedir": 0.1498872555734554, "sim_render-ego": 0.007109853956434462, "in-drivable-lane": 0, "agent_compute-ego": 0.016914513376024034, "deviation-heading": 0.5371305578725647, "set_robot_commands": 0.004600233501858181, "deviation-center-line": 0.04909966206600688, "driven_lanedir_consec": 0.1498872555734554, "sim_compute_sim_state": 0.002711693445841471, "sim_compute_performance-ego": 0.003874248928493923, "sim_compute_robot_state-ego": 0.004932310846116807}}
set_robot_commands_max0.00519445538520813
set_robot_commands_mean0.004952760980525063
set_robot_commands_median0.004971948536959561
set_robot_commands_min0.004600233501858181
sim_compute_performance-ego_max0.004296114047368367
sim_compute_performance-ego_mean0.003989850228946155
sim_compute_performance-ego_median0.0039395491282145185
sim_compute_performance-ego_min0.003874248928493923
sim_compute_robot_state-ego_max0.005571146806081136
sim_compute_robot_state-ego_mean0.005106674686240211
sim_compute_robot_state-ego_median0.004978476148663145
sim_compute_robot_state-ego_min0.004932310846116807
sim_compute_sim_state_max0.003087083498636882
sim_compute_sim_state_mean0.002843898159640652
sim_compute_sim_state_median0.0028033806727482723
sim_compute_sim_state_min0.002711693445841471
sim_physics_max0.06340104341506958
sim_physics_mean0.05778545161597749
sim_physics_median0.05759814152350792
sim_physics_min0.05406045913696289
sim_render-ego_max0.007485101620356242
sim_render-ego_mean0.007202199315259075
sim_render-ego_median0.007196444052237051
sim_render-ego_min0.00701336788408684
simulation-passed1
survival_time_max3.2999999999999963
survival_time_mean1.6099999999999994
survival_time_min0.9000000000000002
No reset possible
254994462Frank (Chude) Qian 🇨🇦In duckietown we do not endorse DUI...aido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104920:09:18
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
254674441Bea Baselines 🐤straightaido3-LF-sim-testingstep1-simulationhost-errornoip-172-31-46-148-104920:10:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1563, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1619, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-testing/submission4441/step1-simulation-ip-172-31-46-148-10492-job25467/tmp/tmp6zh4fxij/episodes/ETHZ_autolab_technical_track-12-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
254634428Bea Baselines 🐤straightaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.37391419923137703
survival_time_median6.349999999999985
deviation-center-line_median0.19764810458264365
in-drivable-lane_median1.649999999999994


other stats
agent_compute-ego_max0.01437830924987793
agent_compute-ego_mean0.013984082896135707
agent_compute-ego_median0.013957171969943576
agent_compute-ego_min0.013672687875942922
deviation-center-line_max0.2288047809259315
deviation-center-line_mean0.1947036061363592
deviation-center-line_min0.1612683272550955
deviation-heading_max1.1654096008330035
deviation-heading_mean0.8034065091365459
deviation-heading_median0.7840179475951651
deviation-heading_min0.46823944403892
driven_any_max1.249688872261276
driven_any_mean0.807618792736822
driven_any_median0.9928463432572194
driven_any_min0.31768933230030155
driven_lanedir_consec_max0.6672388924780033
driven_lanedir_consec_mean0.4003386446527264
driven_lanedir_consec_min0.24305756068667503
driven_lanedir_max0.6672388924780033
driven_lanedir_mean0.4003386446527264
driven_lanedir_median0.37391419923137703
driven_lanedir_min0.24305756068667503
in-drivable-lane_max6.049999999999979
in-drivable-lane_mean2.329999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4329892855289159, "sim_physics": 0.11460393162096962, "survival_time": 2.9499999999999975, "driven_lanedir": 0.41895655267034937, "sim_render-ego": 0.00711571968207925, "in-drivable-lane": 0, "agent_compute-ego": 0.01437830924987793, "deviation-heading": 0.7560843063940643, "set_robot_commands": 0.004808757264735335, "deviation-center-line": 0.19764810458264365, "driven_lanedir_consec": 0.41895655267034937, "sim_compute_sim_state": 0.002827329150700974, "sim_compute_performance-ego": 0.003888784828832594, "sim_compute_robot_state-ego": 0.00518986734293275, "sim_compute_robot_state-npc0": 0.004751156952421544, "sim_compute_robot_state-npc1": 0.004472380977565959, "sim_compute_robot_state-npc2": 0.0044829037229893575, "sim_compute_robot_state-npc3": 0.004433122731871524}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9928463432572194, "sim_physics": 0.10235535629152312, "survival_time": 6.349999999999985, "driven_lanedir": 0.6672388924780033, "sim_render-ego": 0.008380407423484983, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.013672687875942922, "deviation-heading": 1.1654096008330035, "set_robot_commands": 0.0048596952843853805, "deviation-center-line": 0.17732720098681884, "driven_lanedir_consec": 0.6672388924780033, "sim_compute_sim_state": 0.0028008945344939946, "sim_compute_performance-ego": 0.0038831478028785527, "sim_compute_robot_state-ego": 0.005125028880562369, "sim_compute_robot_state-npc0": 0.004741205005195197, "sim_compute_robot_state-npc1": 0.004493405499796229, "sim_compute_robot_state-npc2": 0.004479338803629237, "sim_compute_robot_state-npc3": 0.004467083713201087}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.249688872261276, "sim_physics": 0.112767314609093, "survival_time": 7.89999999999998, "driven_lanedir": 0.24305756068667503, "sim_render-ego": 0.007099598268919353, "in-drivable-lane": 6.049999999999979, "agent_compute-ego": 0.013937446135508864, "deviation-heading": 0.46823944403892, "set_robot_commands": 0.004832510706744617, "deviation-center-line": 0.2288047809259315, "driven_lanedir_consec": 0.24305756068667503, "sim_compute_sim_state": 0.0028104510488389414, "sim_compute_performance-ego": 0.003882886488226396, "sim_compute_robot_state-ego": 0.005143622808818576, "sim_compute_robot_state-npc0": 0.004762463931795917, "sim_compute_robot_state-npc1": 0.004512534865850135, "sim_compute_robot_state-npc2": 0.004489990729319898, "sim_compute_robot_state-npc3": 0.004459953006309799}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.31768933230030155, "sim_physics": 0.11483648088243271, "survival_time": 2.25, "driven_lanedir": 0.2985260181972271, "sim_render-ego": 0.007249842749701606, "in-drivable-lane": 0, "agent_compute-ego": 0.013957171969943576, "deviation-heading": 0.7840179475951651, "set_robot_commands": 0.004862870110405816, "deviation-center-line": 0.1612683272550955, "driven_lanedir_consec": 0.2985260181972271, "sim_compute_sim_state": 0.0027890947129991317, "sim_compute_performance-ego": 0.003905995686848958, "sim_compute_robot_state-ego": 0.005146095487806532, "sim_compute_robot_state-npc0": 0.00470576286315918, "sim_compute_robot_state-npc1": 0.004512363009982639, "sim_compute_robot_state-npc2": 0.004491472244262695, "sim_compute_robot_state-npc3": 0.004482126235961914}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0448801303363977, "sim_physics": 0.09882326412917976, "survival_time": 6.649999999999984, "driven_lanedir": 0.37391419923137703, "sim_render-ego": 0.0071031509485459865, "in-drivable-lane": 3.949999999999986, "agent_compute-ego": 0.013974799249405251, "deviation-heading": 0.8432812468215765, "set_robot_commands": 0.004812253148932206, "deviation-center-line": 0.20846961693130656, "driven_lanedir_consec": 0.37391419923137703, "sim_compute_sim_state": 0.002751162177638004, "sim_compute_performance-ego": 0.003900954597874691, "sim_compute_robot_state-ego": 0.005014638255413314, "sim_compute_robot_state-npc0": 0.004614500174845071, "sim_compute_robot_state-npc1": 0.004501473634762871, "sim_compute_robot_state-npc2": 0.00448774932918692, "sim_compute_robot_state-npc3": 0.004465963607443902}}
set_robot_commands_max0.004862870110405816
set_robot_commands_mean0.00483521730304067
set_robot_commands_median0.004832510706744617
set_robot_commands_min0.004808757264735335
sim_compute_performance-ego_max0.003905995686848958
sim_compute_performance-ego_mean0.003892353880932239
sim_compute_performance-ego_median0.003888784828832594
sim_compute_performance-ego_min0.003882886488226396
sim_compute_robot_state-ego_max0.00518986734293275
sim_compute_robot_state-ego_mean0.005123850555106708
sim_compute_robot_state-ego_median0.005143622808818576
sim_compute_robot_state-ego_min0.005014638255413314
sim_compute_robot_state-npc0_max0.004762463931795917
sim_compute_robot_state-npc0_mean0.004715017785483382
sim_compute_robot_state-npc0_median0.004741205005195197
sim_compute_robot_state-npc0_min0.004614500174845071
sim_compute_robot_state-npc1_max0.004512534865850135
sim_compute_robot_state-npc1_mean0.004498431597591566
sim_compute_robot_state-npc1_median0.004501473634762871
sim_compute_robot_state-npc1_min0.004472380977565959
sim_compute_robot_state-npc2_max0.004491472244262695
sim_compute_robot_state-npc2_mean0.004486290965877622
sim_compute_robot_state-npc2_median0.00448774932918692
sim_compute_robot_state-npc2_min0.004479338803629237
sim_compute_robot_state-npc3_max0.004482126235961914
sim_compute_robot_state-npc3_mean0.004461649858957646
sim_compute_robot_state-npc3_median0.004465963607443902
sim_compute_robot_state-npc3_min0.004433122731871524
sim_compute_sim_state_max0.002827329150700974
sim_compute_sim_state_mean0.0027957863249342086
sim_compute_sim_state_median0.0028008945344939946
sim_compute_sim_state_min0.002751162177638004
sim_physics_max0.11483648088243271
sim_physics_mean0.10867726950663964
sim_physics_median0.112767314609093
sim_physics_min0.09882326412917976
sim_render-ego_max0.008380407423484983
sim_render-ego_mean0.007389743814546236
sim_render-ego_median0.00711571968207925
sim_render-ego_min0.007099598268919353
simulation-passed1
survival_time_max7.89999999999998
survival_time_mean5.21999999999999
survival_time_min2.25
No reset possible
254334125Andrea Censi 🇨🇭rotationaido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104920:30:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
254164186Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:10:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5728900130190617
survival_time_median3.049999999999997
deviation-center-line_median0.1287081573255118
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.026247880230211233
agent_compute-ego_mean0.02249857918816092
agent_compute-ego_median0.0220205179402526
agent_compute-ego_min0.01723176329883177
deviation-center-line_max0.36443765592383554
deviation-center-line_mean0.1588742978783914
deviation-center-line_min0.08393700821326386
deviation-heading_max1.0316671781452431
deviation-heading_mean0.5356514512770911
deviation-heading_median0.46418759639345647
deviation-heading_min0.2008327977683927
driven_any_max1.0990919961264012
driven_any_mean0.7035676322925487
driven_any_median0.7833781665871041
driven_any_min0.21586906071648584
driven_lanedir_consec_max1.0280875807340986
driven_lanedir_consec_mean0.5474505695862126
driven_lanedir_consec_min0.19811047289692163
driven_lanedir_max1.0280875807340986
driven_lanedir_mean0.5474505695862126
driven_lanedir_median0.5728900130190617
driven_lanedir_min0.19811047289692163
in-drivable-lane_max1.399999999999995
in-drivable-lane_mean0.4166666666666652
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.029569969954737, "sim_physics": 0.12675912412878584, "survival_time": 3.649999999999995, "driven_lanedir": 0.5728900130190617, "sim_render-ego": 0.01243773878437199, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.026247880230211233, "deviation-heading": 0.46418759639345647, "set_robot_commands": 0.00979004494131428, "deviation-center-line": 0.16420485117826172, "driven_lanedir_consec": 0.5728900130190617, "sim_compute_sim_state": 0.0053887399908614485, "sim_compute_performance-ego": 0.007622264835932483, "sim_compute_robot_state-ego": 0.00953581888381749}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21586906071648584, "sim_physics": 0.14235070943832398, "survival_time": 1.0000000000000002, "driven_lanedir": 0.19811047289692163, "sim_render-ego": 0.012464559078216551, "in-drivable-lane": 0, "agent_compute-ego": 0.02601792812347412, "deviation-heading": 0.35358071986381573, "set_robot_commands": 0.011128675937652589, "deviation-center-line": 0.08492450847657326, "driven_lanedir_consec": 0.19811047289692163, "sim_compute_sim_state": 0.00532538890838623, "sim_compute_performance-ego": 0.006761372089385986, "sim_compute_robot_state-ego": 0.009941983222961423}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0285461590131229, "sim_physics": 0.10943628646231988, "survival_time": 3.699999999999995, "driven_lanedir": 0.9241157643596049, "sim_render-ego": 0.013460214073593551, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.025870493940404943, "deviation-heading": 0.7204674568635022, "set_robot_commands": 0.010262898496679357, "deviation-center-line": 0.12663250504026446, "driven_lanedir_consec": 0.9241157643596049, "sim_compute_sim_state": 0.005342000239604228, "sim_compute_performance-ego": 0.007663498053679595, "sim_compute_robot_state-ego": 0.010001939696234623}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7833781665871041, "sim_physics": 0.0995652675628662, "survival_time": 3.049999999999997, "driven_lanedir": 0.7738646695799877, "sim_render-ego": 0.011923356134383403, "in-drivable-lane": 0, "agent_compute-ego": 0.0248860062145796, "deviation-heading": 0.3999540773760856, "set_robot_commands": 0.008475315375406235, "deviation-center-line": 0.22820877647883453, "driven_lanedir_consec": 0.7738646695799877, "sim_compute_sim_state": 0.0048673113838571015, "sim_compute_performance-ego": 0.007473543042042216, "sim_compute_robot_state-ego": 0.008612570215444097}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36430896900879234, "sim_physics": 0.1180586889386177, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3193916254754976, "sim_render-ego": 0.012413300573825836, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.025078125298023224, "deviation-heading": 0.618182945554115, "set_robot_commands": 0.010566659271717072, "deviation-center-line": 0.1026554262752819, "driven_lanedir_consec": 0.3193916254754976, "sim_compute_sim_state": 0.005086749792098999, "sim_compute_performance-ego": 0.007510557770729065, "sim_compute_robot_state-ego": 0.009369023144245148}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0127346981029353, "sim_physics": 0.1218161679602958, "survival_time": 3.699999999999995, "driven_lanedir": 0.664699798794147, "sim_render-ego": 0.012150793462186246, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.02437339924477242, "deviation-heading": 0.6957245682129789, "set_robot_commands": 0.010179300565977354, "deviation-center-line": 0.12805471035650365, "driven_lanedir_consec": 0.664699798794147, "sim_compute_sim_state": 0.005214468852893726, "sim_compute_performance-ego": 0.006962563540484454, "sim_compute_robot_state-ego": 0.00922680545497585}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5787661712418932, "sim_physics": 0.09937093424242596, "survival_time": 2.1500000000000004, "driven_lanedir": 0.5755780495920495, "sim_render-ego": 0.011915190275325333, "in-drivable-lane": 0, "agent_compute-ego": 0.022793132205342136, "deviation-heading": 0.2008327977683927, "set_robot_commands": 0.008210453876229219, "deviation-center-line": 0.2232664765139516, "driven_lanedir_consec": 0.5755780495920495, "sim_compute_sim_state": 0.004445586093636446, "sim_compute_performance-ego": 0.00715474195258562, "sim_compute_robot_state-ego": 0.008413076400756836}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0990919961264012, "sim_physics": 0.09073146287496987, "survival_time": 3.8499999999999943, "driven_lanedir": 1.0280875807340986, "sim_render-ego": 0.01103554762803115, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.021359607770845487, "deviation-heading": 1.0316671781452431, "set_robot_commands": 0.008148642329426555, "deviation-center-line": 0.25301109796403, "driven_lanedir_consec": 1.0280875807340986, "sim_compute_sim_state": 0.004202988240625951, "sim_compute_performance-ego": 0.006405954237108107, "sim_compute_robot_state-ego": 0.007886103221348353}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.34198065118955295, "sim_physics": 0.07844235979277513, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3296055640738418, "sim_render-ego": 0.009135797105986497, "in-drivable-lane": 0, "agent_compute-ego": 0.020265406575696223, "deviation-heading": 0.2910852191740013, "set_robot_commands": 0.0069673143584152745, "deviation-center-line": 0.10276020650779565, "driven_lanedir_consec": 0.3296055640738418, "sim_compute_sim_state": 0.0036125429745378166, "sim_compute_performance-ego": 0.005026110287370353, "sim_compute_robot_state-ego": 0.006368604199639682}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.30168509044195024, "sim_physics": 0.09586804646712084, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2398637996379982, "sim_render-ego": 0.012437251897958608, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0209428622172429, "deviation-heading": 0.6213263219174483, "set_robot_commands": 0.007916964017427884, "deviation-center-line": 0.08393700821326386, "driven_lanedir_consec": 0.2398637996379982, "sim_compute_sim_state": 0.005112803899324858, "sim_compute_performance-ego": 0.007004352716299204, "sim_compute_robot_state-ego": 0.00780939138852633}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.046691039627755, "sim_physics": 0.07743360160233138, "survival_time": 3.8499999999999943, "driven_lanedir": 0.7353781713772528, "sim_render-ego": 0.009472524964964237, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.018592701329813378, "deviation-heading": 1.022159846748188, "set_robot_commands": 0.00672639190376579, "deviation-center-line": 0.36443765592383554, "driven_lanedir_consec": 0.7353781713772528, "sim_compute_sim_state": 0.003797373214325347, "sim_compute_performance-ego": 0.005420703392524224, "sim_compute_robot_state-ego": 0.006839541645793172}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0281134464550938, "sim_physics": 0.08715762890560526, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6131669992313173, "sim_render-ego": 0.0105318653751427, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.0220205179402526, "deviation-heading": 0.3935283064502115, "set_robot_commands": 0.008432525983998473, "deviation-center-line": 0.13238951415004194, "driven_lanedir_consec": 0.6131669992313173, "sim_compute_sim_state": 0.0040203047470307686, "sim_compute_performance-ego": 0.006035371565482985, "sim_compute_robot_state-ego": 0.007466242346965092}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9401367212800152, "sim_physics": 0.06939759894983093, "survival_time": 3.349999999999996, "driven_lanedir": 0.4881946546804131, "sim_render-ego": 0.007730533827596636, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.01723176329883177, "deviation-heading": 0.32326847163084654, "set_robot_commands": 0.005587136567528568, "deviation-center-line": 0.114696662336249, "driven_lanedir_consec": 0.4881946546804131, "sim_compute_sim_state": 0.0031472747005633454, "sim_compute_performance-ego": 0.004288353137115934, "sim_compute_robot_state-ego": 0.005479143626654326}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4273559741287285, "sim_physics": 0.09517595427376883, "survival_time": 1.7500000000000009, "driven_lanedir": 0.4020208579940019, "sim_render-ego": 0.01096571513584682, "in-drivable-lane": 0, "agent_compute-ego": 0.021198013850620815, "deviation-heading": 0.5828627869444176, "set_robot_commands": 0.007475308009556362, "deviation-center-line": 0.1287081573255118, "driven_lanedir_consec": 0.4020208579940019, "sim_compute_sim_state": 0.004207045691353935, "sim_compute_performance-ego": 0.006016990116664341, "sim_compute_robot_state-ego": 0.007072489602225168}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.3552863705136616, "sim_physics": 0.07855167696552892, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3467905223469958, "sim_render-ego": 0.01039092771468624, "in-drivable-lane": 0, "agent_compute-ego": 0.020600849582302953, "deviation-heading": 0.31594347611366247, "set_robot_commands": 0.006752998598160282, "deviation-center-line": 0.1452269114354725, "driven_lanedir_consec": 0.3467905223469958, "sim_compute_sim_state": 0.003752423870948053, "sim_compute_performance-ego": 0.00553366445725964, "sim_compute_robot_state-ego": 0.006982095779911164}}
set_robot_commands_max0.011128675937652589
set_robot_commands_mean0.008441375348883685
set_robot_commands_median0.008210453876229219
set_robot_commands_min0.005587136567528568
sim_compute_performance-ego_max0.007663498053679595
sim_compute_performance-ego_mean0.006458669412977614
sim_compute_performance-ego_median0.006761372089385986
sim_compute_performance-ego_min0.004288353137115934
sim_compute_robot_state-ego_max0.010001939696234623
sim_compute_robot_state-ego_mean0.008066988588633252
sim_compute_robot_state-ego_median0.007886103221348353
sim_compute_robot_state-ego_min0.005479143626654326
sim_compute_sim_state_max0.0053887399908614485
sim_compute_sim_state_mean0.004501533506669884
sim_compute_sim_state_median0.004445586093636446
sim_compute_sim_state_min0.0031472747005633454
sim_physics_max0.14235070943832398
sim_physics_mean0.09934103390437111
sim_physics_median0.09586804646712084
sim_physics_min0.06939759894983093
sim_render-ego_max0.013460214073593551
sim_render-ego_mean0.01123102106880772
sim_render-ego_median0.011915190275325333
sim_render-ego_min0.007730533827596636
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean2.63333333333333
survival_time_min1.0000000000000002
No reset possible
253994187Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5728900130190617
survival_time_median3.049999999999997
deviation-center-line_median0.12663250504026446
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.02418523929158195
agent_compute-ego_mean0.0207517051260779
agent_compute-ego_median0.021731793880462646
agent_compute-ego_min0.016029254810230154
deviation-center-line_max0.22820877647883453
deviation-center-line_mean0.14132521348984317
deviation-center-line_min0.08492450847657326
deviation-heading_max0.7204674568635022
deviation-heading_mean0.511274559210195
deviation-heading_median0.46418759639345647
deviation-heading_min0.35358071986381573
driven_any_max1.029569969954737
driven_any_mean0.6843344650560483
driven_any_median0.7833781665871041
driven_any_min0.21586906071648584
driven_lanedir_consec_max0.9241157643596049
driven_lanedir_consec_mean0.5576745090662147
driven_lanedir_consec_min0.19811047289692163
driven_lanedir_max0.9241157643596049
driven_lanedir_mean0.5576745090662147
driven_lanedir_median0.5728900130190617
driven_lanedir_min0.19811047289692163
in-drivable-lane_max1.399999999999995
in-drivable-lane_mean0.32999999999999885
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.029569969954737, "sim_physics": 0.08104305724575095, "survival_time": 3.649999999999995, "driven_lanedir": 0.5728900130190617, "sim_render-ego": 0.009661161736266254, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.01941724672709426, "deviation-heading": 0.46418759639345647, "set_robot_commands": 0.00784690412756515, "deviation-center-line": 0.16420485117826172, "driven_lanedir_consec": 0.5728900130190617, "sim_compute_sim_state": 0.003708966790813289, "sim_compute_performance-ego": 0.0059309691598970595, "sim_compute_robot_state-ego": 0.006756044413945447}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21586906071648584, "sim_physics": 0.11802160739898682, "survival_time": 1.0000000000000002, "driven_lanedir": 0.19811047289692163, "sim_render-ego": 0.011254322528839112, "in-drivable-lane": 0, "agent_compute-ego": 0.022394990921020503, "deviation-heading": 0.35358071986381573, "set_robot_commands": 0.008585894107818603, "deviation-center-line": 0.08492450847657326, "driven_lanedir_consec": 0.19811047289692163, "sim_compute_sim_state": 0.004413425922393799, "sim_compute_performance-ego": 0.006026804447174072, "sim_compute_robot_state-ego": 0.007697045803070068}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0285461590131229, "sim_physics": 0.05912035220378154, "survival_time": 3.699999999999995, "driven_lanedir": 0.9241157643596049, "sim_render-ego": 0.007321599367502573, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.016029254810230154, "deviation-heading": 0.7204674568635022, "set_robot_commands": 0.005602971927539722, "deviation-center-line": 0.12663250504026446, "driven_lanedir_consec": 0.9241157643596049, "sim_compute_sim_state": 0.002883675936106089, "sim_compute_performance-ego": 0.004096459698032688, "sim_compute_robot_state-ego": 0.005205486271832441}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7833781665871041, "sim_physics": 0.10369950826050806, "survival_time": 3.049999999999997, "driven_lanedir": 0.7738646695799877, "sim_render-ego": 0.012354514637931448, "in-drivable-lane": 0, "agent_compute-ego": 0.02418523929158195, "deviation-heading": 0.3999540773760856, "set_robot_commands": 0.008545609771228228, "deviation-center-line": 0.22820877647883453, "driven_lanedir_consec": 0.7738646695799877, "sim_compute_sim_state": 0.005130650567226723, "sim_compute_performance-ego": 0.006781370913396116, "sim_compute_robot_state-ego": 0.008806037121131772}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36430896900879234, "sim_physics": 0.09547192603349686, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3193916254754976, "sim_render-ego": 0.010430552065372469, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.021731793880462646, "deviation-heading": 0.618182945554115, "set_robot_commands": 0.008011572062969208, "deviation-center-line": 0.1026554262752819, "driven_lanedir_consec": 0.3193916254754976, "sim_compute_sim_state": 0.004493281245231628, "sim_compute_performance-ego": 0.006293751299381256, "sim_compute_robot_state-ego": 0.007522031664848328}}
set_robot_commands_max0.008585894107818603
set_robot_commands_mean0.007718590399424183
set_robot_commands_median0.008011572062969208
set_robot_commands_min0.005602971927539722
sim_compute_performance-ego_max0.006781370913396116
sim_compute_performance-ego_mean0.0058258711035762386
sim_compute_performance-ego_median0.006026804447174072
sim_compute_performance-ego_min0.004096459698032688
sim_compute_robot_state-ego_max0.008806037121131772
sim_compute_robot_state-ego_mean0.007197329054965611
sim_compute_robot_state-ego_median0.007522031664848328
sim_compute_robot_state-ego_min0.005205486271832441
sim_compute_sim_state_max0.005130650567226723
sim_compute_sim_state_mean0.004126000092354305
sim_compute_sim_state_median0.004413425922393799
sim_compute_sim_state_min0.002883675936106089
sim_physics_max0.11802160739898682
sim_physics_mean0.09147129022850484
sim_physics_median0.09547192603349686
sim_physics_min0.05912035220378154
sim_render-ego_max0.012354514637931448
sim_render-ego_mean0.010204430067182371
sim_render-ego_median0.010430552065372469
sim_render-ego_min0.007321599367502573
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean2.599999999999998
survival_time_min1.0000000000000002
No reset possible
253834248Manfred Diazchallenge-aido_LF-template-tensorflowaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104920:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3078749493026127
survival_time_median1.4000000000000006
deviation-center-line_median0.09908406396930604
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.030158290357300728
agent_compute-ego_mean0.02287582590333139
agent_compute-ego_median0.02165675163269043
agent_compute-ego_min0.01672922240363227
deviation-center-line_max0.30968742498477
deviation-center-line_mean0.13712923479369618
deviation-center-line_min0.04891662953231811
deviation-heading_max2.563184980797178
deviation-heading_mean0.997320418309639
deviation-heading_median0.5759006354934012
deviation-heading_min0.33181260565903165
driven_any_max1.2293671799175478
driven_any_mean0.6073194849628525
driven_any_median0.3435775890946682
driven_any_min0.19567153720465655
driven_lanedir_consec_max0.6082396069091622
driven_lanedir_consec_mean0.35539585981630156
driven_lanedir_consec_min0.13021009457337085
driven_lanedir_max0.6082396069091622
driven_lanedir_mean0.35539585981630156
driven_lanedir_median0.3078749493026127
driven_lanedir_min0.13021009457337085
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean0.7199999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3435775890946682, "sim_physics": 0.10483729362487793, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3078749493026127, "sim_render-ego": 0.011363077163696288, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0266190242767334, "deviation-heading": 0.4359596823624513, "set_robot_commands": 0.008323068618774415, "deviation-center-line": 0.07774205941850995, "driven_lanedir_consec": 0.3078749493026127, "sim_compute_sim_state": 0.004652233123779297, "sim_compute_performance-ego": 0.0070804405212402345, "sim_compute_robot_state-ego": 0.00835165023803711}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3365642358755502, "sim_physics": 0.08177401338304792, "survival_time": 1.4000000000000006, "driven_lanedir": 0.2974260130570474, "sim_render-ego": 0.009961375168391635, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02165675163269043, "deviation-heading": 0.33181260565903165, "set_robot_commands": 0.007328927516937256, "deviation-center-line": 0.09908406396930604, "driven_lanedir_consec": 0.2974260130570474, "sim_compute_sim_state": 0.003938530172620501, "sim_compute_performance-ego": 0.00613915068762643, "sim_compute_robot_state-ego": 0.007226313863481794}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2293671799175478, "sim_physics": 0.11093343929810956, "survival_time": 6.5999999999999845, "driven_lanedir": 0.6082396069091622, "sim_render-ego": 0.012757015950752027, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.030158290357300728, "deviation-heading": 2.563184980797178, "set_robot_commands": 0.010030271429004091, "deviation-center-line": 0.30968742498477, "driven_lanedir_consec": 0.6082396069091622, "sim_compute_sim_state": 0.005217497999017889, "sim_compute_performance-ego": 0.007861728017980402, "sim_compute_robot_state-ego": 0.009771039991667776}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9314168827218396, "sim_physics": 0.06674713641405106, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4332286352393147, "sim_render-ego": 0.008481059223413467, "in-drivable-lane": 1.1999999999999988, "agent_compute-ego": 0.019215840846300125, "deviation-heading": 1.0797441872361333, "set_robot_commands": 0.006155364215373993, "deviation-center-line": 0.1502159960635768, "driven_lanedir_consec": 0.4332286352393147, "sim_compute_sim_state": 0.003436986356973648, "sim_compute_performance-ego": 0.0047181136906147, "sim_compute_robot_state-ego": 0.006090901792049408}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19567153720465655, "sim_physics": 0.06103005674150255, "survival_time": 0.9000000000000002, "driven_lanedir": 0.13021009457337085, "sim_render-ego": 0.007458077536688911, "in-drivable-lane": 0, "agent_compute-ego": 0.01672922240363227, "deviation-heading": 0.5759006354934012, "set_robot_commands": 0.005205366346571181, "deviation-center-line": 0.04891662953231811, "driven_lanedir_consec": 0.13021009457337085, "sim_compute_sim_state": 0.002860850758022732, "sim_compute_performance-ego": 0.00402375062306722, "sim_compute_robot_state-ego": 0.005025307337443034}}
set_robot_commands_max0.010030271429004091
set_robot_commands_mean0.007408599625332188
set_robot_commands_median0.007328927516937256
set_robot_commands_min0.005205366346571181
sim_compute_performance-ego_max0.007861728017980402
sim_compute_performance-ego_mean0.005964636708105797
sim_compute_performance-ego_median0.00613915068762643
sim_compute_performance-ego_min0.00402375062306722
sim_compute_robot_state-ego_max0.009771039991667776
sim_compute_robot_state-ego_mean0.007293042644535824
sim_compute_robot_state-ego_median0.007226313863481794
sim_compute_robot_state-ego_min0.005025307337443034
sim_compute_sim_state_max0.005217497999017889
sim_compute_sim_state_mean0.004021219682082813
sim_compute_sim_state_median0.003938530172620501
sim_compute_sim_state_min0.002860850758022732
sim_physics_max0.11093343929810956
sim_physics_mean0.08506438789231781
sim_physics_median0.08177401338304792
sim_physics_min0.06103005674150255
sim_render-ego_max0.012757015950752027
sim_render-ego_mean0.010004121008588466
sim_render-ego_median0.009961375168391635
sim_render-ego_min0.007458077536688911
simulation-passed1
survival_time_max6.5999999999999845
survival_time_mean2.6699999999999964
survival_time_min0.9000000000000002
No reset possible
253824396András Kalaposexp2217aido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-46-148-104920:00:07
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling simulator      ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling evaluator      ... done
stderr | 
stderr | ERROR: for solution  pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
253814396András Kalaposexp2217aido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-46-148-104920:00:08
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling simulator      ... 
stderr | Pulling evaluator      ... done
stderr | 
stderr | ERROR: for solution  pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
253794414András Kalaposexp2217aido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-46-148-104920:00:05
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling simulator      ... 
stderr | Pulling evaluator      ... done
stderr | 
stderr | ERROR: for solution  pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
253694414András Kalaposexp2217aido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-46-148-104920:00:15
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling simulator      ... 
stderr | Pulling evaluator      ... 
stderr | Pulling scenario_maker ... done
stderr | 
stderr | ERROR: for solution  pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
253214412Bea Baselines 🐤straightaido3-LFVI-sim-validationstep1-simulationhost-errornoip-172-31-46-148-104920:10:49
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1577, in upload
    aws_object.load()
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1587, in upload
    aws_object.upload_file(realfile, ExtraArgs={"ContentType": mime_type})
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 280, in object_upload_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 131, in upload_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 279, in upload_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 255, in _main
    self._submit(transfer_future=transfer_future, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 549, in _submit
    upload_input_manager.provide_transfer_size(transfer_future)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 237, in provide_transfer_size
    transfer_future.meta.call_args.fileobj))
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 228, in get_file_size
    return os.path.getsize(filename)
  File "/usr/lib/python3.6/genericpath.py", line 50, in getsize
    return os.stat(filename).st_size
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LFVI-sim-validation/submission4412/step1-simulation-ip-172-31-46-148-10492-job25321/challenge-evaluation-output/episodes/udem1-2-0/drawing.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
252324411Bea Baselines 🐤straightaido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104920:29:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4220884951176438
survival_time_median6.399999999999985
deviation-center-line_median0.27892706225192304
in-drivable-lane_median1.8499999999999936


other stats
agent_compute-ego_max0.02769670023846982
agent_compute-ego_mean0.021393104244468497
agent_compute-ego_median0.02183093149450761
agent_compute-ego_min0.017617903649806976
deviation-center-line_max0.5144404589740725
deviation-center-line_mean0.3121654629671339
deviation-center-line_min0.16719255179092368
deviation-heading_max2.18828740566943
deviation-heading_mean0.9028782607085936
deviation-heading_median0.8424743161949844
deviation-heading_min0.4089684352423068
driven_any_max2.1738945004008174
driven_any_mean0.9638129431009536
driven_any_median0.9983629676007618
driven_any_min0.3502727550812653
driven_lanedir_consec_max1.1205511226948994
driven_lanedir_consec_mean0.5700174116347029
driven_lanedir_consec_min0.3239722211241143
driven_lanedir_max1.1205511226948994
driven_lanedir_mean0.5700174116347029
driven_lanedir_median0.4220884951176438
driven_lanedir_min0.3239722211241143
in-drivable-lane_max7.950000000000069
in-drivable-lane_mean2.2233333333333363
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9983629676007618, "sim_physics": 0.19046356156468391, "survival_time": 6.399999999999985, "driven_lanedir": 0.6612439699544281, "sim_render-ego": 0.012618698179721832, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.023303525522351265, "deviation-heading": 0.8424743161949844, "set_robot_commands": 0.009241340681910517, "deviation-center-line": 0.27148260816881825, "driven_lanedir_consec": 0.6612439699544281, "sim_compute_sim_state": 0.0051198918372392654, "sim_compute_performance-ego": 0.007622867822647095, "sim_compute_robot_state-ego": 0.009838193655014038, "sim_compute_robot_state-npc0": 0.008301079273223877, "sim_compute_robot_state-npc1": 0.008417584002017975, "sim_compute_robot_state-npc2": 0.008553985506296158, "sim_compute_robot_state-npc3": 0.007969914004206657}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4392247264253565, "sim_physics": 0.1902729908625285, "survival_time": 2.9999999999999973, "driven_lanedir": 0.41311687643340766, "sim_render-ego": 0.011311670144399008, "in-drivable-lane": 0, "agent_compute-ego": 0.020715216795603435, "deviation-heading": 1.035260802813342, "set_robot_commands": 0.008758227030436197, "deviation-center-line": 0.21478316132086225, "driven_lanedir_consec": 0.41311687643340766, "sim_compute_sim_state": 0.004367454846700033, "sim_compute_performance-ego": 0.00670996904373169, "sim_compute_robot_state-ego": 0.00849919319152832, "sim_compute_robot_state-npc0": 0.007453986008961995, "sim_compute_robot_state-npc1": 0.006954375902811686, "sim_compute_robot_state-npc2": 0.0068765759468078615, "sim_compute_robot_state-npc3": 0.006770149866739909}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5950476006576149, "sim_physics": 0.17272037267684937, "survival_time": 10.000000000000009, "driven_lanedir": 1.0825757147966095, "sim_render-ego": 0.011644484996795657, "in-drivable-lane": 3.050000000000024, "agent_compute-ego": 0.022109932899475097, "deviation-heading": 0.922673447431702, "set_robot_commands": 0.00890942096710205, "deviation-center-line": 0.5144404589740725, "driven_lanedir_consec": 1.0825757147966095, "sim_compute_sim_state": 0.004781968593597412, "sim_compute_performance-ego": 0.006785684823989868, "sim_compute_robot_state-ego": 0.008832423686981202, "sim_compute_robot_state-npc0": 0.00822926163673401, "sim_compute_robot_state-npc1": 0.008042373657226563, "sim_compute_robot_state-npc2": 0.007937517166137695, "sim_compute_robot_state-npc3": 0.00817947745323181}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.58683387649107, "sim_physics": 0.1256021315128959, "survival_time": 9.950000000000006, "driven_lanedir": 1.1205511226948994, "sim_render-ego": 0.009539323835516696, "in-drivable-lane": 2.750000000000024, "agent_compute-ego": 0.018093403859354144, "deviation-heading": 0.8960564351200616, "set_robot_commands": 0.006841986622642632, "deviation-center-line": 0.48425006479995847, "driven_lanedir_consec": 1.1205511226948994, "sim_compute_sim_state": 0.003721189259284705, "sim_compute_performance-ego": 0.0054421987964879326, "sim_compute_robot_state-ego": 0.006813981425223039, "sim_compute_robot_state-npc0": 0.006508065228486181, "sim_compute_robot_state-npc1": 0.006462089979468877, "sim_compute_robot_state-npc2": 0.006078031194868998, "sim_compute_robot_state-npc3": 0.006244962538906078}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3899928201896975, "sim_physics": 0.1763989351413868, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3774367730282412, "sim_render-ego": 0.012251275557058829, "in-drivable-lane": 0, "agent_compute-ego": 0.02302149490073875, "deviation-heading": 0.6889554213117572, "set_robot_commands": 0.009911832986054596, "deviation-center-line": 0.19561224709637468, "driven_lanedir_consec": 0.3774367730282412, "sim_compute_sim_state": 0.005224589948300962, "sim_compute_performance-ego": 0.007105328418590405, "sim_compute_robot_state-ego": 0.009164501119543004, "sim_compute_robot_state-npc0": 0.008976062138875326, "sim_compute_robot_state-npc1": 0.008498191833496094, "sim_compute_robot_state-npc2": 0.008906143682974356, "sim_compute_robot_state-npc3": 0.008361666290848344}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0524319740286436, "sim_physics": 0.15463112361395537, "survival_time": 6.699999999999984, "driven_lanedir": 0.3724269493189274, "sim_render-ego": 0.011152509433120045, "in-drivable-lane": 3.2999999999999887, "agent_compute-ego": 0.02769670023846982, "deviation-heading": 2.18828740566943, "set_robot_commands": 0.009923143173331645, "deviation-center-line": 0.3354455178591389, "driven_lanedir_consec": 0.3724269493189274, "sim_compute_sim_state": 0.004387859088271412, "sim_compute_performance-ego": 0.007547962131784923, "sim_compute_robot_state-ego": 0.008170446353172189, "sim_compute_robot_state-npc0": 0.010163349891776467, "sim_compute_robot_state-npc1": 0.008187333149696463, "sim_compute_robot_state-npc2": 0.007793011950023139, "sim_compute_robot_state-npc3": 0.007203239113537234}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9906143925391104, "sim_physics": 0.15171688560425767, "survival_time": 6.349999999999985, "driven_lanedir": 0.6439415719429004, "sim_render-ego": 0.011614609891035426, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.022185029007318453, "deviation-heading": 1.435419523522128, "set_robot_commands": 0.00911190566115492, "deviation-center-line": 0.3408594232379028, "driven_lanedir_consec": 0.6439415719429004, "sim_compute_sim_state": 0.004632003664031742, "sim_compute_performance-ego": 0.006901660303431233, "sim_compute_robot_state-ego": 0.008666321987242211, "sim_compute_robot_state-npc0": 0.008316952412522683, "sim_compute_robot_state-npc1": 0.008162496596809447, "sim_compute_robot_state-npc2": 0.007931091654019094, "sim_compute_robot_state-npc3": 0.007757798893245187}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.1738945004008174, "sim_physics": 0.15091416041056316, "survival_time": 13.500000000000057, "driven_lanedir": 0.8500792607657917, "sim_render-ego": 0.010531134075588653, "in-drivable-lane": 7.950000000000069, "agent_compute-ego": 0.020612220410947447, "deviation-heading": 0.9205424364448506, "set_robot_commands": 0.007758434613545736, "deviation-center-line": 0.45495052992461377, "driven_lanedir_consec": 0.8500792607657917, "sim_compute_sim_state": 0.004308366775512695, "sim_compute_performance-ego": 0.006230545926977087, "sim_compute_robot_state-ego": 0.007935010945355451, "sim_compute_robot_state-npc0": 0.007470813503971806, "sim_compute_robot_state-npc1": 0.007160577067622432, "sim_compute_robot_state-npc2": 0.007232664249561451, "sim_compute_robot_state-npc3": 0.007249954011705187}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0257712188667258, "sim_physics": 0.1283354195019671, "survival_time": 6.549999999999985, "driven_lanedir": 0.3845931432488001, "sim_render-ego": 0.010414061655525032, "in-drivable-lane": 3.7999999999999865, "agent_compute-ego": 0.0199529524067886, "deviation-heading": 0.6896445394165549, "set_robot_commands": 0.007588104437325747, "deviation-center-line": 0.26135511972461467, "driven_lanedir_consec": 0.3845931432488001, "sim_compute_sim_state": 0.004077889537083284, "sim_compute_performance-ego": 0.00581999771467602, "sim_compute_robot_state-ego": 0.0078941265135321, "sim_compute_robot_state-npc0": 0.007384223792389149, "sim_compute_robot_state-npc1": 0.00697597474542283, "sim_compute_robot_state-npc2": 0.0067393925353770945, "sim_compute_robot_state-npc3": 0.006824948405491487}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.47161119777273736, "sim_physics": 0.13289548084139824, "survival_time": 3.1999999999999966, "driven_lanedir": 0.45590656218911274, "sim_render-ego": 0.009459801018238068, "in-drivable-lane": 0, "agent_compute-ego": 0.017617903649806976, "deviation-heading": 0.8297785897408253, "set_robot_commands": 0.006922293454408646, "deviation-center-line": 0.2177392610099727, "driven_lanedir_consec": 0.45590656218911274, "sim_compute_sim_state": 0.0036571063101291656, "sim_compute_performance-ego": 0.0055654048919677734, "sim_compute_robot_state-ego": 0.00687330961227417, "sim_compute_robot_state-npc0": 0.0061876364052295685, "sim_compute_robot_state-npc1": 0.0059895142912864685, "sim_compute_robot_state-npc2": 0.006037168204784393, "sim_compute_robot_state-npc3": 0.005968581885099411}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3502727550812653, "sim_physics": 0.193034366685517, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3305412160517913, "sim_render-ego": 0.010606147805038765, "in-drivable-lane": 0, "agent_compute-ego": 0.01962203882178482, "deviation-heading": 0.8225989070916062, "set_robot_commands": 0.007914684256728815, "deviation-center-line": 0.16719255179092368, "driven_lanedir_consec": 0.3305412160517913, "sim_compute_sim_state": 0.004356987622319435, "sim_compute_performance-ego": 0.006432786279795121, "sim_compute_robot_state-ego": 0.008232033982568858, "sim_compute_robot_state-npc0": 0.00836539755062181, "sim_compute_robot_state-npc1": 0.007449067368799326, "sim_compute_robot_state-npc2": 0.007082476907846879, "sim_compute_robot_state-npc3": 0.006986603444936324}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4072958182486309, "sim_physics": 0.12225632156644547, "survival_time": 2.799999999999998, "driven_lanedir": 0.40280077962364746, "sim_render-ego": 0.01021641492843628, "in-drivable-lane": 0, "agent_compute-ego": 0.018783258540289744, "deviation-heading": 0.4155969658422808, "set_robot_commands": 0.00790373342377799, "deviation-center-line": 0.2870396517129124, "driven_lanedir_consec": 0.40280077962364746, "sim_compute_sim_state": 0.004025174038750785, "sim_compute_performance-ego": 0.005993860108511788, "sim_compute_robot_state-ego": 0.007701895066670009, "sim_compute_robot_state-npc0": 0.006826204913003104, "sim_compute_robot_state-npc1": 0.006859855992453439, "sim_compute_robot_state-npc2": 0.006962503705705915, "sim_compute_robot_state-npc3": 0.006960728338786534}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0156970270680152, "sim_physics": 0.1586762079825768, "survival_time": 6.499999999999985, "driven_lanedir": 0.3239722211241143, "sim_render-ego": 0.01185603508582482, "in-drivable-lane": 4.149999999999985, "agent_compute-ego": 0.02280861964592567, "deviation-heading": 0.5092523488442444, "set_robot_commands": 0.009834571985098031, "deviation-center-line": 0.27892706225192304, "driven_lanedir_consec": 0.3239722211241143, "sim_compute_sim_state": 0.00490111387692965, "sim_compute_performance-ego": 0.006956283862774189, "sim_compute_robot_state-ego": 0.008745094446035532, "sim_compute_robot_state-npc0": 0.008479765745309682, "sim_compute_robot_state-npc1": 0.008126532114469088, "sim_compute_robot_state-npc2": 0.00822297609769381, "sim_compute_robot_state-npc3": 0.008100467461806078}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7120180155851771, "sim_physics": 0.18018679208652943, "survival_time": 4.6499999999999915, "driven_lanedir": 0.7089865182302293, "sim_render-ego": 0.01171870385446856, "in-drivable-lane": 0, "agent_compute-ego": 0.02254333547366563, "deviation-heading": 0.4089684352423068, "set_robot_commands": 0.009499780593379852, "deviation-center-line": 0.4305749649425981, "driven_lanedir_consec": 0.7089865182302293, "sim_compute_sim_state": 0.004831139759350849, "sim_compute_performance-ego": 0.006731420434931273, "sim_compute_robot_state-ego": 0.00912063608887375, "sim_compute_robot_state-npc0": 0.008362008679297662, "sim_compute_robot_state-npc1": 0.007913104949458953, "sim_compute_robot_state-npc2": 0.008212563812091787, "sim_compute_robot_state-npc3": 0.007722862305179719}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2481252555586806, "sim_physics": 0.18450869186015068, "survival_time": 7.89999999999998, "driven_lanedir": 0.4220884951176438, "sim_render-ego": 0.011675649051424822, "in-drivable-lane": 4.899999999999983, "agent_compute-ego": 0.02183093149450761, "deviation-heading": 0.9376643359428288, "set_robot_commands": 0.009208324589306796, "deviation-center-line": 0.22782932169232223, "driven_lanedir_consec": 0.4220884951176438, "sim_compute_sim_state": 0.004763751090327396, "sim_compute_performance-ego": 0.0068843711780596385, "sim_compute_robot_state-ego": 0.008746728112425986, "sim_compute_robot_state-npc0": 0.008173886733719065, "sim_compute_robot_state-npc1": 0.007887944390502158, "sim_compute_robot_state-npc2": 0.007938802996768227, "sim_compute_robot_state-npc3": 0.007652824438070949}}
set_robot_commands_max0.009923143173331645
set_robot_commands_mean0.00862185229841361
set_robot_commands_median0.00890942096710205
set_robot_commands_min0.006841986622642632
sim_compute_performance-ego_max0.007622867822647095
sim_compute_performance-ego_mean0.006582022782557069
sim_compute_performance-ego_median0.006731420434931273
sim_compute_performance-ego_min0.0054421987964879326
sim_compute_robot_state-ego_max0.009838193655014038
sim_compute_robot_state-ego_mean0.008348926412429325
sim_compute_robot_state-ego_median0.00849919319152832
sim_compute_robot_state-ego_min0.006813981425223039
sim_compute_robot_state-npc0_max0.010163349891776467
sim_compute_robot_state-npc0_mean0.007946579594274826
sim_compute_robot_state-npc0_median0.00822926163673401
sim_compute_robot_state-npc0_min0.0061876364052295685
sim_compute_robot_state-npc1_max0.008498191833496094
sim_compute_robot_state-npc1_mean0.007539134402769453
sim_compute_robot_state-npc1_median0.007887944390502158
sim_compute_robot_state-npc1_min0.0059895142912864685
sim_compute_robot_state-npc2_max0.008906143682974356
sim_compute_robot_state-npc2_mean0.007500327040730458
sim_compute_robot_state-npc2_median0.007793011950023139
sim_compute_robot_state-npc2_min0.006037168204784393
sim_compute_robot_state-npc3_max0.008361666290848344
sim_compute_robot_state-npc3_mean0.007330278563452726
sim_compute_robot_state-npc3_median0.007249954011705187
sim_compute_robot_state-npc3_min0.005968581885099411
sim_compute_sim_state_max0.005224589948300962
sim_compute_sim_state_mean0.004477099083188587
sim_compute_sim_state_median0.004387859088271412
sim_compute_sim_state_min0.0036571063101291656
sim_physics_max0.193034366685517
sim_physics_mean0.16084089612744704
sim_physics_median0.1586762079825768
sim_physics_min0.12225632156644547
sim_render-ego_max0.012618698179721832
sim_render-ego_mean0.011107367967479496
sim_render-ego_median0.011311670144399008
sim_render-ego_min0.009459801018238068
simulation-passed1
survival_time_max13.500000000000057
survival_time_mean6.176666666666664
survival_time_min2.4499999999999993
No reset possible
252063264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-46-148-104920:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251973257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-46-148-104920:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251953265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-46-148-104920:00:25
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible