Duckietown Challenges Home Challenges Submissions

Evaluator 1124

ID1124
evaluatorip-172-31-42-167-7227
ownerI don't have one πŸ˜€
machineip-172-31-42-167
processip-172-31-42-167-7227
versiond-c:4.0.30;d-c-r:4.0.43;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success5 22167
# timeout
# failed
# error2 22180
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
222143510Bea Baselines 🐀challenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-42-167-72270:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06756461713422901
survival_time_median1.3000000000000005
deviation-center-line_median0.06164752465574368
in-drivable-lane_median0.30000000000000027


other stats
agent_compute-ego_max0.18087246201255103
agent_compute-ego_mean0.1592041719368469
agent_compute-ego_median0.1636139102604078
agent_compute-ego_min0.12732056471017691
deviation-center-line_max0.10197695329451532
deviation-center-line_mean0.06780737131373141
deviation-center-line_min0.031097301710084735
deviation-heading_max0.7744072038035601
deviation-heading_mean0.6545173674182166
deviation-heading_median0.6941648817826056
deviation-heading_min0.4494117651116912
driven_any_max0.20972137170857968
driven_any_mean0.15872100939692413
driven_any_median0.13807489982914864
driven_any_min0.11293562914228052
driven_lanedir_consec_max0.1055186317165986
driven_lanedir_consec_mean0.06970804388947685
driven_lanedir_consec_min0.049029246468539345
driven_lanedir_max0.1055186317165986
driven_lanedir_mean0.06970804388947685
driven_lanedir_median0.06756461713422901
driven_lanedir_min0.049029246468539345
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.28000000000000025
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20972137170857968, "sim_physics": 0.1884000301361084, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06756461713422901, "sim_render-ego": 0.0642148798162287, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.18087246201255103, "deviation-heading": 0.7467167375275839, "set_robot_commands": 0.0990622549345999, "deviation-center-line": 0.06164752465574368, "driven_lanedir_consec": 0.06756461713422901, "sim_compute_sim_state": 0.04003740079475172, "sim_compute_performance-ego": 0.06891531655282686, "sim_compute_robot_state-ego": 0.07707646398833304, "sim_compute_robot_state-npc0": 0.0675625584342263, "sim_compute_robot_state-npc1": 0.0677354046792695, "sim_compute_robot_state-npc2": 0.06768104524323434, "sim_compute_robot_state-npc3": 0.06987370866717714}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1978615427615033, "sim_physics": 0.1575034037232399, "survival_time": 1.6000000000000008, "driven_lanedir": 0.049029246468539345, "sim_render-ego": 0.05724864453077316, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15957578271627426, "deviation-heading": 0.7744072038035601, "set_robot_commands": 0.11859802156686784, "deviation-center-line": 0.053449246635032685, "driven_lanedir_consec": 0.049029246468539345, "sim_compute_sim_state": 0.036736860871315, "sim_compute_performance-ego": 0.06255422532558441, "sim_compute_robot_state-ego": 0.06841223686933517, "sim_compute_robot_state-npc0": 0.06615585088729858, "sim_compute_robot_state-npc1": 0.06480564177036285, "sim_compute_robot_state-npc2": 0.06491118669509888, "sim_compute_robot_state-npc3": 0.0635116845369339}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11293562914228052, "sim_physics": 0.18403727075327997, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07433299459107712, "sim_render-ego": 0.06373559910318126, "in-drivable-lane": 0, "agent_compute-ego": 0.1636139102604078, "deviation-heading": 0.6078862488656424, "set_robot_commands": 0.08974235990773076, "deviation-center-line": 0.10197695329451532, "driven_lanedir_consec": 0.07433299459107712, "sim_compute_sim_state": 0.03791840180106785, "sim_compute_performance-ego": 0.07202471857485564, "sim_compute_robot_state-ego": 0.0802733379861583, "sim_compute_robot_state-npc0": 0.06704094098961871, "sim_compute_robot_state-npc1": 0.07009929159413213, "sim_compute_robot_state-npc2": 0.06715180562890094, "sim_compute_robot_state-npc3": 0.06469709976859715}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13501160354310843, "sim_physics": 0.1806473298506303, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1055186317165986, "sim_render-ego": 0.061355363238941536, "in-drivable-lane": 0, "agent_compute-ego": 0.16463813998482443, "deviation-heading": 0.4494117651116912, "set_robot_commands": 0.17051833326166327, "deviation-center-line": 0.09086583027328064, "driven_lanedir_consec": 0.1055186317165986, "sim_compute_sim_state": 0.035157626325433906, "sim_compute_performance-ego": 0.06578110564838756, "sim_compute_robot_state-ego": 0.06891538880088112, "sim_compute_robot_state-npc0": 0.0662692893635143, "sim_compute_robot_state-npc1": 0.06444799900054932, "sim_compute_robot_state-npc2": 0.05803775787353515, "sim_compute_robot_state-npc3": 0.06005118109963157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13807489982914864, "sim_physics": 0.11795257605039156, "survival_time": 1.3000000000000005, "driven_lanedir": 0.052094729536940165, "sim_render-ego": 0.04690561844752385, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12732056471017691, "deviation-heading": 0.6941648817826056, "set_robot_commands": 0.06873478339268611, "deviation-center-line": 0.031097301710084735, "driven_lanedir_consec": 0.052094729536940165, "sim_compute_sim_state": 0.027896816913898177, "sim_compute_performance-ego": 0.04783655129946195, "sim_compute_robot_state-ego": 0.050699316538297214, "sim_compute_robot_state-npc0": 0.05487779470590445, "sim_compute_robot_state-npc1": 0.05382189383873573, "sim_compute_robot_state-npc2": 0.05143063801985521, "sim_compute_robot_state-npc3": 0.05074254366067739}}
set_robot_commands_max0.17051833326166327
set_robot_commands_mean0.10933115061270957
set_robot_commands_median0.0990622549345999
set_robot_commands_min0.06873478339268611
sim_compute_performance-ego_max0.07202471857485564
sim_compute_performance-ego_mean0.06342238348022329
sim_compute_performance-ego_median0.06578110564838756
sim_compute_performance-ego_min0.04783655129946195
sim_compute_robot_state-ego_max0.0802733379861583
sim_compute_robot_state-ego_mean0.06907534883660096
sim_compute_robot_state-ego_median0.06891538880088112
sim_compute_robot_state-ego_min0.050699316538297214
sim_compute_robot_state-npc0_max0.0675625584342263
sim_compute_robot_state-npc0_mean0.06438128687611247
sim_compute_robot_state-npc0_median0.0662692893635143
sim_compute_robot_state-npc0_min0.05487779470590445
sim_compute_robot_state-npc1_max0.07009929159413213
sim_compute_robot_state-npc1_mean0.0641820461766099
sim_compute_robot_state-npc1_median0.06480564177036285
sim_compute_robot_state-npc1_min0.05382189383873573
sim_compute_robot_state-npc2_max0.06768104524323434
sim_compute_robot_state-npc2_mean0.0618424866921249
sim_compute_robot_state-npc2_median0.06491118669509888
sim_compute_robot_state-npc2_min0.05143063801985521
sim_compute_robot_state-npc3_max0.06987370866717714
sim_compute_robot_state-npc3_mean0.06177524354660343
sim_compute_robot_state-npc3_median0.0635116845369339
sim_compute_robot_state-npc3_min0.05074254366067739
sim_compute_sim_state_max0.04003740079475172
sim_compute_sim_state_mean0.035549421341293325
sim_compute_sim_state_median0.036736860871315
sim_compute_sim_state_min0.027896816913898177
sim_physics_max0.1884000301361084
sim_physics_mean0.16570812210273006
sim_physics_median0.1806473298506303
sim_physics_min0.11795257605039156
sim_render-ego_max0.0642148798162287
sim_render-ego_mean0.0586920210273297
sim_render-ego_median0.061355363238941536
sim_render-ego_min0.04690561844752385
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.3600000000000008
survival_time_min1.1000000000000003
No reset possible
222003501Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido2-LF-sim-validationstep1-simulationerrornoip-172-31-42-167-72270:14:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
221893503Bea Baselines 🐀Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-72270:14:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5859307220993988
survival_time_median14.950000000000076
deviation-center-line_median0.7837681504643924
in-drivable-lane_median4.25000000000006


other stats
agent_compute-ego_max0.12462438662846884
agent_compute-ego_mean0.12203301628592876
agent_compute-ego_median0.12133009871658014
agent_compute-ego_min0.12080594937006632
deviation-center-line_max1.0321663237063483
deviation-center-line_mean0.7912161327918256
deviation-center-line_min0.5284459224159573
deviation-heading_max3.281359339883191
deviation-heading_mean2.258069746391028
deviation-heading_median2.168208125134569
deviation-heading_min1.5284360489017683
driven_any_max0.921150933767305
driven_any_mean0.8354570590979442
driven_any_median0.8627452428464282
driven_any_min0.6805455390129964
driven_lanedir_consec_max0.8939566459116248
driven_lanedir_consec_mean0.5667379547862325
driven_lanedir_consec_min0.3096735428853492
driven_lanedir_max0.8939566459116248
driven_lanedir_mean0.56789596649202
driven_lanedir_median0.5917207806283362
driven_lanedir_min0.3096735428853492
in-drivable-lane_max7.300000000000082
in-drivable-lane_mean4.160000000000046
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8086940271684914, "sim_physics": 0.05471728801727295, "survival_time": 14.950000000000076, "driven_lanedir": 0.5917207806283362, "sim_render-ego": 0.043267412185668944, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.12080594937006632, "deviation-heading": 3.281359339883191, "set_robot_commands": 0.0545591934521993, "deviation-center-line": 1.0321663237063483, "driven_lanedir_consec": 0.5859307220993988, "sim_compute_sim_state": 0.022464319864908853, "sim_compute_performance-ego": 0.0378089698155721, "sim_compute_robot_state-ego": 0.04003583431243896}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.921150933767305, "sim_physics": 0.05597441037495931, "survival_time": 14.950000000000076, "driven_lanedir": 0.4278470354958605, "sim_render-ego": 0.03480993509292603, "in-drivable-lane": 7.300000000000082, "agent_compute-ego": 0.12117838621139526, "deviation-heading": 2.168208125134569, "set_robot_commands": 0.05424398422241211, "deviation-center-line": 0.7837681504643924, "driven_lanedir_consec": 0.4278470354958605, "sim_compute_sim_state": 0.02245503822962443, "sim_compute_performance-ego": 0.03807519753774007, "sim_compute_robot_state-ego": 0.03995782136917114}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8627452428464282, "sim_physics": 0.05245293219884237, "survival_time": 14.950000000000076, "driven_lanedir": 0.6162818275389292, "sim_render-ego": 0.035265687306722006, "in-drivable-lane": 4.25000000000006, "agent_compute-ego": 0.12222626050313314, "deviation-heading": 2.6803723706917286, "set_robot_commands": 0.05440415620803833, "deviation-center-line": 0.6902298807565038, "driven_lanedir_consec": 0.6162818275389292, "sim_compute_sim_state": 0.022631789048512777, "sim_compute_performance-ego": 0.03795836130777995, "sim_compute_robot_state-ego": 0.03971260070800781}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9041495526945004, "sim_physics": 0.05456043799718221, "survival_time": 14.950000000000076, "driven_lanedir": 0.8939566459116248, "sim_render-ego": 0.0351440691947937, "in-drivable-lane": 0, "agent_compute-ego": 0.12462438662846884, "deviation-heading": 1.6319728473438837, "set_robot_commands": 0.05417390108108521, "deviation-center-line": 0.9214703866159258, "driven_lanedir_consec": 0.8939566459116248, "sim_compute_sim_state": 0.02263057549794515, "sim_compute_performance-ego": 0.03816551367441813, "sim_compute_robot_state-ego": 0.03978630622227987}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6805455390129964, "sim_physics": 0.054728039916680786, "survival_time": 12.25000000000004, "driven_lanedir": 0.3096735428853492, "sim_render-ego": 0.034657311926082686, "in-drivable-lane": 6.5000000000000515, "agent_compute-ego": 0.12133009871658014, "deviation-heading": 1.5284360489017683, "set_robot_commands": 0.05323705575904067, "deviation-center-line": 0.5284459224159573, "driven_lanedir_consec": 0.3096735428853492, "sim_compute_sim_state": 0.022755166462489537, "sim_compute_performance-ego": 0.03793775597397162, "sim_compute_robot_state-ego": 0.03995263917105538}}
set_robot_commands_max0.0545591934521993
set_robot_commands_mean0.05412365814455513
set_robot_commands_median0.05424398422241211
set_robot_commands_min0.05323705575904067
sim_compute_performance-ego_max0.03816551367441813
sim_compute_performance-ego_mean0.03798915966189637
sim_compute_performance-ego_median0.03795836130777995
sim_compute_performance-ego_min0.0378089698155721
sim_compute_robot_state-ego_max0.04003583431243896
sim_compute_robot_state-ego_mean0.039889040356590626
sim_compute_robot_state-ego_median0.03995263917105538
sim_compute_robot_state-ego_min0.03971260070800781
sim_compute_sim_state_max0.022755166462489537
sim_compute_sim_state_mean0.02258737782069615
sim_compute_sim_state_median0.02263057549794515
sim_compute_sim_state_min0.02245503822962443
sim_physics_max0.05597441037495931
sim_physics_mean0.05448662170098752
sim_physics_median0.05471728801727295
sim_physics_min0.05245293219884237
sim_render-ego_max0.043267412185668944
sim_render-ego_mean0.036628883141238675
sim_render-ego_median0.0351440691947937
sim_render-ego_min0.034657311926082686
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.410000000000071
survival_time_min12.25000000000004
No reset possible
221803500Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-validationstep1-simulationerrornoip-172-31-42-167-72270:20:09
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
221743489FANG MEIYIΒ πŸ‡ΈπŸ‡¬testaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-42-167-72270:34:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.965722012850965
survival_time_median14.950000000000076
deviation-center-line_median0.8226082960032028
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08963076273600261
agent_compute-ego_mean0.08828307600737854
agent_compute-ego_median0.08865948756535848
agent_compute-ego_min0.08696888208389282
deviation-center-line_max1.1120465307225715
deviation-center-line_mean0.7022922069905436
deviation-center-line_min0.2521682471927583
deviation-heading_max3.5321897129885076
deviation-heading_mean1.791614734789469
deviation-heading_median1.3744531536710238
deviation-heading_min0.532473905795214
driven_any_max3.4293368965433886
driven_any_mean2.7353721053576776
driven_any_median3.039288601596238
driven_any_min0.5226223945881474
driven_lanedir_consec_max3.4118608491750515
driven_lanedir_consec_mean2.6345351323652726
driven_lanedir_consec_min0.5121632147374089
driven_lanedir_max3.4118608491750515
driven_lanedir_mean2.6345351323652726
driven_lanedir_median2.965722012850965
driven_lanedir_min0.5121632147374089
in-drivable-lane_max1.4500000000000206
in-drivable-lane_mean0.2366666666666692
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9866153378605995, "sim_physics": 0.05640329758326213, "survival_time": 14.950000000000076, "driven_lanedir": 2.9099066420008093, "sim_render-ego": 0.035102325280507406, "in-drivable-lane": 0, "agent_compute-ego": 0.08887770811716715, "deviation-heading": 2.8817213301556426, "set_robot_commands": 0.054489212036132814, "deviation-center-line": 0.941564438304326, "driven_lanedir_consec": 2.9099066420008093, "sim_compute_sim_state": 0.022403684457143143, "sim_compute_performance-ego": 0.03786998192469279, "sim_compute_robot_state-ego": 0.04090669552485148}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.355156708349294, "sim_physics": 0.05235642433166504, "survival_time": 14.950000000000076, "driven_lanedir": 3.3289112782157, "sim_render-ego": 0.03487789869308472, "in-drivable-lane": 0, "agent_compute-ego": 0.08963076273600261, "deviation-heading": 1.3744531536710238, "set_robot_commands": 0.05378108024597168, "deviation-center-line": 0.8417627979039003, "driven_lanedir_consec": 3.3289112782157, "sim_compute_sim_state": 0.022332963943481447, "sim_compute_performance-ego": 0.037788480917612714, "sim_compute_robot_state-ego": 0.03968350489934285}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.21713297190068, "sim_physics": 0.05307533582051595, "survival_time": 14.950000000000076, "driven_lanedir": 3.1751909296490086, "sim_render-ego": 0.03486967881520589, "in-drivable-lane": 0, "agent_compute-ego": 0.08865948756535848, "deviation-heading": 1.8762675681521224, "set_robot_commands": 0.053621879418691, "deviation-center-line": 0.7117294061233134, "driven_lanedir_consec": 3.1751909296490086, "sim_compute_sim_state": 0.022124388217926023, "sim_compute_performance-ego": 0.03861915508906046, "sim_compute_robot_state-ego": 0.039437594413757326}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.038704676804643, "sim_physics": 0.05396424372990926, "survival_time": 14.950000000000076, "driven_lanedir": 2.965722012850965, "sim_render-ego": 0.03479756514231364, "in-drivable-lane": 0, "agent_compute-ego": 0.08867339849472046, "deviation-heading": 2.707794735908644, "set_robot_commands": 0.054505825837453205, "deviation-center-line": 1.1120465307225715, "driven_lanedir_consec": 2.965722012850965, "sim_compute_sim_state": 0.022031710942586265, "sim_compute_performance-ego": 0.03739616314570109, "sim_compute_robot_state-ego": 0.03933958133061727}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0204654461053, "sim_physics": 0.05455550988515218, "survival_time": 14.950000000000076, "driven_lanedir": 2.63299725932895, "sim_render-ego": 0.03447298367818197, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.08904073397318522, "deviation-heading": 2.882425313896369, "set_robot_commands": 0.05303622166315714, "deviation-center-line": 0.96604815323461, "driven_lanedir_consec": 2.63299725932895, "sim_compute_sim_state": 0.022232662041982015, "sim_compute_performance-ego": 0.037365694046020505, "sim_compute_robot_state-ego": 0.038947932720184326}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0519681980333375, "sim_physics": 0.051524748989180025, "survival_time": 5.09999999999999, "driven_lanedir": 0.8605998438420881, "sim_render-ego": 0.03405342148799522, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.08735201405543908, "deviation-heading": 0.9685722599011006, "set_robot_commands": 0.05299365520477295, "deviation-center-line": 0.28541872789690104, "driven_lanedir_consec": 0.8605998438420881, "sim_compute_sim_state": 0.02203236374200559, "sim_compute_performance-ego": 0.03734406536700679, "sim_compute_robot_state-ego": 0.0388188362121582}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5226223945881474, "sim_physics": 0.05183861215235824, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5121632147374089, "sim_render-ego": 0.03468609664399745, "in-drivable-lane": 0, "agent_compute-ego": 0.08919285111508127, "deviation-heading": 0.532473905795214, "set_robot_commands": 0.05325655613915395, "deviation-center-line": 0.2521682471927583, "driven_lanedir_consec": 0.5121632147374089, "sim_compute_sim_state": 0.022109961105605303, "sim_compute_performance-ego": 0.03752381518735724, "sim_compute_robot_state-ego": 0.03885606992042671}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.039288601596238, "sim_physics": 0.05307088851928711, "survival_time": 14.950000000000076, "driven_lanedir": 2.5496624004354613, "sim_render-ego": 0.03525890270868937, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.08884122610092163, "deviation-heading": 3.5321897129885076, "set_robot_commands": 0.05295687039693197, "deviation-center-line": 0.8624159508297196, "driven_lanedir_consec": 2.5496624004354613, "sim_compute_sim_state": 0.022222790718078613, "sim_compute_performance-ego": 0.0374570631980896, "sim_compute_robot_state-ego": 0.03944264570871989}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.4187846489537748, "sim_physics": 0.05459138552347819, "survival_time": 14.950000000000076, "driven_lanedir": 3.3969117219190004, "sim_render-ego": 0.03451494773228963, "in-drivable-lane": 0, "agent_compute-ego": 0.08867581923802693, "deviation-heading": 1.1793906812742885, "set_robot_commands": 0.05402501424153646, "deviation-center-line": 0.5822249425777268, "driven_lanedir_consec": 3.3969117219190004, "sim_compute_sim_state": 0.022434488932291663, "sim_compute_performance-ego": 0.03770748376846313, "sim_compute_robot_state-ego": 0.03934996763865153}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.078927220818549, "sim_physics": 0.05625072161356608, "survival_time": 14.950000000000076, "driven_lanedir": 3.01373020033252, "sim_render-ego": 0.03504667758941651, "in-drivable-lane": 0, "agent_compute-ego": 0.08790260871251424, "deviation-heading": 2.4709786041640425, "set_robot_commands": 0.0530791179339091, "deviation-center-line": 0.8776002356461725, "driven_lanedir_consec": 3.01373020033252, "sim_compute_sim_state": 0.02237540006637573, "sim_compute_performance-ego": 0.0376964275042216, "sim_compute_robot_state-ego": 0.03934509515762329}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.1602316311148757, "sim_physics": 0.055069005377938816, "survival_time": 5.349999999999989, "driven_lanedir": 1.1453362061130212, "sim_render-ego": 0.03486166936214839, "in-drivable-lane": 0, "agent_compute-ego": 0.08778434156257416, "deviation-heading": 0.5693293093432096, "set_robot_commands": 0.0532786199979693, "deviation-center-line": 0.26555059887674487, "driven_lanedir_consec": 1.1453362061130212, "sim_compute_sim_state": 0.022305234570369543, "sim_compute_performance-ego": 0.03755007503188659, "sim_compute_robot_state-ego": 0.039797482089461565}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.957187632566628, "sim_physics": 0.051906917889912925, "survival_time": 14.950000000000076, "driven_lanedir": 2.90528284583484, "sim_render-ego": 0.03490777889887492, "in-drivable-lane": 0, "agent_compute-ego": 0.08713363726933797, "deviation-heading": 2.322879900412128, "set_robot_commands": 0.053425993919372555, "deviation-center-line": 0.9129473924329092, "driven_lanedir_consec": 2.90528284583484, "sim_compute_sim_state": 0.022054043610890705, "sim_compute_performance-ego": 0.037033216158548994, "sim_compute_robot_state-ego": 0.03944736957550049}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 3.4293368965433886, "sim_physics": 0.05074232498804728, "survival_time": 14.950000000000076, "driven_lanedir": 3.4118608491750515, "sim_render-ego": 0.0345007069905599, "in-drivable-lane": 0, "agent_compute-ego": 0.0878004542986552, "deviation-heading": 1.0885662180497788, "set_robot_commands": 0.053140186468760175, "deviation-center-line": 0.6791259902146699, "driven_lanedir_consec": 3.4118608491750515, "sim_compute_sim_state": 0.022075661023457847, "sim_compute_performance-ego": 0.03722399473190307, "sim_compute_robot_state-ego": 0.03920264482498169}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.400721417794826, "sim_physics": 0.052950107256571455, "survival_time": 14.950000000000076, "driven_lanedir": 3.3795960754943524, "sim_render-ego": 0.0345985730489095, "in-drivable-lane": 0, "agent_compute-ego": 0.08696888208389282, "deviation-heading": 1.213316226931295, "set_robot_commands": 0.05376579443613688, "deviation-center-line": 0.4211713968986284, "driven_lanedir_consec": 3.3795960754943524, "sim_compute_sim_state": 0.022167572180430094, "sim_compute_performance-ego": 0.037599688371022545, "sim_compute_robot_state-ego": 0.039213129679361976}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.353437797334876, "sim_physics": 0.05073422670364379, "survival_time": 14.950000000000076, "driven_lanedir": 3.3301555055499077, "sim_render-ego": 0.03442652940750122, "in-drivable-lane": 0, "agent_compute-ego": 0.08771221478780111, "deviation-heading": 1.27386210119867, "set_robot_commands": 0.05345907688140869, "deviation-center-line": 0.8226082960032028, "driven_lanedir_consec": 3.3301555055499077, "sim_compute_sim_state": 0.022046841780344644, "sim_compute_performance-ego": 0.03784714063008626, "sim_compute_robot_state-ego": 0.03907626152038574}}
set_robot_commands_max0.054505825837453205
set_robot_commands_mean0.05352100698809052
set_robot_commands_median0.053425993919372555
set_robot_commands_min0.05295687039693197
sim_compute_performance-ego_max0.03861915508906046
sim_compute_performance-ego_mean0.03760149633811156
sim_compute_performance-ego_median0.03755007503188659
sim_compute_performance-ego_min0.037033216158548994
sim_compute_robot_state-ego_max0.04090669552485148
sim_compute_robot_state-ego_mean0.03939098741440162
sim_compute_robot_state-ego_median0.03934509515762329
sim_compute_robot_state-ego_min0.0388188362121582
sim_compute_sim_state_max0.022434488932291663
sim_compute_sim_state_mean0.022196651155531245
sim_compute_sim_state_median0.022167572180430094
sim_compute_sim_state_min0.022031710942586265
sim_physics_max0.05640329758326213
sim_physics_mean0.0532689166909659
sim_physics_median0.05307088851928711
sim_physics_min0.05073422670364379
sim_render-ego_max0.03525890270868937
sim_render-ego_mean0.03473171703197839
sim_render-ego_median0.03479756514231364
sim_render-ego_min0.03405342148799522
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.853333333333392
survival_time_min2.9499999999999975
No reset possible
221703487Eric LuTesting the RL solutionaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-72270:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.15406086769215754
survival_time_median1.4000000000000006
deviation-center-line_median0.07567835315463775
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09857716730662756
agent_compute-ego_mean0.095300679264212
agent_compute-ego_median0.09501860618591308
agent_compute-ego_min0.09385873142041658
deviation-center-line_max0.09093183765921768
deviation-center-line_mean0.07706159479937813
deviation-center-line_min0.06408591093805481
deviation-heading_max0.8934033947346649
deviation-heading_mean0.7010445089151116
deviation-heading_median0.6913093832632645
deviation-heading_min0.47753072428537463
driven_any_max0.2577910224960791
driven_any_mean0.2124391994982866
driven_any_median0.21939902893158647
driven_any_min0.13242350921355336
driven_lanedir_consec_max0.19850328520171256
driven_lanedir_consec_mean0.1527359517940967
driven_lanedir_consec_min0.104105773320883
driven_lanedir_max0.19850328520171256
driven_lanedir_mean0.1527359517940967
driven_lanedir_median0.15406086769215754
driven_lanedir_min0.104105773320883
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21939902893158647, "sim_physics": 0.05819904804229736, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1334727831455078, "sim_render-ego": 0.03633081912994385, "in-drivable-lane": 0, "agent_compute-ego": 0.09857716730662756, "deviation-heading": 0.8934033947346649, "set_robot_commands": 0.05497370447431292, "deviation-center-line": 0.09093183765921768, "driven_lanedir_consec": 0.1334727831455078, "sim_compute_sim_state": 0.022636209215436662, "sim_compute_performance-ego": 0.0382084846496582, "sim_compute_robot_state-ego": 0.051823633057730537}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2577910224960791, "sim_physics": 0.05584673881530762, "survival_time": 1.5000000000000009, "driven_lanedir": 0.19850328520171256, "sim_render-ego": 0.034789538383483885, "in-drivable-lane": 0, "agent_compute-ego": 0.09386627674102783, "deviation-heading": 0.6913093832632645, "set_robot_commands": 0.054376649856567386, "deviation-center-line": 0.06408591093805481, "driven_lanedir_consec": 0.19850328520171256, "sim_compute_sim_state": 0.02270684242248535, "sim_compute_performance-ego": 0.037746485074361166, "sim_compute_robot_state-ego": 0.04008355140686035}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13242350921355336, "sim_physics": 0.05480975853769403, "survival_time": 0.9500000000000004, "driven_lanedir": 0.104105773320883, "sim_render-ego": 0.03398306746231882, "in-drivable-lane": 0, "agent_compute-ego": 0.09385873142041658, "deviation-heading": 0.47753072428537463, "set_robot_commands": 0.054158850720054226, "deviation-center-line": 0.08902021293785994, "driven_lanedir_consec": 0.104105773320883, "sim_compute_sim_state": 0.022619347823293584, "sim_compute_performance-ego": 0.03787240229154888, "sim_compute_robot_state-ego": 0.0398236073945698}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21822001671551208, "sim_physics": 0.058458471298217775, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15406086769215754, "sim_render-ego": 0.03552428245544434, "in-drivable-lane": 0, "agent_compute-ego": 0.09501860618591308, "deviation-heading": 0.7886616334486546, "set_robot_commands": 0.05438459396362304, "deviation-center-line": 0.07567835315463775, "driven_lanedir_consec": 0.15406086769215754, "sim_compute_sim_state": 0.02252902030944824, "sim_compute_performance-ego": 0.03798921585083008, "sim_compute_robot_state-ego": 0.04006982803344727}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.23436242013470188, "sim_physics": 0.05845681258610317, "survival_time": 1.4000000000000006, "driven_lanedir": 0.17353704961022265, "sim_render-ego": 0.03587390695299421, "in-drivable-lane": 0, "agent_compute-ego": 0.09518261466707502, "deviation-heading": 0.6543174088435997, "set_robot_commands": 0.05443922110966274, "deviation-center-line": 0.06559165930712046, "driven_lanedir_consec": 0.17353704961022265, "sim_compute_sim_state": 0.022644213267735074, "sim_compute_performance-ego": 0.03777470758983067, "sim_compute_robot_state-ego": 0.04002783979688372}}
set_robot_commands_max0.05497370447431292
set_robot_commands_mean0.054466604024844066
set_robot_commands_median0.05438459396362304
set_robot_commands_min0.054158850720054226
sim_compute_performance-ego_max0.0382084846496582
sim_compute_performance-ego_mean0.037918259091245805
sim_compute_performance-ego_median0.03787240229154888
sim_compute_performance-ego_min0.037746485074361166
sim_compute_robot_state-ego_max0.051823633057730537
sim_compute_robot_state-ego_mean0.04236569193789834
sim_compute_robot_state-ego_median0.04006982803344727
sim_compute_robot_state-ego_min0.0398236073945698
sim_compute_sim_state_max0.02270684242248535
sim_compute_sim_state_mean0.022627126607679782
sim_compute_sim_state_median0.022636209215436662
sim_compute_sim_state_min0.02252902030944824
sim_physics_max0.058458471298217775
sim_physics_mean0.05715416585592399
sim_physics_median0.05819904804229736
sim_physics_min0.05480975853769403
sim_render-ego_max0.03633081912994385
sim_render-ego_mean0.03530032287683702
sim_render-ego_median0.03552428245544434
sim_render-ego_min0.03398306746231882
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.3000000000000005
survival_time_min0.9500000000000004
No reset possible
221673483Liam PaullΒ πŸ‡¨πŸ‡¦duckietown lane following demoaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-72270:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0338600698580631
survival_time_median8.84999999999999
deviation-center-line_median0.5074367400044052
in-drivable-lane_median0.30000000000000027


other stats
agent_compute-ego_max0.06126838554570704
agent_compute-ego_mean0.0580386082305883
agent_compute-ego_median0.05684562927898877
agent_compute-ego_min0.055655168274701655
deviation-center-line_max0.9844921687103164
deviation-center-line_mean0.6124526507274068
deviation-center-line_min0.46487950417727913
deviation-heading_max6.465839742592235
deviation-heading_mean2.8924485240717135
deviation-heading_median2.5325739761076407
deviation-heading_min0.43305060702093273
driven_any_max2.341127147306713
driven_any_mean1.3043860048499156
driven_any_median1.3686237590979644
driven_any_min0.597274598407686
driven_lanedir_consec_max1.379139410654393
driven_lanedir_consec_mean0.902101795977708
driven_lanedir_consec_min0.29392206586718683
driven_lanedir_max1.7711706936283576
driven_lanedir_mean1.0977553492665273
driven_lanedir_median1.20985769469674
driven_lanedir_min0.5348792085409892
in-drivable-lane_max1.2999999999999998
in-drivable-lane_mean0.390000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.341127147306713, "sim_physics": 0.057035818099975585, "survival_time": 14.950000000000076, "driven_lanedir": 1.7711706936283576, "sim_render-ego": 0.03635806004206339, "in-drivable-lane": 1.2999999999999998, "agent_compute-ego": 0.05988845745722453, "deviation-heading": 6.465839742592235, "set_robot_commands": 0.05557692289352417, "deviation-center-line": 0.9844921687103164, "driven_lanedir_consec": 1.0338600698580631, "sim_compute_sim_state": 0.02334641933441162, "sim_compute_performance-ego": 0.03929970026016236, "sim_compute_robot_state-ego": 0.04148724714914958}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7658788572076881, "sim_physics": 0.060088576055040546, "survival_time": 5.09999999999999, "driven_lanedir": 0.5348792085409892, "sim_render-ego": 0.036357089584948966, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.05653540059631946, "deviation-heading": 2.753160874615225, "set_robot_commands": 0.05498574995527081, "deviation-center-line": 0.5074367400044052, "driven_lanedir_consec": 0.29392206586718683, "sim_compute_sim_state": 0.023606604220820407, "sim_compute_performance-ego": 0.03995493814056995, "sim_compute_robot_state-ego": 0.04172150527729707}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.597274598407686, "sim_physics": 0.05782257480385863, "survival_time": 4.049999999999994, "driven_lanedir": 0.593729738812157, "sim_render-ego": 0.036180349043857904, "in-drivable-lane": 0, "agent_compute-ego": 0.06126838554570704, "deviation-heading": 0.43305060702093273, "set_robot_commands": 0.05761123586584021, "deviation-center-line": 0.46487950417727913, "driven_lanedir_consec": 0.593729738812157, "sim_compute_sim_state": 0.023425991152539665, "sim_compute_performance-ego": 0.03902445899115668, "sim_compute_robot_state-ego": 0.04142064224054784}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3686237590979644, "sim_physics": 0.060612884618468206, "survival_time": 8.84999999999999, "driven_lanedir": 1.20985769469674, "sim_render-ego": 0.0362265527585132, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.055655168274701655, "deviation-heading": 2.5325739761076407, "set_robot_commands": 0.05483961644145729, "deviation-center-line": 0.6335674953319381, "driven_lanedir_consec": 1.20985769469674, "sim_compute_sim_state": 0.02324194019123659, "sim_compute_performance-ego": 0.039397282788982496, "sim_compute_robot_state-ego": 0.04124356124360683}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.449025662229527, "sim_physics": 0.05735156625349891, "survival_time": 9.349999999999998, "driven_lanedir": 1.379139410654393, "sim_render-ego": 0.03649078843427852, "in-drivable-lane": 0, "agent_compute-ego": 0.05684562927898877, "deviation-heading": 2.2776174200225356, "set_robot_commands": 0.0543315257618134, "deviation-center-line": 0.4718873454130955, "driven_lanedir_consec": 1.379139410654393, "sim_compute_sim_state": 0.023450794066974825, "sim_compute_performance-ego": 0.039290519959148874, "sim_compute_robot_state-ego": 0.04124309289901651}}
set_robot_commands_max0.05761123586584021
set_robot_commands_mean0.05546901018358118
set_robot_commands_median0.05498574995527081
set_robot_commands_min0.0543315257618134
sim_compute_performance-ego_max0.03995493814056995
sim_compute_performance-ego_mean0.03939338002800407
sim_compute_performance-ego_median0.03929970026016236
sim_compute_performance-ego_min0.03902445899115668
sim_compute_robot_state-ego_max0.04172150527729707
sim_compute_robot_state-ego_mean0.04142320976192356
sim_compute_robot_state-ego_median0.04142064224054784
sim_compute_robot_state-ego_min0.04124309289901651
sim_compute_sim_state_max0.023606604220820407
sim_compute_sim_state_mean0.023414349793196624
sim_compute_sim_state_median0.023425991152539665
sim_compute_sim_state_min0.02324194019123659
sim_physics_max0.060612884618468206
sim_physics_mean0.05858228396616838
sim_physics_median0.05782257480385863
sim_physics_min0.057035818099975585
sim_render-ego_max0.03649078843427852
sim_render-ego_mean0.0363225679727324
sim_render-ego_median0.036357089584948966
sim_render-ego_min0.036180349043857904
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.460000000000012
survival_time_min4.049999999999994
No reset possible