Duckietown Challenges Home Challenges Submissions

Evaluator 533

ID533
evaluatoridsc-rudolf-16007
ownerAndrea Censi ðŸ‡¨ðŸ‡­
machineidsc-rudolf
processidsc-rudolf-16007
versiond-c:4.0.7;d-c-r:4.0.9;d-s:4.0.10
first heard
last heard
statusinactive
# evaluating
# success9 17132
# timeout1 17122
# failed
# error3 17117
# aborted2 17130
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID
submission
user
user label
challenge
step
status
up to date
evaluator
date started
date completed
duration
message
171912249Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-160070:30:42
Timeout: Waited 180 [...]
Timeout:

Waited 1803.8632202148438 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171822268Andrea Censi ðŸ‡¨ðŸ‡­Solution templateaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16108847536691806
agent_compute-ego_mean0.15509333335874015
agent_compute-ego_median0.15342528100997682
agent_compute-ego_min0.15175401463228114
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003429139361662023, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06851464509963989, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15175401463228114, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07769021567176371, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04264951804104973, "sim_compute_performance-ego": 0.06609624974867877, "sim_compute_robot_state-ego": 0.2600628838819616}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0034828905075315443, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06795952055189344, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15342528100997682, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07755487684219603, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04250099545433408, "sim_compute_performance-ego": 0.0674661568232945, "sim_compute_robot_state-ego": 0.07815198671250116}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0033277694995586687, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.06845196577218862, "in-drivable-lane": 0, "agent_compute-ego": 0.1533436811887301, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07707828008211576, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04206275939941406, "sim_compute_performance-ego": 0.0697629268352802, "sim_compute_robot_state-ego": 0.07713129703815166}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003434562101596739, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07356678567281584, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16108847536691806, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08101688943258147, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04586935915598055, "sim_compute_performance-ego": 0.0715453333970977, "sim_compute_robot_state-ego": 0.08312342515805872}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003559410572052002, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.0700726866722107, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15585521459579468, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07897107362747192, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.042718968391418456, "sim_compute_performance-ego": 0.0692133903503418, "sim_compute_robot_state-ego": 0.07819197416305541}}
set_robot_commands_max0.08101688943258147
set_robot_commands_mean0.07846226713122577
set_robot_commands_median0.07769021567176371
set_robot_commands_min0.07707828008211576
sim_compute_performance-ego_max0.0715453333970977
sim_compute_performance-ego_mean0.06881681143093858
sim_compute_performance-ego_median0.0692133903503418
sim_compute_performance-ego_min0.06609624974867877
sim_compute_robot_state-ego_max0.2600628838819616
sim_compute_robot_state-ego_mean0.11533231339074572
sim_compute_robot_state-ego_median0.07819197416305541
sim_compute_robot_state-ego_min0.07713129703815166
sim_compute_sim_state_max0.04586935915598055
sim_compute_sim_state_mean0.043160320088439376
sim_compute_sim_state_median0.04264951804104973
sim_compute_sim_state_min0.04206275939941406
sim_physics_max0.003559410572052002
sim_physics_mean0.003446754408480195
sim_physics_median0.003434562101596739
sim_physics_min0.0033277694995586687
sim_render-ego_max0.07356678567281584
sim_render-ego_mean0.06971312075374969
sim_render-ego_median0.06851464509963989
sim_render-ego_min0.06795952055189344
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171772284Andrea Censi ðŸ‡¨ðŸ‡­Minimal agentaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:07:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.15913260533259466
agent_compute-ego_mean0.15569208393782005
agent_compute-ego_median0.15643042471350693
agent_compute-ego_min0.15132664498828707
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003433799042421229, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06940605009303373, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15834098353105433, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0814790971138898, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04298544981900383, "sim_compute_performance-ego": 0.06631247436299044, "sim_compute_robot_state-ego": 0.2521142118117389}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003285192307971773, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06565011115301222, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15132664498828707, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07606286472744411, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.041499205998012, "sim_compute_performance-ego": 0.06480374790373303, "sim_compute_robot_state-ego": 0.07260822492932516}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.003568139443030724, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07418900636526254, "in-drivable-lane": 0, "agent_compute-ego": 0.15913260533259466, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.08110811160160945, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04380179918729342, "sim_compute_performance-ego": 0.0687865477341872, "sim_compute_robot_state-ego": 0.07659764656653771}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0036881086302966606, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.0709665315907176, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15643042471350693, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08031365348071587, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04282454165016732, "sim_compute_performance-ego": 0.06807525855738943, "sim_compute_robot_state-ego": 0.07842346517051138}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003412315845489502, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07057632923126221, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15322976112365722, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07995773315429687, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04266624450683594, "sim_compute_performance-ego": 0.06921570062637329, "sim_compute_robot_state-ego": 0.08028152942657471}}
set_robot_commands_max0.0814790971138898
set_robot_commands_mean0.07978429201559123
set_robot_commands_median0.08031365348071587
set_robot_commands_min0.07606286472744411
sim_compute_performance-ego_max0.06921570062637329
sim_compute_performance-ego_mean0.06743874583693468
sim_compute_performance-ego_median0.06807525855738943
sim_compute_performance-ego_min0.06480374790373303
sim_compute_robot_state-ego_max0.2521142118117389
sim_compute_robot_state-ego_mean0.1120050155809376
sim_compute_robot_state-ego_median0.07842346517051138
sim_compute_robot_state-ego_min0.07260822492932516
sim_compute_sim_state_max0.04380179918729342
sim_compute_sim_state_mean0.0427554482322625
sim_compute_sim_state_median0.04282454165016732
sim_compute_sim_state_min0.041499205998012
sim_physics_max0.0036881086302966606
sim_physics_mean0.0034775110538419777
sim_physics_median0.003433799042421229
sim_physics_min0.003285192307971773
sim_render-ego_max0.07418900636526254
sim_render-ego_mean0.07015760568665766
sim_render-ego_median0.07057632923126221
sim_render-ego_min0.06565011115301222
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171712292Andrea Censi ðŸ‡¨ðŸ‡­Minimal agentaido2_LFV_r1-v4step1-simulationsuccessyesidsc-rudolf-160070:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16219229936599733
agent_compute-ego_mean0.15709887293447158
agent_compute-ego_median0.1566106488065022
agent_compute-ego_min0.15382283831399585
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003168337485369514, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06462046328712912, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1576474203782923, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07788444967830882, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.035524270113776714, "sim_compute_performance-ego": 0.0663227263618918, "sim_compute_robot_state-ego": 0.25029505000394936, "sim_compute_robot_state-npc0": 0.07438960496117086, "sim_compute_robot_state-npc1": 0.06502378688139074, "sim_compute_robot_state-npc2": 0.06202858686447144, "sim_compute_robot_state-npc3": 0.06226427414838005}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0029837668888152593, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.05923895987253341, "in-drivable-lane": 0, "agent_compute-ego": 0.15382283831399585, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07690285501025972, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.03267625021556067, "sim_compute_performance-ego": 0.06076933467198932, "sim_compute_robot_state-ego": 0.08326420329865955, "sim_compute_robot_state-npc0": 0.0704485537513854, "sim_compute_robot_state-npc1": 0.06285760137769911, "sim_compute_robot_state-npc2": 0.06094706247723291, "sim_compute_robot_state-npc3": 0.06149163700285412}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0033528731419489935, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.06630455530606784, "in-drivable-lane": 0, "agent_compute-ego": 0.15522115780757023, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07892052210294283, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.03655743598937988, "sim_compute_performance-ego": 0.06467201893146221, "sim_compute_robot_state-ego": 0.08356267122121958, "sim_compute_robot_state-npc0": 0.07491640677818885, "sim_compute_robot_state-npc1": 0.06748357919546275, "sim_compute_robot_state-npc2": 0.06486655748807467, "sim_compute_robot_state-npc3": 0.06715299166165865}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0034425840145204125, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06748217198906875, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1566106488065022, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07900761976474668, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.03702897560305712, "sim_compute_performance-ego": 0.06870224999218452, "sim_compute_robot_state-ego": 0.08713188113235845, "sim_compute_robot_state-npc0": 0.07731713608997624, "sim_compute_robot_state-npc1": 0.07051027693399568, "sim_compute_robot_state-npc2": 0.06817323987076922, "sim_compute_robot_state-npc3": 0.06818301794005603}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0035498881340026854, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.06922850370407105, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.16219229936599733, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07955130338668823, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.038852415084838866, "sim_compute_performance-ego": 0.06808069705963135, "sim_compute_robot_state-ego": 0.08547727584838867, "sim_compute_robot_state-npc0": 0.07668142557144166, "sim_compute_robot_state-npc1": 0.07175606489181519, "sim_compute_robot_state-npc2": 0.06989626169204712, "sim_compute_robot_state-npc3": 0.07080627918243408}}
set_robot_commands_max0.07955130338668823
set_robot_commands_mean0.07845334998858926
set_robot_commands_median0.07892052210294283
set_robot_commands_min0.07690285501025972
sim_compute_performance-ego_max0.06870224999218452
sim_compute_performance-ego_mean0.06570940540343184
sim_compute_performance-ego_median0.0663227263618918
sim_compute_performance-ego_min0.06076933467198932
sim_compute_robot_state-ego_max0.25029505000394936
sim_compute_robot_state-ego_mean0.11794621630091512
sim_compute_robot_state-ego_median0.08547727584838867
sim_compute_robot_state-ego_min0.08326420329865955
sim_compute_robot_state-npc0_max0.07731713608997624
sim_compute_robot_state-npc0_mean0.07475062543043261
sim_compute_robot_state-npc0_median0.07491640677818885
sim_compute_robot_state-npc0_min0.0704485537513854
sim_compute_robot_state-npc1_max0.07175606489181519
sim_compute_robot_state-npc1_mean0.06752626185607269
sim_compute_robot_state-npc1_median0.06748357919546275
sim_compute_robot_state-npc1_min0.06285760137769911
sim_compute_robot_state-npc2_max0.06989626169204712
sim_compute_robot_state-npc2_mean0.06518234167851908
sim_compute_robot_state-npc2_median0.06486655748807467
sim_compute_robot_state-npc2_min0.06094706247723291
sim_compute_robot_state-npc3_max0.07080627918243408
sim_compute_robot_state-npc3_mean0.0659796399870766
sim_compute_robot_state-npc3_median0.06715299166165865
sim_compute_robot_state-npc3_min0.06149163700285412
sim_compute_sim_state_max0.038852415084838866
sim_compute_sim_state_mean0.03612786940132265
sim_compute_sim_state_median0.03655743598937988
sim_compute_sim_state_min0.03267625021556067
sim_physics_max0.0035498881340026854
sim_physics_mean0.003299489932931373
sim_physics_median0.0033528731419489935
sim_physics_min0.0029837668888152593
sim_render-ego_max0.06922850370407105
sim_render-ego_mean0.06537493083177404
sim_render-ego_median0.06630455530606784
sim_render-ego_min0.05923895987253341
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171622313FANG MEIYI ðŸ‡¸ðŸ‡¬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-160070:30:40
Timeout: Waited 180 [...]
Timeout:

Waited 1800.7076151371002 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171582318FANG MEIYI ðŸ‡¸ðŸ‡¬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.319514778943256
survival_time_median3.399999999999996
deviation-center-line_median0.14321219721956907
in-drivable-lane_median2.0499999999999967


other stats
agent_compute-ego_max0.16174074481515324
agent_compute-ego_mean0.15159503423164716
agent_compute-ego_median0.14950578808784484
agent_compute-ego_min0.14678519422357733
deviation-center-line_max0.21768105498084453
deviation-center-line_mean0.12271561500230632
deviation-center-line_min0.027720906512798266
deviation-heading_max3.655032594749009
deviation-heading_mean1.6074827418142192
deviation-heading_median1.266099663893892
deviation-heading_min0.4886362551025064
driven_any_max2.4910168350063504
driven_any_mean1.309921017625998
driven_any_median1.3062827501309398
driven_any_min0.43303832405777215
driven_lanedir_consec_max0.703692114523236
driven_lanedir_consec_mean0.3340026075124708
driven_lanedir_consec_min0.07680271452255027
driven_lanedir_max0.703692114523236
driven_lanedir_mean0.33758711178837875
driven_lanedir_median0.319514778943256
driven_lanedir_min0.09472523590209024
in-drivable-lane_max4.349999999999996
in-drivable-lane_mean1.9999999999999984
in-drivable-lane_min0.40000000000000013
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3062827501309398, "sim_physics": 0.0030599411796121035, "survival_time": 3.399999999999996, "driven_lanedir": 0.09472523590209024, "sim_render-ego": 0.06820242895799525, "in-drivable-lane": 2.1499999999999977, "agent_compute-ego": 0.16174074481515324, "deviation-heading": 1.0178378189114463, "set_robot_commands": 0.08161951864466947, "deviation-center-line": 0.14321219721956907, "driven_lanedir_consec": 0.07680271452255027, "sim_compute_sim_state": 0.04377225216697244, "sim_compute_performance-ego": 0.06947987219866585, "sim_compute_robot_state-ego": 0.30516089060727286}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5487627104102557, "sim_physics": 0.0033202916383743286, "survival_time": 3.999999999999994, "driven_lanedir": 0.4280473165409451, "sim_render-ego": 0.06689688265323639, "in-drivable-lane": 2.0499999999999967, "agent_compute-ego": 0.14950578808784484, "deviation-heading": 1.6098073764142418, "set_robot_commands": 0.0764259159564972, "deviation-center-line": 0.14839142624591525, "driven_lanedir_consec": 0.4280473165409451, "sim_compute_sim_state": 0.04381081759929657, "sim_compute_performance-ego": 0.0674383670091629, "sim_compute_robot_state-ego": 0.07735752761363983}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7705044685246707, "sim_physics": 0.002904794045857021, "survival_time": 2.799999999999998, "driven_lanedir": 0.319514778943256, "sim_render-ego": 0.06046055470194135, "in-drivable-lane": 1.05, "agent_compute-ego": 0.15057029468672617, "deviation-heading": 1.266099663893892, "set_robot_commands": 0.0806111650807517, "deviation-center-line": 0.07657249005240453, "driven_lanedir_consec": 0.319514778943256, "sim_compute_sim_state": 0.04090938823563712, "sim_compute_performance-ego": 0.0631860111440931, "sim_compute_robot_state-ego": 0.07660846625055585}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4910168350063504, "sim_physics": 0.0029373498252742197, "survival_time": 9.049999999999994, "driven_lanedir": 0.703692114523236, "sim_render-ego": 0.062378078534458224, "in-drivable-lane": 4.349999999999996, "agent_compute-ego": 0.1493731493449343, "deviation-heading": 3.655032594749009, "set_robot_commands": 0.07809541370328618, "deviation-center-line": 0.21768105498084453, "driven_lanedir_consec": 0.703692114523236, "sim_compute_sim_state": 0.04142575764524344, "sim_compute_performance-ego": 0.061617026671520254, "sim_compute_robot_state-ego": 0.0732912016178363}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.43303832405777215, "sim_physics": 0.00268521092154763, "survival_time": 1.1000000000000003, "driven_lanedir": 0.14195611303236655, "sim_render-ego": 0.06052477793260054, "in-drivable-lane": 0.40000000000000013, "agent_compute-ego": 0.14678519422357733, "deviation-heading": 0.4886362551025064, "set_robot_commands": 0.08250635320490057, "deviation-center-line": 0.027720906512798266, "driven_lanedir_consec": 0.14195611303236655, "sim_compute_sim_state": 0.041995026848532936, "sim_compute_performance-ego": 0.0628415888006037, "sim_compute_robot_state-ego": 0.0757414536042647}}
set_robot_commands_max0.08250635320490057
set_robot_commands_mean0.07985167331802102
set_robot_commands_median0.0806111650807517
set_robot_commands_min0.0764259159564972
sim_compute_performance-ego_max0.06947987219866585
sim_compute_performance-ego_mean0.06491257316480917
sim_compute_performance-ego_median0.0631860111440931
sim_compute_performance-ego_min0.061617026671520254
sim_compute_robot_state-ego_max0.30516089060727286
sim_compute_robot_state-ego_mean0.1216319079387139
sim_compute_robot_state-ego_median0.07660846625055585
sim_compute_robot_state-ego_min0.0732912016178363
sim_compute_sim_state_max0.04381081759929657
sim_compute_sim_state_mean0.0423826484991365
sim_compute_sim_state_median0.041995026848532936
sim_compute_sim_state_min0.04090938823563712
sim_physics_max0.0033202916383743286
sim_physics_mean0.0029815175221330607
sim_physics_median0.0029373498252742197
sim_physics_min0.00268521092154763
sim_render-ego_max0.06820242895799525
sim_render-ego_mean0.06369254455604634
sim_render-ego_median0.062378078534458224
sim_render-ego_min0.06046055470194135
simulation-passed1
survival_time_max9.049999999999994
survival_time_mean4.069999999999997
survival_time_min1.1000000000000003
No reset possible
171542327Konstantin ChaikaMinimal agentaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16690572859748962
agent_compute-ego_mean0.1597727029995556
agent_compute-ego_median0.15857300525758325
agent_compute-ego_min0.15634998908409706
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0032445227398591884, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.0712538151180043, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.159215790383956, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.08327805995941162, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04423305918188656, "sim_compute_performance-ego": 0.06977247490602381, "sim_compute_robot_state-ego": 0.26530837311464195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0035361221858433317, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07259529355972533, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.16690572859748962, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07929691057356578, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.044052914967612614, "sim_compute_performance-ego": 0.0708230904170445, "sim_compute_robot_state-ego": 0.08186030009436229}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0036014740283672624, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07218944476200984, "in-drivable-lane": 0, "agent_compute-ego": 0.15634998908409706, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07829890984755296, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04357173993037297, "sim_compute_performance-ego": 0.07313368137066181, "sim_compute_robot_state-ego": 0.08045861904437725}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.00351679034349395, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07279230036386629, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15857300525758325, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07907071636944282, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.043940227206160386, "sim_compute_performance-ego": 0.07151447563636594, "sim_compute_robot_state-ego": 0.0811015512885117}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0035137009620666505, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07003946542739868, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1578190016746521, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07729371309280396, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04180469751358032, "sim_compute_performance-ego": 0.06830455541610718, "sim_compute_robot_state-ego": 0.0778219199180603}}
set_robot_commands_max0.08327805995941162
set_robot_commands_mean0.07944766196855543
set_robot_commands_median0.07907071636944282
set_robot_commands_min0.07729371309280396
sim_compute_performance-ego_max0.07313368137066181
sim_compute_performance-ego_mean0.07070965554924066
sim_compute_performance-ego_median0.0708230904170445
sim_compute_performance-ego_min0.06830455541610718
sim_compute_robot_state-ego_max0.26530837311464195
sim_compute_robot_state-ego_mean0.1173101526919907
sim_compute_robot_state-ego_median0.0811015512885117
sim_compute_robot_state-ego_min0.0778219199180603
sim_compute_sim_state_max0.04423305918188656
sim_compute_sim_state_mean0.04352052775992257
sim_compute_sim_state_median0.043940227206160386
sim_compute_sim_state_min0.04180469751358032
sim_physics_max0.0036014740283672624
sim_physics_mean0.0034825220519260763
sim_physics_median0.00351679034349395
sim_physics_min0.0032445227398591884
sim_render-ego_max0.07279230036386629
sim_render-ego_mean0.07177406384620089
sim_render-ego_median0.07218944476200984
sim_render-ego_min0.07003946542739868
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171462333Bhairav MehtaBaseline solution using reinforcement learningaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:22:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.6760228236109347
survival_time_median14.950000000000076
deviation-center-line_median0.2349287147361276
in-drivable-lane_median7.500000000000039


other stats
agent_compute-ego_max0.17000613689422608
agent_compute-ego_mean0.1665477754275004
agent_compute-ego_median0.16734947681427
agent_compute-ego_min0.16361301501592002
deviation-center-line_max0.2349306604543784
deviation-center-line_mean0.2349290643247573
deviation-center-line_min0.23492851696102396
deviation-heading_max5.833940015674341
deviation-heading_mean5.83394001567434
deviation-heading_median5.83394001567434
deviation-heading_min5.83394001567434
driven_any_max8.841232955081617
driven_any_mean8.841232955081612
driven_any_median8.84123295508161
driven_any_min8.841232955081608
driven_lanedir_consec_max-2.67601614789072
driven_lanedir_consec_mean-2.6760240395458146
driven_lanedir_consec_min-2.676035221377435
driven_lanedir_max-2.67601614789072
driven_lanedir_mean-2.6760240395458146
driven_lanedir_median-2.6760228236109347
driven_lanedir_min-2.676035221377435
in-drivable-lane_max7.500000000000039
in-drivable-lane_mean7.50000000000004
in-drivable-lane_min7.500000000000039
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 8.841232955081617, "sim_physics": 0.003185315132141114, "survival_time": 14.950000000000076, "driven_lanedir": -2.6760228236109347, "sim_render-ego": 0.06328420718510945, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.16418031533559163, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.07653710206349691, "deviation-center-line": 0.2349287147361289, "driven_lanedir_consec": -2.6760228236109347, "sim_compute_sim_state": 0.04354617436726888, "sim_compute_performance-ego": 0.06563482284545899, "sim_compute_robot_state-ego": 0.12136285781860352}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 8.84123295508161, "sim_physics": 0.0030370791753133136, "survival_time": 14.950000000000076, "driven_lanedir": -2.676029856959261, "sim_render-ego": 0.06667255798975627, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.1675899330774943, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.07860051949818929, "deviation-center-line": 0.2349306604543784, "driven_lanedir_consec": -2.676029856959261, "sim_compute_sim_state": 0.043842872778574626, "sim_compute_performance-ego": 0.0668258015314738, "sim_compute_robot_state-ego": 0.07824211359024048}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 8.841232955081612, "sim_physics": 0.002865112622578939, "survival_time": 14.950000000000076, "driven_lanedir": -2.676035221377435, "sim_render-ego": 0.06609967390696207, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.16361301501592002, "deviation-heading": 5.833940015674341, "set_robot_commands": 0.07766127983729045, "deviation-center-line": 0.23492851696102396, "driven_lanedir_consec": -2.676035221377435, "sim_compute_sim_state": 0.04272719621658325, "sim_compute_performance-ego": 0.06506348927815755, "sim_compute_robot_state-ego": 0.0777858837445577}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 8.841232955081608, "sim_physics": 0.0032431705792744956, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.06753344297409057, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.16734947681427, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.08005588293075562, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.0428636376063029, "sim_compute_performance-ego": 0.0674896264076233, "sim_compute_robot_state-ego": 0.07712311267852784}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 8.841232955081608, "sim_physics": 0.0034549053510030112, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.06785641113917033, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17000613689422608, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.07761965036392211, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.04425624450047811, "sim_compute_performance-ego": 0.06842396338780721, "sim_compute_robot_state-ego": 0.07871404727300008}}
set_robot_commands_max0.08005588293075562
set_robot_commands_mean0.07809488693873087
set_robot_commands_median0.07766127983729045
set_robot_commands_min0.07653710206349691
sim_compute_performance-ego_max0.06842396338780721
sim_compute_performance-ego_mean0.06668754069010416
sim_compute_performance-ego_median0.0668258015314738
sim_compute_performance-ego_min0.06506348927815755
sim_compute_robot_state-ego_max0.12136285781860352
sim_compute_robot_state-ego_mean0.08664560302098592
sim_compute_robot_state-ego_median0.07824211359024048
sim_compute_robot_state-ego_min0.07712311267852784
sim_compute_sim_state_max0.04425624450047811
sim_compute_sim_state_mean0.04344722509384155
sim_compute_sim_state_median0.04354617436726888
sim_compute_sim_state_min0.04272719621658325
sim_physics_max0.0034549053510030112
sim_physics_mean0.0031571165720621747
sim_physics_median0.003185315132141114
sim_physics_min0.002865112622578939
sim_render-ego_max0.06785641113917033
sim_render-ego_mean0.06628925863901775
sim_render-ego_median0.06667255798975627
sim_render-ego_min0.06328420718510945
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
171392333Bhairav MehtaBaseline solution using reinforcement learningaido2_LF_r2-v4step1-simulationsuccessnoidsc-rudolf-160070:22:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.6760228236109347
survival_time_median14.950000000000076
deviation-center-line_median0.2349287147361276
in-drivable-lane_median7.500000000000039


other stats
agent_compute-ego_max0.17536739905675253
agent_compute-ego_mean0.1731416303316752
agent_compute-ego_median0.17318819681803385
agent_compute-ego_min0.17018280188242593
deviation-center-line_max0.2349306604543784
deviation-center-line_mean0.2349290643247573
deviation-center-line_min0.23492851696102396
deviation-heading_max5.833940015674341
deviation-heading_mean5.83394001567434
deviation-heading_median5.83394001567434
deviation-heading_min5.83394001567434
driven_any_max8.841232955081617
driven_any_mean8.841232955081612
driven_any_median8.84123295508161
driven_any_min8.841232955081608
driven_lanedir_consec_max-2.67601614789072
driven_lanedir_consec_mean-2.6760240395458146
driven_lanedir_consec_min-2.676035221377435
driven_lanedir_max-2.67601614789072
driven_lanedir_mean-2.6760240395458146
driven_lanedir_median-2.6760228236109347
driven_lanedir_min-2.676035221377435
in-drivable-lane_max7.500000000000039
in-drivable-lane_mean7.50000000000004
in-drivable-lane_min7.500000000000039
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 8.841232955081617, "sim_physics": 0.003734909693400065, "survival_time": 14.950000000000076, "driven_lanedir": -2.6760228236109347, "sim_render-ego": 0.075882834593455, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17225707769393922, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.08072811603546143, "deviation-center-line": 0.2349287147361289, "driven_lanedir_consec": -2.6760228236109347, "sim_compute_sim_state": 0.04602961540222168, "sim_compute_performance-ego": 0.07329297383626301, "sim_compute_robot_state-ego": 0.11741482814153036}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 8.84123295508161, "sim_physics": 0.0037738180160522463, "survival_time": 14.950000000000076, "driven_lanedir": -2.676029856959261, "sim_render-ego": 0.07598739862442017, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17318819681803385, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.08102426767349243, "deviation-center-line": 0.2349306604543784, "driven_lanedir_consec": -2.676029856959261, "sim_compute_sim_state": 0.04610706726710002, "sim_compute_performance-ego": 0.07268331289291381, "sim_compute_robot_state-ego": 0.08119651556015015}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 8.841232955081612, "sim_physics": 0.0031742215156555175, "survival_time": 14.950000000000076, "driven_lanedir": -2.676035221377435, "sim_render-ego": 0.06746062676111857, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17536739905675253, "deviation-heading": 5.833940015674341, "set_robot_commands": 0.08200763543446858, "deviation-center-line": 0.23492851696102396, "driven_lanedir_consec": -2.676035221377435, "sim_compute_sim_state": 0.045781927903493246, "sim_compute_performance-ego": 0.06904930194218953, "sim_compute_robot_state-ego": 0.0820286758740743}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 8.841232955081608, "sim_physics": 0.0032025790214538575, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.06980853954950969, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17471267620722453, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.08326441526412964, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.04643571138381958, "sim_compute_performance-ego": 0.0694140632947286, "sim_compute_robot_state-ego": 0.08265830834706624}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 8.841232955081608, "sim_physics": 0.003114305337270101, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.06874533891677856, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17018280188242593, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.081183180809021, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.045883890787760416, "sim_compute_performance-ego": 0.06827832778294882, "sim_compute_robot_state-ego": 0.08087632179260254}}
set_robot_commands_max0.08326441526412964
set_robot_commands_mean0.08164152304331461
set_robot_commands_median0.081183180809021
set_robot_commands_min0.08072811603546143
sim_compute_performance-ego_max0.07329297383626301
sim_compute_performance-ego_mean0.07054359594980877
sim_compute_performance-ego_median0.0694140632947286
sim_compute_performance-ego_min0.06827832778294882
sim_compute_robot_state-ego_max0.11741482814153036
sim_compute_robot_state-ego_mean0.0888349299430847
sim_compute_robot_state-ego_median0.0820286758740743
sim_compute_robot_state-ego_min0.08087632179260254
sim_compute_sim_state_max0.04643571138381958
sim_compute_sim_state_mean0.04604764254887899
sim_compute_sim_state_median0.04602961540222168
sim_compute_sim_state_min0.045781927903493246
sim_physics_max0.0037738180160522463
sim_physics_mean0.0033999667167663576
sim_physics_median0.0032025790214538575
sim_physics_min0.003114305337270101
sim_render-ego_max0.07598739862442017
sim_render-ego_mean0.0715769476890564
sim_render-ego_median0.06980853954950969
sim_render-ego_min0.06746062676111857
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
171382321Egor ZamotaevPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-160070:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11367620719230018
error_L20.020246837187118595


No reset possible
171362323Bhairav MehtaBaseline solution using reinforcement learningaido2_LF_r2-v4step1-simulationabortednoidsc-rudolf-160070:03:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171322329Konstantin ChaikaMinimal agentaido2_LFVI_r1-v4step1-simulationsuccessnoidsc-rudolf-160070:14:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.1665033535523848
agent_compute-ego_mean0.16487815267849878
agent_compute-ego_median0.16584294543546788
agent_compute-ego_min0.1618356425711449
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.003605826147671404, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.07559756903812803, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.16413869364508268, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.079157253791546, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.042374926599962955, "sim_compute_performance-ego": 0.07325494536038103, "sim_compute_robot_state-ego": 0.1630914359257139, "sim_compute_robot_state-npc0": 0.07954247244473162, "sim_compute_robot_state-npc1": 0.07581493772309401, "sim_compute_robot_state-npc2": 0.07466525538214322, "sim_compute_robot_state-npc3": 0.07477167228172565}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.003639766664216013, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.0742736765832612, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1665033535523848, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.08061502196572044, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.04228951714255593, "sim_compute_performance-ego": 0.07355305281552402, "sim_compute_robot_state-ego": 0.09410521117123692, "sim_compute_robot_state-npc0": 0.08063047221212676, "sim_compute_robot_state-npc1": 0.07594927874478427, "sim_compute_robot_state-npc2": 0.07496049548640396, "sim_compute_robot_state-npc3": 0.07759987585472339}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.0035622094539885826, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.07402402289370273, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.1618356425711449, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.07901641409447853, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.04207040147578463, "sim_compute_performance-ego": 0.0717377079294083, "sim_compute_robot_state-ego": 0.08919171323167517, "sim_compute_robot_state-npc0": 0.07778383315877711, "sim_compute_robot_state-npc1": 0.07560805056957488, "sim_compute_robot_state-npc2": 0.07453335853333169, "sim_compute_robot_state-npc3": 0.07425592808013266}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.0035296916961669923, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.074885014926686, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.16584294543546788, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.07811175795162426, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.042312055475571576, "sim_compute_performance-ego": 0.07218670564539292, "sim_compute_robot_state-ego": 0.08930023417753331, "sim_compute_robot_state-npc0": 0.07783231454737047, "sim_compute_robot_state-npc1": 0.07387948877671185, "sim_compute_robot_state-npc2": 0.07329613180721507, "sim_compute_robot_state-npc3": 0.07346375970279469}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.003635981503654929, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.07853906996109906, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.16607012818841374, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.08042366013807409, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.042848324074464685, "sim_compute_performance-ego": 0.07263997372458963, "sim_compute_robot_state-ego": 0.08722982687108657, "sim_compute_robot_state-npc0": 0.08014310808742747, "sim_compute_robot_state-npc1": 0.07660154735340792, "sim_compute_robot_state-npc2": 0.075010944815243, "sim_compute_robot_state-npc3": 0.07508752626531265}}
set_robot_commands_max0.08061502196572044
set_robot_commands_mean0.07946482158828867
set_robot_commands_median0.079157253791546
set_robot_commands_min0.07811175795162426
sim_compute_performance-ego_max0.07355305281552402
sim_compute_performance-ego_mean0.07267447709505918
sim_compute_performance-ego_median0.07263997372458963
sim_compute_performance-ego_min0.0717377079294083
sim_compute_robot_state-ego_max0.1630914359257139
sim_compute_robot_state-ego_mean0.10458368427544916
sim_compute_robot_state-ego_median0.08930023417753331
sim_compute_robot_state-ego_min0.08722982687108657
sim_compute_robot_state-npc0_max0.08063047221212676
sim_compute_robot_state-npc0_mean0.0791864400900867
sim_compute_robot_state-npc0_median0.07954247244473162
sim_compute_robot_state-npc0_min0.07778383315877711
sim_compute_robot_state-npc1_max0.07660154735340792
sim_compute_robot_state-npc1_mean0.07557066063351459
sim_compute_robot_state-npc1_median0.07581493772309401
sim_compute_robot_state-npc1_min0.07387948877671185
sim_compute_robot_state-npc2_max0.075010944815243
sim_compute_robot_state-npc2_mean0.07449323720486739
sim_compute_robot_state-npc2_median0.07466525538214322
sim_compute_robot_state-npc2_min0.07329613180721507
sim_compute_robot_state-npc3_max0.07759987585472339
sim_compute_robot_state-npc3_mean0.0750357524369378
sim_compute_robot_state-npc3_median0.07477167228172565
sim_compute_robot_state-npc3_min0.07346375970279469
sim_compute_sim_state_max0.042848324074464685
sim_compute_sim_state_mean0.042379044953667955
sim_compute_sim_state_median0.042312055475571576
sim_compute_sim_state_min0.04207040147578463
sim_physics_max0.003639766664216013
sim_physics_mean0.003594695093139584
sim_physics_median0.003605826147671404
sim_physics_min0.0035296916961669923
sim_render-ego_max0.07853906996109906
sim_render-ego_mean0.0754638706805754
sim_render-ego_median0.074885014926686
sim_render-ego_min0.07402402289370273
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
171302324Nikhil Khedekar ðŸ‡®ðŸ‡³PredictorLastaido2-PREDstep1-simulationabortednoidsc-rudolf-160070:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11862072964919444
error_L20.02167979792340312


No reset possible
171222327Konstantin ChaikaMinimal agentaido2_LF_r2-v4step1-simulationtimeoutnoidsc-rudolf-16007----No reset possible
171172319FANG MEIYI ðŸ‡¸ðŸ‡¬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:05:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible