Duckietown Challenges Home Challenges Submissions

Evaluator 599

ID599
evaluatoridsc-rudolf-6108
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-6108
versiond-c:4.0.12;d-c-r:4.0.15;d-s:4.0.13
first heard
last heard
statusinactive
# evaluating
# success6 17532
# timeout
# failed
# error4 17498
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
175802369Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-61080:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1499317827678862
agent_compute-ego_mean0.1466767935909792
agent_compute-ego_median0.14793691158294678
agent_compute-ego_min0.13981029215980978
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.013890417183146757, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.05743241310119629, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.13981029215980978, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07861134935827817, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.03758740425109863, "sim_compute_performance-ego": 0.06114279522615321, "sim_compute_robot_state-ego": 0.0614580371800591}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.013375248227800642, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06527983574640184, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.1499317827678862, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.0833270511929951, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04007209293426029, "sim_compute_performance-ego": 0.06558212779817127, "sim_compute_robot_state-ego": 0.06465275703914582}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.01329814470731295, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.06723977602445162, "in-drivable-lane": 0, "agent_compute-ego": 0.1477310950939472, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07589558087862455, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.03906040925246019, "sim_compute_performance-ego": 0.06309103965759277, "sim_compute_robot_state-ego": 0.06772455068734975}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.01450698840908888, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.0650315720860551, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14797388635030606, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08140173190977515, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04161559953922179, "sim_compute_performance-ego": 0.06717514701005889, "sim_compute_robot_state-ego": 0.06865656085130645}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.01421276330947876, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06748358964920044, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14793691158294678, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07864565134048462, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.040403308868408205, "sim_compute_performance-ego": 0.06667174816131592, "sim_compute_robot_state-ego": 0.0670830512046814}}
set_robot_commands_max0.0833270511929951
set_robot_commands_mean0.07957627293603152
set_robot_commands_median0.07864565134048462
set_robot_commands_min0.07589558087862455
sim_compute_performance-ego_max0.06717514701005889
sim_compute_performance-ego_mean0.06473257157065841
sim_compute_performance-ego_median0.06558212779817127
sim_compute_performance-ego_min0.06114279522615321
sim_compute_robot_state-ego_max0.06865656085130645
sim_compute_robot_state-ego_mean0.06591499139250849
sim_compute_robot_state-ego_median0.0670830512046814
sim_compute_robot_state-ego_min0.0614580371800591
sim_compute_sim_state_max0.04161559953922179
sim_compute_sim_state_mean0.039747762969089814
sim_compute_sim_state_median0.04007209293426029
sim_compute_sim_state_min0.03758740425109863
sim_physics_max0.01450698840908888
sim_physics_mean0.013856712367365598
sim_physics_median0.013890417183146757
sim_physics_min0.01329814470731295
sim_render-ego_max0.06748358964920044
sim_render-ego_mean0.06449343732146105
sim_render-ego_median0.06527983574640184
sim_render-ego_min0.05743241310119629
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
175682392Liam Paull 🇨🇦random_agentaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-61080:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.13147391213311088
agent_compute-ego_mean0.12753541428958554
agent_compute-ego_median0.12761656097743823
agent_compute-ego_min0.12389412679170309
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.01363316826198412, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.060267427693242615, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.12761656097743823, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.07983396364294965, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.04061512325121009, "sim_compute_performance-ego": 0.06778123067772907, "sim_compute_robot_state-ego": 0.06826145752616551}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.013399124145507812, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.0620142998902694, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12603370003078296, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07679541214652684, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.04034538891004479, "sim_compute_performance-ego": 0.05894210027611774, "sim_compute_robot_state-ego": 0.06584735538648523}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.01313062147660689, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.05744331533258611, "in-drivable-lane": 0, "agent_compute-ego": 0.12865877151489258, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.08109957521611993, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.0377884561365301, "sim_compute_performance-ego": 0.06023711507970637, "sim_compute_robot_state-ego": 0.062197327613830566}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.017869207594129775, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.05959010124206543, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.13147391213311088, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07885037528143989, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.0421545770433214, "sim_compute_performance-ego": 0.059200790193345815, "sim_compute_robot_state-ego": 0.06449246406555176}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.013830849998875667, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06201340022839998, "in-drivable-lane": 0, "agent_compute-ego": 0.12389412679170309, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.0730453792371248, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.03680163935611123, "sim_compute_performance-ego": 0.06636231823971397, "sim_compute_robot_state-ego": 0.06154435559322959}}
set_robot_commands_max0.08109957521611993
set_robot_commands_mean0.07792494110483222
set_robot_commands_median0.07885037528143989
set_robot_commands_min0.0730453792371248
sim_compute_performance-ego_max0.06778123067772907
sim_compute_performance-ego_mean0.06250471089332259
sim_compute_performance-ego_median0.06023711507970637
sim_compute_performance-ego_min0.05894210027611774
sim_compute_robot_state-ego_max0.06826145752616551
sim_compute_robot_state-ego_mean0.06446859203705253
sim_compute_robot_state-ego_median0.06449246406555176
sim_compute_robot_state-ego_min0.06154435559322959
sim_compute_sim_state_max0.0421545770433214
sim_compute_sim_state_mean0.03954103693944352
sim_compute_sim_state_median0.04034538891004479
sim_compute_sim_state_min0.03680163935611123
sim_physics_max0.017869207594129775
sim_physics_mean0.014372594295420852
sim_physics_median0.01363316826198412
sim_physics_min0.01313062147660689
sim_render-ego_max0.0620142998902694
sim_render-ego_mean0.06026570887731271
sim_render-ego_median0.060267427693242615
sim_render-ego_min0.05744331533258611
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
175662384Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-61080:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06827346217896346
survival_time_median0.49999999999999994
deviation-center-line_median0.009500218743329774
in-drivable-lane_median0.19999999999999996


other stats
agent_compute-ego_max0.22631104787190756
agent_compute-ego_mean0.20471026102701825
agent_compute-ego_median0.21764953136444093
agent_compute-ego_min0.16676905155181884
deviation-center-line_max0.013795833178615487
deviation-center-line_mean0.010207102944378942
deviation-center-line_min0.008650642668958316
deviation-heading_max0.2263600585831548
deviation-heading_mean0.20912932769450193
deviation-heading_median0.2115131753551608
deviation-heading_min0.1940939023214228
driven_any_max0.17301347449321022
driven_any_mean0.1653330094028725
driven_any_median0.16806535041271312
driven_any_min0.15594992193497675
driven_lanedir_consec_max0.08518884240781377
driven_lanedir_consec_mean0.06681416126707977
driven_lanedir_consec_min0.05329073985858912
driven_lanedir_max0.08518884240781377
driven_lanedir_mean0.06681416126707977
driven_lanedir_median0.06827346217896346
driven_lanedir_min0.05329073985858912
in-drivable-lane_max0.19999999999999996
in-drivable-lane_mean0.17999999999999994
in-drivable-lane_min0.14999999999999997
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17014180631424294, "sim_physics": 0.014520978927612303, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06999983811956012, "sim_render-ego": 0.06594688892364502, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.18768503665924072, "deviation-heading": 0.1974597303744625, "set_robot_commands": 0.08263778686523438, "deviation-center-line": 0.009500218743329774, "driven_lanedir_consec": 0.06999983811956012, "sim_compute_sim_state": 0.04279780387878418, "sim_compute_performance-ego": 0.0710226058959961, "sim_compute_robot_state-ego": 0.06788544654846192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15949449385921952, "sim_physics": 0.01287076473236084, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06827346217896346, "sim_render-ego": 0.06893129348754883, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.21764953136444093, "deviation-heading": 0.1940939023214228, "set_robot_commands": 0.0822690486907959, "deviation-center-line": 0.009110194604717353, "driven_lanedir_consec": 0.06827346217896346, "sim_compute_sim_state": 0.03524124622344971, "sim_compute_performance-ego": 0.06362400054931641, "sim_compute_robot_state-ego": 0.06197965145111084}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17301347449321022, "sim_physics": 0.013411879539489746, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05329073985858912, "sim_render-ego": 0.06702301502227784, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.16676905155181884, "deviation-heading": 0.2115131753551608, "set_robot_commands": 0.07852721214294434, "deviation-center-line": 0.008650642668958316, "driven_lanedir_consec": 0.05329073985858912, "sim_compute_sim_state": 0.042772650718688965, "sim_compute_performance-ego": 0.06611435413360596, "sim_compute_robot_state-ego": 0.06635541915893554}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15594992193497675, "sim_physics": 0.012058125601874458, "survival_time": 0.45, "driven_lanedir": 0.0573179237704724, "sim_render-ego": 0.06721700562371148, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.22631104787190756, "deviation-heading": 0.21621977183830865, "set_robot_commands": 0.08227904637654622, "deviation-center-line": 0.009978625526273786, "driven_lanedir_consec": 0.0573179237704724, "sim_compute_sim_state": 0.04060045878092448, "sim_compute_performance-ego": 0.06493679682413737, "sim_compute_robot_state-ego": 0.060314575831095375}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16806535041271312, "sim_physics": 0.013385963439941409, "survival_time": 0.49999999999999994, "driven_lanedir": 0.08518884240781377, "sim_render-ego": 0.06559736728668213, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.2251366376876831, "deviation-heading": 0.2263600585831548, "set_robot_commands": 0.07763357162475586, "deviation-center-line": 0.013795833178615487, "driven_lanedir_consec": 0.08518884240781377, "sim_compute_sim_state": 0.041727113723754886, "sim_compute_performance-ego": 0.06521744728088379, "sim_compute_robot_state-ego": 0.0640596628189087}}
set_robot_commands_max0.08263778686523438
set_robot_commands_mean0.08066933314005534
set_robot_commands_median0.0822690486907959
set_robot_commands_min0.07763357162475586
sim_compute_performance-ego_max0.0710226058959961
sim_compute_performance-ego_mean0.06618304093678792
sim_compute_performance-ego_median0.06521744728088379
sim_compute_performance-ego_min0.06362400054931641
sim_compute_robot_state-ego_max0.06788544654846192
sim_compute_robot_state-ego_mean0.06411895116170248
sim_compute_robot_state-ego_median0.0640596628189087
sim_compute_robot_state-ego_min0.060314575831095375
sim_compute_sim_state_max0.04279780387878418
sim_compute_sim_state_mean0.04062785466512044
sim_compute_sim_state_median0.041727113723754886
sim_compute_sim_state_min0.03524124622344971
sim_physics_max0.014520978927612303
sim_physics_mean0.01324954244825575
sim_physics_median0.013385963439941409
sim_physics_min0.012058125601874458
sim_render-ego_max0.06893129348754883
sim_render-ego_mean0.06694311406877305
sim_render-ego_median0.06702301502227784
sim_render-ego_min0.06559736728668213
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.48999999999999994
survival_time_min0.45
No reset possible
175482374Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-61080:14:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.15110902505762436
agent_compute-ego_mean0.14811622703702118
agent_compute-ego_median0.15002805175203263
agent_compute-ego_min0.1397597544333514
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.028513135581180966, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.06643272268361058, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.1505182956827098, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.07822053843531115, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.038467463131608634, "sim_compute_performance-ego": 0.06606792581492457, "sim_compute_robot_state-ego": 0.06488834578415444, "sim_compute_robot_state-npc0": 0.07164389182781351, "sim_compute_robot_state-npc1": 0.0678212363144447, "sim_compute_robot_state-npc2": 0.06740251738449622, "sim_compute_robot_state-npc3": 0.06920998178679368}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.02675853714798436, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.06202878012801662, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15002805175203263, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.07714715148463394, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.03555920991030606, "sim_compute_performance-ego": 0.061747204173694954, "sim_compute_robot_state-ego": 0.061671271468653824, "sim_compute_robot_state-npc0": 0.0675756244948416, "sim_compute_robot_state-npc1": 0.06440646720655037, "sim_compute_robot_state-npc2": 0.06505020820733273, "sim_compute_robot_state-npc3": 0.06368708971774939}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.02939511867279702, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.06724716754669839, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.14916600825938772, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.0760559173340493, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.03606844962911403, "sim_compute_performance-ego": 0.06555337094246073, "sim_compute_robot_state-ego": 0.06290172008757895, "sim_compute_robot_state-npc0": 0.06933191482056962, "sim_compute_robot_state-npc1": 0.06503726573700601, "sim_compute_robot_state-npc2": 0.06655615187705831, "sim_compute_robot_state-npc3": 0.0651304950105383}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.030120566312004535, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.06891568127800436, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.15110902505762436, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.0765557373271269, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.03762396924635943, "sim_compute_performance-ego": 0.06541585641748765, "sim_compute_robot_state-ego": 0.06455686232622931, "sim_compute_robot_state-npc0": 0.07398792996126062, "sim_compute_robot_state-npc1": 0.06759313695571002, "sim_compute_robot_state-npc2": 0.06720201828900506, "sim_compute_robot_state-npc3": 0.06879632052253275}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.02528611351461971, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.060564893133500046, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.1397597544333514, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.0737829839482027, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.0346904852811028, "sim_compute_performance-ego": 0.059830381589777326, "sim_compute_robot_state-ego": 0.058529366465175856, "sim_compute_robot_state-npc0": 0.0667191323112039, "sim_compute_robot_state-npc1": 0.061630746897529155, "sim_compute_robot_state-npc2": 0.06215291514116175, "sim_compute_robot_state-npc3": 0.061149509514079374}}
set_robot_commands_max0.07822053843531115
set_robot_commands_mean0.0763524657058648
set_robot_commands_median0.0765557373271269
set_robot_commands_min0.0737829839482027
sim_compute_performance-ego_max0.06606792581492457
sim_compute_performance-ego_mean0.06372294778766904
sim_compute_performance-ego_median0.06541585641748765
sim_compute_performance-ego_min0.059830381589777326
sim_compute_robot_state-ego_max0.06488834578415444
sim_compute_robot_state-ego_mean0.06250951322635848
sim_compute_robot_state-ego_median0.06290172008757895
sim_compute_robot_state-ego_min0.058529366465175856
sim_compute_robot_state-npc0_max0.07398792996126062
sim_compute_robot_state-npc0_mean0.06985169868313786
sim_compute_robot_state-npc0_median0.06933191482056962
sim_compute_robot_state-npc0_min0.0667191323112039
sim_compute_robot_state-npc1_max0.0678212363144447
sim_compute_robot_state-npc1_mean0.06529777062224805
sim_compute_robot_state-npc1_median0.06503726573700601
sim_compute_robot_state-npc1_min0.061630746897529155
sim_compute_robot_state-npc2_max0.06740251738449622
sim_compute_robot_state-npc2_mean0.06567276217981081
sim_compute_robot_state-npc2_median0.06655615187705831
sim_compute_robot_state-npc2_min0.06215291514116175
sim_compute_robot_state-npc3_max0.06920998178679368
sim_compute_robot_state-npc3_mean0.0655946793103387
sim_compute_robot_state-npc3_median0.0651304950105383
sim_compute_robot_state-npc3_min0.061149509514079374
sim_compute_sim_state_max0.038467463131608634
sim_compute_sim_state_mean0.03648191543969819
sim_compute_sim_state_median0.03606844962911403
sim_compute_sim_state_min0.0346904852811028
sim_physics_max0.030120566312004535
sim_physics_mean0.02801469424571732
sim_physics_median0.028513135581180966
sim_physics_min0.02528611351461971
sim_render-ego_max0.06891568127800436
sim_render-ego_mean0.065037848953966
sim_render-ego_median0.06643272268361058
sim_render-ego_min0.060564893133500046
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
175422376Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-61080:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2501898935829012
survival_time_median2.6499999999999986
deviation-center-line_median0.02537368915309797
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.05609844765573178
agent_compute-ego_mean0.05329406415482396
agent_compute-ego_median0.05367976246458112
agent_compute-ego_min0.05065198378129439
deviation-center-line_max0.03958613065683618
deviation-center-line_mean0.02918970941936276
deviation-center-line_min0.020890767023363815
deviation-heading_max0.20304552908957563
deviation-heading_mean0.1920323650242732
deviation-heading_median0.1949200760095926
deviation-heading_min0.17840427823186208
driven_any_max1.59
driven_any_mean1.349999999999999
driven_any_median1.5899999999999932
driven_any_min0.9900000000000008
driven_lanedir_consec_max1.3567189392346433
driven_lanedir_consec_mean1.0593730735411984
driven_lanedir_consec_min0.6561020726944444
driven_lanedir_max1.3567189392346433
driven_lanedir_mean1.0593730735411984
driven_lanedir_median1.2501898935829012
driven_lanedir_min0.6561020726944444
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.4299999999999992
in-drivable-lane_min0.30000000000000027
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900000000000012, "sim_physics": 0.013827475634488192, "survival_time": 1.6500000000000008, "driven_lanedir": 0.6561020726944444, "sim_render-ego": 0.06444179650508997, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.05367976246458112, "deviation-heading": 0.18074641270076017, "set_robot_commands": 0.07465875510013464, "deviation-center-line": 0.020890767023363815, "driven_lanedir_consec": 0.6561020726944444, "sim_compute_sim_state": 0.03999888535701867, "sim_compute_performance-ego": 0.0661775271097819, "sim_compute_robot_state-ego": 0.06692564126217004}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900000000000008, "sim_physics": 0.0135208476673473, "survival_time": 1.6500000000000008, "driven_lanedir": 0.7836645686111028, "sim_render-ego": 0.06366997776609479, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.05065198378129439, "deviation-heading": 0.1949200760095926, "set_robot_commands": 0.0722154053774747, "deviation-center-line": 0.03958613065683618, "driven_lanedir_consec": 0.7836645686111028, "sim_compute_sim_state": 0.03701793063770641, "sim_compute_performance-ego": 0.06330147656527432, "sim_compute_robot_state-ego": 0.06467424017010313}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5899999999999932, "sim_physics": 0.013892695588885614, "survival_time": 2.6499999999999986, "driven_lanedir": 1.3567189392346433, "sim_render-ego": 0.0660511997510802, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.05461363972357984, "deviation-heading": 0.17840427823186208, "set_robot_commands": 0.0745080956872904, "deviation-center-line": 0.034724271110417856, "driven_lanedir_consec": 1.3567189392346433, "sim_compute_sim_state": 0.04274998071058741, "sim_compute_performance-ego": 0.06804609298706055, "sim_compute_robot_state-ego": 0.06867258053905559}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59, "sim_physics": 0.014445376846025575, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.06862181987402574, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.05609844765573178, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.07865302517728985, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.04224679155169793, "sim_compute_performance-ego": 0.06857024498705594, "sim_compute_robot_state-ego": 0.06894477358404195}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.59, "sim_physics": 0.013421193608697856, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.06279595842901266, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.05142648714893269, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.0745746504585698, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.03622248037806097, "sim_compute_performance-ego": 0.06320104958876124, "sim_compute_robot_state-ego": 0.06374704163029508}}
set_robot_commands_max0.07865302517728985
set_robot_commands_mean0.07492198636015188
set_robot_commands_median0.0745746504585698
set_robot_commands_min0.0722154053774747
sim_compute_performance-ego_max0.06857024498705594
sim_compute_performance-ego_mean0.06585927824758679
sim_compute_performance-ego_median0.0661775271097819
sim_compute_performance-ego_min0.06320104958876124
sim_compute_robot_state-ego_max0.06894477358404195
sim_compute_robot_state-ego_mean0.06659285543713317
sim_compute_robot_state-ego_median0.06692564126217004
sim_compute_robot_state-ego_min0.06374704163029508
sim_compute_sim_state_max0.04274998071058741
sim_compute_sim_state_mean0.03964721372701428
sim_compute_sim_state_median0.03999888535701867
sim_compute_sim_state_min0.03622248037806097
sim_physics_max0.014445376846025575
sim_physics_mean0.013821517869088909
sim_physics_median0.013827475634488192
sim_physics_min0.013421193608697856
sim_render-ego_max0.06862181987402574
sim_render-ego_mean0.06511615046506067
sim_render-ego_median0.06444179650508997
sim_render-ego_min0.06279595842901266
simulation-passed1
survival_time_max2.6499999999999986
survival_time_mean2.249999999999999
survival_time_min1.6500000000000008
No reset possible
175322373Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-61080:14:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.14344600644604913
agent_compute-ego_mean0.13804776771359956
agent_compute-ego_median0.13847731702467975
agent_compute-ego_min0.1343496676647302
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0267775716452763, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.06088092409331223, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.14344600644604913, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.07662861264985184, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.03440306597742541, "sim_compute_performance-ego": 0.06115088298402983, "sim_compute_robot_state-ego": 0.06301420803727775, "sim_compute_robot_state-npc0": 0.06688903446855216, "sim_compute_robot_state-npc1": 0.06263764480064656, "sim_compute_robot_state-npc2": 0.060183273512741615, "sim_compute_robot_state-npc3": 0.06149865018910375}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.025764515905669243, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.06006469509818337, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1343496676647302, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.07391694097807913, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.033130616852731415, "sim_compute_performance-ego": 0.05935541788736979, "sim_compute_robot_state-ego": 0.05930505738113866, "sim_compute_robot_state-npc0": 0.06577965707489938, "sim_compute_robot_state-npc1": 0.06237277840123032, "sim_compute_robot_state-npc2": 0.060215635733170944, "sim_compute_robot_state-npc3": 0.060742883971243194}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.029476657826849755, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.060064120495573005, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.1348641984006192, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.07312567944222308, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.03365417997887794, "sim_compute_performance-ego": 0.05936395107431615, "sim_compute_robot_state-ego": 0.061141851100515815, "sim_compute_robot_state-npc0": 0.06579232469518134, "sim_compute_robot_state-npc1": 0.06055374602054027, "sim_compute_robot_state-npc2": 0.06090811719285681, "sim_compute_robot_state-npc3": 0.05976135426379265}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.027920032950008614, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.05945092089035932, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.13847731702467975, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.07362229964312385, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.0331909319933723, "sim_compute_performance-ego": 0.06027529940885656, "sim_compute_robot_state-ego": 0.06231978640836828, "sim_compute_robot_state-npc0": 0.0644080218146829, "sim_compute_robot_state-npc1": 0.05981600705315085, "sim_compute_robot_state-npc2": 0.05922904295079848, "sim_compute_robot_state-npc3": 0.06080758431378533}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.024609776104197786, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.058816303225124586, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.1391016490319196, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.07511412746766034, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.031910682425779456, "sim_compute_performance-ego": 0.05946530664668364, "sim_compute_robot_state-ego": 0.05991437505273258, "sim_compute_robot_state-npc0": 0.06767345526639153, "sim_compute_robot_state-npc1": 0.059623977717231304, "sim_compute_robot_state-npc2": 0.0581827864927404, "sim_compute_robot_state-npc3": 0.058350671740139234}}
set_robot_commands_max0.07662861264985184
set_robot_commands_mean0.07448153203618765
set_robot_commands_median0.07391694097807913
set_robot_commands_min0.07312567944222308
sim_compute_performance-ego_max0.06115088298402983
sim_compute_performance-ego_mean0.05992217160025119
sim_compute_performance-ego_median0.05946530664668364
sim_compute_performance-ego_min0.05935541788736979
sim_compute_robot_state-ego_max0.06301420803727775
sim_compute_robot_state-ego_mean0.06113905559600661
sim_compute_robot_state-ego_median0.061141851100515815
sim_compute_robot_state-ego_min0.05930505738113866
sim_compute_robot_state-npc0_max0.06767345526639153
sim_compute_robot_state-npc0_mean0.06610849866394146
sim_compute_robot_state-npc0_median0.06579232469518134
sim_compute_robot_state-npc0_min0.0644080218146829
sim_compute_robot_state-npc1_max0.06263764480064656
sim_compute_robot_state-npc1_mean0.06100083079855987
sim_compute_robot_state-npc1_median0.06055374602054027
sim_compute_robot_state-npc1_min0.059623977717231304
sim_compute_robot_state-npc2_max0.06090811719285681
sim_compute_robot_state-npc2_mean0.05974377117646166
sim_compute_robot_state-npc2_median0.060183273512741615
sim_compute_robot_state-npc2_min0.0581827864927404
sim_compute_robot_state-npc3_max0.06149865018910375
sim_compute_robot_state-npc3_mean0.060232228895612826
sim_compute_robot_state-npc3_median0.060742883971243194
sim_compute_robot_state-npc3_min0.058350671740139234
sim_compute_sim_state_max0.03440306597742541
sim_compute_sim_state_mean0.0332578954456373
sim_compute_sim_state_median0.0331909319933723
sim_compute_sim_state_min0.031910682425779456
sim_physics_max0.029476657826849755
sim_physics_mean0.02690971088640034
sim_physics_median0.0267775716452763
sim_physics_min0.024609776104197786
sim_render-ego_max0.06088092409331223
sim_render-ego_mean0.05985539276051051
sim_render-ego_median0.060064120495573005
sim_render-ego_min0.058816303225124586
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
175192326Konstantin ChaikaPredictorLastaido2-PREDstep1-simulationerrornoidsc-rudolf-61080:02:30
Timeout: Waited 120 [...]
Timeout:

Waited 120 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
175122270Andrea Censi 🇨🇭PredictorLastaido2-PREDstep1-simulationerrornoidsc-rudolf-61080:02:30
Timeout: Waited 120 [...]
Timeout:

Waited 120 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
175042281Andrea Censi 🇨🇭PredictorMeanaido2-PREDstep1-simulationerrornoidsc-rudolf-61080:02:28
Timeout: Waited 120 [...]
Timeout:

Waited 120 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
174982283Andrea Censi 🇨🇭PredictorLastaido2-PREDstep1-simulationerrornoidsc-rudolf-61080:02:39
Timeout: Waited 120 [...]
Timeout:

Waited 120 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible