Duckietown Challenges Home Challenges Submissions

Evaluator 735

ID735
evaluatorip-172-31-25-98-9766
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-9766
versiond-c:4.0.17;d-c-r:4.0.26;d-s:4.0.17
first heard
last heard
statusinactive
# evaluating
# success15 17846
# timeout1 18068
# failed
# error16 17853
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
180682676Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationtimeoutnoip-172-31-25-98-97660:25:04
I can see how the jo [...]
I can see how the job 18068 is timeout because passed 1504 seconds and the timeout is 1200.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
180632681Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:18:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7322998488987488
survival_time_median3.649999999999995
deviation-center-line_median0.2243841654427191
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.09507989088694256
agent_compute-ego_mean0.0829111340936868
agent_compute-ego_median0.08580351727349418
agent_compute-ego_min0.06654473526837075
deviation-center-line_max0.5460781579714795
deviation-center-line_mean0.2454386270980437
deviation-center-line_min0.07184242826360611
deviation-heading_max2.6009978653614185
deviation-heading_mean1.0875822232254675
deviation-heading_median0.7301029801806983
deviation-heading_min0.29493603329448104
driven_any_max2.2447786276145085
driven_any_mean1.2287432726675598
driven_any_median1.172333180328872
driven_any_min0.44993925369855226
driven_lanedir_consec_max1.055367425136
driven_lanedir_consec_mean0.7426813271613203
driven_lanedir_consec_min0.4390706498431785
driven_lanedir_max1.1973725684683487
driven_lanedir_mean0.8356958710752403
driven_lanedir_median0.8734905941477327
driven_lanedir_min0.4390706498431785
in-drivable-lane_max2.1999999999999953
in-drivable-lane_mean0.8499999999999979
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.44993925369855226, "sim_physics": 0.037595486640930174, "survival_time": 1.5000000000000009, "driven_lanedir": 0.4390706498431785, "sim_render-ego": 0.07450776100158692, "in-drivable-lane": 0, "agent_compute-ego": 0.09507989088694256, "deviation-heading": 0.29493603329448104, "set_robot_commands": 0.1104652961095174, "deviation-center-line": 0.11150855469386496, "driven_lanedir_consec": 0.4390706498431785, "sim_compute_sim_state": 0.04684177239735921, "sim_compute_performance-ego": 0.07834045092264812, "sim_compute_robot_state-ego": 0.08484856287638347, "sim_compute_robot_state-npc0": 0.07730731964111329, "sim_compute_robot_state-npc1": 0.075327467918396, "sim_compute_robot_state-npc2": 0.08039259115854899, "sim_compute_robot_state-npc3": 0.08289966583251954}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2447786276145085, "sim_physics": 0.04045419182096209, "survival_time": 6.999999999999983, "driven_lanedir": 1.1973725684683487, "sim_render-ego": 0.07213619095938546, "in-drivable-lane": 2.1999999999999953, "agent_compute-ego": 0.08580351727349418, "deviation-heading": 2.6009978653614185, "set_robot_commands": 0.10883025441850935, "deviation-center-line": 0.5460781579714795, "driven_lanedir_consec": 0.7322998488987488, "sim_compute_sim_state": 0.044165228094373433, "sim_compute_performance-ego": 0.07548517840249198, "sim_compute_robot_state-ego": 0.08241915362221854, "sim_compute_robot_state-npc0": 0.07623380933489118, "sim_compute_robot_state-npc1": 0.0750100919178554, "sim_compute_robot_state-npc2": 0.07514847346714565, "sim_compute_robot_state-npc3": 0.07580923863819668}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8838547392064144, "sim_physics": 0.04260615002025257, "survival_time": 2.7499999999999982, "driven_lanedir": 0.8734905941477327, "sim_render-ego": 0.07353438030589711, "in-drivable-lane": 0, "agent_compute-ego": 0.08886837959289551, "deviation-heading": 0.3484759887351704, "set_robot_commands": 0.11966739134355024, "deviation-center-line": 0.27337982911854875, "driven_lanedir_consec": 0.8734905941477327, "sim_compute_sim_state": 0.04431064779108221, "sim_compute_performance-ego": 0.07750679796392268, "sim_compute_robot_state-ego": 0.08653693632646041, "sim_compute_robot_state-npc0": 0.07736833745783026, "sim_compute_robot_state-npc1": 0.07830434279008346, "sim_compute_robot_state-npc2": 0.07924770441922274, "sim_compute_robot_state-npc3": 0.07854521491310813}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.392810562489452, "sim_physics": 0.03689907337057179, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6131781177809414, "sim_render-ego": 0.0677457513480351, "in-drivable-lane": 1.799999999999995, "agent_compute-ego": 0.07825914744673104, "deviation-heading": 1.4633982485555703, "set_robot_commands": 0.099174400855755, "deviation-center-line": 0.07184242826360611, "driven_lanedir_consec": 0.6131781177809414, "sim_compute_sim_state": 0.03963475391782563, "sim_compute_performance-ego": 0.06998989225804121, "sim_compute_robot_state-ego": 0.07436155176710808, "sim_compute_robot_state-npc0": 0.06933127874615548, "sim_compute_robot_state-npc1": 0.07169905750230811, "sim_compute_robot_state-npc2": 0.07049196341942096, "sim_compute_robot_state-npc3": 0.07416401512321384}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.172333180328872, "sim_physics": 0.03244059053185868, "survival_time": 3.649999999999995, "driven_lanedir": 1.055367425136, "sim_render-ego": 0.054260155926012014, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.06654473526837075, "deviation-heading": 0.7301029801806983, "set_robot_commands": 0.08243542174770407, "deviation-center-line": 0.2243841654427191, "driven_lanedir_consec": 1.055367425136, "sim_compute_sim_state": 0.030537170906589455, "sim_compute_performance-ego": 0.05743455560240027, "sim_compute_robot_state-ego": 0.05895422582756983, "sim_compute_robot_state-npc0": 0.05526537437961526, "sim_compute_robot_state-npc1": 0.05455454081705172, "sim_compute_robot_state-npc2": 0.056002950015133376, "sim_compute_robot_state-npc3": 0.054765381225167886}}
set_robot_commands_max0.11966739134355024
set_robot_commands_mean0.1041145528950072
set_robot_commands_median0.10883025441850935
set_robot_commands_min0.08243542174770407
sim_compute_performance-ego_max0.07834045092264812
sim_compute_performance-ego_mean0.07175137502990085
sim_compute_performance-ego_median0.07548517840249198
sim_compute_performance-ego_min0.05743455560240027
sim_compute_robot_state-ego_max0.08653693632646041
sim_compute_robot_state-ego_mean0.07742408608394806
sim_compute_robot_state-ego_median0.08241915362221854
sim_compute_robot_state-ego_min0.05895422582756983
sim_compute_robot_state-npc0_max0.07736833745783026
sim_compute_robot_state-npc0_mean0.0711012239119211
sim_compute_robot_state-npc0_median0.07623380933489118
sim_compute_robot_state-npc0_min0.05526537437961526
sim_compute_robot_state-npc1_max0.07830434279008346
sim_compute_robot_state-npc1_mean0.07097910018913893
sim_compute_robot_state-npc1_median0.0750100919178554
sim_compute_robot_state-npc1_min0.05455454081705172
sim_compute_robot_state-npc2_max0.08039259115854899
sim_compute_robot_state-npc2_mean0.07225673649589434
sim_compute_robot_state-npc2_median0.07514847346714565
sim_compute_robot_state-npc2_min0.056002950015133376
sim_compute_robot_state-npc3_max0.08289966583251954
sim_compute_robot_state-npc3_mean0.07323670314644122
sim_compute_robot_state-npc3_median0.07580923863819668
sim_compute_robot_state-npc3_min0.054765381225167886
sim_compute_sim_state_max0.04684177239735921
sim_compute_sim_state_mean0.04109791462144598
sim_compute_sim_state_median0.044165228094373433
sim_compute_sim_state_min0.030537170906589455
sim_physics_max0.04260615002025257
sim_physics_mean0.03799909847691506
sim_physics_median0.037595486640930174
sim_physics_min0.03244059053185868
sim_render-ego_max0.07450776100158692
sim_render-ego_mean0.06843684790818333
sim_render-ego_median0.07213619095938546
sim_render-ego_min0.054260155926012014
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.8499999999999943
survival_time_min1.5000000000000009
No reset possible
180602668Rami Al-Naim 🇷🇺Modidfied configaido2-LFV-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:00:33
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
180582672Rami Al-Naim 🇷🇺Modidfied configaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:00:31
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
180562653Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:14:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9603556839475176
survival_time_median3.049999999999997
deviation-center-line_median0.24807512111060304
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.08611554418291364
agent_compute-ego_mean0.08432629722800454
agent_compute-ego_median0.08460590732631398
agent_compute-ego_min0.08239470011946085
deviation-center-line_max0.4446002974180936
deviation-center-line_mean0.24789877906631216
deviation-center-line_min0.1395364721872027
deviation-heading_max3.5169759698241863
deviation-heading_mean1.2306736276013708
deviation-heading_median0.6961736630114217
deviation-heading_min0.3215944586683667
driven_any_max3.319183058989142
driven_any_mean1.3511033372470895
driven_any_median0.979932658986168
driven_any_min0.5302735045845643
driven_lanedir_consec_max1.7564748612496863
driven_lanedir_consec_mean0.9278339837123084
driven_lanedir_consec_min0.38632642577069853
driven_lanedir_max1.77102750194947
driven_lanedir_mean0.9353357579454628
driven_lanedir_median0.9603556839475176
driven_lanedir_min0.4092826562366866
in-drivable-lane_max3.400000000000011
in-drivable-lane_mean0.8700000000000022
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5302735045845643, "sim_physics": 0.02106500353131975, "survival_time": 1.7500000000000009, "driven_lanedir": 0.5176181838392866, "sim_render-ego": 0.07359185900006976, "in-drivable-lane": 0, "agent_compute-ego": 0.08611554418291364, "deviation-heading": 0.3215944586683667, "set_robot_commands": 0.11031853812081471, "deviation-center-line": 0.1456706250519749, "driven_lanedir_consec": 0.5176181838392866, "sim_compute_sim_state": 0.04320932115827288, "sim_compute_performance-ego": 0.0755659852709089, "sim_compute_robot_state-ego": 0.08360954693385533}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8501944637578153, "sim_physics": 0.025724694413958856, "survival_time": 2.6499999999999986, "driven_lanedir": 0.4092826562366866, "sim_render-ego": 0.07284395199901653, "in-drivable-lane": 0.9000000000000007, "agent_compute-ego": 0.08281225078510789, "deviation-heading": 1.1048592625437017, "set_robot_commands": 0.10848553675525592, "deviation-center-line": 0.1395364721872027, "driven_lanedir_consec": 0.38632642577069853, "sim_compute_sim_state": 0.041293639057087446, "sim_compute_performance-ego": 0.07574277104071851, "sim_compute_robot_state-ego": 0.07967443286247973}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.319183058989142, "sim_physics": 0.023297149777988305, "survival_time": 10.350000000000012, "driven_lanedir": 1.77102750194947, "sim_render-ego": 0.07215382396311, "in-drivable-lane": 3.400000000000011, "agent_compute-ego": 0.08239470011946085, "deviation-heading": 3.5169759698241863, "set_robot_commands": 0.10439189275105794, "deviation-center-line": 0.4446002974180936, "driven_lanedir_consec": 1.7564748612496863, "sim_compute_sim_state": 0.04136972150940826, "sim_compute_performance-ego": 0.07614666367498572, "sim_compute_robot_state-ego": 0.07988363648382361}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.075932999917757, "sim_physics": 0.027266370716379648, "survival_time": 3.349999999999996, "driven_lanedir": 1.018394763754353, "sim_render-ego": 0.0745017492949073, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08460590732631398, "deviation-heading": 0.6961736630114217, "set_robot_commands": 0.11518067388392206, "deviation-center-line": 0.26161137956368674, "driven_lanedir_consec": 1.018394763754353, "sim_compute_sim_state": 0.04307622696036723, "sim_compute_performance-ego": 0.07856211733462205, "sim_compute_robot_state-ego": 0.08803693216238449}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.979932658986168, "sim_physics": 0.02499123870349321, "survival_time": 3.049999999999997, "driven_lanedir": 0.9603556839475176, "sim_render-ego": 0.07205060661816207, "in-drivable-lane": 0, "agent_compute-ego": 0.0857030837262263, "deviation-heading": 0.5137647839591778, "set_robot_commands": 0.11082925171148582, "deviation-center-line": 0.24807512111060304, "driven_lanedir_consec": 0.9603556839475176, "sim_compute_sim_state": 0.04247655634020195, "sim_compute_performance-ego": 0.07737879284092637, "sim_compute_robot_state-ego": 0.08223709512929447}}
set_robot_commands_max0.11518067388392206
set_robot_commands_mean0.10984117864450728
set_robot_commands_median0.11031853812081471
set_robot_commands_min0.10439189275105794
sim_compute_performance-ego_max0.07856211733462205
sim_compute_performance-ego_mean0.0766792660324323
sim_compute_performance-ego_median0.07614666367498572
sim_compute_performance-ego_min0.0755659852709089
sim_compute_robot_state-ego_max0.08803693216238449
sim_compute_robot_state-ego_mean0.08268832871436753
sim_compute_robot_state-ego_median0.08223709512929447
sim_compute_robot_state-ego_min0.07967443286247973
sim_compute_sim_state_max0.04320932115827288
sim_compute_sim_state_mean0.04228509300506755
sim_compute_sim_state_median0.04247655634020195
sim_compute_sim_state_min0.041293639057087446
sim_physics_max0.027266370716379648
sim_physics_mean0.024468891428627952
sim_physics_median0.02499123870349321
sim_physics_min0.02106500353131975
sim_render-ego_max0.0745017492949073
sim_render-ego_mean0.07302839817505313
sim_render-ego_median0.07284395199901653
sim_render-ego_min0.07205060661816207
simulation-passed1
survival_time_max10.350000000000012
survival_time_mean4.230000000000001
survival_time_min1.7500000000000009
No reset possible
180522660Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:20:55
Waited 1205 seconds [...]
Waited 1205 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
180492648Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-25-98-97660:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2448526305955765
survival_time_median1.0000000000000002
deviation-center-line_median0.02780956837444773
in-drivable-lane_median0.4500000000000001


other stats
agent_compute-ego_max0.05714845657348633
agent_compute-ego_mean0.05304611881573995
agent_compute-ego_median0.05354567766189575
agent_compute-ego_min0.049205833673477174
deviation-center-line_max0.1257230388091751
deviation-center-line_mean0.05577343615770758
deviation-center-line_min0.01951527185289407
deviation-heading_max0.5595345336423936
deviation-heading_mean0.32175424111925316
deviation-heading_median0.3074760381865353
deviation-heading_min0.16993642764665495
driven_any_max1.135775595781212
driven_any_mean0.7105521201006961
driven_any_median0.5457640496143795
driven_any_min0.3022738981004901
driven_lanedir_consec_max0.8171012478585276
driven_lanedir_consec_mean0.42515260445919045
driven_lanedir_consec_min0.164471242446655
driven_lanedir_max0.8171012478585276
driven_lanedir_mean0.4357084916634508
driven_lanedir_median0.2448526305955765
driven_lanedir_min0.164471242446655
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.38000000000000017
in-drivable-lane_min0.04999999999999999
per-episodes
details{"udem1-0-0": {"driven_any": 0.5457640496143795, "sim_physics": 0.02980567216873169, "survival_time": 1.0000000000000002, "driven_lanedir": 0.164471242446655, "sim_render-ego": 0.04804040193557739, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.05354567766189575, "deviation-heading": 0.18758204257854744, "set_robot_commands": 0.06667618751525879, "deviation-center-line": 0.01951527185289407, "driven_lanedir_consec": 0.164471242446655, "sim_compute_sim_state": 0.027729356288909913, "sim_compute_performance-ego": 0.047445166110992434, "sim_compute_robot_state-ego": 0.05087004899978638, "sim_compute_robot_state-npc0": 0.049124181270599365, "sim_compute_robot_state-npc1": 0.04814989566802978, "sim_compute_robot_state-npc2": 0.04613691568374634, "sim_compute_robot_state-npc3": 0.04564690589904785}, "udem1-1-0": {"driven_any": 0.5108934139126888, "sim_physics": 0.02434072774999282, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120319035776863, "sim_render-ego": 0.052533991196576285, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.05591225624084473, "deviation-heading": 0.3074760381865353, "set_robot_commands": 0.07458268894868739, "deviation-center-line": 0.02399913959382396, "driven_lanedir_consec": 0.1725821469418083, "sim_compute_sim_state": 0.033858411452349496, "sim_compute_performance-ego": 0.05210940978106331, "sim_compute_robot_state-ego": 0.050810996223898494, "sim_compute_robot_state-npc0": 0.04944328700794893, "sim_compute_robot_state-npc1": 0.0496831360985251, "sim_compute_robot_state-npc2": 0.05764943010666791, "sim_compute_robot_state-npc3": 0.05937997032614315}, "udem1-2-0": {"driven_any": 0.3022738981004901, "sim_physics": 0.031937265396118165, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955765, "sim_render-ego": 0.043440055847167966, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.05714845657348633, "deviation-heading": 0.16993642764665495, "set_robot_commands": 0.06854720115661621, "deviation-center-line": 0.02780956837444773, "driven_lanedir_consec": 0.2448526305955765, "sim_compute_sim_state": 0.02417516708374023, "sim_compute_performance-ego": 0.04608662128448486, "sim_compute_robot_state-ego": 0.04294173717498779, "sim_compute_robot_state-npc0": 0.0456554651260376, "sim_compute_robot_state-npc1": 0.045121383666992185, "sim_compute_robot_state-npc2": 0.04978315830230713, "sim_compute_robot_state-npc3": 0.04968976974487305}, "udem1-3-0": {"driven_any": 1.135775595781212, "sim_physics": 0.026530182361602785, "survival_time": 2.000000000000001, "driven_lanedir": 0.7709141470587263, "sim_render-ego": 0.04640456438064575, "in-drivable-lane": 0.6000000000000003, "agent_compute-ego": 0.049205833673477174, "deviation-heading": 0.3842421635421346, "set_robot_commands": 0.06926783323287963, "deviation-center-line": 0.08182016215819705, "driven_lanedir_consec": 0.7267557544533849, "sim_compute_sim_state": 0.028588372468948364, "sim_compute_performance-ego": 0.04778112769126893, "sim_compute_robot_state-ego": 0.05127928853034973, "sim_compute_robot_state-npc0": 0.05179356336593628, "sim_compute_robot_state-npc1": 0.04869288206100464, "sim_compute_robot_state-npc2": 0.048160821199417114, "sim_compute_robot_state-npc3": 0.04925156235694885}, "udem1-4-0": {"driven_any": 1.05805364309471, "sim_physics": 0.02685215256430886, "survival_time": 1.6500000000000008, "driven_lanedir": 0.8171012478585276, "sim_render-ego": 0.04793910546736284, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.049418369928995766, "deviation-heading": 0.5595345336423936, "set_robot_commands": 0.06788323864792332, "deviation-center-line": 0.1257230388091751, "driven_lanedir_consec": 0.8171012478585276, "sim_compute_sim_state": 0.02679259849317146, "sim_compute_performance-ego": 0.048576882391264946, "sim_compute_robot_state-ego": 0.051543170755559746, "sim_compute_robot_state-npc0": 0.04786802783156886, "sim_compute_robot_state-npc1": 0.04769929972561923, "sim_compute_robot_state-npc2": 0.04713512189460523, "sim_compute_robot_state-npc3": 0.04710865020751953}}
set_robot_commands_max0.07458268894868739
set_robot_commands_mean0.06939142990027307
set_robot_commands_median0.06854720115661621
set_robot_commands_min0.06667618751525879
sim_compute_performance-ego_max0.05210940978106331
sim_compute_performance-ego_mean0.0483998414518149
sim_compute_performance-ego_median0.04778112769126893
sim_compute_performance-ego_min0.04608662128448486
sim_compute_robot_state-ego_max0.051543170755559746
sim_compute_robot_state-ego_mean0.04948904833691643
sim_compute_robot_state-ego_median0.05087004899978638
sim_compute_robot_state-ego_min0.04294173717498779
sim_compute_robot_state-npc0_max0.05179356336593628
sim_compute_robot_state-npc0_mean0.04877690492041821
sim_compute_robot_state-npc0_median0.049124181270599365
sim_compute_robot_state-npc0_min0.0456554651260376
sim_compute_robot_state-npc1_max0.0496831360985251
sim_compute_robot_state-npc1_mean0.04786931944403419
sim_compute_robot_state-npc1_median0.04814989566802978
sim_compute_robot_state-npc1_min0.045121383666992185
sim_compute_robot_state-npc2_max0.05764943010666791
sim_compute_robot_state-npc2_mean0.04977308943734875
sim_compute_robot_state-npc2_median0.048160821199417114
sim_compute_robot_state-npc2_min0.04613691568374634
sim_compute_robot_state-npc3_max0.05937997032614315
sim_compute_robot_state-npc3_mean0.050215371706906486
sim_compute_robot_state-npc3_median0.04925156235694885
sim_compute_robot_state-npc3_min0.04564690589904785
sim_compute_sim_state_max0.033858411452349496
sim_compute_sim_state_mean0.028228781157423895
sim_compute_sim_state_median0.027729356288909913
sim_compute_sim_state_min0.02417516708374023
sim_physics_max0.031937265396118165
sim_physics_mean0.02789320004815087
sim_physics_median0.02685215256430886
sim_physics_min0.02434072774999282
sim_render-ego_max0.052533991196576285
sim_render-ego_mean0.04767162376546604
sim_render-ego_median0.04793910546736284
sim_render-ego_min0.043440055847167966
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.2000000000000004
survival_time_min0.49999999999999994
No reset possible
180402633Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2342705027983982
survival_time_median1.7500000000000009
deviation-center-line_median0.10801953665034704
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.1263368855351987
agent_compute-ego_mean0.0978445445994702
agent_compute-ego_median0.08549972942897252
agent_compute-ego_min0.0850083449530223
deviation-center-line_max0.17768774509810673
deviation-center-line_mean0.08758489727910898
deviation-center-line_min0.019005533143064354
deviation-heading_max0.759385645220147
deviation-heading_mean0.3195081252333424
deviation-heading_median0.1806788823983304
deviation-heading_min0.118601117425238
driven_any_max2.812198352312563
driven_any_mean1.6891781761410722
driven_any_median1.608242001486626
driven_any_min0.3130680825984642
driven_lanedir_consec_max1.7389031534183392
driven_lanedir_consec_mean0.9694700664283822
driven_lanedir_consec_min0.28316071129320397
driven_lanedir_max1.7389031534183392
driven_lanedir_mean0.9694700664283822
driven_lanedir_median1.2342705027983982
driven_lanedir_min0.28316071129320397
in-drivable-lane_max1.5999999999999988
in-drivable-lane_mean0.7299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.02419304847717285, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.05477450204932171, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.1263368855351987, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.07672716223675272, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.031475315923276154, "sim_compute_performance-ego": 0.05690766417461893, "sim_compute_robot_state-ego": 0.05880797427633534, "sim_compute_robot_state-npc0": 0.05470300757366678, "sim_compute_robot_state-npc1": 0.058055183161859925, "sim_compute_robot_state-npc2": 0.05707434985948646, "sim_compute_robot_state-npc3": 0.05732480339382006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.025288977930622715, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.04501246252367573, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.10718272578331732, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.06331813335418701, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.026733782983595324, "sim_compute_performance-ego": 0.045951789425265406, "sim_compute_robot_state-ego": 0.04890349603468372, "sim_compute_robot_state-npc0": 0.05011940002441406, "sim_compute_robot_state-npc1": 0.04693943454373267, "sim_compute_robot_state-npc2": 0.04783558460973924, "sim_compute_robot_state-npc3": 0.04723806919590119}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.018472024372645782, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.037575176783970425, "in-drivable-lane": 0, "agent_compute-ego": 0.08549972942897252, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.05413964816502163, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.02181039537702288, "sim_compute_performance-ego": 0.03730886323111398, "sim_compute_robot_state-ego": 0.03921733583722796, "sim_compute_robot_state-npc0": 0.03862942968096052, "sim_compute_robot_state-npc1": 0.03805889402117048, "sim_compute_robot_state-npc2": 0.03799165998186384, "sim_compute_robot_state-npc3": 0.038495847157069614}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.016615193230765206, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.0370413030896868, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.08519503729684012, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.05419431413922991, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.02184183256966727, "sim_compute_performance-ego": 0.037221009390694754, "sim_compute_robot_state-ego": 0.03909575598580497, "sim_compute_robot_state-npc0": 0.03904054505484445, "sim_compute_robot_state-npc1": 0.0379922662462507, "sim_compute_robot_state-npc2": 0.03800415992736816, "sim_compute_robot_state-npc3": 0.038527911049979074}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.018479649982755145, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.03734195800054641, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.0850083449530223, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.054140658605666386, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.021621813849797323, "sim_compute_performance-ego": 0.03714844158717564, "sim_compute_robot_state-ego": 0.038813636416480654, "sim_compute_robot_state-npc0": 0.0389927795955113, "sim_compute_robot_state-npc1": 0.03803778830028716, "sim_compute_robot_state-npc2": 0.037969664921836246, "sim_compute_robot_state-npc3": 0.038608187720889135}}
set_robot_commands_max0.07672716223675272
set_robot_commands_mean0.06050398330017152
set_robot_commands_median0.05419431413922991
set_robot_commands_min0.05413964816502163
sim_compute_performance-ego_max0.05690766417461893
sim_compute_performance-ego_mean0.04290755356177374
sim_compute_performance-ego_median0.03730886323111398
sim_compute_performance-ego_min0.03714844158717564
sim_compute_robot_state-ego_max0.05880797427633534
sim_compute_robot_state-ego_mean0.04496763971010653
sim_compute_robot_state-ego_median0.03921733583722796
sim_compute_robot_state-ego_min0.038813636416480654
sim_compute_robot_state-npc0_max0.05470300757366678
sim_compute_robot_state-npc0_mean0.04429703238587942
sim_compute_robot_state-npc0_median0.03904054505484445
sim_compute_robot_state-npc0_min0.03862942968096052
sim_compute_robot_state-npc1_max0.058055183161859925
sim_compute_robot_state-npc1_mean0.043816713254660175
sim_compute_robot_state-npc1_median0.03805889402117048
sim_compute_robot_state-npc1_min0.0379922662462507
sim_compute_robot_state-npc2_max0.05707434985948646
sim_compute_robot_state-npc2_mean0.04377508386005878
sim_compute_robot_state-npc2_median0.03800415992736816
sim_compute_robot_state-npc2_min0.037969664921836246
sim_compute_robot_state-npc3_max0.05732480339382006
sim_compute_robot_state-npc3_mean0.04403896370353182
sim_compute_robot_state-npc3_median0.038608187720889135
sim_compute_robot_state-npc3_min0.038495847157069614
sim_compute_sim_state_max0.031475315923276154
sim_compute_sim_state_mean0.024696628140671792
sim_compute_sim_state_median0.02184183256966727
sim_compute_sim_state_min0.021621813849797323
sim_physics_max0.025288977930622715
sim_physics_mean0.02060977879879234
sim_physics_median0.018479649982755145
sim_physics_min0.016615193230765206
sim_render-ego_max0.05477450204932171
sim_render-ego_mean0.042349080489440215
sim_render-ego_median0.037575176783970425
sim_render-ego_min0.0370413030896868
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.899999999999999
survival_time_min0.35
No reset possible
180312616Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-25-98-97660:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.14493823051452637
agent_compute-ego_mean0.12025700107713162
agent_compute-ego_median0.12203741073608398
agent_compute-ego_min0.0896280564759907
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.014339623243912409, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.04672307553498641, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.10423411493716032, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.06857329866160518, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.027171207510906716, "sim_compute_performance-ego": 0.05010633883268937, "sim_compute_robot_state-ego": 0.05088636149530825}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.01841332601464313, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.05658295880193296, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.14493823051452637, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.0900221700253694, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.033738955207492996, "sim_compute_performance-ego": 0.05976725661236307, "sim_compute_robot_state-ego": 0.05999008468959643}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.015082662755792791, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.05157922614704479, "in-drivable-lane": 0, "agent_compute-ego": 0.12203741073608398, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.07932235977866432, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.031771031293002044, "sim_compute_performance-ego": 0.053095102310180664, "sim_compute_robot_state-ego": 0.06225785342129794}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.016758574379814997, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.062108251783582896, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.1404471927218967, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.08638472027248806, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.03605861133999295, "sim_compute_performance-ego": 0.061098734537760414, "sim_compute_robot_state-ego": 0.06496776474846734}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.013982183054873818, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.04085575906853927, "in-drivable-lane": 0, "agent_compute-ego": 0.0896280564759907, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.05427246344716925, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.02379389813071803, "sim_compute_performance-ego": 0.04212340555692974, "sim_compute_robot_state-ego": 0.04346734599063271}}
set_robot_commands_max0.0900221700253694
set_robot_commands_mean0.07571500243705924
set_robot_commands_median0.07932235977866432
set_robot_commands_min0.05427246344716925
sim_compute_performance-ego_max0.061098734537760414
sim_compute_performance-ego_mean0.05323816756998465
sim_compute_performance-ego_median0.053095102310180664
sim_compute_performance-ego_min0.04212340555692974
sim_compute_robot_state-ego_max0.06496776474846734
sim_compute_robot_state-ego_mean0.05631388206906054
sim_compute_robot_state-ego_median0.05999008468959643
sim_compute_robot_state-ego_min0.04346734599063271
sim_compute_sim_state_max0.03605861133999295
sim_compute_sim_state_mean0.030506740696422546
sim_compute_sim_state_median0.031771031293002044
sim_compute_sim_state_min0.02379389813071803
sim_physics_max0.01841332601464313
sim_physics_mean0.01571527388980743
sim_physics_median0.015082662755792791
sim_physics_min0.013982183054873818
sim_render-ego_max0.062108251783582896
sim_render-ego_mean0.05156985426721726
sim_render-ego_median0.05157922614704479
sim_render-ego_min0.04085575906853927
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
180192597Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:00:31
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
180122591Julian Zillybaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19458825281460657
survival_time_median2.1500000000000004
deviation-center-line_median0.13804779879502196
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2499519814836218
agent_compute-ego_mean0.20993377937736252
agent_compute-ego_median0.213168400984544
agent_compute-ego_min0.16573460698127743
deviation-center-line_max0.14714971812954666
deviation-center-line_mean0.1312220324254954
deviation-center-line_min0.11066586021753166
deviation-heading_max1.1468425077550548
deviation-heading_mean1.0732992733226108
deviation-heading_median1.0521303064682912
deviation-heading_min1.0420559153837334
driven_any_max0.27085284428628564
driven_any_mean0.24354157622078523
driven_any_median0.23627668375753796
driven_any_min0.2210019846031949
driven_lanedir_consec_max0.23233118975408873
driven_lanedir_consec_mean0.20116789228090867
driven_lanedir_consec_min0.17602345086021565
driven_lanedir_max0.23233118975408873
driven_lanedir_mean0.20116789228090867
driven_lanedir_median0.19458825281460657
driven_lanedir_min0.17602345086021565
in-drivable-lane_max0.04999999999999982
in-drivable-lane_mean0.009999999999999964
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.23627668375753796, "sim_physics": 0.03490370927855026, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19458825281460657, "sim_render-ego": 0.06351143260334813, "in-drivable-lane": 0, "agent_compute-ego": 0.2203276989071868, "deviation-heading": 1.1468425077550548, "set_robot_commands": 0.09110870472220488, "deviation-center-line": 0.14714971812954666, "driven_lanedir_consec": 0.19458825281460657, "sim_compute_sim_state": 0.037700015445088234, "sim_compute_performance-ego": 0.06475891623386117, "sim_compute_robot_state-ego": 0.06948475505030433, "sim_compute_robot_state-npc0": 0.0598916397538296, "sim_compute_robot_state-npc1": 0.061822480933610785, "sim_compute_robot_state-npc2": 0.06560825192651083, "sim_compute_robot_state-npc3": 0.06343392993128577}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.26216112970488764, "sim_physics": 0.029935679537184696, "survival_time": 2.3499999999999996, "driven_lanedir": 0.21792508493213217, "sim_render-ego": 0.057185015779860474, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.20048620853018256, "deviation-heading": 1.0834108240464158, "set_robot_commands": 0.08066837331081958, "deviation-center-line": 0.13905324926331683, "driven_lanedir_consec": 0.21792508493213217, "sim_compute_sim_state": 0.033895989681812046, "sim_compute_performance-ego": 0.06136372748841631, "sim_compute_robot_state-ego": 0.0642240250364263, "sim_compute_robot_state-npc0": 0.07299840196650079, "sim_compute_robot_state-npc1": 0.0613347570946876, "sim_compute_robot_state-npc2": 0.06642591699640801, "sim_compute_robot_state-npc3": 0.06269840483969831}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27085284428628564, "sim_physics": 0.037219301183172994, "survival_time": 2.3499999999999996, "driven_lanedir": 0.23233118975408873, "sim_render-ego": 0.0675356388092041, "in-drivable-lane": 0, "agent_compute-ego": 0.2499519814836218, "deviation-heading": 1.0420568129595589, "set_robot_commands": 0.0968233067938622, "deviation-center-line": 0.13804779879502196, "driven_lanedir_consec": 0.23233118975408873, "sim_compute_sim_state": 0.03962725274106289, "sim_compute_performance-ego": 0.06965107106147929, "sim_compute_robot_state-ego": 0.0725469284869255, "sim_compute_robot_state-npc0": 0.06843796689459618, "sim_compute_robot_state-npc1": 0.06849175818423008, "sim_compute_robot_state-npc2": 0.06890135623039083, "sim_compute_robot_state-npc3": 0.07045520112869587}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2210019846031949, "sim_physics": 0.03034289066608135, "survival_time": 1.950000000000001, "driven_lanedir": 0.17602345086021565, "sim_render-ego": 0.05809769263634315, "in-drivable-lane": 0, "agent_compute-ego": 0.213168400984544, "deviation-heading": 1.0420559153837334, "set_robot_commands": 0.08448355625837277, "deviation-center-line": 0.11066586021753166, "driven_lanedir_consec": 0.17602345086021565, "sim_compute_sim_state": 0.03357286942310822, "sim_compute_performance-ego": 0.05966552709921812, "sim_compute_robot_state-ego": 0.06377547826522435, "sim_compute_robot_state-npc0": 0.06241563650277945, "sim_compute_robot_state-npc1": 0.0634771310366117, "sim_compute_robot_state-npc2": 0.06129294175368089, "sim_compute_robot_state-npc3": 0.06249639315482897}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22741523875201997, "sim_physics": 0.022786229848861694, "survival_time": 2.000000000000001, "driven_lanedir": 0.1849714830435003, "sim_render-ego": 0.04902210235595703, "in-drivable-lane": 0, "agent_compute-ego": 0.16573460698127743, "deviation-heading": 1.0521303064682912, "set_robot_commands": 0.07662222981452942, "deviation-center-line": 0.12119353572205992, "driven_lanedir_consec": 0.1849714830435003, "sim_compute_sim_state": 0.027430617809295656, "sim_compute_performance-ego": 0.05028373599052429, "sim_compute_robot_state-ego": 0.05123268961906433, "sim_compute_robot_state-npc0": 0.0523723304271698, "sim_compute_robot_state-npc1": 0.04939227700233459, "sim_compute_robot_state-npc2": 0.04827864766120911, "sim_compute_robot_state-npc3": 0.04961082935333252}}
set_robot_commands_max0.0968233067938622
set_robot_commands_mean0.08594123417995778
set_robot_commands_median0.08448355625837277
set_robot_commands_min0.07662222981452942
sim_compute_performance-ego_max0.06965107106147929
sim_compute_performance-ego_mean0.06114459557469983
sim_compute_performance-ego_median0.06136372748841631
sim_compute_performance-ego_min0.05028373599052429
sim_compute_robot_state-ego_max0.0725469284869255
sim_compute_robot_state-ego_mean0.06425277529158896
sim_compute_robot_state-ego_median0.0642240250364263
sim_compute_robot_state-ego_min0.05123268961906433
sim_compute_robot_state-npc0_max0.07299840196650079
sim_compute_robot_state-npc0_mean0.06322319510897516
sim_compute_robot_state-npc0_median0.06241563650277945
sim_compute_robot_state-npc0_min0.0523723304271698
sim_compute_robot_state-npc1_max0.06849175818423008
sim_compute_robot_state-npc1_mean0.06090368085029496
sim_compute_robot_state-npc1_median0.061822480933610785
sim_compute_robot_state-npc1_min0.04939227700233459
sim_compute_robot_state-npc2_max0.06890135623039083
sim_compute_robot_state-npc2_mean0.06210142291363994
sim_compute_robot_state-npc2_median0.06560825192651083
sim_compute_robot_state-npc2_min0.04827864766120911
sim_compute_robot_state-npc3_max0.07045520112869587
sim_compute_robot_state-npc3_mean0.061738951681568274
sim_compute_robot_state-npc3_median0.06269840483969831
sim_compute_robot_state-npc3_min0.04961082935333252
sim_compute_sim_state_max0.03962725274106289
sim_compute_sim_state_mean0.03444534902007341
sim_compute_sim_state_median0.033895989681812046
sim_compute_sim_state_min0.027430617809295656
sim_physics_max0.037219301183172994
sim_physics_mean0.0310375621027702
sim_physics_median0.03034289066608135
sim_physics_min0.022786229848861694
sim_render-ego_max0.0675356388092041
sim_render-ego_mean0.05907037643694257
sim_render-ego_median0.05809769263634315
sim_render-ego_min0.04902210235595703
simulation-passed1
survival_time_max2.3499999999999996
survival_time_mean2.16
survival_time_min1.950000000000001
No reset possible
180022577Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:02:08
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
179932561Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2448526305955787
survival_time_median1.0000000000000002
deviation-center-line_median0.02780958695734228
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.07360737323760987
agent_compute-ego_mean0.06495734063226313
agent_compute-ego_median0.06402931493871353
agent_compute-ego_min0.055070340633392334
deviation-center-line_max0.1367821583469593
deviation-center-line_mean0.05703771312424479
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792061
deviation-heading_mean0.33854872313755296
deviation-heading_median0.30747603818653535
deviation-heading_min0.1699364276466551
driven_any_max0.9094890302704564
driven_any_mean0.614817253072296
driven_any_median0.5457640496143875
driven_any_min0.3022738981004904
driven_lanedir_consec_max0.7972872880234139
driven_lanedir_consec_mean0.4211895144689454
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.7972872880234139
driven_lanedir_mean0.42291373507306657
driven_lanedir_median0.2448526305955787
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.01987534761428833, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.06480510234832763, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.06991779804229736, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.09482603073120116, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.03933869600296021, "sim_compute_performance-ego": 0.06533604860305786, "sim_compute_robot_state-ego": 0.06721570491790771}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126885, "sim_physics": 0.01665785733391257, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120271352061035, "sim_render-ego": 0.05412459373474121, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.06402931493871353, "deviation-heading": 0.30747603818653535, "set_robot_commands": 0.0903938237358542, "deviation-center-line": 0.023999233443120993, "driven_lanedir_consec": 0.17258161050000476, "sim_compute_sim_state": 0.03148283677942613, "sim_compute_performance-ego": 0.057117644478293025, "sim_compute_robot_state-ego": 0.0566863873425652}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3022738981004904, "sim_physics": 0.021434974670410157, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955787, "sim_render-ego": 0.07217297554016114, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.07360737323760987, "deviation-heading": 0.1699364276466551, "set_robot_commands": 0.10515666007995604, "deviation-center-line": 0.02780958695734228, "driven_lanedir_consec": 0.2448526305955787, "sim_compute_sim_state": 0.04269745349884033, "sim_compute_performance-ego": 0.07713508605957031, "sim_compute_robot_state-ego": 0.07896850109100342}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.016629866191319058, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.052593231201171875, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.055070340633392334, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.07690057584217616, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.03081406014306205, "sim_compute_performance-ego": 0.05366734095982143, "sim_compute_robot_state-ego": 0.05877082688467843}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704564, "sim_physics": 0.016958528949368383, "survival_time": 1.5500000000000007, "driven_lanedir": 0.7972872880234139, "sim_render-ego": 0.059562998433266914, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.06216187630930255, "deviation-heading": 0.6295143987792061, "set_robot_commands": 0.08499288558959961, "deviation-center-line": 0.1367821583469593, "driven_lanedir_consec": 0.7972872880234139, "sim_compute_sim_state": 0.033477975476172664, "sim_compute_performance-ego": 0.06025321252884403, "sim_compute_robot_state-ego": 0.05988094114488171}}
set_robot_commands_max0.10515666007995604
set_robot_commands_mean0.09045399519575743
set_robot_commands_median0.0903938237358542
set_robot_commands_min0.07690057584217616
sim_compute_performance-ego_max0.07713508605957031
sim_compute_performance-ego_mean0.06270186652591733
sim_compute_performance-ego_median0.06025321252884403
sim_compute_performance-ego_min0.05366734095982143
sim_compute_robot_state-ego_max0.07896850109100342
sim_compute_robot_state-ego_mean0.06430447227620731
sim_compute_robot_state-ego_median0.05988094114488171
sim_compute_robot_state-ego_min0.0566863873425652
sim_compute_sim_state_max0.04269745349884033
sim_compute_sim_state_mean0.03556220438009228
sim_compute_sim_state_median0.033477975476172664
sim_compute_sim_state_min0.03081406014306205
sim_physics_max0.021434974670410157
sim_physics_mean0.018311314951859704
sim_physics_median0.016958528949368383
sim_physics_min0.016629866191319058
sim_render-ego_max0.07217297554016114
sim_render-ego_mean0.06065178025153375
sim_render-ego_median0.059562998433266914
sim_render-ego_min0.052593231201171875
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
179792552Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24485310743273692
survival_time_median1.0000000000000002
deviation-center-line_median0.02780957766589444
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.07734911441802979
agent_compute-ego_mean0.0644793876460265
agent_compute-ego_median0.06607269389288765
agent_compute-ego_min0.04380842947190808
deviation-center-line_max0.1367821242164622
deviation-center-line_mean0.05703768142247749
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792059
deviation-heading_mean0.33854872313755296
deviation-heading_median0.3074760381865352
deviation-heading_min0.16993642764665506
driven_any_max0.9094890302704578
driven_any_mean0.6148172530722962
driven_any_median0.5457640496143875
driven_any_min0.30227389810048894
driven_lanedir_consec_max0.797287526441987
driven_lanedir_consec_mean0.4211897171247365
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.797287526441987
driven_lanedir_mean0.4229139258079286
driven_lanedir_median0.24485310743273692
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.031115078926086427, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.06555004119873047, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.06394060850143432, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.08768852949142455, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.038596820831298825, "sim_compute_performance-ego": 0.0735156774520874, "sim_compute_robot_state-ego": 0.07804630994796753, "sim_compute_robot_state-npc0": 0.0660622239112854, "sim_compute_robot_state-npc1": 0.06691628694534302, "sim_compute_robot_state-npc2": 0.06542384624481201, "sim_compute_robot_state-npc3": 0.06622459888458251}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126896, "sim_physics": 0.03239896718193503, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120295193918956, "sim_render-ego": 0.05788062600528493, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.0712260919458726, "deviation-heading": 0.3074760381865352, "set_robot_commands": 0.09318950596977682, "deviation-center-line": 0.02399911835622947, "driven_lanedir_consec": 0.17258190852322874, "sim_compute_sim_state": 0.03688587861902574, "sim_compute_performance-ego": 0.05760672513176413, "sim_compute_robot_state-ego": 0.06406448869144216, "sim_compute_robot_state-npc0": 0.06330345658694997, "sim_compute_robot_state-npc1": 0.062314692665548885, "sim_compute_robot_state-npc2": 0.06483221054077148, "sim_compute_robot_state-npc3": 0.062727970235488}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30227389810048894, "sim_physics": 0.038460183143615725, "survival_time": 0.49999999999999994, "driven_lanedir": 0.24485310743273692, "sim_render-ego": 0.07264649868011475, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.07734911441802979, "deviation-heading": 0.16993642764665506, "set_robot_commands": 0.1032641887664795, "deviation-center-line": 0.02780957766589444, "driven_lanedir_consec": 0.24485310743273692, "sim_compute_sim_state": 0.04109945297241211, "sim_compute_performance-ego": 0.06903836727142335, "sim_compute_robot_state-ego": 0.08381087779998779, "sim_compute_robot_state-npc0": 0.07991786003112793, "sim_compute_robot_state-npc1": 0.07482740879058838, "sim_compute_robot_state-npc2": 0.0713576078414917, "sim_compute_robot_state-npc3": 0.07022683620452881}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.03319634710039411, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.06283259391784668, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06607269389288765, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.09435335227421351, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.03703471592494419, "sim_compute_performance-ego": 0.06329280989510673, "sim_compute_robot_state-ego": 0.0666426420211792, "sim_compute_robot_state-npc0": 0.0657673818724496, "sim_compute_robot_state-npc1": 0.06702129329953875, "sim_compute_robot_state-npc2": 0.06749027967453003, "sim_compute_robot_state-npc3": 0.0672958493232727}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704578, "sim_physics": 0.020315524070493637, "survival_time": 1.5500000000000007, "driven_lanedir": 0.797287526441987, "sim_render-ego": 0.0402513780901509, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.04380842947190808, "deviation-heading": 0.6295143987792059, "set_robot_commands": 0.05706590221774194, "deviation-center-line": 0.1367821242164622, "driven_lanedir_consec": 0.797287526441987, "sim_compute_sim_state": 0.023408589824553457, "sim_compute_performance-ego": 0.04070857263380481, "sim_compute_robot_state-ego": 0.04233116488302908, "sim_compute_robot_state-npc0": 0.0420002322043142, "sim_compute_robot_state-npc1": 0.040519360573061054, "sim_compute_robot_state-npc2": 0.04057225104301206, "sim_compute_robot_state-npc3": 0.04044438177539456}}
set_robot_commands_max0.1032641887664795
set_robot_commands_mean0.08711229574392726
set_robot_commands_median0.09318950596977682
set_robot_commands_min0.05706590221774194
sim_compute_performance-ego_max0.0735156774520874
sim_compute_performance-ego_mean0.060832430476837285
sim_compute_performance-ego_median0.06329280989510673
sim_compute_performance-ego_min0.04070857263380481
sim_compute_robot_state-ego_max0.08381087779998779
sim_compute_robot_state-ego_mean0.06697909666872115
sim_compute_robot_state-ego_median0.0666426420211792
sim_compute_robot_state-ego_min0.04233116488302908
sim_compute_robot_state-npc0_max0.07991786003112793
sim_compute_robot_state-npc0_mean0.06341023092122543
sim_compute_robot_state-npc0_median0.0657673818724496
sim_compute_robot_state-npc0_min0.0420002322043142
sim_compute_robot_state-npc1_max0.07482740879058838
sim_compute_robot_state-npc1_mean0.062319808454816016
sim_compute_robot_state-npc1_median0.06691628694534302
sim_compute_robot_state-npc1_min0.040519360573061054
sim_compute_robot_state-npc2_max0.0713576078414917
sim_compute_robot_state-npc2_mean0.06193523906892345
sim_compute_robot_state-npc2_median0.06542384624481201
sim_compute_robot_state-npc2_min0.04057225104301206
sim_compute_robot_state-npc3_max0.07022683620452881
sim_compute_robot_state-npc3_mean0.06138392728465332
sim_compute_robot_state-npc3_median0.06622459888458251
sim_compute_robot_state-npc3_min0.04044438177539456
sim_compute_sim_state_max0.04109945297241211
sim_compute_sim_state_mean0.03540509163444687
sim_compute_sim_state_median0.03703471592494419
sim_compute_sim_state_min0.023408589824553457
sim_physics_max0.038460183143615725
sim_physics_mean0.031097220084504985
sim_physics_median0.03239896718193503
sim_physics_min0.020315524070493637
sim_render-ego_max0.07264649868011475
sim_render-ego_mean0.059832227578425545
sim_render-ego_median0.06283259391784668
sim_render-ego_min0.0402513780901509
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
179742367Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6896127428821732
survival_time_median1.1500000000000004
deviation-center-line_median0.05610305022565209
in-drivable-lane_median0.20000000000000007


other stats
agent_compute-ego_max0.1769271829853887
agent_compute-ego_mean0.13122879925721925
agent_compute-ego_median0.11685179812567574
agent_compute-ego_min0.11383742871491806
deviation-center-line_max0.07504669169058735
deviation-center-line_mean0.05629372528587068
deviation-center-line_min0.031337769455374115
deviation-heading_max0.4695314592890065
deviation-heading_mean0.28295632700130013
deviation-heading_median0.28969351082790473
deviation-heading_min0.13822734158708538
driven_any_max1.1972535692377095
driven_any_mean1.069550703128448
driven_any_median1.0381750331691957
driven_any_min1.0257183998178268
driven_lanedir_consec_max0.8123144800841251
driven_lanedir_consec_mean0.6312226729648216
driven_lanedir_consec_min0.4373052105850964
driven_lanedir_max0.9325407987545682
driven_lanedir_mean0.7224147694584564
driven_lanedir_median0.8123144800841251
driven_lanedir_min0.48318684247252186
in-drivable-lane_max0.6000000000000004
in-drivable-lane_mean0.3000000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.03651959555489676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.06234194551195417, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.11685179812567574, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.09224826097488403, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.03530856541224888, "sim_compute_performance-ego": 0.06137596709387643, "sim_compute_robot_state-ego": 0.06130852018083845, "sim_compute_robot_state-npc0": 0.06492011887686593, "sim_compute_robot_state-npc1": 0.0656624606677464, "sim_compute_robot_state-npc2": 0.06126952171325683, "sim_compute_robot_state-npc3": 0.06162181070872715}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.04269418120384216, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.0590113898118337, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.11593157052993774, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.08775275945663452, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03849910696347555, "sim_compute_performance-ego": 0.06285691261291504, "sim_compute_robot_state-ego": 0.06974292794863383, "sim_compute_robot_state-npc0": 0.06408899029095967, "sim_compute_robot_state-npc1": 0.06444156169891357, "sim_compute_robot_state-npc2": 0.06243886550267538, "sim_compute_robot_state-npc3": 0.06581234931945801}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.04339268933171811, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.07114153322966202, "in-drivable-lane": 0, "agent_compute-ego": 0.1769271829853887, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.10358799022176993, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.04197892935379692, "sim_compute_performance-ego": 0.07139340690944505, "sim_compute_robot_state-ego": 0.07878836341526198, "sim_compute_robot_state-npc0": 0.07201671600341797, "sim_compute_robot_state-npc1": 0.07082875915195631, "sim_compute_robot_state-npc2": 0.07236648642498514, "sim_compute_robot_state-npc3": 0.07292282063028087}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.036407387774923576, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.06389683225880498, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.13259601593017578, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.08607917246611221, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.035921449246613876, "sim_compute_performance-ego": 0.06450663442197054, "sim_compute_robot_state-ego": 0.06864939565243929, "sim_compute_robot_state-npc0": 0.06257460428320843, "sim_compute_robot_state-npc1": 0.06214991859767748, "sim_compute_robot_state-npc2": 0.057847904122394066, "sim_compute_robot_state-npc3": 0.0617128558780836}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.030598350193189537, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.05915398183076278, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.11383742871491806, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.08691452897113303, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.03502439415973166, "sim_compute_performance-ego": 0.058340145194012184, "sim_compute_robot_state-ego": 0.0608840507009755, "sim_compute_robot_state-npc0": 0.06449250552965247, "sim_compute_robot_state-npc1": 0.05620384216308594, "sim_compute_robot_state-npc2": 0.05869180223216181, "sim_compute_robot_state-npc3": 0.06027507781982422}}
set_robot_commands_max0.10358799022176993
set_robot_commands_mean0.09131654241810674
set_robot_commands_median0.08775275945663452
set_robot_commands_min0.08607917246611221
sim_compute_performance-ego_max0.07139340690944505
sim_compute_performance-ego_mean0.06369461324644385
sim_compute_performance-ego_median0.06285691261291504
sim_compute_performance-ego_min0.058340145194012184
sim_compute_robot_state-ego_max0.07878836341526198
sim_compute_robot_state-ego_mean0.06787465157962981
sim_compute_robot_state-ego_median0.06864939565243929
sim_compute_robot_state-ego_min0.0608840507009755
sim_compute_robot_state-npc0_max0.07201671600341797
sim_compute_robot_state-npc0_mean0.0656185869968209
sim_compute_robot_state-npc0_median0.06449250552965247
sim_compute_robot_state-npc0_min0.06257460428320843
sim_compute_robot_state-npc1_max0.07082875915195631
sim_compute_robot_state-npc1_mean0.06385730845587594
sim_compute_robot_state-npc1_median0.06444156169891357
sim_compute_robot_state-npc1_min0.05620384216308594
sim_compute_robot_state-npc2_max0.07236648642498514
sim_compute_robot_state-npc2_mean0.06252291599909464
sim_compute_robot_state-npc2_median0.06126952171325683
sim_compute_robot_state-npc2_min0.057847904122394066
sim_compute_robot_state-npc3_max0.07292282063028087
sim_compute_robot_state-npc3_mean0.06446898287127477
sim_compute_robot_state-npc3_median0.0617128558780836
sim_compute_robot_state-npc3_min0.06027507781982422
sim_compute_sim_state_max0.04197892935379692
sim_compute_sim_state_mean0.03734648902717337
sim_compute_sim_state_median0.035921449246613876
sim_compute_sim_state_min0.03502439415973166
sim_physics_max0.04339268933171811
sim_physics_mean0.03792244081171403
sim_physics_median0.03651959555489676
sim_physics_min0.030598350193189537
sim_render-ego_max0.07114153322966202
sim_render-ego_mean0.06310913652860353
sim_render-ego_median0.06234194551195417
sim_render-ego_min0.0590113898118337
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2100000000000004
survival_time_min1.1500000000000004
No reset possible
179692375Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-25-98-97660:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2501898935829012
survival_time_median2.6499999999999986
deviation-center-line_median0.02537368915309797
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.07016275963693294
agent_compute-ego_mean0.059596737702960215
agent_compute-ego_median0.06438519015456691
agent_compute-ego_min0.04159704244361734
deviation-center-line_max0.03958613065683618
deviation-center-line_mean0.02918970941936276
deviation-center-line_min0.020890767023363815
deviation-heading_max0.20304552908957563
deviation-heading_mean0.1920323650242732
deviation-heading_median0.1949200760095926
deviation-heading_min0.17840427823186208
driven_any_max1.59
driven_any_mean1.349999999999999
driven_any_median1.5899999999999932
driven_any_min0.9900000000000008
driven_lanedir_consec_max1.3567189392346433
driven_lanedir_consec_mean1.0593730735411984
driven_lanedir_consec_min0.6561020726944444
driven_lanedir_max1.3567189392346433
driven_lanedir_mean1.0593730735411984
driven_lanedir_median1.2501898935829012
driven_lanedir_min0.6561020726944444
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.4299999999999992
in-drivable-lane_min0.30000000000000027
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900000000000012, "sim_physics": 0.017783569567131275, "survival_time": 1.6500000000000008, "driven_lanedir": 0.6561020726944444, "sim_render-ego": 0.06379073316400702, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.06540364207643451, "deviation-heading": 0.18074641270076017, "set_robot_commands": 0.09565719691189851, "deviation-center-line": 0.020890767023363815, "driven_lanedir_consec": 0.6561020726944444, "sim_compute_sim_state": 0.03782286788478042, "sim_compute_performance-ego": 0.06504930871905702, "sim_compute_robot_state-ego": 0.07302666432929761}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900000000000008, "sim_physics": 0.01869672717470111, "survival_time": 1.6500000000000008, "driven_lanedir": 0.7836645686111028, "sim_render-ego": 0.059779961903889976, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.06438519015456691, "deviation-heading": 0.1949200760095926, "set_robot_commands": 0.09731987750891484, "deviation-center-line": 0.03958613065683618, "driven_lanedir_consec": 0.7836645686111028, "sim_compute_sim_state": 0.04004183682528409, "sim_compute_performance-ego": 0.06177256324074485, "sim_compute_robot_state-ego": 0.06636605118260239}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5899999999999932, "sim_physics": 0.024351835250854492, "survival_time": 2.6499999999999986, "driven_lanedir": 1.3567189392346433, "sim_render-ego": 0.07165621361642513, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.07016275963693294, "deviation-heading": 0.17840427823186208, "set_robot_commands": 0.11086885884123028, "deviation-center-line": 0.034724271110417856, "driven_lanedir_consec": 1.3567189392346433, "sim_compute_sim_state": 0.04543968416609854, "sim_compute_performance-ego": 0.07444989456320708, "sim_compute_robot_state-ego": 0.08239877448891694}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59, "sim_physics": 0.0142269899260323, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.04452722927309432, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04159704244361734, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.06838625781940964, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.02829542250003455, "sim_compute_performance-ego": 0.04672395058397977, "sim_compute_robot_state-ego": 0.04829416185055139}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.59, "sim_physics": 0.01976073013161713, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.058290000231760855, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.056435054203249374, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.08479273544167573, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.03421858121763985, "sim_compute_performance-ego": 0.06062961524387576, "sim_compute_robot_state-ego": 0.06314861999367768}}
set_robot_commands_max0.11086885884123028
set_robot_commands_mean0.0914049853046258
set_robot_commands_median0.09565719691189851
set_robot_commands_min0.06838625781940964
sim_compute_performance-ego_max0.07444989456320708
sim_compute_performance-ego_mean0.061725066470172896
sim_compute_performance-ego_median0.06177256324074485
sim_compute_performance-ego_min0.04672395058397977
sim_compute_robot_state-ego_max0.08239877448891694
sim_compute_robot_state-ego_mean0.06664685436900922
sim_compute_robot_state-ego_median0.06636605118260239
sim_compute_robot_state-ego_min0.04829416185055139
sim_compute_sim_state_max0.04543968416609854
sim_compute_sim_state_mean0.03716367851876749
sim_compute_sim_state_median0.03782286788478042
sim_compute_sim_state_min0.02829542250003455
sim_physics_max0.024351835250854492
sim_physics_mean0.01896397041006726
sim_physics_median0.01869672717470111
sim_physics_min0.0142269899260323
sim_render-ego_max0.07165621361642513
sim_render-ego_mean0.05960882763783546
sim_render-ego_median0.059779961903889976
sim_render-ego_min0.04452722927309432
simulation-passed1
survival_time_max2.6499999999999986
survival_time_mean2.249999999999999
survival_time_min1.6500000000000008
No reset possible
179642388Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.04697203436506503
survival_time_median0.49999999999999994
deviation-center-line_median0.005483517752038102
in-drivable-lane_median0.24999999999999992


other stats
agent_compute-ego_max0.1832377380794949
agent_compute-ego_mean0.1626078046692742
agent_compute-ego_median0.16415541172027587
agent_compute-ego_min0.14656858444213866
deviation-center-line_max0.010957600800593771
deviation-center-line_mean0.007024108527906314
deviation-center-line_min0.004671339705683301
deviation-heading_max0.2286569842151092
deviation-heading_mean0.18429563554031225
deviation-heading_median0.17019208586391282
deviation-heading_min0.15984706164282908
driven_any_max0.16592186652227786
driven_any_mean0.15267418704628016
driven_any_median0.1557493769774621
driven_any_min0.13416875855406785
driven_lanedir_consec_max0.0673382198181165
driven_lanedir_consec_mean0.04964144665312888
driven_lanedir_consec_min0.04204622902833366
driven_lanedir_max0.0673382198181165
driven_lanedir_mean0.04964144665312888
driven_lanedir_median0.04697203436506503
driven_lanedir_min0.04204622902833366
in-drivable-lane_max0.24999999999999992
in-drivable-lane_mean0.19999999999999996
in-drivable-lane_min0.09999999999999998
per-episodes
details{"udem1-0-0": {"driven_any": 0.15969697013565934, "sim_physics": 0.03200976848602295, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04697203436506503, "sim_render-ego": 0.05362379550933838, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.14656858444213866, "deviation-heading": 0.15984706164282908, "set_robot_commands": 0.07066850662231446, "deviation-center-line": 0.004671339705683301, "driven_lanedir_consec": 0.04697203436506503, "sim_compute_sim_state": 0.03177773952484131, "sim_compute_performance-ego": 0.05371394157409668, "sim_compute_robot_state-ego": 0.055598115921020506, "sim_compute_robot_state-npc0": 0.05293083190917969, "sim_compute_robot_state-npc1": 0.05379295349121094, "sim_compute_robot_state-npc2": 0.05029611587524414, "sim_compute_robot_state-npc3": 0.05399637222290039}, "udem1-1-0": {"driven_any": 0.1478339630419336, "sim_physics": 0.039798200130462646, "survival_time": 0.4, "driven_lanedir": 0.0673382198181165, "sim_render-ego": 0.05433166027069092, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.15443474054336548, "deviation-heading": 0.19994996389483705, "set_robot_commands": 0.08078712224960327, "deviation-center-line": 0.010957600800593771, "driven_lanedir_consec": 0.0673382198181165, "sim_compute_sim_state": 0.030945628881454468, "sim_compute_performance-ego": 0.05746191740036011, "sim_compute_robot_state-ego": 0.06420806050300598, "sim_compute_robot_state-npc0": 0.06009113788604736, "sim_compute_robot_state-npc1": 0.05509340763092041, "sim_compute_robot_state-npc2": 0.058286577463150024, "sim_compute_robot_state-npc3": 0.05957844853401184}, "udem1-2-0": {"driven_any": 0.16592186652227786, "sim_physics": 0.03738124370574951, "survival_time": 0.49999999999999994, "driven_lanedir": 0.048204641500074974, "sim_render-ego": 0.06322364807128907, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.1646425485610962, "deviation-heading": 0.1628320820848731, "set_robot_commands": 0.08628981113433838, "deviation-center-line": 0.005483517752038102, "driven_lanedir_consec": 0.048204641500074974, "sim_compute_sim_state": 0.033576154708862306, "sim_compute_performance-ego": 0.06774210929870605, "sim_compute_robot_state-ego": 0.06450145244598389, "sim_compute_robot_state-npc0": 0.06035401821136475, "sim_compute_robot_state-npc1": 0.05755305290222168, "sim_compute_robot_state-npc2": 0.06106679439544678, "sim_compute_robot_state-npc3": 0.06260912418365479}, "udem1-3-0": {"driven_any": 0.13416875855406785, "sim_physics": 0.04094129138522678, "survival_time": 0.45, "driven_lanedir": 0.04204622902833366, "sim_render-ego": 0.07117854224310981, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.1832377380794949, "deviation-heading": 0.2286569842151092, "set_robot_commands": 0.10587700208028156, "deviation-center-line": 0.008648296643625056, "driven_lanedir_consec": 0.04204622902833366, "sim_compute_sim_state": 0.04007927576700846, "sim_compute_performance-ego": 0.07365359200371636, "sim_compute_robot_state-ego": 0.08076723416646321, "sim_compute_robot_state-npc0": 0.0682928827073839, "sim_compute_robot_state-npc1": 0.06822074784172906, "sim_compute_robot_state-npc2": 0.0710079934861925, "sim_compute_robot_state-npc3": 0.07066104147169325}, "udem1-4-0": {"driven_any": 0.1557493769774621, "sim_physics": 0.03817660808563232, "survival_time": 0.49999999999999994, "driven_lanedir": 0.043646108554054264, "sim_render-ego": 0.0742647647857666, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.16415541172027587, "deviation-heading": 0.17019208586391282, "set_robot_commands": 0.0984065055847168, "deviation-center-line": 0.005359787737591341, "driven_lanedir_consec": 0.043646108554054264, "sim_compute_sim_state": 0.041521239280700686, "sim_compute_performance-ego": 0.07167201042175293, "sim_compute_robot_state-ego": 0.07454841136932373, "sim_compute_robot_state-npc0": 0.0673607349395752, "sim_compute_robot_state-npc1": 0.06729016304016114, "sim_compute_robot_state-npc2": 0.06775250434875488, "sim_compute_robot_state-npc3": 0.06903355121612549}}
set_robot_commands_max0.10587700208028156
set_robot_commands_mean0.08840578953425089
set_robot_commands_median0.08628981113433838
set_robot_commands_min0.07066850662231446
sim_compute_performance-ego_max0.07365359200371636
sim_compute_performance-ego_mean0.06484871413972643
sim_compute_performance-ego_median0.06774210929870605
sim_compute_performance-ego_min0.05371394157409668
sim_compute_robot_state-ego_max0.08076723416646321
sim_compute_robot_state-ego_mean0.06792465488115947
sim_compute_robot_state-ego_median0.06450145244598389
sim_compute_robot_state-ego_min0.055598115921020506
sim_compute_robot_state-npc0_max0.0682928827073839
sim_compute_robot_state-npc0_mean0.06180592113071017
sim_compute_robot_state-npc0_median0.06035401821136475
sim_compute_robot_state-npc0_min0.05293083190917969
sim_compute_robot_state-npc1_max0.06822074784172906
sim_compute_robot_state-npc1_mean0.06039006498124864
sim_compute_robot_state-npc1_median0.05755305290222168
sim_compute_robot_state-npc1_min0.05379295349121094
sim_compute_robot_state-npc2_max0.0710079934861925
sim_compute_robot_state-npc2_mean0.06168199711375766
sim_compute_robot_state-npc2_median0.06106679439544678
sim_compute_robot_state-npc2_min0.05029611587524414
sim_compute_robot_state-npc3_max0.07066104147169325
sim_compute_robot_state-npc3_mean0.06317570752567715
sim_compute_robot_state-npc3_median0.06260912418365479
sim_compute_robot_state-npc3_min0.05399637222290039
sim_compute_sim_state_max0.041521239280700686
sim_compute_sim_state_mean0.03558000763257344
sim_compute_sim_state_median0.033576154708862306
sim_compute_sim_state_min0.030945628881454468
sim_physics_max0.04094129138522678
sim_physics_mean0.03766142235861884
sim_physics_median0.03817660808563232
sim_physics_min0.03200976848602295
sim_render-ego_max0.0742647647857666
sim_render-ego_mean0.06332448217603895
sim_render-ego_median0.06322364807128907
sim_render-ego_min0.05362379550933838
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.4699999999999999
survival_time_min0.4
No reset possible
179602543Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-25-98-97660:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.1613469340584495
agent_compute-ego_mean0.14723288833528753
agent_compute-ego_median0.14702717463175455
agent_compute-ego_min0.13282879539158032
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.017889955769414486, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06069878909898841, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.14349324806876804, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.08681835298952849, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.03164186684981636, "sim_compute_performance-ego": 0.06227168829544731, "sim_compute_robot_state-ego": 0.06486689526101817}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.016643772954526154, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.05497692978900412, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.13282879539158032, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07728237691132919, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.03201795660931131, "sim_compute_performance-ego": 0.05959710867508598, "sim_compute_robot_state-ego": 0.06385065161663553}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.022855975411155006, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.06649844212965532, "in-drivable-lane": 0, "agent_compute-ego": 0.1613469340584495, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.103225361217152, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.04017683592709628, "sim_compute_performance-ego": 0.07118783213875511, "sim_compute_robot_state-ego": 0.0742060813036832}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.019079499774509005, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.05542588233947754, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.14702717463175455, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.10417813724941676, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.03948150740729438, "sim_compute_performance-ego": 0.06043537457784017, "sim_compute_robot_state-ego": 0.0677440431382921}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.022684988222624127, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06607668023360402, "in-drivable-lane": 0, "agent_compute-ego": 0.15146828952588534, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.09810072497317664, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.03974113966289319, "sim_compute_performance-ego": 0.06437346809788753, "sim_compute_robot_state-ego": 0.07572831605610095}}
set_robot_commands_max0.10417813724941676
set_robot_commands_mean0.0939209906681206
set_robot_commands_median0.09810072497317664
set_robot_commands_min0.07728237691132919
sim_compute_performance-ego_max0.07118783213875511
sim_compute_performance-ego_mean0.06357309435700322
sim_compute_performance-ego_median0.06227168829544731
sim_compute_performance-ego_min0.05959710867508598
sim_compute_robot_state-ego_max0.07572831605610095
sim_compute_robot_state-ego_mean0.06927919747514599
sim_compute_robot_state-ego_median0.0677440431382921
sim_compute_robot_state-ego_min0.06385065161663553
sim_compute_sim_state_max0.04017683592709628
sim_compute_sim_state_mean0.036611861291282306
sim_compute_sim_state_median0.03948150740729438
sim_compute_sim_state_min0.03164186684981636
sim_physics_max0.022855975411155006
sim_physics_mean0.019830838426445757
sim_physics_median0.019079499774509005
sim_physics_min0.016643772954526154
sim_render-ego_max0.06649844212965532
sim_render-ego_mean0.06073534471814588
sim_render-ego_median0.06069878909898841
sim_render-ego_min0.05497692978900412
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
179482467Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-25-98-97660:04:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.15816493656324304
agent_compute-ego_mean0.14353319464456638
agent_compute-ego_median0.14507238070170084
agent_compute-ego_min0.12956323406913064
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.02222281953562861, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.07118459369825281, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.15816493656324304, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.09846681097279424, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.04080076839612878, "sim_compute_performance-ego": 0.07223445436228877, "sim_compute_robot_state-ego": 0.07723570906597635}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.017613099968951683, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.05573505940644637, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.13059703163478686, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.0853415468464727, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.03163761677949325, "sim_compute_performance-ego": 0.06050284012504246, "sim_compute_robot_state-ego": 0.059420564900273865}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.017894528128884056, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.05568054589358243, "in-drivable-lane": 0, "agent_compute-ego": 0.12956323406913064, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.07833469997752797, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.031647411259737884, "sim_compute_performance-ego": 0.05466272614218972, "sim_compute_robot_state-ego": 0.058169321580366654}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.018694162368774418, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.05748642815483941, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.14507238070170084, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.0801728301578098, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.033463478088378906, "sim_compute_performance-ego": 0.05885963969760471, "sim_compute_robot_state-ego": 0.06054944462246365}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.0207175706562243, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06758653490166915, "in-drivable-lane": 0, "agent_compute-ego": 0.1542683902539705, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.1006558568854081, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.041726689589651006, "sim_compute_performance-ego": 0.07328846580103825, "sim_compute_robot_state-ego": 0.07434989276685212}}
set_robot_commands_max0.1006558568854081
set_robot_commands_mean0.08859434896800256
set_robot_commands_median0.0853415468464727
set_robot_commands_min0.07833469997752797
sim_compute_performance-ego_max0.07328846580103825
sim_compute_performance-ego_mean0.06390962522563279
sim_compute_performance-ego_median0.06050284012504246
sim_compute_performance-ego_min0.05466272614218972
sim_compute_robot_state-ego_max0.07723570906597635
sim_compute_robot_state-ego_mean0.06594498658718653
sim_compute_robot_state-ego_median0.06054944462246365
sim_compute_robot_state-ego_min0.058169321580366654
sim_compute_sim_state_max0.041726689589651006
sim_compute_sim_state_mean0.03585519282267797
sim_compute_sim_state_median0.033463478088378906
sim_compute_sim_state_min0.03163761677949325
sim_physics_max0.02222281953562861
sim_physics_mean0.019428436131692615
sim_physics_median0.018694162368774418
sim_physics_min0.017613099968951683
sim_render-ego_max0.07118459369825281
sim_render-ego_mean0.06153463241095804
sim_render-ego_median0.05748642815483941
sim_render-ego_min0.05568054589358243
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
179442501jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:00:27
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
179362542Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:00:34
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
179282488Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:00:30
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
179042411jiang pengBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:21:54
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
179012429Andrea Censi 🇨🇭random_agentaido2-LF-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:00:28
The container "solut [...]
The container "solution" exited with code 2.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178992433Andrea Censi 🇨🇭random_agentaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:00:32
The container "solut [...]
The container "solution" exited with code 2.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178972460Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:00:30
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178902480Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:00:30
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178892484Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:00:30
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178852505Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:00:28
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178762376Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2501898935829012
survival_time_median2.6499999999999986
deviation-center-line_median0.02537368915309797
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.07120370415021789
agent_compute-ego_mean0.05797204933144693
agent_compute-ego_median0.061934331677994635
agent_compute-ego_min0.04356268680456913
deviation-center-line_max0.03958613065683618
deviation-center-line_mean0.02918970941936276
deviation-center-line_min0.020890767023363815
deviation-heading_max0.20304552908957563
deviation-heading_mean0.1920323650242732
deviation-heading_median0.1949200760095926
deviation-heading_min0.17840427823186208
driven_any_max1.59
driven_any_mean1.349999999999999
driven_any_median1.5899999999999932
driven_any_min0.9900000000000008
driven_lanedir_consec_max1.3567189392346433
driven_lanedir_consec_mean1.0593730735411984
driven_lanedir_consec_min0.6561020726944444
driven_lanedir_max1.3567189392346433
driven_lanedir_mean1.0593730735411984
driven_lanedir_median1.2501898935829012
driven_lanedir_min0.6561020726944444
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.4299999999999992
in-drivable-lane_min0.30000000000000027
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900000000000012, "sim_physics": 0.01370373639193448, "survival_time": 1.6500000000000008, "driven_lanedir": 0.6561020726944444, "sim_render-ego": 0.04556213003216368, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.045944387262517754, "deviation-heading": 0.18074641270076017, "set_robot_commands": 0.07075035210811731, "deviation-center-line": 0.020890767023363815, "driven_lanedir_consec": 0.6561020726944444, "sim_compute_sim_state": 0.02864196083762429, "sim_compute_performance-ego": 0.04563198667584044, "sim_compute_robot_state-ego": 0.04717898368835449}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900000000000008, "sim_physics": 0.013060251871744793, "survival_time": 1.6500000000000008, "driven_lanedir": 0.7836645686111028, "sim_render-ego": 0.04651590549584591, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.04356268680456913, "deviation-heading": 0.1949200760095926, "set_robot_commands": 0.06960233775052158, "deviation-center-line": 0.03958613065683618, "driven_lanedir_consec": 0.7836645686111028, "sim_compute_sim_state": 0.02792089635675604, "sim_compute_performance-ego": 0.05259102041071111, "sim_compute_robot_state-ego": 0.0526741056731253}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5899999999999932, "sim_physics": 0.02042247214407291, "survival_time": 2.6499999999999986, "driven_lanedir": 1.3567189392346433, "sim_render-ego": 0.06203886248030752, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.061934331677994635, "deviation-heading": 0.17840427823186208, "set_robot_commands": 0.093107781320248, "deviation-center-line": 0.034724271110417856, "driven_lanedir_consec": 1.3567189392346433, "sim_compute_sim_state": 0.0377284400867966, "sim_compute_performance-ego": 0.06467991954875442, "sim_compute_robot_state-ego": 0.06678552447624926}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59, "sim_physics": 0.024519452508890403, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.0678342693256882, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.06721513676193525, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.10560775702854372, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.04046143225903781, "sim_compute_performance-ego": 0.0713609794400773, "sim_compute_robot_state-ego": 0.07670858671080391}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.59, "sim_physics": 0.027089523819257628, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.06756472137739074, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.07120370415021789, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.10603812055767708, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.04104654294139934, "sim_compute_performance-ego": 0.0716844324795705, "sim_compute_robot_state-ego": 0.07903292044153754}}
set_robot_commands_max0.10603812055767708
set_robot_commands_mean0.08902126975302155
set_robot_commands_median0.093107781320248
set_robot_commands_min0.06960233775052158
sim_compute_performance-ego_max0.0716844324795705
sim_compute_performance-ego_mean0.06118966771099075
sim_compute_performance-ego_median0.06467991954875442
sim_compute_performance-ego_min0.04563198667584044
sim_compute_robot_state-ego_max0.07903292044153754
sim_compute_robot_state-ego_mean0.0644760241980141
sim_compute_robot_state-ego_median0.06678552447624926
sim_compute_robot_state-ego_min0.04717898368835449
sim_compute_sim_state_max0.04104654294139934
sim_compute_sim_state_mean0.035159854496322814
sim_compute_sim_state_median0.0377284400867966
sim_compute_sim_state_min0.02792089635675604
sim_physics_max0.027089523819257628
sim_physics_mean0.01975908734718004
sim_physics_median0.02042247214407291
sim_physics_min0.013060251871744793
sim_render-ego_max0.0678342693256882
sim_render-ego_mean0.05790317774227921
sim_render-ego_median0.06203886248030752
sim_render-ego_min0.04556213003216368
simulation-passed1
survival_time_max2.6499999999999986
survival_time_mean2.249999999999999
survival_time_min1.6500000000000008
No reset possible
178532446Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:20:47
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178462421Andrea Censi 🇨🇭random_agentaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:09:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2342705027983982
survival_time_median1.7500000000000009
deviation-center-line_median0.10801953665034704
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.1432378784058586
agent_compute-ego_mean0.13120158885757172
agent_compute-ego_median0.13468088642243417
agent_compute-ego_min0.11926909855433872
deviation-center-line_max0.17768774509810673
deviation-center-line_mean0.08758489727910898
deviation-center-line_min0.019005533143064354
deviation-heading_max0.759385645220147
deviation-heading_mean0.3195081252333424
deviation-heading_median0.1806788823983304
deviation-heading_min0.118601117425238
driven_any_max2.812198352312563
driven_any_mean1.6891781761410722
driven_any_median1.608242001486626
driven_any_min0.3130680825984642
driven_lanedir_consec_max1.7389031534183392
driven_lanedir_consec_mean0.9694700664283822
driven_lanedir_consec_min0.28316071129320397
driven_lanedir_max1.7389031534183392
driven_lanedir_mean0.9694700664283822
driven_lanedir_median1.2342705027983982
driven_lanedir_min0.28316071129320397
in-drivable-lane_max1.5999999999999988
in-drivable-lane_mean0.7299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.0382308234339175, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06583612898121709, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.13573528372723123, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.09724294621011484, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.03988058670707371, "sim_compute_performance-ego": 0.07101613542307979, "sim_compute_robot_state-ego": 0.07768963730853537, "sim_compute_robot_state-npc0": 0.07231535082278044, "sim_compute_robot_state-npc1": 0.07251614073048467, "sim_compute_robot_state-npc2": 0.07025445025900136, "sim_compute_robot_state-npc3": 0.07375589660976244}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.03826252106697329, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.06388850365915606, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.13468088642243417, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.09650796075021068, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.03789123027555404, "sim_compute_performance-ego": 0.06605133702678065, "sim_compute_robot_state-ego": 0.07113884725878315, "sim_compute_robot_state-npc0": 0.06885232079413629, "sim_compute_robot_state-npc1": 0.06664920237756544, "sim_compute_robot_state-npc2": 0.06649193071549939, "sim_compute_robot_state-npc3": 0.06857308649247693}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.024414266858782088, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.05233052798679897, "in-drivable-lane": 0, "agent_compute-ego": 0.11926909855433872, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.0851999010358538, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.025329385484967912, "sim_compute_performance-ego": 0.04858425685337612, "sim_compute_robot_state-ego": 0.04879137447902134, "sim_compute_robot_state-npc0": 0.05170014926365444, "sim_compute_robot_state-npc1": 0.0469693796975272, "sim_compute_robot_state-npc2": 0.04849747249058315, "sim_compute_robot_state-npc3": 0.05141786166599819}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.027505568095615933, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.058521665845598494, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.12308479717799596, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.08438595363071986, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.03703463418143136, "sim_compute_performance-ego": 0.06260496548243931, "sim_compute_robot_state-ego": 0.06600443295070103, "sim_compute_robot_state-npc0": 0.06413049697875976, "sim_compute_robot_state-npc1": 0.06327896799360003, "sim_compute_robot_state-npc2": 0.06226176534380232, "sim_compute_robot_state-npc3": 0.06463487488882882}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.03651553108578637, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.06635368816436284, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.1432378784058586, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.10323839338998946, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.03957452092851911, "sim_compute_performance-ego": 0.06883428588746086, "sim_compute_robot_state-ego": 0.07578937591068328, "sim_compute_robot_state-npc0": 0.07031198531862289, "sim_compute_robot_state-npc1": 0.06934399831862677, "sim_compute_robot_state-npc2": 0.06961575765458364, "sim_compute_robot_state-npc3": 0.07167111502753364}}
set_robot_commands_max0.10323839338998946
set_robot_commands_mean0.09331503100337774
set_robot_commands_median0.09650796075021068
set_robot_commands_min0.08438595363071986
sim_compute_performance-ego_max0.07101613542307979
sim_compute_performance-ego_mean0.06341819613462735
sim_compute_performance-ego_median0.06605133702678065
sim_compute_performance-ego_min0.04858425685337612
sim_compute_robot_state-ego_max0.07768963730853537
sim_compute_robot_state-ego_mean0.06788273358154484
sim_compute_robot_state-ego_median0.07113884725878315
sim_compute_robot_state-ego_min0.04879137447902134
sim_compute_robot_state-npc0_max0.07231535082278044
sim_compute_robot_state-npc0_mean0.06546206063559076
sim_compute_robot_state-npc0_median0.06885232079413629
sim_compute_robot_state-npc0_min0.05170014926365444
sim_compute_robot_state-npc1_max0.07251614073048467
sim_compute_robot_state-npc1_mean0.06375153782356083
sim_compute_robot_state-npc1_median0.06664920237756544
sim_compute_robot_state-npc1_min0.0469693796975272
sim_compute_robot_state-npc2_max0.07025445025900136
sim_compute_robot_state-npc2_mean0.06342427529269397
sim_compute_robot_state-npc2_median0.06649193071549939
sim_compute_robot_state-npc2_min0.04849747249058315
sim_compute_robot_state-npc3_max0.07375589660976244
sim_compute_robot_state-npc3_mean0.06601056693692
sim_compute_robot_state-npc3_median0.06857308649247693
sim_compute_robot_state-npc3_min0.05141786166599819
sim_compute_sim_state_max0.03988058670707371
sim_compute_sim_state_mean0.035942071515509225
sim_compute_sim_state_median0.03789123027555404
sim_compute_sim_state_min0.025329385484967912
sim_physics_max0.03826252106697329
sim_physics_mean0.03298574210821504
sim_physics_median0.03651553108578637
sim_physics_min0.024414266858782088
sim_render-ego_max0.06635368816436284
sim_render-ego_mean0.06138610292742669
sim_render-ego_median0.06388850365915606
sim_render-ego_min0.05233052798679897
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.899999999999999
survival_time_min0.35
No reset possible