Duckietown Challenges Home Challenges Submissions

Evaluator 1732

ID1732
evaluatorp-1
ownerI don't have one 😀
machineccb2d4f7342b
processp-1
versiond-c:5.1.1;d-c-r:5.0.12;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success8 32997
# timeout
# failed
# error4 33047
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
330536684Anthony Courchesne 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationerroryesp-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
330506683Anthony Courchesne 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationerroryesp-10:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
330486682Anthony Courchesne 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationerroryesp-10:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
330476681Anthony Courchesne 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationerroryesp-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
330316672Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:12:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.467125507442073
survival_time_median14.950000000000076
deviation-center-line_median1.0156143495644685
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.41667431144304173
agent_compute-ego_mean0.35408003293919477
agent_compute-ego_median0.3745146218935649
agent_compute-ego_min0.2788011288642883
deviation-center-line_max2.271602413611514
deviation-center-line_mean1.267258537253567
deviation-center-line_min0.21922163544582832
deviation-heading_max6.405479979525619
deviation-heading_mean4.165516011637489
deviation-heading_median4.6748340659233145
deviation-heading_min1.4811605816625506
driven_any_max6.707146700404721
driven_any_mean2.774597816206848
driven_any_median1.6840417569710089
driven_any_min1.2344332164431937
driven_lanedir_consec_max5.085726530851964
driven_lanedir_consec_mean2.206076946661735
driven_lanedir_consec_min0.8114609081144724
driven_lanedir_max5.940565031442432
driven_lanedir_mean2.3770446467798285
driven_lanedir_median1.467125507442073
driven_lanedir_min0.8114609081144724
in-drivable-lane_max1.5499999999999965
in-drivable-lane_mean0.5699999999999987
in-drivable-lane_min0.04999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 6.707146700404721, "sim_physics": 0.05892474253972371, "survival_time": 14.950000000000076, "driven_lanedir": 5.940565031442432, "sim_render-ego": 0.01110787868499756, "in-drivable-lane": 0.8999999999999981, "agent_compute-ego": 0.2788011288642883, "deviation-heading": 4.6748340659233145, "set_robot_commands": 0.0062954409917195635, "deviation-center-line": 1.0156143495644685, "driven_lanedir_consec": 5.085726530851964, "sim_compute_sim_state": 0.003931694825490315, "sim_compute_performance-ego": 0.006780961354573568, "sim_compute_robot_state-ego": 0.008195676803588868}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2344332164431937, "sim_physics": 0.0625585150718689, "survival_time": 14.950000000000076, "driven_lanedir": 0.9804009436610344, "sim_render-ego": 0.010369192759195964, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.3957629362742106, "deviation-heading": 6.263470638720892, "set_robot_commands": 0.006546340783437093, "deviation-center-line": 2.2599351305509976, "driven_lanedir_consec": 0.9804009436610344, "sim_compute_sim_state": 0.0038384215037027994, "sim_compute_performance-ego": 0.006111443042755127, "sim_compute_robot_state-ego": 0.007441245714823405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6840417569710089, "sim_physics": 0.06411024411519368, "survival_time": 14.950000000000076, "driven_lanedir": 1.467125507442073, "sim_render-ego": 0.010369717280069989, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.3745146218935649, "deviation-heading": 6.405479979525619, "set_robot_commands": 0.0063693785667419435, "deviation-center-line": 2.271602413611514, "driven_lanedir_consec": 1.467125507442073, "sim_compute_sim_state": 0.003764288425445557, "sim_compute_performance-ego": 0.006149616241455078, "sim_compute_robot_state-ego": 0.007270613511403402}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.435351335583154, "sim_physics": 0.06731784471901514, "survival_time": 4.6499999999999915, "driven_lanedir": 0.8114609081144724, "sim_render-ego": 0.01016642714059481, "in-drivable-lane": 1.5499999999999965, "agent_compute-ego": 0.41667431144304173, "deviation-heading": 2.002634792355072, "set_robot_commands": 0.005897593754594044, "deviation-center-line": 0.21922163544582832, "driven_lanedir_consec": 0.8114609081144724, "sim_compute_sim_state": 0.003385879660165438, "sim_compute_performance-ego": 0.00561974125523721, "sim_compute_robot_state-ego": 0.006792053099601499}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8120160716321627, "sim_physics": 0.06719183530963835, "survival_time": 6.099999999999986, "driven_lanedir": 2.685670843239131, "sim_render-ego": 0.011825317242106451, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.30464716622086824, "deviation-heading": 1.4811605816625506, "set_robot_commands": 0.00612347243262119, "deviation-center-line": 0.5699191570950265, "driven_lanedir_consec": 2.685670843239131, "sim_compute_sim_state": 0.003726623097404105, "sim_compute_performance-ego": 0.006020403299175325, "sim_compute_robot_state-ego": 0.006980126021338291}}
set_robot_commands_max0.006546340783437093
set_robot_commands_mean0.006246445305822767
set_robot_commands_median0.0062954409917195635
set_robot_commands_min0.005897593754594044
sim_compute_performance-ego_max0.006780961354573568
sim_compute_performance-ego_mean0.006136433038639261
sim_compute_performance-ego_median0.006111443042755127
sim_compute_performance-ego_min0.00561974125523721
sim_compute_robot_state-ego_max0.008195676803588868
sim_compute_robot_state-ego_mean0.007335943030151093
sim_compute_robot_state-ego_median0.007270613511403402
sim_compute_robot_state-ego_min0.006792053099601499
sim_compute_sim_state_max0.003931694825490315
sim_compute_sim_state_mean0.003729381502441643
sim_compute_sim_state_median0.003764288425445557
sim_compute_sim_state_min0.003385879660165438
sim_physics_max0.06731784471901514
sim_physics_mean0.06402063635108796
sim_physics_median0.06411024411519368
sim_physics_min0.05892474253972371
sim_render-ego_max0.011825317242106451
sim_render-ego_mean0.010767706621392956
sim_render-ego_median0.010369717280069989
sim_render-ego_min0.01016642714059481
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.120000000000044
survival_time_min4.6499999999999915
No reset possible
330286671Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:10:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1336861453988236
survival_time_median11.450000000000028
deviation-center-line_median0.5325445403759834
in-drivable-lane_median2.500000000000016


other stats
agent_compute-ego_max0.2784035078684489
agent_compute-ego_mean0.24857522683250055
agent_compute-ego_median0.24404470681103035
agent_compute-ego_min0.22160341049813984
deviation-center-line_max0.6895083025712629
deviation-center-line_mean0.49166921192032176
deviation-center-line_min0.2540061183307593
deviation-heading_max3.101914001818309
deviation-heading_mean2.102570138135988
deviation-heading_median2.123567059948401
deviation-heading_min1.1060853021055517
driven_any_max4.675785751261526
driven_any_mean3.262995017887085
driven_any_median3.829153663502375
driven_any_min1.2908783891314075
driven_lanedir_consec_max3.915712138263706
driven_lanedir_consec_mean2.7439681793845723
driven_lanedir_consec_min0.979183589481859
driven_lanedir_max3.915712138263706
driven_lanedir_mean2.754021741075901
driven_lanedir_median3.1839539538554664
driven_lanedir_min0.979183589481859
in-drivable-lane_max10.050000000000086
in-drivable-lane_mean3.61000000000003
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2908783891314075, "sim_physics": 0.062219153131757465, "survival_time": 3.4999999999999956, "driven_lanedir": 0.979183589481859, "sim_render-ego": 0.012652976172310966, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.22862043380737304, "deviation-heading": 1.40685319526287, "set_robot_commands": 0.007436421939304896, "deviation-center-line": 0.2540061183307593, "driven_lanedir_consec": 0.979183589481859, "sim_compute_sim_state": 0.004901947293962751, "sim_compute_performance-ego": 0.007387651715959821, "sim_compute_robot_state-ego": 0.009265705517360142}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.675785751261526, "sim_physics": 0.06236945390701294, "survival_time": 14.950000000000076, "driven_lanedir": 3.915712138263706, "sim_render-ego": 0.011352368195851644, "in-drivable-lane": 3.550000000000039, "agent_compute-ego": 0.2784035078684489, "deviation-heading": 3.101914001818309, "set_robot_commands": 0.006554238796234131, "deviation-center-line": 0.6895083025712629, "driven_lanedir_consec": 3.915712138263706, "sim_compute_sim_state": 0.004220185279846192, "sim_compute_performance-ego": 0.006549161275227864, "sim_compute_robot_state-ego": 0.00815649668375651}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.154712780987021, "sim_physics": 0.05890236775080363, "survival_time": 14.950000000000076, "driven_lanedir": 2.0811949194050383, "sim_render-ego": 0.011793233553568525, "in-drivable-lane": 10.050000000000086, "agent_compute-ego": 0.2702040751775106, "deviation-heading": 1.1060853021055517, "set_robot_commands": 0.006378800868988037, "deviation-center-line": 0.3842310442493742, "driven_lanedir_consec": 2.0811949194050383, "sim_compute_sim_state": 0.004195316632588705, "sim_compute_performance-ego": 0.006702558199564616, "sim_compute_robot_state-ego": 0.008273727893829345}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.364444504553096, "sim_physics": 0.05920798080977394, "survival_time": 11.450000000000028, "driven_lanedir": 3.610064104373435, "sim_render-ego": 0.012220507625929654, "in-drivable-lane": 2.500000000000016, "agent_compute-ego": 0.24404470681103035, "deviation-heading": 2.123567059948401, "set_robot_commands": 0.006455375638070585, "deviation-center-line": 0.5325445403759834, "driven_lanedir_consec": 3.610064104373435, "sim_compute_sim_state": 0.004218983337868769, "sim_compute_performance-ego": 0.006565517733711342, "sim_compute_robot_state-ego": 0.008290962360831848}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.829153663502375, "sim_physics": 0.06025952494083928, "survival_time": 9.850000000000003, "driven_lanedir": 3.1839539538554664, "sim_render-ego": 0.011769272954330832, "in-drivable-lane": 1.350000000000013, "agent_compute-ego": 0.22160341049813984, "deviation-heading": 2.774431131544808, "set_robot_commands": 0.006356843231898274, "deviation-center-line": 0.5980560540742287, "driven_lanedir_consec": 3.1336861453988236, "sim_compute_sim_state": 0.004408704447867302, "sim_compute_performance-ego": 0.006614752832403038, "sim_compute_robot_state-ego": 0.008645148446717238}}
set_robot_commands_max0.007436421939304896
set_robot_commands_mean0.006636336094899185
set_robot_commands_median0.006455375638070585
set_robot_commands_min0.006356843231898274
sim_compute_performance-ego_max0.007387651715959821
sim_compute_performance-ego_mean0.006763928351373336
sim_compute_performance-ego_median0.006614752832403038
sim_compute_performance-ego_min0.006549161275227864
sim_compute_robot_state-ego_max0.009265705517360142
sim_compute_robot_state-ego_mean0.008526408180499016
sim_compute_robot_state-ego_median0.008290962360831848
sim_compute_robot_state-ego_min0.00815649668375651
sim_compute_sim_state_max0.004901947293962751
sim_compute_sim_state_mean0.004389027398426744
sim_compute_sim_state_median0.004220185279846192
sim_compute_sim_state_min0.004195316632588705
sim_physics_max0.06236945390701294
sim_physics_mean0.060591696108037454
sim_physics_median0.06025952494083928
sim_physics_min0.05890236775080363
sim_render-ego_max0.012652976172310966
sim_render-ego_mean0.011957671700398324
sim_render-ego_median0.011793233553568525
sim_render-ego_min0.011352368195851644
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.940000000000037
survival_time_min3.4999999999999956
No reset possible
330256669Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:09:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2807639128848995
survival_time_median9.950000000000006
deviation-center-line_median0.6687971010482546
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.31475314994653064
agent_compute-ego_mean0.26221122589867574
agent_compute-ego_median0.24978158941221
agent_compute-ego_min0.237176570892334
deviation-center-line_max0.9469153153753156
deviation-center-line_mean0.6271093375805761
deviation-center-line_min0.2054852440924096
deviation-heading_max4.0293530604019105
deviation-heading_mean2.43104138867576
deviation-heading_median2.654664529263763
deviation-heading_min0.9407175246303028
driven_any_max4.850855180827966
driven_any_mean3.009565299886897
driven_any_median2.851500084068678
driven_any_min1.2935953086750762
driven_lanedir_consec_max4.444749376586647
driven_lanedir_consec_mean2.7204868223465803
driven_lanedir_consec_min1.2517063592177118
driven_lanedir_max4.444749376586647
driven_lanedir_mean2.7204868223465803
driven_lanedir_median2.2807639128848995
driven_lanedir_min1.2517063592177118
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean0.6499999999999997
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.851500084068678, "sim_physics": 0.06249127076498827, "survival_time": 9.950000000000006, "driven_lanedir": 2.2807639128848995, "sim_render-ego": 0.011559927283818995, "in-drivable-lane": 1.2000000000000055, "agent_compute-ego": 0.24978158941221, "deviation-heading": 3.519388555936685, "set_robot_commands": 0.006889255801636969, "deviation-center-line": 0.6687971010482546, "driven_lanedir_consec": 2.2807639128848995, "sim_compute_sim_state": 0.0045412569189790504, "sim_compute_performance-ego": 0.0069593904006421264, "sim_compute_robot_state-ego": 0.008691567272397142}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3725294419887009, "sim_physics": 0.060223271449406944, "survival_time": 4.799999999999991, "driven_lanedir": 1.3340369486094887, "sim_render-ego": 0.012278263767560324, "in-drivable-lane": 0.0, "agent_compute-ego": 0.31475314994653064, "deviation-heading": 1.0110832731461414, "set_robot_commands": 0.006733730435371399, "deviation-center-line": 0.2054852440924096, "driven_lanedir_consec": 1.3340369486094887, "sim_compute_sim_state": 0.004394660393397014, "sim_compute_performance-ego": 0.007004968822002411, "sim_compute_robot_state-ego": 0.008929299811522165}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2935953086750762, "sim_physics": 0.058744005181572655, "survival_time": 4.399999999999992, "driven_lanedir": 1.2517063592177118, "sim_render-ego": 0.011809335513548418, "in-drivable-lane": 0.0, "agent_compute-ego": 0.238588040525263, "deviation-heading": 0.9407175246303028, "set_robot_commands": 0.0068582811138846655, "deviation-center-line": 0.39725200874004624, "driven_lanedir_consec": 1.2517063592177118, "sim_compute_sim_state": 0.004628793759779496, "sim_compute_performance-ego": 0.006711623885414817, "sim_compute_robot_state-ego": 0.008601557124744762}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.850855180827966, "sim_physics": 0.061623371442159014, "survival_time": 14.950000000000076, "driven_lanedir": 4.291177514434153, "sim_render-ego": 0.011343870957692464, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.270756778717041, "deviation-heading": 2.654664529263763, "set_robot_commands": 0.006667261123657227, "deviation-center-line": 0.917097018646854, "driven_lanedir_consec": 4.291177514434153, "sim_compute_sim_state": 0.00407563845316569, "sim_compute_performance-ego": 0.006607933839162191, "sim_compute_robot_state-ego": 0.008034748236338297}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.679346483874063, "sim_physics": 0.06121299425760905, "survival_time": 14.950000000000076, "driven_lanedir": 4.444749376586647, "sim_render-ego": 0.011363402207692464, "in-drivable-lane": 0.0, "agent_compute-ego": 0.237176570892334, "deviation-heading": 4.0293530604019105, "set_robot_commands": 0.006338268121083577, "deviation-center-line": 0.9469153153753156, "driven_lanedir_consec": 4.444749376586647, "sim_compute_sim_state": 0.004057902495066325, "sim_compute_performance-ego": 0.006539258162180582, "sim_compute_robot_state-ego": 0.008105576038360596}}
set_robot_commands_max0.006889255801636969
set_robot_commands_mean0.006697359319126768
set_robot_commands_median0.006733730435371399
set_robot_commands_min0.006338268121083577
sim_compute_performance-ego_max0.007004968822002411
sim_compute_performance-ego_mean0.006764635021880426
sim_compute_performance-ego_median0.006711623885414817
sim_compute_performance-ego_min0.006539258162180582
sim_compute_robot_state-ego_max0.008929299811522165
sim_compute_robot_state-ego_mean0.008472549696672594
sim_compute_robot_state-ego_median0.008601557124744762
sim_compute_robot_state-ego_min0.008034748236338297
sim_compute_sim_state_max0.004628793759779496
sim_compute_sim_state_mean0.004339650404077515
sim_compute_sim_state_median0.004394660393397014
sim_compute_sim_state_min0.004057902495066325
sim_physics_max0.06249127076498827
sim_physics_mean0.060858982619147184
sim_physics_median0.06121299425760905
sim_physics_min0.058744005181572655
sim_render-ego_max0.012278263767560324
sim_render-ego_mean0.011670959946062532
sim_render-ego_median0.011559927283818995
sim_render-ego_min0.011343870957692464
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.810000000000027
survival_time_min4.399999999999992
No reset possible
330176664Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:15:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0058310190648836
survival_time_median14.950000000000076
deviation-center-line_median1.1002483386800823
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.5038698182437883
agent_compute-ego_mean0.32845947122810165
agent_compute-ego_median0.2668274466196696
agent_compute-ego_min0.2465167306050533
deviation-center-line_max1.2419852684708106
deviation-center-line_mean1.0348931646652255
deviation-center-line_min0.7843252054019453
deviation-heading_max4.007987784430865
deviation-heading_mean2.98027633771596
deviation-heading_median2.8078734302622803
deviation-heading_min2.1037044756962615
driven_any_max3.293803406422737
driven_any_mean3.0181560571212733
driven_any_median3.1022482876346142
driven_any_min2.4994297063516107
driven_lanedir_consec_max3.1637866303574613
driven_lanedir_consec_mean2.8535134585970026
driven_lanedir_consec_min2.1131540444697627
driven_lanedir_max3.1637866303574613
driven_lanedir_mean2.857118096943104
driven_lanedir_median3.0058310190648836
driven_lanedir_min2.1311772362002706
in-drivable-lane_max1.1500000000000163
in-drivable-lane_mean0.23000000000000329
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1022482876346142, "sim_physics": 0.06226375182469686, "survival_time": 14.950000000000076, "driven_lanedir": 2.9414119732554527, "sim_render-ego": 0.011577266852060954, "in-drivable-lane": 0.0, "agent_compute-ego": 0.26248438119888307, "deviation-heading": 4.007987784430865, "set_robot_commands": 0.0066420324643452966, "deviation-center-line": 0.8577686858707883, "driven_lanedir_consec": 2.9414119732554527, "sim_compute_sim_state": 0.0042124795913696285, "sim_compute_performance-ego": 0.0068193348248799645, "sim_compute_robot_state-ego": 0.0082243545850118}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.105863131416231, "sim_physics": 0.05838143984476725, "survival_time": 14.950000000000076, "driven_lanedir": 3.0058310190648836, "sim_render-ego": 0.01137163798014323, "in-drivable-lane": 0.0, "agent_compute-ego": 0.2668274466196696, "deviation-heading": 3.2709781143234404, "set_robot_commands": 0.0066506719589233395, "deviation-center-line": 1.1901383249025013, "driven_lanedir_consec": 3.0058310190648836, "sim_compute_sim_state": 0.004212019443511963, "sim_compute_performance-ego": 0.0065221405029296875, "sim_compute_robot_state-ego": 0.008310117721557618}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4994297063516107, "sim_physics": 0.05949294967811648, "survival_time": 11.900000000000034, "driven_lanedir": 2.1311772362002706, "sim_render-ego": 0.011309833085837485, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.2465167306050533, "deviation-heading": 2.710837883866953, "set_robot_commands": 0.00656207068627622, "deviation-center-line": 0.7843252054019453, "driven_lanedir_consec": 2.1131540444697627, "sim_compute_sim_state": 0.004065872240467232, "sim_compute_performance-ego": 0.006484706862633969, "sim_compute_robot_state-ego": 0.00845395216420919}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0894357537811743, "sim_physics": 0.06659182707468668, "survival_time": 14.950000000000076, "driven_lanedir": 3.043383625837452, "sim_render-ego": 0.010924073060353597, "in-drivable-lane": 0.0, "agent_compute-ego": 0.3625989794731141, "deviation-heading": 2.1037044756962615, "set_robot_commands": 0.006605571905771892, "deviation-center-line": 1.2419852684708106, "driven_lanedir_consec": 3.043383625837452, "sim_compute_sim_state": 0.003986508846282959, "sim_compute_performance-ego": 0.0063593061765035, "sim_compute_robot_state-ego": 0.007833289305369058}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.293803406422737, "sim_physics": 0.06980904292710971, "survival_time": 13.65000000000006, "driven_lanedir": 3.1637866303574613, "sim_render-ego": 0.009524059819651176, "in-drivable-lane": 0.0, "agent_compute-ego": 0.5038698182437883, "deviation-heading": 2.8078734302622803, "set_robot_commands": 0.006443173020750612, "deviation-center-line": 1.1002483386800823, "driven_lanedir_consec": 3.1637866303574613, "sim_compute_sim_state": 0.003698404018695538, "sim_compute_performance-ego": 0.0058309665093055135, "sim_compute_robot_state-ego": 0.006863546022128709}}
set_robot_commands_max0.0066506719589233395
set_robot_commands_mean0.006580704007213473
set_robot_commands_median0.006605571905771892
set_robot_commands_min0.006443173020750612
sim_compute_performance-ego_max0.0068193348248799645
sim_compute_performance-ego_mean0.006403290975250528
sim_compute_performance-ego_median0.006484706862633969
sim_compute_performance-ego_min0.0058309665093055135
sim_compute_robot_state-ego_max0.00845395216420919
sim_compute_robot_state-ego_mean0.007937051959655274
sim_compute_robot_state-ego_median0.0082243545850118
sim_compute_robot_state-ego_min0.006863546022128709
sim_compute_sim_state_max0.0042124795913696285
sim_compute_sim_state_mean0.004035056828065464
sim_compute_sim_state_median0.004065872240467232
sim_compute_sim_state_min0.003698404018695538
sim_physics_max0.06980904292710971
sim_physics_mean0.0633078022698754
sim_physics_median0.06226375182469686
sim_physics_min0.05838143984476725
sim_render-ego_max0.011577266852060954
sim_render-ego_mean0.010941374159609288
sim_render-ego_median0.011309833085837485
sim_render-ego_min0.009524059819651176
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.080000000000066
survival_time_min11.900000000000034
No reset possible
330156663Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3762347107782751
survival_time_median2.0500000000000007
deviation-center-line_median0.07713555993525333
in-drivable-lane_median0.5500000000000004


other stats
agent_compute-ego_max0.5752583682537079
agent_compute-ego_mean0.539680948160194
agent_compute-ego_median0.5629839141194414
agent_compute-ego_min0.4677330342734733
deviation-center-line_max0.23644498723523416
deviation-center-line_mean0.10321419249998146
deviation-center-line_min0.04842236775290718
deviation-heading_max0.9714239964860384
deviation-heading_mean0.5898724805680371
deviation-heading_median0.490841237948531
deviation-heading_min0.3859590622077501
driven_any_max1.0696710722939755
driven_any_mean0.7950707235036509
driven_any_median0.8287956156289586
driven_any_min0.46024066100718414
driven_lanedir_consec_max0.8752387664266663
driven_lanedir_consec_mean0.43645176077298337
driven_lanedir_consec_min0.1364197516202803
driven_lanedir_max0.8752387664266663
driven_lanedir_mean0.4403020770573657
driven_lanedir_median0.3762347107782751
driven_lanedir_min0.1364197516202803
in-drivable-lane_max0.8000000000000005
in-drivable-lane_mean0.5600000000000002
in-drivable-lane_min0.29999999999999893
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7839561014896939, "sim_physics": 0.0729735362820509, "survival_time": 2.0500000000000007, "driven_lanedir": 0.4570859894311413, "sim_render-ego": 0.009615793460752906, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.5629839141194414, "deviation-heading": 0.9714239964860384, "set_robot_commands": 0.0063459059087241565, "deviation-center-line": 0.1008744616641592, "driven_lanedir_consec": 0.43783440800922946, "sim_compute_sim_state": 0.0035542976565477325, "sim_compute_performance-ego": 0.00603574078257491, "sim_compute_robot_state-ego": 0.006931991111941454}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8287956156289586, "sim_physics": 0.07300870011492473, "survival_time": 2.0500000000000007, "driven_lanedir": 0.3565311670304656, "sim_render-ego": 0.009955801614900915, "in-drivable-lane": 0.8000000000000003, "agent_compute-ego": 0.4677330342734733, "deviation-heading": 0.4580951073553448, "set_robot_commands": 0.007137199727500357, "deviation-center-line": 0.07713555993525333, "driven_lanedir_consec": 0.3565311670304656, "sim_compute_sim_state": 0.004183222607868474, "sim_compute_performance-ego": 0.005878186807399843, "sim_compute_robot_state-ego": 0.00716962465425817}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0696710722939755, "sim_physics": 0.07035315858906713, "survival_time": 2.8999999999999977, "driven_lanedir": 0.8752387664266663, "sim_render-ego": 0.010128715942645895, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.5702364691372576, "deviation-heading": 0.6430429988425209, "set_robot_commands": 0.006316694720038052, "deviation-center-line": 0.23644498723523416, "driven_lanedir_consec": 0.8752387664266663, "sim_compute_sim_state": 0.0037066895386268354, "sim_compute_performance-ego": 0.005917212058757913, "sim_compute_robot_state-ego": 0.007027391729683712}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.46024066100718414, "sim_physics": 0.07954237461090088, "survival_time": 1.5000000000000009, "driven_lanedir": 0.1364197516202803, "sim_render-ego": 0.010450275739034016, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.5221929550170898, "deviation-heading": 0.490841237948531, "set_robot_commands": 0.0069650967915852865, "deviation-center-line": 0.053193585912353424, "driven_lanedir_consec": 0.1364197516202803, "sim_compute_sim_state": 0.0036504507064819337, "sim_compute_performance-ego": 0.006026419003804525, "sim_compute_robot_state-ego": 0.007332523663838704}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8326901670984418, "sim_physics": 0.07643129229545594, "survival_time": 2.000000000000001, "driven_lanedir": 0.3762347107782751, "sim_render-ego": 0.009631651639938354, "in-drivable-lane": 0.8000000000000005, "agent_compute-ego": 0.5752583682537079, "deviation-heading": 0.3859590622077501, "set_robot_commands": 0.006089925765991211, "deviation-center-line": 0.04842236775290718, "driven_lanedir_consec": 0.3762347107782751, "sim_compute_sim_state": 0.0036852121353149418, "sim_compute_performance-ego": 0.005413806438446045, "sim_compute_robot_state-ego": 0.006647944450378418}}
set_robot_commands_max0.007137199727500357
set_robot_commands_mean0.0065709645827678135
set_robot_commands_median0.0063459059087241565
set_robot_commands_min0.006089925765991211
sim_compute_performance-ego_max0.00603574078257491
sim_compute_performance-ego_mean0.005854273018196647
sim_compute_performance-ego_median0.005917212058757913
sim_compute_performance-ego_min0.005413806438446045
sim_compute_robot_state-ego_max0.007332523663838704
sim_compute_robot_state-ego_mean0.007021895122020091
sim_compute_robot_state-ego_median0.007027391729683712
sim_compute_robot_state-ego_min0.006647944450378418
sim_compute_sim_state_max0.004183222607868474
sim_compute_sim_state_mean0.003755974528967984
sim_compute_sim_state_median0.0036852121353149418
sim_compute_sim_state_min0.0035542976565477325
sim_physics_max0.07954237461090088
sim_physics_mean0.07446181237847992
sim_physics_median0.07300870011492473
sim_physics_min0.07035315858906713
sim_render-ego_max0.010450275739034016
sim_render-ego_mean0.009956447679454417
sim_render-ego_median0.009955801614900915
sim_render-ego_min0.009615793460752906
simulation-passed1
survival_time_max2.8999999999999977
survival_time_mean2.1
survival_time_min1.5000000000000009
No reset possible
330036656Anastasiya Nikolskaya 🇷🇺PredictorLastaido2-PREDstep1-simulationsuccessyesp-10:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1075804947594378
error_L20.01853907318942318


No reset possible
329996655Faisal Mubaidien 🇯🇴PredictorLastaido2-PREDstep1-simulationsuccessyesp-10:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10990346297237429
error_L20.018180178309497936


No reset possible
329976654Charlie Gauthier 🇨🇦challenge-aido_LF-template-randomaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:03:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03040596316842472
agent_compute-ego_mean0.02957901714021609
agent_compute-ego_median0.0293523835354164
agent_compute-ego_min0.028812766075134277
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.06601525728519146, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.012808423775892992, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.03037859843327449, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.008210874520815335, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.0055399766335120565, "sim_compute_performance-ego": 0.00757451240832989, "sim_compute_robot_state-ego": 0.009203809958237868}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.0697678804397583, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.013101744651794431, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02894537448883057, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.008561444282531739, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.005629777908325195, "sim_compute_performance-ego": 0.007214868068695068, "sim_compute_robot_state-ego": 0.008976483345031738}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.06584645018858068, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.012397135005277744, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03040596316842472, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.008110382977653952, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.005617478314568014, "sim_compute_performance-ego": 0.007210261681500603, "sim_compute_robot_state-ego": 0.0096969534369076}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.0634198501461842, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.012969642389016073, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.0293523835354164, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.008358838128261879, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.0057614787680203795, "sim_compute_performance-ego": 0.007254666969424389, "sim_compute_robot_state-ego": 0.009451549561297307}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.06781677766279741, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.012364289977333765, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028812766075134277, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.008586460893804377, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.005503025921908292, "sim_compute_performance-ego": 0.007491122592579235, "sim_compute_robot_state-ego": 0.009173664179715242}}
set_robot_commands_max0.008586460893804377
set_robot_commands_mean0.008365600160613457
set_robot_commands_median0.008358838128261879
set_robot_commands_min0.008110382977653952
sim_compute_performance-ego_max0.00757451240832989
sim_compute_performance-ego_mean0.007349086344105837
sim_compute_performance-ego_median0.007254666969424389
sim_compute_performance-ego_min0.007210261681500603
sim_compute_robot_state-ego_max0.0096969534369076
sim_compute_robot_state-ego_mean0.00930049209623795
sim_compute_robot_state-ego_median0.009203809958237868
sim_compute_robot_state-ego_min0.008976483345031738
sim_compute_sim_state_max0.0057614787680203795
sim_compute_sim_state_mean0.0056103475092667875
sim_compute_sim_state_median0.005617478314568014
sim_compute_sim_state_min0.005503025921908292
sim_physics_max0.0697678804397583
sim_physics_mean0.06657324314450241
sim_physics_median0.06601525728519146
sim_physics_min0.0634198501461842
sim_render-ego_max0.013101744651794431
sim_render-ego_mean0.012728247159863
sim_render-ego_median0.012808423775892992
sim_render-ego_min0.012364289977333765
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible