Duckietown Challenges Home Challenges Submissions

Evaluator 1834

ID1834
evaluatorp-1
ownerI don't have one 😀
machine85b77f8f72e9
processp-1
versiond-c:6.0.20;d-c-r:6.0.10
first heard
last heard
statusinactive
# evaluating
# success1 33211
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
332116724Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccess Note that this job is not up to date; the challenge has been changed. p-10:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2854660888970464
survival_time_median1.3000000000000005
deviation-center-line_median0.06284413452560553
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.047558060059180625
agent_compute-ego0_mean0.045876422448036
agent_compute-ego0_median0.04509729743003845
agent_compute-ego0_min0.04497390985488891
agent_compute-ego1_max0.0454250665811392
agent_compute-ego1_mean0.04500002835550879
agent_compute-ego1_median0.045163591702779136
agent_compute-ego1_min0.04441142678260803
agent_compute-ego2_max0.044491199346689075
agent_compute-ego2_mean0.04400974501911391
agent_compute-ego2_median0.04392178058624267
agent_compute-ego2_min0.04361625512441
complete-iteration_max1.053836730810312
complete-iteration_mean1.0287406006429949
complete-iteration_median1.0255161821842194
complete-iteration_min1.0068688889344533
deviation-center-line_max0.17558186710680573
deviation-center-line_mean0.07497020349885104
deviation-center-line_min0.03023162811959447
deviation-heading_max0.4256838142434032
deviation-heading_mean0.2585336484276801
deviation-heading_median0.24941907306017713
deviation-heading_min0.11294399362033967
driven_any_max0.5067267887685254
driven_any_mean0.3604012772023528
driven_any_median0.29543199872934806
driven_any_min0.2790450441091847
driven_lanedir_consec_max0.5042949535567818
driven_lanedir_consec_mean0.351058153912489
driven_lanedir_consec_min0.25792366855908844
driven_lanedir_max0.5042949535567818
driven_lanedir_mean0.351058153912489
driven_lanedir_median0.2854660888970464
driven_lanedir_min0.25792366855908844
get_state_dump_max0.04825196266174316
get_state_dump_mean0.047413508301107285
get_state_dump_median0.047173921878521256
get_state_dump_min0.04681464036305746
get_ui_image_max0.13201556755946234
get_ui_image_mean0.12893093742875977
get_ui_image_median0.12816668748855592
get_ui_image_min0.1266105572382609
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 0.29543199872934806, "get_ui_image": 0.13201556755946234, "step_physics": 0.5155430023486798, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2854660888970464, "get_state_dump": 0.047173921878521256, "sim_render-ego0": 0.007305979728698731, "sim_render-ego1": 0.006958521329439604, "sim_render-ego2": 0.0077666502732497, "in-drivable-lane": 0.0, "deviation-heading": 0.24097801149263123, "agent_compute-ego0": 0.047558060059180625, "agent_compute-ego1": 0.0454250665811392, "agent_compute-ego2": 0.044491199346689075, "complete-iteration": 1.053836730810312, "set_robot_commands": 0.007486866070674016, "deviation-center-line": 0.05243521053902064, "driven_lanedir_consec": 0.2854660888970464, "sim_compute_sim_state": 0.06322585619412936, "sim_compute_performance-ego0": 0.006381337459270771, "sim_compute_performance-ego1": 0.005947241416344276, "sim_compute_performance-ego2": 0.006414395112257738, "sim_compute_robot_state-ego0": 0.011525245813223032, "sim_compute_robot_state-ego1": 0.01056205309354342, "sim_compute_robot_state-ego2": 0.010489271237299992, "sim_compute_robot_state-parked0": 0.01119078122652494, "sim_compute_robot_state-parked1": 0.011012700887826772, "sim_compute_robot_state-parked2": 0.010338132198040305, "sim_compute_robot_state-parked3": 0.01038963978107159, "sim_compute_robot_state-parked4": 0.010071323468134953, "sim_compute_robot_state-parked5": 0.010278876011188213}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 0.2954319987293505, "get_ui_image": 0.13201556755946234, "step_physics": 0.5155430023486798, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2916225894959399, "get_state_dump": 0.047173921878521256, "sim_render-ego0": 0.007305979728698731, "sim_render-ego1": 0.006958521329439604, "sim_render-ego2": 0.0077666502732497, "in-drivable-lane": 0.0, "deviation-heading": 0.1262889439224917, "agent_compute-ego0": 0.047558060059180625, "agent_compute-ego1": 0.0454250665811392, "agent_compute-ego2": 0.044491199346689075, "complete-iteration": 1.053836730810312, "set_robot_commands": 0.007486866070674016, "deviation-center-line": 0.04867126635386884, "driven_lanedir_consec": 0.2916225894959399, "sim_compute_sim_state": 0.06322585619412936, "sim_compute_performance-ego0": 0.006381337459270771, "sim_compute_performance-ego1": 0.005947241416344276, "sim_compute_performance-ego2": 0.006414395112257738, "sim_compute_robot_state-ego0": 0.011525245813223032, "sim_compute_robot_state-ego1": 0.01056205309354342, "sim_compute_robot_state-ego2": 0.010489271237299992, "sim_compute_robot_state-parked0": 0.01119078122652494, "sim_compute_robot_state-parked1": 0.011012700887826772, "sim_compute_robot_state-parked2": 0.010338132198040305, "sim_compute_robot_state-parked3": 0.01038963978107159, "sim_compute_robot_state-parked4": 0.010071323468134953, "sim_compute_robot_state-parked5": 0.010278876011188213}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 0.29543199872934783, "get_ui_image": 0.13201556755946234, "step_physics": 0.5155430023486798, "survival_time": 1.3000000000000005, "driven_lanedir": 0.27329084181707186, "get_state_dump": 0.047173921878521256, "sim_render-ego0": 0.007305979728698731, "sim_render-ego1": 0.006958521329439604, "sim_render-ego2": 0.0077666502732497, "in-drivable-lane": 0.0, "deviation-heading": 0.4241066870766807, "agent_compute-ego0": 0.047558060059180625, "agent_compute-ego1": 0.0454250665811392, "agent_compute-ego2": 0.044491199346689075, "complete-iteration": 1.053836730810312, "set_robot_commands": 0.007486866070674016, "deviation-center-line": 0.0778327622118958, "driven_lanedir_consec": 0.27329084181707186, "sim_compute_sim_state": 0.06322585619412936, "sim_compute_performance-ego0": 0.006381337459270771, "sim_compute_performance-ego1": 0.005947241416344276, "sim_compute_performance-ego2": 0.006414395112257738, "sim_compute_robot_state-ego0": 0.011525245813223032, "sim_compute_robot_state-ego1": 0.01056205309354342, "sim_compute_robot_state-ego2": 0.010489271237299992, "sim_compute_robot_state-parked0": 0.01119078122652494, "sim_compute_robot_state-parked1": 0.011012700887826772, "sim_compute_robot_state-parked2": 0.010338132198040305, "sim_compute_robot_state-parked3": 0.01038963978107159, "sim_compute_robot_state-parked4": 0.010071323468134953, "sim_compute_robot_state-parked5": 0.010278876011188213}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 0.5067267887685215, "get_ui_image": 0.12816668748855592, "step_physics": 0.48855522871017454, "survival_time": 2.000000000000001, "driven_lanedir": 0.5042949535567818, "get_state_dump": 0.04825196266174316, "sim_render-ego0": 0.007294946908950805, "sim_render-ego1": 0.006955808401107788, "sim_render-ego2": 0.0072345733642578125, "in-drivable-lane": 0.0, "deviation-heading": 0.1941428917269147, "agent_compute-ego0": 0.04509729743003845, "agent_compute-ego1": 0.04441142678260803, "agent_compute-ego2": 0.04392178058624267, "complete-iteration": 1.0255161821842194, "set_robot_commands": 0.007271617650985718, "deviation-center-line": 0.034019277966619695, "driven_lanedir_consec": 0.5042949535567818, "sim_compute_sim_state": 0.06851068735122681, "sim_compute_performance-ego0": 0.006373745203018188, "sim_compute_performance-ego1": 0.005899065732955932, "sim_compute_performance-ego2": 0.0058970868587493895, "sim_compute_robot_state-ego0": 0.01122179627418518, "sim_compute_robot_state-ego1": 0.010574924945831298, "sim_compute_robot_state-ego2": 0.00992116928100586, "sim_compute_robot_state-parked0": 0.010640865564346314, "sim_compute_robot_state-parked1": 0.010806792974472046, "sim_compute_robot_state-parked2": 0.011725890636444093, "sim_compute_robot_state-parked3": 0.011149442195892334, "sim_compute_robot_state-parked4": 0.010518711805343629, "sim_compute_robot_state-parked5": 0.01071927547454834}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 0.5067267887685218, "get_ui_image": 0.12816668748855592, "step_physics": 0.48855522871017454, "survival_time": 2.000000000000001, "driven_lanedir": 0.49725990941494747, "get_state_dump": 0.04825196266174316, "sim_render-ego0": 0.007294946908950805, "sim_render-ego1": 0.006955808401107788, "sim_render-ego2": 0.0072345733642578125, "in-drivable-lane": 0.0, "deviation-heading": 0.2965974608483565, "agent_compute-ego0": 0.04509729743003845, "agent_compute-ego1": 0.04441142678260803, "agent_compute-ego2": 0.04392178058624267, "complete-iteration": 1.0255161821842194, "set_robot_commands": 0.007271617650985718, "deviation-center-line": 0.17558186710680573, "driven_lanedir_consec": 0.49725990941494747, "sim_compute_sim_state": 0.06851068735122681, "sim_compute_performance-ego0": 0.006373745203018188, "sim_compute_performance-ego1": 0.005899065732955932, "sim_compute_performance-ego2": 0.0058970868587493895, "sim_compute_robot_state-ego0": 0.01122179627418518, "sim_compute_robot_state-ego1": 0.010574924945831298, "sim_compute_robot_state-ego2": 0.00992116928100586, "sim_compute_robot_state-parked0": 0.010640865564346314, "sim_compute_robot_state-parked1": 0.010806792974472046, "sim_compute_robot_state-parked2": 0.011725890636444093, "sim_compute_robot_state-parked3": 0.011149442195892334, "sim_compute_robot_state-parked4": 0.010518711805343629, "sim_compute_robot_state-parked5": 0.01071927547454834}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 0.5067267887685254, "get_ui_image": 0.12816668748855592, "step_physics": 0.48855522871017454, "survival_time": 2.000000000000001, "driven_lanedir": 0.502699138983365, "get_state_dump": 0.04825196266174316, "sim_render-ego0": 0.007294946908950805, "sim_render-ego1": 0.006955808401107788, "sim_render-ego2": 0.0072345733642578125, "in-drivable-lane": 0.0, "deviation-heading": 0.24941907306017713, "agent_compute-ego0": 0.04509729743003845, "agent_compute-ego1": 0.04441142678260803, "agent_compute-ego2": 0.04392178058624267, "complete-iteration": 1.0255161821842194, "set_robot_commands": 0.007271617650985718, "deviation-center-line": 0.10927530776247374, "driven_lanedir_consec": 0.502699138983365, "sim_compute_sim_state": 0.06851068735122681, "sim_compute_performance-ego0": 0.006373745203018188, "sim_compute_performance-ego1": 0.005899065732955932, "sim_compute_performance-ego2": 0.0058970868587493895, "sim_compute_robot_state-ego0": 0.01122179627418518, "sim_compute_robot_state-ego1": 0.010574924945831298, "sim_compute_robot_state-ego2": 0.00992116928100586, "sim_compute_robot_state-parked0": 0.010640865564346314, "sim_compute_robot_state-parked1": 0.010806792974472046, "sim_compute_robot_state-parked2": 0.011725890636444093, "sim_compute_robot_state-parked3": 0.011149442195892334, "sim_compute_robot_state-parked4": 0.010518711805343629, "sim_compute_robot_state-parked5": 0.01071927547454834}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 0.27904504410918823, "get_ui_image": 0.1266105572382609, "step_physics": 0.4844608008861542, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2702189877808481, "get_state_dump": 0.04681464036305746, "sim_render-ego0": 0.006753295660018921, "sim_render-ego1": 0.0065663158893585205, "sim_render-ego2": 0.006917864084243774, "in-drivable-lane": 0.0, "deviation-heading": 0.25664195985812654, "agent_compute-ego0": 0.04497390985488891, "agent_compute-ego1": 0.045163591702779136, "agent_compute-ego2": 0.04361625512441, "complete-iteration": 1.0068688889344533, "set_robot_commands": 0.00689042607943217, "deviation-center-line": 0.06284413452560553, "driven_lanedir_consec": 0.2702189877808481, "sim_compute_sim_state": 0.06267633040746053, "sim_compute_performance-ego0": 0.006558726231257121, "sim_compute_performance-ego1": 0.006208846966425578, "sim_compute_performance-ego2": 0.00583993395169576, "sim_compute_robot_state-ego0": 0.011111140251159668, "sim_compute_robot_state-ego1": 0.009753356377283732, "sim_compute_robot_state-ego2": 0.010200252135594686, "sim_compute_robot_state-parked0": 0.010070393482844034, "sim_compute_robot_state-parked1": 0.010421415170033772, "sim_compute_robot_state-parked2": 0.009778340657552084, "sim_compute_robot_state-parked3": 0.010025709867477415, "sim_compute_robot_state-parked4": 0.010698089996973671, "sim_compute_robot_state-parked5": 0.010975201924641928}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 0.2790450441091847, "get_ui_image": 0.1266105572382609, "step_physics": 0.4844608008861542, "survival_time": 1.2000000000000004, "driven_lanedir": 0.276747206707312, "get_state_dump": 0.04681464036305746, "sim_render-ego0": 0.006753295660018921, "sim_render-ego1": 0.0065663158893585205, "sim_render-ego2": 0.006917864084243774, "in-drivable-lane": 0.0, "deviation-heading": 0.11294399362033967, "agent_compute-ego0": 0.04497390985488891, "agent_compute-ego1": 0.045163591702779136, "agent_compute-ego2": 0.04361625512441, "complete-iteration": 1.0068688889344533, "set_robot_commands": 0.00689042607943217, "deviation-center-line": 0.03023162811959447, "driven_lanedir_consec": 0.276747206707312, "sim_compute_sim_state": 0.06267633040746053, "sim_compute_performance-ego0": 0.006558726231257121, "sim_compute_performance-ego1": 0.006208846966425578, "sim_compute_performance-ego2": 0.00583993395169576, "sim_compute_robot_state-ego0": 0.011111140251159668, "sim_compute_robot_state-ego1": 0.009753356377283732, "sim_compute_robot_state-ego2": 0.010200252135594686, "sim_compute_robot_state-parked0": 0.010070393482844034, "sim_compute_robot_state-parked1": 0.010421415170033772, "sim_compute_robot_state-parked2": 0.009778340657552084, "sim_compute_robot_state-parked3": 0.010025709867477415, "sim_compute_robot_state-parked4": 0.010698089996973671, "sim_compute_robot_state-parked5": 0.010975201924641928}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 0.2790450441091874, "get_ui_image": 0.1266105572382609, "step_physics": 0.4844608008861542, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25792366855908844, "get_state_dump": 0.04681464036305746, "sim_render-ego0": 0.006753295660018921, "sim_render-ego1": 0.0065663158893585205, "sim_render-ego2": 0.006917864084243774, "in-drivable-lane": 0.0, "deviation-heading": 0.4256838142434032, "agent_compute-ego0": 0.04497390985488891, "agent_compute-ego1": 0.045163591702779136, "agent_compute-ego2": 0.04361625512441, "complete-iteration": 1.0068688889344533, "set_robot_commands": 0.00689042607943217, "deviation-center-line": 0.08384037690377498, "driven_lanedir_consec": 0.25792366855908844, "sim_compute_sim_state": 0.06267633040746053, "sim_compute_performance-ego0": 0.006558726231257121, "sim_compute_performance-ego1": 0.006208846966425578, "sim_compute_performance-ego2": 0.00583993395169576, "sim_compute_robot_state-ego0": 0.011111140251159668, "sim_compute_robot_state-ego1": 0.009753356377283732, "sim_compute_robot_state-ego2": 0.010200252135594686, "sim_compute_robot_state-parked0": 0.010070393482844034, "sim_compute_robot_state-parked1": 0.010421415170033772, "sim_compute_robot_state-parked2": 0.009778340657552084, "sim_compute_robot_state-parked3": 0.010025709867477415, "sim_compute_robot_state-parked4": 0.010698089996973671, "sim_compute_robot_state-parked5": 0.010975201924641928}}
set_robot_commands_max0.007486866070674016
set_robot_commands_mean0.007216303267030635
set_robot_commands_median0.007271617650985718
set_robot_commands_min0.00689042607943217
sim_compute_performance-ego0_max0.006558726231257121
sim_compute_performance-ego0_mean0.006437936297848693
sim_compute_performance-ego0_median0.006381337459270771
sim_compute_performance-ego0_min0.006373745203018188
sim_compute_performance-ego1_max0.006208846966425578
sim_compute_performance-ego1_mean0.006018384705241928
sim_compute_performance-ego1_median0.005947241416344276
sim_compute_performance-ego1_min0.005899065732955932
sim_compute_performance-ego2_max0.006414395112257738
sim_compute_performance-ego2_mean0.006050471974234296
sim_compute_performance-ego2_median0.0058970868587493895
sim_compute_performance-ego2_min0.00583993395169576
sim_compute_robot_state-ego0_max0.011525245813223032
sim_compute_robot_state-ego0_mean0.011286060779522628
sim_compute_robot_state-ego0_median0.01122179627418518
sim_compute_robot_state-ego0_min0.011111140251159668
sim_compute_robot_state-ego1_max0.010574924945831298
sim_compute_robot_state-ego1_mean0.010296778138886152
sim_compute_robot_state-ego1_median0.01056205309354342
sim_compute_robot_state-ego1_min0.009753356377283732
sim_compute_robot_state-ego2_max0.010489271237299992
sim_compute_robot_state-ego2_mean0.010203564217966844
sim_compute_robot_state-ego2_median0.010200252135594686
sim_compute_robot_state-ego2_min0.00992116928100586
sim_compute_robot_state-parked0_max0.01119078122652494
sim_compute_robot_state-parked0_mean0.010634013424571764
sim_compute_robot_state-parked0_median0.010640865564346314
sim_compute_robot_state-parked0_min0.010070393482844034
sim_compute_robot_state-parked1_max0.011012700887826772
sim_compute_robot_state-parked1_mean0.010746969677444197
sim_compute_robot_state-parked1_median0.010806792974472046
sim_compute_robot_state-parked1_min0.010421415170033772
sim_compute_robot_state-parked2_max0.011725890636444093
sim_compute_robot_state-parked2_mean0.01061412116401216
sim_compute_robot_state-parked2_median0.010338132198040305
sim_compute_robot_state-parked2_min0.009778340657552084
sim_compute_robot_state-parked3_max0.011149442195892334
sim_compute_robot_state-parked3_mean0.010521597281480447
sim_compute_robot_state-parked3_median0.01038963978107159
sim_compute_robot_state-parked3_min0.010025709867477415
sim_compute_robot_state-parked4_max0.010698089996973671
sim_compute_robot_state-parked4_mean0.010429375090150753
sim_compute_robot_state-parked4_median0.010518711805343629
sim_compute_robot_state-parked4_min0.010071323468134953
sim_compute_robot_state-parked5_max0.010975201924641928
sim_compute_robot_state-parked5_mean0.010657784470126158
sim_compute_robot_state-parked5_median0.01071927547454834
sim_compute_robot_state-parked5_min0.010278876011188213
sim_compute_sim_state_max0.06851068735122681
sim_compute_sim_state_mean0.06480429131760558
sim_compute_sim_state_median0.06322585619412936
sim_compute_sim_state_min0.06267633040746053
sim_render-ego0_max0.007305979728698731
sim_render-ego0_mean0.007118074099222819
sim_render-ego0_median0.007294946908950805
sim_render-ego0_min0.006753295660018921
sim_render-ego1_max0.006958521329439604
sim_render-ego1_mean0.0068268818733019715
sim_render-ego1_median0.006955808401107788
sim_render-ego1_min0.0065663158893585205
sim_render-ego2_max0.0077666502732497
sim_render-ego2_mean0.007306362573917096
sim_render-ego2_median0.0072345733642578125
sim_render-ego2_min0.006917864084243774
simulation-passed1
step_physics_max0.5155430023486798
step_physics_mean0.4961863439816695
step_physics_median0.48855522871017454
step_physics_min0.4844608008861542
survival_time_max2.000000000000001
survival_time_mean1.5000000000000009
survival_time_min1.2000000000000004
No reset possible