Duckietown Challenges Home Challenges Submissions

Evaluator 5147

ID5147
evaluatornoname
ownerMarc Maitre
machineone
processnoname_one
version6.2.20
first heard
last heard
statusinactive
# evaluating
# success2 75544
# timeout1 76073
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors16
Processor frequency (MHz)3.3 GHz
Free % of processors94%
RAM total (MB)31.4 GB
RAM free (MB)28.9 GB
Disk (MB)479.6 GB
Disk available (MB)429.5 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7607415162Merlinda Poontemplate-rosmooc-modconsimsuccessnononame0:14:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median23.80000000000016
deviation-center-line_median1.920273776813633
driven_lanedir_consec_median1.8692339994563332
survival_time_median37.1749999999994


other stats
agent_compute-ego0_max0.02266113708416621
agent_compute-ego0_mean0.02226390372088079
agent_compute-ego0_median0.02226390372088079
agent_compute-ego0_min0.021866670357595375
complete-iteration_max0.23538918161670136
complete-iteration_mean0.2332429394835222
complete-iteration_median0.2332429394835222
complete-iteration_min0.23109669735034308
deviation-center-line_max3.840547553627266
deviation-center-line_mean1.920273776813633
deviation-center-line_min0.0
deviation-heading_max0.3465427436737171
deviation-heading_mean0.17327137183685856
deviation-heading_median0.17327137183685856
deviation-heading_min0.0
distance-from-start_max8.324144961261704
distance-from-start_mean5.091775874392652
distance-from-start_median5.091775874392652
distance-from-start_min1.8594067875235996
driven_any_max8.324248791854945
driven_any_mean5.092243193324066
driven_any_median5.092243193324066
driven_any_min1.8602375947931875
driven_lanedir_consec_max3.7384679989126663
driven_lanedir_consec_mean1.8692339994563332
driven_lanedir_consec_min0.0
driven_lanedir_max3.7384679989126663
driven_lanedir_mean1.8692339994563332
driven_lanedir_median1.8692339994563332
driven_lanedir_min0.0
get_duckie_state_max1.957847012413873e-06
get_duckie_state_mean1.9122498589513128e-06
get_duckie_state_median1.9122498589513128e-06
get_duckie_state_min1.866652705488753e-06
get_robot_state_max0.005944912677799831
get_robot_state_mean0.005878051972618618
get_robot_state_median0.005878051972618618
get_robot_state_min0.005811191267437405
get_state_dump_max0.008220671779579587
get_state_dump_mean0.008151713341684078
get_state_dump_median0.008151713341684078
get_state_dump_min0.008082754903788571
get_ui_image_max0.05400479187278525
get_ui_image_mean0.05399973284722323
get_ui_image_median0.05399973284722323
get_ui_image_min0.0539946738216612
in-drivable-lane_max33.25000000000025
in-drivable-lane_mean23.80000000000016
in-drivable-lane_min14.350000000000067
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324248791854945, "get_ui_image": 0.05400479187278525, "step_physics": 0.08926215080496275, "survival_time": 59.99999999999873, "driven_lanedir": 3.7384679989126663, "get_state_dump": 0.008082754903788571, "get_robot_state": 0.005944912677799831, "sim_render-ego0": 0.005487998657480664, "get_duckie_state": 1.866652705488753e-06, "in-drivable-lane": 33.25000000000025, "deviation-heading": 0.3465427436737171, "agent_compute-ego0": 0.021866670357595375, "complete-iteration": 0.23538918161670136, "set_robot_commands": 0.00409029683502985, "distance-from-start": 8.324144961261704, "deviation-center-line": 3.840547553627266, "driven_lanedir_consec": 3.7384679989126663, "sim_compute_sim_state": 0.043412339975196654, "sim_compute_performance-ego0": 0.003105908408947134}, "LF-full-loop-001-ego0": {"driven_any": 1.8602375947931875, "get_ui_image": 0.0539946738216612, "step_physics": 0.09004072099924088, "survival_time": 14.350000000000067, "driven_lanedir": 0.0, "get_state_dump": 0.008220671779579587, "get_robot_state": 0.005811191267437405, "sim_render-ego0": 0.005409359104103512, "get_duckie_state": 1.957847012413873e-06, "in-drivable-lane": 14.350000000000067, "deviation-heading": 0.0, "agent_compute-ego0": 0.02266113708416621, "complete-iteration": 0.23109669735034308, "set_robot_commands": 0.003996924393706852, "distance-from-start": 1.8594067875235996, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.037739626235432096, "sim_compute_performance-ego0": 0.003092277381155226}}
set_robot_commands_max0.00409029683502985
set_robot_commands_mean0.004043610614368351
set_robot_commands_median0.004043610614368351
set_robot_commands_min0.003996924393706852
sim_compute_performance-ego0_max0.003105908408947134
sim_compute_performance-ego0_mean0.00309909289505118
sim_compute_performance-ego0_median0.00309909289505118
sim_compute_performance-ego0_min0.003092277381155226
sim_compute_sim_state_max0.043412339975196654
sim_compute_sim_state_mean0.04057598310531438
sim_compute_sim_state_median0.04057598310531438
sim_compute_sim_state_min0.037739626235432096
sim_render-ego0_max0.005487998657480664
sim_render-ego0_mean0.005448678880792088
sim_render-ego0_median0.005448678880792088
sim_render-ego0_min0.005409359104103512
simulation-passed1
step_physics_max0.09004072099924088
step_physics_mean0.08965143590210181
step_physics_median0.08965143590210181
step_physics_min0.08926215080496275
survival_time_max59.99999999999873
survival_time_mean37.1749999999994
survival_time_min14.350000000000067
No reset possible
7607315162Merlinda Poontemplate-rosmooc-modconsimtimeoutnononame0:05:48
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7554414911Marc Maitretemplate-rosmooc-modconsimsuccessnononame0:11:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median15.199999999999998
deviation-center-line_median1.248107174658983
driven_lanedir_consec_median1.8590971326408183
survival_time_median28.52500000000004


other stats
agent_compute-ego0_max0.02262645112924857
agent_compute-ego0_mean0.022068205459931156
agent_compute-ego0_median0.022068205459931156
agent_compute-ego0_min0.021509959790613743
complete-iteration_max0.22666365140444272
complete-iteration_mean0.22555037729961205
complete-iteration_median0.22555037729961205
complete-iteration_min0.22443710319478136
deviation-center-line_max2.496214349317966
deviation-center-line_mean1.248107174658983
deviation-center-line_min0.0
deviation-heading_max1.5743305719041625
deviation-heading_mean0.7871652859520812
deviation-heading_median0.7871652859520812
deviation-heading_min0.0
distance-from-start_max5.214208620656309
distance-from-start_mean3.8228684461793696
distance-from-start_median3.8228684461793696
distance-from-start_min2.43152827170243
driven_any_max5.2145351057917715
driven_any_mean3.8343813566678793
driven_any_median3.8343813566678793
driven_any_min2.454227607543987
driven_lanedir_consec_max3.718194265281637
driven_lanedir_consec_mean1.8590971326408183
driven_lanedir_consec_min0.0
driven_lanedir_max3.718194265281637
driven_lanedir_mean1.8590971326408183
driven_lanedir_median1.8590971326408183
driven_lanedir_min0.0
get_duckie_state_max2.1336225657936074e-06
get_duckie_state_mean2.01475736071425e-06
get_duckie_state_median2.01475736071425e-06
get_duckie_state_min1.8958921556348924e-06
get_robot_state_max0.005955932357094505
get_robot_state_mean0.005918488940058352
get_robot_state_median0.005918488940058352
get_robot_state_min0.005881045523022199
get_state_dump_max0.008690545466039088
get_state_dump_mean0.008442517747404532
get_state_dump_median0.008442517747404532
get_state_dump_min0.008194490028769976
get_ui_image_max0.051357772331135525
get_ui_image_mean0.0510655749367537
get_ui_image_median0.0510655749367537
get_ui_image_min0.05077337754237187
in-drivable-lane_max18.60000000000013
in-drivable-lane_mean15.199999999999998
in-drivable-lane_min11.799999999999866
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.2145351057917715, "get_ui_image": 0.05077337754237187, "step_physics": 0.08695722307477678, "survival_time": 38.44999999999995, "driven_lanedir": 3.718194265281637, "get_state_dump": 0.008690545466039088, "get_robot_state": 0.005955932357094505, "sim_render-ego0": 0.005254369896727723, "get_duckie_state": 1.8958921556348924e-06, "in-drivable-lane": 11.799999999999866, "deviation-heading": 1.5743305719041625, "agent_compute-ego0": 0.021509959790613743, "complete-iteration": 0.22666365140444272, "set_robot_commands": 0.0040366510292152305, "distance-from-start": 5.214208620656309, "deviation-center-line": 2.496214349317966, "driven_lanedir_consec": 3.718194265281637, "sim_compute_sim_state": 0.040326740524985576, "sim_compute_performance-ego0": 0.0030286816807536337}, "LF-full-loop-001-ego0": {"driven_any": 2.454227607543987, "get_ui_image": 0.051357772331135525, "step_physics": 0.08737260598599432, "survival_time": 18.60000000000013, "driven_lanedir": 0.0, "get_state_dump": 0.008194490028769976, "get_robot_state": 0.005881045523022199, "sim_render-ego0": 0.00521750808081742, "get_duckie_state": 2.1336225657936074e-06, "in-drivable-lane": 18.60000000000013, "deviation-heading": 0.0, "agent_compute-ego0": 0.02262645112924857, "complete-iteration": 0.22443710319478136, "set_robot_commands": 0.00404099037436314, "distance-from-start": 2.43152827170243, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0367051647431729, "sim_compute_performance-ego0": 0.002909905789045482}}
set_robot_commands_max0.00404099037436314
set_robot_commands_mean0.004038820701789185
set_robot_commands_median0.004038820701789185
set_robot_commands_min0.0040366510292152305
sim_compute_performance-ego0_max0.0030286816807536337
sim_compute_performance-ego0_mean0.002969293734899558
sim_compute_performance-ego0_median0.002969293734899558
sim_compute_performance-ego0_min0.002909905789045482
sim_compute_sim_state_max0.040326740524985576
sim_compute_sim_state_mean0.03851595263407924
sim_compute_sim_state_median0.03851595263407924
sim_compute_sim_state_min0.0367051647431729
sim_render-ego0_max0.005254369896727723
sim_render-ego0_mean0.0052359389887725715
sim_render-ego0_median0.0052359389887725715
sim_render-ego0_min0.00521750808081742
simulation-passed1
step_physics_max0.08737260598599432
step_physics_mean0.08716491453038555
step_physics_median0.08716491453038555
step_physics_min0.08695722307477678
survival_time_max38.44999999999995
survival_time_mean28.52500000000004
survival_time_min18.60000000000013
No reset possible