Duckietown Challenges Home Challenges Submissions

Evaluator 2232

ID2232
evaluatormont01-27dc059cd4cd-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont01-27dc059cd4cd-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 39909
# timeout
# failed
# error
# aborted1 39919
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3991911222Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simabortednomont01-27dc059cd4cd-10:02:55
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3990910909Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont01-27dc059cd4cd-10:10:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1456459332318847
survival_time_median14.950000000000076
deviation-center-line_median0.41781030646230666
in-drivable-lane_median0.7250000000000103


other stats
agent_compute-ego_max0.018511144320170085
agent_compute-ego_mean0.017856423060099283
agent_compute-ego_median0.01767627994219462
agent_compute-ego_min0.01756198803583781
complete-iteration_max0.2227248764038086
complete-iteration_mean0.2159789401292801
complete-iteration_median0.21661389549573265
complete-iteration_min0.20796309312184652
deviation-center-line_max0.7070758371825943
deviation-center-line_mean0.4372892985957174
deviation-center-line_min0.206460744275662
deviation-heading_max1.2141902171475865
deviation-heading_mean0.970939656086115
deviation-heading_median0.9673383089223596
deviation-heading_min0.7348917893521538
driven_any_max2.2969945818364645
driven_any_mean2.2877419208878473
driven_any_median2.2871431675997087
driven_any_min2.2796867665155056
driven_lanedir_consec_max2.2798023041214446
driven_lanedir_consec_mean1.7954187904815506
driven_lanedir_consec_min0.6105809913409882
driven_lanedir_max2.2798023041214446
driven_lanedir_mean1.7954187904815506
driven_lanedir_median2.1456459332318847
driven_lanedir_min0.6105809913409882
get_duckie_state_max4.089673360188802e-06
get_duckie_state_mean3.98258368174235e-06
get_duckie_state_median3.991921742757161e-06
get_duckie_state_min3.856817881266276e-06
get_robot_state_max0.016547861099243163
get_robot_state_mean0.01623195946216583
get_robot_state_median0.016156896750132245
get_robot_state_min0.01606618324915568
get_state_dump_max0.014079031149546305
get_state_dump_mean0.013684048255284628
get_state_dump_median0.013634339968363444
get_state_dump_min0.013388481934865316
get_ui_image_max0.037474815050760904
get_ui_image_mean0.03712838411331176
get_ui_image_median0.03719565669695536
get_ui_image_min0.03664740800857544
in-drivable-lane_max10.550000000000086
in-drivable-lane_mean3.000000000000026
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2796867665155056, "get_ui_image": 0.03714194695154826, "step_physics": 0.08760801076889038, "survival_time": 14.950000000000076, "driven_lanedir": 2.0228630818116233, "get_state_dump": 0.013444455464680987, "sim_render-ego": 0.0063998961448669435, "get_robot_state": 0.016099310715993246, "get_duckie_state": 4.089673360188802e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.01768136501312256, "deviation-heading": 1.2141902171475865, "complete-iteration": 0.21227894306182865, "set_robot_commands": 0.004981042544047038, "deviation-center-line": 0.7070758371825943, "driven_lanedir_consec": 2.0228630818116233, "sim_compute_sim_state": 0.024570064544677736, "sim_compute_performance-ego": 0.004198137124379476}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.2871460533505283, "get_ui_image": 0.03664740800857544, "step_physics": 0.08435420513153076, "survival_time": 14.950000000000076, "driven_lanedir": 2.2798023041214446, "get_state_dump": 0.013388481934865316, "sim_render-ego": 0.006354106267293294, "get_robot_state": 0.01606618324915568, "get_duckie_state": 4.013379414876302e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01756198803583781, "deviation-heading": 0.8832856604255901, "complete-iteration": 0.20796309312184652, "set_robot_commands": 0.004930924574534098, "deviation-center-line": 0.3174812257292688, "driven_lanedir_consec": 2.2798023041214446, "sim_compute_sim_state": 0.024253591696421304, "sim_compute_performance-ego": 0.004250713189442952}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.2969945818364645, "get_ui_image": 0.037249366442362465, "step_physics": 0.09382210810979208, "survival_time": 14.950000000000076, "driven_lanedir": 0.6105809913409882, "get_state_dump": 0.013824224472045898, "sim_render-ego": 0.00666567881902059, "get_robot_state": 0.016547861099243163, "get_duckie_state": 3.970464070638021e-06, "in-drivable-lane": 10.550000000000086, "agent_compute-ego": 0.018511144320170085, "deviation-heading": 0.7348917893521538, "complete-iteration": 0.22094884792963665, "set_robot_commands": 0.004963403542836507, "deviation-center-line": 0.206460744275662, "driven_lanedir_consec": 0.6105809913409882, "sim_compute_sim_state": 0.02488261938095093, "sim_compute_performance-ego": 0.004321993986765544}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.2871402818488895, "get_ui_image": 0.037474815050760904, "step_physics": 0.09362703084945678, "survival_time": 14.950000000000076, "driven_lanedir": 2.2684287846521465, "get_state_dump": 0.014079031149546305, "sim_render-ego": 0.006306970914204915, "get_robot_state": 0.01621448278427124, "get_duckie_state": 3.856817881266276e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01767119487126668, "deviation-heading": 1.0513909574191294, "complete-iteration": 0.2227248764038086, "set_robot_commands": 0.004930040041605631, "deviation-center-line": 0.5181393871953445, "driven_lanedir_consec": 2.2684287846521465, "sim_compute_sim_state": 0.02798162619272868, "sim_compute_performance-ego": 0.004283267656962077}}
set_robot_commands_max0.004981042544047038
set_robot_commands_mean0.0049513526757558185
set_robot_commands_median0.004947164058685303
set_robot_commands_min0.004930040041605631
sim_compute_performance-ego_max0.004321993986765544
sim_compute_performance-ego_mean0.0042635279893875125
sim_compute_performance-ego_median0.004266990423202515
sim_compute_performance-ego_min0.004198137124379476
sim_compute_sim_state_max0.02798162619272868
sim_compute_sim_state_mean0.02542197545369466
sim_compute_sim_state_median0.024726341962814338
sim_compute_sim_state_min0.024253591696421304
sim_render-ego_max0.00666567881902059
sim_render-ego_mean0.006431663036346435
sim_render-ego_median0.0063770012060801184
sim_render-ego_min0.006306970914204915
simulation-passed1
step_physics_max0.09382210810979208
step_physics_mean0.0898528387149175
step_physics_median0.09061752080917358
step_physics_min0.08435420513153076
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible