Duckietown Challenges Home Challenges Submissions

Evaluator 2212

ID2212
evaluatorreg02-2e50246280f2-1
ownerI don't have one 😀
machinearchimede
processreg02-2e50246280f2-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 39109
# timeout
# failed
# error
# aborted2 39103
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3911911166Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg02-2e50246280f2-1----No reset possible
3910910406Bea Baselines 🐤baseline-duckietownaido5-LF-sanity-sim-validationsanity-checksuccessnoreg02-2e50246280f2-10:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.02026528127192284
survival_time_median0.49999999999999994
deviation-center-line_median0.007349611280372466
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.026926864277232777
agent_compute-ego_mean0.026926864277232777
agent_compute-ego_median0.026926864277232777
agent_compute-ego_min0.026926864277232777
complete-iteration_max0.33958361365578393
complete-iteration_mean0.33958361365578393
complete-iteration_median0.33958361365578393
complete-iteration_min0.33958361365578393
deviation-center-line_max0.007349611280372466
deviation-center-line_mean0.007349611280372466
deviation-center-line_min0.007349611280372466
deviation-heading_max0.05705845837418036
deviation-heading_mean0.05705845837418036
deviation-heading_median0.05705845837418036
deviation-heading_min0.05705845837418036
driven_any_max0.020428783744262283
driven_any_mean0.020428783744262283
driven_any_median0.020428783744262283
driven_any_min0.020428783744262283
driven_lanedir_consec_max0.02026528127192284
driven_lanedir_consec_mean0.02026528127192284
driven_lanedir_consec_min0.02026528127192284
driven_lanedir_max0.02026528127192284
driven_lanedir_mean0.02026528127192284
driven_lanedir_median0.02026528127192284
driven_lanedir_min0.02026528127192284
get_duckie_state_max0.006438580426302823
get_duckie_state_mean0.006438580426302823
get_duckie_state_median0.006438580426302823
get_duckie_state_min0.006438580426302823
get_robot_state_max0.02336320010098544
get_robot_state_mean0.02336320010098544
get_robot_state_median0.02336320010098544
get_robot_state_min0.02336320010098544
get_state_dump_max0.01900098540566184
get_state_dump_mean0.01900098540566184
get_state_dump_median0.01900098540566184
get_state_dump_min0.01900098540566184
get_ui_image_max0.05984683470292525
get_ui_image_mean0.05984683470292525
get_ui_image_median0.05984683470292525
get_ui_image_min0.05984683470292525
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.020428783744262283, "get_ui_image": 0.05984683470292525, "step_physics": 0.1495700099251487, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02026528127192284, "get_state_dump": 0.01900098540566184, "sim_render-ego": 0.009773969650268556, "get_robot_state": 0.02336320010098544, "get_duckie_state": 0.006438580426302823, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026926864277232777, "deviation-heading": 0.05705845837418036, "complete-iteration": 0.33958361365578393, "set_robot_commands": 0.006698868491432883, "deviation-center-line": 0.007349611280372466, "driven_lanedir_consec": 0.02026528127192284, "sim_compute_sim_state": 0.03138100017200817, "sim_compute_performance-ego": 0.006362286480990323}}
set_robot_commands_max0.006698868491432883
set_robot_commands_mean0.006698868491432883
set_robot_commands_median0.006698868491432883
set_robot_commands_min0.006698868491432883
sim_compute_performance-ego_max0.006362286480990323
sim_compute_performance-ego_mean0.006362286480990323
sim_compute_performance-ego_median0.006362286480990323
sim_compute_performance-ego_min0.006362286480990323
sim_compute_sim_state_max0.03138100017200817
sim_compute_sim_state_mean0.03138100017200817
sim_compute_sim_state_median0.03138100017200817
sim_compute_sim_state_min0.03138100017200817
sim_render-ego_max0.009773969650268556
sim_render-ego_mean0.009773969650268556
sim_render-ego_median0.009773969650268556
sim_render-ego_min0.009773969650268556
simulation-passed1
step_physics_max0.1495700099251487
step_physics_mean0.1495700099251487
step_physics_median0.1495700099251487
step_physics_min0.1495700099251487
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
3910311025Mo Kleit 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednoreg02-2e50246280f2-10:09:18
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible