Duckietown Challenges Home Challenges Submissions

Evaluator 2234

ID2234
evaluatormont03-91ea0cbf132f-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont03-91ea0cbf132f-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 39910
# timeout
# failed
# error
# aborted1 39918
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3991811122Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednomont03-91ea0cbf132f-10:00:53
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3991010908Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont03-91ea0cbf132f-10:10:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.024098334606762
survival_time_median14.900000000000077
deviation-center-line_median0.5567981947185969
in-drivable-lane_median4.350000000000062


other stats
agent_compute-ego_max0.01811471700668335
agent_compute-ego_mean0.017507556572351948
agent_compute-ego_median0.01745538730381746
agent_compute-ego_min0.01700473467508952
complete-iteration_max0.21818615129901103
complete-iteration_mean0.21284767132014135
complete-iteration_median0.21213640848795573
complete-iteration_min0.20893171700564295
deviation-center-line_max0.8101771930020111
deviation-center-line_mean0.5841932141663492
deviation-center-line_min0.41299927422619176
deviation-heading_max2.1762920238114467
deviation-heading_mean1.5349375383265873
deviation-heading_median1.4561477762511474
deviation-heading_min1.051162576992607
driven_any_max2.9589849151579677
driven_any_mean2.8917207219733996
driven_any_median2.873091496869801
driven_any_min2.8617149789960283
driven_lanedir_consec_max2.9076730671011317
driven_lanedir_consec_mean2.117578777997571
driven_lanedir_consec_min1.5144453756756298
driven_lanedir_max2.9076730671011317
driven_lanedir_mean2.117578777997571
driven_lanedir_median2.024098334606762
driven_lanedir_min1.5144453756756298
get_duckie_state_max3.0023080331307872e-06
get_duckie_state_mean2.8864156702768306e-06
get_duckie_state_median2.892017364501953e-06
get_duckie_state_min2.759319918972629e-06
get_robot_state_max0.016048680250893538
get_robot_state_mean0.015884598797542757
get_robot_state_median0.01586593747138977
get_robot_state_min0.01575783999649795
get_state_dump_max0.013501248359680177
get_state_dump_mean0.013421951223148395
get_state_dump_median0.013427641965416051
get_state_dump_min0.0133312726020813
get_ui_image_max0.037461378357627174
get_ui_image_mean0.037088031814957304
get_ui_image_median0.03708815833133479
get_ui_image_min0.03671443223953247
in-drivable-lane_max6.600000000000082
in-drivable-lane_mean3.825000000000052
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9589849151579677, "get_ui_image": 0.03671443223953247, "step_physics": 0.08739543596903483, "survival_time": 14.950000000000076, "driven_lanedir": 2.9076730671011317, "get_state_dump": 0.0133312726020813, "sim_render-ego": 0.0062238645553588864, "get_robot_state": 0.015846253236134845, "get_duckie_state": 2.796649932861328e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01700473467508952, "deviation-heading": 2.1762920238114467, "complete-iteration": 0.2101634661356608, "set_robot_commands": 0.004856936931610108, "deviation-center-line": 0.6811498862508517, "driven_lanedir_consec": 2.9076730671011317, "sim_compute_sim_state": 0.024483744303385416, "sim_compute_performance-ego": 0.004157444636027018}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8813813275431506, "get_ui_image": 0.037461378357627174, "step_physics": 0.08557610828559715, "survival_time": 14.300000000000068, "driven_lanedir": 2.076016554563571, "get_state_dump": 0.013441882767043748, "sim_render-ego": 0.006143754178827459, "get_robot_state": 0.01575783999649795, "get_duckie_state": 2.759319918972629e-06, "in-drivable-lane": 3.8500000000000543, "agent_compute-ego": 0.01740412862150819, "deviation-heading": 1.3266255629813208, "complete-iteration": 0.20893171700564295, "set_robot_commands": 0.004753673826897895, "deviation-center-line": 0.41299927422619176, "driven_lanedir_consec": 2.076016554563571, "sim_compute_sim_state": 0.024138767402488867, "sim_compute_performance-ego": 0.004101772408385377}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8648016661964513, "get_ui_image": 0.03711609522501628, "step_physics": 0.08867340167363484, "survival_time": 14.950000000000076, "driven_lanedir": 1.5144453756756298, "get_state_dump": 0.013501248359680177, "sim_render-ego": 0.006410054365793864, "get_robot_state": 0.015885621706644693, "get_duckie_state": 2.987384796142578e-06, "in-drivable-lane": 6.600000000000082, "agent_compute-ego": 0.01811471700668335, "deviation-heading": 1.5856699895209745, "complete-iteration": 0.21410935084025065, "set_robot_commands": 0.004954230785369873, "deviation-center-line": 0.8101771930020111, "driven_lanedir_consec": 1.5144453756756298, "sim_compute_sim_state": 0.025153874556223553, "sim_compute_performance-ego": 0.004145333766937256}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8617149789960283, "get_ui_image": 0.03706022143765331, "step_physics": 0.08957564389264142, "survival_time": 14.850000000000076, "driven_lanedir": 1.972180114649952, "get_state_dump": 0.013413401163788356, "sim_render-ego": 0.006421105227486453, "get_robot_state": 0.016048680250893538, "get_duckie_state": 3.0023080331307872e-06, "in-drivable-lane": 4.850000000000069, "agent_compute-ego": 0.01750664598612673, "deviation-heading": 1.051162576992607, "complete-iteration": 0.21818615129901103, "set_robot_commands": 0.0049721921734536935, "deviation-center-line": 0.4324465031863421, "driven_lanedir_consec": 1.972180114649952, "sim_compute_sim_state": 0.02883170429704968, "sim_compute_performance-ego": 0.004199809096879028}}
set_robot_commands_max0.0049721921734536935
set_robot_commands_mean0.004884258429332892
set_robot_commands_median0.004905583858489991
set_robot_commands_min0.004753673826897895
sim_compute_performance-ego_max0.004199809096879028
sim_compute_performance-ego_mean0.00415108997705717
sim_compute_performance-ego_median0.004151389201482137
sim_compute_performance-ego_min0.004101772408385377
sim_compute_sim_state_max0.02883170429704968
sim_compute_sim_state_mean0.02565202263978688
sim_compute_sim_state_median0.024818809429804484
sim_compute_sim_state_min0.024138767402488867
sim_render-ego_max0.006421105227486453
sim_render-ego_mean0.006299694581866666
sim_render-ego_median0.006316959460576375
sim_render-ego_min0.006143754178827459
simulation-passed1
step_physics_max0.08957564389264142
step_physics_mean0.08780514745522705
step_physics_median0.08803441882133484
step_physics_min0.08557610828559715
survival_time_max14.950000000000076
survival_time_mean14.762500000000074
survival_time_min14.300000000000068
No reset possible