Duckietown Challenges Home Challenges Submissions

Evaluator 2231

ID2231
evaluatormont02-c025970e2024-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont02-c025970e2024-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 39907
# timeout
# failed
# error
# aborted1 39915
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3991511130Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednomont02-c025970e2024-10:01:45
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3990710909Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont02-c025970e2024-10:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1506255931145164
survival_time_median14.950000000000076
deviation-center-line_median0.36304480952911977
in-drivable-lane_median0.6500000000000092


other stats
agent_compute-ego_max0.017717576026916503
agent_compute-ego_mean0.017258879939715067
agent_compute-ego_median0.01715348998705546
agent_compute-ego_min0.017010963757832846
complete-iteration_max0.21855581045150757
complete-iteration_mean0.21000829478104913
complete-iteration_median0.20898826042811075
complete-iteration_min0.2035008478164673
deviation-center-line_max0.7968896761257456
deviation-center-line_mean0.44499066858304376
deviation-center-line_min0.25698337914818986
deviation-heading_max1.5997288603332769
deviation-heading_mean1.1718071449123344
deviation-heading_median1.216900496950496
deviation-heading_min0.6536987254150689
driven_any_max2.287146112700107
driven_any_mean2.2852602101171096
driven_any_median2.287106617785152
driven_any_min2.279681492198027
driven_lanedir_consec_max2.254525491736677
driven_lanedir_consec_mean1.7980501514241078
driven_lanedir_consec_min0.6364239277307218
driven_lanedir_max2.254525491736677
driven_lanedir_mean1.7980501514241078
driven_lanedir_median2.1506255931145164
driven_lanedir_min0.6364239277307218
get_duckie_state_max2.701282501220703e-06
get_duckie_state_mean2.6534001032511393e-06
get_duckie_state_median2.660353978474935e-06
get_duckie_state_min2.591609954833984e-06
get_robot_state_max0.016430986722310383
get_robot_state_mean0.01597651223341624
get_robot_state_median0.015898949305216473
get_robot_state_min0.01567716360092163
get_state_dump_max0.013886755307515462
get_state_dump_mean0.013558314243952431
get_state_dump_median0.01346251924832662
get_state_dump_min0.013421463171641033
get_ui_image_max0.037017656962076824
get_ui_image_mean0.03620341698328654
get_ui_image_median0.036202517747879026
get_ui_image_min0.03539097547531128
in-drivable-lane_max10.400000000000086
in-drivable-lane_mean2.925000000000026
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.279681492198027, "get_ui_image": 0.03548976977666219, "step_physics": 0.082174391746521, "survival_time": 14.950000000000076, "driven_lanedir": 2.0505982355861163, "get_state_dump": 0.013478695551554362, "sim_render-ego": 0.006163312594095866, "get_robot_state": 0.015759015878041585, "get_duckie_state": 2.591609954833984e-06, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.01714285691579183, "deviation-heading": 1.13486593603993, "complete-iteration": 0.2035008478164673, "set_robot_commands": 0.004795711835225423, "deviation-center-line": 0.7968896761257456, "driven_lanedir_consec": 2.0505982355861163, "sim_compute_sim_state": 0.02425391594568888, "sim_compute_performance-ego": 0.004097435474395752}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.2871311730684782, "get_ui_image": 0.03539097547531128, "step_physics": 0.08135132153828939, "survival_time": 14.950000000000076, "driven_lanedir": 2.250652950642916, "get_state_dump": 0.013886755307515462, "sim_render-ego": 0.006453022956848144, "get_robot_state": 0.016430986722310383, "get_duckie_state": 2.6655197143554687e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017164123058319092, "deviation-heading": 1.5997288603332769, "complete-iteration": 0.20360533316930135, "set_robot_commands": 0.004955440362294515, "deviation-center-line": 0.3625084356596883, "driven_lanedir_consec": 2.250652950642916, "sim_compute_sim_state": 0.0236601988474528, "sim_compute_performance-ego": 0.004160129229227702}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.2870820625018258, "get_ui_image": 0.037017656962076824, "step_physics": 0.09418890873591106, "survival_time": 14.950000000000076, "driven_lanedir": 0.6364239277307218, "get_state_dump": 0.013446342945098878, "sim_render-ego": 0.006425903638203939, "get_robot_state": 0.016038882732391357, "get_duckie_state": 2.701282501220703e-06, "in-drivable-lane": 10.400000000000086, "agent_compute-ego": 0.017717576026916503, "deviation-heading": 0.6536987254150689, "complete-iteration": 0.21855581045150757, "set_robot_commands": 0.004958462715148926, "deviation-center-line": 0.25698337914818986, "driven_lanedir_consec": 0.6364239277307218, "sim_compute_sim_state": 0.024278283913930256, "sim_compute_performance-ego": 0.004333215554555257}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.287146112700107, "get_ui_image": 0.03691526571909587, "step_physics": 0.08820468107859293, "survival_time": 14.950000000000076, "driven_lanedir": 2.254525491736677, "get_state_dump": 0.013421463171641033, "sim_render-ego": 0.0061491115887959795, "get_robot_state": 0.01567716360092163, "get_duckie_state": 2.655188242594401e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017010963757832846, "deviation-heading": 1.298935057861062, "complete-iteration": 0.21437118768692015, "set_robot_commands": 0.0048826988538106285, "deviation-center-line": 0.3635811833985512, "driven_lanedir_consec": 2.254525491736677, "sim_compute_sim_state": 0.02781488974889119, "sim_compute_performance-ego": 0.004144360224405924}}
set_robot_commands_max0.004958462715148926
set_robot_commands_mean0.004898078441619873
set_robot_commands_median0.004919069608052572
set_robot_commands_min0.004795711835225423
sim_compute_performance-ego_max0.004333215554555257
sim_compute_performance-ego_mean0.004183785120646159
sim_compute_performance-ego_median0.004152244726816813
sim_compute_performance-ego_min0.004097435474395752
sim_compute_sim_state_max0.02781488974889119
sim_compute_sim_state_mean0.025001822113990785
sim_compute_sim_state_median0.02426609992980957
sim_compute_sim_state_min0.0236601988474528
sim_render-ego_max0.006453022956848144
sim_render-ego_mean0.006297837694485982
sim_render-ego_median0.006294608116149902
sim_render-ego_min0.0061491115887959795
simulation-passed1
step_physics_max0.09418890873591106
step_physics_mean0.08647982577482859
step_physics_median0.08518953641255697
step_physics_min0.08135132153828939
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible