Duckietown Challenges Home Challenges Submissions

Evaluator 637

ID637
evaluatoridsc-rudolf-5533
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-5533
versiond-c:4.0.14;d-c-r:4.0.18;d-s:4.0.15
first heard
last heard
statusinactive
# evaluating
# success1 17609
# timeout
# failed
# error2 17602
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
176152408jiang pengBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-55330:21:08
Timeout: Waited 120 [...]
Timeout:

Waited 1202 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176092416Andrea Censi 🇨🇭random_agentaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-55330:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.1237129024837328
agent_compute-ego_mean0.1143513527491402
agent_compute-ego_median0.11479820145501032
agent_compute-ego_min0.10414829461470894
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.012396076451177185, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06200652537138566, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.1237129024837328, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.0755797054456628, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.03807788309843644, "sim_compute_performance-ego": 0.06247915392336638, "sim_compute_robot_state-ego": 0.06420848680579144}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.012661674748296324, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.05519882492397143, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.10414829461470894, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.06900401737378992, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.034720296445100204, "sim_compute_performance-ego": 0.0616467517355214, "sim_compute_robot_state-ego": 0.06353795010110606}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.012328115376559172, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.05990848758003928, "in-drivable-lane": 0, "agent_compute-ego": 0.11762317744168369, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.0706863511692394, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.03562748432159424, "sim_compute_performance-ego": 0.0616706826470115, "sim_compute_robot_state-ego": 0.060573122718117454}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.01351581679450141, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.05590563350253635, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.11479820145501032, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07601348559061687, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.03170090251498752, "sim_compute_performance-ego": 0.05298537678188748, "sim_compute_robot_state-ego": 0.06144025590684679}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.01269573914377313, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.05545765475222939, "in-drivable-lane": 0, "agent_compute-ego": 0.11147418775056538, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.0746516930429559, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.03475970970956903, "sim_compute_performance-ego": 0.057427331020957546, "sim_compute_robot_state-ego": 0.058214275460494194}}
set_robot_commands_max0.07601348559061687
set_robot_commands_mean0.07318705052445297
set_robot_commands_median0.0746516930429559
set_robot_commands_min0.06900401737378992
sim_compute_performance-ego_max0.06247915392336638
sim_compute_performance-ego_mean0.05924185922174886
sim_compute_performance-ego_median0.0616467517355214
sim_compute_performance-ego_min0.05298537678188748
sim_compute_robot_state-ego_max0.06420848680579144
sim_compute_robot_state-ego_mean0.06159481819847119
sim_compute_robot_state-ego_median0.06144025590684679
sim_compute_robot_state-ego_min0.058214275460494194
sim_compute_sim_state_max0.03807788309843644
sim_compute_sim_state_mean0.034977255217937486
sim_compute_sim_state_median0.03475970970956903
sim_compute_sim_state_min0.03170090251498752
sim_physics_max0.01351581679450141
sim_physics_mean0.012719484502861445
sim_physics_median0.012661674748296324
sim_physics_min0.012328115376559172
sim_render-ego_max0.06200652537138566
sim_render-ego_mean0.057695425226032424
sim_render-ego_median0.05590563350253635
sim_render-ego_min0.05519882492397143
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
176022437Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-55330:00:39
The result file is n [...]
The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2437/step1-simulation-idsc-rudolf-5533-job17602:

File '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2437/step1-simulation-idsc-rudolf-5533-job17602/challenge-results/challenge_results.yaml' does not exist. 

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible