Duckietown Challenges Home Challenges Submissions

Evaluator 2283

ID2283
evaluatornoname-charlie-agency-1
ownerCharlie Gauthier 🇨🇦
machinecharlie-agency
processnoname-charlie-agency-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 42018
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4201811352Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. noname-charlie-agency-10:15:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6219511419255426
survival_time_median14.950000000000076
deviation-center-line_median0.22312456906100656
in-drivable-lane_median10.575000000000047


other stats
agent_compute-ego_max0.08295616785685221
agent_compute-ego_mean0.07851518714637087
agent_compute-ego_median0.07833992648542973
agent_compute-ego_min0.07442472775777181
complete-iteration_max0.27677819490432737
complete-iteration_mean0.26479690484833296
complete-iteration_median0.26425995071729025
complete-iteration_min0.2538895230544241
deviation-center-line_max0.3198688203990741
deviation-center-line_mean0.20428796504831964
deviation-center-line_min0.051033901672191365
deviation-heading_max1.5349557481686582
deviation-heading_mean0.9323774415196798
deviation-heading_median0.9686862322214752
deviation-heading_min0.2571815534671106
driven_any_max7.8896256025245055
driven_any_mean6.127982123463939
driven_any_median7.889625602524492
driven_any_min0.843051686282266
driven_lanedir_consec_max2.108442573665656
driven_lanedir_consec_mean1.434783536268943
driven_lanedir_consec_min0.3867892875590312
driven_lanedir_max2.108442573665656
driven_lanedir_mean1.434783536268943
driven_lanedir_median1.6219511419255426
driven_lanedir_min0.3867892875590312
get_duckie_state_max2.0837783813476563e-06
get_duckie_state_mean1.9419193267822265e-06
get_duckie_state_median1.9478797912597656e-06
get_duckie_state_min1.7881393432617188e-06
get_robot_state_max0.012338083585103353
get_robot_state_mean0.012276600390149836
get_robot_state_median0.012292473316192628
get_robot_state_min0.012183371343110738
get_state_dump_max0.012256677945454916
get_state_dump_mean0.011783989155501651
get_state_dump_median0.011695947019677414
get_state_dump_min0.01148738463719686
get_ui_image_max0.0410213843981425
get_ui_image_mean0.0398056879064493
get_ui_image_median0.03980541467666626
get_ui_image_min0.038590537874322185
in-drivable-lane_max12.050000000000054
in-drivable-lane_mean8.500000000000037
in-drivable-lane_min0.8000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 7.88962560252449, "get_ui_image": 0.0410213843981425, "step_physics": 0.09321956237157186, "survival_time": 14.950000000000076, "driven_lanedir": 1.3091089843817938, "get_state_dump": 0.01148738463719686, "sim_render-ego": 0.00579686959584554, "get_robot_state": 0.012338083585103353, "get_duckie_state": 2.0837783813476563e-06, "in-drivable-lane": 12.050000000000054, "agent_compute-ego": 0.08295616785685221, "deviation-heading": 0.7361123269606696, "complete-iteration": 0.27677819490432737, "set_robot_commands": 0.003953176339467367, "deviation-center-line": 0.1469766982916817, "driven_lanedir_consec": 1.3091089843817938, "sim_compute_sim_state": 0.022150525252024333, "sim_compute_performance-ego": 0.00371626615524292}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 7.889625602524494, "get_ui_image": 0.0399949328104655, "step_physics": 0.0908868177731832, "survival_time": 14.950000000000076, "driven_lanedir": 1.9347932994692916, "get_state_dump": 0.01179917335510254, "sim_render-ego": 0.005669716993967692, "get_robot_state": 0.01230877161026001, "get_duckie_state": 1.9629796346028644e-06, "in-drivable-lane": 10.800000000000049, "agent_compute-ego": 0.07899605909983318, "deviation-heading": 1.201260137482281, "complete-iteration": 0.2679415742556254, "set_robot_commands": 0.003901992638905843, "deviation-center-line": 0.2992724398303314, "driven_lanedir_consec": 1.9347932994692916, "sim_compute_sim_state": 0.020451658566792805, "sim_compute_performance-ego": 0.003790731430053711}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.843051686282266, "get_ui_image": 0.038590537874322185, "step_physics": 0.07998580054232948, "survival_time": 1.900000000000001, "driven_lanedir": 0.3867892875590312, "get_state_dump": 0.011592720684252288, "sim_render-ego": 0.005489443477831389, "get_robot_state": 0.012183371343110738, "get_duckie_state": 1.7881393432617188e-06, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.0776837938710263, "deviation-heading": 0.2571815534671106, "complete-iteration": 0.2538895230544241, "set_robot_commands": 0.0035660768810071445, "deviation-center-line": 0.051033901672191365, "driven_lanedir_consec": 0.3867892875590312, "sim_compute_sim_state": 0.021123484561317844, "sim_compute_performance-ego": 0.003537993682058234}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 7.8896256025245055, "get_ui_image": 0.03961589654286703, "step_physics": 0.08526126066843669, "survival_time": 14.950000000000076, "driven_lanedir": 2.108442573665656, "get_state_dump": 0.012256677945454916, "sim_render-ego": 0.005526758829752604, "get_robot_state": 0.012276175022125245, "get_duckie_state": 1.932779947916667e-06, "in-drivable-lane": 10.350000000000048, "agent_compute-ego": 0.07442472775777181, "deviation-heading": 1.5349557481686582, "complete-iteration": 0.26057832717895507, "set_robot_commands": 0.003719892501831055, "deviation-center-line": 0.3198688203990741, "driven_lanedir_consec": 2.108442573665656, "sim_compute_sim_state": 0.023857359091440836, "sim_compute_performance-ego": 0.0034973700841267902}}
set_robot_commands_max0.003953176339467367
set_robot_commands_mean0.003785284590302853
set_robot_commands_median0.003810942570368449
set_robot_commands_min0.0035660768810071445
sim_compute_performance-ego_max0.003790731430053711
sim_compute_performance-ego_mean0.0036355903378704137
sim_compute_performance-ego_median0.003627129918650577
sim_compute_performance-ego_min0.0034973700841267902
sim_compute_sim_state_max0.023857359091440836
sim_compute_sim_state_mean0.021895756867893957
sim_compute_sim_state_median0.021637004906671087
sim_compute_sim_state_min0.020451658566792805
sim_render-ego_max0.00579686959584554
sim_render-ego_mean0.0056206972243493065
sim_render-ego_median0.005598237911860148
sim_render-ego_min0.005489443477831389
simulation-passed1
step_physics_max0.09321956237157186
step_physics_mean0.0873383603388803
step_physics_median0.08807403922080995
step_physics_min0.07998580054232948
survival_time_max14.950000000000076
survival_time_mean11.68750000000006
survival_time_min1.900000000000001
No reset possible