Duckietown Challenges Home Challenges Submissions

Evaluator 2282

ID2282
evaluatormont04-ef63c33f6e8a-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont04-ef63c33f6e8a-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 41987
# timeout1 42013
# failed3 41978
# error2 41985
# aborted1 41980
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4201311351Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutnomont04-ef63c33f6e8a-1----No reset possible
4200711349Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednomont04-ef63c33f6e8a-10:02:41
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4200211348Bhavya Patwa 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornomont04-ef63c33f6e8a-11:00:25
Waited 3603 seconds [...]
Waited 3603 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4198711341Frank (Chude) Qian 🇨🇦template-tensorflowaido5-LF-sim-validationLFv-simsuccessnomont04-ef63c33f6e8a-10:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3082700666591687
survival_time_median1.2500000000000004
deviation-center-line_median0.06328719552974536
in-drivable-lane_median0.2750000000000002


other stats
agent_compute-ego_max0.10439571967491736
agent_compute-ego_mean0.040300134369086874
agent_compute-ego_median0.01915202915668487
agent_compute-ego_min0.01850075948806036
complete-iteration_max0.2872745990753174
complete-iteration_mean0.22654849307877675
complete-iteration_median0.2073107393582662
complete-iteration_min0.2042978945232573
deviation-center-line_max0.4638530090952888
deviation-center-line_mean0.16168444464569898
deviation-center-line_min0.05631037842801645
deviation-heading_max1.5151542472897073
deviation-heading_mean0.5674301278130888
deviation-heading_median0.27132167914278116
deviation-heading_min0.2119229056770854
driven_any_max6.885512778791684
driven_any_mean2.0320437584927338
driven_any_median0.4615642409653772
driven_any_min0.319533773248497
driven_lanedir_consec_max2.077289497880688
driven_lanedir_consec_mean0.7246786603886592
driven_lanedir_consec_min0.20488501035561144
driven_lanedir_max2.077289497880688
driven_lanedir_mean0.7246786603886592
driven_lanedir_median0.3082700666591687
driven_lanedir_min0.20488501035561144
get_duckie_state_max2.86102294921875e-06
get_duckie_state_mean2.7129632649404224e-06
get_duckie_state_median2.689789503048628e-06
get_duckie_state_min2.611251104445685e-06
get_robot_state_max0.016629897631131686
get_robot_state_mean0.015739216404956777
get_robot_state_median0.01629303256670634
get_robot_state_min0.013740902855282738
get_state_dump_max0.015160074600806603
get_state_dump_mean0.014589144437959342
get_state_dump_median0.014644370675086976
get_state_dump_min0.013907761800856818
get_ui_image_max0.03724086284637451
get_ui_image_mean0.035540633884978384
get_ui_image_median0.035325886072256625
get_ui_image_min0.03426990054902576
in-drivable-lane_max9.850000000000056
in-drivable-lane_mean2.6500000000000137
in-drivable-lane_min0.20000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.4860647718287001, "get_ui_image": 0.035227335416353665, "step_physics": 0.07750977919651912, "survival_time": 1.3000000000000005, "driven_lanedir": 0.34599616849907733, "get_state_dump": 0.015160074600806603, "sim_render-ego": 0.0063330301871666545, "get_robot_state": 0.016629897631131686, "get_duckie_state": 2.760153550368089e-06, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10439571967491736, "deviation-heading": 0.24230474808843408, "complete-iteration": 0.2872745990753174, "set_robot_commands": 0.0047996319257296045, "deviation-center-line": 0.06297626712927899, "driven_lanedir_consec": 0.34599616849907733, "sim_compute_sim_state": 0.022751670617323656, "sim_compute_performance-ego": 0.004317824657146747}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.4370637101020543, "get_ui_image": 0.03724086284637451, "step_physics": 0.08399222294489543, "survival_time": 1.2000000000000004, "driven_lanedir": 0.27054396481926, "get_state_dump": 0.014856308698654177, "sim_render-ego": 0.006422330935796102, "get_robot_state": 0.016512115796407063, "get_duckie_state": 2.86102294921875e-06, "in-drivable-lane": 0.30000000000000016, "agent_compute-ego": 0.01906693975130717, "deviation-heading": 0.30033861019712826, "complete-iteration": 0.2101014256477356, "set_robot_commands": 0.005117336908976237, "deviation-center-line": 0.05631037842801645, "driven_lanedir_consec": 0.27054396481926, "sim_compute_sim_state": 0.022420763969421387, "sim_compute_performance-ego": 0.0043221016724904375}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 6.885512778791684, "get_ui_image": 0.035424436728159585, "step_physics": 0.08038758436838786, "survival_time": 14.950000000000076, "driven_lanedir": 2.077289497880688, "get_state_dump": 0.014432432651519776, "sim_render-ego": 0.00621049960454305, "get_robot_state": 0.016073949337005615, "get_duckie_state": 2.6194254557291666e-06, "in-drivable-lane": 9.850000000000056, "agent_compute-ego": 0.01923711856206258, "deviation-heading": 1.5151542472897073, "complete-iteration": 0.2045200530687968, "set_robot_commands": 0.00503907839457194, "deviation-center-line": 0.4638530090952888, "driven_lanedir_consec": 2.077289497880688, "sim_compute_sim_state": 0.023395229975382487, "sim_compute_performance-ego": 0.004172879854838054}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.319533773248497, "get_ui_image": 0.03426990054902576, "step_physics": 0.08532404899597168, "survival_time": 1.0500000000000005, "driven_lanedir": 0.20488501035561144, "get_state_dump": 0.013907761800856818, "sim_render-ego": 0.005626281102498372, "get_robot_state": 0.013740902855282738, "get_duckie_state": 2.611251104445685e-06, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.01850075948806036, "deviation-heading": 0.2119229056770854, "complete-iteration": 0.2042978945232573, "set_robot_commands": 0.004825115203857422, "deviation-center-line": 0.06359812393021173, "driven_lanedir_consec": 0.20488501035561144, "sim_compute_sim_state": 0.02396959350222633, "sim_compute_performance-ego": 0.003983043489002046}}
set_robot_commands_max0.005117336908976237
set_robot_commands_mean0.004945290608283801
set_robot_commands_median0.004932096799214681
set_robot_commands_min0.0047996319257296045
sim_compute_performance-ego_max0.0043221016724904375
sim_compute_performance-ego_mean0.004198962418369321
sim_compute_performance-ego_median0.0042453522559924
sim_compute_performance-ego_min0.003983043489002046
sim_compute_sim_state_max0.02396959350222633
sim_compute_sim_state_mean0.023134314516088463
sim_compute_sim_state_median0.02307345029635307
sim_compute_sim_state_min0.022420763969421387
sim_render-ego_max0.006422330935796102
sim_render-ego_mean0.0061480354575010445
sim_render-ego_median0.006271764895854852
sim_render-ego_min0.005626281102498372
simulation-passed1
step_physics_max0.08532404899597168
step_physics_mean0.08180340887644352
step_physics_median0.08218990365664164
step_physics_min0.07750977919651912
survival_time_max14.950000000000076
survival_time_mean4.6250000000000195
survival_time_min1.0500000000000005
No reset possible
4198511344Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornomont04-ef63c33f6e8a-11:00:40
Waited 3600 seconds [...]
Waited 3600 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4198311342Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednomont04-ef63c33f6e8a-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4198011341Frank (Chude) Qian 🇨🇦template-tensorflowaido5-LF-sim-validationLFv-simabortednomont04-ef63c33f6e8a-10:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.32226478842715434
survival_time_median1.2750000000000004
deviation-center-line_median0.06706150391437496
in-drivable-lane_median0.2750000000000002


other stats
agent_compute-ego_max0.10431987267953378
agent_compute-ego_mean0.04069816021534502
agent_compute-ego_median0.01991603062266395
agent_compute-ego_min0.018640706936518352
complete-iteration_max0.27579304907057023
complete-iteration_mean0.21607840639258188
complete-iteration_median0.19888467090470452
complete-iteration_min0.1907512346903483
deviation-center-line_max0.4638530090952888
deviation-center-line_mean0.16357159883801378
deviation-center-line_min0.05631037842801645
deviation-heading_max1.5151542472897073
deviation-heading_mean0.5701750514709977
deviation-heading_median0.2768115264585992
deviation-heading_min0.2119229056770854
driven_any_max6.885512778791684
driven_any_mean2.0393747879380015
driven_any_median0.47622629985591247
driven_any_min0.319533773248497
driven_lanedir_consec_max2.077289497880688
driven_lanedir_consec_mean0.7316760212726521
driven_lanedir_consec_min0.20488501035561144
driven_lanedir_max2.077289497880688
driven_lanedir_mean0.7316760212726521
driven_lanedir_median0.32226478842715434
driven_lanedir_min0.20488501035561144
get_duckie_state_max2.675586276584201e-06
get_duckie_state_mean2.5693339014810226e-06
get_duckie_state_median2.614458401997884e-06
get_duckie_state_min2.372832525344122e-06
get_robot_state_max0.015304023424784345
get_robot_state_mean0.01420354964241149
get_robot_state_median0.013941811190711128
get_robot_state_min0.01362655276343936
get_state_dump_max0.014171812269422743
get_state_dump_mean0.013712772093121968
get_state_dump_median0.01368511438369751
get_state_dump_min0.013309047335670107
get_ui_image_max0.034311232566833494
get_ui_image_mean0.033240655264841816
get_ui_image_median0.03295840283550283
get_ui_image_min0.032734582821528115
in-drivable-lane_max9.850000000000056
in-drivable-lane_mean2.6500000000000137
in-drivable-lane_min0.20000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.5153888896097707, "get_ui_image": 0.032892721670645254, "step_physics": 0.07462057360896358, "survival_time": 1.3500000000000003, "driven_lanedir": 0.37398561203504865, "get_state_dump": 0.014171812269422743, "sim_render-ego": 0.005802657869127061, "get_robot_state": 0.013977262708875868, "get_duckie_state": 2.675586276584201e-06, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10431987267953378, "deviation-heading": 0.25328444272007006, "complete-iteration": 0.27579304907057023, "set_robot_commands": 0.004595579924406829, "deviation-center-line": 0.0705248838985382, "driven_lanedir_consec": 0.37398561203504865, "sim_compute_sim_state": 0.0211922151071054, "sim_compute_performance-ego": 0.004062493642171224}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.4370637101020543, "get_ui_image": 0.032734582821528115, "step_physics": 0.07573007543881734, "survival_time": 1.2000000000000004, "driven_lanedir": 0.27054396481926, "get_state_dump": 0.013700584570566813, "sim_render-ego": 0.005821724732716878, "get_robot_state": 0.013906359672546388, "get_duckie_state": 2.672274907430013e-06, "in-drivable-lane": 0.30000000000000016, "agent_compute-ego": 0.018640706936518352, "deviation-heading": 0.30033861019712826, "complete-iteration": 0.1907512346903483, "set_robot_commands": 0.004825711250305176, "deviation-center-line": 0.05631037842801645, "driven_lanedir_consec": 0.27054396481926, "sim_compute_sim_state": 0.02118807037671407, "sim_compute_performance-ego": 0.004047214984893799}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 6.885512778791684, "get_ui_image": 0.034311232566833494, "step_physics": 0.075456489721934, "survival_time": 14.950000000000076, "driven_lanedir": 2.077289497880688, "get_state_dump": 0.013669644196828206, "sim_render-ego": 0.006027962366739909, "get_robot_state": 0.015304023424784345, "get_duckie_state": 2.556641896565755e-06, "in-drivable-lane": 9.850000000000056, "agent_compute-ego": 0.019917388757069904, "deviation-heading": 1.5151542472897073, "complete-iteration": 0.19627252499262493, "set_robot_commands": 0.004974644184112548, "deviation-center-line": 0.4638530090952888, "driven_lanedir_consec": 2.077289497880688, "sim_compute_sim_state": 0.02235809246699015, "sim_compute_performance-ego": 0.004097940127054851}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.319533773248497, "get_ui_image": 0.0330240840003604, "step_physics": 0.0823907625107538, "survival_time": 1.0500000000000005, "driven_lanedir": 0.20488501035561144, "get_state_dump": 0.013309047335670107, "sim_render-ego": 0.005786521094185966, "get_robot_state": 0.01362655276343936, "get_duckie_state": 2.372832525344122e-06, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.019914672488258, "deviation-heading": 0.2119229056770854, "complete-iteration": 0.20149681681678408, "set_robot_commands": 0.004605384100051154, "deviation-center-line": 0.06359812393021173, "driven_lanedir_consec": 0.20488501035561144, "sim_compute_sim_state": 0.024541400727771577, "sim_compute_performance-ego": 0.004150231679280599}}
set_robot_commands_max0.004974644184112548
set_robot_commands_mean0.004750329864718926
set_robot_commands_median0.004715547675178165
set_robot_commands_min0.004595579924406829
sim_compute_performance-ego_max0.004150231679280599
sim_compute_performance-ego_mean0.0040894701083501175
sim_compute_performance-ego_median0.004080216884613037
sim_compute_performance-ego_min0.004047214984893799
sim_compute_sim_state_max0.024541400727771577
sim_compute_sim_state_mean0.0223199446696453
sim_compute_sim_state_median0.021775153787047776
sim_compute_sim_state_min0.02118807037671407
sim_render-ego_max0.006027962366739909
sim_render-ego_mean0.005859716515692453
sim_render-ego_median0.005812191300921969
sim_render-ego_min0.005786521094185966
simulation-passed1
step_physics_max0.0823907625107538
step_physics_mean0.07704947532011719
step_physics_median0.07559328258037568
step_physics_min0.07462057360896358
survival_time_max14.950000000000076
survival_time_mean4.63750000000002
survival_time_min1.0500000000000005
No reset possible
4197811340Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednomont04-ef63c33f6e8a-10:01:01
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible