Duckietown Challenges Home Challenges Submissions

Evaluator 1389

ID1389
evaluatoruberduck-12491
ownerI don't have one 😀
machineuberduck
processuberduck-12491
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success1 23548
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
235483679Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessyesuberduck-124910:30:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6935805249478659
survival_time_median14.950000000000076
deviation-center-line_median0.13811270405225393
in-drivable-lane_median7.250000000000037


other stats
agent_compute-ego_max0.15933898687362671
agent_compute-ego_mean0.15797752710346122
agent_compute-ego_median0.15821378469467162
agent_compute-ego_min0.15302540196312797
deviation-center-line_max0.5247579329171296
deviation-center-line_mean0.2279084377875802
deviation-center-line_min0.038694648277245336
deviation-heading_max6.053631647519605
deviation-heading_mean4.3381373313945835
deviation-heading_median5.704071130785565
deviation-heading_min0.2698718914419194
driven_any_max2.185306548531152
driven_any_mean1.625802086819021
driven_any_median2.185306548531143
driven_any_min0.08532904011133041
driven_lanedir_consec_max0.6958089939919965
driven_lanedir_consec_mean0.5164610549083716
driven_lanedir_consec_min0.023144130689651377
driven_lanedir_max0.6958089939919965
driven_lanedir_mean0.5164610549083716
driven_lanedir_median0.6935805249478659
driven_lanedir_min0.023144130689651377
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean5.436666666666693
in-drivable-lane_min0.2500000000000002
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.185306548531152, "sim_physics": 0.039283523559570314, "survival_time": 14.950000000000076, "driven_lanedir": 0.6935805249478659, "sim_render-ego": 0.03448126236597697, "in-drivable-lane": 7.300000000000036, "agent_compute-ego": 0.15933898687362671, "deviation-heading": 5.801699789039097, "set_robot_commands": 0.05379996379216512, "deviation-center-line": 0.42632647013358815, "driven_lanedir_consec": 0.6935805249478659, "sim_compute_sim_state": 0.022508841355641684, "sim_compute_performance-ego": 0.03749715805053711, "sim_compute_robot_state-ego": 0.04242408911387126}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311447, "sim_physics": 0.0397440505027771, "survival_time": 14.950000000000076, "driven_lanedir": 0.6945338083100598, "sim_render-ego": 0.034337681929270426, "in-drivable-lane": 7.350000000000037, "agent_compute-ego": 0.15785382350285848, "deviation-heading": 5.704071130785565, "set_robot_commands": 0.05418444474538167, "deviation-center-line": 0.09203990928853956, "driven_lanedir_consec": 0.6945338083100598, "sim_compute_sim_state": 0.022943864663441976, "sim_compute_performance-ego": 0.03786550839742025, "sim_compute_robot_state-ego": 0.04279261271158854}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08532904011133041, "sim_physics": 0.04327666759490967, "survival_time": 0.9000000000000002, "driven_lanedir": 0.023144130689651377, "sim_render-ego": 0.03585749202304416, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15838680002424452, "deviation-heading": 0.3584582273080204, "set_robot_commands": 0.05345202816857232, "deviation-center-line": 0.041663353925832584, "driven_lanedir_consec": 0.023144130689651377, "sim_compute_sim_state": 0.023923675219217937, "sim_compute_performance-ego": 0.04061571756998698, "sim_compute_robot_state-ego": 0.04394936561584473}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.185306548531149, "sim_physics": 0.04025985399881999, "survival_time": 14.950000000000076, "driven_lanedir": 0.6921605544021268, "sim_render-ego": 0.03448169469833374, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.15802271763483683, "deviation-heading": 5.725118401226187, "set_robot_commands": 0.05349369843800863, "deviation-center-line": 0.3235070869376339, "driven_lanedir_consec": 0.6921605544021268, "sim_compute_sim_state": 0.022332515716552735, "sim_compute_performance-ego": 0.038118801911671954, "sim_compute_robot_state-ego": 0.04273395776748657}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.18530654853115, "sim_physics": 0.037029492855072024, "survival_time": 14.950000000000076, "driven_lanedir": 0.6948995260115542, "sim_render-ego": 0.03383704582850138, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.15776660442352294, "deviation-heading": 5.610544076489624, "set_robot_commands": 0.05405068318049113, "deviation-center-line": 0.13576341190830038, "driven_lanedir_consec": 0.6948995260115542, "sim_compute_sim_state": 0.021787665685017905, "sim_compute_performance-ego": 0.0370750617980957, "sim_compute_robot_state-ego": 0.04220193068186442}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.18530654853114, "sim_physics": 0.03879992564519246, "survival_time": 14.950000000000076, "driven_lanedir": 0.6935576438398612, "sim_render-ego": 0.03467660586039225, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.15821378469467162, "deviation-heading": 6.053631647519605, "set_robot_commands": 0.05319578250249227, "deviation-center-line": 0.46569006797573825, "driven_lanedir_consec": 0.6935576438398612, "sim_compute_sim_state": 0.022146724859873453, "sim_compute_performance-ego": 0.03746253728866577, "sim_compute_robot_state-ego": 0.042493101755777994}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.185306548531143, "sim_physics": 0.039200963973999026, "survival_time": 14.950000000000076, "driven_lanedir": 0.6953333414337557, "sim_render-ego": 0.034529268741607666, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.1591520078976949, "deviation-heading": 5.874526439563811, "set_robot_commands": 0.05378411610921224, "deviation-center-line": 0.5247579329171296, "driven_lanedir_consec": 0.6953333414337557, "sim_compute_sim_state": 0.02271462599436442, "sim_compute_performance-ego": 0.03891139348347982, "sim_compute_robot_state-ego": 0.04268733898798625}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.08532904011133226, "sim_physics": 0.04181370470258925, "survival_time": 0.9000000000000002, "driven_lanedir": 0.023710002985235512, "sim_render-ego": 0.03321834405263265, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15302540196312797, "deviation-heading": 0.3476484984306861, "set_robot_commands": 0.06430554389953613, "deviation-center-line": 0.038694648277245336, "driven_lanedir_consec": 0.023710002985235512, "sim_compute_sim_state": 0.021387471093071833, "sim_compute_performance-ego": 0.037261406580607094, "sim_compute_robot_state-ego": 0.04381538761986627}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.1853065485311474, "sim_physics": 0.03864828666051229, "survival_time": 14.950000000000076, "driven_lanedir": 0.693726533816768, "sim_render-ego": 0.034654221534729, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.157433230082194, "deviation-heading": 5.901771614359146, "set_robot_commands": 0.05313583453496297, "deviation-center-line": 0.1351465823580643, "driven_lanedir_consec": 0.693726533816768, "sim_compute_sim_state": 0.0229230801264445, "sim_compute_performance-ego": 0.03760641813278198, "sim_compute_robot_state-ego": 0.04265083392461141}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.185306548531149, "sim_physics": 0.0383633812268575, "survival_time": 14.950000000000076, "driven_lanedir": 0.6946567575492519, "sim_render-ego": 0.034336596330006915, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.15875677029291788, "deviation-heading": 5.862596978233645, "set_robot_commands": 0.053025810718536376, "deviation-center-line": 0.4400368985757062, "driven_lanedir_consec": 0.6946567575492519, "sim_compute_sim_state": 0.022499624888102213, "sim_compute_performance-ego": 0.03890157779057821, "sim_compute_robot_state-ego": 0.04237241029739379}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.09267214810871956, "sim_physics": 0.04465564928556744, "survival_time": 0.9500000000000004, "driven_lanedir": 0.032550922632334056, "sim_render-ego": 0.03487423846596166, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15849286631533974, "deviation-heading": 0.2698718914419194, "set_robot_commands": 0.0542335635737369, "deviation-center-line": 0.04534215101103772, "driven_lanedir_consec": 0.032550922632334056, "sim_compute_sim_state": 0.024648704026874742, "sim_compute_performance-ego": 0.037455270164891294, "sim_compute_robot_state-ego": 0.04296640345924779}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.185306548531143, "sim_physics": 0.03881066083908081, "survival_time": 14.950000000000076, "driven_lanedir": 0.6958089939919965, "sim_render-ego": 0.03411954243977865, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.1585290789604187, "deviation-heading": 5.984218850284319, "set_robot_commands": 0.05329973300298055, "deviation-center-line": 0.34479124707378467, "driven_lanedir_consec": 0.6958089939919965, "sim_compute_sim_state": 0.02195420742034912, "sim_compute_performance-ego": 0.03725295861562093, "sim_compute_robot_state-ego": 0.04198444922765096}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.185306548531148, "sim_physics": 0.0374134635925293, "survival_time": 14.950000000000076, "driven_lanedir": 0.6932617575622324, "sim_render-ego": 0.03434733947118123, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.15921226421991985, "deviation-heading": 5.617488650083433, "set_robot_commands": 0.05295859177907307, "deviation-center-line": 0.2108984178734968, "driven_lanedir_consec": 0.6932617575622324, "sim_compute_sim_state": 0.02272683064142863, "sim_compute_performance-ego": 0.03834009250005086, "sim_compute_robot_state-ego": 0.04281677881876628}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.1853065485311327, "sim_physics": 0.03806484858194987, "survival_time": 14.950000000000076, "driven_lanedir": 0.6938456840605172, "sim_render-ego": 0.03399771769841512, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.15766629219055175, "deviation-heading": 5.688506307987748, "set_robot_commands": 0.05308113257090251, "deviation-center-line": 0.13811270405225393, "driven_lanedir_consec": 0.6938456840605172, "sim_compute_sim_state": 0.02228950579961141, "sim_compute_performance-ego": 0.03770959297815959, "sim_compute_robot_state-ego": 0.04221926212310791}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.085329040111332, "sim_physics": 0.04281024138132731, "survival_time": 0.9000000000000002, "driven_lanedir": 0.03214564139236442, "sim_render-ego": 0.034628205829196505, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.15781227747599283, "deviation-heading": 0.27190746816595013, "set_robot_commands": 0.053916864924960665, "deviation-center-line": 0.05585568450535137, "driven_lanedir_consec": 0.03214564139236442, "sim_compute_sim_state": 0.023171146710713703, "sim_compute_performance-ego": 0.039982583787706166, "sim_compute_robot_state-ego": 0.041894767019483775}}
set_robot_commands_max0.06430554389953613
set_robot_commands_mean0.054261186129400826
set_robot_commands_median0.05349369843800863
set_robot_commands_min0.05295859177907307
sim_compute_performance-ego_max0.04061571756998698
sim_compute_performance-ego_mean0.038137071936683586
sim_compute_performance-ego_median0.03770959297815959
sim_compute_performance-ego_min0.0370750617980957
sim_compute_robot_state-ego_max0.04394936561584473
sim_compute_robot_state-ego_mean0.042666845941636534
sim_compute_robot_state-ego_median0.04265083392461141
sim_compute_robot_state-ego_min0.041894767019483775
sim_compute_sim_state_max0.024648704026874742
sim_compute_sim_state_mean0.022663898946713744
sim_compute_sim_state_median0.022508841355641684
sim_compute_sim_state_min0.021387471093071833
sim_physics_max0.04465564928556744
sim_physics_mean0.03987831429338362
sim_physics_median0.039200963973999026
sim_physics_min0.037029492855072024
sim_render-ego_max0.03585749202304416
sim_render-ego_mean0.034425150484601895
sim_render-ego_median0.03448126236597697
sim_render-ego_min0.03321834405263265
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.206666666666724
survival_time_min0.9000000000000002
No reset possible