Duckietown Challenges Home Challenges Submissions

Evaluator 1608

ID1608
evaluatorip-172-31-35-218-10492
ownerI don't have one 😀
machineip-172-31-35-218
processip-172-31-35-218-10492
versiond-c:5.0.7;d-c-r:5.0.11;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success1 25186
# timeout
# failed
# error
# aborted
# host-error4 25140
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
251864402Alex Deliyannischallenge-aido_LF-template-tensorflowaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104920:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1842027839263616
survival_time_median1.3000000000000005
deviation-center-line_median0.10470349887446208
in-drivable-lane_median0.04999999999999993


other stats
agent_compute-ego_max0.02612309302053144
agent_compute-ego_mean0.019979017069049473
agent_compute-ego_median0.01980869449786286
agent_compute-ego_min0.0162766170501709
deviation-center-line_max0.2195128341135992
deviation-center-line_mean0.11965066495161128
deviation-center-line_min0.05138196625470114
deviation-heading_max2.09912110893468
deviation-heading_mean0.7293532920783843
deviation-heading_median0.5624027275170563
deviation-heading_min0.2987822432778311
driven_any_max0.8781323718181886
driven_any_mean0.3984670085265996
driven_any_median0.3225499553344542
driven_any_min0.17545288639262913
driven_lanedir_consec_max0.5974954413498512
driven_lanedir_consec_mean0.28151770307717755
driven_lanedir_consec_min0.15348468534336843
driven_lanedir_max0.5974954413498512
driven_lanedir_mean0.3028452749364187
driven_lanedir_median0.23576895559026775
driven_lanedir_min0.15348468534336843
in-drivable-lane_max0.5499999999999985
in-drivable-lane_mean0.0899999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2580310932194903, "sim_physics": 0.09695303958395252, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1842027839263616, "sim_render-ego": 0.01091412875963294, "in-drivable-lane": 0, "agent_compute-ego": 0.025221959404323417, "deviation-heading": 0.6340150346163657, "set_robot_commands": 0.007998497589774754, "deviation-center-line": 0.08065418911632966, "driven_lanedir_consec": 0.1842027839263616, "sim_compute_sim_state": 0.004706569339918054, "sim_compute_performance-ego": 0.006392634433248769, "sim_compute_robot_state-ego": 0.008225980012313179}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5155260231296013, "sim_physics": 0.07342537029369457, "survival_time": 1.850000000000001, "driven_lanedir": 0.4222860588509091, "sim_render-ego": 0.008193428451950485, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.020338909046069997, "deviation-heading": 0.7210700601785971, "set_robot_commands": 0.00588208920246846, "deviation-center-line": 0.11201599775833, "driven_lanedir_consec": 0.4222860588509091, "sim_compute_sim_state": 0.00344613436106089, "sim_compute_performance-ego": 0.004502277116517763, "sim_compute_robot_state-ego": 0.005867687431541649}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3473654607620847, "sim_physics": 0.0961481217415102, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3378498662270695, "sim_render-ego": 0.0115879274183704, "in-drivable-lane": 0, "agent_compute-ego": 0.02612309302053144, "deviation-heading": 0.2987822432778311, "set_robot_commands": 0.008917393222931893, "deviation-center-line": 0.1374637481078199, "driven_lanedir_consec": 0.3378498662270695, "sim_compute_sim_state": 0.004424348954231509, "sim_compute_performance-ego": 0.006646894639538181, "sim_compute_robot_state-ego": 0.008059570866246377}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3225499553344542, "sim_physics": 0.0807877228810237, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2663674892239891, "sim_render-ego": 0.015131473541259766, "in-drivable-lane": 0, "agent_compute-ego": 0.020911014997042145, "deviation-heading": 0.5685025788614784, "set_robot_commands": 0.006625679823068472, "deviation-center-line": 0.07194847919462577, "driven_lanedir_consec": 0.2663674892239891, "sim_compute_sim_state": 0.003676698758051946, "sim_compute_performance-ego": 0.005195874434251051, "sim_compute_robot_state-ego": 0.006589421859154334}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4749277421116507, "sim_physics": 0.06477981143527561, "survival_time": 2.25, "driven_lanedir": 0.231994073601268, "sim_render-ego": 0.008129967583550347, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.019633224275377063, "deviation-heading": 1.2493373280565707, "set_robot_commands": 0.0058270189497205945, "deviation-center-line": 0.13558328174728465, "driven_lanedir_consec": 0.1623789998668843, "sim_compute_sim_state": 0.0034117698669433594, "sim_compute_performance-ego": 0.004557159211900499, "sim_compute_robot_state-ego": 0.005663315455118815}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.8781323718181886, "sim_physics": 0.07127626262493987, "survival_time": 3.349999999999996, "driven_lanedir": 0.5212140325713603, "sim_render-ego": 0.008423317724199438, "in-drivable-lane": 0.5499999999999985, "agent_compute-ego": 0.01980869449786286, "deviation-heading": 1.770144753086966, "set_robot_commands": 0.006126809476026849, "deviation-center-line": 0.2195128341135992, "driven_lanedir_consec": 0.5212140325713603, "sim_compute_sim_state": 0.003564019701374111, "sim_compute_performance-ego": 0.004726068297428871, "sim_compute_robot_state-ego": 0.005887675641187981}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.6608350783355073, "sim_physics": 0.08370540988060736, "survival_time": 3.099999999999997, "driven_lanedir": 0.4234138355810843, "sim_render-ego": 0.009995468201175813, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.02368602060502575, "deviation-heading": 2.09912110893468, "set_robot_commands": 0.0074870663304482735, "deviation-center-line": 0.2018963595789836, "driven_lanedir_consec": 0.17311533142685054, "sim_compute_sim_state": 0.004182169514317666, "sim_compute_performance-ego": 0.005874199251974782, "sim_compute_robot_state-ego": 0.007397294044494629}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.5955155461267574, "sim_physics": 0.07704027674414894, "survival_time": 2.2, "driven_lanedir": 0.5321778536538276, "sim_render-ego": 0.009243493730371649, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.02275008505040949, "deviation-heading": 0.513641648079555, "set_robot_commands": 0.0069865855303677645, "deviation-center-line": 0.20025820669216857, "driven_lanedir_consec": 0.5321778536538276, "sim_compute_sim_state": 0.0038825381885875354, "sim_compute_performance-ego": 0.005246682600541549, "sim_compute_robot_state-ego": 0.006622021848505194}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1847091645187285, "sim_physics": 0.07515540122985839, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15348468534336843, "sim_render-ego": 0.010388336181640624, "in-drivable-lane": 0, "agent_compute-ego": 0.021648063659667968, "deviation-heading": 0.5624027275170563, "set_robot_commands": 0.007885866165161133, "deviation-center-line": 0.07336534596198716, "driven_lanedir_consec": 0.15348468534336843, "sim_compute_sim_state": 0.0039783668518066405, "sim_compute_performance-ego": 0.005777978897094726, "sim_compute_robot_state-ego": 0.006785173416137696}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.202974345540159, "sim_physics": 0.06277268811276085, "survival_time": 0.9500000000000004, "driven_lanedir": 0.1543093698689888, "sim_render-ego": 0.007186262231124074, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01684060849641499, "deviation-heading": 0.32998010482318846, "set_robot_commands": 0.0048737902390329465, "deviation-center-line": 0.06395854323657815, "driven_lanedir_consec": 0.1543093698689888, "sim_compute_sim_state": 0.0028902354993318256, "sim_compute_performance-ego": 0.003981502432572215, "sim_compute_robot_state-ego": 0.0051486617640445105}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.20633482216338384, "sim_physics": 0.06099581718444824, "survival_time": 1.0000000000000002, "driven_lanedir": 0.16196237488595444, "sim_render-ego": 0.007509243488311767, "in-drivable-lane": 0.04999999999999993, "agent_compute-ego": 0.016838836669921874, "deviation-heading": 0.3045518083002793, "set_robot_commands": 0.005197179317474365, "deviation-center-line": 0.08146995724121178, "driven_lanedir_consec": 0.16196237488595444, "sim_compute_sim_state": 0.0029574155807495115, "sim_compute_performance-ego": 0.004120373725891113, "sim_compute_robot_state-ego": 0.005116403102874756}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.21871047072907956, "sim_physics": 0.06378332773844402, "survival_time": 0.9000000000000002, "driven_lanedir": 0.16366395084092633, "sim_render-ego": 0.007242692841423882, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01694015661875407, "deviation-heading": 0.33020732012705795, "set_robot_commands": 0.004927794138590495, "deviation-center-line": 0.05138196625470114, "driven_lanedir_consec": 0.16366395084092633, "sim_compute_sim_state": 0.0029591586854722765, "sim_compute_performance-ego": 0.004054096009996202, "sim_compute_robot_state-ego": 0.005197140905592177}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2987562859478422, "sim_physics": 0.057952692111333214, "survival_time": 1.2000000000000004, "driven_lanedir": 0.23576895559026775, "sim_render-ego": 0.007319122552871704, "in-drivable-lane": 0, "agent_compute-ego": 0.01634638508160909, "deviation-heading": 0.5171770696227082, "set_robot_commands": 0.005033264557520549, "deviation-center-line": 0.06349629498017767, "driven_lanedir_consec": 0.23576895559026775, "sim_compute_sim_state": 0.002891212701797486, "sim_compute_performance-ego": 0.004060616095860799, "sim_compute_robot_state-ego": 0.005098611116409302}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.6371838817694372, "sim_physics": 0.056064577102661134, "survival_time": 2.499999999999999, "driven_lanedir": 0.5974954413498512, "sim_render-ego": 0.007100863456726074, "in-drivable-lane": 0, "agent_compute-ego": 0.0162766170501709, "deviation-heading": 0.7156335171799187, "set_robot_commands": 0.005094375610351563, "deviation-center-line": 0.19705127141590956, "driven_lanedir_consec": 0.5974954413498512, "sim_compute_sim_state": 0.002928471565246582, "sim_compute_performance-ego": 0.003991308212280273, "sim_compute_robot_state-ego": 0.005037102699279785}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.17545288639262913, "sim_physics": 0.06019805669784546, "survival_time": 1.0000000000000002, "driven_lanedir": 0.15648835253105364, "sim_render-ego": 0.007367944717407227, "in-drivable-lane": 0, "agent_compute-ego": 0.016321587562561034, "deviation-heading": 0.32573207851350844, "set_robot_commands": 0.005060768127441407, "deviation-center-line": 0.10470349887446208, "driven_lanedir_consec": 0.15648835253105364, "sim_compute_sim_state": 0.002900683879852295, "sim_compute_performance-ego": 0.003996741771697998, "sim_compute_robot_state-ego": 0.005104029178619384}}
set_robot_commands_max0.008917393222931893
set_robot_commands_mean0.006261611885358636
set_robot_commands_median0.00588208920246846
set_robot_commands_min0.0048737902390329465
sim_compute_performance-ego_max0.006646894639538181
sim_compute_performance-ego_mean0.00487496047538632
sim_compute_performance-ego_median0.004557159211900499
sim_compute_performance-ego_min0.003981502432572215
sim_compute_robot_state-ego_max0.008225980012313179
sim_compute_robot_state-ego_mean0.0061200059561013175
sim_compute_robot_state-ego_median0.005867687431541649
sim_compute_robot_state-ego_min0.005037102699279785
sim_compute_sim_state_max0.004706569339918054
sim_compute_sim_state_mean0.0035199862299161127
sim_compute_sim_state_median0.00344613436106089
sim_compute_sim_state_min0.0028902354993318256
sim_physics_max0.09695303958395252
sim_physics_mean0.07206923835750029
sim_physics_median0.07127626262493987
sim_physics_min0.056064577102661134
sim_render-ego_max0.015131473541259766
sim_render-ego_mean0.00904891139200108
sim_render-ego_median0.008193428451950485
sim_render-ego_min0.007100863456726074
simulation-passed1
survival_time_max3.349999999999996
survival_time_mean1.703333333333333
survival_time_min0.9000000000000002
No reset possible
251603257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104920:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251463264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104920:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251453264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104920:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251403265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104920:00:05
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible