Duckietown Challenges Home Challenges Submissions

Evaluator 685

ID685
evaluatorInstance2
ownerJulian Zilly
machineidsc-rudolf
processInstance2
versiond-c:4.0.16;d-c-r:4.0.22;d-s:4.0.16
first heard
last heard
statusinactive
# evaluating
# success1 17720
# timeout
# failed
# error2 17708
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
177352538Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornoInstance20:00:52
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177202511Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationsuccessnoInstance20:05:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24485310743273692
survival_time_median1.0000000000000002
deviation-center-line_median0.02780957766589444
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16359051581351988
agent_compute-ego_mean0.15480778230370854
agent_compute-ego_median0.15386958633150374
agent_compute-ego_min0.1487230896949768
deviation-center-line_max0.1367821242164622
deviation-center-line_mean0.05703768142247749
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792059
deviation-heading_mean0.33854872313755296
deviation-heading_median0.3074760381865352
deviation-heading_min0.16993642764665506
driven_any_max0.9094890302704578
driven_any_mean0.6148172530722962
driven_any_median0.5457640496143875
driven_any_min0.30227389810048894
driven_lanedir_consec_max0.797287526441987
driven_lanedir_consec_mean0.4211897171247365
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.797287526441987
driven_lanedir_mean0.4229139258079286
driven_lanedir_median0.24485310743273692
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.019787812232971193, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.05425840616226196, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.1487230896949768, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.0721941351890564, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.031774473190307614, "sim_compute_performance-ego": 0.06031038761138916, "sim_compute_robot_state-ego": 0.06288940906524658, "sim_compute_robot_state-npc0": 0.06115834712982178, "sim_compute_robot_state-npc1": 0.057150614261627194, "sim_compute_robot_state-npc2": 0.05982650518417358, "sim_compute_robot_state-npc3": 0.058366692066192626}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126896, "sim_physics": 0.025609871920417335, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120295193918956, "sim_render-ego": 0.06410809124217313, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.15712575351490693, "deviation-heading": 0.3074760381865352, "set_robot_commands": 0.07593868760501638, "deviation-center-line": 0.02399911835622947, "driven_lanedir_consec": 0.17258190852322874, "sim_compute_sim_state": 0.03586878496057847, "sim_compute_performance-ego": 0.06421292529386632, "sim_compute_robot_state-ego": 0.06671940579133875, "sim_compute_robot_state-npc0": 0.06973420872407801, "sim_compute_robot_state-npc1": 0.06466965114369112, "sim_compute_robot_state-npc2": 0.06357148114372702, "sim_compute_robot_state-npc3": 0.06629476827733657}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30227389810048894, "sim_physics": 0.02353191375732422, "survival_time": 0.49999999999999994, "driven_lanedir": 0.24485310743273692, "sim_render-ego": 0.06262018680572509, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.1507299661636353, "deviation-heading": 0.16993642764665506, "set_robot_commands": 0.07996952533721924, "deviation-center-line": 0.02780957766589444, "driven_lanedir_consec": 0.24485310743273692, "sim_compute_sim_state": 0.033309531211853025, "sim_compute_performance-ego": 0.06105489730834961, "sim_compute_robot_state-ego": 0.06842899322509766, "sim_compute_robot_state-npc0": 0.06742367744445801, "sim_compute_robot_state-npc1": 0.06430597305297851, "sim_compute_robot_state-npc2": 0.06597514152526855, "sim_compute_robot_state-npc3": 0.06409058570861817}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.026007379804338728, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.06880370208195277, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15386958633150374, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.07715986456189837, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.037326957498277934, "sim_compute_performance-ego": 0.06824404852730888, "sim_compute_robot_state-ego": 0.06485245057514735, "sim_compute_robot_state-npc0": 0.07311761379241943, "sim_compute_robot_state-npc1": 0.06734249421528407, "sim_compute_robot_state-npc2": 0.06710551466260638, "sim_compute_robot_state-npc3": 0.06807877336229597}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704578, "sim_physics": 0.023526668548583984, "survival_time": 1.5500000000000007, "driven_lanedir": 0.797287526441987, "sim_render-ego": 0.07300233071850191, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.16359051581351988, "deviation-heading": 0.6295143987792059, "set_robot_commands": 0.07875472499478248, "deviation-center-line": 0.1367821242164622, "driven_lanedir_consec": 0.797287526441987, "sim_compute_sim_state": 0.04153013229370117, "sim_compute_performance-ego": 0.0702276998950589, "sim_compute_robot_state-ego": 0.06882852123629662, "sim_compute_robot_state-npc0": 0.0774393081665039, "sim_compute_robot_state-npc1": 0.07601311899000598, "sim_compute_robot_state-npc2": 0.07487737747930712, "sim_compute_robot_state-npc3": 0.07239683212772492}}
set_robot_commands_max0.07996952533721924
set_robot_commands_mean0.07680338753759457
set_robot_commands_median0.07715986456189837
set_robot_commands_min0.0721941351890564
sim_compute_performance-ego_max0.0702276998950589
sim_compute_performance-ego_mean0.06480999172719457
sim_compute_performance-ego_median0.06421292529386632
sim_compute_performance-ego_min0.06031038761138916
sim_compute_robot_state-ego_max0.06882852123629662
sim_compute_robot_state-ego_mean0.0663437559786254
sim_compute_robot_state-ego_median0.06671940579133875
sim_compute_robot_state-ego_min0.06288940906524658
sim_compute_robot_state-npc0_max0.0774393081665039
sim_compute_robot_state-npc0_mean0.06977463105145623
sim_compute_robot_state-npc0_median0.06973420872407801
sim_compute_robot_state-npc0_min0.06115834712982178
sim_compute_robot_state-npc1_max0.07601311899000598
sim_compute_robot_state-npc1_mean0.06589637033271738
sim_compute_robot_state-npc1_median0.06466965114369112
sim_compute_robot_state-npc1_min0.057150614261627194
sim_compute_robot_state-npc2_max0.07487737747930712
sim_compute_robot_state-npc2_mean0.06627120399901652
sim_compute_robot_state-npc2_median0.06597514152526855
sim_compute_robot_state-npc2_min0.05982650518417358
sim_compute_robot_state-npc3_max0.07239683212772492
sim_compute_robot_state-npc3_mean0.06584553030843365
sim_compute_robot_state-npc3_median0.06629476827733657
sim_compute_robot_state-npc3_min0.058366692066192626
sim_compute_sim_state_max0.04153013229370117
sim_compute_sim_state_mean0.03596197583094364
sim_compute_sim_state_median0.03586878496057847
sim_compute_sim_state_min0.031774473190307614
sim_physics_max0.026007379804338728
sim_physics_mean0.023692729252727092
sim_physics_median0.02353191375732422
sim_physics_min0.019787812232971193
sim_render-ego_max0.07300233071850191
sim_render-ego_mean0.06455854340212297
sim_render-ego_median0.06410809124217313
sim_render-ego_min0.05425840616226196
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
177082533Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFV-sim-validationstep1-simulationerrornoInstance20:02:13
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible