Duckietown Challenges Home Challenges Submissions

Evaluator 687

ID687
evaluatoridsc-rudolf-6108
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-6108
versiond-c:4.0.16;d-c-r:4.0.22;d-s:4.0.16
first heard
last heard
statusinactive
# evaluating
# success1 17729
# timeout
# failed
# error1 17722
# aborted2 17709
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
177312536Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFVI-sim-testingstep1-simulationabortednoidsc-rudolf-61080:00:37
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177292510Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-61080:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24485310743273692
survival_time_median1.0000000000000002
deviation-center-line_median0.02780957766589444
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.17249558953677907
agent_compute-ego_mean0.16540079179124215
agent_compute-ego_median0.16470936036879016
agent_compute-ego_min0.15899490118026732
deviation-center-line_max0.1367821242164622
deviation-center-line_mean0.05703768142247749
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792059
deviation-heading_mean0.33854872313755296
deviation-heading_median0.3074760381865352
deviation-heading_min0.16993642764665506
driven_any_max0.9094890302704578
driven_any_mean0.6148172530722962
driven_any_median0.5457640496143875
driven_any_min0.30227389810048894
driven_lanedir_consec_max0.797287526441987
driven_lanedir_consec_mean0.4211897171247365
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.797287526441987
driven_lanedir_mean0.4229139258079286
driven_lanedir_median0.24485310743273692
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.02112845182418823, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.0615828275680542, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.15899490118026732, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.07780900001525878, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.035925424098968504, "sim_compute_performance-ego": 0.0653497338294983, "sim_compute_robot_state-ego": 0.06505546569824219, "sim_compute_robot_state-npc0": 0.07210166454315185, "sim_compute_robot_state-npc1": 0.06583317518234252, "sim_compute_robot_state-npc2": 0.06784273386001587, "sim_compute_robot_state-npc3": 0.06862809658050537}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126896, "sim_physics": 0.024774902007159063, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120295193918956, "sim_render-ego": 0.07331010874579935, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.17249558953677907, "deviation-heading": 0.3074760381865352, "set_robot_commands": 0.0799101661233341, "deviation-center-line": 0.02399911835622947, "driven_lanedir_consec": 0.17258190852322874, "sim_compute_sim_state": 0.04195563933428596, "sim_compute_performance-ego": 0.06988909665276022, "sim_compute_robot_state-ego": 0.06715655326843262, "sim_compute_robot_state-npc0": 0.0745084145489861, "sim_compute_robot_state-npc1": 0.0699768627391142, "sim_compute_robot_state-npc2": 0.0721278611351462, "sim_compute_robot_state-npc3": 0.0740352658664479}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30227389810048894, "sim_physics": 0.025600886344909667, "survival_time": 0.49999999999999994, "driven_lanedir": 0.24485310743273692, "sim_render-ego": 0.06911802291870117, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.15998497009277343, "deviation-heading": 0.16993642764665506, "set_robot_commands": 0.07676308155059815, "deviation-center-line": 0.02780957766589444, "driven_lanedir_consec": 0.24485310743273692, "sim_compute_sim_state": 0.03762202262878418, "sim_compute_performance-ego": 0.07065341472625733, "sim_compute_robot_state-ego": 0.0687563419342041, "sim_compute_robot_state-npc0": 0.0714841365814209, "sim_compute_robot_state-npc1": 0.06775286197662353, "sim_compute_robot_state-npc2": 0.0686265230178833, "sim_compute_robot_state-npc3": 0.06554126739501953}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.0232560464314052, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.07281188453946795, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17081913777760097, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.08032298939568656, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.04114523955753872, "sim_compute_performance-ego": 0.06639466115406581, "sim_compute_robot_state-ego": 0.0648074746131897, "sim_compute_robot_state-npc0": 0.07820222207478114, "sim_compute_robot_state-npc1": 0.072767402444567, "sim_compute_robot_state-npc2": 0.07162904739379883, "sim_compute_robot_state-npc3": 0.0729003804070609}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704578, "sim_physics": 0.022135042375133883, "survival_time": 1.5500000000000007, "driven_lanedir": 0.797287526441987, "sim_render-ego": 0.06984816828081684, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.16470936036879016, "deviation-heading": 0.6295143987792059, "set_robot_commands": 0.07765463859804216, "deviation-center-line": 0.1367821242164622, "driven_lanedir_consec": 0.797287526441987, "sim_compute_sim_state": 0.039840690551265594, "sim_compute_performance-ego": 0.06680776226905084, "sim_compute_robot_state-ego": 0.06672480029444541, "sim_compute_robot_state-npc0": 0.0804380678361462, "sim_compute_robot_state-npc1": 0.07318335194741526, "sim_compute_robot_state-npc2": 0.07003527302895823, "sim_compute_robot_state-npc3": 0.06924398483768586}}
set_robot_commands_max0.08032298939568656
set_robot_commands_mean0.07849197513658394
set_robot_commands_median0.07780900001525878
set_robot_commands_min0.07676308155059815
sim_compute_performance-ego_max0.07065341472625733
sim_compute_performance-ego_mean0.0678189337263265
sim_compute_performance-ego_median0.06680776226905084
sim_compute_performance-ego_min0.0653497338294983
sim_compute_robot_state-ego_max0.0687563419342041
sim_compute_robot_state-ego_mean0.0665001271617028
sim_compute_robot_state-ego_median0.06672480029444541
sim_compute_robot_state-ego_min0.0648074746131897
sim_compute_robot_state-npc0_max0.0804380678361462
sim_compute_robot_state-npc0_mean0.07534690111689725
sim_compute_robot_state-npc0_median0.0745084145489861
sim_compute_robot_state-npc0_min0.0714841365814209
sim_compute_robot_state-npc1_max0.07318335194741526
sim_compute_robot_state-npc1_mean0.0699027308580125
sim_compute_robot_state-npc1_median0.0699768627391142
sim_compute_robot_state-npc1_min0.06583317518234252
sim_compute_robot_state-npc2_max0.0721278611351462
sim_compute_robot_state-npc2_mean0.07005228768716049
sim_compute_robot_state-npc2_median0.07003527302895823
sim_compute_robot_state-npc2_min0.06784273386001587
sim_compute_robot_state-npc3_max0.0740352658664479
sim_compute_robot_state-npc3_mean0.0700697990173439
sim_compute_robot_state-npc3_median0.06924398483768586
sim_compute_robot_state-npc3_min0.06554126739501953
sim_compute_sim_state_max0.04195563933428596
sim_compute_sim_state_mean0.03929780323416859
sim_compute_sim_state_median0.039840690551265594
sim_compute_sim_state_min0.035925424098968504
sim_physics_max0.025600886344909667
sim_physics_mean0.023379065796559212
sim_physics_median0.0232560464314052
sim_physics_min0.02112845182418823
sim_render-ego_max0.07331010874579935
sim_render-ego_mean0.0693342024105679
sim_render-ego_median0.06984816828081684
sim_render-ego_min0.0615828275680542
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
177222532Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-61080:00:39
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177092516Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationabortednoidsc-rudolf-61080:01:45
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible