Duckietown Challenges Home Challenges Submissions

Evaluator 650

ID650
evaluatoridsc-rudolf-5891
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-5891
versiond-c:4.0.14;d-c-r:4.0.19;d-s:4.0.15
first heard
last heard
statusinactive
# evaluating
# success4 17652
# timeout
# failed
# error1 17641
# aborted
# host-error1 17627
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
177022460Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-58910:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24485310743273692
survival_time_median1.0000000000000002
deviation-center-line_median0.02780957766589444
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16401573419570922
agent_compute-ego_mean0.15432898552057767
agent_compute-ego_median0.152299427986145
agent_compute-ego_min0.14893290826252528
deviation-center-line_max0.1367821242164622
deviation-center-line_mean0.05703768142247749
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792059
deviation-heading_mean0.33854872313755296
deviation-heading_median0.3074760381865352
deviation-heading_min0.16993642764665506
driven_any_max0.9094890302704578
driven_any_mean0.6148172530722962
driven_any_median0.5457640496143875
driven_any_min0.30227389810048894
driven_lanedir_consec_max0.797287526441987
driven_lanedir_consec_mean0.4211897171247365
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.797287526441987
driven_lanedir_mean0.4229139258079286
driven_lanedir_median0.24485310743273692
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.02099665403366089, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.0672081708908081, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.16401573419570922, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.07631691694259643, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.038451218605041505, "sim_compute_performance-ego": 0.06239382028579712, "sim_compute_robot_state-ego": 0.06028571128845215, "sim_compute_robot_state-npc0": 0.07184643745422363, "sim_compute_robot_state-npc1": 0.06845178604125976, "sim_compute_robot_state-npc2": 0.06897711753845215, "sim_compute_robot_state-npc3": 0.06765971183776856}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126896, "sim_physics": 0.023714794832117417, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120295193918956, "sim_render-ego": 0.061299955143648034, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.15060882007374482, "deviation-heading": 0.3074760381865352, "set_robot_commands": 0.0764468277201933, "deviation-center-line": 0.02399911835622947, "driven_lanedir_consec": 0.17258190852322874, "sim_compute_sim_state": 0.03509128794950597, "sim_compute_performance-ego": 0.057968981125775504, "sim_compute_robot_state-ego": 0.06298083417555865, "sim_compute_robot_state-npc0": 0.06644355549531825, "sim_compute_robot_state-npc1": 0.06539386861464556, "sim_compute_robot_state-npc2": 0.0654286496779498, "sim_compute_robot_state-npc3": 0.062488247366512525}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30227389810048894, "sim_physics": 0.026598858833312988, "survival_time": 0.49999999999999994, "driven_lanedir": 0.24485310743273692, "sim_render-ego": 0.06487791538238526, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.152299427986145, "deviation-heading": 0.16993642764665506, "set_robot_commands": 0.07579431533813477, "deviation-center-line": 0.02780957766589444, "driven_lanedir_consec": 0.24485310743273692, "sim_compute_sim_state": 0.03960187435150146, "sim_compute_performance-ego": 0.06864871978759765, "sim_compute_robot_state-ego": 0.06644957065582276, "sim_compute_robot_state-npc0": 0.07108421325683593, "sim_compute_robot_state-npc1": 0.06759417057037354, "sim_compute_robot_state-npc2": 0.06589078903198242, "sim_compute_robot_state-npc3": 0.06564869880676269}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.020610289914267405, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.06211239950997489, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14893290826252528, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.07437453951154437, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.033135405608585904, "sim_compute_performance-ego": 0.05819693633488247, "sim_compute_robot_state-ego": 0.056752605097634454, "sim_compute_robot_state-npc0": 0.0623511757169451, "sim_compute_robot_state-npc1": 0.060183320726667135, "sim_compute_robot_state-npc2": 0.05988424164908273, "sim_compute_robot_state-npc3": 0.060046638761247904}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704578, "sim_physics": 0.02092237626352618, "survival_time": 1.5500000000000007, "driven_lanedir": 0.797287526441987, "sim_render-ego": 0.061667442321777344, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.15578803708476405, "deviation-heading": 0.6295143987792059, "set_robot_commands": 0.08009967496318202, "deviation-center-line": 0.1367821242164622, "driven_lanedir_consec": 0.797287526441987, "sim_compute_sim_state": 0.03282968459590789, "sim_compute_performance-ego": 0.06643614461345057, "sim_compute_robot_state-ego": 0.06157590496924616, "sim_compute_robot_state-npc0": 0.07002699759698683, "sim_compute_robot_state-npc1": 0.0642903543287708, "sim_compute_robot_state-npc2": 0.06444029654225995, "sim_compute_robot_state-npc3": 0.0623700003470144}}
set_robot_commands_max0.08009967496318202
set_robot_commands_mean0.07660645489513018
set_robot_commands_median0.07631691694259643
set_robot_commands_min0.07437453951154437
sim_compute_performance-ego_max0.06864871978759765
sim_compute_performance-ego_mean0.06272892042950066
sim_compute_performance-ego_median0.06239382028579712
sim_compute_performance-ego_min0.057968981125775504
sim_compute_robot_state-ego_max0.06644957065582276
sim_compute_robot_state-ego_mean0.061608925237342835
sim_compute_robot_state-ego_median0.06157590496924616
sim_compute_robot_state-ego_min0.056752605097634454
sim_compute_robot_state-npc0_max0.07184643745422363
sim_compute_robot_state-npc0_mean0.06835047590406194
sim_compute_robot_state-npc0_median0.07002699759698683
sim_compute_robot_state-npc0_min0.0623511757169451
sim_compute_robot_state-npc1_max0.06845178604125976
sim_compute_robot_state-npc1_mean0.06518270005634336
sim_compute_robot_state-npc1_median0.06539386861464556
sim_compute_robot_state-npc1_min0.060183320726667135
sim_compute_robot_state-npc2_max0.06897711753845215
sim_compute_robot_state-npc2_mean0.06492421888794542
sim_compute_robot_state-npc2_median0.0654286496779498
sim_compute_robot_state-npc2_min0.05988424164908273
sim_compute_robot_state-npc3_max0.06765971183776856
sim_compute_robot_state-npc3_mean0.06364265942386121
sim_compute_robot_state-npc3_median0.062488247366512525
sim_compute_robot_state-npc3_min0.060046638761247904
sim_compute_sim_state_max0.03960187435150146
sim_compute_sim_state_mean0.03582189422210854
sim_compute_sim_state_median0.03509128794950597
sim_compute_sim_state_min0.03282968459590789
sim_physics_max0.026598858833312988
sim_physics_mean0.022568594775376975
sim_physics_median0.02099665403366089
sim_physics_min0.020610289914267405
sim_render-ego_max0.0672081708908081
sim_render-ego_mean0.06343317664971873
sim_render-ego_median0.06211239950997489
sim_render-ego_min0.061299955143648034
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
176842492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-58910:06:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.14968670310224663
survival_time_median1.950000000000001
deviation-center-line_median0.026601869463271685
in-drivable-lane_median0.9500000000000004


other stats
agent_compute-ego_max0.22193883812945825
agent_compute-ego_mean0.18301735310470152
agent_compute-ego_median0.1702104531801664
agent_compute-ego_min0.16307038181232955
deviation-center-line_max0.07628285458566914
deviation-center-line_mean0.04253524280289111
deviation-center-line_min0.01794634473968737
deviation-heading_max1.9015193440581577
deviation-heading_mean0.9764038698610804
deviation-heading_median0.7313033789567542
deviation-heading_min0.4746007116730604
driven_any_max1.2251802854317448
driven_any_mean0.5909706562213726
driven_any_median0.47712200415230094
driven_any_min0.26098288947564435
driven_lanedir_consec_max0.3068917896128962
driven_lanedir_consec_mean0.1750726636092402
driven_lanedir_consec_min0.06982026130673225
driven_lanedir_max0.3068917896128962
driven_lanedir_mean0.1750726636092402
driven_lanedir_median0.14968670310224663
driven_lanedir_min0.06982026130673225
in-drivable-lane_max2.599999999999995
in-drivable-lane_mean1.169999999999999
in-drivable-lane_min0.55
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2251802854317448, "sim_physics": 0.014865946769714356, "survival_time": 4.99999999999999, "driven_lanedir": 0.3068917896128962, "sim_render-ego": 0.06482208490371705, "in-drivable-lane": 2.599999999999995, "agent_compute-ego": 0.1942338418960571, "deviation-heading": 1.9015193440581577, "set_robot_commands": 0.0805260705947876, "deviation-center-line": 0.0716926096531827, "driven_lanedir_consec": 0.3068917896128962, "sim_compute_sim_state": 0.04081210136413574, "sim_compute_performance-ego": 0.06513190746307373, "sim_compute_robot_state-ego": 0.065569908618927}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3901266790478741, "sim_physics": 0.012607446083655724, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1443472945941453, "sim_render-ego": 0.06578281292548546, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.1702104531801664, "deviation-heading": 0.5843676666032386, "set_robot_commands": 0.07470669196202205, "deviation-center-line": 0.026601869463271685, "driven_lanedir_consec": 0.1443472945941453, "sim_compute_sim_state": 0.04100112731640155, "sim_compute_performance-ego": 0.06188337619488056, "sim_compute_robot_state-ego": 0.06358960041633019}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6014414229992986, "sim_physics": 0.014395016544270065, "survival_time": 2.6499999999999986, "driven_lanedir": 0.20461726943018063, "sim_render-ego": 0.07314363065755593, "in-drivable-lane": 1.1999999999999995, "agent_compute-ego": 0.16307038181232955, "deviation-heading": 1.190228248014191, "set_robot_commands": 0.08123385681296294, "deviation-center-line": 0.07628285458566914, "driven_lanedir_consec": 0.20461726943018063, "sim_compute_sim_state": 0.045265148270804925, "sim_compute_performance-ego": 0.07074105514670317, "sim_compute_robot_state-ego": 0.06940708970123867}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.26098288947564435, "sim_physics": 0.012374484020730724, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06982026130673225, "sim_render-ego": 0.056881832039874534, "in-drivable-lane": 0.55, "agent_compute-ego": 0.22193883812945825, "deviation-heading": 0.4746007116730604, "set_robot_commands": 0.07226943969726562, "deviation-center-line": 0.01794634473968737, "driven_lanedir_consec": 0.06982026130673225, "sim_compute_sim_state": 0.034786898156870964, "sim_compute_performance-ego": 0.05623950128969939, "sim_compute_robot_state-ego": 0.057033839433089546}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.47712200415230094, "sim_physics": 0.01311496587900015, "survival_time": 1.950000000000001, "driven_lanedir": 0.14968670310224663, "sim_render-ego": 0.06935092119070199, "in-drivable-lane": 0.9500000000000004, "agent_compute-ego": 0.1656332505054963, "deviation-heading": 0.7313033789567542, "set_robot_commands": 0.07605475645798904, "deviation-center-line": 0.020152535572644657, "driven_lanedir_consec": 0.14968670310224663, "sim_compute_sim_state": 0.04317645537547576, "sim_compute_performance-ego": 0.06715957323710124, "sim_compute_robot_state-ego": 0.06715682225349622}}
set_robot_commands_max0.08123385681296294
set_robot_commands_mean0.07695816310500544
set_robot_commands_median0.07605475645798904
set_robot_commands_min0.07226943969726562
sim_compute_performance-ego_max0.07074105514670317
sim_compute_performance-ego_mean0.06423108266629161
sim_compute_performance-ego_median0.06513190746307373
sim_compute_performance-ego_min0.05623950128969939
sim_compute_robot_state-ego_max0.06940708970123867
sim_compute_robot_state-ego_mean0.06455145208461632
sim_compute_robot_state-ego_median0.065569908618927
sim_compute_robot_state-ego_min0.057033839433089546
sim_compute_sim_state_max0.045265148270804925
sim_compute_sim_state_mean0.04100834609673779
sim_compute_sim_state_median0.04100112731640155
sim_compute_sim_state_min0.034786898156870964
sim_physics_max0.014865946769714356
sim_physics_mean0.013471571859474202
sim_physics_median0.01311496587900015
sim_physics_min0.012374484020730724
sim_render-ego_max0.07314363065755593
sim_render-ego_mean0.065996256343467
sim_render-ego_median0.06578281292548546
sim_render-ego_min0.056881832039874534
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean2.409999999999998
survival_time_min1.1500000000000004
No reset possible
176672492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-58910:13:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4936880558251384
survival_time_median7.699999999999981
deviation-center-line_median0.11502607549440146
in-drivable-lane_median4.049999999999989


other stats
agent_compute-ego_max0.1881269558270772
agent_compute-ego_mean0.1740165160331891
agent_compute-ego_median0.17375655607743698
agent_compute-ego_min0.1626726853383052
deviation-center-line_max0.6970899163529084
deviation-center-line_mean0.29079520155678207
deviation-center-line_min0.004856645825223418
deviation-heading_max5.8915783315136085
deviation-heading_mean3.3196816459022904
deviation-heading_median2.767014896844651
deviation-heading_min0.171862479956711
driven_any_max3.581645574919951
driven_any_mean1.9650083064945931
driven_any_median1.6931001203635068
driven_any_min0.1438974395701745
driven_lanedir_consec_max1.0784164102407028
driven_lanedir_consec_mean0.5744823086583998
driven_lanedir_consec_min0.03594352914334831
driven_lanedir_max1.0784164102407028
driven_lanedir_mean0.5744823086583998
driven_lanedir_median0.4936880558251384
driven_lanedir_min0.03594352914334831
in-drivable-lane_max7.950000000000044
in-drivable-lane_mean4.440000000000014
in-drivable-lane_min0.24999999999999992
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.087371150823246, "sim_physics": 0.014016187552249792, "survival_time": 4.94999999999999, "driven_lanedir": 0.3597035275465226, "sim_render-ego": 0.05835613819083782, "in-drivable-lane": 2.399999999999995, "agent_compute-ego": 0.17375655607743698, "deviation-heading": 1.9181868927878587, "set_robot_commands": 0.07460965532245058, "deviation-center-line": 0.08887816137563719, "driven_lanedir_consec": 0.3597035275465226, "sim_compute_sim_state": 0.03668900692101681, "sim_compute_performance-ego": 0.05982243653499719, "sim_compute_robot_state-ego": 0.06173296649046619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.581645574919951, "sim_physics": 0.011817941665649414, "survival_time": 14.950000000000076, "driven_lanedir": 1.0784164102407028, "sim_render-ego": 0.05742671489715576, "in-drivable-lane": 7.55000000000004, "agent_compute-ego": 0.1881269558270772, "deviation-heading": 5.8915783315136085, "set_robot_commands": 0.07632782141367594, "deviation-center-line": 0.5481252087357399, "driven_lanedir_consec": 1.0784164102407028, "sim_compute_sim_state": 0.03746393839518229, "sim_compute_performance-ego": 0.05858848015467326, "sim_compute_robot_state-ego": 0.061663049856821694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.3190272467960864, "sim_physics": 0.012102747758229572, "survival_time": 14.950000000000076, "driven_lanedir": 0.9046600205362872, "sim_render-ego": 0.05960306167602539, "in-drivable-lane": 7.950000000000044, "agent_compute-ego": 0.1641857361793518, "deviation-heading": 5.849765628408624, "set_robot_commands": 0.0764054012298584, "deviation-center-line": 0.6970899163529084, "driven_lanedir_consec": 0.9046600205362872, "sim_compute_sim_state": 0.03835823218027751, "sim_compute_performance-ego": 0.06118638594945272, "sim_compute_robot_state-ego": 0.06323851664861044}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1438974395701745, "sim_physics": 0.013250160217285156, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03594352914334831, "sim_render-ego": 0.05961265563964844, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.18134064674377445, "deviation-heading": 0.171862479956711, "set_robot_commands": 0.08046567440032959, "deviation-center-line": 0.004856645825223418, "driven_lanedir_consec": 0.03594352914334831, "sim_compute_sim_state": 0.03705105781555176, "sim_compute_performance-ego": 0.054616332054138184, "sim_compute_robot_state-ego": 0.0644139289855957}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6931001203635068, "sim_physics": 0.013286878536273907, "survival_time": 7.699999999999981, "driven_lanedir": 0.4936880558251384, "sim_render-ego": 0.06055647212189513, "in-drivable-lane": 4.049999999999989, "agent_compute-ego": 0.1626726853383052, "deviation-heading": 2.767014896844651, "set_robot_commands": 0.07803026112643155, "deviation-center-line": 0.11502607549440146, "driven_lanedir_consec": 0.4936880558251384, "sim_compute_sim_state": 0.03872479711260114, "sim_compute_performance-ego": 0.06261194371557854, "sim_compute_robot_state-ego": 0.06450720731314126}}
set_robot_commands_max0.08046567440032959
set_robot_commands_mean0.07716776269854922
set_robot_commands_median0.0764054012298584
set_robot_commands_min0.07460965532245058
sim_compute_performance-ego_max0.06261194371557854
sim_compute_performance-ego_mean0.05936511568176798
sim_compute_performance-ego_median0.05982243653499719
sim_compute_performance-ego_min0.054616332054138184
sim_compute_robot_state-ego_max0.06450720731314126
sim_compute_robot_state-ego_mean0.06311113385892705
sim_compute_robot_state-ego_median0.06323851664861044
sim_compute_robot_state-ego_min0.061663049856821694
sim_compute_sim_state_max0.03872479711260114
sim_compute_sim_state_mean0.0376574064849259
sim_compute_sim_state_median0.03746393839518229
sim_compute_sim_state_min0.03668900692101681
sim_physics_max0.014016187552249792
sim_physics_mean0.01289478314593757
sim_physics_median0.013250160217285156
sim_physics_min0.011817941665649414
sim_render-ego_max0.06055647212189513
sim_render-ego_mean0.05911100850511251
sim_render-ego_median0.05960306167602539
sim_render-ego_min0.05742671489715576
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.610000000000026
survival_time_min0.49999999999999994
No reset possible
176522475Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-58910:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6896127428821732
survival_time_median1.1500000000000004
deviation-center-line_median0.05610305022565209
in-drivable-lane_median0.20000000000000007


other stats
agent_compute-ego_max0.15180241210120066
agent_compute-ego_mean0.1507639441184129
agent_compute-ego_median0.15118791659673056
agent_compute-ego_min0.14872649441594665
deviation-center-line_max0.07504669169058735
deviation-center-line_mean0.05629372528587068
deviation-center-line_min0.031337769455374115
deviation-heading_max0.4695314592890065
deviation-heading_mean0.28295632700130013
deviation-heading_median0.28969351082790473
deviation-heading_min0.13822734158708538
driven_any_max1.1972535692377095
driven_any_mean1.069550703128448
driven_any_median1.0381750331691957
driven_any_min1.0257183998178268
driven_lanedir_consec_max0.8123144800841251
driven_lanedir_consec_mean0.6312226729648216
driven_lanedir_consec_min0.4373052105850964
driven_lanedir_max0.9325407987545682
driven_lanedir_mean0.7224147694584564
driven_lanedir_median0.8123144800841251
driven_lanedir_min0.48318684247252186
in-drivable-lane_max0.6000000000000004
in-drivable-lane_mean0.3000000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.02780418736594064, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.06415488038744245, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.15180241210120066, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07664797987256732, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.03640226806913104, "sim_compute_performance-ego": 0.06068827424730573, "sim_compute_robot_state-ego": 0.06034042154039655, "sim_compute_robot_state-npc0": 0.07339927128383092, "sim_compute_robot_state-npc1": 0.06533317906515938, "sim_compute_robot_state-npc2": 0.06884430987494332, "sim_compute_robot_state-npc3": 0.0678303667477199}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.028455843528111775, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.0647647778193156, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.15118791659673056, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.0807496706644694, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03605881333351135, "sim_compute_performance-ego": 0.06278998653093974, "sim_compute_robot_state-ego": 0.06536962588628133, "sim_compute_robot_state-npc0": 0.06776157021522522, "sim_compute_robot_state-npc1": 0.06591689586639404, "sim_compute_robot_state-npc2": 0.06458953022956848, "sim_compute_robot_state-npc3": 0.0675556759039561}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.028238659319670303, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.0631631146306577, "in-drivable-lane": 0, "agent_compute-ego": 0.14872649441594665, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.08402895927429199, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.03588438034057617, "sim_compute_performance-ego": 0.06209353778673255, "sim_compute_robot_state-ego": 0.06475842517355214, "sim_compute_robot_state-npc0": 0.07031839826832646, "sim_compute_robot_state-npc1": 0.0672329094098962, "sim_compute_robot_state-npc2": 0.06329281433768895, "sim_compute_robot_state-npc3": 0.06429878525111986}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.02809801309005074, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.06827522360760233, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.1505572277566661, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.07944717614547066, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.0372077693109927, "sim_compute_performance-ego": 0.06702121444370436, "sim_compute_robot_state-ego": 0.0645150723664657, "sim_compute_robot_state-npc0": 0.06947975573332413, "sim_compute_robot_state-npc1": 0.06586038548013438, "sim_compute_robot_state-npc2": 0.0657444311224896, "sim_compute_robot_state-npc3": 0.06577903291453487}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.027940242186836575, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.07132019167361052, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15154566972152048, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.08036720234414806, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.03998568783635679, "sim_compute_performance-ego": 0.06780495850936226, "sim_compute_robot_state-ego": 0.06904504610144574, "sim_compute_robot_state-npc0": 0.07529850628065027, "sim_compute_robot_state-npc1": 0.06696251164311948, "sim_compute_robot_state-npc2": 0.06602193998253864, "sim_compute_robot_state-npc3": 0.06716748942499576}}
set_robot_commands_max0.08402895927429199
set_robot_commands_mean0.0802481976601895
set_robot_commands_median0.08036720234414806
set_robot_commands_min0.07664797987256732
sim_compute_performance-ego_max0.06780495850936226
sim_compute_performance-ego_mean0.06407959430360892
sim_compute_performance-ego_median0.06278998653093974
sim_compute_performance-ego_min0.06068827424730573
sim_compute_robot_state-ego_max0.06904504610144574
sim_compute_robot_state-ego_mean0.0648057182136283
sim_compute_robot_state-ego_median0.06475842517355214
sim_compute_robot_state-ego_min0.06034042154039655
sim_compute_robot_state-npc0_max0.07529850628065027
sim_compute_robot_state-npc0_mean0.0712515003562714
sim_compute_robot_state-npc0_median0.07031839826832646
sim_compute_robot_state-npc0_min0.06776157021522522
sim_compute_robot_state-npc1_max0.0672329094098962
sim_compute_robot_state-npc1_mean0.0662611762929407
sim_compute_robot_state-npc1_median0.06591689586639404
sim_compute_robot_state-npc1_min0.06533317906515938
sim_compute_robot_state-npc2_max0.06884430987494332
sim_compute_robot_state-npc2_mean0.06569860510944579
sim_compute_robot_state-npc2_median0.0657444311224896
sim_compute_robot_state-npc2_min0.06329281433768895
sim_compute_robot_state-npc3_max0.0678303667477199
sim_compute_robot_state-npc3_mean0.0665262700484653
sim_compute_robot_state-npc3_median0.06716748942499576
sim_compute_robot_state-npc3_min0.06429878525111986
sim_compute_sim_state_max0.03998568783635679
sim_compute_sim_state_mean0.03710778377811361
sim_compute_sim_state_median0.03640226806913104
sim_compute_sim_state_min0.03588438034057617
sim_physics_max0.028455843528111775
sim_physics_mean0.028107389098122004
sim_physics_median0.02809801309005074
sim_physics_min0.02780418736594064
sim_render-ego_max0.07132019167361052
sim_render-ego_mean0.06633563762372573
sim_render-ego_median0.0647647778193156
sim_render-ego_min0.0631631146306577
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2100000000000004
survival_time_min1.1500000000000004
No reset possible
176412488Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-58910:01:36
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176272446Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errornoidsc-rudolf-58910:21:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 471, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 980, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1131, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1177, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-idsc-rudolf-5891-job17627/tmp/tmprrni27cs/attempts/ETHZ_autolab_technical_track-4-0.attempt4/log.gs2.cbor.tmp']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible