Duckietown Challenges Home Challenges Submissions

Evaluator 651

ID651
evaluatoridsc-rudolf-6108
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-6108
versiond-c:4.0.14;d-c-r:4.0.19;d-s:4.0.15
first heard
last heard
statusinactive
# evaluating
# success2 17654
# timeout1 17683
# failed
# error2 17629
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
176832492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationtimeoutnoidsc-rudolf-61080:25:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176712492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-61080:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13535995607379014
survival_time_median1.4500000000000006
deviation-center-line_median0.05266677666821573
in-drivable-lane_median0.6000000000000003


other stats
agent_compute-ego_max0.19681171496709188
agent_compute-ego_mean0.17848048283737403
agent_compute-ego_median0.18344326496124264
agent_compute-ego_min0.16213958913629706
deviation-center-line_max0.5542159869352689
deviation-center-line_mean0.1982225324833248
deviation-center-line_min0.00831519445406567
deviation-heading_max5.653412723877743
deviation-heading_mean2.5275070397883104
deviation-heading_median0.7064337476442553
deviation-heading_min0.21010120574604055
driven_any_max3.431708024063918
driven_any_mean1.5387104712952566
driven_any_median0.3824361849717727
driven_any_min0.16821398125513337
driven_lanedir_consec_max1.029119544334537
driven_lanedir_consec_mean0.4592779212690713
driven_lanedir_consec_min0.053313231180677656
driven_lanedir_max1.029119544334537
driven_lanedir_mean0.4592779212690713
driven_lanedir_median0.13535995607379014
driven_lanedir_min0.053313231180677656
in-drivable-lane_max7.75000000000004
in-drivable-lane_mean3.360000000000016
in-drivable-lane_min0.24999999999999992
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3276773786331187, "sim_physics": 0.01266890525817871, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1348769377068968, "sim_render-ego": 0.06155080795288086, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.18524693489074703, "deviation-heading": 0.5991510083327124, "set_robot_commands": 0.07668601036071777, "deviation-center-line": 0.05266677666821573, "driven_lanedir_consec": 0.1348769377068968, "sim_compute_sim_state": 0.03819360733032227, "sim_compute_performance-ego": 0.0662339210510254, "sim_compute_robot_state-ego": 0.06167724609375}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16821398125513337, "sim_physics": 0.013006708838722923, "survival_time": 0.5499999999999999, "driven_lanedir": 0.053313231180677656, "sim_render-ego": 0.06875651532953436, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.16213958913629706, "deviation-heading": 0.21010120574604055, "set_robot_commands": 0.08103067224675958, "deviation-center-line": 0.00831519445406567, "driven_lanedir_consec": 0.053313231180677656, "sim_compute_sim_state": 0.04514213041825728, "sim_compute_performance-ego": 0.06834441965276544, "sim_compute_robot_state-ego": 0.07002024217085405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3824361849717727, "sim_physics": 0.01240625052616514, "survival_time": 1.4500000000000006, "driven_lanedir": 0.13535995607379014, "sim_render-ego": 0.06182213487296269, "in-drivable-lane": 0.6000000000000003, "agent_compute-ego": 0.1647609102314916, "deviation-heading": 0.7064337476442553, "set_robot_commands": 0.07938420361485975, "deviation-center-line": 0.04520881085954776, "driven_lanedir_consec": 0.13535995607379014, "sim_compute_sim_state": 0.04034485488102354, "sim_compute_performance-ego": 0.06658550788616312, "sim_compute_robot_state-ego": 0.06483567994216392}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.3835167875523413, "sim_physics": 0.013770822683970134, "survival_time": 14.950000000000076, "driven_lanedir": 0.9437199370494552, "sim_render-ego": 0.0728096612294515, "in-drivable-lane": 7.75000000000004, "agent_compute-ego": 0.19681171496709188, "deviation-heading": 5.653412723877743, "set_robot_commands": 0.08217486063639323, "deviation-center-line": 0.3307058934995259, "driven_lanedir_consec": 0.9437199370494552, "sim_compute_sim_state": 0.04385079622268677, "sim_compute_performance-ego": 0.07071189006169637, "sim_compute_robot_state-ego": 0.06942742586135864}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.431708024063918, "sim_physics": 0.013729222615559896, "survival_time": 14.950000000000076, "driven_lanedir": 1.029119544334537, "sim_render-ego": 0.07302351872126261, "in-drivable-lane": 7.750000000000038, "agent_compute-ego": 0.18344326496124264, "deviation-heading": 5.4684365133408, "set_robot_commands": 0.07862322171529135, "deviation-center-line": 0.5542159869352689, "driven_lanedir_consec": 1.029119544334537, "sim_compute_sim_state": 0.04520213762919108, "sim_compute_performance-ego": 0.073098836739858, "sim_compute_robot_state-ego": 0.06971930185953776}}
set_robot_commands_max0.08217486063639323
set_robot_commands_mean0.07957979371480434
set_robot_commands_median0.07938420361485975
set_robot_commands_min0.07668601036071777
sim_compute_performance-ego_max0.073098836739858
sim_compute_performance-ego_mean0.06899491507830166
sim_compute_performance-ego_median0.06834441965276544
sim_compute_performance-ego_min0.0662339210510254
sim_compute_robot_state-ego_max0.07002024217085405
sim_compute_robot_state-ego_mean0.06713597918553287
sim_compute_robot_state-ego_median0.06942742586135864
sim_compute_robot_state-ego_min0.06167724609375
sim_compute_sim_state_max0.04520213762919108
sim_compute_sim_state_mean0.042546705296296186
sim_compute_sim_state_median0.04385079622268677
sim_compute_sim_state_min0.03819360733032227
sim_physics_max0.013770822683970134
sim_physics_mean0.01311638198451936
sim_physics_median0.013006708838722923
sim_physics_min0.01240625052616514
sim_render-ego_max0.07302351872126261
sim_render-ego_mean0.0675925276212184
sim_render-ego_median0.06875651532953436
sim_render-ego_min0.06155080795288086
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.630000000000031
survival_time_min0.5499999999999999
No reset possible
176542492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-61080:07:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05732221069836685
survival_time_median0.45
deviation-center-line_median0.007267084958873945
in-drivable-lane_median0.19999999999999996


other stats
agent_compute-ego_max0.225758052666982
agent_compute-ego_mean0.19010972854060185
agent_compute-ego_median0.19021812117243383
agent_compute-ego_min0.15459738837348092
deviation-center-line_max0.49564490935617633
deviation-center-line_mean0.11760737543831434
deviation-center-line_min0.006100978632826479
deviation-heading_max4.346403297365892
deviation-heading_mean1.3224160281282769
deviation-heading_median0.21752885904382255
deviation-heading_min0.16585794792455782
driven_any_max4.715308168903362
driven_any_mean1.2956573731403176
driven_any_median0.17992547417505222
driven_any_min0.12844569609395232
driven_lanedir_consec_max0.47177763083113655
driven_lanedir_consec_mean0.2020806188977647
driven_lanedir_consec_min0.02492571137509403
driven_lanedir_max1.0519958490322114
driven_lanedir_mean0.3181242625379797
driven_lanedir_median0.05732221069836685
driven_lanedir_min0.02492571137509403
in-drivable-lane_max9.60000000000004
in-drivable-lane_mean2.4400000000000066
in-drivable-lane_min0.19999999999999996
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.12844569609395232, "sim_physics": 0.012887530856662326, "survival_time": 0.45, "driven_lanedir": 0.02492571137509403, "sim_render-ego": 0.06120692359076606, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.18265056610107425, "deviation-heading": 0.21752885904382255, "set_robot_commands": 0.07467132144504124, "deviation-center-line": 0.007267084958873945, "driven_lanedir_consec": 0.02492571137509403, "sim_compute_sim_state": 0.041904608408610024, "sim_compute_performance-ego": 0.06008299191792806, "sim_compute_robot_state-ego": 0.06156343883938259}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.715308168903362, "sim_physics": 0.01217180887858073, "survival_time": 14.950000000000076, "driven_lanedir": 1.0519958490322114, "sim_render-ego": 0.05533058484395345, "in-drivable-lane": 9.60000000000004, "agent_compute-ego": 0.225758052666982, "deviation-heading": 4.346403297365892, "set_robot_commands": 0.07290706316630045, "deviation-center-line": 0.49564490935617633, "driven_lanedir_consec": 0.47177763083113655, "sim_compute_sim_state": 0.03432756265004476, "sim_compute_performance-ego": 0.05668075561523438, "sim_compute_robot_state-ego": 0.05840797185897827}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17992547417505222, "sim_physics": 0.01216525501675076, "survival_time": 0.45, "driven_lanedir": 0.05732221069836685, "sim_render-ego": 0.06661976708306207, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.15459738837348092, "deviation-heading": 0.16585794792455782, "set_robot_commands": 0.07914561695522732, "deviation-center-line": 0.006783896925508835, "driven_lanedir_consec": 0.05732221069836685, "sim_compute_sim_state": 0.038743151558770075, "sim_compute_performance-ego": 0.06185094515482584, "sim_compute_robot_state-ego": 0.0661168893178304}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3005298112741634, "sim_physics": 0.01302931394921728, "survival_time": 4.149999999999993, "driven_lanedir": 0.40100433509283473, "sim_render-ego": 0.0563169014023011, "in-drivable-lane": 1.9999999999999964, "agent_compute-ego": 0.19021812117243383, "deviation-heading": 1.715054729411556, "set_robot_commands": 0.0750222924243973, "deviation-center-line": 0.07224000731818618, "driven_lanedir_consec": 0.40100433509283473, "sim_compute_sim_state": 0.03673999855317265, "sim_compute_performance-ego": 0.05872338363923222, "sim_compute_robot_state-ego": 0.0616436378065362}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15407771525505826, "sim_physics": 0.013218667772081165, "survival_time": 0.45, "driven_lanedir": 0.05537320649139144, "sim_render-ego": 0.05465835995144314, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.19732451438903809, "deviation-heading": 0.16723530689555716, "set_robot_commands": 0.07506624857584636, "deviation-center-line": 0.006100978632826479, "driven_lanedir_consec": 0.05537320649139144, "sim_compute_sim_state": 0.03741947809855143, "sim_compute_performance-ego": 0.06162903043958875, "sim_compute_robot_state-ego": 0.06528923246595594}}
set_robot_commands_max0.07914561695522732
set_robot_commands_mean0.07536250851336254
set_robot_commands_median0.0750222924243973
set_robot_commands_min0.07290706316630045
sim_compute_performance-ego_max0.06185094515482584
sim_compute_performance-ego_mean0.05979342135336185
sim_compute_performance-ego_median0.06008299191792806
sim_compute_performance-ego_min0.05668075561523438
sim_compute_robot_state-ego_max0.0661168893178304
sim_compute_robot_state-ego_mean0.06260423405773667
sim_compute_robot_state-ego_median0.0616436378065362
sim_compute_robot_state-ego_min0.05840797185897827
sim_compute_sim_state_max0.041904608408610024
sim_compute_sim_state_mean0.03782695985382979
sim_compute_sim_state_median0.03741947809855143
sim_compute_sim_state_min0.03432756265004476
sim_physics_max0.013218667772081165
sim_physics_mean0.01269451529465845
sim_physics_median0.012887530856662326
sim_physics_min0.01216525501675076
sim_render-ego_max0.06661976708306207
sim_render-ego_mean0.05882650737430515
sim_render-ego_median0.0563169014023011
sim_render-ego_min0.05465835995144314
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.090000000000014
survival_time_min0.45
No reset possible
176372496Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-61080:22:41
Waited 1205 seconds [...]
Waited 1205 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176292451Nicky EichmannBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-61080:21:32
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible