Duckietown Challenges Home Challenges Submissions

Evaluator 1570

ID1570
evaluatoridsc-rudolf-17986
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-17986
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success23 24266
# timeout
# failed
# error1 24261
# aborted1 24287
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
243114131Wencan Huang 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10458265732151584
error_L20.01727201513037226


No reset possible
243094126Andrea Censi 🇨🇭rotationaido3-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-179860:18:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.0005547867508171045
survival_time_median14.950000000000076
deviation-center-line_median0.44901648578509457
in-drivable-lane_median7.600000000000044


other stats
agent_compute-ego_max0.16234874884287517
agent_compute-ego_mean0.16141488790512085
agent_compute-ego_median0.161557768980662
agent_compute-ego_min0.1600712498029073
deviation-center-line_max0.5610133203215761
deviation-center-line_mean0.3827485453764907
deviation-center-line_min0.13860669343031343
deviation-heading_max5.876680788839771
deviation-heading_mean5.630778146323924
deviation-heading_median5.657649106857695
deviation-heading_min5.445457843647878
driven_any_max0.026478672834056367
driven_any_mean0.02486423959225153
driven_any_median0.02593019554121306
driven_any_min0.022165452661374756
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.00046586963337973407
driven_lanedir_consec_min-0.003361806018059577
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.00046586963337973407
driven_lanedir_median-0.0005547867508171045
driven_lanedir_min-0.003361806018059577
in-drivable-lane_max7.700000000000042
in-drivable-lane_mean7.620000000000043
in-drivable-lane_min7.550000000000042
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834056367, "sim_physics": 0.06019291718800863, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.0697616950670878, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.16234874884287517, "deviation-heading": 5.657649106857695, "set_robot_commands": 0.07976543029149373, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.04398110946019491, "sim_compute_performance-ego": 0.07185821692148844, "sim_compute_robot_state-ego": 0.06348634322484334}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02593019554121306, "sim_physics": 0.05947999556859334, "survival_time": 14.950000000000076, "driven_lanedir": -0.003361806018059577, "sim_render-ego": 0.06893130540847778, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.1600712498029073, "deviation-heading": 5.445457843647878, "set_robot_commands": 0.07918537060419718, "deviation-center-line": 0.13860669343031343, "driven_lanedir_consec": -0.003361806018059577, "sim_compute_sim_state": 0.044005312124888105, "sim_compute_performance-ego": 0.07162327607472738, "sim_compute_robot_state-ego": 0.0651182198524475}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672438047, "sim_physics": 0.05767321268717448, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021181059556472093, "sim_render-ego": 0.06755985021591186, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.16121086915334065, "deviation-heading": 5.876680788839771, "set_robot_commands": 0.08038809537887573, "deviation-center-line": 0.4784517475259532, "driven_lanedir_consec": 0.0021181059556472093, "sim_compute_sim_state": 0.04296723524729411, "sim_compute_performance-ego": 0.06922548055648804, "sim_compute_robot_state-ego": 0.06242547035217285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661374756, "sim_physics": 0.060531657536824546, "survival_time": 14.950000000000076, "driven_lanedir": -0.002690854798440334, "sim_render-ego": 0.07031966606775919, "in-drivable-lane": 7.700000000000042, "agent_compute-ego": 0.161557768980662, "deviation-heading": 5.721005148732661, "set_robot_commands": 0.0796274216969808, "deviation-center-line": 0.44901648578509457, "driven_lanedir_consec": -0.002690854798440334, "sim_compute_sim_state": 0.0443781050046285, "sim_compute_performance-ego": 0.07115744829177856, "sim_compute_robot_state-ego": 0.06501769701639812}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025942472252175396, "sim_physics": 0.05872844298680623, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005547867508171045, "sim_render-ego": 0.06947889645894369, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.1618858027458191, "deviation-heading": 5.453097843541612, "set_robot_commands": 0.07992214282353718, "deviation-center-line": 0.28665447981951625, "driven_lanedir_consec": -0.0005547867508171045, "sim_compute_sim_state": 0.044093926747639976, "sim_compute_performance-ego": 0.06995826562245687, "sim_compute_robot_state-ego": 0.06297678152720133}}
set_robot_commands_max0.08038809537887573
set_robot_commands_mean0.07977769215901694
set_robot_commands_median0.07976543029149373
set_robot_commands_min0.07918537060419718
sim_compute_performance-ego_max0.07185821692148844
sim_compute_performance-ego_mean0.07076453749338786
sim_compute_performance-ego_median0.07115744829177856
sim_compute_performance-ego_min0.06922548055648804
sim_compute_robot_state-ego_max0.0651182198524475
sim_compute_robot_state-ego_mean0.06380490239461263
sim_compute_robot_state-ego_median0.06348634322484334
sim_compute_robot_state-ego_min0.06242547035217285
sim_compute_sim_state_max0.0443781050046285
sim_compute_sim_state_mean0.043885137716929125
sim_compute_sim_state_median0.044005312124888105
sim_compute_sim_state_min0.04296723524729411
sim_physics_max0.060531657536824546
sim_physics_mean0.05932124519348144
sim_physics_median0.05947999556859334
sim_physics_min0.05767321268717448
sim_render-ego_max0.07031966606775919
sim_render-ego_mean0.06921028264363607
sim_render-ego_median0.06947889645894369
sim_render-ego_min0.06755985021591186
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
243084055Zoltán L?rinczPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11130525667672234
error_L20.01957479145634654


No reset possible
243064057Zoltán L?rinczPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10867024694927868
error_L20.019606800549882328


No reset possible
243044059Zoltán L?rinczPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10595851478138256
error_L20.018365879516401656


No reset possible
243024064Basile Dura 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11582761695421022
error_L20.021186576724753495


No reset possible
243004066Rekha SundararajanPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10615109723631816
error_L20.017562198077865427


No reset possible
242974071Sergio Duvan Mendoza Rojas 🇨🇴PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10230424931155611
error_L20.0172746830449671


No reset possible
242964073Linus Lingg 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11928131258779164
error_L20.021812080787707487


No reset possible
242944078Maximilian Stölzle 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12798017570522266
error_L20.026920030375138067


No reset possible
242924080Johannes Lienhart 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11036358176663331
error_L20.01938578339731113


No reset possible
242894082Elias Wicki 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1152983831939133
error_L20.020511830479912552


No reset possible
242874083Alexander Hatteland 🇨🇭PredictorLastaido2-PREDstep1-simulationabortednoidsc-rudolf-179860:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10731454909144823
error_L20.017825765325070443


No reset possible
242864085Marc-Philippe FreyPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11981826833788844
error_L20.022229488820683967


No reset possible
242844087Carmen ScheidemannPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12017698442345372
error_L20.021304559096957262


No reset possible
242824096Johannes BoghaertPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12412824307703337
error_L20.023485003265269


No reset possible
242804098Shengjie Hu 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1293731188213082
error_L20.025910178234811957


No reset possible
242784100Paula WulkopPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10260966263013396
error_L20.01691796984795528


No reset possible
242764105Etienne WaltherPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10141912605170068
error_L20.016368908107528477


No reset possible
242744108Nikolaj Witting 🇩🇰PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1156113968179332
error_L20.0200317575293712


No reset possible
242724111Wencan Huang 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12325963610631258
error_L20.023373275391506906


No reset possible
242704113Frank (Chude) Qian 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1193337285519781
error_L20.021052139937538357


No reset possible
242684115Simone Arreghini 🇮🇹PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11077172240203864
error_L20.01959377886877063


No reset possible
242664117Xiao'ao Song 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-179860:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11915977161597922
error_L20.02307187343748855


No reset possible
242614129Andrea Censi 🇨🇭rotationaido3-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-179861:02:19
Waited 3604 seconds [...]
Waited 3604 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible