Duckietown Challenges Home Challenges Submissions

Evaluator 513

ID513
evaluatoridsc-rudolf-15120
ownerAndrea CensiΒ πŸ‡¨πŸ‡­
machineidsc-rudolf
processidsc-rudolf-15120
versionDC:4.0.6;DCR:4.0.5;DTS:4.0.8
first heard
last heard
statusinactive
# evaluating
# success6 16994
# timeout
# failed
# error9 16978
# aborted
# host-error1 16991
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
171062249Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-151200:30:38
Timeout: Waited 180 [...]
Timeout:

Waited 1801.0097942352295 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170802280FANG MEIYIΒ πŸ‡ΈπŸ‡¬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-151200:30:39
Timeout: Waited 180 [...]
Timeout:

Waited 1800.3850038051605 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170772282Andrea CensiΒ πŸ‡¨πŸ‡­PredictorRandomaido2-PREDstep1-simulationsuccessnoidsc-rudolf-151200:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.319830531459148
error_L20.15623474529406167


No reset possible
170732287Andrea CensiΒ πŸ‡¨πŸ‡­Minimal agentaido2_LFV_r1-v4step1-simulationsuccessnoidsc-rudolf-151200:12:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1620815110206604
agent_compute-ego_mean0.1587250803948849
agent_compute-ego_median0.1600904842702354
agent_compute-ego_min0.15174984553503612
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003407569492564482, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07040084810817943, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15913215104271383, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.08177622276193955, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04049215246649349, "sim_compute_performance-ego": 0.069640973035027, "sim_compute_robot_state-ego": 0.25934822419110465, "sim_compute_robot_state-npc0": 0.07684450640397913, "sim_compute_robot_state-npc1": 0.0717471206889433, "sim_compute_robot_state-npc2": 0.07182460672715131, "sim_compute_robot_state-npc3": 0.07106082229053273}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.002968530806284102, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.06481675496177068, "in-drivable-lane": 0, "agent_compute-ego": 0.15174984553503612, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07617513717166961, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.03519553986806718, "sim_compute_performance-ego": 0.06299113091968354, "sim_compute_robot_state-ego": 0.08645885709732298, "sim_compute_robot_state-npc0": 0.07743151604183136, "sim_compute_robot_state-npc1": 0.06604694563245016, "sim_compute_robot_state-npc2": 0.06282677726140098, "sim_compute_robot_state-npc3": 0.06297457028949072}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0032703986534705527, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.06819946215702938, "in-drivable-lane": 0, "agent_compute-ego": 0.16057141010577863, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07982950944166917, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.035562592286330005, "sim_compute_performance-ego": 0.06678248185377855, "sim_compute_robot_state-ego": 0.08514933586120606, "sim_compute_robot_state-npc0": 0.07721559817974384, "sim_compute_robot_state-npc1": 0.07090179736797626, "sim_compute_robot_state-npc2": 0.06680700962360088, "sim_compute_robot_state-npc3": 0.06552194081819974}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0035001010429568406, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07224551642813333, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1600904842702354, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08048454435860239, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.039434252715692286, "sim_compute_performance-ego": 0.07192346526355278, "sim_compute_robot_state-ego": 0.08833539776685762, "sim_compute_robot_state-npc0": 0.07781935901176638, "sim_compute_robot_state-npc1": 0.07369197577964968, "sim_compute_robot_state-npc2": 0.07084269349167986, "sim_compute_robot_state-npc3": 0.07138133339765595}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0036106610298156736, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.07517846822738647, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1620815110206604, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07927397966384887, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.041684696674346926, "sim_compute_performance-ego": 0.07193953037261963, "sim_compute_robot_state-ego": 0.08816115617752075, "sim_compute_robot_state-npc0": 0.07763625144958496, "sim_compute_robot_state-npc1": 0.07394863128662109, "sim_compute_robot_state-npc2": 0.07285788536071777, "sim_compute_robot_state-npc3": 0.0734255075454712}}
set_robot_commands_max0.08177622276193955
set_robot_commands_mean0.07950787867954592
set_robot_commands_median0.07982950944166917
set_robot_commands_min0.07617513717166961
sim_compute_performance-ego_max0.07193953037261963
sim_compute_performance-ego_mean0.06865551628893231
sim_compute_performance-ego_median0.069640973035027
sim_compute_performance-ego_min0.06299113091968354
sim_compute_robot_state-ego_max0.25934822419110465
sim_compute_robot_state-ego_mean0.1214905942188024
sim_compute_robot_state-ego_median0.08816115617752075
sim_compute_robot_state-ego_min0.08514933586120606
sim_compute_robot_state-npc0_max0.07781935901176638
sim_compute_robot_state-npc0_mean0.07738944621738114
sim_compute_robot_state-npc0_median0.07743151604183136
sim_compute_robot_state-npc0_min0.07684450640397913
sim_compute_robot_state-npc1_max0.07394863128662109
sim_compute_robot_state-npc1_mean0.0712672941511281
sim_compute_robot_state-npc1_median0.0717471206889433
sim_compute_robot_state-npc1_min0.06604694563245016
sim_compute_robot_state-npc2_max0.07285788536071777
sim_compute_robot_state-npc2_mean0.06903179449291016
sim_compute_robot_state-npc2_median0.07084269349167986
sim_compute_robot_state-npc2_min0.06282677726140098
sim_compute_robot_state-npc3_max0.0734255075454712
sim_compute_robot_state-npc3_mean0.06887283486827007
sim_compute_robot_state-npc3_median0.07106082229053273
sim_compute_robot_state-npc3_min0.06297457028949072
sim_compute_sim_state_max0.041684696674346926
sim_compute_sim_state_mean0.038473846802185976
sim_compute_sim_state_median0.039434252715692286
sim_compute_sim_state_min0.03519553986806718
sim_physics_max0.0036106610298156736
sim_physics_mean0.003351452205018331
sim_physics_median0.003407569492564482
sim_physics_min0.002968530806284102
sim_render-ego_max0.07517846822738647
sim_render-ego_mean0.07016820997649986
sim_render-ego_median0.07040084810817943
sim_render-ego_min0.06481675496177068
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
170712288Andrea CensiΒ πŸ‡¨πŸ‡­PredictorMeanaido2-PREDstep1-simulationsuccessnoidsc-rudolf-151200:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.2604885450235106
error_L20.08355500864784418


No reset possible
170452313FANG MEIYIΒ πŸ‡ΈπŸ‡¬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-151200:31:44
Timeout: Waited 180 [...]
Timeout:

Waited 1803.0378539562225 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170412252Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-151200:30:41
Timeout: Waited 180 [...]
Timeout:

Waited 1803.0147533416748 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170142278Peter AlmasiΒ πŸ‡­πŸ‡ΊPyTorch templateaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-151200:32:34
Timeout: Waited 180 [...]
Timeout:

Waited 1801.6029233932495 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170052287Andrea CensiΒ πŸ‡¨πŸ‡­Minimal agentaido2_LFV_r1-v4step1-simulationsuccessnoidsc-rudolf-151200:11:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.15335351701766725
agent_compute-ego_mean0.1484699982500184
agent_compute-ego_median0.15110604355974896
agent_compute-ego_min0.13497060262239896
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0031444430351257324, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06020098924636841, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15219197904362397, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07931805358213537, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.03590126949198106, "sim_compute_performance-ego": 0.06725248168496524, "sim_compute_robot_state-ego": 0.25733379756703095, "sim_compute_robot_state-npc0": 0.08006519429823931, "sim_compute_robot_state-npc1": 0.07210862285950605, "sim_compute_robot_state-npc2": 0.07079160564086016, "sim_compute_robot_state-npc3": 0.07077564912683823}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.003292386493985615, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.06460425210377527, "in-drivable-lane": 0, "agent_compute-ego": 0.15335351701766725, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.0786404496147519, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.03758962570674835, "sim_compute_performance-ego": 0.06715664787897987, "sim_compute_robot_state-ego": 0.09139972262912328, "sim_compute_robot_state-npc0": 0.07883183918302021, "sim_compute_robot_state-npc1": 0.07158644994099934, "sim_compute_robot_state-npc2": 0.07101899101620629, "sim_compute_robot_state-npc3": 0.07266536969987172}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0029698151808518628, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.05917253127464881, "in-drivable-lane": 0, "agent_compute-ego": 0.13497060262239896, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07324277804448054, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.03493247765761155, "sim_compute_performance-ego": 0.06086783775916466, "sim_compute_robot_state-ego": 0.08257626386789176, "sim_compute_robot_state-npc0": 0.07651081452002892, "sim_compute_robot_state-npc1": 0.07199266140277569, "sim_compute_robot_state-npc2": 0.06916719583364633, "sim_compute_robot_state-npc3": 0.06841439100412222}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0030223538235920233, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06020058945911687, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15110604355974896, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0771130061731106, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.03590530302466416, "sim_compute_performance-ego": 0.06442869872581668, "sim_compute_robot_state-ego": 0.08599210076215791, "sim_compute_robot_state-npc0": 0.07828332447424168, "sim_compute_robot_state-npc1": 0.07153706725050764, "sim_compute_robot_state-npc2": 0.0694828236975321, "sim_compute_robot_state-npc3": 0.06981577233570378}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0030185437202453614, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.05920783042907715, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15072784900665284, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07631650686264038, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.034486477375030515, "sim_compute_performance-ego": 0.059773786067962645, "sim_compute_robot_state-ego": 0.08097208976745605, "sim_compute_robot_state-npc0": 0.07517471075057984, "sim_compute_robot_state-npc1": 0.06971953153610229, "sim_compute_robot_state-npc2": 0.06994521141052246, "sim_compute_robot_state-npc3": 0.06928743124008178}}
set_robot_commands_max0.07931805358213537
set_robot_commands_mean0.07692615885542375
set_robot_commands_median0.0771130061731106
set_robot_commands_min0.07324277804448054
sim_compute_performance-ego_max0.06725248168496524
sim_compute_performance-ego_mean0.06389589042337782
sim_compute_performance-ego_median0.06442869872581668
sim_compute_performance-ego_min0.059773786067962645
sim_compute_robot_state-ego_max0.25733379756703095
sim_compute_robot_state-ego_mean0.119654794918732
sim_compute_robot_state-ego_median0.08599210076215791
sim_compute_robot_state-ego_min0.08097208976745605
sim_compute_robot_state-npc0_max0.08006519429823931
sim_compute_robot_state-npc0_mean0.077773176645222
sim_compute_robot_state-npc0_median0.07828332447424168
sim_compute_robot_state-npc0_min0.07517471075057984
sim_compute_robot_state-npc1_max0.07210862285950605
sim_compute_robot_state-npc1_mean0.07138886659797819
sim_compute_robot_state-npc1_median0.07158644994099934
sim_compute_robot_state-npc1_min0.06971953153610229
sim_compute_robot_state-npc2_max0.07101899101620629
sim_compute_robot_state-npc2_mean0.07008116551975348
sim_compute_robot_state-npc2_median0.06994521141052246
sim_compute_robot_state-npc2_min0.06916719583364633
sim_compute_robot_state-npc3_max0.07266536969987172
sim_compute_robot_state-npc3_mean0.07019172268132355
sim_compute_robot_state-npc3_median0.06981577233570378
sim_compute_robot_state-npc3_min0.06841439100412222
sim_compute_sim_state_max0.03758962570674835
sim_compute_sim_state_mean0.03576303065120713
sim_compute_sim_state_median0.03590126949198106
sim_compute_sim_state_min0.034486477375030515
sim_physics_max0.003292386493985615
sim_physics_mean0.003089508450760119
sim_physics_median0.0030223538235920233
sim_physics_min0.0029698151808518628
sim_render-ego_max0.06460425210377527
sim_render-ego_mean0.0606772385025973
sim_render-ego_median0.06020058945911687
sim_render-ego_min0.05917253127464881
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
170012289Andrea CensiΒ πŸ‡¨πŸ‡­PredictorRandomaido2-PREDstep1-simulationsuccessnoidsc-rudolf-151200:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.2993842300876608
error_L20.1332929678417077


No reset possible
169942294Andrea CensiΒ πŸ‡¨πŸ‡­Minimal agentaido2_LFV_r1-v4step1-simulationsuccessnoidsc-rudolf-151200:12:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1572268009185791
agent_compute-ego_mean0.15435963793127414
agent_compute-ego_median0.15662754163509462
agent_compute-ego_min0.14908285351360545
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0036632944555843577, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06727993838927325, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14908285351360545, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.08048318063511568, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04084396712920245, "sim_compute_performance-ego": 0.07097475668963264, "sim_compute_robot_state-ego": 0.2685324830167434, "sim_compute_robot_state-npc0": 0.08316836988224703, "sim_compute_robot_state-npc1": 0.07817758882746977, "sim_compute_robot_state-npc2": 0.079253729651956, "sim_compute_robot_state-npc3": 0.07929923604516421}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.003626361725822328, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.0719846733032711, "in-drivable-lane": 0, "agent_compute-ego": 0.1567785210079617, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.08036518853808207, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.04561486319890098, "sim_compute_performance-ego": 0.07591342547583202, "sim_compute_robot_state-ego": 0.10046946056305416, "sim_compute_robot_state-npc0": 0.08696195435902429, "sim_compute_robot_state-npc1": 0.08324448646061004, "sim_compute_robot_state-npc2": 0.0844029358455113, "sim_compute_robot_state-npc3": 0.0850147217039078}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.003476410645705003, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07123521291292631, "in-drivable-lane": 0, "agent_compute-ego": 0.1520824725811298, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07864329998309795, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.041241656816922705, "sim_compute_performance-ego": 0.07596584466787484, "sim_compute_robot_state-ego": 0.0952858778146597, "sim_compute_robot_state-npc0": 0.08429406973031851, "sim_compute_robot_state-npc1": 0.0807015272287222, "sim_compute_robot_state-npc2": 0.08016796478858361, "sim_compute_robot_state-npc3": 0.08000240325927735}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0035225211120233305, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.0734367079851104, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15662754163509462, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08278264068975681, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.0426098718875792, "sim_compute_performance-ego": 0.07404936813726658, "sim_compute_robot_state-ego": 0.09965292418875343, "sim_compute_robot_state-npc0": 0.08576028812222364, "sim_compute_robot_state-npc1": 0.0818208717718357, "sim_compute_robot_state-npc2": 0.08206940278774355, "sim_compute_robot_state-npc3": 0.08136262254017156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.003541114330291748, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.07376069784164428, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1572268009185791, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.08068646669387818, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.04333628654479981, "sim_compute_performance-ego": 0.07638792991638184, "sim_compute_robot_state-ego": 0.09618884563446044, "sim_compute_robot_state-npc0": 0.08578261137008666, "sim_compute_robot_state-npc1": 0.08463987112045288, "sim_compute_robot_state-npc2": 0.08310211181640625, "sim_compute_robot_state-npc3": 0.08062556505203247}}
set_robot_commands_max0.08278264068975681
set_robot_commands_mean0.08059215530798615
set_robot_commands_median0.08048318063511568
set_robot_commands_min0.07864329998309795
sim_compute_performance-ego_max0.07638792991638184
sim_compute_performance-ego_mean0.07465826497739758
sim_compute_performance-ego_median0.07591342547583202
sim_compute_performance-ego_min0.07097475668963264
sim_compute_robot_state-ego_max0.2685324830167434
sim_compute_robot_state-ego_mean0.13202591824353424
sim_compute_robot_state-ego_median0.09965292418875343
sim_compute_robot_state-ego_min0.0952858778146597
sim_compute_robot_state-npc0_max0.08696195435902429
sim_compute_robot_state-npc0_mean0.08519345869278003
sim_compute_robot_state-npc0_median0.08576028812222364
sim_compute_robot_state-npc0_min0.08316836988224703
sim_compute_robot_state-npc1_max0.08463987112045288
sim_compute_robot_state-npc1_mean0.08171686908181812
sim_compute_robot_state-npc1_median0.0818208717718357
sim_compute_robot_state-npc1_min0.07817758882746977
sim_compute_robot_state-npc2_max0.0844029358455113
sim_compute_robot_state-npc2_mean0.08179922897804014
sim_compute_robot_state-npc2_median0.08206940278774355
sim_compute_robot_state-npc2_min0.079253729651956
sim_compute_robot_state-npc3_max0.0850147217039078
sim_compute_robot_state-npc3_mean0.08126090972011069
sim_compute_robot_state-npc3_median0.08062556505203247
sim_compute_robot_state-npc3_min0.07929923604516421
sim_compute_sim_state_max0.04561486319890098
sim_compute_sim_state_mean0.04272932911548103
sim_compute_sim_state_median0.0426098718875792
sim_compute_sim_state_min0.04084396712920245
sim_physics_max0.0036632944555843577
sim_physics_mean0.003565940453885353
sim_physics_median0.003541114330291748
sim_physics_min0.003476410645705003
sim_render-ego_max0.07376069784164428
sim_render-ego_mean0.07153944608644507
sim_render-ego_median0.0719846733032711
sim_render-ego_min0.06727993838927325
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
169932295Andrea CensiΒ πŸ‡¨πŸ‡­Java templateaido2-AMOD-efficiencystep1-simulationerrornoidsc-rudolf-151200:00:29
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169922297Andrea CensiΒ πŸ‡¨πŸ‡­Java templateaido2-AMOD-service_qualitystep1-simulationerrornoidsc-rudolf-151200:00:48
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169912244Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido2_LFV_r1-v4step1-simulationhost-errornoidsc-rudolf-151200:00:50
Error while running [...]

stderr | Pulling evaluator      ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling solution       ... done
stderr | 
stderr | ERROR: for simulator  Cannot overwrite digest sha256:e0d5d7cf9732568fcba0710e48aa1d4eaf6e9ddfbc6af0afa961c1607b5f4711
stderr | Cannot overwrite digest sha256:e0d5d7cf9732568fcba0710e48aa1d4eaf6e9ddfbc6af0afa961c1607b5f4711
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169822265Andrea CensiΒ πŸ‡¨πŸ‡­PredictorMeanaido2-PREDstep1-simulationerrornoidsc-rudolf-151200:00:33
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169782272Andrea CensiΒ πŸ‡¨πŸ‡­PredictorMeanaido2-PREDstep1-simulationerrornoidsc-rudolf-151200:00:33
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible