AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 767

evaluator767
ownerAndrea Censi
machinenutonomy-P50
processnutonomy-P50-6318
versiond-c:4.0.18;d-c-r:4.0.27;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success16
# timeout1
# failed
# error12
# aborted4
# host-error10
arm0
x86_641
Mac0
gpu available1
Number of processors8
Processor frequency (MHz)3.4 GHz
Free % of processors
RAM total (MB)15.5 GB
RAM free (MB)11.1 GB
Disk (MB)452.8 GB
Disk available (MB)
Docker Hub
P11
P2
Cloud simulations
PI Camera0
# Duckiebots0
Map 3x3 avaiable0
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
192142981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationtimeoutno7671:05:48
I can see how the jo [...]
I can see how the job 19214 is timeout because passed 3948 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
192102964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno7670:18:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5667290884960443
survival_time_median14.950000000000076
deviation-center-line_median0.398324515619486
in-drivable-lane_median3.200000000000018


other stats
agent_compute-ego_max0.1167363399683043
agent_compute-ego_mean0.11450816581953348
agent_compute-ego_median0.11631455230074982
agent_compute-ego_min0.11113672971725463
deviation-center-line_max0.9346331265421992
deviation-center-line_mean0.5654450530961703
deviation-center-line_min0.18970047786435376
deviation-heading_max6.016161144404485
deviation-heading_mean2.3093260500374457
deviation-heading_median1.3963345862077443
deviation-heading_min1.313315170416522
driven_any_max1.6929429087638026
driven_any_mean1.453818242837175
driven_any_median1.52323920285428
driven_any_min0.9442529884243072
driven_lanedir_consec_max1.5839289106952368
driven_lanedir_consec_mean0.856514431924443
driven_lanedir_consec_min0.5300766732460096
driven_lanedir_max1.5839289106952368
driven_lanedir_mean0.8604328547035124
driven_lanedir_median0.5827543313206553
driven_lanedir_min0.5300766732460096
in-drivable-lane_max8.900000000000091
in-drivable-lane_mean4.470000000000039
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.6929429087638026, "sim_physics": 0.01881798772907576, "survival_time": 14.950000000000076, "driven_lanedir": 1.0734160333678644, "sim_render-ego": 0.03516330687098679, "in-drivable-lane": 3.200000000000018, "agent_compute-ego": 0.11631455230074982, "deviation-heading": 6.016161144404485, "set_robot_commands": 0.05276405771440487, "deviation-center-line": 0.9076187546535042, "driven_lanedir_consec": 1.0698491622971285, "sim_compute_sim_state": 0.02170496481318139, "sim_compute_performance-ego": 0.03741805529514683, "sim_compute_robot_state-ego": 0.038864646866967445, "sim_compute_robot_state-npc0": 0.03858670422863402, "sim_compute_robot_state-npc1": 0.03844837759649475, "sim_compute_robot_state-npc2": 0.03848241643363417, "sim_compute_robot_state-npc3": 0.03895322534950282}, "udem1-1-0": {"driven_any": 0.9442529884243072, "sim_physics": 0.01869792161985885, "survival_time": 6.449999999999985, "driven_lanedir": 0.5827543313206553, "sim_render-ego": 0.0362623089043669, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.1167363399683043, "deviation-heading": 1.3963345862077443, "set_robot_commands": 0.05291020223336627, "deviation-center-line": 0.18970047786435376, "driven_lanedir_consec": 0.5667290884960443, "sim_compute_sim_state": 0.021647915359615355, "sim_compute_performance-ego": 0.037437817847081854, "sim_compute_robot_state-ego": 0.039199999136518136, "sim_compute_robot_state-npc0": 0.038642700328383336, "sim_compute_robot_state-npc1": 0.03886322827302208, "sim_compute_robot_state-npc2": 0.03840385666189268, "sim_compute_robot_state-npc3": 0.03818011468695116}, "udem1-2-0": {"driven_any": 1.52323920285428, "sim_physics": 0.017436470985412598, "survival_time": 14.950000000000076, "driven_lanedir": 0.5319883248877959, "sim_render-ego": 0.03397969802220662, "in-drivable-lane": 8.85000000000009, "agent_compute-ego": 0.11178709268569946, "deviation-heading": 1.323917909927847, "set_robot_commands": 0.05163753986358643, "deviation-center-line": 0.398324515619486, "driven_lanedir_consec": 0.5319883248877959, "sim_compute_sim_state": 0.021354300181070963, "sim_compute_performance-ego": 0.03648407300313314, "sim_compute_robot_state-ego": 0.03723074595133464, "sim_compute_robot_state-npc0": 0.03763383944829305, "sim_compute_robot_state-npc1": 0.037264169057210285, "sim_compute_robot_state-npc2": 0.03697995662689209, "sim_compute_robot_state-npc3": 0.03728773832321167}, "udem1-3-0": {"driven_any": 1.5115029157601982, "sim_physics": 0.018037375609079996, "survival_time": 14.950000000000076, "driven_lanedir": 0.5300766732460096, "sim_render-ego": 0.033592127958933515, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.11113672971725463, "deviation-heading": 1.313315170416522, "set_robot_commands": 0.05136369387308756, "deviation-center-line": 0.39694839080130834, "driven_lanedir_consec": 0.5300766732460096, "sim_compute_sim_state": 0.021049261887868244, "sim_compute_performance-ego": 0.03614336649576823, "sim_compute_robot_state-ego": 0.037852206230163575, "sim_compute_robot_state-npc0": 0.0374018398920695, "sim_compute_robot_state-npc1": 0.03703181425730387, "sim_compute_robot_state-npc2": 0.03684073527654013, "sim_compute_robot_state-npc3": 0.03721197366714477}, "udem1-4-0": {"driven_any": 1.5971531983832885, "sim_physics": 0.01833004792531331, "survival_time": 14.950000000000076, "driven_lanedir": 1.5839289106952368, "sim_render-ego": 0.03555997769037882, "in-drivable-lane": 0, "agent_compute-ego": 0.11656611442565916, "deviation-heading": 1.4969014392306297, "set_robot_commands": 0.05252784570058187, "deviation-center-line": 0.9346331265421992, "driven_lanedir_consec": 1.5839289106952368, "sim_compute_sim_state": 0.02190232038497925, "sim_compute_performance-ego": 0.03779081106185913, "sim_compute_robot_state-ego": 0.03919035275777181, "sim_compute_robot_state-npc0": 0.0395637853940328, "sim_compute_robot_state-npc1": 0.03867676655451457, "sim_compute_robot_state-npc2": 0.038220164775848386, "sim_compute_robot_state-npc3": 0.03915022850036621}}
set_robot_commands_max0.05291020223336627
set_robot_commands_mean0.05224066787700539
set_robot_commands_median0.05252784570058187
set_robot_commands_min0.05136369387308756
sim_compute_performance-ego_max0.03779081106185913
sim_compute_performance-ego_mean0.03705482474059784
sim_compute_performance-ego_median0.03741805529514683
sim_compute_performance-ego_min0.03614336649576823
sim_compute_robot_state-ego_max0.039199999136518136
sim_compute_robot_state-ego_mean0.03846759018855112
sim_compute_robot_state-ego_median0.038864646866967445
sim_compute_robot_state-ego_min0.03723074595133464
sim_compute_robot_state-npc0_max0.0395637853940328
sim_compute_robot_state-npc0_mean0.038365773858282534
sim_compute_robot_state-npc0_median0.03858670422863402
sim_compute_robot_state-npc0_min0.0374018398920695
sim_compute_robot_state-npc1_max0.03886322827302208
sim_compute_robot_state-npc1_mean0.03805687114770911
sim_compute_robot_state-npc1_median0.03844837759649475
sim_compute_robot_state-npc1_min0.03703181425730387
sim_compute_robot_state-npc2_max0.03848241643363417
sim_compute_robot_state-npc2_mean0.03778542595496149
sim_compute_robot_state-npc2_median0.038220164775848386
sim_compute_robot_state-npc2_min0.03684073527654013
sim_compute_robot_state-npc3_max0.03915022850036621
sim_compute_robot_state-npc3_mean0.03815665610543533
sim_compute_robot_state-npc3_median0.03818011468695116
sim_compute_robot_state-npc3_min0.03721197366714477
sim_compute_sim_state_max0.02190232038497925
sim_compute_sim_state_mean0.02153175252534304
sim_compute_sim_state_median0.021647915359615355
sim_compute_sim_state_min0.021049261887868244
sim_physics_max0.01881798772907576
sim_physics_mean0.018263960773748103
sim_physics_median0.01833004792531331
sim_physics_min0.017436470985412598
sim_render-ego_max0.0362623089043669
sim_render-ego_mean0.03491148388937453
sim_render-ego_median0.03516330687098679
sim_render-ego_min0.033592127958933515
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.250000000000057
survival_time_min6.449999999999985
192072970Andrea Censiminimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessno7670:09:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225306900765771
survival_time_median10.750000000000018
deviation-center-line_median0.40864173779456053
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.0867348936106592
agent_compute-ego_mean0.08345531262366618
agent_compute-ego_median0.08572825016798796
agent_compute-ego_min0.0778980725002985
deviation-center-line_max0.6491801892887803
deviation-center-line_mean0.3683230725655418
deviation-center-line_min0.1475671628461062
deviation-heading_max2.2060076411946548
deviation-heading_mean1.4163758252990906
deviation-heading_median1.5250264276913703
deviation-heading_min0.6970592634293067
driven_any_max1.6057043265958648
driven_any_mean1.3484469345214642
driven_any_median1.5756972277649912
driven_any_min0.9900494571900692
driven_lanedir_consec_max1.4904214722299334
driven_lanedir_consec_mean1.0721437270256324
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.4904214722299334
driven_lanedir_mean1.0721437270256324
driven_lanedir_median1.225306900765771
driven_lanedir_min0.6474115509746436
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.4300000000000082
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.009685159587174011, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.032683751565946946, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.08090994855482801, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.05034639680985925, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.02030697829431767, "sim_compute_performance-ego": 0.03635436682392367, "sim_compute_robot_state-ego": 0.03723313311021105}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.0098324726967916, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.03163314213717941, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.0778980725002985, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.04936342343796779, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.020098651412629735, "sim_compute_performance-ego": 0.034850752266654135, "sim_compute_robot_state-ego": 0.03722497668579547}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.010770679054773444, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.03512258486897422, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.0867348936106592, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.053249531262658634, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.02242362018123336, "sim_compute_performance-ego": 0.03762328036697456, "sim_compute_robot_state-ego": 0.0391962132646364}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.010620791413063229, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.034223288159037746, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.08600539828455725, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.053288547382798306, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.022112742135691088, "sim_compute_performance-ego": 0.037863556174344795, "sim_compute_robot_state-ego": 0.03890851042991461}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.01055822769800822, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.03477518205289488, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.08572825016798796, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.052627379143679584, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.02206451142275775, "sim_compute_performance-ego": 0.038294965470278705, "sim_compute_robot_state-ego": 0.03911720823358606}}
set_robot_commands_max0.053288547382798306
set_robot_commands_mean0.05177505560739272
set_robot_commands_median0.052627379143679584
set_robot_commands_min0.04936342343796779
sim_compute_performance-ego_max0.038294965470278705
sim_compute_performance-ego_mean0.03699738422043518
sim_compute_performance-ego_median0.03762328036697456
sim_compute_performance-ego_min0.034850752266654135
sim_compute_robot_state-ego_max0.0391962132646364
sim_compute_robot_state-ego_mean0.03833600834482871
sim_compute_robot_state-ego_median0.03890851042991461
sim_compute_robot_state-ego_min0.03722497668579547
sim_compute_sim_state_max0.02242362018123336
sim_compute_sim_state_mean0.02140130068932592
sim_compute_sim_state_median0.02206451142275775
sim_compute_sim_state_min0.020098651412629735
sim_physics_max0.010770679054773444
sim_physics_mean0.0102934660899621
sim_physics_median0.01055822769800822
sim_physics_min0.009685159587174011
sim_render-ego_max0.03512258486897422
sim_render-ego_mean0.033687589756806635
sim_render-ego_median0.034223288159037746
sim_render-ego_min0.03163314213717941
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean9.300000000000004
survival_time_min6.849999999999984
192032912duckietown_mumchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno7670:10:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9155842498369492
survival_time_median11.65000000000003
deviation-center-line_median0.7444106618205801
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05405204217942035
agent_compute-ego_mean0.05255583015438194
agent_compute-ego_median0.05217398129976713
agent_compute-ego_min0.05155584945187548
deviation-center-line_max1.145185975143482
deviation-center-line_mean0.7956077351488897
deviation-center-line_min0.42131021260548374
deviation-heading_max3.7454115672837145
deviation-heading_mean2.0398681243929255
deviation-heading_median1.835226355111387
deviation-heading_min0.6665609404145512
driven_any_max2.3532112511497623
driven_any_mean1.5322948084395271
driven_any_median1.8253548955381595
driven_any_min0.6842416511385191
driven_lanedir_consec_max1.7893431149620276
driven_lanedir_consec_mean1.007348626849343
driven_lanedir_consec_min0.6730551409975218
driven_lanedir_max1.7893431149620276
driven_lanedir_mean1.2113701741264316
driven_lanedir_median1.098347280519953
driven_lanedir_min0.6730551409975218
in-drivable-lane_max3.950000000000036
in-drivable-lane_mean1.490000000000009
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3532112511497623, "sim_physics": 0.010423000653584796, "survival_time": 14.950000000000076, "driven_lanedir": 1.5761769879956686, "sim_render-ego": 0.03662275234858195, "in-drivable-lane": 3.950000000000036, "agent_compute-ego": 0.05212221384048462, "deviation-heading": 3.149181188920488, "set_robot_commands": 0.05559446573257446, "deviation-center-line": 1.0672725524807631, "driven_lanedir_consec": 0.7388322822932306, "sim_compute_sim_state": 0.02353488286336263, "sim_compute_performance-ego": 0.04002222061157226, "sim_compute_robot_state-ego": 0.04138780117034912}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8253548955381595, "sim_physics": 0.010597061189970744, "survival_time": 11.65000000000003, "driven_lanedir": 1.7893431149620276, "sim_render-ego": 0.036042396602712475, "in-drivable-lane": 0, "agent_compute-ego": 0.05155584945187548, "deviation-heading": 1.835226355111387, "set_robot_commands": 0.05632766735911881, "deviation-center-line": 1.145185975143482, "driven_lanedir_consec": 1.7893431149620276, "sim_compute_sim_state": 0.023084089991360773, "sim_compute_performance-ego": 0.04006559756692387, "sim_compute_robot_state-ego": 0.04101187579109945}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9333537516789936, "sim_physics": 0.010359199320683712, "survival_time": 6.099999999999986, "driven_lanedir": 0.9199283461569858, "sim_render-ego": 0.03388729447224101, "in-drivable-lane": 0, "agent_compute-ego": 0.05405204217942035, "deviation-heading": 0.802960570234488, "set_robot_commands": 0.05202525170122991, "deviation-center-line": 0.5998592736941397, "driven_lanedir_consec": 0.9199283461569858, "sim_compute_sim_state": 0.0214318721020808, "sim_compute_performance-ego": 0.03722324723103007, "sim_compute_robot_state-ego": 0.038171342161835216}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.011531651675046146, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.034738003552614985, "in-drivable-lane": 0, "agent_compute-ego": 0.05217398129976713, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.05357024957845499, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.022458411835052153, "sim_compute_performance-ego": 0.03764213834490095, "sim_compute_robot_state-ego": 0.03923833763206398}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8653124926922, "sim_physics": 0.010006036077226912, "survival_time": 11.900000000000034, "driven_lanedir": 1.098347280519953, "sim_render-ego": 0.03390322412763323, "in-drivable-lane": 3.5000000000000098, "agent_compute-ego": 0.052875064000362106, "deviation-heading": 3.7454115672837145, "set_robot_commands": 0.0519088887366928, "deviation-center-line": 0.7444106618205801, "driven_lanedir_consec": 0.9155842498369492, "sim_compute_sim_state": 0.021207324597014098, "sim_compute_performance-ego": 0.0369736837739704, "sim_compute_robot_state-ego": 0.03802905964250324}}
set_robot_commands_max0.05632766735911881
set_robot_commands_mean0.05388530462161419
set_robot_commands_median0.05357024957845499
set_robot_commands_min0.0519088887366928
sim_compute_performance-ego_max0.04006559756692387
sim_compute_performance-ego_mean0.03838537750567951
sim_compute_performance-ego_median0.03764213834490095
sim_compute_performance-ego_min0.0369736837739704
sim_compute_robot_state-ego_max0.04138780117034912
sim_compute_robot_state-ego_mean0.0395676832795702
sim_compute_robot_state-ego_median0.03923833763206398
sim_compute_robot_state-ego_min0.03802905964250324
sim_compute_sim_state_max0.02353488286336263
sim_compute_sim_state_mean0.02234331627777409
sim_compute_sim_state_median0.022458411835052153
sim_compute_sim_state_min0.021207324597014098
sim_physics_max0.011531651675046146
sim_physics_mean0.010583389783302463
sim_physics_median0.010423000653584796
sim_physics_min0.010006036077226912
sim_render-ego_max0.03662275234858195
sim_render-ego_mean0.03503873422075673
sim_render-ego_median0.034738003552614985
sim_render-ego_min0.03388729447224101
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.830000000000023
survival_time_min4.549999999999992
191982516Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrorno7670:01:08
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191922828Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationerrorno7670:02:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191912831AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrorno7670:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191902843AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrorno7670:00:55
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191862868almasipBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrorno7670:02:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191852516Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrorno7670:01:02
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191792899Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationerrorno7670:02:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191762920Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationerrorno7670:02:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191662917Claudio RuchPython templateaido2-AMOD-service_qualitystep2-scoringsuccessyes7670:11:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-32.26542305478577


other stats
efficiency-63.02377221914047
fleet_size-1000000000
191362312Andrea CensiPython templateaido2-AMOD-service_qualitystep1-simulationsuccessyes7670:23:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
191352961Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationhost-errorno7670:01:30
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job19135-82296', 'pull']:

   >  Command '['docker-compose', '-p', 'job19135-82296', 'pull']' returned non-zero exit status 1.

stdout | 

stderr | Pulling evaluator      ...
stderr | Pulling scenario_maker ...
stderr | Pulling simulator      ...
stderr | Pulling solution       ...
stderr | 
stderr | Pulling simulator      ... error
stderr | 
stderr | Pulling solution       ... error
stderr | 
stderr | Pulling evaluator      ... error
stderr | 
stderr | Pulling scenario_maker ... error
stderr | 
stderr | ERROR: for simulator  Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-simulator/manifests/2019_04_20_10_15_30: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-simulator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | 
stderr | ERROR: for solution  Get https://registry-1.docker.io/v2/julian121266/aido-submissions/manifests/2019_04_24_07_40_09: Get https://auth.docker.io/token?scope=repository%3Ajulian121266%2Faido-submissions%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | 
stderr | ERROR: for evaluator  Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-evaluator/manifests/2019_04_20_10_15_18: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-evaluator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | 
stderr | ERROR: for scenario_maker  Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-scenario_maker/manifests/2019_04_20_10_15_59: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-scenario_maker%3Apull&service=registry.docker.io: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-simulator/manifests/2019_04_20_10_15_30: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-simulator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/julian121266/aido-submissions/manifests/2019_04_24_07_40_09: Get https://auth.docker.io/token?scope=repository%3Ajulian121266%2Faido-submissions%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-evaluator/manifests/2019_04_20_10_15_18: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-evaluator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-scenario_maker/manifests/2019_04_20_10_15_59: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-scenario_maker%3Apull&service=registry.docker.io: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191012921Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessno7670:27:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0566858977432112
survival_time_median1.5500000000000007
deviation-center-line_median0.023148172805414476
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.09818818492274133
agent_compute-ego_mean0.091763393855422
agent_compute-ego_median0.09325681194182366
agent_compute-ego_min0.08672705189935093
deviation-center-line_max0.4143603141649533
deviation-center-line_mean0.099432655391562
deviation-center-line_min0.013250602252189114
deviation-heading_max5.97404295840024
deviation-heading_mean1.6296975851773374
deviation-heading_median0.5645872376871222
deviation-heading_min0.46340652718145225
driven_any_max1.7144396805780229
driven_any_mean0.4617436989834115
driven_any_median0.1510553521954725
driven_any_min0.1448083064525979
driven_lanedir_consec_max0.5676263413936016
driven_lanedir_consec_mean0.1526879226511613
driven_lanedir_consec_min0.040683725717511
driven_lanedir_max0.5676263413936016
driven_lanedir_mean0.1526879226511613
driven_lanedir_median0.0566858977432112
driven_lanedir_min0.040683725717511
in-drivable-lane_max7.200000000000043
in-drivable-lane_mean1.880000000000009
in-drivable-lane_min0.5000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1448083064525979, "sim_physics": 0.010274664048225648, "survival_time": 1.5500000000000007, "driven_lanedir": 0.040683725717511, "sim_render-ego": 0.03575081209982595, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.09818818492274133, "deviation-heading": 0.46340652718145225, "set_robot_commands": 0.053619092510592554, "deviation-center-line": 0.013250602252189114, "driven_lanedir_consec": 0.040683725717511, "sim_compute_sim_state": 0.022027284868301883, "sim_compute_performance-ego": 0.038121054249425086, "sim_compute_robot_state-ego": 0.03839412812263735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1521701972305242, "sim_physics": 0.010777050449002174, "survival_time": 1.5500000000000007, "driven_lanedir": 0.057380457033182064, "sim_render-ego": 0.036004712504725304, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09325681194182366, "deviation-heading": 0.5940789334905884, "set_robot_commands": 0.05243767461469097, "deviation-center-line": 0.026623618713001788, "driven_lanedir_consec": 0.057380457033182064, "sim_compute_sim_state": 0.02207330734499039, "sim_compute_performance-ego": 0.03807761592249717, "sim_compute_robot_state-ego": 0.04076395496245353}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7144396805780229, "sim_physics": 0.010018366972605388, "survival_time": 14.950000000000076, "driven_lanedir": 0.5676263413936016, "sim_render-ego": 0.03551799217859904, "in-drivable-lane": 7.200000000000043, "agent_compute-ego": 0.09382350285847982, "deviation-heading": 5.97404295840024, "set_robot_commands": 0.05260050614674886, "deviation-center-line": 0.4143603141649533, "driven_lanedir_consec": 0.5676263413936016, "sim_compute_sim_state": 0.02173088788986206, "sim_compute_performance-ego": 0.03699928442637126, "sim_compute_robot_state-ego": 0.03879706859588623}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1510553521954725, "sim_physics": 0.009541111607705393, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0566858977432112, "sim_render-ego": 0.033189465922694054, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.08682141765471428, "deviation-heading": 0.5645872376871222, "set_robot_commands": 0.04766164287444083, "deviation-center-line": 0.023148172805414476, "driven_lanedir_consec": 0.0566858977432112, "sim_compute_sim_state": 0.020038297099451863, "sim_compute_performance-ego": 0.034150808088241086, "sim_compute_robot_state-ego": 0.03549002831982028}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14624495846044025, "sim_physics": 0.0093549448868324, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04106319136830061, "sim_render-ego": 0.032924923403509734, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.08672705189935093, "deviation-heading": 0.5523722691272842, "set_robot_commands": 0.04776415331610318, "deviation-center-line": 0.019780569022251424, "driven_lanedir_consec": 0.04106319136830061, "sim_compute_sim_state": 0.018999749216540105, "sim_compute_performance-ego": 0.03366459649184655, "sim_compute_robot_state-ego": 0.03532898014989393}}
set_robot_commands_max0.053619092510592554
set_robot_commands_mean0.05081661389251528
set_robot_commands_median0.05243767461469097
set_robot_commands_min0.04766164287444083
sim_compute_performance-ego_max0.038121054249425086
sim_compute_performance-ego_mean0.03620267183567623
sim_compute_performance-ego_median0.03699928442637126
sim_compute_performance-ego_min0.03366459649184655
sim_compute_robot_state-ego_max0.04076395496245353
sim_compute_robot_state-ego_mean0.03775483203013826
sim_compute_robot_state-ego_median0.03839412812263735
sim_compute_robot_state-ego_min0.03532898014989393
sim_compute_sim_state_max0.02207330734499039
sim_compute_sim_state_mean0.02097390528382926
sim_compute_sim_state_median0.02173088788986206
sim_compute_sim_state_min0.018999749216540105
sim_physics_max0.010777050449002174
sim_physics_mean0.0099932275928742
sim_physics_median0.010018366972605388
sim_physics_min0.0093549448868324
sim_render-ego_max0.036004712504725304
sim_render-ego_mean0.03467758122187081
sim_render-ego_median0.03551799217859904
sim_render-ego_min0.032924923403509734
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.210000000000016
survival_time_min1.4500000000000006
190892916Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationabortedno7670:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190872917Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationabortedno7670:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190692915Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationhost-errorno7670:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190672914Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationhost-errorno7670:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190352907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno7671:25:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-nutonomy-P50-6318-job19035/tmp/tmpf0pr3qn3/attempts/udem1-4-0.attempt4/log.gs2.cbor']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190222891dcharrezPython templateaido2-AMOD-efficiencystep1-simulationhost-errorno7670:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190172892dcharrezPython templateaido2-AMOD-service_qualitystep1-simulationhost-errorno7670:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
190102889dcharrezPython templateaido2-AMOD-efficiencystep1-simulationhost-errorno7670:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189952890dcharrezPython templateaido2-AMOD-service_qualitystep1-simulationhost-errorno7670:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189622889dcharrezPython templateaido2-AMOD-efficiencystep1-simulationabortedno7670:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189602890dcharrezPython templateaido2-AMOD-service_qualitystep1-simulationabortedno7670:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189482888dcharrezPredictorLastaido2-PREDstep1-simulationsuccessno7670:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11053343004933798
error_L20.01852605233087393


189462886dcharrezPredictorLastaido2-PREDstep1-simulationsuccessno7670:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12315509149471632
error_L20.02388587331016121


189372884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno7670:23:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-nutonomy-P50-6318-job18937/tmp/tmppnqhi3c_/attempts/udem1-3-0.attempt3/log.gs2.cbor']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189262363Andrea Censirandom_agentaido2-LF-sim-validationstep1-simulationsuccessno7670:05:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.07847550240429965
agent_compute-ego_mean0.07532129587405485
agent_compute-ego_median0.07661286872975967
agent_compute-ego_min0.0710841566324234
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010749812396067494, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03584353428966594, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.07352245978589328, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.053785890903113025, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.02135303335369758, "sim_compute_performance-ego": 0.04108583702231353, "sim_compute_robot_state-ego": 0.039001109465113225}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.010454194112257524, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.03741995854811235, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.07847550240429965, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.05526195872913708, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.022922261194749313, "sim_compute_performance-ego": 0.03936931219967929, "sim_compute_robot_state-ego": 0.04003148187290539}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01055360370212131, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.03638987541198731, "in-drivable-lane": 0, "agent_compute-ego": 0.07691149181789822, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.05389268663194444, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02220055792066786, "sim_compute_performance-ego": 0.03862266540527344, "sim_compute_robot_state-ego": 0.03964676856994629}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.010356391469637552, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03412485122680664, "in-drivable-lane": 0, "agent_compute-ego": 0.0710841566324234, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.050862908363342285, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02008754511674245, "sim_compute_performance-ego": 0.0355378786722819, "sim_compute_robot_state-ego": 0.036656235655148826}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.011985989177928253, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.03601581208846148, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.07661286872975967, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05353331916472491, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.022491455078125, "sim_compute_performance-ego": 0.0375407057649949, "sim_compute_robot_state-ego": 0.039707730798160326}}
set_robot_commands_max0.05526195872913708
set_robot_commands_mean0.053467352758452345
set_robot_commands_median0.053785890903113025
set_robot_commands_min0.050862908363342285
sim_compute_performance-ego_max0.04108583702231353
sim_compute_performance-ego_mean0.038431279812908614
sim_compute_performance-ego_median0.03862266540527344
sim_compute_performance-ego_min0.0355378786722819
sim_compute_robot_state-ego_max0.04003148187290539
sim_compute_robot_state-ego_mean0.039008665272254814
sim_compute_robot_state-ego_median0.03964676856994629
sim_compute_robot_state-ego_min0.036656235655148826
sim_compute_sim_state_max0.022922261194749313
sim_compute_sim_state_mean0.02181097053279644
sim_compute_sim_state_median0.02220055792066786
sim_compute_sim_state_min0.02008754511674245
sim_physics_max0.011985989177928253
sim_physics_mean0.010819998171602428
sim_physics_median0.01055360370212131
sim_physics_min0.010356391469637552
sim_render-ego_max0.03741995854811235
sim_render-ego_mean0.03595880631300674
sim_render-ego_median0.03601581208846148
sim_render-ego_min0.03412485122680664
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
189202370Liam Paullminimal_agent (Python 3)aido2-LF-sim-validationstep1-simulationsuccessno7670:12:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225306900765771
survival_time_median10.750000000000018
deviation-center-line_median0.40864173779456053
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.08812728593515795
agent_compute-ego_mean0.08517162629955949
agent_compute-ego_median0.084036683594739
agent_compute-ego_min0.08258479806874365
deviation-center-line_max0.6491801892887803
deviation-center-line_mean0.3683230725655418
deviation-center-line_min0.1475671628461062
deviation-heading_max2.2060076411946548
deviation-heading_mean1.4163758252990906
deviation-heading_median1.5250264276913703
deviation-heading_min0.6970592634293067
driven_any_max1.6057043265958648
driven_any_mean1.3484469345214642
driven_any_median1.5756972277649912
driven_any_min0.9900494571900692
driven_lanedir_consec_max1.4904214722299334
driven_lanedir_consec_mean1.0721437270256324
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.4904214722299334
driven_lanedir_mean1.0721437270256324
driven_lanedir_median1.225306900765771
driven_lanedir_min0.6474115509746436
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.4300000000000082
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.011800373200889972, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.035857799241868715, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.08763486704380392, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.05084500724463154, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.02288418536563571, "sim_compute_performance-ego": 0.03817251431856224, "sim_compute_robot_state-ego": 0.040330020643824294}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.01061614238432724, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.03478332853665317, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08347449685535292, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.050823481413569765, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.021440939311563535, "sim_compute_performance-ego": 0.03698987160285894, "sim_compute_robot_state-ego": 0.03829749657289825}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.010343208441285275, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.03498060179398199, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.08258479806874365, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.0505630692024402, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.021038582506735765, "sim_compute_performance-ego": 0.03606793164137768, "sim_compute_robot_state-ego": 0.03721722572908273}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.011485782889432684, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.03645606928093489, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.08812728593515795, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.052772565220677574, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.022987060768659726, "sim_compute_performance-ego": 0.038085172342699626, "sim_compute_robot_state-ego": 0.0396013758903326}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.010123433890166109, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.03528519802623325, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.084036683594739, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.05197797660474424, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.021580745776494343, "sim_compute_performance-ego": 0.037081881805702495, "sim_compute_robot_state-ego": 0.03834867035901105}}
set_robot_commands_max0.052772565220677574
set_robot_commands_mean0.05139641993721267
set_robot_commands_median0.05084500724463154
set_robot_commands_min0.0505630692024402
sim_compute_performance-ego_max0.03817251431856224
sim_compute_performance-ego_mean0.037279474342240194
sim_compute_performance-ego_median0.037081881805702495
sim_compute_performance-ego_min0.03606793164137768
sim_compute_robot_state-ego_max0.040330020643824294
sim_compute_robot_state-ego_mean0.03875895783902979
sim_compute_robot_state-ego_median0.03834867035901105
sim_compute_robot_state-ego_min0.03721722572908273
sim_compute_sim_state_max0.022987060768659726
sim_compute_sim_state_mean0.021986302745817816
sim_compute_sim_state_median0.021580745776494343
sim_compute_sim_state_min0.021038582506735765
sim_physics_max0.011800373200889972
sim_physics_mean0.010873788161220256
sim_physics_median0.01061614238432724
sim_physics_min0.010123433890166109
sim_render-ego_max0.03645606928093489
sim_render-ego_mean0.0354725993759344
sim_render-ego_median0.03528519802623325
sim_render-ego_min0.03478332853665317
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean9.300000000000004
survival_time_min6.849999999999984
189132376Liam Paullminimal_agent_python2 (Python 2)aido2-LF-sim-validationstep1-simulationsuccessno7670:07:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2394590679116675
survival_time_median5.549999999999988
deviation-center-line_median0.04756896992501765
in-drivable-lane_median0.9999999999999964


other stats
agent_compute-ego_max0.041902533522597304
agent_compute-ego_mean0.03736311975900117
agent_compute-ego_median0.036885912353928026
agent_compute-ego_min0.03470991323660086
deviation-center-line_max0.06628159589691172
deviation-center-line_mean0.055053867384428454
deviation-center-line_min0.04756874938348469
deviation-heading_max0.3902119203851745
deviation-heading_mean0.3724667982759654
deviation-heading_median0.39020902164128224
deviation-heading_min0.34585149487811473
driven_any_max1.5771689201187185
driven_any_mean1.343168920198914
driven_any_median1.5771689201187176
driven_any_min0.992168920319208
driven_lanedir_consec_max1.344898529895705
driven_lanedir_consec_mean1.047634910702065
driven_lanedir_consec_min0.6544587706938922
driven_lanedir_max1.344898529895705
driven_lanedir_mean1.047634910702065
driven_lanedir_median1.2394590679116675
driven_lanedir_min0.6544587706938922
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.8799999999999969
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.011263665225770738, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.03670378194914923, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03548868828349643, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.054705656237072416, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.022000296248330012, "sim_compute_performance-ego": 0.03932187292310926, "sim_compute_robot_state-ego": 0.03913576735390557}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.992168920319208, "sim_physics": 0.013611502117580838, "survival_time": 3.599999999999995, "driven_lanedir": 0.7598991170973933, "sim_render-ego": 0.0382725199063619, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.037828551398383245, "deviation-heading": 0.34585253283397355, "set_robot_commands": 0.05597290727827284, "deviation-center-line": 0.06628159589691172, "driven_lanedir_consec": 0.7598991170973933, "sim_compute_sim_state": 0.023330108986960515, "sim_compute_performance-ego": 0.04108754793802897, "sim_compute_robot_state-ego": 0.04224980539745755}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187185, "sim_physics": 0.011831083813229122, "survival_time": 5.549999999999988, "driven_lanedir": 1.344898529895705, "sim_render-ego": 0.03776663273304432, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.036885912353928026, "deviation-heading": 0.34585149487811473, "set_robot_commands": 0.054838704633283185, "deviation-center-line": 0.06628127233324356, "driven_lanedir_consec": 1.344898529895705, "sim_compute_sim_state": 0.023148117838679132, "sim_compute_performance-ego": 0.03931336574726277, "sim_compute_robot_state-ego": 0.0406155843992491}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.01410820892265251, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.04304786200995918, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.041902533522597304, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.06214830682084367, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.025850446374566707, "sim_compute_performance-ego": 0.0450153415267532, "sim_compute_robot_state-ego": 0.046095321844289966}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.012136261742394247, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.03501480334513896, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03470991323660086, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.05207692395459424, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.021089124249982404, "sim_compute_performance-ego": 0.03650569700979971, "sim_compute_robot_state-ego": 0.038599220482078755}}
set_robot_commands_max0.06214830682084367
set_robot_commands_mean0.05594849978481327
set_robot_commands_median0.054838704633283185
set_robot_commands_min0.05207692395459424
sim_compute_performance-ego_max0.0450153415267532
sim_compute_performance-ego_mean0.04024876502899079
sim_compute_performance-ego_median0.03932187292310926
sim_compute_performance-ego_min0.03650569700979971
sim_compute_robot_state-ego_max0.046095321844289966
sim_compute_robot_state-ego_mean0.04133913989539619
sim_compute_robot_state-ego_median0.0406155843992491
sim_compute_robot_state-ego_min0.038599220482078755
sim_compute_sim_state_max0.025850446374566707
sim_compute_sim_state_mean0.023083618739703753
sim_compute_sim_state_median0.023148117838679132
sim_compute_sim_state_min0.021089124249982404
sim_physics_max0.01410820892265251
sim_physics_mean0.012590144364325493
sim_physics_median0.012136261742394247
sim_physics_min0.011263665225770738
sim_render-ego_max0.04304786200995918
sim_render-ego_mean0.03816111998873072
sim_render-ego_median0.03776663273304432
sim_render-ego_min0.03501480334513896
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean4.769999999999992
survival_time_min3.599999999999995
188872410jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationhost-errorno7670:24:20
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2410/step1-simulation-nutonomy-P50-6318-job18887/tmp/tmpgio67it1/attempts/ETHZ_autolab_technical_track-3-0.attempt3/log.gs2.cbor']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
188832407vguerraBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessno7670:09:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06092810812389593
survival_time_median1.4500000000000006
deviation-center-line_median0.02759984044858422
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.0975822169205238
agent_compute-ego_mean0.09423203847022904
agent_compute-ego_median0.09548007208725502
agent_compute-ego_min0.08902104147549333
deviation-center-line_max0.06309944562387113
deviation-center-line_mean0.03391841014839599
deviation-center-line_min0.02296796274949999
deviation-heading_max1.624846446358105
deviation-heading_mean0.7882865981193399
deviation-heading_median0.5925601499045107
deviation-heading_min0.5444366347877188
driven_any_max0.5089678419080116
driven_any_mean0.2299967746153256
driven_any_median0.16541423175805248
driven_any_min0.14793728273500953
driven_lanedir_consec_max0.1814935724987703
driven_lanedir_consec_mean0.08221973224724732
driven_lanedir_consec_min0.05316019322444565
driven_lanedir_max0.1814935724987703
driven_lanedir_mean0.08221973224724732
driven_lanedir_median0.06092810812389593
driven_lanedir_min0.05316019322444565
in-drivable-lane_max1.8999999999999977
in-drivable-lane_mean0.7199999999999999
in-drivable-lane_min0.4000000000000003
per-episodes
details{"udem1-0-0": {"driven_any": 0.17154856958109754, "sim_physics": 0.017857387148100753, "survival_time": 1.4500000000000006, "driven_lanedir": 0.061322155459707206, "sim_render-ego": 0.03578634919791386, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.0975822169205238, "deviation-heading": 0.5444366347877188, "set_robot_commands": 0.052248223074551285, "deviation-center-line": 0.024948807959231437, "driven_lanedir_consec": 0.061322155459707206, "sim_compute_sim_state": 0.02041925232985924, "sim_compute_performance-ego": 0.03632778134839288, "sim_compute_robot_state-ego": 0.03829697082782614, "sim_compute_robot_state-npc0": 0.03794494168511752, "sim_compute_robot_state-npc1": 0.040565326296049975, "sim_compute_robot_state-npc2": 0.03670378389029667, "sim_compute_robot_state-npc3": 0.03759348803553088}, "udem1-1-0": {"driven_any": 0.16541423175805248, "sim_physics": 0.019592490689507847, "survival_time": 1.4500000000000006, "driven_lanedir": 0.054194631929417536, "sim_render-ego": 0.03719227067355452, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09548007208725502, "deviation-heading": 0.5555303031506756, "set_robot_commands": 0.050115667540451575, "deviation-center-line": 0.02296796274949999, "driven_lanedir_consec": 0.054194631929417536, "sim_compute_sim_state": 0.021159073402141702, "sim_compute_performance-ego": 0.03623147668509648, "sim_compute_robot_state-ego": 0.03810801177189268, "sim_compute_robot_state-npc0": 0.03758273453548037, "sim_compute_robot_state-npc1": 0.036629668597517345, "sim_compute_robot_state-npc2": 0.03682845214317585, "sim_compute_robot_state-npc3": 0.03730828186561321}, "udem1-2-0": {"driven_any": 0.5089678419080116, "sim_physics": 0.020619797152142193, "survival_time": 4.299999999999993, "driven_lanedir": 0.1814935724987703, "sim_render-ego": 0.035448925439701524, "in-drivable-lane": 1.8999999999999977, "agent_compute-ego": 0.09318192060603651, "deviation-heading": 1.624846446358105, "set_robot_commands": 0.05069619555806005, "deviation-center-line": 0.06309944562387113, "driven_lanedir_consec": 0.1814935724987703, "sim_compute_sim_state": 0.020944966826328012, "sim_compute_performance-ego": 0.037194057952526005, "sim_compute_robot_state-ego": 0.0382242479989695, "sim_compute_robot_state-npc0": 0.038759957912356355, "sim_compute_robot_state-npc1": 0.037526003150052806, "sim_compute_robot_state-npc2": 0.03841598921043928, "sim_compute_robot_state-npc3": 0.03828931132028269}, "udem1-3-0": {"driven_any": 0.14793728273500953, "sim_physics": 0.01903111594063895, "survival_time": 1.4000000000000006, "driven_lanedir": 0.05316019322444565, "sim_render-ego": 0.03733496155057635, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09589494126183648, "deviation-heading": 0.5925601499045107, "set_robot_commands": 0.05114405495779855, "deviation-center-line": 0.02759984044858422, "driven_lanedir_consec": 0.05316019322444565, "sim_compute_sim_state": 0.020439743995666504, "sim_compute_performance-ego": 0.03663577352251325, "sim_compute_robot_state-ego": 0.037941387721470425, "sim_compute_robot_state-npc0": 0.03670712879725865, "sim_compute_robot_state-npc1": 0.03675229208809989, "sim_compute_robot_state-npc2": 0.03640735149383545, "sim_compute_robot_state-npc3": 0.036222645214625766}, "udem1-4-0": {"driven_any": 0.1561159470944568, "sim_physics": 0.016893362176829373, "survival_time": 1.4500000000000006, "driven_lanedir": 0.06092810812389593, "sim_render-ego": 0.03505529206374596, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.08902104147549333, "deviation-heading": 0.6240594563956893, "set_robot_commands": 0.04975252315915864, "deviation-center-line": 0.030975993960793216, "driven_lanedir_consec": 0.06092810812389593, "sim_compute_sim_state": 0.020475782197097253, "sim_compute_performance-ego": 0.03525030201879041, "sim_compute_robot_state-ego": 0.03658233017757021, "sim_compute_robot_state-npc0": 0.03625397024483516, "sim_compute_robot_state-npc1": 0.03641501788435311, "sim_compute_robot_state-npc2": 0.03593328081328293, "sim_compute_robot_state-npc3": 0.03769337719884412}}
set_robot_commands_max0.052248223074551285
set_robot_commands_mean0.050791332858004024
set_robot_commands_median0.05069619555806005
set_robot_commands_min0.04975252315915864
sim_compute_performance-ego_max0.037194057952526005
sim_compute_performance-ego_mean0.036327878305463815
sim_compute_performance-ego_median0.03632778134839288
sim_compute_performance-ego_min0.03525030201879041
sim_compute_robot_state-ego_max0.03829697082782614
sim_compute_robot_state-ego_mean0.037830589699545794
sim_compute_robot_state-ego_median0.03810801177189268
sim_compute_robot_state-ego_min0.03658233017757021
sim_compute_robot_state-npc0_max0.038759957912356355
sim_compute_robot_state-npc0_mean0.037449746635009606
sim_compute_robot_state-npc0_median0.03758273453548037
sim_compute_robot_state-npc0_min0.03625397024483516
sim_compute_robot_state-npc1_max0.040565326296049975
sim_compute_robot_state-npc1_mean0.03757766160321462
sim_compute_robot_state-npc1_median0.03675229208809989
sim_compute_robot_state-npc1_min0.03641501788435311
sim_compute_robot_state-npc2_max0.03841598921043928
sim_compute_robot_state-npc2_mean0.03685777151020604
sim_compute_robot_state-npc2_median0.03670378389029667
sim_compute_robot_state-npc2_min0.03593328081328293
sim_compute_robot_state-npc3_max0.03828931132028269
sim_compute_robot_state-npc3_mean0.03742142072697933
sim_compute_robot_state-npc3_median0.03759348803553088
sim_compute_robot_state-npc3_min0.036222645214625766
sim_compute_sim_state_max0.021159073402141702
sim_compute_sim_state_mean0.020687763750218545
sim_compute_sim_state_median0.020475782197097253
sim_compute_sim_state_min0.02041925232985924
sim_physics_max0.020619797152142193
sim_physics_mean0.018798830621443822
sim_physics_median0.01903111594063895
sim_physics_min0.016893362176829373
sim_render-ego_max0.03733496155057635
sim_render-ego_mean0.03616355978509844
sim_render-ego_median0.03578634919791386
sim_render-ego_min0.03505529206374596
simulation-passed1
survival_time_max4.299999999999993
survival_time_mean2.009999999999999
survival_time_min1.4000000000000006
188692424Andrea Censirandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessno7670:10:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.07642064018855019
agent_compute-ego_mean0.07410015222392867
agent_compute-ego_median0.07376965056074426
agent_compute-ego_min0.07161430212167594
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.020118921522110228, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03672835183522058, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.07642064018855019, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.05247226215544201, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.020597298940022785, "sim_compute_performance-ego": 0.03748396086314368, "sim_compute_robot_state-ego": 0.038360921163407585, "sim_compute_robot_state-npc0": 0.037902703360905725, "sim_compute_robot_state-npc1": 0.03768914843362475, "sim_compute_robot_state-npc2": 0.03696482900589231, "sim_compute_robot_state-npc3": 0.03724719229198638}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.018747750450583064, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0357665968876259, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.07530118904861749, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.054036308737362135, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.02044945604660932, "sim_compute_performance-ego": 0.03671340848885331, "sim_compute_robot_state-ego": 0.03905696027419146, "sim_compute_robot_state-npc0": 0.037486665389117074, "sim_compute_robot_state-npc1": 0.03719327496547325, "sim_compute_robot_state-npc2": 0.03793629478005802, "sim_compute_robot_state-npc3": 0.037454960392970665}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.020453387691128637, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.03698648175885601, "in-drivable-lane": 0, "agent_compute-ego": 0.07339497920005553, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.051473602171867125, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.02102356187758907, "sim_compute_performance-ego": 0.03678620246148879, "sim_compute_robot_state-ego": 0.03853484507529966, "sim_compute_robot_state-npc0": 0.03739913817374937, "sim_compute_robot_state-npc1": 0.03743911943128032, "sim_compute_robot_state-npc2": 0.03696821966478901, "sim_compute_robot_state-npc3": 0.037113028187905586}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.020215978013708235, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03687588712002369, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.07376965056074426, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.05184774195894282, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02141074677731129, "sim_compute_performance-ego": 0.03689016179835543, "sim_compute_robot_state-ego": 0.03809747797377566, "sim_compute_robot_state-npc0": 0.03840699094407102, "sim_compute_robot_state-npc1": 0.03701673416381187, "sim_compute_robot_state-npc2": 0.03742070654605297, "sim_compute_robot_state-npc3": 0.03738275741009002}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.017816561918992262, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.035238793263068564, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.07161430212167594, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05146072461054875, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02061119904884925, "sim_compute_performance-ego": 0.03716789759122408, "sim_compute_robot_state-ego": 0.04019435093953059, "sim_compute_robot_state-npc0": 0.037153234848609336, "sim_compute_robot_state-npc1": 0.036724429864149824, "sim_compute_robot_state-npc2": 0.036514075902792126, "sim_compute_robot_state-npc3": 0.03677710203024057}}
set_robot_commands_max0.054036308737362135
set_robot_commands_mean0.05225812792683256
set_robot_commands_median0.05184774195894282
set_robot_commands_min0.05146072461054875
sim_compute_performance-ego_max0.03748396086314368
sim_compute_performance-ego_mean0.03700832624061305
sim_compute_performance-ego_median0.03689016179835543
sim_compute_performance-ego_min0.03671340848885331
sim_compute_robot_state-ego_max0.04019435093953059
sim_compute_robot_state-ego_mean0.03884891108524099
sim_compute_robot_state-ego_median0.03853484507529966
sim_compute_robot_state-ego_min0.03809747797377566
sim_compute_robot_state-npc0_max0.03840699094407102
sim_compute_robot_state-npc0_mean0.03766974654329051
sim_compute_robot_state-npc0_median0.037486665389117074
sim_compute_robot_state-npc0_min0.037153234848609336
sim_compute_robot_state-npc1_max0.03768914843362475
sim_compute_robot_state-npc1_mean0.037212541371668
sim_compute_robot_state-npc1_median0.03719327496547325
sim_compute_robot_state-npc1_min0.036724429864149824
sim_compute_robot_state-npc2_max0.03793629478005802
sim_compute_robot_state-npc2_mean0.03716082517991689
sim_compute_robot_state-npc2_median0.03696821966478901
sim_compute_robot_state-npc2_min0.036514075902792126
sim_compute_robot_state-npc3_max0.037454960392970665
sim_compute_robot_state-npc3_mean0.03719500806263864
sim_compute_robot_state-npc3_median0.03724719229198638
sim_compute_robot_state-npc3_min0.03677710203024057
sim_compute_sim_state_max0.02141074677731129
sim_compute_sim_state_mean0.02081845253807634
sim_compute_sim_state_median0.02061119904884925
sim_compute_sim_state_min0.02044945604660932
sim_physics_max0.020453387691128637
sim_physics_mean0.019470519919304485
sim_physics_median0.020118921522110228
sim_physics_min0.017816561918992262
sim_render-ego_max0.03698648175885601
sim_render-ego_mean0.03631922217295895
sim_render-ego_median0.03672835183522058
sim_render-ego_min0.035238793263068564
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
188612437Andrea Censirandom_agentaido2-LFVI-sim-validationstep1-simulationerrorno7670:02:09
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
188582440Jacopo Tanirandom_agentaido2-LF-sim-validationstep1-simulationsuccessno7670:05:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.09434343468059192
agent_compute-ego_mean0.087806218084584
agent_compute-ego_median0.08623242828081239
agent_compute-ego_min0.0838811572860269
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010476625190590913, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03624717244562113, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08623242828081239, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.05174827575683594, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.020832291189229715, "sim_compute_performance-ego": 0.03778077071567751, "sim_compute_robot_state-ego": 0.039909317808331186}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01140605861490423, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0391627387567, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.09434343468059192, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.0534588098526001, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.026230806654149837, "sim_compute_performance-ego": 0.04117856784300371, "sim_compute_robot_state-ego": 0.04283022880554199}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.010488663779364691, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.03543947537740071, "in-drivable-lane": 0, "agent_compute-ego": 0.08593063354492188, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.050969632466634114, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02249028417799208, "sim_compute_performance-ego": 0.03741103278266059, "sim_compute_robot_state-ego": 0.039588552051120336}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.010944525400797524, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03734348217646281, "in-drivable-lane": 0, "agent_compute-ego": 0.08864343663056691, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.05423585077126821, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.023032074173291523, "sim_compute_performance-ego": 0.03927519420782725, "sim_compute_robot_state-ego": 0.03998995820681254}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.011057475033928366, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.03525807577020982, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0838811572860269, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05277440828435561, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.021640402429244095, "sim_compute_performance-ego": 0.03743113139096428, "sim_compute_robot_state-ego": 0.03823156917796416}}
set_robot_commands_max0.05423585077126821
set_robot_commands_mean0.052637395426338794
set_robot_commands_median0.05277440828435561
set_robot_commands_min0.050969632466634114
sim_compute_performance-ego_max0.04117856784300371
sim_compute_performance-ego_mean0.03861533938802667
sim_compute_performance-ego_median0.03778077071567751
sim_compute_performance-ego_min0.03741103278266059
sim_compute_robot_state-ego_max0.04283022880554199
sim_compute_robot_state-ego_mean0.04010992520995404
sim_compute_robot_state-ego_median0.039909317808331186
sim_compute_robot_state-ego_min0.03823156917796416
sim_compute_sim_state_max0.026230806654149837
sim_compute_sim_state_mean0.022845171724781448
sim_compute_sim_state_median0.02249028417799208
sim_compute_sim_state_min0.020832291189229715
sim_physics_max0.01140605861490423
sim_physics_mean0.010874669603917144
sim_physics_median0.010944525400797524
sim_physics_min0.010476625190590913
sim_render-ego_max0.0391627387567
sim_render-ego_mean0.03669018890527889
sim_render-ego_median0.03624717244562113
sim_render-ego_min0.03525807577020982
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
188532444Jacopo Tanirandom_agentaido2-LFVI-sim-validationstep1-simulationsuccessno7670:10:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.09332517935679507
agent_compute-ego_mean0.08768605852613418
agent_compute-ego_median0.08638361856049183
agent_compute-ego_min0.08471206695802751
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.02041324736580016, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03728787104288737, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.08813226033770849, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.05461582304939391, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.021936522589789495, "sim_compute_performance-ego": 0.03786597176203652, "sim_compute_robot_state-ego": 0.039135119271656825, "sim_compute_robot_state-npc0": 0.03998258757212805, "sim_compute_robot_state-npc1": 0.06425535489642431, "sim_compute_robot_state-npc2": 0.03873787607465472, "sim_compute_robot_state-npc3": 0.03926939812917558}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.01885600651011747, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.036599224688960055, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.08638361856049183, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.05234156870374493, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.021137073928234624, "sim_compute_performance-ego": 0.03751258289112764, "sim_compute_robot_state-ego": 0.04093650275585698, "sim_compute_robot_state-npc0": 0.038003089381199257, "sim_compute_robot_state-npc1": 0.037781318028767906, "sim_compute_robot_state-npc2": 0.03828320783727309, "sim_compute_robot_state-npc3": 0.03912554535211301}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.020398605254388625, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.03585189388644311, "in-drivable-lane": 0, "agent_compute-ego": 0.08471206695802751, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.05157653362520279, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.020805001258850098, "sim_compute_performance-ego": 0.036049000678523895, "sim_compute_robot_state-ego": 0.038526696543539726, "sim_compute_robot_state-npc0": 0.03680392619102232, "sim_compute_robot_state-npc1": 0.03707622712658298, "sim_compute_robot_state-npc2": 0.03652258842222152, "sim_compute_robot_state-npc3": 0.03738224121832078}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.020526530894827335, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.038027834384999376, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08587716741764799, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.052878034875748006, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02141706486965748, "sim_compute_performance-ego": 0.0374112864758106, "sim_compute_robot_state-ego": 0.03884070223950325, "sim_compute_robot_state-npc0": 0.038315841492186205, "sim_compute_robot_state-npc1": 0.03795748568595724, "sim_compute_robot_state-npc2": 0.03755057872609889, "sim_compute_robot_state-npc3": 0.03854513168334961}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.01882858001268827, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.03881409076543955, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.09332517935679507, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05279438770734347, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.021692963746877816, "sim_compute_performance-ego": 0.04066850130374615, "sim_compute_robot_state-ego": 0.042363134714273304, "sim_compute_robot_state-npc0": 0.043288854452279896, "sim_compute_robot_state-npc1": 0.040302822223076455, "sim_compute_robot_state-npc2": 0.03966762010867779, "sim_compute_robot_state-npc3": 0.03944506553503183}}
set_robot_commands_max0.05461582304939391
set_robot_commands_mean0.05284126959228662
set_robot_commands_median0.05279438770734347
set_robot_commands_min0.05157653362520279
sim_compute_performance-ego_max0.04066850130374615
sim_compute_performance-ego_mean0.037901468622248954
sim_compute_performance-ego_median0.03751258289112764
sim_compute_performance-ego_min0.036049000678523895
sim_compute_robot_state-ego_max0.042363134714273304
sim_compute_robot_state-ego_mean0.03996043110496601
sim_compute_robot_state-ego_median0.039135119271656825
sim_compute_robot_state-ego_min0.038526696543539726
sim_compute_robot_state-npc0_max0.043288854452279896
sim_compute_robot_state-npc0_mean0.03927885981776315
sim_compute_robot_state-npc0_median0.038315841492186205
sim_compute_robot_state-npc0_min0.03680392619102232
sim_compute_robot_state-npc1_max0.06425535489642431
sim_compute_robot_state-npc1_mean0.043474641592161786
sim_compute_robot_state-npc1_median0.03795748568595724
sim_compute_robot_state-npc1_min0.03707622712658298
sim_compute_robot_state-npc2_max0.03966762010867779
sim_compute_robot_state-npc2_mean0.0381523742337852
sim_compute_robot_state-npc2_median0.03828320783727309
sim_compute_robot_state-npc2_min0.03652258842222152
sim_compute_robot_state-npc3_max0.03944506553503183
sim_compute_robot_state-npc3_mean0.03875347638359816
sim_compute_robot_state-npc3_median0.03912554535211301
sim_compute_robot_state-npc3_min0.03738224121832078
sim_compute_sim_state_max0.021936522589789495
sim_compute_sim_state_mean0.0213977252786819
sim_compute_sim_state_median0.02141706486965748
sim_compute_sim_state_min0.020805001258850098
sim_physics_max0.020526530894827335
sim_physics_mean0.019804594007564374
sim_physics_median0.020398605254388625
sim_physics_min0.01882858001268827
sim_render-ego_max0.03881409076543955
sim_render-ego_mean0.03731618295374589
sim_render-ego_median0.03728787104288737
sim_render-ego_min0.03585189388644311
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
188332476Liam Paullchallenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessno7670:10:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.08777262155826275
agent_compute-ego_mean0.08399169996561415
agent_compute-ego_median0.08492079903097714
agent_compute-ego_min0.07841839487590486
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.01812763062734453, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03302235073513455, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.07841839487590486, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.04784662761385479, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.019059014698815723, "sim_compute_performance-ego": 0.03355685491410513, "sim_compute_robot_state-ego": 0.035194646744501026, "sim_compute_robot_state-npc0": 0.03450962853810144, "sim_compute_robot_state-npc1": 0.034272409620739165, "sim_compute_robot_state-npc2": 0.03410719689868745, "sim_compute_robot_state-npc3": 0.034259516095358225}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.018849779577816233, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.03592698246824975, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.08492079903097714, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.051616210563510075, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.02120043717178644, "sim_compute_performance-ego": 0.03688177875444001, "sim_compute_robot_state-ego": 0.039727580313589056, "sim_compute_robot_state-npc0": 0.03886940432529824, "sim_compute_robot_state-npc1": 0.03810362254872041, "sim_compute_robot_state-npc2": 0.03751382173276415, "sim_compute_robot_state-npc3": 0.037561313778746365}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.01998727936898508, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.036498250499848395, "in-drivable-lane": 0, "agent_compute-ego": 0.08557568057890862, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.052201009565784086, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.021219661158900106, "sim_compute_performance-ego": 0.03691581756837906, "sim_compute_robot_state-ego": 0.03920560498391428, "sim_compute_robot_state-npc0": 0.039055528179291754, "sim_compute_robot_state-npc1": 0.03829515749408353, "sim_compute_robot_state-npc2": 0.0377390653856339, "sim_compute_robot_state-npc3": 0.03816231604545347}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.019655904871352176, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03686620326752358, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08327100378401736, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.05115500155915605, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02114657645529889, "sim_compute_performance-ego": 0.03643621536011391, "sim_compute_robot_state-ego": 0.03839274162941791, "sim_compute_robot_state-npc0": 0.03823674486038533, "sim_compute_robot_state-npc1": 0.03743646499958444, "sim_compute_robot_state-npc2": 0.03723434438096716, "sim_compute_robot_state-npc3": 0.03731003974346405}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.01815134286880493, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.03621326501552875, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08777262155826275, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05294002019442045, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.021429291138282187, "sim_compute_performance-ego": 0.03846594920525184, "sim_compute_robot_state-ego": 0.03962994538820707, "sim_compute_robot_state-npc0": 0.04098889460930458, "sim_compute_robot_state-npc1": 0.03861189347047072, "sim_compute_robot_state-npc2": 0.03842032872713529, "sim_compute_robot_state-npc3": 0.03895476231208214}}
set_robot_commands_max0.05294002019442045
set_robot_commands_mean0.05115177389934509
set_robot_commands_median0.051616210563510075
set_robot_commands_min0.04784662761385479
sim_compute_performance-ego_max0.03846594920525184
sim_compute_performance-ego_mean0.03645132316045799
sim_compute_performance-ego_median0.03688177875444001
sim_compute_performance-ego_min0.03355685491410513
sim_compute_robot_state-ego_max0.039727580313589056
sim_compute_robot_state-ego_mean0.03843010381192587
sim_compute_robot_state-ego_median0.03920560498391428
sim_compute_robot_state-ego_min0.035194646744501026
sim_compute_robot_state-npc0_max0.04098889460930458
sim_compute_robot_state-npc0_mean0.03833204010247627
sim_compute_robot_state-npc0_median0.03886940432529824
sim_compute_robot_state-npc0_min0.03450962853810144
sim_compute_robot_state-npc1_max0.03861189347047072
sim_compute_robot_state-npc1_mean0.03734390962671966
sim_compute_robot_state-npc1_median0.03810362254872041
sim_compute_robot_state-npc1_min0.034272409620739165
sim_compute_robot_state-npc2_max0.03842032872713529
sim_compute_robot_state-npc2_mean0.03700295142503759
sim_compute_robot_state-npc2_median0.03751382173276415
sim_compute_robot_state-npc2_min0.03410719689868745
sim_compute_robot_state-npc3_max0.03895476231208214
sim_compute_robot_state-npc3_mean0.03724958959502085
sim_compute_robot_state-npc3_median0.037561313778746365
sim_compute_robot_state-npc3_min0.034259516095358225
sim_compute_sim_state_max0.021429291138282187
sim_compute_sim_state_mean0.020810996124616662
sim_compute_sim_state_median0.02120043717178644
sim_compute_sim_state_min0.019059014698815723
sim_physics_max0.01998727936898508
sim_physics_mean0.01895438746286059
sim_physics_median0.018849779577816233
sim_physics_min0.01812763062734453
sim_render-ego_max0.03686620326752358
sim_render-ego_mean0.03570541039725701
sim_render-ego_median0.03621326501552875
sim_render-ego_min0.03302235073513455
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
188292480Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrorno7670:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
188262487Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno7670:01:09
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
187892541jp18813100494test for ppoaido2-LF-sim-testingstep1-simulationerrorno7670:08:54
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.