AI Driving Olympics Home Challenges Submissions Jobs

Submission 2884

Submission2884
Competingyes
Challengeaido2-LFVI-sim-testing
UserAndrea Daniele
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22722
Next
User labelminimal_agent (Python 3)
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
227222884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationerroryes-1:00:45
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217782884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:47:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.637258234942822
survival_time_median7.199999999999982
deviation-center-line_median0.41059891008830585
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.16968288350461133
agent_compute-ego_mean0.16515382256209218
agent_compute-ego_median0.16511767100443883
agent_compute-ego_min0.16015940030415854
deviation-center-line_max0.9349599376168654
deviation-center-line_mean0.4387555178222911
deviation-center-line_min0.17941317297639486
deviation-heading_max4.374417856296392
deviation-heading_mean1.5940974384060418
deviation-heading_median1.0234199155419084
deviation-heading_min0.4336566898932428
driven_any_max2.1860208965398997
driven_any_mean1.068337512713888
driven_any_median1.0253513500538094
driven_any_min0.3424596765232271
driven_lanedir_consec_max1.8538963171887557
driven_lanedir_consec_mean0.6976649549765142
driven_lanedir_consec_min0.3024072802283877
driven_lanedir_max1.8539439248016505
driven_lanedir_mean0.7124823821349586
driven_lanedir_median0.637258234942822
driven_lanedir_min0.3024072802283877
in-drivable-lane_max7.600000000000008
in-drivable-lane_mean1.933333333333337
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.12693730603277156, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.07194848081706899, "in-drivable-lane": 0, "agent_compute-ego": 0.16511767100443883, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.08229935591199757, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.04299464162472075, "sim_compute_performance-ego": 0.0726201027895497, "sim_compute_robot_state-ego": 0.06942181038645516, "sim_compute_robot_state-npc0": 0.08088208510812404, "sim_compute_robot_state-npc1": 0.07698364911881168, "sim_compute_robot_state-npc2": 0.07630635995780473, "sim_compute_robot_state-npc3": 0.0754741936658336}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.12634963128301832, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.07371504439247979, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.16520211431715223, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.08206385705206129, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.043125886056158275, "sim_compute_performance-ego": 0.07237605419423845, "sim_compute_robot_state-ego": 0.06885110835234325, "sim_compute_robot_state-npc0": 0.08028948472605811, "sim_compute_robot_state-npc1": 0.07740163140826756, "sim_compute_robot_state-npc2": 0.07819574077924092, "sim_compute_robot_state-npc3": 0.07673289212915632}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.11642061296056529, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.07122182748356803, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.16430581495410107, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.08149723928482806, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.04373522762392388, "sim_compute_performance-ego": 0.07205944178534336, "sim_compute_robot_state-ego": 0.06325482442730763, "sim_compute_robot_state-npc0": 0.07889920473098755, "sim_compute_robot_state-npc1": 0.07795669309428481, "sim_compute_robot_state-npc2": 0.07657299373970657, "sim_compute_robot_state-npc3": 0.07683626257005285}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.1176477567354838, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.07189079205195109, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.16583154360453287, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.08121085325876871, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.0448590890566508, "sim_compute_performance-ego": 0.07143751541773478, "sim_compute_robot_state-ego": 0.0635452938079834, "sim_compute_robot_state-npc0": 0.0805606746673584, "sim_compute_robot_state-npc1": 0.07911055088043213, "sim_compute_robot_state-npc2": 0.07810980478922526, "sim_compute_robot_state-npc3": 0.07741122007369995}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.12156297542430736, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.07172803084055583, "in-drivable-lane": 0, "agent_compute-ego": 0.16442743054142706, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.08149630493587917, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.04444798716792354, "sim_compute_performance-ego": 0.07876836812054669, "sim_compute_robot_state-ego": 0.06535808245340984, "sim_compute_robot_state-npc0": 0.08142019642723931, "sim_compute_robot_state-npc1": 0.08159630828433567, "sim_compute_robot_state-npc2": 0.07810671682711001, "sim_compute_robot_state-npc3": 0.07595230473412408}, "udem1-5-0": {"driven_any": 1.1302403061470987, "sim_physics": 0.1161557215793877, "survival_time": 7.84999999999998, "driven_lanedir": 0.39314661474467094, "sim_render-ego": 0.06688882742717767, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.16141757995459685, "deviation-heading": 2.4308255969868253, "set_robot_commands": 0.08043220999893869, "deviation-center-line": 0.38861383599610416, "driven_lanedir_consec": 0.39314661474467094, "sim_compute_sim_state": 0.04140991314201598, "sim_compute_performance-ego": 0.06904004637602788, "sim_compute_robot_state-ego": 0.06395105039997465, "sim_compute_robot_state-npc0": 0.07822125276942161, "sim_compute_robot_state-npc1": 0.07494588262715916, "sim_compute_robot_state-npc2": 0.07404952444088687, "sim_compute_robot_state-npc3": 0.0725569163158441}, "udem1-6-0": {"driven_any": 0.5061578530870738, "sim_physics": 0.13568668365478517, "survival_time": 3.7499999999999942, "driven_lanedir": 0.500515270834164, "sim_render-ego": 0.07015716234842936, "in-drivable-lane": 0, "agent_compute-ego": 0.16015940030415854, "deviation-heading": 0.5159300208401423, "set_robot_commands": 0.08317319869995117, "deviation-center-line": 0.32277039791323286, "driven_lanedir_consec": 0.500515270834164, "sim_compute_sim_state": 0.04248271624247233, "sim_compute_performance-ego": 0.06920099894205729, "sim_compute_robot_state-ego": 0.06408433596293131, "sim_compute_robot_state-npc0": 0.07646729787190755, "sim_compute_robot_state-npc1": 0.07368386268615723, "sim_compute_robot_state-npc2": 0.07489459673563639, "sim_compute_robot_state-npc3": 0.07417364438374838}, "udem1-7-0": {"driven_any": 1.0295382151776031, "sim_physics": 0.12642829948001438, "survival_time": 7.199999999999982, "driven_lanedir": 0.9359161916925074, "sim_render-ego": 0.0706126954820421, "in-drivable-lane": 0, "agent_compute-ego": 0.1613155702749888, "deviation-heading": 2.4651914972100637, "set_robot_commands": 0.08013084861967298, "deviation-center-line": 0.5408967871824802, "driven_lanedir_consec": 0.9268938600486144, "sim_compute_sim_state": 0.04186895489692688, "sim_compute_performance-ego": 0.06939515968163808, "sim_compute_robot_state-ego": 0.06474913656711578, "sim_compute_robot_state-npc0": 0.07867191235224406, "sim_compute_robot_state-npc1": 0.07569295499059889, "sim_compute_robot_state-npc2": 0.07500766879982418, "sim_compute_robot_state-npc3": 0.07444155050648583}, "udem1-8-0": {"driven_any": 1.0117814342566946, "sim_physics": 0.12143264425561782, "survival_time": 7.049999999999983, "driven_lanedir": 0.6909705366951359, "sim_render-ego": 0.07410987894585792, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.16677821443435994, "deviation-heading": 2.329921518550053, "set_robot_commands": 0.08196027904537552, "deviation-center-line": 0.5441337791691367, "driven_lanedir_consec": 0.6909705366951359, "sim_compute_sim_state": 0.045780467648878165, "sim_compute_performance-ego": 0.07517048484044718, "sim_compute_robot_state-ego": 0.0666153887484936, "sim_compute_robot_state-npc0": 0.08178100856483406, "sim_compute_robot_state-npc1": 0.08151958005648133, "sim_compute_robot_state-npc2": 0.07969995593348293, "sim_compute_robot_state-npc3": 0.07925312400709653}, "udem1-9-0": {"driven_any": 1.0121721984179504, "sim_physics": 0.13395842638882724, "survival_time": 7.149999999999983, "driven_lanedir": 0.6896653033503108, "sim_render-ego": 0.07338870822132884, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.16823527529523088, "deviation-heading": 1.7559109248467348, "set_robot_commands": 0.08297684309365866, "deviation-center-line": 0.4657042775355992, "driven_lanedir_consec": 0.6525088666893104, "sim_compute_sim_state": 0.04448310645310195, "sim_compute_performance-ego": 0.07414947356377448, "sim_compute_robot_state-ego": 0.0644817335622294, "sim_compute_robot_state-npc0": 0.08099480608960132, "sim_compute_robot_state-npc1": 0.07990801084291685, "sim_compute_robot_state-npc2": 0.07856401030000273, "sim_compute_robot_state-npc3": 0.07795605959592165}, "udem1-10-0": {"driven_any": 0.3424596765232271, "sim_physics": 0.11975897275484523, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3212520101257572, "sim_render-ego": 0.07493182329031137, "in-drivable-lane": 0, "agent_compute-ego": 0.16508545783849862, "deviation-heading": 0.9083914070419382, "set_robot_commands": 0.08079333488757794, "deviation-center-line": 0.17941317297639486, "driven_lanedir_consec": 0.3212520101257572, "sim_compute_sim_state": 0.04551999844037569, "sim_compute_performance-ego": 0.07391698543842022, "sim_compute_robot_state-ego": 0.0637474197607774, "sim_compute_robot_state-npc0": 0.08034143998072697, "sim_compute_robot_state-npc1": 0.07914452827893771, "sim_compute_robot_state-npc2": 0.07711303234100342, "sim_compute_robot_state-npc3": 0.07803173707081722}, "udem1-11-0": {"driven_any": 0.45910689128684445, "sim_physics": 0.11662325574390923, "survival_time": 3.349999999999996, "driven_lanedir": 0.4553365542784813, "sim_render-ego": 0.0743883937152464, "in-drivable-lane": 0, "agent_compute-ego": 0.16968288350461133, "deviation-heading": 0.4336566898932428, "set_robot_commands": 0.08270171151232364, "deviation-center-line": 0.3396621974449056, "driven_lanedir_consec": 0.4553365542784813, "sim_compute_sim_state": 0.046085350549043114, "sim_compute_performance-ego": 0.07377424880639831, "sim_compute_robot_state-ego": 0.06339181359134503, "sim_compute_robot_state-npc0": 0.08183578234999928, "sim_compute_robot_state-npc1": 0.08037514828923922, "sim_compute_robot_state-npc2": 0.07903472701115395, "sim_compute_robot_state-npc3": 0.08080662186466046}, "udem1-12-0": {"driven_any": 1.447644041392146, "sim_physics": 0.11965771931320872, "survival_time": 10.050000000000008, "driven_lanedir": 0.3024072802283877, "sim_render-ego": 0.06928021397756699, "in-drivable-lane": 7.600000000000008, "agent_compute-ego": 0.1651047106405989, "deviation-heading": 0.5639614932962997, "set_robot_commands": 0.08067129026004924, "deviation-center-line": 0.287042893102722, "driven_lanedir_consec": 0.3024072802283877, "sim_compute_sim_state": 0.0427414184779077, "sim_compute_performance-ego": 0.06902055835249413, "sim_compute_robot_state-ego": 0.061557513564380245, "sim_compute_robot_state-npc0": 0.07694179976164404, "sim_compute_robot_state-npc1": 0.07495050762423236, "sim_compute_robot_state-npc2": 0.07535890678861248, "sim_compute_robot_state-npc3": 0.07508514176553754}, "udem1-13-0": {"driven_any": 1.0071223990792053, "sim_physics": 0.11647128051435444, "survival_time": 7.099999999999983, "driven_lanedir": 0.6504510750495411, "sim_render-ego": 0.07337422941772032, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.1665178117617755, "deviation-heading": 1.767427394796984, "set_robot_commands": 0.08132591885580144, "deviation-center-line": 0.44358814435396954, "driven_lanedir_consec": 0.6504510750495411, "sim_compute_sim_state": 0.04556733453777474, "sim_compute_performance-ego": 0.07409664778642251, "sim_compute_robot_state-ego": 0.06306054054851264, "sim_compute_robot_state-npc0": 0.0808744447332033, "sim_compute_robot_state-npc1": 0.07908081672561, "sim_compute_robot_state-npc2": 0.07869398929703404, "sim_compute_robot_state-npc3": 0.0779935423756989}, "udem1-14-0": {"driven_any": 1.0832727219252307, "sim_physics": 0.1339908728474065, "survival_time": 7.599999999999981, "driven_lanedir": 0.5461047072099379, "sim_render-ego": 0.07400076012862356, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1681258600009115, "deviation-heading": 4.374417856296392, "set_robot_commands": 0.08364066167881615, "deviation-center-line": 0.4695309103813122, "driven_lanedir_consec": 0.3703185844575955, "sim_compute_sim_state": 0.0464606269409782, "sim_compute_performance-ego": 0.07284409592026159, "sim_compute_robot_state-ego": 0.0647885705295362, "sim_compute_robot_state-npc0": 0.08087192397368581, "sim_compute_robot_state-npc1": 0.08053107481253774, "sim_compute_robot_state-npc2": 0.08074732987504256, "sim_compute_robot_state-npc3": 0.07998159684632954}}
set_robot_commands_max0.08364066167881615
set_robot_commands_mean0.08175826047304667
set_robot_commands_median0.08149723928482806
set_robot_commands_min0.08013084861967298
sim_compute_performance-ego_max0.07876836812054669
sim_compute_performance-ego_mean0.07252467880102363
sim_compute_performance-ego_median0.0726201027895497
sim_compute_performance-ego_min0.06902055835249413
sim_compute_robot_state-ego_max0.06942181038645516
sim_compute_robot_state-ego_mean0.0647239081775197
sim_compute_robot_state-ego_median0.06408433596293131
sim_compute_robot_state-ego_min0.061557513564380245
sim_compute_robot_state-npc0_max0.08183578234999928
sim_compute_robot_state-npc0_mean0.07993688760713567
sim_compute_robot_state-npc0_median0.0805606746673584
sim_compute_robot_state-npc0_min0.07646729787190755
sim_compute_robot_state-npc1_max0.08159630828433567
sim_compute_robot_state-npc1_mean0.07819207998133347
sim_compute_robot_state-npc1_median0.07908081672561
sim_compute_robot_state-npc1_min0.07368386268615723
sim_compute_robot_state-npc2_max0.08074732987504256
sim_compute_robot_state-npc2_mean0.0773636905077178
sim_compute_robot_state-npc2_median0.07810671682711001
sim_compute_robot_state-npc2_min0.07404952444088687
sim_compute_robot_state-npc3_max0.08080662186466046
sim_compute_robot_state-npc3_mean0.07684578719366715
sim_compute_robot_state-npc3_median0.07683626257005285
sim_compute_robot_state-npc3_min0.0725569163158441
sim_compute_sim_state_max0.0464606269409782
sim_compute_sim_state_mean0.0441041812572568
sim_compute_sim_state_median0.04444798716792354
sim_compute_sim_state_min0.04140991314201598
sim_physics_max0.13568668365478517
sim_physics_mean0.1232721439312335
sim_physics_median0.12143264425561782
sim_physics_min0.1161557215793877
sim_render-ego_max0.07493182329031137
sim_render-ego_mean0.07210912456932857
sim_render-ego_median0.07194848081706899
sim_render-ego_min0.06688882742717767
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.47
survival_time_min2.5999999999999988
217552884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5317-job21755/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217352884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:31:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5197-job21735/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216832884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:14
I can see how the jo [...]
I can see how the job 21683 is timeout because passed 3914 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216642884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:28:52
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 484, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5197-job21664/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213412884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:55:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.637258234942822
survival_time_median7.199999999999982
deviation-center-line_median0.41059891008830585
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.1516653103614921
agent_compute-ego_mean0.14370199066870615
agent_compute-ego_median0.14686969032994024
agent_compute-ego_min0.10960798663692876
deviation-center-line_max0.9349599376168654
deviation-center-line_mean0.4387555178222911
deviation-center-line_min0.17941317297639486
deviation-heading_max4.374417856296392
deviation-heading_mean1.5940974384060418
deviation-heading_median1.0234199155419084
deviation-heading_min0.4336566898932428
driven_any_max2.1860208965398997
driven_any_mean1.068337512713888
driven_any_median1.0253513500538094
driven_any_min0.3424596765232271
driven_lanedir_consec_max1.8538963171887557
driven_lanedir_consec_mean0.6976649549765142
driven_lanedir_consec_min0.3024072802283877
driven_lanedir_max1.8539439248016505
driven_lanedir_mean0.7124823821349586
driven_lanedir_median0.637258234942822
driven_lanedir_min0.3024072802283877
in-drivable-lane_max7.600000000000008
in-drivable-lane_mean1.933333333333337
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.17796313973654687, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.058869485306528815, "in-drivable-lane": 0, "agent_compute-ego": 0.1448918886944256, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.0885524760305354, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.0372228664634502, "sim_compute_performance-ego": 0.06567928010383539, "sim_compute_robot_state-ego": 0.06925658420123885, "sim_compute_robot_state-npc0": 0.06676784975338826, "sim_compute_robot_state-npc1": 0.06500833751881017, "sim_compute_robot_state-npc2": 0.06554978611194982, "sim_compute_robot_state-npc3": 0.06588010766864878}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.19867607288890415, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.06330155332883199, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14764545857906342, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.09440684484110938, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.03881170517868466, "sim_compute_performance-ego": 0.06841495136419933, "sim_compute_robot_state-ego": 0.07423700392246246, "sim_compute_robot_state-npc0": 0.06986112892627716, "sim_compute_robot_state-npc1": 0.06890180210272472, "sim_compute_robot_state-npc2": 0.06900571452246772, "sim_compute_robot_state-npc3": 0.06852361891004774}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.1931453923710057, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.06192477707002984, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.14816732875636365, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.09301933792770886, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.03913404316198631, "sim_compute_performance-ego": 0.06783002908112573, "sim_compute_robot_state-ego": 0.07289731404820426, "sim_compute_robot_state-npc0": 0.0690416654602426, "sim_compute_robot_state-npc1": 0.06977116573052328, "sim_compute_robot_state-npc2": 0.0697627311847249, "sim_compute_robot_state-npc3": 0.06902957744285708}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.19069501241048176, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.06171159505844116, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.1470088283220927, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.09147494157155354, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.03832197268803914, "sim_compute_performance-ego": 0.06633276859919231, "sim_compute_robot_state-ego": 0.07012192169825236, "sim_compute_robot_state-npc0": 0.06825666268666586, "sim_compute_robot_state-npc1": 0.06626783847808838, "sim_compute_robot_state-npc2": 0.06478115876515707, "sim_compute_robot_state-npc3": 0.06519928216934204}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.1972368469944707, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.06571556903697827, "in-drivable-lane": 0, "agent_compute-ego": 0.14686969032994024, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.09257254777131256, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.040650517852218064, "sim_compute_performance-ego": 0.0666630886219166, "sim_compute_robot_state-ego": 0.07200865833847611, "sim_compute_robot_state-npc0": 0.06952027921323423, "sim_compute_robot_state-npc1": 0.07041616793032046, "sim_compute_robot_state-npc2": 0.06954191349170825, "sim_compute_robot_state-npc3": 0.06846422177773935}, "udem1-5-0": {"driven_any": 1.1302403061470987, "sim_physics": 0.17993524575689038, "survival_time": 7.84999999999998, "driven_lanedir": 0.39314661474467094, "sim_render-ego": 0.06546495826381027, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.14942900845958929, "deviation-heading": 2.4308255969868253, "set_robot_commands": 0.0893893378555395, "deviation-center-line": 0.38861383599610416, "driven_lanedir_consec": 0.39314661474467094, "sim_compute_sim_state": 0.0391095945030261, "sim_compute_performance-ego": 0.06727069958000426, "sim_compute_robot_state-ego": 0.07104134711490315, "sim_compute_robot_state-npc0": 0.06531319800455859, "sim_compute_robot_state-npc1": 0.06839748704509371, "sim_compute_robot_state-npc2": 0.06646541121659005, "sim_compute_robot_state-npc3": 0.06679220564046483}, "udem1-6-0": {"driven_any": 0.5061578530870738, "sim_physics": 0.21831342379252117, "survival_time": 3.7499999999999942, "driven_lanedir": 0.500515270834164, "sim_render-ego": 0.06228947003682454, "in-drivable-lane": 0, "agent_compute-ego": 0.14836861610412597, "deviation-heading": 0.5159300208401423, "set_robot_commands": 0.0904753875732422, "deviation-center-line": 0.32277039791323286, "driven_lanedir_consec": 0.500515270834164, "sim_compute_sim_state": 0.03762097358703613, "sim_compute_performance-ego": 0.06881686210632325, "sim_compute_robot_state-ego": 0.07210201899210612, "sim_compute_robot_state-npc0": 0.06569125811258952, "sim_compute_robot_state-npc1": 0.0658716869354248, "sim_compute_robot_state-npc2": 0.06386165301005045, "sim_compute_robot_state-npc3": 0.06603817939758301}, "udem1-7-0": {"driven_any": 1.0295382151776031, "sim_physics": 0.2055157605144713, "survival_time": 7.199999999999982, "driven_lanedir": 0.9359161916925074, "sim_render-ego": 0.06252410345607334, "in-drivable-lane": 0, "agent_compute-ego": 0.15040967696242863, "deviation-heading": 2.4651914972100637, "set_robot_commands": 0.08993937902980381, "deviation-center-line": 0.5408967871824802, "driven_lanedir_consec": 0.9268938600486144, "sim_compute_sim_state": 0.03966323203510709, "sim_compute_performance-ego": 0.06912701328595479, "sim_compute_robot_state-ego": 0.07130391730202569, "sim_compute_robot_state-npc0": 0.06708970334794787, "sim_compute_robot_state-npc1": 0.06846603751182556, "sim_compute_robot_state-npc2": 0.06836433543099298, "sim_compute_robot_state-npc3": 0.06694941222667694}, "udem1-8-0": {"driven_any": 1.0117814342566946, "sim_physics": 0.1753844995025202, "survival_time": 7.049999999999983, "driven_lanedir": 0.6909705366951359, "sim_render-ego": 0.06139033736912071, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.14241777075097917, "deviation-heading": 2.329921518550053, "set_robot_commands": 0.08520481096091845, "deviation-center-line": 0.5441337791691367, "driven_lanedir_consec": 0.6909705366951359, "sim_compute_sim_state": 0.03570111254428295, "sim_compute_performance-ego": 0.06500705590484836, "sim_compute_robot_state-ego": 0.06946099227201855, "sim_compute_robot_state-npc0": 0.06547885245465218, "sim_compute_robot_state-npc1": 0.06460009399035298, "sim_compute_robot_state-npc2": 0.06315670791247212, "sim_compute_robot_state-npc3": 0.06333562837424853}, "udem1-9-0": {"driven_any": 1.0121721984179504, "sim_physics": 0.144118875890345, "survival_time": 7.149999999999983, "driven_lanedir": 0.6896653033503108, "sim_render-ego": 0.04377523168817267, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.10960798663692876, "deviation-heading": 1.7559109248467348, "set_robot_commands": 0.06678609247807857, "deviation-center-line": 0.4657042775355992, "driven_lanedir_consec": 0.6525088666893104, "sim_compute_sim_state": 0.02678497187741153, "sim_compute_performance-ego": 0.04940281381140222, "sim_compute_robot_state-ego": 0.04864892259344354, "sim_compute_robot_state-npc0": 0.04758452868961788, "sim_compute_robot_state-npc1": 0.05981266581928813, "sim_compute_robot_state-npc2": 0.0480343928703895, "sim_compute_robot_state-npc3": 0.047360425228839154}, "udem1-10-0": {"driven_any": 0.3424596765232271, "sim_physics": 0.18849242192048293, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3212520101257572, "sim_render-ego": 0.05526778789666983, "in-drivable-lane": 0, "agent_compute-ego": 0.14025551080703735, "deviation-heading": 0.9083914070419382, "set_robot_commands": 0.08775294285554153, "deviation-center-line": 0.17941317297639486, "driven_lanedir_consec": 0.3212520101257572, "sim_compute_sim_state": 0.035833702637599066, "sim_compute_performance-ego": 0.06342747578254113, "sim_compute_robot_state-ego": 0.06817815853999211, "sim_compute_robot_state-npc0": 0.06317633390426636, "sim_compute_robot_state-npc1": 0.06567739523374118, "sim_compute_robot_state-npc2": 0.06776350736618042, "sim_compute_robot_state-npc3": 0.06011425531827486}, "udem1-11-0": {"driven_any": 0.45910689128684445, "sim_physics": 0.1941764959648474, "survival_time": 3.349999999999996, "driven_lanedir": 0.4553365542784813, "sim_render-ego": 0.06548834914591775, "in-drivable-lane": 0, "agent_compute-ego": 0.1516653103614921, "deviation-heading": 0.4336566898932428, "set_robot_commands": 0.08717106705281272, "deviation-center-line": 0.3396621974449056, "driven_lanedir_consec": 0.4553365542784813, "sim_compute_sim_state": 0.03820260603036454, "sim_compute_performance-ego": 0.06793191183858843, "sim_compute_robot_state-ego": 0.07351326942443848, "sim_compute_robot_state-npc0": 0.06511671507536475, "sim_compute_robot_state-npc1": 0.06670154742340544, "sim_compute_robot_state-npc2": 0.06737004820980243, "sim_compute_robot_state-npc3": 0.06846901552001042}, "udem1-12-0": {"driven_any": 1.447644041392146, "sim_physics": 0.19401329785437132, "survival_time": 10.050000000000008, "driven_lanedir": 0.3024072802283877, "sim_render-ego": 0.05914111398345795, "in-drivable-lane": 7.600000000000008, "agent_compute-ego": 0.14567030128554917, "deviation-heading": 0.5639614932962997, "set_robot_commands": 0.08989717118182586, "deviation-center-line": 0.287042893102722, "driven_lanedir_consec": 0.3024072802283877, "sim_compute_sim_state": 0.03820064411827581, "sim_compute_performance-ego": 0.0659624166156522, "sim_compute_robot_state-ego": 0.07095689204201769, "sim_compute_robot_state-npc0": 0.06624372325726409, "sim_compute_robot_state-npc1": 0.06479158804784367, "sim_compute_robot_state-npc2": 0.06614741875757625, "sim_compute_robot_state-npc3": 0.0673801483799569}, "udem1-13-0": {"driven_any": 1.0071223990792053, "sim_physics": 0.1853433041505411, "survival_time": 7.099999999999983, "driven_lanedir": 0.6504510750495411, "sim_render-ego": 0.058185511911419074, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14209243277428854, "deviation-heading": 1.767427394796984, "set_robot_commands": 0.08579204955571135, "deviation-center-line": 0.44358814435396954, "driven_lanedir_consec": 0.6504510750495411, "sim_compute_sim_state": 0.03710939682705302, "sim_compute_performance-ego": 0.06606654382087815, "sim_compute_robot_state-ego": 0.06859374550026907, "sim_compute_robot_state-npc0": 0.062437180062414895, "sim_compute_robot_state-npc1": 0.06057772837894063, "sim_compute_robot_state-npc2": 0.06474356080444765, "sim_compute_robot_state-npc3": 0.06472457630533568}, "udem1-14-0": {"driven_any": 1.0832727219252307, "sim_physics": 0.19419152171988235, "survival_time": 7.599999999999981, "driven_lanedir": 0.5461047072099379, "sim_render-ego": 0.06026168873435572, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1410300512062876, "deviation-heading": 4.374417856296392, "set_robot_commands": 0.08555082427827936, "deviation-center-line": 0.4695309103813122, "driven_lanedir_consec": 0.3703185844575955, "sim_compute_sim_state": 0.03605116825354727, "sim_compute_performance-ego": 0.06736264730754651, "sim_compute_robot_state-ego": 0.06597029535393965, "sim_compute_robot_state-npc0": 0.06362545333410564, "sim_compute_robot_state-npc1": 0.06308718417820178, "sim_compute_robot_state-npc2": 0.06325208670214603, "sim_compute_robot_state-npc3": 0.06512032684526946}}
set_robot_commands_max0.09440684484110938
set_robot_commands_mean0.08786568073093155
set_robot_commands_median0.0893893378555395
set_robot_commands_min0.06678609247807857
sim_compute_performance-ego_max0.06912701328595479
sim_compute_performance-ego_mean0.06568637052160058
sim_compute_performance-ego_median0.0666630886219166
sim_compute_performance-ego_min0.04940281381140222
sim_compute_robot_state-ego_max0.07423700392246246
sim_compute_robot_state-ego_mean0.06921940275625255
sim_compute_robot_state-ego_median0.07095689204201769
sim_compute_robot_state-ego_min0.04864892259344354
sim_compute_robot_state-npc0_max0.06986112892627716
sim_compute_robot_state-npc0_mean0.065013635485506
sim_compute_robot_state-npc0_median0.06569125811258952
sim_compute_robot_state-npc0_min0.04758452868961788
sim_compute_robot_state-npc1_max0.07041616793032046
sim_compute_robot_state-npc1_mean0.06588991508830565
sim_compute_robot_state-npc1_median0.0658716869354248
sim_compute_robot_state-npc1_min0.05981266581928813
sim_compute_robot_state-npc2_max0.0697627311847249
sim_compute_robot_state-npc2_mean0.0651866950904437
sim_compute_robot_state-npc2_median0.06614741875757625
sim_compute_robot_state-npc2_min0.0480343928703895
sim_compute_robot_state-npc3_max0.06902957744285708
sim_compute_robot_state-npc3_mean0.06489206541368632
sim_compute_robot_state-npc3_median0.06603817939758301
sim_compute_robot_state-npc3_min0.047360425228839154
sim_compute_sim_state_max0.040650517852218064
sim_compute_sim_state_mean0.03722790051720546
sim_compute_sim_state_median0.03820064411827581
sim_compute_sim_state_min0.02678497187741153
sim_physics_max0.21831342379252117
sim_physics_mean0.18914675409788553
sim_physics_median0.1931453923710057
sim_physics_min0.144118875890345
sim_render-ego_max0.06571556903697827
sim_render-ego_mean0.06035410215244214
sim_render-ego_median0.06171159505844116
sim_render-ego_min0.04377523168817267
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.47
survival_time_min2.5999999999999988
213162884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:56:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 486, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1024, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1179, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1226, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-42-167-7227-job21316/tmp/tmp37ql90uy/episodes/udem1-10-0/camera.mp4.metadata.yaml']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212892884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:54:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-42-167-7194-job21289/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212102884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:58:27
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-25-98-2062-job21210/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211742884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:57:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5317-job21174/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211722884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:45:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.637258234942822
survival_time_median7.199999999999982
deviation-center-line_median0.41059891008830585
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.15012601216634114
agent_compute-ego_mean0.13312605906883973
agent_compute-ego_median0.1295027661679396
agent_compute-ego_min0.1237940611662688
deviation-center-line_max0.9349599376168654
deviation-center-line_mean0.4387555178222911
deviation-center-line_min0.17941317297639486
deviation-heading_max4.374417856296392
deviation-heading_mean1.5940974384060418
deviation-heading_median1.0234199155419084
deviation-heading_min0.4336566898932428
driven_any_max2.1860208965398997
driven_any_mean1.068337512713888
driven_any_median1.0253513500538094
driven_any_min0.3424596765232271
driven_lanedir_consec_max1.8538963171887557
driven_lanedir_consec_mean0.6976649549765142
driven_lanedir_consec_min0.3024072802283877
driven_lanedir_max1.8539439248016505
driven_lanedir_mean0.7124823821349586
driven_lanedir_median0.637258234942822
driven_lanedir_min0.3024072802283877
in-drivable-lane_max7.600000000000008
in-drivable-lane_mean1.933333333333337
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.11581507615283528, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.05426934335084088, "in-drivable-lane": 0, "agent_compute-ego": 0.13732940222309753, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.07886906324234684, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.0338617974677972, "sim_compute_performance-ego": 0.057380975875179326, "sim_compute_robot_state-ego": 0.060143577314056125, "sim_compute_robot_state-npc0": 0.06325161246071874, "sim_compute_robot_state-npc1": 0.060595396345695565, "sim_compute_robot_state-npc2": 0.0591135932280954, "sim_compute_robot_state-npc3": 0.059615047632065495}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.1165167854891883, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.059949484136369496, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14576361080010733, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.078215758005778, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.035767623119884066, "sim_compute_performance-ego": 0.062231616841422185, "sim_compute_robot_state-ego": 0.06370470093356238, "sim_compute_robot_state-npc0": 0.07442371878359053, "sim_compute_robot_state-npc1": 0.06518743932247162, "sim_compute_robot_state-npc2": 0.06316728724373712, "sim_compute_robot_state-npc3": 0.0639337698618571}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.1153436508335051, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.06147265629690202, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.1476791940751623, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.07932850865067029, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.03646001464030782, "sim_compute_performance-ego": 0.06483227698529354, "sim_compute_robot_state-ego": 0.06410674091245307, "sim_compute_robot_state-npc0": 0.07281998239579748, "sim_compute_robot_state-npc1": 0.06612893499311853, "sim_compute_robot_state-npc2": 0.06488253347209243, "sim_compute_robot_state-npc3": 0.06501951276278886}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.11844890832901, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.05986140807469686, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.15012601216634114, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.08065773328145345, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.03634553114573161, "sim_compute_performance-ego": 0.06385727961858113, "sim_compute_robot_state-ego": 0.06408099810282389, "sim_compute_robot_state-npc0": 0.07095338265101114, "sim_compute_robot_state-npc1": 0.06582988977432251, "sim_compute_robot_state-npc2": 0.06476933399836222, "sim_compute_robot_state-npc3": 0.06560160716374715}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.11022776144522207, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.05127394199371338, "in-drivable-lane": 0, "agent_compute-ego": 0.1237940611662688, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.0757383284745393, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.032549279707449454, "sim_compute_performance-ego": 0.05519849724239773, "sim_compute_robot_state-ego": 0.05710936034167254, "sim_compute_robot_state-npc0": 0.05719266555927418, "sim_compute_robot_state-npc1": 0.058488836994877565, "sim_compute_robot_state-npc2": 0.057053446769714355, "sim_compute_robot_state-npc3": 0.056207374290183736}, "udem1-5-0": {"driven_any": 1.1302403061470987, "sim_physics": 0.1206230692043426, "survival_time": 7.84999999999998, "driven_lanedir": 0.39314661474467094, "sim_render-ego": 0.0535517650045407, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.1304562638519676, "deviation-heading": 2.4308255969868253, "set_robot_commands": 0.08046446636224248, "deviation-center-line": 0.38861383599610416, "driven_lanedir_consec": 0.39314661474467094, "sim_compute_sim_state": 0.03429033953672762, "sim_compute_performance-ego": 0.05910921552378661, "sim_compute_robot_state-ego": 0.06064818922881108, "sim_compute_robot_state-npc0": 0.06021320743925253, "sim_compute_robot_state-npc1": 0.060176389232562605, "sim_compute_robot_state-npc2": 0.0599154712288243, "sim_compute_robot_state-npc3": 0.060672778232841736}, "udem1-6-0": {"driven_any": 0.5061578530870738, "sim_physics": 0.13707372665405274, "survival_time": 3.7499999999999942, "driven_lanedir": 0.500515270834164, "sim_render-ego": 0.05475413322448731, "in-drivable-lane": 0, "agent_compute-ego": 0.13188724517822265, "deviation-heading": 0.5159300208401423, "set_robot_commands": 0.08167822202046712, "deviation-center-line": 0.32277039791323286, "driven_lanedir_consec": 0.500515270834164, "sim_compute_sim_state": 0.03443298657735189, "sim_compute_performance-ego": 0.05910935084025065, "sim_compute_robot_state-ego": 0.06084873517354329, "sim_compute_robot_state-npc0": 0.060091403325398765, "sim_compute_robot_state-npc1": 0.05988039334615072, "sim_compute_robot_state-npc2": 0.0601014773050944, "sim_compute_robot_state-npc3": 0.059987541834513346}, "udem1-7-0": {"driven_any": 1.0295382151776031, "sim_physics": 0.12489067514737448, "survival_time": 7.199999999999982, "driven_lanedir": 0.9359161916925074, "sim_render-ego": 0.053796425461769104, "in-drivable-lane": 0, "agent_compute-ego": 0.12942330373658073, "deviation-heading": 2.4651914972100637, "set_robot_commands": 0.08080451521608564, "deviation-center-line": 0.5408967871824802, "driven_lanedir_consec": 0.9268938600486144, "sim_compute_sim_state": 0.034165405564837985, "sim_compute_performance-ego": 0.05864928993913862, "sim_compute_robot_state-ego": 0.05969224704636468, "sim_compute_robot_state-npc0": 0.061497430006663, "sim_compute_robot_state-npc1": 0.06048773891395993, "sim_compute_robot_state-npc2": 0.05933017200893826, "sim_compute_robot_state-npc3": 0.05966338846418592}, "udem1-8-0": {"driven_any": 1.0117814342566946, "sim_physics": 0.11648160346010898, "survival_time": 7.049999999999983, "driven_lanedir": 0.6909705366951359, "sim_render-ego": 0.05374333199034346, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.13030526316757743, "deviation-heading": 2.329921518550053, "set_robot_commands": 0.08033066945718535, "deviation-center-line": 0.5441337791691367, "driven_lanedir_consec": 0.6909705366951359, "sim_compute_sim_state": 0.03432073491684934, "sim_compute_performance-ego": 0.05851820681957488, "sim_compute_robot_state-ego": 0.060380467286346655, "sim_compute_robot_state-npc0": 0.06015150259572563, "sim_compute_robot_state-npc1": 0.06055777969089805, "sim_compute_robot_state-npc2": 0.05935818591016404, "sim_compute_robot_state-npc3": 0.05964802850222757}, "udem1-9-0": {"driven_any": 1.0121721984179504, "sim_physics": 0.126952463096672, "survival_time": 7.149999999999983, "driven_lanedir": 0.6896653033503108, "sim_render-ego": 0.05358620123429732, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.12824502524796066, "deviation-heading": 1.7559109248467348, "set_robot_commands": 0.08025004980447409, "deviation-center-line": 0.4657042775355992, "driven_lanedir_consec": 0.6525088666893104, "sim_compute_sim_state": 0.03355654969915643, "sim_compute_performance-ego": 0.05765600471229819, "sim_compute_robot_state-ego": 0.059109532749736224, "sim_compute_robot_state-npc0": 0.05890316396326452, "sim_compute_robot_state-npc1": 0.058797687917322546, "sim_compute_robot_state-npc2": 0.05858746275201544, "sim_compute_robot_state-npc3": 0.05872702431845498}, "udem1-10-0": {"driven_any": 0.3424596765232271, "sim_physics": 0.11584649177697988, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3212520101257572, "sim_render-ego": 0.0528754133444566, "in-drivable-lane": 0, "agent_compute-ego": 0.1289369142972506, "deviation-heading": 0.9083914070419382, "set_robot_commands": 0.07856028355084933, "deviation-center-line": 0.17941317297639486, "driven_lanedir_consec": 0.3212520101257572, "sim_compute_sim_state": 0.03351896084271944, "sim_compute_performance-ego": 0.05740963954191942, "sim_compute_robot_state-ego": 0.05982789626488319, "sim_compute_robot_state-npc0": 0.05882360843511728, "sim_compute_robot_state-npc1": 0.058980854657980114, "sim_compute_robot_state-npc2": 0.05854789568827702, "sim_compute_robot_state-npc3": 0.058766805208646335}, "udem1-11-0": {"driven_any": 0.45910689128684445, "sim_physics": 0.1148265048639098, "survival_time": 3.349999999999996, "driven_lanedir": 0.4553365542784813, "sim_render-ego": 0.05299824387279909, "in-drivable-lane": 0, "agent_compute-ego": 0.1295027661679396, "deviation-heading": 0.4336566898932428, "set_robot_commands": 0.0787870278998987, "deviation-center-line": 0.3396621974449056, "driven_lanedir_consec": 0.4553365542784813, "sim_compute_sim_state": 0.03357543874142775, "sim_compute_performance-ego": 0.05748072666908378, "sim_compute_robot_state-ego": 0.05960634573182063, "sim_compute_robot_state-npc0": 0.059372311207785536, "sim_compute_robot_state-npc1": 0.059414646518764214, "sim_compute_robot_state-npc2": 0.0587481028998076, "sim_compute_robot_state-npc3": 0.05880229864547502}, "udem1-12-0": {"driven_any": 1.447644041392146, "sim_physics": 0.11777391125313678, "survival_time": 10.050000000000008, "driven_lanedir": 0.3024072802283877, "sim_render-ego": 0.052544759873727066, "in-drivable-lane": 7.600000000000008, "agent_compute-ego": 0.12757963920707133, "deviation-heading": 0.5639614932962997, "set_robot_commands": 0.08025479316711426, "deviation-center-line": 0.287042893102722, "driven_lanedir_consec": 0.3024072802283877, "sim_compute_sim_state": 0.033736907427583764, "sim_compute_performance-ego": 0.057563033270005566, "sim_compute_robot_state-ego": 0.05930565601557641, "sim_compute_robot_state-npc0": 0.05920579896044376, "sim_compute_robot_state-npc1": 0.05881184013328742, "sim_compute_robot_state-npc2": 0.058228998041864655, "sim_compute_robot_state-npc3": 0.05854071787933805}, "udem1-13-0": {"driven_any": 1.0071223990792053, "sim_physics": 0.11187144904069496, "survival_time": 7.099999999999983, "driven_lanedir": 0.6504510750495411, "sim_render-ego": 0.05322697296948501, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.12782283568046462, "deviation-heading": 1.767427394796984, "set_robot_commands": 0.078875311663453, "deviation-center-line": 0.44358814435396954, "driven_lanedir_consec": 0.6504510750495411, "sim_compute_sim_state": 0.033178112876247355, "sim_compute_performance-ego": 0.057861590049636195, "sim_compute_robot_state-ego": 0.06002132489647664, "sim_compute_robot_state-npc0": 0.059178542083417864, "sim_compute_robot_state-npc1": 0.05887325716690278, "sim_compute_robot_state-npc2": 0.058544105207416375, "sim_compute_robot_state-npc3": 0.05867297044942077}, "udem1-14-0": {"driven_any": 1.0832727219252307, "sim_physics": 0.12449794537142704, "survival_time": 7.599999999999981, "driven_lanedir": 0.5461047072099379, "sim_render-ego": 0.052656586232938264, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.12803934906658374, "deviation-heading": 4.374417856296392, "set_robot_commands": 0.07800323084781044, "deviation-center-line": 0.4695309103813122, "driven_lanedir_consec": 0.3703185844575955, "sim_compute_sim_state": 0.03351476474812156, "sim_compute_performance-ego": 0.0571780989044591, "sim_compute_robot_state-ego": 0.05887786965621145, "sim_compute_robot_state-npc0": 0.05940027299680208, "sim_compute_robot_state-npc1": 0.05831453517863625, "sim_compute_robot_state-npc2": 0.058358310084593926, "sim_compute_robot_state-npc3": 0.059035420417785645}}
set_robot_commands_max0.08167822202046712
set_robot_commands_mean0.07938786410962456
set_robot_commands_median0.07932850865067029
set_robot_commands_min0.0757383284745393
sim_compute_performance-ego_max0.06483227698529354
sim_compute_performance-ego_mean0.058935720188868466
sim_compute_performance-ego_median0.057861590049636195
sim_compute_performance-ego_min0.05519849724239773
sim_compute_robot_state-ego_max0.06410674091245307
sim_compute_robot_state-ego_mean0.06049757611028921
sim_compute_robot_state-ego_median0.06002132489647664
sim_compute_robot_state-ego_min0.05710936034167254
sim_compute_robot_state-npc0_max0.07442371878359053
sim_compute_robot_state-npc0_mean0.06236524019095088
sim_compute_robot_state-npc0_median0.060091403325398765
sim_compute_robot_state-npc0_min0.05719266555927418
sim_compute_robot_state-npc1_max0.06612893499311853
sim_compute_robot_state-npc1_mean0.06070170801246335
sim_compute_robot_state-npc1_median0.05988039334615072
sim_compute_robot_state-npc1_min0.05831453517863625
sim_compute_robot_state-npc2_max0.06488253347209243
sim_compute_robot_state-npc2_mean0.0599137583892665
sim_compute_robot_state-npc2_median0.0591135932280954
sim_compute_robot_state-npc2_min0.057053446769714355
sim_compute_robot_state-npc3_max0.06560160716374715
sim_compute_robot_state-npc3_mean0.06019295237756878
sim_compute_robot_state-npc3_median0.059615047632065495
sim_compute_robot_state-npc3_min0.056207374290183736
sim_compute_sim_state_max0.03646001464030782
sim_compute_sim_state_mean0.03421829646747956
sim_compute_sim_state_median0.0338617974677972
sim_compute_sim_state_min0.032549279707449454
sim_physics_max0.13707372665405274
sim_physics_mean0.119146001474564
sim_physics_median0.1165167854891883
sim_physics_min0.11022776144522207
sim_render-ego_max0.06147265629690202
sim_render-ego_mean0.05470404447075776
sim_render-ego_median0.05358620123429732
sim_render-ego_min0.05127394199371338
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.47
survival_time_min2.5999999999999988
211202884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:58:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-25-98-2470-job21120/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
210902884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:56:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5197-job21090/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
210152884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:58:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-40-253-32125-job21015/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209702884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:51:18
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5376-job20970/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209492884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:10:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-25-98-2348-job20949/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202762884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationerrorno-0:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202612884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:12:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20261-897017', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20261-897017', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20261-897017', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
200502884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:22:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7406162049123841
survival_time_median9.950000000000006
deviation-center-line_median0.3302177143601141
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16425176337361336
agent_compute-ego_mean0.15149367309054926
agent_compute-ego_median0.15023934024654023
agent_compute-ego_min0.1447388172149658
deviation-center-line_max0.6904628736300545
deviation-center-line_mean0.3874259749000404
deviation-center-line_min0.2530034862371619
deviation-heading_max1.0778162767766089
deviation-heading_mean0.8215479365254513
deviation-heading_median0.9150868055674838
deviation-heading_min0.3781055846447399
driven_any_max2.20273818289615
driven_any_mean1.2469484705963905
driven_any_median1.4279632190835694
driven_any_min0.4328289963250949
driven_lanedir_consec_max2.201596053570166
driven_lanedir_consec_mean1.1015078923939634
driven_lanedir_consec_min0.4219705604336601
driven_lanedir_max2.201596053570166
driven_lanedir_mean1.1015543630441058
driven_lanedir_median0.7406162049123841
driven_lanedir_min0.4219705604336601
in-drivable-lane_max4.550000000000018
in-drivable-lane_mean0.9100000000000036
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.6645051945479123, "sim_physics": 0.18263817458173592, "survival_time": 11.450000000000028, "driven_lanedir": 1.6584103880801533, "sim_render-ego": 0.05840702452513849, "in-drivable-lane": 0, "agent_compute-ego": 0.14737046129318304, "deviation-heading": 0.9150868055674838, "set_robot_commands": 0.08860089893424354, "deviation-center-line": 0.6904628736300545, "driven_lanedir_consec": 1.6581780348294406, "sim_compute_sim_state": 0.03721077265177231, "sim_compute_performance-ego": 0.06380482948503119, "sim_compute_robot_state-ego": 0.06777628228133423, "sim_compute_robot_state-npc0": 0.06489437948668368, "sim_compute_robot_state-npc1": 0.06282027319529171, "sim_compute_robot_state-npc2": 0.06225940025529487, "sim_compute_robot_state-npc3": 0.06296346385406094}, "udem1-1-0": {"driven_any": 0.5067067601292259, "sim_physics": 0.15370917320251465, "survival_time": 3.649999999999995, "driven_lanedir": 0.4851786082241656, "sim_render-ego": 0.059183316688015034, "in-drivable-lane": 0, "agent_compute-ego": 0.15023934024654023, "deviation-heading": 1.0778162767766089, "set_robot_commands": 0.08751670628377836, "deviation-center-line": 0.25585703994298503, "driven_lanedir_consec": 0.4851786082241656, "sim_compute_sim_state": 0.03674356904748368, "sim_compute_performance-ego": 0.06434022237176765, "sim_compute_robot_state-ego": 0.07004274080877435, "sim_compute_robot_state-npc0": 0.06497549030878773, "sim_compute_robot_state-npc1": 0.06495656705882451, "sim_compute_robot_state-npc2": 0.06365240763311517, "sim_compute_robot_state-npc3": 0.06935747682231747}, "udem1-2-0": {"driven_any": 1.4279632190835694, "sim_physics": 0.17443693942161062, "survival_time": 9.950000000000006, "driven_lanedir": 0.7406162049123841, "sim_render-ego": 0.05564133485957007, "in-drivable-lane": 4.550000000000018, "agent_compute-ego": 0.15086798332444387, "deviation-heading": 1.0112025852481552, "set_robot_commands": 0.08690090155481693, "deviation-center-line": 0.3302177143601141, "driven_lanedir_consec": 0.7406162049123841, "sim_compute_sim_state": 0.03726805993660011, "sim_compute_performance-ego": 0.06294391622495411, "sim_compute_robot_state-ego": 0.06600315007732142, "sim_compute_robot_state-npc0": 0.06124833960029947, "sim_compute_robot_state-npc1": 0.06224395162496135, "sim_compute_robot_state-npc2": 0.06284874647705999, "sim_compute_robot_state-npc3": 0.06481235949837383}, "udem1-3-0": {"driven_any": 2.20273818289615, "sim_physics": 0.19433486541112263, "survival_time": 14.950000000000076, "driven_lanedir": 2.201596053570166, "sim_render-ego": 0.05919396956761678, "in-drivable-lane": 0, "agent_compute-ego": 0.1447388172149658, "deviation-heading": 0.3781055846447399, "set_robot_commands": 0.08699873050053915, "deviation-center-line": 0.4075887603298862, "driven_lanedir_consec": 2.201596053570166, "sim_compute_sim_state": 0.03721928199132283, "sim_compute_performance-ego": 0.06514434417088827, "sim_compute_robot_state-ego": 0.06976767698923747, "sim_compute_robot_state-npc0": 0.0655835469563802, "sim_compute_robot_state-npc1": 0.06433459917704264, "sim_compute_robot_state-npc2": 0.0637879713376363, "sim_compute_robot_state-npc3": 0.06396921157836914}, "udem1-4-0": {"driven_any": 0.4328289963250949, "sim_physics": 0.11501739919185638, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4219705604336601, "sim_render-ego": 0.04655298590660095, "in-drivable-lane": 0, "agent_compute-ego": 0.16425176337361336, "deviation-heading": 0.7255284303902685, "set_robot_commands": 0.1414029709994793, "deviation-center-line": 0.2530034862371619, "driven_lanedir_consec": 0.4219705604336601, "sim_compute_sim_state": 0.02929968759417534, "sim_compute_performance-ego": 0.05177886411547661, "sim_compute_robot_state-ego": 0.05438586696982384, "sim_compute_robot_state-npc0": 0.054374419152736664, "sim_compute_robot_state-npc1": 0.05921652913093567, "sim_compute_robot_state-npc2": 0.05336464196443558, "sim_compute_robot_state-npc3": 0.05341874435544014}}
set_robot_commands_max0.1414029709994793
set_robot_commands_mean0.09828404165457146
set_robot_commands_median0.08751670628377836
set_robot_commands_min0.08690090155481693
sim_compute_performance-ego_max0.06514434417088827
sim_compute_performance-ego_mean0.061602435273623565
sim_compute_performance-ego_median0.06380482948503119
sim_compute_performance-ego_min0.05177886411547661
sim_compute_robot_state-ego_max0.07004274080877435
sim_compute_robot_state-ego_mean0.06559514342529826
sim_compute_robot_state-ego_median0.06777628228133423
sim_compute_robot_state-ego_min0.05438586696982384
sim_compute_robot_state-npc0_max0.0655835469563802
sim_compute_robot_state-npc0_mean0.06221523510097755
sim_compute_robot_state-npc0_median0.06489437948668368
sim_compute_robot_state-npc0_min0.054374419152736664
sim_compute_robot_state-npc1_max0.06495656705882451
sim_compute_robot_state-npc1_mean0.06271438403741117
sim_compute_robot_state-npc1_median0.06282027319529171
sim_compute_robot_state-npc1_min0.05921652913093567
sim_compute_robot_state-npc2_max0.0637879713376363
sim_compute_robot_state-npc2_mean0.061182633533508377
sim_compute_robot_state-npc2_median0.06284874647705999
sim_compute_robot_state-npc2_min0.05336464196443558
sim_compute_robot_state-npc3_max0.06935747682231747
sim_compute_robot_state-npc3_mean0.06290425122171231
sim_compute_robot_state-npc3_median0.06396921157836914
sim_compute_robot_state-npc3_min0.05341874435544014
sim_compute_sim_state_max0.03726805993660011
sim_compute_sim_state_mean0.03554827424427086
sim_compute_sim_state_median0.03721077265177231
sim_compute_sim_state_min0.02929968759417534
sim_physics_max0.19433486541112263
sim_physics_mean0.16402731036176804
sim_physics_median0.17443693942161062
sim_physics_min0.11501739919185638
sim_render-ego_max0.05919396956761678
sim_render-ego_mean0.05579572630938827
sim_render-ego_median0.05840702452513849
sim_render-ego_min0.04655298590660095
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.64000000000002
survival_time_min3.1999999999999966
200482884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:22:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7406162049123841
survival_time_median9.950000000000006
deviation-center-line_median0.3302177143601141
in-drivable-lane_median0


other stats
agent_compute-ego_max0.23363769426941872
agent_compute-ego_mean0.1622209528637371
agent_compute-ego_median0.14661732615341783
agent_compute-ego_min0.14114497774210408
deviation-center-line_max0.6904628736300545
deviation-center-line_mean0.3874259749000404
deviation-center-line_min0.2530034862371619
deviation-heading_max1.0778162767766089
deviation-heading_mean0.8215479365254513
deviation-heading_median0.9150868055674838
deviation-heading_min0.3781055846447399
driven_any_max2.20273818289615
driven_any_mean1.2469484705963905
driven_any_median1.4279632190835694
driven_any_min0.4328289963250949
driven_lanedir_consec_max2.201596053570166
driven_lanedir_consec_mean1.1015078923939634
driven_lanedir_consec_min0.4219705604336601
driven_lanedir_max2.201596053570166
driven_lanedir_mean1.1015543630441058
driven_lanedir_median0.7406162049123841
driven_lanedir_min0.4219705604336601
in-drivable-lane_max4.550000000000018
in-drivable-lane_mean0.9100000000000036
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.6645051945479123, "sim_physics": 0.17942340717565544, "survival_time": 11.450000000000028, "driven_lanedir": 1.6584103880801533, "sim_render-ego": 0.05771594901272303, "in-drivable-lane": 0, "agent_compute-ego": 0.14661732615341783, "deviation-heading": 0.9150868055674838, "set_robot_commands": 0.09268553496448234, "deviation-center-line": 0.6904628736300545, "driven_lanedir_consec": 1.6581780348294406, "sim_compute_sim_state": 0.03638429933239799, "sim_compute_performance-ego": 0.06554410447199792, "sim_compute_robot_state-ego": 0.06961002724660016, "sim_compute_robot_state-npc0": 0.06817572189730849, "sim_compute_robot_state-npc1": 0.06499614049253505, "sim_compute_robot_state-npc2": 0.06366755139879784, "sim_compute_robot_state-npc3": 0.06566993117853023}, "udem1-1-0": {"driven_any": 0.5067067601292259, "sim_physics": 0.1586687891450647, "survival_time": 3.649999999999995, "driven_lanedir": 0.4851786082241656, "sim_render-ego": 0.05941894609634191, "in-drivable-lane": 0, "agent_compute-ego": 0.1469334021006545, "deviation-heading": 1.0778162767766089, "set_robot_commands": 0.08986077896536213, "deviation-center-line": 0.25585703994298503, "driven_lanedir_consec": 0.4851786082241656, "sim_compute_sim_state": 0.035127228253508266, "sim_compute_performance-ego": 0.06366227097707251, "sim_compute_robot_state-ego": 0.06840415196876003, "sim_compute_robot_state-npc0": 0.06503681287373582, "sim_compute_robot_state-npc1": 0.07221322843473252, "sim_compute_robot_state-npc2": 0.06369963084181694, "sim_compute_robot_state-npc3": 0.06661029711161574}, "udem1-2-0": {"driven_any": 1.4279632190835694, "sim_physics": 0.16558114607729504, "survival_time": 9.950000000000006, "driven_lanedir": 0.7406162049123841, "sim_render-ego": 0.057543762964219904, "in-drivable-lane": 4.550000000000018, "agent_compute-ego": 0.14114497774210408, "deviation-heading": 1.0112025852481552, "set_robot_commands": 0.08792808427283512, "deviation-center-line": 0.3302177143601141, "driven_lanedir_consec": 0.7406162049123841, "sim_compute_sim_state": 0.03594986038591395, "sim_compute_performance-ego": 0.060667281174779535, "sim_compute_robot_state-ego": 0.06861685508459657, "sim_compute_robot_state-npc0": 0.06405465327315595, "sim_compute_robot_state-npc1": 0.06340365793237734, "sim_compute_robot_state-npc2": 0.06251235703128068, "sim_compute_robot_state-npc3": 0.06337785001975207}, "udem1-3-0": {"driven_any": 2.20273818289615, "sim_physics": 0.1903776931762695, "survival_time": 14.950000000000076, "driven_lanedir": 2.201596053570166, "sim_render-ego": 0.05716086626052856, "in-drivable-lane": 0, "agent_compute-ego": 0.1427713640530904, "deviation-heading": 0.3781055846447399, "set_robot_commands": 0.08853756030400595, "deviation-center-line": 0.4075887603298862, "driven_lanedir_consec": 2.201596053570166, "sim_compute_sim_state": 0.03720680316289266, "sim_compute_performance-ego": 0.06466033140818278, "sim_compute_robot_state-ego": 0.06749629020690918, "sim_compute_robot_state-npc0": 0.06632691144943237, "sim_compute_robot_state-npc1": 0.06593314011891684, "sim_compute_robot_state-npc2": 0.0642449402809143, "sim_compute_robot_state-npc3": 0.06353774944941203}, "udem1-4-0": {"driven_any": 0.4328289963250949, "sim_physics": 0.1267976462841034, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4219705604336601, "sim_render-ego": 0.054573237895965576, "in-drivable-lane": 0, "agent_compute-ego": 0.23363769426941872, "deviation-heading": 0.7255284303902685, "set_robot_commands": 0.15470247343182564, "deviation-center-line": 0.2530034862371619, "driven_lanedir_consec": 0.4219705604336601, "sim_compute_sim_state": 0.03427066653966904, "sim_compute_performance-ego": 0.058978158980607986, "sim_compute_robot_state-ego": 0.0588432140648365, "sim_compute_robot_state-npc0": 0.07099807262420654, "sim_compute_robot_state-npc1": 0.05834737420082092, "sim_compute_robot_state-npc2": 0.05891544371843338, "sim_compute_robot_state-npc3": 0.06133582815527916}}
set_robot_commands_max0.15470247343182564
set_robot_commands_mean0.10274288638770224
set_robot_commands_median0.08986077896536213
set_robot_commands_min0.08792808427283512
sim_compute_performance-ego_max0.06554410447199792
sim_compute_performance-ego_mean0.06270242940252815
sim_compute_performance-ego_median0.06366227097707251
sim_compute_performance-ego_min0.058978158980607986
sim_compute_robot_state-ego_max0.06961002724660016
sim_compute_robot_state-ego_mean0.06659410771434049
sim_compute_robot_state-ego_median0.06840415196876003
sim_compute_robot_state-ego_min0.0588432140648365
sim_compute_robot_state-npc0_max0.07099807262420654
sim_compute_robot_state-npc0_mean0.06691843442356783
sim_compute_robot_state-npc0_median0.06632691144943237
sim_compute_robot_state-npc0_min0.06405465327315595
sim_compute_robot_state-npc1_max0.07221322843473252
sim_compute_robot_state-npc1_mean0.06497870823587654
sim_compute_robot_state-npc1_median0.06499614049253505
sim_compute_robot_state-npc1_min0.05834737420082092
sim_compute_robot_state-npc2_max0.0642449402809143
sim_compute_robot_state-npc2_mean0.06260798465424863
sim_compute_robot_state-npc2_median0.06366755139879784
sim_compute_robot_state-npc2_min0.05891544371843338
sim_compute_robot_state-npc3_max0.06661029711161574
sim_compute_robot_state-npc3_mean0.06410633118291784
sim_compute_robot_state-npc3_median0.06353774944941203
sim_compute_robot_state-npc3_min0.06133582815527916
sim_compute_sim_state_max0.03720680316289266
sim_compute_sim_state_mean0.035787771534876375
sim_compute_sim_state_median0.03594986038591395
sim_compute_sim_state_min0.03427066653966904
sim_physics_max0.1903776931762695
sim_physics_mean0.16416973637167762
sim_physics_median0.16558114607729504
sim_physics_min0.1267976462841034
sim_render-ego_max0.05941894609634191
sim_render-ego_mean0.057282552445955794
sim_render-ego_median0.057543762964219904
sim_render-ego_min0.054573237895965576
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.64000000000002
survival_time_min3.1999999999999966
198152884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:16:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6901360175647038
survival_time_median10.650000000000016
deviation-center-line_median0.4039313142790796
in-drivable-lane_median0.6000000000000085


other stats
agent_compute-ego_max0.14476484784456056
agent_compute-ego_mean0.13914709547198792
agent_compute-ego_median0.1384086351439427
agent_compute-ego_min0.1333812189102173
deviation-center-line_max0.9036494815724962
deviation-center-line_mean0.4973531693381113
deviation-center-line_min0.2311413759150724
deviation-heading_max2.6534330145643485
deviation-heading_mean1.257401153787074
deviation-heading_median0.9653047879124452
deviation-heading_min0.7284890770541999
driven_any_max2.1984483527409555
driven_any_mean1.347894490995063
driven_any_median1.552620499061873
driven_any_min0.4064770712157617
driven_lanedir_consec_max2.104424594597506
driven_lanedir_consec_mean1.0762202721064849
driven_lanedir_consec_min0.39472830997852393
driven_lanedir_max2.1044675097701213
driven_lanedir_mean1.076281468554041
driven_lanedir_median0.6901360175647038
driven_lanedir_min0.39472830997852393
in-drivable-lane_max5.600000000000026
in-drivable-lane_mean1.5800000000000058
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5569031012111356, "sim_physics": 0.027572664144997285, "survival_time": 10.700000000000015, "driven_lanedir": 1.5502659426823462, "sim_render-ego": 0.058882580739315425, "in-drivable-lane": 0, "agent_compute-ego": 0.14476484784456056, "deviation-heading": 0.917584903294301, "set_robot_commands": 0.07730212724097421, "deviation-center-line": 0.5991921834049575, "driven_lanedir_consec": 1.55000287561718, "sim_compute_sim_state": 0.034320647471419004, "sim_compute_performance-ego": 0.06108995018718399, "sim_compute_robot_state-ego": 0.06082623472837644, "sim_compute_robot_state-npc0": 0.06760486932558434, "sim_compute_robot_state-npc1": 0.06322458525684392, "sim_compute_robot_state-npc2": 0.0617899047994168, "sim_compute_robot_state-npc3": 0.061101580334601}, "udem1-1-0": {"driven_any": 1.0250234307455888, "sim_physics": 0.027087406678633255, "survival_time": 7.149999999999983, "driven_lanedir": 0.6418095627745097, "sim_render-ego": 0.05542938525860126, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.13662253059707322, "deviation-heading": 2.6534330145643485, "set_robot_commands": 0.07593776462795017, "deviation-center-line": 0.4039313142790796, "driven_lanedir_consec": 0.6418095627745097, "sim_compute_sim_state": 0.03295868926948601, "sim_compute_performance-ego": 0.05907266790216619, "sim_compute_robot_state-ego": 0.05876448271157858, "sim_compute_robot_state-npc0": 0.0640531469891955, "sim_compute_robot_state-npc1": 0.060671181111902624, "sim_compute_robot_state-npc2": 0.05898557843028249, "sim_compute_robot_state-npc3": 0.058569904807564264}, "udem1-2-0": {"driven_any": 1.552620499061873, "sim_physics": 0.02678426330638044, "survival_time": 10.650000000000016, "driven_lanedir": 0.6901360175647038, "sim_render-ego": 0.05725132691468431, "in-drivable-lane": 5.600000000000026, "agent_compute-ego": 0.1384086351439427, "deviation-heading": 1.0221939861100755, "set_robot_commands": 0.07445619923408042, "deviation-center-line": 0.3488514915189506, "driven_lanedir_consec": 0.6901360175647038, "sim_compute_sim_state": 0.0343549262749757, "sim_compute_performance-ego": 0.05922032186123127, "sim_compute_robot_state-ego": 0.05958799017427113, "sim_compute_robot_state-npc0": 0.06584028011196656, "sim_compute_robot_state-npc1": 0.06162857001935932, "sim_compute_robot_state-npc2": 0.061404494612429625, "sim_compute_robot_state-npc3": 0.06078842548137539}, "udem1-3-0": {"driven_any": 2.1984483527409555, "sim_physics": 0.026555255254109705, "survival_time": 14.950000000000076, "driven_lanedir": 2.1044675097701213, "sim_render-ego": 0.05563187917073568, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.1333812189102173, "deviation-heading": 0.9653047879124452, "set_robot_commands": 0.07410444974899293, "deviation-center-line": 0.9036494815724962, "driven_lanedir_consec": 2.104424594597506, "sim_compute_sim_state": 0.03288876454035441, "sim_compute_performance-ego": 0.05849095662434896, "sim_compute_robot_state-ego": 0.06022523164749145, "sim_compute_robot_state-npc0": 0.06355364004770915, "sim_compute_robot_state-npc1": 0.06000769297281901, "sim_compute_robot_state-npc2": 0.05990353425343831, "sim_compute_robot_state-npc3": 0.059341909885406496}, "udem1-4-0": {"driven_any": 0.4064770712157617, "sim_physics": 0.02976038058598836, "survival_time": 2.9999999999999973, "driven_lanedir": 0.39472830997852393, "sim_render-ego": 0.05857606728871664, "in-drivable-lane": 0, "agent_compute-ego": 0.14255824486414592, "deviation-heading": 0.7284890770541999, "set_robot_commands": 0.07445412079493205, "deviation-center-line": 0.2311413759150724, "driven_lanedir_consec": 0.39472830997852393, "sim_compute_sim_state": 0.035927351315816244, "sim_compute_performance-ego": 0.06247610251108805, "sim_compute_robot_state-ego": 0.06280210018157958, "sim_compute_robot_state-npc0": 0.07251017491022746, "sim_compute_robot_state-npc1": 0.06247121493021647, "sim_compute_robot_state-npc2": 0.06203921635945638, "sim_compute_robot_state-npc3": 0.06514815489451091}}
set_robot_commands_max0.07730212724097421
set_robot_commands_mean0.07525093232938596
set_robot_commands_median0.07445619923408042
set_robot_commands_min0.07410444974899293
sim_compute_performance-ego_max0.06247610251108805
sim_compute_performance-ego_mean0.06006999981720369
sim_compute_performance-ego_median0.05922032186123127
sim_compute_performance-ego_min0.05849095662434896
sim_compute_robot_state-ego_max0.06280210018157958
sim_compute_robot_state-ego_mean0.060441207888659434
sim_compute_robot_state-ego_median0.06022523164749145
sim_compute_robot_state-ego_min0.05876448271157858
sim_compute_robot_state-npc0_max0.07251017491022746
sim_compute_robot_state-npc0_mean0.06671242227693659
sim_compute_robot_state-npc0_median0.06584028011196656
sim_compute_robot_state-npc0_min0.06355364004770915
sim_compute_robot_state-npc1_max0.06322458525684392
sim_compute_robot_state-npc1_mean0.06160064885822827
sim_compute_robot_state-npc1_median0.06162857001935932
sim_compute_robot_state-npc1_min0.06000769297281901
sim_compute_robot_state-npc2_max0.06203921635945638
sim_compute_robot_state-npc2_mean0.06082454569100472
sim_compute_robot_state-npc2_median0.061404494612429625
sim_compute_robot_state-npc2_min0.05898557843028249
sim_compute_robot_state-npc3_max0.06514815489451091
sim_compute_robot_state-npc3_mean0.06098999508069162
sim_compute_robot_state-npc3_median0.06078842548137539
sim_compute_robot_state-npc3_min0.058569904807564264
sim_compute_sim_state_max0.035927351315816244
sim_compute_sim_state_mean0.034090075774410276
sim_compute_sim_state_median0.034320647471419004
sim_compute_sim_state_min0.03288876454035441
sim_physics_max0.02976038058598836
sim_physics_mean0.027551993994021813
sim_physics_median0.027087406678633255
sim_physics_min0.026555255254109705
sim_render-ego_max0.058882580739315425
sim_render-ego_mean0.05715424787441066
sim_render-ego_median0.05725132691468431
sim_render-ego_min0.05542938525860126
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.29000000000002
survival_time_min2.9999999999999973
197832884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:20:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6901360175647038
survival_time_median10.650000000000016
deviation-center-line_median0.4039313142790796
in-drivable-lane_median0.6000000000000085


other stats
agent_compute-ego_max0.16288886864980062
agent_compute-ego_mean0.13757024503168713
agent_compute-ego_median0.1369975463885097
agent_compute-ego_min0.11693833424494816
deviation-center-line_max0.9036494815724962
deviation-center-line_mean0.4973531693381113
deviation-center-line_min0.2311413759150724
deviation-heading_max2.6534330145643485
deviation-heading_mean1.257401153787074
deviation-heading_median0.9653047879124452
deviation-heading_min0.7284890770541999
driven_any_max2.1984483527409555
driven_any_mean1.347894490995063
driven_any_median1.552620499061873
driven_any_min0.4064770712157617
driven_lanedir_consec_max2.104424594597506
driven_lanedir_consec_mean1.0762202721064849
driven_lanedir_consec_min0.39472830997852393
driven_lanedir_max2.1044675097701213
driven_lanedir_mean1.076281468554041
driven_lanedir_median0.6901360175647038
driven_lanedir_min0.39472830997852393
in-drivable-lane_max5.600000000000026
in-drivable-lane_mean1.5800000000000058
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5569031012111356, "sim_physics": 0.03779405633979869, "survival_time": 10.700000000000015, "driven_lanedir": 1.5502659426823462, "sim_render-ego": 0.051780968068916106, "in-drivable-lane": 0, "agent_compute-ego": 0.1287579302475831, "deviation-heading": 0.917584903294301, "set_robot_commands": 0.09068393150222635, "deviation-center-line": 0.5991921834049575, "driven_lanedir_consec": 1.55000287561718, "sim_compute_sim_state": 0.03887178184830139, "sim_compute_performance-ego": 0.06991271772117258, "sim_compute_robot_state-ego": 0.05805483488278968, "sim_compute_robot_state-npc0": 0.06002091692986889, "sim_compute_robot_state-npc1": 0.0575959838439371, "sim_compute_robot_state-npc2": 0.05863791759883132, "sim_compute_robot_state-npc3": 0.06061556183289145}, "udem1-1-0": {"driven_any": 1.0250234307455888, "sim_physics": 0.03183308514681729, "survival_time": 7.149999999999983, "driven_lanedir": 0.6418095627745097, "sim_render-ego": 0.04602285365124682, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.11693833424494816, "deviation-heading": 2.6534330145643485, "set_robot_commands": 0.07344128368617771, "deviation-center-line": 0.4039313142790796, "driven_lanedir_consec": 0.6418095627745097, "sim_compute_sim_state": 0.029361359722964418, "sim_compute_performance-ego": 0.04988655010303417, "sim_compute_robot_state-ego": 0.05252293606738111, "sim_compute_robot_state-npc0": 0.051510405707192584, "sim_compute_robot_state-npc1": 0.051010973803646914, "sim_compute_robot_state-npc2": 0.05033849002598049, "sim_compute_robot_state-npc3": 0.05122678596656639}, "udem1-2-0": {"driven_any": 1.552620499061873, "sim_physics": 0.03638331319244815, "survival_time": 10.650000000000016, "driven_lanedir": 0.6901360175647038, "sim_render-ego": 0.056097330621710406, "in-drivable-lane": 5.600000000000026, "agent_compute-ego": 0.1369975463885097, "deviation-heading": 1.0221939861100755, "set_robot_commands": 0.08447442703963445, "deviation-center-line": 0.3488514915189506, "driven_lanedir_consec": 0.6901360175647038, "sim_compute_sim_state": 0.03289220814413868, "sim_compute_performance-ego": 0.06416054846535266, "sim_compute_robot_state-ego": 0.06336889244581052, "sim_compute_robot_state-npc0": 0.06020026027876447, "sim_compute_robot_state-npc1": 0.06041545487345664, "sim_compute_robot_state-npc2": 0.05865638916481269, "sim_compute_robot_state-npc3": 0.059865443359518274}, "udem1-3-0": {"driven_any": 2.1984483527409555, "sim_physics": 0.03722669363021851, "survival_time": 14.950000000000076, "driven_lanedir": 2.1044675097701213, "sim_render-ego": 0.05650542894999186, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.142268545627594, "deviation-heading": 0.9653047879124452, "set_robot_commands": 0.08625896612803141, "deviation-center-line": 0.9036494815724962, "driven_lanedir_consec": 2.104424594597506, "sim_compute_sim_state": 0.034980152448018394, "sim_compute_performance-ego": 0.06203893740971883, "sim_compute_robot_state-ego": 0.06571340163548788, "sim_compute_robot_state-npc0": 0.062527441183726, "sim_compute_robot_state-npc1": 0.06191541274388631, "sim_compute_robot_state-npc2": 0.06145999113718669, "sim_compute_robot_state-npc3": 0.061413919925689696}, "udem1-4-0": {"driven_any": 0.4064770712157617, "sim_physics": 0.04884496132532755, "survival_time": 2.9999999999999973, "driven_lanedir": 0.39472830997852393, "sim_render-ego": 0.06198824644088745, "in-drivable-lane": 0, "agent_compute-ego": 0.16288886864980062, "deviation-heading": 0.7284890770541999, "set_robot_commands": 0.09749075174331664, "deviation-center-line": 0.2311413759150724, "driven_lanedir_consec": 0.39472830997852393, "sim_compute_sim_state": 0.037095820903778075, "sim_compute_performance-ego": 0.0668578823407491, "sim_compute_robot_state-ego": 0.07259361743927002, "sim_compute_robot_state-npc0": 0.06984785795211793, "sim_compute_robot_state-npc1": 0.06700145800908407, "sim_compute_robot_state-npc2": 0.06760838826497396, "sim_compute_robot_state-npc3": 0.06609239180882771}}
set_robot_commands_max0.09749075174331664
set_robot_commands_mean0.08646987201987733
set_robot_commands_median0.08625896612803141
set_robot_commands_min0.07344128368617771
sim_compute_performance-ego_max0.06991271772117258
sim_compute_performance-ego_mean0.06257132720800547
sim_compute_performance-ego_median0.06416054846535266
sim_compute_performance-ego_min0.04988655010303417
sim_compute_robot_state-ego_max0.07259361743927002
sim_compute_robot_state-ego_mean0.06245073649414784
sim_compute_robot_state-ego_median0.06336889244581052
sim_compute_robot_state-ego_min0.05252293606738111
sim_compute_robot_state-npc0_max0.06984785795211793
sim_compute_robot_state-npc0_mean0.06082137641033397
sim_compute_robot_state-npc0_median0.06020026027876447
sim_compute_robot_state-npc0_min0.051510405707192584
sim_compute_robot_state-npc1_max0.06700145800908407
sim_compute_robot_state-npc1_mean0.05958785665480221
sim_compute_robot_state-npc1_median0.06041545487345664
sim_compute_robot_state-npc1_min0.051010973803646914
sim_compute_robot_state-npc2_max0.06760838826497396
sim_compute_robot_state-npc2_mean0.059340235238357034
sim_compute_robot_state-npc2_median0.05865638916481269
sim_compute_robot_state-npc2_min0.05033849002598049
sim_compute_robot_state-npc3_max0.06609239180882771
sim_compute_robot_state-npc3_mean0.059842820578698705
sim_compute_robot_state-npc3_median0.06061556183289145
sim_compute_robot_state-npc3_min0.05122678596656639
sim_compute_sim_state_max0.03887178184830139
sim_compute_sim_state_mean0.03464026461344019
sim_compute_sim_state_median0.034980152448018394
sim_compute_sim_state_min0.029361359722964418
sim_physics_max0.04884496132532755
sim_physics_mean0.03841642192692204
sim_physics_median0.03722669363021851
sim_physics_min0.03183308514681729
sim_render-ego_max0.06198824644088745
sim_render-ego_mean0.05447896554655053
sim_render-ego_median0.056097330621710406
sim_render-ego_min0.04602285365124682
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.29000000000002
survival_time_min2.9999999999999973
197572884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:13:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19757-275266', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19757-275266', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19757-275266', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
197552884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:16:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6901360175647038
survival_time_median10.650000000000016
deviation-center-line_median0.4039313142790796
in-drivable-lane_median0.6000000000000085


other stats
agent_compute-ego_max0.14348365863164267
agent_compute-ego_mean0.1392787632480313
agent_compute-ego_median0.14003145444643247
agent_compute-ego_min0.13337775309880576
deviation-center-line_max0.9036494815724962
deviation-center-line_mean0.4973531693381113
deviation-center-line_min0.2311413759150724
deviation-heading_max2.6534330145643485
deviation-heading_mean1.257401153787074
deviation-heading_median0.9653047879124452
deviation-heading_min0.7284890770541999
driven_any_max2.1984483527409555
driven_any_mean1.347894490995063
driven_any_median1.552620499061873
driven_any_min0.4064770712157617
driven_lanedir_consec_max2.104424594597506
driven_lanedir_consec_mean1.0762202721064849
driven_lanedir_consec_min0.39472830997852393
driven_lanedir_max2.1044675097701213
driven_lanedir_mean1.076281468554041
driven_lanedir_median0.6901360175647038
driven_lanedir_min0.39472830997852393
in-drivable-lane_max5.600000000000026
in-drivable-lane_mean1.5800000000000058
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5569031012111356, "sim_physics": 0.02564699070475926, "survival_time": 10.700000000000015, "driven_lanedir": 1.5502659426823462, "sim_render-ego": 0.056078490809859514, "in-drivable-lane": 0, "agent_compute-ego": 0.14150882769967907, "deviation-heading": 0.917584903294301, "set_robot_commands": 0.07626956645573411, "deviation-center-line": 0.5991921834049575, "driven_lanedir_consec": 1.55000287561718, "sim_compute_sim_state": 0.03247985995818521, "sim_compute_performance-ego": 0.057681776652826325, "sim_compute_robot_state-ego": 0.057827792435048896, "sim_compute_robot_state-npc0": 0.0654988222033064, "sim_compute_robot_state-npc1": 0.06006271928270286, "sim_compute_robot_state-npc2": 0.05851242475420515, "sim_compute_robot_state-npc3": 0.058671203729148226}, "udem1-1-0": {"driven_any": 1.0250234307455888, "sim_physics": 0.027088447050614792, "survival_time": 7.149999999999983, "driven_lanedir": 0.6418095627745097, "sim_render-ego": 0.05466306292927348, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14003145444643247, "deviation-heading": 2.6534330145643485, "set_robot_commands": 0.0784947722108214, "deviation-center-line": 0.4039313142790796, "driven_lanedir_consec": 0.6418095627745097, "sim_compute_sim_state": 0.03296428126888675, "sim_compute_performance-ego": 0.05949090410779406, "sim_compute_robot_state-ego": 0.06065271951101877, "sim_compute_robot_state-npc0": 0.06726089891020234, "sim_compute_robot_state-npc1": 0.06191231154061697, "sim_compute_robot_state-npc2": 0.05975911667296936, "sim_compute_robot_state-npc3": 0.05971823038754763}, "udem1-2-0": {"driven_any": 1.552620499061873, "sim_physics": 0.02575782990791428, "survival_time": 10.650000000000016, "driven_lanedir": 0.6901360175647038, "sim_render-ego": 0.05532616180993022, "in-drivable-lane": 5.600000000000026, "agent_compute-ego": 0.13799212236359645, "deviation-heading": 1.0221939861100755, "set_robot_commands": 0.07483027798469077, "deviation-center-line": 0.3488514915189506, "driven_lanedir_consec": 0.6901360175647038, "sim_compute_sim_state": 0.032599470425099836, "sim_compute_performance-ego": 0.056594667300372055, "sim_compute_robot_state-ego": 0.058259559908943, "sim_compute_robot_state-npc0": 0.06473634164657951, "sim_compute_robot_state-npc1": 0.05992098705309658, "sim_compute_robot_state-npc2": 0.058354866896436805, "sim_compute_robot_state-npc3": 0.058734866934762875}, "udem1-3-0": {"driven_any": 2.1984483527409555, "sim_physics": 0.024998904069264728, "survival_time": 14.950000000000076, "driven_lanedir": 2.1044675097701213, "sim_render-ego": 0.05302613496780396, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.13337775309880576, "deviation-heading": 0.9653047879124452, "set_robot_commands": 0.07408005714416505, "deviation-center-line": 0.9036494815724962, "driven_lanedir_consec": 2.104424594597506, "sim_compute_sim_state": 0.03140202124913533, "sim_compute_performance-ego": 0.056445992787679033, "sim_compute_robot_state-ego": 0.05756576061248779, "sim_compute_robot_state-npc0": 0.06388742129007975, "sim_compute_robot_state-npc1": 0.05842101494471232, "sim_compute_robot_state-npc2": 0.057369304498036705, "sim_compute_robot_state-npc3": 0.056775302092234296}, "udem1-4-0": {"driven_any": 0.4064770712157617, "sim_physics": 0.02689972718556722, "survival_time": 2.9999999999999973, "driven_lanedir": 0.39472830997852393, "sim_render-ego": 0.0563064177831014, "in-drivable-lane": 0, "agent_compute-ego": 0.14348365863164267, "deviation-heading": 0.7284890770541999, "set_robot_commands": 0.07618591785430909, "deviation-center-line": 0.2311413759150724, "driven_lanedir_consec": 0.39472830997852393, "sim_compute_sim_state": 0.03396684726079305, "sim_compute_performance-ego": 0.05988693634668986, "sim_compute_robot_state-ego": 0.05961379607518514, "sim_compute_robot_state-npc0": 0.07147929271062216, "sim_compute_robot_state-npc1": 0.06262425581614177, "sim_compute_robot_state-npc2": 0.060822399457295735, "sim_compute_robot_state-npc3": 0.061025877793629967}}
set_robot_commands_max0.0784947722108214
set_robot_commands_mean0.07597211832994408
set_robot_commands_median0.07618591785430909
set_robot_commands_min0.07408005714416505
sim_compute_performance-ego_max0.05988693634668986
sim_compute_performance-ego_mean0.05802005543907227
sim_compute_performance-ego_median0.057681776652826325
sim_compute_performance-ego_min0.056445992787679033
sim_compute_robot_state-ego_max0.06065271951101877
sim_compute_robot_state-ego_mean0.05878392570853672
sim_compute_robot_state-ego_median0.058259559908943
sim_compute_robot_state-ego_min0.05756576061248779
sim_compute_robot_state-npc0_max0.07147929271062216
sim_compute_robot_state-npc0_mean0.06657255535215803
sim_compute_robot_state-npc0_median0.0654988222033064
sim_compute_robot_state-npc0_min0.06388742129007975
sim_compute_robot_state-npc1_max0.06262425581614177
sim_compute_robot_state-npc1_mean0.060588257727454096
sim_compute_robot_state-npc1_median0.06006271928270286
sim_compute_robot_state-npc1_min0.05842101494471232
sim_compute_robot_state-npc2_max0.060822399457295735
sim_compute_robot_state-npc2_mean0.058963622455788754
sim_compute_robot_state-npc2_median0.05851242475420515
sim_compute_robot_state-npc2_min0.057369304498036705
sim_compute_robot_state-npc3_max0.061025877793629967
sim_compute_robot_state-npc3_mean0.0589850961874646
sim_compute_robot_state-npc3_median0.058734866934762875
sim_compute_robot_state-npc3_min0.056775302092234296
sim_compute_sim_state_max0.03396684726079305
sim_compute_sim_state_mean0.03268249603242003
sim_compute_sim_state_median0.032599470425099836
sim_compute_sim_state_min0.03140202124913533
sim_physics_max0.027088447050614792
sim_physics_mean0.026078379783624057
sim_physics_median0.02575782990791428
sim_physics_min0.024998904069264728
sim_render-ego_max0.0563064177831014
sim_render-ego_mean0.05508005365999371
sim_render-ego_median0.05532616180993022
sim_render-ego_min0.05302613496780396
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.29000000000002
survival_time_min2.9999999999999973
192912884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno-0:16:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6900582707828695
survival_time_median14.700000000000074
deviation-center-line_median0.3591683262706219
in-drivable-lane_median1.200000000000017


other stats
agent_compute-ego_max0.08803842911103955
agent_compute-ego_mean0.08384075803882411
agent_compute-ego_median0.08195193449656168
agent_compute-ego_min0.08110756073554937
deviation-center-line_max0.5528244200733968
deviation-center-line_mean0.3250388716749043
deviation-center-line_min0.12474392863155234
deviation-heading_max1.7841667326335335
deviation-heading_mean1.0687591038626745
deviation-heading_median0.9805073681793997
deviation-heading_min0.6869591234399757
driven_any_max2.196039556148948
driven_any_mean1.706254237612001
driven_any_median2.1660738591449116
driven_any_min0.9910472848979056
driven_lanedir_consec_max1.8205635516580176
driven_lanedir_consec_mean1.3480125540484669
driven_lanedir_consec_min0.616683423521228
driven_lanedir_max2.1929637182965305
driven_lanedir_mean1.482287538796306
driven_lanedir_median1.8205635516580176
driven_lanedir_min0.616683423521228
in-drivable-lane_max2.3999999999999915
in-drivable-lane_mean1.250000000000006
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.1660738591449116, "sim_physics": 0.018506993241861565, "survival_time": 14.700000000000074, "driven_lanedir": 1.961201560444252, "sim_render-ego": 0.03518822241802605, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.08803842911103955, "deviation-heading": 0.9805073681793997, "set_robot_commands": 0.05283498196374802, "deviation-center-line": 0.3591683262706219, "driven_lanedir_consec": 1.6900582707828695, "sim_compute_sim_state": 0.021775759807249315, "sim_compute_performance-ego": 0.038081465124272976, "sim_compute_robot_state-ego": 0.03926071666535877, "sim_compute_robot_state-npc0": 0.03895964346775392, "sim_compute_robot_state-npc1": 0.038387139638264976, "sim_compute_robot_state-npc2": 0.03846313758772247, "sim_compute_robot_state-npc3": 0.038604388431626925}, "udem1-1-0": {"driven_any": 1.0094322716915194, "sim_physics": 0.01783115930960212, "survival_time": 7.099999999999983, "driven_lanedir": 0.616683423521228, "sim_render-ego": 0.032853148352931925, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.08171625876090896, "deviation-heading": 0.7757170340260829, "set_robot_commands": 0.05092070472072547, "deviation-center-line": 0.12474392863155234, "driven_lanedir_consec": 0.616683423521228, "sim_compute_sim_state": 0.02083218769288399, "sim_compute_performance-ego": 0.03546366725169437, "sim_compute_robot_state-ego": 0.03684782646071743, "sim_compute_robot_state-npc0": 0.03650191132451447, "sim_compute_robot_state-npc1": 0.03642524799830477, "sim_compute_robot_state-npc2": 0.036142847907375285, "sim_compute_robot_state-npc3": 0.036710250545555434}, "udem1-2-0": {"driven_any": 2.168678216176718, "sim_physics": 0.017780779984037754, "survival_time": 14.750000000000076, "driven_lanedir": 1.8205635516580176, "sim_render-ego": 0.03550867145344362, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.086389607090061, "deviation-heading": 1.7841667326335335, "set_robot_commands": 0.05229742244138556, "deviation-center-line": 0.38105433778148035, "driven_lanedir_consec": 1.8205635516580176, "sim_compute_sim_state": 0.021534146292734955, "sim_compute_performance-ego": 0.03753868927389888, "sim_compute_robot_state-ego": 0.03862183861813303, "sim_compute_robot_state-npc0": 0.03846808692156258, "sim_compute_robot_state-npc1": 0.038880989107034976, "sim_compute_robot_state-npc2": 0.03771497597128658, "sim_compute_robot_state-npc3": 0.03827657618765103}, "udem1-3-0": {"driven_any": 2.196039556148948, "sim_physics": 0.01754659175872803, "survival_time": 14.950000000000076, "driven_lanedir": 2.1929637182965305, "sim_render-ego": 0.03331644376118978, "in-drivable-lane": 0, "agent_compute-ego": 0.08195193449656168, "deviation-heading": 0.6869591234399757, "set_robot_commands": 0.05059731403986613, "deviation-center-line": 0.5528244200733968, "driven_lanedir_consec": 1.792732084218717, "sim_compute_sim_state": 0.020840903123219807, "sim_compute_performance-ego": 0.03542014439900716, "sim_compute_robot_state-ego": 0.03708198070526123, "sim_compute_robot_state-npc0": 0.03744139194488525, "sim_compute_robot_state-npc1": 0.03614476521809896, "sim_compute_robot_state-npc2": 0.03598997116088867, "sim_compute_robot_state-npc3": 0.03634913365046184}, "udem1-4-0": {"driven_any": 0.9910472848979056, "sim_physics": 0.01802157485572091, "survival_time": 6.849999999999984, "driven_lanedir": 0.8200254400615028, "sim_render-ego": 0.032482631015081476, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.08110756073554937, "deviation-heading": 1.116445261034381, "set_robot_commands": 0.04959516455657291, "deviation-center-line": 0.20740334561747012, "driven_lanedir_consec": 0.8200254400615028, "sim_compute_sim_state": 0.02073685792240783, "sim_compute_performance-ego": 0.03568007302110213, "sim_compute_robot_state-ego": 0.0370025634765625, "sim_compute_robot_state-npc0": 0.03615674659283492, "sim_compute_robot_state-npc1": 0.03584890470017482, "sim_compute_robot_state-npc2": 0.035646821460584656, "sim_compute_robot_state-npc3": 0.035716521478917476}}
set_robot_commands_max0.05283498196374802
set_robot_commands_mean0.05124911754445962
set_robot_commands_median0.05092070472072547
set_robot_commands_min0.04959516455657291
sim_compute_performance-ego_max0.038081465124272976
sim_compute_performance-ego_mean0.0364368078139951
sim_compute_performance-ego_median0.03568007302110213
sim_compute_performance-ego_min0.03542014439900716
sim_compute_robot_state-ego_max0.03926071666535877
sim_compute_robot_state-ego_mean0.03776298518520659
sim_compute_robot_state-ego_median0.03708198070526123
sim_compute_robot_state-ego_min0.03684782646071743
sim_compute_robot_state-npc0_max0.03895964346775392
sim_compute_robot_state-npc0_mean0.037505556050310224
sim_compute_robot_state-npc0_median0.03744139194488525
sim_compute_robot_state-npc0_min0.03615674659283492
sim_compute_robot_state-npc1_max0.038880989107034976
sim_compute_robot_state-npc1_mean0.0371374093323757
sim_compute_robot_state-npc1_median0.03642524799830477
sim_compute_robot_state-npc1_min0.03584890470017482
sim_compute_robot_state-npc2_max0.03846313758772247
sim_compute_robot_state-npc2_mean0.03679155081757153
sim_compute_robot_state-npc2_median0.036142847907375285
sim_compute_robot_state-npc2_min0.035646821460584656
sim_compute_robot_state-npc3_max0.038604388431626925
sim_compute_robot_state-npc3_mean0.03713137405884254
sim_compute_robot_state-npc3_median0.036710250545555434
sim_compute_robot_state-npc3_min0.035716521478917476
sim_compute_sim_state_max0.021775759807249315
sim_compute_sim_state_mean0.021143970967699176
sim_compute_sim_state_median0.020840903123219807
sim_compute_sim_state_min0.02073685792240783
sim_physics_max0.018506993241861565
sim_physics_mean0.017937419829990076
sim_physics_median0.01783115930960212
sim_physics_min0.01754659175872803
sim_render-ego_max0.03550867145344362
sim_render-ego_mean0.03386982340013457
sim_render-ego_median0.03331644376118978
sim_render-ego_min0.032482631015081476
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.67000000000004
survival_time_min6.849999999999984
189402884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationerrorno-0:21:05
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189372884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errorno-0:23:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-nutonomy-P50-6318-job18937/tmp/tmppnqhi3c_/attempts/udem1-3-0.attempt3/log.gs2.cbor']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.