AI Driving Olympics Home Challenges Submissions Jobs

Submission 2964

Submission2964
Competingyes
Challengeaido2-LFVI-sim-testing
UserJulian Zilly
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22690
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
226902964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes-0:30:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217732964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:51:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2608955663992025
survival_time_median5.399999999999989
deviation-center-line_median0.20084634484832703
in-drivable-lane_median2.249999999999992


other stats
agent_compute-ego_max0.24733241399129233
agent_compute-ego_mean0.22295074898987544
agent_compute-ego_median0.2208186930684901
agent_compute-ego_min0.20851443608601888
deviation-center-line_max1.1720265597834716
deviation-center-line_mean0.3573592478909198
deviation-center-line_min0.1428855896189655
deviation-heading_max2.558394372300888
deviation-heading_mean1.546763675293946
deviation-heading_median1.3806901130057407
deviation-heading_min0.6850290349648949
driven_any_max1.7164128485614625
driven_any_mean0.9027371861967096
driven_any_median0.6523104756131728
driven_any_min0.3978453035301088
driven_lanedir_consec_max1.143343399810823
driven_lanedir_consec_mean0.4002633833657869
driven_lanedir_consec_min0.09758637927766456
driven_lanedir_max1.143354294700582
driven_lanedir_mean0.4020652290249285
driven_lanedir_median0.26453356304097864
driven_lanedir_min0.11774447930030751
in-drivable-lane_max11.350000000000076
in-drivable-lane_mean3.670000000000005
in-drivable-lane_min0.9999999999999998
per-episodes
details{"udem1-0-0": {"driven_any": 1.57601795169403, "sim_physics": 0.12233672142028808, "survival_time": 14.950000000000076, "driven_lanedir": 1.143354294700582, "sim_render-ego": 0.07148106257120768, "in-drivable-lane": 4.35, "agent_compute-ego": 0.22798529307047527, "deviation-heading": 2.19704879108416, "set_robot_commands": 0.08226104656855265, "deviation-center-line": 1.1720265597834716, "driven_lanedir_consec": 1.143343399810823, "sim_compute_sim_state": 0.04343433141708374, "sim_compute_performance-ego": 0.06993387619654337, "sim_compute_robot_state-ego": 0.06470466454823812, "sim_compute_robot_state-npc0": 0.07992879947026571, "sim_compute_robot_state-npc1": 0.07655198256174724, "sim_compute_robot_state-npc2": 0.07584770282109578, "sim_compute_robot_state-npc3": 0.07596304893493652}, "udem1-1-0": {"driven_any": 0.6424147621501354, "sim_physics": 0.11208113203657434, "survival_time": 4.699999999999991, "driven_lanedir": 0.23160724167811209, "sim_render-ego": 0.07113352481355058, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.22955450098565283, "deviation-heading": 0.7479120421270805, "set_robot_commands": 0.08044720710592067, "deviation-center-line": 0.2467664462159971, "driven_lanedir_consec": 0.23160724167811209, "sim_compute_sim_state": 0.04417085393946221, "sim_compute_performance-ego": 0.0709574856656663, "sim_compute_robot_state-ego": 0.06455721246435288, "sim_compute_robot_state-npc0": 0.08092382106375187, "sim_compute_robot_state-npc1": 0.07730361248584504, "sim_compute_robot_state-npc2": 0.07901184609595766, "sim_compute_robot_state-npc3": 0.07736074163558636}, "udem1-2-0": {"driven_any": 0.5803831483180321, "sim_physics": 0.11328977888280696, "survival_time": 4.399999999999992, "driven_lanedir": 0.2531621545967542, "sim_render-ego": 0.06976882436058739, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.22160226648504083, "deviation-heading": 1.6093861462953691, "set_robot_commands": 0.07967595620588823, "deviation-center-line": 0.19471746667896137, "driven_lanedir_consec": 0.2505902471756509, "sim_compute_sim_state": 0.043572051958604294, "sim_compute_performance-ego": 0.06948117234490135, "sim_compute_robot_state-ego": 0.0628792101686651, "sim_compute_robot_state-npc0": 0.07708990302952853, "sim_compute_robot_state-npc1": 0.0751330093903975, "sim_compute_robot_state-npc2": 0.0754746903072704, "sim_compute_robot_state-npc3": 0.07520203156904741}, "udem1-3-0": {"driven_any": 0.6930163550623264, "sim_physics": 0.11970722458579323, "survival_time": 5.4999999999999885, "driven_lanedir": 0.2936925227677294, "sim_render-ego": 0.07156232703815807, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.2323404463854703, "deviation-heading": 1.3806901130057407, "set_robot_commands": 0.08040655742992055, "deviation-center-line": 0.20084634484832703, "driven_lanedir_consec": 0.2936925227677294, "sim_compute_sim_state": 0.04431368654424494, "sim_compute_performance-ego": 0.07116906642913819, "sim_compute_robot_state-ego": 0.06368557756597346, "sim_compute_robot_state-npc0": 0.07993964932181619, "sim_compute_robot_state-npc1": 0.07719759724356912, "sim_compute_robot_state-npc2": 0.07674057266928933, "sim_compute_robot_state-npc3": 0.07747495607896285}, "udem1-4-0": {"driven_any": 0.726977866558023, "sim_physics": 0.12302914561841312, "survival_time": 7.449999999999981, "driven_lanedir": 0.310660658762115, "sim_render-ego": 0.07072494654047409, "in-drivable-lane": 3.8499999999999863, "agent_compute-ego": 0.2243876185193158, "deviation-heading": 1.2098105969177917, "set_robot_commands": 0.07901706631551653, "deviation-center-line": 0.16532566738797286, "driven_lanedir_consec": 0.310660658762115, "sim_compute_sim_state": 0.042486802043530766, "sim_compute_performance-ego": 0.07143313292688971, "sim_compute_robot_state-ego": 0.06276777766694959, "sim_compute_robot_state-npc0": 0.0784894011964734, "sim_compute_robot_state-npc1": 0.07450772931911802, "sim_compute_robot_state-npc2": 0.07491432900396769, "sim_compute_robot_state-npc3": 0.07593013616216263}, "udem1-5-0": {"driven_any": 0.3978453035301088, "sim_physics": 0.12513487092379866, "survival_time": 2.8999999999999977, "driven_lanedir": 0.11774447930030751, "sim_render-ego": 0.06647004752323546, "in-drivable-lane": 0.9999999999999998, "agent_compute-ego": 0.2197488258624899, "deviation-heading": 1.6925645772410327, "set_robot_commands": 0.07946143890249319, "deviation-center-line": 0.1735437445962933, "driven_lanedir_consec": 0.09758637927766456, "sim_compute_sim_state": 0.0415419915626789, "sim_compute_performance-ego": 0.06844918070168331, "sim_compute_robot_state-ego": 0.06122162835351352, "sim_compute_robot_state-npc0": 0.07531724716054983, "sim_compute_robot_state-npc1": 0.07297790050506592, "sim_compute_robot_state-npc2": 0.0724450843087558, "sim_compute_robot_state-npc3": 0.07322407590931859}, "udem1-6-0": {"driven_any": 1.7164128485614625, "sim_physics": 0.12179917176564536, "survival_time": 14.950000000000076, "driven_lanedir": 0.31826533752536035, "sim_render-ego": 0.06861803452173869, "in-drivable-lane": 11.350000000000076, "agent_compute-ego": 0.21463666359583536, "deviation-heading": 1.5185693859293536, "set_robot_commands": 0.07865565061569214, "deviation-center-line": 0.24228247059434377, "driven_lanedir_consec": 0.31826533752536035, "sim_compute_sim_state": 0.04159240484237671, "sim_compute_performance-ego": 0.06979383865992228, "sim_compute_robot_state-ego": 0.06452231884002685, "sim_compute_robot_state-npc0": 0.07783617893854777, "sim_compute_robot_state-npc1": 0.07389932711919149, "sim_compute_robot_state-npc2": 0.07315255641937256, "sim_compute_robot_state-npc3": 0.07274492343266804}, "udem1-7-0": {"driven_any": 1.5547398647183264, "sim_physics": 0.11901355663935344, "survival_time": 14.950000000000076, "driven_lanedir": 0.9240303057466428, "sim_render-ego": 0.06636511246363322, "in-drivable-lane": 5.850000000000033, "agent_compute-ego": 0.20851443608601888, "deviation-heading": 2.4443341920247557, "set_robot_commands": 0.07750221093495686, "deviation-center-line": 0.8108093504766862, "driven_lanedir_consec": 0.9240303057466428, "sim_compute_sim_state": 0.039584566752115885, "sim_compute_performance-ego": 0.06607524474461873, "sim_compute_robot_state-ego": 0.06339271386464437, "sim_compute_robot_state-npc0": 0.0757525372505188, "sim_compute_robot_state-npc1": 0.07120590845743816, "sim_compute_robot_state-npc2": 0.06956116199493408, "sim_compute_robot_state-npc3": 0.06909144083658854}, "udem1-8-0": {"driven_any": 0.6523104756131728, "sim_physics": 0.1210382867742468, "survival_time": 5.399999999999989, "driven_lanedir": 0.20729196775899483, "sim_render-ego": 0.06816665331522624, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.21824059442237573, "deviation-heading": 0.9291643289602276, "set_robot_commands": 0.0786058019708704, "deviation-center-line": 0.17532429801956018, "driven_lanedir_consec": 0.20729196775899483, "sim_compute_sim_state": 0.041679062225200514, "sim_compute_performance-ego": 0.069049424595303, "sim_compute_robot_state-ego": 0.05992686748504639, "sim_compute_robot_state-npc0": 0.07851631773842706, "sim_compute_robot_state-npc1": 0.07422730437031498, "sim_compute_robot_state-npc2": 0.07239654770603886, "sim_compute_robot_state-npc3": 0.07184279627270168}, "udem1-9-0": {"driven_any": 0.5914292311973395, "sim_physics": 0.11286073542655782, "survival_time": 4.699999999999991, "driven_lanedir": 0.26453356304097864, "sim_render-ego": 0.07094769528571596, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.21552599490957056, "deviation-heading": 1.307620896559932, "set_robot_commands": 0.08190311015920436, "deviation-center-line": 0.2290836275229732, "driven_lanedir_consec": 0.2608955663992025, "sim_compute_sim_state": 0.04160208397723259, "sim_compute_performance-ego": 0.07002049050432571, "sim_compute_robot_state-ego": 0.062130770784743286, "sim_compute_robot_state-npc0": 0.07776916534342665, "sim_compute_robot_state-npc1": 0.07679729512397279, "sim_compute_robot_state-npc2": 0.07557405563111001, "sim_compute_robot_state-npc3": 0.0747294045509176}, "udem1-10-0": {"driven_any": 1.309652357436689, "sim_physics": 0.11141338030497232, "survival_time": 14.950000000000076, "driven_lanedir": 0.817590323250172, "sim_render-ego": 0.07098621447881062, "in-drivable-lane": 5.750000000000014, "agent_compute-ego": 0.21626368443171184, "deviation-heading": 2.4259984256123848, "set_robot_commands": 0.0803896975517273, "deviation-center-line": 0.7114420579876652, "driven_lanedir_consec": 0.817590323250172, "sim_compute_sim_state": 0.04378805875778198, "sim_compute_performance-ego": 0.07245668172836303, "sim_compute_robot_state-ego": 0.062422634760538734, "sim_compute_robot_state-npc0": 0.07889632701873779, "sim_compute_robot_state-npc1": 0.07683469216028849, "sim_compute_robot_state-npc2": 0.07657650629679362, "sim_compute_robot_state-npc3": 0.07706924120585124}, "udem1-11-0": {"driven_any": 1.5723708749552083, "sim_physics": 0.1109466748451119, "survival_time": 13.400000000000055, "driven_lanedir": 0.6072409125125113, "sim_render-ego": 0.07122815367001206, "in-drivable-lane": 6.850000000000019, "agent_compute-ego": 0.2208186930684901, "deviation-heading": 2.558394372300888, "set_robot_commands": 0.07964937633542872, "deviation-center-line": 0.5854212300230356, "driven_lanedir_consec": 0.6072409125125113, "sim_compute_sim_state": 0.04323711946829042, "sim_compute_performance-ego": 0.07265617509386432, "sim_compute_robot_state-ego": 0.06301078778594288, "sim_compute_robot_state-npc0": 0.07890624430642199, "sim_compute_robot_state-npc1": 0.07683428454754958, "sim_compute_robot_state-npc2": 0.07538075856308439, "sim_compute_robot_state-npc3": 0.07497248720766893}, "udem1-12-0": {"driven_any": 0.4505118928051962, "sim_physics": 0.11083926054147572, "survival_time": 3.2499999999999964, "driven_lanedir": 0.13117238648572327, "sim_render-ego": 0.07022198163546049, "in-drivable-lane": 1.6999999999999955, "agent_compute-ego": 0.2267506269308237, "deviation-heading": 0.6850290349648949, "set_robot_commands": 0.07899380463820238, "deviation-center-line": 0.16089230400188598, "driven_lanedir_consec": 0.13117238648572327, "sim_compute_sim_state": 0.039183950424194335, "sim_compute_performance-ego": 0.06238543803875263, "sim_compute_robot_state-ego": 0.05743253781245305, "sim_compute_robot_state-npc0": 0.07224095784700833, "sim_compute_robot_state-npc1": 0.06923570999732384, "sim_compute_robot_state-npc2": 0.06858100524315468, "sim_compute_robot_state-npc3": 0.06897757970369779}, "udem1-13-0": {"driven_any": 0.5458419364958047, "sim_physics": 0.10868728308030116, "survival_time": 4.049999999999994, "driven_lanedir": 0.20743957123293688, "sim_render-ego": 0.07064011950551728, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.22055917610356837, "deviation-heading": 1.1269147480263744, "set_robot_commands": 0.08052765292885863, "deviation-center-line": 0.1428855896189655, "driven_lanedir_consec": 0.20743957123293688, "sim_compute_sim_state": 0.04291200932161308, "sim_compute_performance-ego": 0.0726225111219618, "sim_compute_robot_state-ego": 0.06272595605732482, "sim_compute_robot_state-npc0": 0.07789437270458834, "sim_compute_robot_state-npc1": 0.07688819037543403, "sim_compute_robot_state-npc2": 0.07726891835530598, "sim_compute_robot_state-npc3": 0.07480007630807382}, "udem1-14-0": {"driven_any": 0.5311329238547909, "sim_physics": 0.1353218445832702, "survival_time": 4.3499999999999925, "driven_lanedir": 0.20319271601500863, "sim_render-ego": 0.07166767120361328, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.24733241399129233, "deviation-heading": 1.3680174783591983, "set_robot_commands": 0.08313628448837104, "deviation-center-line": 0.14902156060765684, "driven_lanedir_consec": 0.20254393010316463, "sim_compute_sim_state": 0.043123349376108455, "sim_compute_performance-ego": 0.07053468693261859, "sim_compute_robot_state-ego": 0.06581710946970973, "sim_compute_robot_state-npc0": 0.0809265361435112, "sim_compute_robot_state-npc1": 0.07680705772049126, "sim_compute_robot_state-npc2": 0.07717037474972079, "sim_compute_robot_state-npc3": 0.07630457549259581}}
set_robot_commands_max0.08313628448837104
set_robot_commands_mean0.0800421908101069
set_robot_commands_median0.07967595620588823
set_robot_commands_min0.07750221093495686
sim_compute_performance-ego_max0.07265617509386432
sim_compute_performance-ego_mean0.06980122704563682
sim_compute_performance-ego_median0.07002049050432571
sim_compute_performance-ego_min0.06238543803875263
sim_compute_robot_state-ego_max0.06581710946970973
sim_compute_robot_state-ego_mean0.06274651784187485
sim_compute_robot_state-ego_median0.0628792101686651
sim_compute_robot_state-ego_min0.05743253781245305
sim_compute_robot_state-npc0_max0.0809265361435112
sim_compute_robot_state-npc0_mean0.07802849723557156
sim_compute_robot_state-npc0_median0.0784894011964734
sim_compute_robot_state-npc0_min0.07224095784700833
sim_compute_robot_state-npc1_max0.07730361248584504
sim_compute_robot_state-npc1_mean0.07509344009184984
sim_compute_robot_state-npc1_median0.07655198256174724
sim_compute_robot_state-npc1_min0.06923570999732384
sim_compute_robot_state-npc2_max0.07901184609595766
sim_compute_robot_state-npc2_mean0.07467307401105677
sim_compute_robot_state-npc2_median0.0754746903072704
sim_compute_robot_state-npc2_min0.06858100524315468
sim_compute_robot_state-npc3_max0.07747495607896285
sim_compute_robot_state-npc3_mean0.07437916768671851
sim_compute_robot_state-npc3_median0.07497248720766893
sim_compute_robot_state-npc3_min0.06897757970369779
sim_compute_sim_state_max0.04431368654424494
sim_compute_sim_state_mean0.04241482150736792
sim_compute_sim_state_median0.04291200932161308
sim_compute_sim_state_min0.039183950424194335
sim_physics_max0.1353218445832702
sim_physics_mean0.11783327116190728
sim_physics_median0.11901355663935344
sim_physics_min0.10868728308030116
sim_render-ego_max0.07166767120361328
sim_render-ego_mean0.06999882459512939
sim_render-ego_median0.07072494654047409
sim_render-ego_min0.06636511246363322
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.993333333333352
survival_time_min2.8999999999999977
217562964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:58:40
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2964/step1-simulation-ip-172-31-42-167-7227-job21756/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217362964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:31:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2964/step1-simulation-ip-172-31-38-104-5376-job21736/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216872964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:37
I can see how the jo [...]
I can see how the job 21687 is timeout because passed 3937 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216622964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:31:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 484, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2964/step1-simulation-ip-172-31-40-253-31940-job21662/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209042964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:44:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2614593202358675
survival_time_median5.4999999999999885
deviation-center-line_median0.20148444194673792
in-drivable-lane_median2.249999999999992


other stats
agent_compute-ego_max0.20115523228700133
agent_compute-ego_mean0.17995209691442504
agent_compute-ego_median0.17364183823267618
agent_compute-ego_min0.16805358336005413
deviation-center-line_max1.0966852117217885
deviation-center-line_mean0.35093894337605197
deviation-center-line_min0.13278148023730907
deviation-heading_max4.768308438086855
deviation-heading_mean1.8311774328133448
deviation-heading_median1.3735883942288474
deviation-heading_min0.7330787532144281
driven_any_max1.71568579325213
driven_any_mean0.8405156524574232
driven_any_median0.6948370775802656
driven_any_min0.39703819588727823
driven_lanedir_consec_max0.9920380425578708
driven_lanedir_consec_mean0.3906420393468203
driven_lanedir_consec_min0.09746958616672874
driven_lanedir_max0.9920380425578708
driven_lanedir_mean0.3971546010074819
driven_lanedir_median0.2665530376720202
driven_lanedir_min0.11615128251271888
in-drivable-lane_max6.000000000000006
in-drivable-lane_mean3.01333333333333
in-drivable-lane_min0.9999999999999998
per-episodes
details{"udem1-0-0": {"driven_any": 1.1687440866105778, "sim_physics": 0.11376765766880544, "survival_time": 11.65000000000003, "driven_lanedir": 0.9024188827554402, "sim_render-ego": 0.05074297716689212, "in-drivable-lane": 1.7499999999999991, "agent_compute-ego": 0.16894536570929664, "deviation-heading": 3.487309960719762, "set_robot_commands": 0.07348392654386202, "deviation-center-line": 1.0966852117217885, "driven_lanedir_consec": 0.8971327764351686, "sim_compute_sim_state": 0.03236296146212729, "sim_compute_performance-ego": 0.05477400399072999, "sim_compute_robot_state-ego": 0.057669582285082906, "sim_compute_robot_state-npc0": 0.059169901287095227, "sim_compute_robot_state-npc1": 0.05663930090711864, "sim_compute_robot_state-npc2": 0.05601102395119074, "sim_compute_robot_state-npc3": 0.056085898640841375}, "udem1-1-0": {"driven_any": 1.0418901434485732, "sim_physics": 0.10369664682468896, "survival_time": 7.099999999999983, "driven_lanedir": 0.196003202758098, "sim_render-ego": 0.05132794548088397, "in-drivable-lane": 4.899999999999983, "agent_compute-ego": 0.16805358336005413, "deviation-heading": 0.7330787532144281, "set_robot_commands": 0.07400380389791139, "deviation-center-line": 0.22174985939034883, "driven_lanedir_consec": 0.196003202758098, "sim_compute_sim_state": 0.03167148543075776, "sim_compute_performance-ego": 0.05481727022520253, "sim_compute_robot_state-ego": 0.05687777425201846, "sim_compute_robot_state-npc0": 0.05817106743933449, "sim_compute_robot_state-npc1": 0.057037766550628234, "sim_compute_robot_state-npc2": 0.05584440768604547, "sim_compute_robot_state-npc3": 0.05510476945151745}, "udem1-2-0": {"driven_any": 0.5603011586281277, "sim_physics": 0.108105548790523, "survival_time": 4.199999999999993, "driven_lanedir": 0.25454165140795393, "sim_render-ego": 0.05173887241454352, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17022910288402013, "deviation-heading": 2.069494250888107, "set_robot_commands": 0.07469237702233451, "deviation-center-line": 0.21589417909522465, "driven_lanedir_consec": 0.23997882535839743, "sim_compute_sim_state": 0.03173696994781494, "sim_compute_performance-ego": 0.054576476414998375, "sim_compute_robot_state-ego": 0.056095228308723086, "sim_compute_robot_state-npc0": 0.057593708946591333, "sim_compute_robot_state-npc1": 0.05644391548065912, "sim_compute_robot_state-npc2": 0.05525606870651245, "sim_compute_robot_state-npc3": 0.05495929718017578}, "udem1-3-0": {"driven_any": 0.6948370775802656, "sim_physics": 0.11110994382338092, "survival_time": 5.4999999999999885, "driven_lanedir": 0.2933463062782431, "sim_render-ego": 0.05162077383561568, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.17133087895133278, "deviation-heading": 1.3848957762859535, "set_robot_commands": 0.07457157265056263, "deviation-center-line": 0.20148444194673792, "driven_lanedir_consec": 0.2933463062782431, "sim_compute_sim_state": 0.031345276399092244, "sim_compute_performance-ego": 0.0556333065032959, "sim_compute_robot_state-ego": 0.056174733422019264, "sim_compute_robot_state-npc0": 0.0574619401584972, "sim_compute_robot_state-npc1": 0.055978582122109155, "sim_compute_robot_state-npc2": 0.05556507110595703, "sim_compute_robot_state-npc3": 0.05546391227028587}, "udem1-4-0": {"driven_any": 0.7288989512041975, "sim_physics": 0.11699689934585268, "survival_time": 7.549999999999981, "driven_lanedir": 0.3108966353171312, "sim_render-ego": 0.05104012047218171, "in-drivable-lane": 3.949999999999986, "agent_compute-ego": 0.17167237420745243, "deviation-heading": 1.2057277035626046, "set_robot_commands": 0.0740720388905102, "deviation-center-line": 0.16464601254740208, "driven_lanedir_consec": 0.3108966353171312, "sim_compute_sim_state": 0.03172972975977209, "sim_compute_performance-ego": 0.05452235013443903, "sim_compute_robot_state-ego": 0.05669951596796907, "sim_compute_robot_state-npc0": 0.058466091850735494, "sim_compute_robot_state-npc1": 0.05685392278709159, "sim_compute_robot_state-npc2": 0.05590919311472912, "sim_compute_robot_state-npc3": 0.05624474121245327}, "udem1-5-0": {"driven_any": 0.39703819588727823, "sim_physics": 0.11428195854713176, "survival_time": 2.8999999999999977, "driven_lanedir": 0.11615128251271888, "sim_render-ego": 0.04991019594258275, "in-drivable-lane": 0.9999999999999998, "agent_compute-ego": 0.17372907441237878, "deviation-heading": 1.701244101221442, "set_robot_commands": 0.07349815450865647, "deviation-center-line": 0.17209960799028748, "driven_lanedir_consec": 0.09746958616672874, "sim_compute_sim_state": 0.03133227496311582, "sim_compute_performance-ego": 0.054336704056838464, "sim_compute_robot_state-ego": 0.05663008936520281, "sim_compute_robot_state-npc0": 0.05836110690544392, "sim_compute_robot_state-npc1": 0.057562108697562384, "sim_compute_robot_state-npc2": 0.056184439823545256, "sim_compute_robot_state-npc3": 0.05647498985816692}, "udem1-6-0": {"driven_any": 0.7246257970830159, "sim_physics": 0.11563424212591988, "survival_time": 6.999999999999983, "driven_lanedir": 0.2921563433076231, "sim_render-ego": 0.05175898926598685, "in-drivable-lane": 3.7999999999999865, "agent_compute-ego": 0.17336009911128453, "deviation-heading": 1.1832894221215495, "set_robot_commands": 0.07352454151426042, "deviation-center-line": 0.17883377510998882, "driven_lanedir_consec": 0.2921563433076231, "sim_compute_sim_state": 0.03154749529702323, "sim_compute_performance-ego": 0.05509035587310791, "sim_compute_robot_state-ego": 0.057632340703691755, "sim_compute_robot_state-npc0": 0.05943054301398141, "sim_compute_robot_state-npc1": 0.056439171518598286, "sim_compute_robot_state-npc2": 0.05625057561056954, "sim_compute_robot_state-npc3": 0.05588614089148385}, "udem1-7-0": {"driven_any": 1.4989751912048106, "sim_physics": 0.1180981437365214, "survival_time": 14.950000000000076, "driven_lanedir": 0.9920380425578708, "sim_render-ego": 0.057589324315389, "in-drivable-lane": 4.8500000000000165, "agent_compute-ego": 0.1888369901974996, "deviation-heading": 2.593321914364914, "set_robot_commands": 0.07779950062433878, "deviation-center-line": 0.8930830658836169, "driven_lanedir_consec": 0.9920380425578708, "sim_compute_sim_state": 0.03445927381515503, "sim_compute_performance-ego": 0.061201210816701254, "sim_compute_robot_state-ego": 0.061458560625712075, "sim_compute_robot_state-npc0": 0.06542396227518718, "sim_compute_robot_state-npc1": 0.06150665044784546, "sim_compute_robot_state-npc2": 0.060377533435821536, "sim_compute_robot_state-npc3": 0.061813377539316816}, "udem1-8-0": {"driven_any": 0.650083946579263, "sim_physics": 0.12330730535365918, "survival_time": 5.399999999999989, "driven_lanedir": 0.2073790035791512, "sim_render-ego": 0.05498419867621528, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.1767549956286395, "deviation-heading": 0.9292646291509512, "set_robot_commands": 0.07345484141950254, "deviation-center-line": 0.1753805611732481, "driven_lanedir_consec": 0.2073790035791512, "sim_compute_sim_state": 0.03312425480948554, "sim_compute_performance-ego": 0.05710254554395323, "sim_compute_robot_state-ego": 0.05843195650312635, "sim_compute_robot_state-npc0": 0.06042832798428006, "sim_compute_robot_state-npc1": 0.05799392859141032, "sim_compute_robot_state-npc2": 0.0574784102263274, "sim_compute_robot_state-npc3": 0.05737602489965933}, "udem1-9-0": {"driven_any": 0.5799724284291642, "sim_physics": 0.11471346927725752, "survival_time": 4.599999999999992, "driven_lanedir": 0.2665530376720202, "sim_render-ego": 0.051897668320199715, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.173581978549128, "deviation-heading": 1.3735883942288474, "set_robot_commands": 0.07537143904229869, "deviation-center-line": 0.23386615957645104, "driven_lanedir_consec": 0.2614593202358675, "sim_compute_sim_state": 0.03266076937965725, "sim_compute_performance-ego": 0.05615997832754384, "sim_compute_robot_state-ego": 0.05787561769070833, "sim_compute_robot_state-npc0": 0.06105224723401277, "sim_compute_robot_state-npc1": 0.058115655961244, "sim_compute_robot_state-npc2": 0.05756708590880684, "sim_compute_robot_state-npc3": 0.05796323651852815}, "udem1-10-0": {"driven_any": 1.2950824283814402, "sim_physics": 0.10883115768432618, "survival_time": 14.950000000000076, "driven_lanedir": 0.8000311170495698, "sim_render-ego": 0.05200765609741211, "in-drivable-lane": 5.750000000000016, "agent_compute-ego": 0.17364183823267618, "deviation-heading": 2.5926571175162296, "set_robot_commands": 0.07406233231226603, "deviation-center-line": 0.6717952001889067, "driven_lanedir_consec": 0.8000311170495698, "sim_compute_sim_state": 0.03304048617680867, "sim_compute_performance-ego": 0.056444666385650634, "sim_compute_robot_state-ego": 0.05833124399185181, "sim_compute_robot_state-npc0": 0.05935145854949951, "sim_compute_robot_state-npc1": 0.05760382890701294, "sim_compute_robot_state-npc2": 0.056926886240641274, "sim_compute_robot_state-npc3": 0.057114028930664064}, "udem1-11-0": {"driven_any": 1.71568579325213, "sim_physics": 0.1138234086845756, "survival_time": 13.850000000000062, "driven_lanedir": 0.7598949455224013, "sim_render-ego": 0.05786789797703712, "in-drivable-lane": 6.000000000000006, "agent_compute-ego": 0.19076667795973137, "deviation-heading": 4.768308438086855, "set_robot_commands": 0.07773051020901126, "deviation-center-line": 0.5481409563560539, "driven_lanedir_consec": 0.7100766338581339, "sim_compute_sim_state": 0.03471647531116912, "sim_compute_performance-ego": 0.06074373730683585, "sim_compute_robot_state-ego": 0.06327199333411261, "sim_compute_robot_state-npc0": 0.06790108629082084, "sim_compute_robot_state-npc1": 0.06315239069694216, "sim_compute_robot_state-npc2": 0.06207063740341242, "sim_compute_robot_state-npc3": 0.061937011966636465}, "udem1-12-0": {"driven_any": 0.441710194969058, "sim_physics": 0.12159648675184984, "survival_time": 3.2499999999999964, "driven_lanedir": 0.13714308178727275, "sim_render-ego": 0.05989640309260442, "in-drivable-lane": 1.3999999999999966, "agent_compute-ego": 0.20020766258239747, "deviation-heading": 1.0697418372863186, "set_robot_commands": 0.07774308644808256, "deviation-center-line": 0.19946905157429817, "driven_lanedir_consec": 0.1328973146935839, "sim_compute_sim_state": 0.03598635013286884, "sim_compute_performance-ego": 0.06296831644498385, "sim_compute_robot_state-ego": 0.06443236057574932, "sim_compute_robot_state-npc0": 0.07540790117703951, "sim_compute_robot_state-npc1": 0.06591896644005409, "sim_compute_robot_state-npc2": 0.06526944087101863, "sim_compute_robot_state-npc3": 0.06275881253756009}, "udem1-13-0": {"driven_any": 0.579600214570104, "sim_physics": 0.11524528054630057, "survival_time": 4.249999999999993, "driven_lanedir": 0.22618072538931555, "sim_render-ego": 0.057938730015474206, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1970155996434829, "deviation-heading": 1.161462009615178, "set_robot_commands": 0.07551562365363626, "deviation-center-line": 0.1581745878491176, "driven_lanedir_consec": 0.22618072538931555, "sim_compute_sim_state": 0.035770573335535384, "sim_compute_performance-ego": 0.06296981362735524, "sim_compute_robot_state-ego": 0.06488603704115924, "sim_compute_robot_state-npc0": 0.06814827077529009, "sim_compute_robot_state-npc1": 0.06461084309746237, "sim_compute_robot_state-npc2": 0.06438907735487993, "sim_compute_robot_state-npc3": 0.06285889849943273}, "udem1-14-0": {"driven_any": 0.5302891790333447, "sim_physics": 0.13320408196284853, "survival_time": 4.3499999999999925, "driven_lanedir": 0.2025847572174209, "sim_render-ego": 0.059751633940071894, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.20115523228700133, "deviation-heading": 1.2142771839370263, "set_robot_commands": 0.07692872244736244, "deviation-center-line": 0.13278148023730907, "driven_lanedir_consec": 0.2025847572174209, "sim_compute_sim_state": 0.03530379821514261, "sim_compute_performance-ego": 0.0625304161817178, "sim_compute_robot_state-ego": 0.06365796615337503, "sim_compute_robot_state-npc0": 0.07093156891307612, "sim_compute_robot_state-npc1": 0.06509886390861423, "sim_compute_robot_state-npc2": 0.06270222554261658, "sim_compute_robot_state-npc3": 0.06364983525769465}}
set_robot_commands_max0.07779950062433878
set_robot_commands_mean0.07509683141230641
set_robot_commands_median0.07457157265056263
set_robot_commands_min0.07345484141950254
sim_compute_performance-ego_max0.06296981362735524
sim_compute_performance-ego_mean0.057591410122223595
sim_compute_performance-ego_median0.05615997832754384
sim_compute_performance-ego_min0.054336704056838464
sim_compute_robot_state-ego_max0.06488603704115924
sim_compute_robot_state-ego_mean0.05934166668136682
sim_compute_robot_state-ego_median0.05787561769070833
sim_compute_robot_state-ego_min0.056095228308723086
sim_compute_robot_state-npc0_max0.07540790117703951
sim_compute_robot_state-npc0_mean0.06248661218672568
sim_compute_robot_state-npc0_median0.05943054301398141
sim_compute_robot_state-npc0_min0.0574619401584972
sim_compute_robot_state-npc1_max0.06591896644005409
sim_compute_robot_state-npc1_mean0.05939705974095687
sim_compute_robot_state-npc1_median0.05760382890701294
sim_compute_robot_state-npc1_min0.055978582122109155
sim_compute_robot_state-npc2_max0.06526944087101863
sim_compute_robot_state-npc2_mean0.058520138465471626
sim_compute_robot_state-npc2_median0.056926886240641274
sim_compute_robot_state-npc2_min0.05525606870651245
sim_compute_robot_state-npc3_max0.06364983525769465
sim_compute_robot_state-npc3_mean0.05837939837696113
sim_compute_robot_state-npc3_median0.057114028930664064
sim_compute_robot_state-npc3_min0.05495929718017578
sim_compute_sim_state_max0.03598635013286884
sim_compute_sim_state_mean0.033119211629035056
sim_compute_sim_state_median0.03266076937965725
sim_compute_sim_state_min0.03133227496311582
sim_physics_max0.13320408196284853
sim_physics_mean0.11549414874157608
sim_physics_median0.11471346927725752
sim_physics_min0.10369664682468896
sim_render-ego_max0.05989640309260442
sim_render-ego_mean0.05400489246753935
sim_render-ego_median0.051897668320199715
sim_render-ego_min0.04991019594258275
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.4333333333333425
survival_time_min2.8999999999999977
207772964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2964/step1-simulation-ip-172-31-38-104-5317-job20777/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
207602964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:41:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2964/step1-simulation-ip-172-31-42-167-7194-job20760/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202292964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:16:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2902258034004441
survival_time_median5.599999999999988
deviation-center-line_median0.21165362963141215
in-drivable-lane_median2.299999999999992


other stats
agent_compute-ego_max0.1899690024058024
agent_compute-ego_mean0.18647500329640523
agent_compute-ego_median0.18638830686870375
agent_compute-ego_min0.18315189812570956
deviation-center-line_max0.7798338312848856
deviation-center-line_mean0.32037913272849694
deviation-center-line_min0.18004373482074018
deviation-heading_max3.483904891147005
deviation-heading_mean1.7484126613702622
deviation-heading_median1.4122990945778853
deviation-heading_min0.7443834236005582
driven_any_max1.3872081427975853
driven_any_mean0.892887906286784
driven_any_median0.6940982220996107
driven_any_min0.5707747139086313
driven_lanedir_consec_max0.84044513478798
driven_lanedir_consec_mean0.3795444430343523
driven_lanedir_consec_min0.19961050775602152
driven_lanedir_max0.841975384499321
driven_lanedir_mean0.3812307845530837
driven_lanedir_median0.2902258034004441
driven_lanedir_min0.19961050775602152
in-drivable-lane_max11.200000000000085
in-drivable-lane_mean3.8700000000000103
in-drivable-lane_min1.2499999999999956
per-episodes
details{"udem1-0-0": {"driven_any": 1.1592936480529097, "sim_physics": 0.11825765999667164, "survival_time": 10.15000000000001, "driven_lanedir": 0.841975384499321, "sim_render-ego": 0.05720885633835064, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.18315189812570956, "deviation-heading": 3.483904891147005, "set_robot_commands": 0.07617651887715156, "deviation-center-line": 0.7798338312848856, "driven_lanedir_consec": 0.84044513478798, "sim_compute_sim_state": 0.03506272297187392, "sim_compute_performance-ego": 0.060611480562557725, "sim_compute_robot_state-ego": 0.059516205576253055, "sim_compute_robot_state-npc0": 0.0668342113494873, "sim_compute_robot_state-npc1": 0.06304472420603184, "sim_compute_robot_state-npc2": 0.061746530344920794, "sim_compute_robot_state-npc3": 0.061189646791354774}, "udem1-1-0": {"driven_any": 0.6530648045751835, "sim_physics": 0.10064034963908948, "survival_time": 4.749999999999991, "driven_lanedir": 0.19961050775602152, "sim_render-ego": 0.06003042020295796, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.18638830686870375, "deviation-heading": 0.7443834236005582, "set_robot_commands": 0.07520416912279632, "deviation-center-line": 0.22589370265760284, "driven_lanedir_consec": 0.19961050775602152, "sim_compute_sim_state": 0.035259003388254266, "sim_compute_performance-ego": 0.060507844623766446, "sim_compute_robot_state-ego": 0.06108918691936292, "sim_compute_robot_state-npc0": 0.06925985185723556, "sim_compute_robot_state-npc1": 0.06331361218502647, "sim_compute_robot_state-npc2": 0.062865023863943, "sim_compute_robot_state-npc3": 0.0633930432169061}, "udem1-2-0": {"driven_any": 0.5707747139086313, "sim_physics": 0.09629485524933912, "survival_time": 4.3499999999999925, "driven_lanedir": 0.25492083618776196, "sim_render-ego": 0.05755391066101776, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.18615525344322467, "deviation-heading": 1.8458932643677044, "set_robot_commands": 0.0785784091072521, "deviation-center-line": 0.21165362963141215, "driven_lanedir_consec": 0.2480193783054463, "sim_compute_sim_state": 0.03522609020101613, "sim_compute_performance-ego": 0.06071082750956217, "sim_compute_robot_state-ego": 0.05926570399054166, "sim_compute_robot_state-npc0": 0.06685807787138841, "sim_compute_robot_state-npc1": 0.06376710705373478, "sim_compute_robot_state-npc2": 0.06190939607291386, "sim_compute_robot_state-npc3": 0.060101199424129795}, "udem1-3-0": {"driven_any": 0.6940982220996107, "sim_physics": 0.10827724422727313, "survival_time": 5.599999999999988, "driven_lanedir": 0.2902258034004441, "sim_render-ego": 0.05715474486351013, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.18671055563858577, "deviation-heading": 1.4122990945778853, "set_robot_commands": 0.07444057720048088, "deviation-center-line": 0.2044707652478439, "driven_lanedir_consec": 0.2902258034004441, "sim_compute_sim_state": 0.035577629293714254, "sim_compute_performance-ego": 0.06117759219237736, "sim_compute_robot_state-ego": 0.058998012116977146, "sim_compute_robot_state-npc0": 0.06880599686077662, "sim_compute_robot_state-npc1": 0.06311775531087603, "sim_compute_robot_state-npc2": 0.06158144984926496, "sim_compute_robot_state-npc3": 0.06079065586839403}, "udem1-4-0": {"driven_any": 1.3872081427975853, "sim_physics": 0.1252780040105184, "survival_time": 14.950000000000076, "driven_lanedir": 0.31942139092186994, "sim_render-ego": 0.05935331185658773, "in-drivable-lane": 11.200000000000085, "agent_compute-ego": 0.1899690024058024, "deviation-heading": 1.2555826331581574, "set_robot_commands": 0.07639591773351033, "deviation-center-line": 0.18004373482074018, "driven_lanedir_consec": 0.31942139092186994, "sim_compute_sim_state": 0.03553223450978597, "sim_compute_performance-ego": 0.06261487325032553, "sim_compute_robot_state-ego": 0.06061438004175822, "sim_compute_robot_state-npc0": 0.0687888518969218, "sim_compute_robot_state-npc1": 0.06450204054514568, "sim_compute_robot_state-npc2": 0.06355435848236084, "sim_compute_robot_state-npc3": 0.06340546607971191}}
set_robot_commands_max0.0785784091072521
set_robot_commands_mean0.07615911840823823
set_robot_commands_median0.07617651887715156
set_robot_commands_min0.07444057720048088
sim_compute_performance-ego_max0.06261487325032553
sim_compute_performance-ego_mean0.06112452362771785
sim_compute_performance-ego_median0.06071082750956217
sim_compute_performance-ego_min0.060507844623766446
sim_compute_robot_state-ego_max0.06108918691936292
sim_compute_robot_state-ego_mean0.0598966977289786
sim_compute_robot_state-ego_median0.059516205576253055
sim_compute_robot_state-ego_min0.058998012116977146
sim_compute_robot_state-npc0_max0.06925985185723556
sim_compute_robot_state-npc0_mean0.06810939796716195
sim_compute_robot_state-npc0_median0.0687888518969218
sim_compute_robot_state-npc0_min0.0668342113494873
sim_compute_robot_state-npc1_max0.06450204054514568
sim_compute_robot_state-npc1_mean0.06354904786016297
sim_compute_robot_state-npc1_median0.06331361218502647
sim_compute_robot_state-npc1_min0.06304472420603184
sim_compute_robot_state-npc2_max0.06355435848236084
sim_compute_robot_state-npc2_mean0.06233135172268069
sim_compute_robot_state-npc2_median0.06190939607291386
sim_compute_robot_state-npc2_min0.06158144984926496
sim_compute_robot_state-npc3_max0.06340546607971191
sim_compute_robot_state-npc3_mean0.06177600227609933
sim_compute_robot_state-npc3_median0.061189646791354774
sim_compute_robot_state-npc3_min0.060101199424129795
sim_compute_sim_state_max0.035577629293714254
sim_compute_sim_state_mean0.0353315360729289
sim_compute_sim_state_median0.035259003388254266
sim_compute_sim_state_min0.03506272297187392
sim_physics_max0.1252780040105184
sim_physics_mean0.10974962262457837
sim_physics_median0.10827724422727313
sim_physics_min0.09629485524933912
sim_render-ego_max0.06003042020295796
sim_render-ego_mean0.058260248784484846
sim_render-ego_median0.05755391066101776
sim_render-ego_min0.05715474486351013
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.960000000000011
survival_time_min4.3499999999999925
201532964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:12:18
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20153-493133', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20153-493133', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20153-493133', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
200562964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:25:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.28852556745626456
survival_time_median7.549999999999981
deviation-center-line_median0.20933429762150513
in-drivable-lane_median2.6500000000000155


other stats
agent_compute-ego_max0.22667296896589564
agent_compute-ego_mean0.2146758451649023
agent_compute-ego_median0.21437691025814767
agent_compute-ego_min0.198419517239198
deviation-center-line_max1.2149497111474865
deviation-center-line_mean0.42977013848893914
deviation-center-line_min0.169035697673801
deviation-heading_max4.572094143268666
deviation-heading_mean2.0168080070037737
deviation-heading_median1.3848106940050038
deviation-heading_min1.2201731485486895
driven_any_max1.9136517617450857
driven_any_mean1.1055803677406917
driven_any_median0.725672618711466
driven_any_min0.596295975495364
driven_lanedir_consec_max1.1822037233566394
driven_lanedir_consec_mean0.46469886307422026
driven_lanedir_consec_min0.2743304061908669
driven_lanedir_max1.1896137038682304
driven_lanedir_mean0.46808633077117345
driven_lanedir_median0.2944055281647606
driven_lanedir_min0.2753525262923193
in-drivable-lane_max11.80000000000008
in-drivable-lane_mean4.250000000000014
in-drivable-lane_min1.3499999999999952
per-episodes
details{"udem1-0-0": {"driven_any": 1.684111005706507, "sim_physics": 0.20366616491544048, "survival_time": 14.750000000000076, "driven_lanedir": 1.1896137038682304, "sim_render-ego": 0.0639378790128029, "in-drivable-lane": 2.6500000000000155, "agent_compute-ego": 0.21437691025814767, "deviation-heading": 4.572094143268666, "set_robot_commands": 0.09874478033033468, "deviation-center-line": 1.2149497111474865, "driven_lanedir_consec": 1.1822037233566394, "sim_compute_sim_state": 0.03769048432172355, "sim_compute_performance-ego": 0.06802665015398446, "sim_compute_robot_state-ego": 0.07205164796214993, "sim_compute_robot_state-npc0": 0.06964295354940124, "sim_compute_robot_state-npc1": 0.0695178387528759, "sim_compute_robot_state-npc2": 0.06974900213338561, "sim_compute_robot_state-npc3": 0.06823953127456923}, "udem1-1-0": {"driven_any": 0.596295975495364, "sim_physics": 0.1557772544899372, "survival_time": 4.94999999999999, "driven_lanedir": 0.2944055281647606, "sim_render-ego": 0.062235032669221514, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.208283812108666, "deviation-heading": 1.2762971127742415, "set_robot_commands": 0.09465441077646584, "deviation-center-line": 0.36142512003955835, "driven_lanedir_consec": 0.28852556745626456, "sim_compute_sim_state": 0.03879384079364815, "sim_compute_performance-ego": 0.06704639906835075, "sim_compute_robot_state-ego": 0.06987935364848435, "sim_compute_robot_state-npc0": 0.06908356059681285, "sim_compute_robot_state-npc1": 0.06732245165892321, "sim_compute_robot_state-npc2": 0.06604079766706987, "sim_compute_robot_state-npc3": 0.067379481864698}, "udem1-2-0": {"driven_any": 1.9136517617450857, "sim_physics": 0.2012199076016744, "survival_time": 14.950000000000076, "driven_lanedir": 0.2753525262923193, "sim_render-ego": 0.06359177668889364, "in-drivable-lane": 11.80000000000008, "agent_compute-ego": 0.22562601725260417, "deviation-heading": 1.3848106940050038, "set_robot_commands": 0.09926456054051716, "deviation-center-line": 0.19410586596234464, "driven_lanedir_consec": 0.2753525262923193, "sim_compute_sim_state": 0.04011881192525228, "sim_compute_performance-ego": 0.07114884455998739, "sim_compute_robot_state-ego": 0.07660428762435913, "sim_compute_robot_state-npc0": 0.07134606997172038, "sim_compute_robot_state-npc1": 0.07083915313084921, "sim_compute_robot_state-npc2": 0.07041934251785278, "sim_compute_robot_state-npc3": 0.07067558368047079}, "udem1-3-0": {"driven_any": 0.6081704770450342, "sim_physics": 0.1893977535531876, "survival_time": 4.699999999999991, "driven_lanedir": 0.27797780345554624, "sim_render-ego": 0.06299531967081923, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.22667296896589564, "deviation-heading": 1.6306649364222665, "set_robot_commands": 0.09987947535007556, "deviation-center-line": 0.20933429762150513, "driven_lanedir_consec": 0.2743304061908669, "sim_compute_sim_state": 0.04183936372716376, "sim_compute_performance-ego": 0.07106161624827284, "sim_compute_robot_state-ego": 0.07584684960385586, "sim_compute_robot_state-npc0": 0.07517171413340468, "sim_compute_robot_state-npc1": 0.07226665730172015, "sim_compute_robot_state-npc2": 0.07224392383656603, "sim_compute_robot_state-npc3": 0.07413249066535463}, "udem1-4-0": {"driven_any": 0.725672618711466, "sim_physics": 0.17338339224556423, "survival_time": 7.549999999999981, "driven_lanedir": 0.303082092075011, "sim_render-ego": 0.05420536868619603, "in-drivable-lane": 3.949999999999986, "agent_compute-ego": 0.198419517239198, "deviation-heading": 1.2201731485486895, "set_robot_commands": 0.08400013273125452, "deviation-center-line": 0.169035697673801, "driven_lanedir_consec": 0.303082092075011, "sim_compute_sim_state": 0.03305850281620657, "sim_compute_performance-ego": 0.05920880677684254, "sim_compute_robot_state-ego": 0.0740007059463602, "sim_compute_robot_state-npc0": 0.059962714744719446, "sim_compute_robot_state-npc1": 0.05988807551908177, "sim_compute_robot_state-npc2": 0.0580557118977932, "sim_compute_robot_state-npc3": 0.058432406937049715}}
set_robot_commands_max0.09987947535007556
set_robot_commands_mean0.09530867194572956
set_robot_commands_median0.09874478033033468
set_robot_commands_min0.08400013273125452
sim_compute_performance-ego_max0.07114884455998739
sim_compute_performance-ego_mean0.06729846336148759
sim_compute_performance-ego_median0.06802665015398446
sim_compute_performance-ego_min0.05920880677684254
sim_compute_robot_state-ego_max0.07660428762435913
sim_compute_robot_state-ego_mean0.07367656895704189
sim_compute_robot_state-ego_median0.0740007059463602
sim_compute_robot_state-ego_min0.06987935364848435
sim_compute_robot_state-npc0_max0.07517171413340468
sim_compute_robot_state-npc0_mean0.06904140259921171
sim_compute_robot_state-npc0_median0.06964295354940124
sim_compute_robot_state-npc0_min0.059962714744719446
sim_compute_robot_state-npc1_max0.07226665730172015
sim_compute_robot_state-npc1_mean0.06796683527269005
sim_compute_robot_state-npc1_median0.0695178387528759
sim_compute_robot_state-npc1_min0.05988807551908177
sim_compute_robot_state-npc2_max0.07224392383656603
sim_compute_robot_state-npc2_mean0.0673017556105335
sim_compute_robot_state-npc2_median0.06974900213338561
sim_compute_robot_state-npc2_min0.0580557118977932
sim_compute_robot_state-npc3_max0.07413249066535463
sim_compute_robot_state-npc3_mean0.06777189888442846
sim_compute_robot_state-npc3_median0.06823953127456923
sim_compute_robot_state-npc3_min0.058432406937049715
sim_compute_sim_state_max0.04183936372716376
sim_compute_sim_state_mean0.03830020071679886
sim_compute_sim_state_median0.03879384079364815
sim_compute_sim_state_min0.03305850281620657
sim_physics_max0.20366616491544048
sim_physics_mean0.18468889456116075
sim_physics_median0.1893977535531876
sim_physics_min0.1557772544899372
sim_render-ego_max0.0639378790128029
sim_render-ego_mean0.061393075345586655
sim_render-ego_median0.06299531967081923
sim_render-ego_min0.05420536868619603
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.380000000000024
survival_time_min4.699999999999991
200392964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:01:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20039-550927', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20039-550927', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20039-550927', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
198092964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:25:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3632709853899321
survival_time_median14.950000000000076
deviation-center-line_median0.2651556500958301
in-drivable-lane_median2.199999999999992


other stats
agent_compute-ego_max0.2403205143777948
agent_compute-ego_mean0.21406297965157303
agent_compute-ego_median0.21068809111913045
agent_compute-ego_min0.2007650647844587
deviation-center-line_max1.338768390486617
deviation-center-line_mean0.5833651019248329
deviation-center-line_min0.17956925054779688
deviation-heading_max1.911104817429614
deviation-heading_mean1.371509752151971
deviation-heading_median1.3652537939052305
deviation-heading_min0.7451138797018895
driven_any_max1.650928186830955
driven_any_mean1.21784380082501
driven_any_median1.502155110133958
driven_any_min0.6850636179225965
driven_lanedir_consec_max1.5499306361971164
driven_lanedir_consec_mean0.7329507511157798
driven_lanedir_consec_min0.2693312838668618
driven_lanedir_max1.5499306361971164
driven_lanedir_mean0.7329507511157798
driven_lanedir_median0.3632709853899321
driven_lanedir_min0.2693312838668618
in-drivable-lane_max11.200000000000085
in-drivable-lane_mean3.750000000000012
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.502155110133958, "sim_physics": 0.03986517667770386, "survival_time": 14.950000000000076, "driven_lanedir": 1.1673208440022462, "sim_render-ego": 0.05969158490498861, "in-drivable-lane": 3.5999999999999908, "agent_compute-ego": 0.20334578275680543, "deviation-heading": 1.911104817429614, "set_robot_commands": 0.09187567313512168, "deviation-center-line": 1.338768390486617, "driven_lanedir_consec": 1.1673208440022462, "sim_compute_sim_state": 0.03713069200515747, "sim_compute_performance-ego": 0.06541584253311157, "sim_compute_robot_state-ego": 0.06865583340326945, "sim_compute_robot_state-npc0": 0.06664136330286662, "sim_compute_robot_state-npc1": 0.06700712521870932, "sim_compute_robot_state-npc2": 0.06525582393010457, "sim_compute_robot_state-npc3": 0.06533918937047323}, "udem1-1-0": {"driven_any": 0.6850636179225965, "sim_physics": 0.04260722471743214, "survival_time": 4.899999999999991, "driven_lanedir": 0.2693312838668618, "sim_render-ego": 0.06057168269643978, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.2007650647844587, "deviation-heading": 0.7451138797018895, "set_robot_commands": 0.09172646366820043, "deviation-center-line": 0.2651556500958301, "driven_lanedir_consec": 0.2693312838668618, "sim_compute_sim_state": 0.03669844841470524, "sim_compute_performance-ego": 0.06429301962560537, "sim_compute_robot_state-ego": 0.06543077498066183, "sim_compute_robot_state-npc0": 0.06485108210116017, "sim_compute_robot_state-npc1": 0.06572820702377631, "sim_compute_robot_state-npc2": 0.06514873066726996, "sim_compute_robot_state-npc3": 0.06526582824940584}, "udem1-2-0": {"driven_any": 0.6876186580608464, "sim_physics": 0.047087576514796205, "survival_time": 4.749999999999991, "driven_lanedir": 0.3149000061227425, "sim_render-ego": 0.062468601527966953, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.2403205143777948, "deviation-heading": 1.2083798606632024, "set_robot_commands": 0.09858937012521844, "deviation-center-line": 0.17956925054779688, "driven_lanedir_consec": 0.3149000061227425, "sim_compute_sim_state": 0.04046435356140136, "sim_compute_performance-ego": 0.06927243784854287, "sim_compute_robot_state-ego": 0.07659800178126284, "sim_compute_robot_state-npc0": 0.07000113286470112, "sim_compute_robot_state-npc1": 0.07065830481679816, "sim_compute_robot_state-npc2": 0.07195301055908203, "sim_compute_robot_state-npc3": 0.07260706048262747}, "udem1-3-0": {"driven_any": 1.650928186830955, "sim_physics": 0.0430057692527771, "survival_time": 14.950000000000076, "driven_lanedir": 0.3632709853899321, "sim_render-ego": 0.06107528289159139, "in-drivable-lane": 11.200000000000085, "agent_compute-ego": 0.2151954452196757, "deviation-heading": 1.3652537939052305, "set_robot_commands": 0.09324332555135093, "deviation-center-line": 0.24303355671047608, "driven_lanedir_consec": 0.3632709853899321, "sim_compute_sim_state": 0.03771128575007121, "sim_compute_performance-ego": 0.06677445729573568, "sim_compute_robot_state-ego": 0.07108130455017089, "sim_compute_robot_state-npc0": 0.06696974515914916, "sim_compute_robot_state-npc1": 0.06736607154210408, "sim_compute_robot_state-npc2": 0.06762938896814982, "sim_compute_robot_state-npc3": 0.06736282269159953}, "udem1-4-0": {"driven_any": 1.5634534311766934, "sim_physics": 0.03827539920806885, "survival_time": 14.950000000000076, "driven_lanedir": 1.5499306361971164, "sim_render-ego": 0.05965169350306193, "in-drivable-lane": 0, "agent_compute-ego": 0.21068809111913045, "deviation-heading": 1.6276964090599195, "set_robot_commands": 0.0942766531308492, "deviation-center-line": 0.8902986617834451, "driven_lanedir_consec": 1.5499306361971164, "sim_compute_sim_state": 0.0383815614382426, "sim_compute_performance-ego": 0.06598840395609538, "sim_compute_robot_state-ego": 0.07010128577550252, "sim_compute_robot_state-npc0": 0.0666686987876892, "sim_compute_robot_state-npc1": 0.06540005127588908, "sim_compute_robot_state-npc2": 0.0647949473063151, "sim_compute_robot_state-npc3": 0.06525809526443481}}
set_robot_commands_max0.09858937012521844
set_robot_commands_mean0.09394229712214812
set_robot_commands_median0.09324332555135093
set_robot_commands_min0.09172646366820043
sim_compute_performance-ego_max0.06927243784854287
sim_compute_performance-ego_mean0.06634883225181817
sim_compute_performance-ego_median0.06598840395609538
sim_compute_performance-ego_min0.06429301962560537
sim_compute_robot_state-ego_max0.07659800178126284
sim_compute_robot_state-ego_mean0.0703734400981735
sim_compute_robot_state-ego_median0.07010128577550252
sim_compute_robot_state-ego_min0.06543077498066183
sim_compute_robot_state-npc0_max0.07000113286470112
sim_compute_robot_state-npc0_mean0.06702640444311325
sim_compute_robot_state-npc0_median0.0666686987876892
sim_compute_robot_state-npc0_min0.06485108210116017
sim_compute_robot_state-npc1_max0.07065830481679816
sim_compute_robot_state-npc1_mean0.0672319519754554
sim_compute_robot_state-npc1_median0.06700712521870932
sim_compute_robot_state-npc1_min0.06540005127588908
sim_compute_robot_state-npc2_max0.07195301055908203
sim_compute_robot_state-npc2_mean0.0669563802861843
sim_compute_robot_state-npc2_median0.06525582393010457
sim_compute_robot_state-npc2_min0.0647949473063151
sim_compute_robot_state-npc3_max0.07260706048262747
sim_compute_robot_state-npc3_mean0.06716659921170817
sim_compute_robot_state-npc3_median0.06533918937047323
sim_compute_robot_state-npc3_min0.06525809526443481
sim_compute_sim_state_max0.04046435356140136
sim_compute_sim_state_mean0.03807726823391558
sim_compute_sim_state_median0.03771128575007121
sim_compute_sim_state_min0.03669844841470524
sim_physics_max0.047087576514796205
sim_physics_mean0.04216822927415563
sim_physics_median0.04260722471743214
sim_physics_min0.03827539920806885
sim_render-ego_max0.062468601527966953
sim_render-ego_mean0.06069176910480974
sim_render-ego_median0.06057168269643978
sim_render-ego_min0.05965169350306193
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.900000000000045
survival_time_min4.749999999999991
197822964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:26:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5975986756994165
survival_time_median14.250000000000068
deviation-center-line_median0.3775052436346698
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.23841966662490577
agent_compute-ego_mean0.2111329305013573
agent_compute-ego_median0.2196654665390117
agent_compute-ego_min0.1742461057419473
deviation-center-line_max1.1025796926994342
deviation-center-line_mean0.520206485180279
deviation-center-line_min0.18960642709523456
deviation-heading_max4.212639230003372
deviation-heading_mean2.148380848089503
deviation-heading_median1.7489013413312102
deviation-heading_min1.3062353559265814
driven_any_max2.070954882041485
driven_any_mean1.4088388339405131
driven_any_median1.56214733690226
driven_any_min0.6352242709825823
driven_lanedir_consec_max1.5485624462583454
driven_lanedir_consec_mean0.7867777219961404
driven_lanedir_consec_min0.3002145230499671
driven_lanedir_max1.5485624462583454
driven_lanedir_mean0.792496370339663
driven_lanedir_median0.6141268241945652
driven_lanedir_min0.3071272359464803
in-drivable-lane_max11.750000000000082
in-drivable-lane_mean3.5200000000000173
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.7427730549662384, "sim_physics": 0.04702743647391336, "survival_time": 14.250000000000068, "driven_lanedir": 1.181602827372633, "sim_render-ego": 0.06530402836046721, "in-drivable-lane": 2.800000000000015, "agent_compute-ego": 0.23841966662490577, "deviation-heading": 4.212639230003372, "set_robot_commands": 0.10280426761560273, "deviation-center-line": 1.1025796926994342, "driven_lanedir_consec": 1.1764504470466817, "sim_compute_sim_state": 0.041213796849836386, "sim_compute_performance-ego": 0.07073174777783846, "sim_compute_robot_state-ego": 0.07440176093787478, "sim_compute_robot_state-npc0": 0.07184883251524808, "sim_compute_robot_state-npc1": 0.07212376761854741, "sim_compute_robot_state-npc2": 0.07257826035482842, "sim_compute_robot_state-npc3": 0.07244790144133986}, "udem1-1-0": {"driven_any": 1.03309462481, "sim_physics": 0.0459586581927818, "survival_time": 7.449999999999981, "driven_lanedir": 0.6141268241945652, "sim_render-ego": 0.06224137824653779, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.2196654665390117, "deviation-heading": 1.7489013413312102, "set_robot_commands": 0.09563238828774266, "deviation-center-line": 0.3775052436346698, "driven_lanedir_consec": 0.5975986756994165, "sim_compute_sim_state": 0.03923299488605269, "sim_compute_performance-ego": 0.06772008038207189, "sim_compute_robot_state-ego": 0.06991136474097336, "sim_compute_robot_state-npc0": 0.06745400844804393, "sim_compute_robot_state-npc1": 0.07026319215761735, "sim_compute_robot_state-npc2": 0.06907923269591876, "sim_compute_robot_state-npc3": 0.06877626188649427}, "udem1-2-0": {"driven_any": 2.070954882041485, "sim_physics": 0.041172974904378254, "survival_time": 14.950000000000076, "driven_lanedir": 0.3110625179262909, "sim_render-ego": 0.05923715114593506, "in-drivable-lane": 11.750000000000082, "agent_compute-ego": 0.22008292516072592, "deviation-heading": 1.3062353559265814, "set_robot_commands": 0.0903991667429606, "deviation-center-line": 0.18960642709523456, "driven_lanedir_consec": 0.3110625179262909, "sim_compute_sim_state": 0.03705477873484293, "sim_compute_performance-ego": 0.06478403170903524, "sim_compute_robot_state-ego": 0.06987037817637126, "sim_compute_robot_state-npc0": 0.06497082948684692, "sim_compute_robot_state-npc1": 0.06518334865570069, "sim_compute_robot_state-npc2": 0.06604402144749959, "sim_compute_robot_state-npc3": 0.06565812508265177}, "udem1-3-0": {"driven_any": 0.6352242709825823, "sim_physics": 0.039727117152924235, "survival_time": 4.699999999999991, "driven_lanedir": 0.3071272359464803, "sim_render-ego": 0.05341643221834873, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.1742461057419473, "deviation-heading": 1.790602410550626, "set_robot_commands": 0.07954592907682378, "deviation-center-line": 0.21761450356562737, "driven_lanedir_consec": 0.3002145230499671, "sim_compute_sim_state": 0.032087977896345425, "sim_compute_performance-ego": 0.055417821762409614, "sim_compute_robot_state-ego": 0.058138809305556274, "sim_compute_robot_state-npc0": 0.05637708116084971, "sim_compute_robot_state-npc1": 0.05513867672453535, "sim_compute_robot_state-npc2": 0.05324838009286434, "sim_compute_robot_state-npc3": 0.05643840799940393}, "udem1-4-0": {"driven_any": 1.56214733690226, "sim_physics": 0.03877755403518677, "survival_time": 14.950000000000076, "driven_lanedir": 1.5485624462583454, "sim_render-ego": 0.05687099933624268, "in-drivable-lane": 0, "agent_compute-ego": 0.20325048844019572, "deviation-heading": 1.6835259026357234, "set_robot_commands": 0.0880026388168335, "deviation-center-line": 0.7137265589064293, "driven_lanedir_consec": 1.5485624462583454, "sim_compute_sim_state": 0.0355991538365682, "sim_compute_performance-ego": 0.06210660378138224, "sim_compute_robot_state-ego": 0.06547492186228435, "sim_compute_robot_state-npc0": 0.06297893206278483, "sim_compute_robot_state-npc1": 0.06289551417032878, "sim_compute_robot_state-npc2": 0.06137293418248495, "sim_compute_robot_state-npc3": 0.06175297498703003}}
set_robot_commands_max0.10280426761560273
set_robot_commands_mean0.09127687810799266
set_robot_commands_median0.0903991667429606
set_robot_commands_min0.07954592907682378
sim_compute_performance-ego_max0.07073174777783846
sim_compute_performance-ego_mean0.06415205708254748
sim_compute_performance-ego_median0.06478403170903524
sim_compute_performance-ego_min0.055417821762409614
sim_compute_robot_state-ego_max0.07440176093787478
sim_compute_robot_state-ego_mean0.067559447004612
sim_compute_robot_state-ego_median0.06987037817637126
sim_compute_robot_state-ego_min0.058138809305556274
sim_compute_robot_state-npc0_max0.07184883251524808
sim_compute_robot_state-npc0_mean0.0647259367347547
sim_compute_robot_state-npc0_median0.06497082948684692
sim_compute_robot_state-npc0_min0.05637708116084971
sim_compute_robot_state-npc1_max0.07212376761854741
sim_compute_robot_state-npc1_mean0.06512089986534593
sim_compute_robot_state-npc1_median0.06518334865570069
sim_compute_robot_state-npc1_min0.05513867672453535
sim_compute_robot_state-npc2_max0.07257826035482842
sim_compute_robot_state-npc2_mean0.0644645657547192
sim_compute_robot_state-npc2_median0.06604402144749959
sim_compute_robot_state-npc2_min0.05324838009286434
sim_compute_robot_state-npc3_max0.07244790144133986
sim_compute_robot_state-npc3_mean0.06501473427938396
sim_compute_robot_state-npc3_median0.06565812508265177
sim_compute_robot_state-npc3_min0.05643840799940393
sim_compute_sim_state_max0.041213796849836386
sim_compute_sim_state_mean0.037037740440729126
sim_compute_sim_state_median0.03705477873484293
sim_compute_sim_state_min0.032087977896345425
sim_physics_max0.04702743647391336
sim_physics_mean0.042532748151836886
sim_physics_median0.041172974904378254
sim_physics_min0.03877755403518677
sim_render-ego_max0.06530402836046721
sim_render-ego_mean0.05941399786150629
sim_render-ego_median0.05923715114593506
sim_render-ego_min0.05341643221834873
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.26000000000004
survival_time_min4.699999999999991
197392964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:14:38
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19739-331507', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19739-331507', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19739-331507', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
193822964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5709051654389476
survival_time_median14.950000000000076
deviation-center-line_median0.3912929888775338
in-drivable-lane_median3.1500000000000163


other stats
agent_compute-ego_max0.21511070728302
agent_compute-ego_mean0.205807749425522
agent_compute-ego_median0.2115296204884847
agent_compute-ego_min0.1805042618452901
deviation-center-line_max0.9276125295132688
deviation-center-line_mean0.5574057235692841
deviation-center-line_min0.19039149909259545
deviation-heading_max5.884759059916577
deviation-heading_mean2.28973127679276
deviation-heading_median1.4308416482119204
deviation-heading_min1.319943262192483
driven_any_max1.738608554054438
driven_any_mean1.4684919105941083
driven_any_median1.5322050041141475
driven_any_min0.9692989598763576
driven_lanedir_consec_max1.5862428091847005
driven_lanedir_consec_mean0.8603610915392949
driven_lanedir_consec_min0.5282229279365811
driven_lanedir_max1.5862428091847005
driven_lanedir_mean0.8633567434367396
driven_lanedir_median0.5821811391984233
driven_lanedir_min0.5282229279365811
in-drivable-lane_max8.900000000000091
in-drivable-lane_mean4.500000000000038
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.738608554054438, "sim_physics": 0.0373214142089741, "survival_time": 14.850000000000076, "driven_lanedir": 1.091799715417436, "sim_render-ego": 0.05440333234742033, "in-drivable-lane": 3.1500000000000163, "agent_compute-ego": 0.1805042618452901, "deviation-heading": 5.884759059916577, "set_robot_commands": 0.07964185512427127, "deviation-center-line": 0.8866027566580598, "driven_lanedir_consec": 1.088097429689688, "sim_compute_sim_state": 0.03373450060886165, "sim_compute_performance-ego": 0.05764652101279108, "sim_compute_robot_state-ego": 0.05976787079062927, "sim_compute_robot_state-npc0": 0.05927080417722965, "sim_compute_robot_state-npc1": 0.05813635318768948, "sim_compute_robot_state-npc2": 0.058224453267826375, "sim_compute_robot_state-npc3": 0.05943936209887366}, "udem1-1-0": {"driven_any": 0.9692989598763576, "sim_physics": 0.0416666612480626, "survival_time": 6.5999999999999845, "driven_lanedir": 0.5821811391984233, "sim_render-ego": 0.06381906162608754, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.20976543245893536, "deviation-heading": 1.4308416482119204, "set_robot_commands": 0.0920772895668492, "deviation-center-line": 0.19039149909259545, "driven_lanedir_consec": 0.5709051654389476, "sim_compute_sim_state": 0.03927560105468288, "sim_compute_performance-ego": 0.06670673688252766, "sim_compute_robot_state-ego": 0.06767958763873938, "sim_compute_robot_state-npc0": 0.06918494629137444, "sim_compute_robot_state-npc1": 0.07052121379158714, "sim_compute_robot_state-npc2": 0.06929519140359128, "sim_compute_robot_state-npc3": 0.07000613031965314}, "udem1-2-0": {"driven_any": 1.5322050041141475, "sim_physics": 0.04198368151982625, "survival_time": 14.950000000000076, "driven_lanedir": 0.5283371254465572, "sim_render-ego": 0.06318212668100993, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.21511070728302, "deviation-heading": 1.319943262192483, "set_robot_commands": 0.09427900950113932, "deviation-center-line": 0.3912929888775338, "driven_lanedir_consec": 0.5283371254465572, "sim_compute_sim_state": 0.03828404347101847, "sim_compute_performance-ego": 0.0678201429049174, "sim_compute_robot_state-ego": 0.06927644968032837, "sim_compute_robot_state-npc0": 0.06877776940663656, "sim_compute_robot_state-npc1": 0.06849287350972494, "sim_compute_robot_state-npc2": 0.06725978533426921, "sim_compute_robot_state-npc3": 0.06770797888437907}, "udem1-3-0": {"driven_any": 1.5033635972297024, "sim_physics": 0.0429161540667216, "survival_time": 14.950000000000076, "driven_lanedir": 0.5282229279365811, "sim_render-ego": 0.06077344258626302, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.21212872505187988, "deviation-heading": 1.3219236499258815, "set_robot_commands": 0.09269525051116945, "deviation-center-line": 0.39112884370496265, "driven_lanedir_consec": 0.5282229279365811, "sim_compute_sim_state": 0.03829325596491496, "sim_compute_performance-ego": 0.06600387891133626, "sim_compute_robot_state-ego": 0.07057364543279011, "sim_compute_robot_state-npc0": 0.06833916107813517, "sim_compute_robot_state-npc1": 0.06716951608657837, "sim_compute_robot_state-npc2": 0.06752822319666545, "sim_compute_robot_state-npc3": 0.06865292310714721}, "udem1-4-0": {"driven_any": 1.5989834376958971, "sim_physics": 0.04025238831837972, "survival_time": 14.950000000000076, "driven_lanedir": 1.5862428091847005, "sim_render-ego": 0.06023004770278931, "in-drivable-lane": 0, "agent_compute-ego": 0.2115296204884847, "deviation-heading": 1.4911887637169368, "set_robot_commands": 0.0919098734855652, "deviation-center-line": 0.9276125295132688, "driven_lanedir_consec": 1.5862428091847005, "sim_compute_sim_state": 0.038238544464111325, "sim_compute_performance-ego": 0.06539910236994426, "sim_compute_robot_state-ego": 0.06841514110565186, "sim_compute_robot_state-npc0": 0.06715990543365478, "sim_compute_robot_state-npc1": 0.06780296166737874, "sim_compute_robot_state-npc2": 0.06743947505950927, "sim_compute_robot_state-npc3": 0.06824461221694947}}
set_robot_commands_max0.09427900950113932
set_robot_commands_mean0.09012065563779888
set_robot_commands_median0.0920772895668492
set_robot_commands_min0.07964185512427127
sim_compute_performance-ego_max0.0678201429049174
sim_compute_performance-ego_mean0.06471527641630333
sim_compute_performance-ego_median0.06600387891133626
sim_compute_performance-ego_min0.05764652101279108
sim_compute_robot_state-ego_max0.07057364543279011
sim_compute_robot_state-ego_mean0.0671425389296278
sim_compute_robot_state-ego_median0.06841514110565186
sim_compute_robot_state-ego_min0.05976787079062927
sim_compute_robot_state-npc0_max0.06918494629137444
sim_compute_robot_state-npc0_mean0.06654651727740613
sim_compute_robot_state-npc0_median0.06833916107813517
sim_compute_robot_state-npc0_min0.05927080417722965
sim_compute_robot_state-npc1_max0.07052121379158714
sim_compute_robot_state-npc1_mean0.06642458364859175
sim_compute_robot_state-npc1_median0.06780296166737874
sim_compute_robot_state-npc1_min0.05813635318768948
sim_compute_robot_state-npc2_max0.06929519140359128
sim_compute_robot_state-npc2_mean0.06594942565237231
sim_compute_robot_state-npc2_median0.06743947505950927
sim_compute_robot_state-npc2_min0.058224453267826375
sim_compute_robot_state-npc3_max0.07000613031965314
sim_compute_robot_state-npc3_mean0.0668102013254005
sim_compute_robot_state-npc3_median0.06824461221694947
sim_compute_robot_state-npc3_min0.05943936209887366
sim_compute_sim_state_max0.03927560105468288
sim_compute_sim_state_mean0.03756518911271785
sim_compute_sim_state_median0.03828404347101847
sim_compute_sim_state_min0.03373450060886165
sim_physics_max0.0429161540667216
sim_physics_mean0.04082805987239286
sim_physics_median0.0416666612480626
sim_physics_min0.0373214142089741
sim_render-ego_max0.06381906162608754
sim_render-ego_mean0.060481602188714026
sim_render-ego_median0.06077344258626302
sim_render-ego_min0.05440333234742033
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.260000000000057
survival_time_min6.5999999999999845
192322964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:03
I can see how the jo [...]
I can see how the job 19232 is timeout because passed 3903 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
192272964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/docker/transport/unixconn.py", line 43, in connect
    sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/docker/transport/unixconn.py", line 43, in connect
    sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 918, in list
    since=since)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 208, in containers
    res = self._result(self._get(u, params=params), True)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 571, in run_single
    timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 646, in run_one
    client = check_docker_environment()
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

Make sure the docker service is running.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
192212964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:02:40
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/docker/transport/unixconn.py", line 43, in connect
    sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/docker/transport/unixconn.py", line 43, in connect
    sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 918, in list
    since=since)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 208, in containers
    res = self._result(self._get(u, params=params), True)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 892, in write_logs
    client = check_docker_environment()
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

Make sure the docker service is running.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
192112964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:22:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19211-430248', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19211-430248', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19211-430248', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
192102964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno-0:18:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5667290884960443
survival_time_median14.950000000000076
deviation-center-line_median0.398324515619486
in-drivable-lane_median3.200000000000018


other stats
agent_compute-ego_max0.1167363399683043
agent_compute-ego_mean0.11450816581953348
agent_compute-ego_median0.11631455230074982
agent_compute-ego_min0.11113672971725463
deviation-center-line_max0.9346331265421992
deviation-center-line_mean0.5654450530961703
deviation-center-line_min0.18970047786435376
deviation-heading_max6.016161144404485
deviation-heading_mean2.3093260500374457
deviation-heading_median1.3963345862077443
deviation-heading_min1.313315170416522
driven_any_max1.6929429087638026
driven_any_mean1.453818242837175
driven_any_median1.52323920285428
driven_any_min0.9442529884243072
driven_lanedir_consec_max1.5839289106952368
driven_lanedir_consec_mean0.856514431924443
driven_lanedir_consec_min0.5300766732460096
driven_lanedir_max1.5839289106952368
driven_lanedir_mean0.8604328547035124
driven_lanedir_median0.5827543313206553
driven_lanedir_min0.5300766732460096
in-drivable-lane_max8.900000000000091
in-drivable-lane_mean4.470000000000039
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.6929429087638026, "sim_physics": 0.01881798772907576, "survival_time": 14.950000000000076, "driven_lanedir": 1.0734160333678644, "sim_render-ego": 0.03516330687098679, "in-drivable-lane": 3.200000000000018, "agent_compute-ego": 0.11631455230074982, "deviation-heading": 6.016161144404485, "set_robot_commands": 0.05276405771440487, "deviation-center-line": 0.9076187546535042, "driven_lanedir_consec": 1.0698491622971285, "sim_compute_sim_state": 0.02170496481318139, "sim_compute_performance-ego": 0.03741805529514683, "sim_compute_robot_state-ego": 0.038864646866967445, "sim_compute_robot_state-npc0": 0.03858670422863402, "sim_compute_robot_state-npc1": 0.03844837759649475, "sim_compute_robot_state-npc2": 0.03848241643363417, "sim_compute_robot_state-npc3": 0.03895322534950282}, "udem1-1-0": {"driven_any": 0.9442529884243072, "sim_physics": 0.01869792161985885, "survival_time": 6.449999999999985, "driven_lanedir": 0.5827543313206553, "sim_render-ego": 0.0362623089043669, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.1167363399683043, "deviation-heading": 1.3963345862077443, "set_robot_commands": 0.05291020223336627, "deviation-center-line": 0.18970047786435376, "driven_lanedir_consec": 0.5667290884960443, "sim_compute_sim_state": 0.021647915359615355, "sim_compute_performance-ego": 0.037437817847081854, "sim_compute_robot_state-ego": 0.039199999136518136, "sim_compute_robot_state-npc0": 0.038642700328383336, "sim_compute_robot_state-npc1": 0.03886322827302208, "sim_compute_robot_state-npc2": 0.03840385666189268, "sim_compute_robot_state-npc3": 0.03818011468695116}, "udem1-2-0": {"driven_any": 1.52323920285428, "sim_physics": 0.017436470985412598, "survival_time": 14.950000000000076, "driven_lanedir": 0.5319883248877959, "sim_render-ego": 0.03397969802220662, "in-drivable-lane": 8.85000000000009, "agent_compute-ego": 0.11178709268569946, "deviation-heading": 1.323917909927847, "set_robot_commands": 0.05163753986358643, "deviation-center-line": 0.398324515619486, "driven_lanedir_consec": 0.5319883248877959, "sim_compute_sim_state": 0.021354300181070963, "sim_compute_performance-ego": 0.03648407300313314, "sim_compute_robot_state-ego": 0.03723074595133464, "sim_compute_robot_state-npc0": 0.03763383944829305, "sim_compute_robot_state-npc1": 0.037264169057210285, "sim_compute_robot_state-npc2": 0.03697995662689209, "sim_compute_robot_state-npc3": 0.03728773832321167}, "udem1-3-0": {"driven_any": 1.5115029157601982, "sim_physics": 0.018037375609079996, "survival_time": 14.950000000000076, "driven_lanedir": 0.5300766732460096, "sim_render-ego": 0.033592127958933515, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.11113672971725463, "deviation-heading": 1.313315170416522, "set_robot_commands": 0.05136369387308756, "deviation-center-line": 0.39694839080130834, "driven_lanedir_consec": 0.5300766732460096, "sim_compute_sim_state": 0.021049261887868244, "sim_compute_performance-ego": 0.03614336649576823, "sim_compute_robot_state-ego": 0.037852206230163575, "sim_compute_robot_state-npc0": 0.0374018398920695, "sim_compute_robot_state-npc1": 0.03703181425730387, "sim_compute_robot_state-npc2": 0.03684073527654013, "sim_compute_robot_state-npc3": 0.03721197366714477}, "udem1-4-0": {"driven_any": 1.5971531983832885, "sim_physics": 0.01833004792531331, "survival_time": 14.950000000000076, "driven_lanedir": 1.5839289106952368, "sim_render-ego": 0.03555997769037882, "in-drivable-lane": 0, "agent_compute-ego": 0.11656611442565916, "deviation-heading": 1.4969014392306297, "set_robot_commands": 0.05252784570058187, "deviation-center-line": 0.9346331265421992, "driven_lanedir_consec": 1.5839289106952368, "sim_compute_sim_state": 0.02190232038497925, "sim_compute_performance-ego": 0.03779081106185913, "sim_compute_robot_state-ego": 0.03919035275777181, "sim_compute_robot_state-npc0": 0.0395637853940328, "sim_compute_robot_state-npc1": 0.03867676655451457, "sim_compute_robot_state-npc2": 0.038220164775848386, "sim_compute_robot_state-npc3": 0.03915022850036621}}
set_robot_commands_max0.05291020223336627
set_robot_commands_mean0.05224066787700539
set_robot_commands_median0.05252784570058187
set_robot_commands_min0.05136369387308756
sim_compute_performance-ego_max0.03779081106185913
sim_compute_performance-ego_mean0.03705482474059784
sim_compute_performance-ego_median0.03741805529514683
sim_compute_performance-ego_min0.03614336649576823
sim_compute_robot_state-ego_max0.039199999136518136
sim_compute_robot_state-ego_mean0.03846759018855112
sim_compute_robot_state-ego_median0.038864646866967445
sim_compute_robot_state-ego_min0.03723074595133464
sim_compute_robot_state-npc0_max0.0395637853940328
sim_compute_robot_state-npc0_mean0.038365773858282534
sim_compute_robot_state-npc0_median0.03858670422863402
sim_compute_robot_state-npc0_min0.0374018398920695
sim_compute_robot_state-npc1_max0.03886322827302208
sim_compute_robot_state-npc1_mean0.03805687114770911
sim_compute_robot_state-npc1_median0.03844837759649475
sim_compute_robot_state-npc1_min0.03703181425730387
sim_compute_robot_state-npc2_max0.03848241643363417
sim_compute_robot_state-npc2_mean0.03778542595496149
sim_compute_robot_state-npc2_median0.038220164775848386
sim_compute_robot_state-npc2_min0.03684073527654013
sim_compute_robot_state-npc3_max0.03915022850036621
sim_compute_robot_state-npc3_mean0.03815665610543533
sim_compute_robot_state-npc3_median0.03818011468695116
sim_compute_robot_state-npc3_min0.03721197366714477
sim_compute_sim_state_max0.02190232038497925
sim_compute_sim_state_mean0.02153175252534304
sim_compute_sim_state_median0.021647915359615355
sim_compute_sim_state_min0.021049261887868244
sim_physics_max0.01881798772907576
sim_physics_mean0.018263960773748103
sim_physics_median0.01833004792531331
sim_physics_min0.017436470985412598
sim_render-ego_max0.0362623089043669
sim_render-ego_mean0.03491148388937453
sim_render-ego_median0.03516330687098679
sim_render-ego_min0.033592127958933515
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.250000000000057
survival_time_min6.449999999999985
191222964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerrorno-0:21:04
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.