AI Driving Olympics Home Challenges Submissions Jobs

Submission 6594

Submission6594
Competingyes
Challengeaido3-off-LF-sim-validation
UserJBRRussia
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 32596
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessing50
User priority

32596

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
325966594JBRRussiachallenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationsuccessyes-0:13:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9896664359720593
survival_time_median14.950000000000076
deviation-center-line_median0.8115246106993077
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03063231070836385
agent_compute-ego_mean0.029256776491800945
agent_compute-ego_median0.029041353861490884
agent_compute-ego_min0.027702876726786296
deviation-center-line_max0.9752604048360518
deviation-center-line_mean0.7664873734164422
deviation-center-line_min0.3978722446497848
deviation-heading_max4.462120574328274
deviation-heading_mean2.8001112029247017
deviation-heading_median3.017100227928008
deviation-heading_min1.160056388226342
driven_any_max2.042769383989091
driven_any_mean2.041415638846515
driven_any_median2.042754828141024
driven_any_min2.036042205379264
driven_lanedir_consec_max2.0319041320091165
driven_lanedir_consec_mean1.868126571885875
driven_lanedir_consec_min1.647875526530051
driven_lanedir_max2.0319041320091165
driven_lanedir_mean1.868126571885875
driven_lanedir_median1.9896664359720593
driven_lanedir_min1.647875526530051
in-drivable-lane_max2.1499999999999924
in-drivable-lane_mean0.7900000000000036
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.036042205379264, "sim_physics": 0.10061530669530232, "survival_time": 14.950000000000076, "driven_lanedir": 1.647875526530051, "sim_render-ego": 0.014373908837636312, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.03063231070836385, "deviation-heading": 4.462120574328274, "set_robot_commands": 0.00987727721532186, "deviation-center-line": 0.8962473231973871, "driven_lanedir_consec": 1.647875526530051, "sim_compute_sim_state": 0.006925772825876871, "sim_compute_performance-ego": 0.009215584595998128, "sim_compute_robot_state-ego": 0.010289010206858316}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0427596756437274, "sim_physics": 0.10185730854670208, "survival_time": 14.950000000000076, "driven_lanedir": 2.0111988974809023, "sim_render-ego": 0.014787755807240803, "in-drivable-lane": 0, "agent_compute-ego": 0.030020062923431397, "deviation-heading": 2.1978654199898258, "set_robot_commands": 0.00958756685256958, "deviation-center-line": 0.9752604048360518, "driven_lanedir_consec": 2.0111988974809023, "sim_compute_sim_state": 0.006551125844319662, "sim_compute_performance-ego": 0.00927610476811727, "sim_compute_robot_state-ego": 0.010457410017649332}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.042754828141024, "sim_physics": 0.09822837432225544, "survival_time": 14.950000000000076, "driven_lanedir": 1.6599878674372448, "sim_render-ego": 0.014129145940144855, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.027702876726786296, "deviation-heading": 3.017100227928008, "set_robot_commands": 0.009767320156097412, "deviation-center-line": 0.8115246106993077, "driven_lanedir_consec": 1.6599878674372448, "sim_compute_sim_state": 0.006853710810343424, "sim_compute_performance-ego": 0.008974034786224366, "sim_compute_robot_state-ego": 0.0103218142191569}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0427521010794676, "sim_physics": 0.09901806433995564, "survival_time": 14.950000000000076, "driven_lanedir": 2.0319041320091165, "sim_render-ego": 0.014341489473978678, "in-drivable-lane": 0, "agent_compute-ego": 0.028887278238932293, "deviation-heading": 1.160056388226342, "set_robot_commands": 0.009572861194610595, "deviation-center-line": 0.3978722446497848, "driven_lanedir_consec": 2.0319041320091165, "sim_compute_sim_state": 0.0065488306681315105, "sim_compute_performance-ego": 0.00885214885075887, "sim_compute_robot_state-ego": 0.010525999069213868}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.042769383989091, "sim_physics": 0.09545059442520142, "survival_time": 14.950000000000076, "driven_lanedir": 1.9896664359720593, "sim_render-ego": 0.014239486853281656, "in-drivable-lane": 0, "agent_compute-ego": 0.029041353861490884, "deviation-heading": 3.1634134041510578, "set_robot_commands": 0.009527071317036949, "deviation-center-line": 0.7515322836996797, "driven_lanedir_consec": 1.9896664359720593, "sim_compute_sim_state": 0.006749757925669352, "sim_compute_performance-ego": 0.008842827479044597, "sim_compute_robot_state-ego": 0.010167957146962484}}
set_robot_commands_max0.00987727721532186
set_robot_commands_mean0.009666419347127276
set_robot_commands_median0.00958756685256958
set_robot_commands_min0.009527071317036949
sim_compute_performance-ego_max0.00927610476811727
sim_compute_performance-ego_mean0.009032140096028646
sim_compute_performance-ego_median0.008974034786224366
sim_compute_performance-ego_min0.008842827479044597
sim_compute_robot_state-ego_max0.010525999069213868
sim_compute_robot_state-ego_mean0.01035243813196818
sim_compute_robot_state-ego_median0.0103218142191569
sim_compute_robot_state-ego_min0.010167957146962484
sim_compute_sim_state_max0.006925772825876871
sim_compute_sim_state_mean0.006725839614868165
sim_compute_sim_state_median0.006749757925669352
sim_compute_sim_state_min0.0065488306681315105
sim_physics_max0.10185730854670208
sim_physics_mean0.09903392966588338
sim_physics_median0.09901806433995564
sim_physics_min0.09545059442520142
sim_render-ego_max0.014787755807240803
sim_render-ego_mean0.01437435738245646
sim_render-ego_median0.014341489473978678
sim_render-ego_min0.014129145940144855
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
325956594JBRRussiachallenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationsuccessyes-0:12:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9914827714485763
survival_time_median14.950000000000076
deviation-center-line_median0.8690875216509437
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03186520497004191
agent_compute-ego_mean0.028983354568481445
agent_compute-ego_median0.02830501635869344
agent_compute-ego_min0.02790844678878784
deviation-center-line_max1.0160878984267212
deviation-center-line_mean0.8673081078798888
deviation-center-line_min0.7375651471415474
deviation-heading_max4.418306042463508
deviation-heading_mean2.859839085239868
deviation-heading_median2.699730039407205
deviation-heading_min1.7498970656654782
driven_any_max2.042774433135928
driven_any_mean2.0414116435262293
driven_any_median2.0427415117338388
driven_any_min2.0360433999920433
driven_lanedir_consec_max2.0196086723735456
driven_lanedir_consec_mean1.8801334866976027
driven_lanedir_consec_min1.6566997737504163
driven_lanedir_max2.0196086723735456
driven_lanedir_mean1.8801334866976027
driven_lanedir_median1.9914827714485763
driven_lanedir_min1.6566997737504163
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.7200000000000036
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0360433999920433, "sim_physics": 0.08771180232365926, "survival_time": 14.950000000000076, "driven_lanedir": 1.6566997737504163, "sim_render-ego": 0.014182737668355306, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.03186520497004191, "deviation-heading": 4.418306042463508, "set_robot_commands": 0.009626622994740803, "deviation-center-line": 0.8690875216509437, "driven_lanedir_consec": 1.6566997737504163, "sim_compute_sim_state": 0.006354503631591797, "sim_compute_performance-ego": 0.00884422222773234, "sim_compute_robot_state-ego": 0.010265462398529051}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0427391851064267, "sim_physics": 0.0916961137453715, "survival_time": 14.950000000000076, "driven_lanedir": 2.0011631776531713, "sim_render-ego": 0.014357264041900636, "in-drivable-lane": 0, "agent_compute-ego": 0.028617612520853677, "deviation-heading": 2.699730039407205, "set_robot_commands": 0.00935848871866862, "deviation-center-line": 0.7911783621098696, "driven_lanedir_consec": 2.0011631776531713, "sim_compute_sim_state": 0.006244517167409261, "sim_compute_performance-ego": 0.008903303941090901, "sim_compute_robot_state-ego": 0.010435479482014974}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.0427596876629104, "sim_physics": 0.08708619356155395, "survival_time": 14.950000000000076, "driven_lanedir": 1.7317130382623038, "sim_render-ego": 0.014173203309377037, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.02790844678878784, "deviation-heading": 2.548914267989245, "set_robot_commands": 0.009648622671763104, "deviation-center-line": 0.922621610070362, "driven_lanedir_consec": 1.7317130382623038, "sim_compute_sim_state": 0.006642599105834961, "sim_compute_performance-ego": 0.008722589810689291, "sim_compute_robot_state-ego": 0.01044530709584554}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0427415117338388, "sim_physics": 0.08492050170898438, "survival_time": 14.950000000000076, "driven_lanedir": 1.9914827714485763, "sim_render-ego": 0.01419457753499349, "in-drivable-lane": 0, "agent_compute-ego": 0.02830501635869344, "deviation-heading": 2.882348010673903, "set_robot_commands": 0.009557532469431558, "deviation-center-line": 0.7375651471415474, "driven_lanedir_consec": 1.9914827714485763, "sim_compute_sim_state": 0.006475231647491455, "sim_compute_performance-ego": 0.008734912077585855, "sim_compute_robot_state-ego": 0.010009802182515464}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.042774433135928, "sim_physics": 0.08610245943069458, "survival_time": 14.950000000000076, "driven_lanedir": 2.0196086723735456, "sim_render-ego": 0.014367721875508626, "in-drivable-lane": 0, "agent_compute-ego": 0.028220492204030355, "deviation-heading": 1.7498970656654782, "set_robot_commands": 0.00968136707941691, "deviation-center-line": 1.0160878984267212, "driven_lanedir_consec": 2.0196086723735456, "sim_compute_sim_state": 0.006226414839426676, "sim_compute_performance-ego": 0.008791216214497884, "sim_compute_robot_state-ego": 0.01054197629292806}}
set_robot_commands_max0.00968136707941691
set_robot_commands_mean0.0095745267868042
set_robot_commands_median0.009626622994740803
set_robot_commands_min0.00935848871866862
sim_compute_performance-ego_max0.008903303941090901
sim_compute_performance-ego_mean0.008799248854319253
sim_compute_performance-ego_median0.008791216214497884
sim_compute_performance-ego_min0.008722589810689291
sim_compute_robot_state-ego_max0.01054197629292806
sim_compute_robot_state-ego_mean0.010339605490366615
sim_compute_robot_state-ego_median0.010435479482014974
sim_compute_robot_state-ego_min0.010009802182515464
sim_compute_sim_state_max0.006642599105834961
sim_compute_sim_state_mean0.00638865327835083
sim_compute_sim_state_median0.006354503631591797
sim_compute_sim_state_min0.006226414839426676
sim_physics_max0.0916961137453715
sim_physics_mean0.08750341415405274
sim_physics_median0.08708619356155395
sim_physics_min0.08492050170898438
sim_render-ego_max0.014367721875508626
sim_render-ego_mean0.014255100886027015
sim_render-ego_median0.01419457753499349
sim_render-ego_min0.014173203309377037
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
325926594JBRRussiachallenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationsuccessyes-0:13:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.995757307778654
survival_time_median14.950000000000076
deviation-center-line_median0.7114890404857205
in-drivable-lane_median0


other stats
agent_compute-ego_max0.029129961331685383
agent_compute-ego_mean0.02847813081741333
agent_compute-ego_median0.028338104883829752
agent_compute-ego_min0.02792269786198934
deviation-center-line_max0.9285936256141674
deviation-center-line_mean0.7639717838963999
deviation-center-line_min0.6520943535811582
deviation-heading_max4.22600446660747
deviation-heading_mean2.9518109019394223
deviation-heading_median2.823117954487751
deviation-heading_min2.304837777645238
driven_any_max2.042770995612082
driven_any_mean2.0414121362730993
driven_any_median2.0427430194049174
driven_any_min2.0360501119758463
driven_lanedir_consec_max2.004996239324087
driven_lanedir_consec_mean1.8819735751852775
driven_lanedir_consec_min1.6843380420440446
driven_lanedir_max2.004996239324087
driven_lanedir_mean1.8819735751852775
driven_lanedir_median1.995757307778654
driven_lanedir_min1.6843380420440446
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.6900000000000034
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0360501119758463, "sim_physics": 0.10234655618667604, "survival_time": 14.950000000000076, "driven_lanedir": 1.6843380420440446, "sim_render-ego": 0.014646429220835368, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.02886584997177124, "deviation-heading": 4.22600446660747, "set_robot_commands": 0.009436818758646649, "deviation-center-line": 0.8356832227010085, "driven_lanedir_consec": 1.6843380420440446, "sim_compute_sim_state": 0.006812933286031087, "sim_compute_performance-ego": 0.00914369265238444, "sim_compute_robot_state-ego": 0.010649425188700358}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0427390545217676, "sim_physics": 0.10046260356903076, "survival_time": 14.950000000000076, "driven_lanedir": 1.995757307778654, "sim_render-ego": 0.014483819802602133, "in-drivable-lane": 0, "agent_compute-ego": 0.029129961331685383, "deviation-heading": 2.823117954487751, "set_robot_commands": 0.009616129398345948, "deviation-center-line": 0.6919986770999453, "driven_lanedir_consec": 1.995757307778654, "sim_compute_sim_state": 0.006953018506368001, "sim_compute_performance-ego": 0.00895240306854248, "sim_compute_robot_state-ego": 0.010348099867502849}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.042757499850883, "sim_physics": 0.09978120644887288, "survival_time": 14.950000000000076, "driven_lanedir": 1.7231486977155328, "sim_render-ego": 0.014786807696024576, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.02792269786198934, "deviation-heading": 2.844182463349925, "set_robot_commands": 0.00974782943725586, "deviation-center-line": 0.9285936256141674, "driven_lanedir_consec": 1.7231486977155328, "sim_compute_sim_state": 0.006816247304280599, "sim_compute_performance-ego": 0.009274374643961587, "sim_compute_robot_state-ego": 0.010416306654612224}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0427430194049174, "sim_physics": 0.10142764965693156, "survival_time": 14.950000000000076, "driven_lanedir": 2.0016275890640696, "sim_render-ego": 0.014941161473592122, "in-drivable-lane": 0, "agent_compute-ego": 0.028338104883829752, "deviation-heading": 2.304837777645238, "set_robot_commands": 0.009281522432963051, "deviation-center-line": 0.6520943535811582, "driven_lanedir_consec": 2.0016275890640696, "sim_compute_sim_state": 0.006868500709533692, "sim_compute_performance-ego": 0.009123502572377522, "sim_compute_robot_state-ego": 0.010237274964650472}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.042770995612082, "sim_physics": 0.1010528794924418, "survival_time": 14.950000000000076, "driven_lanedir": 2.004996239324087, "sim_render-ego": 0.0145246426264445, "in-drivable-lane": 0, "agent_compute-ego": 0.028134040037790933, "deviation-heading": 2.5609118476067283, "set_robot_commands": 0.00971950928370158, "deviation-center-line": 0.7114890404857205, "driven_lanedir_consec": 2.004996239324087, "sim_compute_sim_state": 0.006969020366668701, "sim_compute_performance-ego": 0.008883618513743082, "sim_compute_robot_state-ego": 0.010527586142222089}}
set_robot_commands_max0.00974782943725586
set_robot_commands_mean0.009560361862182617
set_robot_commands_median0.009616129398345948
set_robot_commands_min0.009281522432963051
sim_compute_performance-ego_max0.009274374643961587
sim_compute_performance-ego_mean0.009075518290201822
sim_compute_performance-ego_median0.009123502572377522
sim_compute_performance-ego_min0.008883618513743082
sim_compute_robot_state-ego_max0.010649425188700358
sim_compute_robot_state-ego_mean0.010435738563537597
sim_compute_robot_state-ego_median0.010416306654612224
sim_compute_robot_state-ego_min0.010237274964650472
sim_compute_sim_state_max0.006969020366668701
sim_compute_sim_state_mean0.006883944034576416
sim_compute_sim_state_median0.006868500709533692
sim_compute_sim_state_min0.006812933286031087
sim_physics_max0.10234655618667604
sim_physics_mean0.10101417907079062
sim_physics_median0.1010528794924418
sim_physics_min0.09978120644887288
sim_render-ego_max0.014941161473592122
sim_render-ego_mean0.01467657216389974
sim_render-ego_median0.014646429220835368
sim_render-ego_min0.014483819802602133
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
325906594JBRRussiachallenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationhost-erroryes-0:02:46
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job32590-991703', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job32590-991703', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job32590-991703_evaluation" with the default driver
stderr | Creating volume "job32590-991703_fifos" with default driver
stderr | Creating job32590-991703_simulator_1 ...
stderr | Creating job32590-991703_evaluator_1 ...
stderr | Creating job32590-991703_scenario_maker_1 ...
stderr | Creating job32590-991703_solution_1       ...
stderr | 
stderr | Creating job32590-991703_evaluator_1      ... done
stderr | 
stderr | Creating job32590-991703_simulator_1      ... done
stderr | 
stderr | ERROR: for job32590-991703_scenario_maker_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job32590-991703_solution_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for scenario_maker  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for solution  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
stderr | If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
325886594JBRRussiachallenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationhost-erroryes-0:09:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 372, in setup_logging
    my_stderr.flush()
  File "/project/src/duckietown_challenges_runner/runner.py", line 1247, in flush
    self.file.flush()
OSError: [Errno 28] No space left on device

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device
Hidden. If you are the author, please login using the top-right link or use the dashboard.