AI Driving Olympics Home Challenges Submissions Jobs

Submission 4572

Submission4572
Competingyes
Challengeaido3-LF-sim-validation
Usermiksaz
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27321
Next
User labelchameleon-3
Admin priority50
Blessing50
User priority

27321

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
273214572miksazchameleon-3aido3-LF-sim-validationstep1-simulationsuccessyes-0:15:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.872414776632022
survival_time_median14.950000000000076
deviation-center-line_median0.7784711744166976
in-drivable-lane_median0.9500000000000136


other stats
agent_compute-ego_max0.2254647617754729
agent_compute-ego_mean0.22066421582733375
agent_compute-ego_median0.22365106662114465
agent_compute-ego_min0.21063652038574215
deviation-center-line_max0.9315958796841464
deviation-center-line_mean0.7217014050633623
deviation-center-line_min0.5262316230549741
deviation-heading_max3.467620989346798
deviation-heading_mean3.1100951361732805
deviation-heading_median3.33778043629327
deviation-heading_min2.490832616280813
driven_any_max4.994656363620709
driven_any_mean4.13206033648588
driven_any_median4.125862813456492
driven_any_min2.9781518883191045
driven_lanedir_consec_max4.698252060539647
driven_lanedir_consec_mean3.779619363782777
driven_lanedir_consec_min2.3217769973328757
driven_lanedir_max4.698252060539647
driven_lanedir_mean3.779619363782777
driven_lanedir_median3.872414776632022
driven_lanedir_min2.3217769973328757
in-drivable-lane_max2.1500000000000306
in-drivable-lane_mean0.8900000000000127
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9781518883191045, "sim_physics": 0.10267949415289836, "survival_time": 11.500000000000028, "driven_lanedir": 2.3217769973328757, "sim_render-ego": 0.013751103567040485, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.2254647617754729, "deviation-heading": 3.33778043629327, "set_robot_commands": 0.00925943022188933, "deviation-center-line": 0.5853076744045072, "driven_lanedir_consec": 2.3217769973328757, "sim_compute_sim_state": 0.005603723940641983, "sim_compute_performance-ego": 0.008480339464933977, "sim_compute_robot_state-ego": 0.009656152517899225}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.125862813456492, "sim_physics": 0.1015260402361552, "survival_time": 14.950000000000076, "driven_lanedir": 3.613570433061532, "sim_render-ego": 0.01367609182993571, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.22365106662114465, "deviation-heading": 3.467620989346798, "set_robot_commands": 0.009108812808990478, "deviation-center-line": 0.7784711744166976, "driven_lanedir_consec": 3.613570433061532, "sim_compute_sim_state": 0.005725383758544922, "sim_compute_performance-ego": 0.00815479596455892, "sim_compute_robot_state-ego": 0.009702067375183103}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.999545690593045, "sim_physics": 0.09310810009638468, "survival_time": 14.950000000000076, "driven_lanedir": 3.872414776632022, "sim_render-ego": 0.013634867668151855, "in-drivable-lane": 0, "agent_compute-ego": 0.22419380903244016, "deviation-heading": 2.8519851922489527, "set_robot_commands": 0.009643855094909668, "deviation-center-line": 0.9315958796841464, "driven_lanedir_consec": 3.872414776632022, "sim_compute_sim_state": 0.005974297523498535, "sim_compute_performance-ego": 0.00806564728418986, "sim_compute_robot_state-ego": 0.009961278438568116}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.994656363620709, "sim_physics": 0.0905094623565674, "survival_time": 14.950000000000076, "driven_lanedir": 4.698252060539647, "sim_render-ego": 0.013523237705230713, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.2193749213218689, "deviation-heading": 2.490832616280813, "set_robot_commands": 0.009145219326019288, "deviation-center-line": 0.5262316230549741, "driven_lanedir_consec": 4.698252060539647, "sim_compute_sim_state": 0.005664028326670329, "sim_compute_performance-ego": 0.00851180632909139, "sim_compute_robot_state-ego": 0.00921291987101237}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.56208492644005, "sim_physics": 0.08429856220881145, "survival_time": 14.950000000000076, "driven_lanedir": 4.392082551347809, "sim_render-ego": 0.01294316053390503, "in-drivable-lane": 0, "agent_compute-ego": 0.21063652038574215, "deviation-heading": 3.402256446696569, "set_robot_commands": 0.009796357154846192, "deviation-center-line": 0.7869006737564862, "driven_lanedir_consec": 4.392082551347809, "sim_compute_sim_state": 0.005829658508300781, "sim_compute_performance-ego": 0.007401900291442871, "sim_compute_robot_state-ego": 0.009179294109344482}}
set_robot_commands_max0.009796357154846192
set_robot_commands_mean0.009390734921330992
set_robot_commands_median0.00925943022188933
set_robot_commands_min0.009108812808990478
sim_compute_performance-ego_max0.00851180632909139
sim_compute_performance-ego_mean0.008122897866843403
sim_compute_performance-ego_median0.00815479596455892
sim_compute_performance-ego_min0.007401900291442871
sim_compute_robot_state-ego_max0.009961278438568116
sim_compute_robot_state-ego_mean0.00954234246240146
sim_compute_robot_state-ego_median0.009656152517899225
sim_compute_robot_state-ego_min0.009179294109344482
sim_compute_sim_state_max0.005974297523498535
sim_compute_sim_state_mean0.0057594184115313096
sim_compute_sim_state_median0.005725383758544922
sim_compute_sim_state_min0.005603723940641983
sim_physics_max0.10267949415289836
sim_physics_mean0.0944243318101634
sim_physics_median0.09310810009638468
sim_physics_min0.08429856220881145
sim_render-ego_max0.013751103567040485
sim_render-ego_mean0.01350569226085276
sim_render-ego_median0.013634867668151855
sim_render-ego_min0.01294316053390503
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.260000000000067
survival_time_min11.500000000000028
260574572miksazchameleon-3aido3-LF-sim-validationstep1-simulationsuccessno-0:14:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.908185982414876
survival_time_median14.950000000000076
deviation-center-line_median0.6427660824562942
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.2215564529101054
agent_compute-ego_mean0.2210773969544352
agent_compute-ego_median0.22090404033660888
agent_compute-ego_min0.2206960462754773
deviation-center-line_max0.8491838791029767
deviation-center-line_mean0.6178930896811297
deviation-center-line_min0.26886016740196267
deviation-heading_max3.21859142979319
deviation-heading_mean2.453745379037659
deviation-heading_median2.4727579883128974
deviation-heading_min1.572319036677893
driven_any_max4.6669521172459225
driven_any_mean3.9889829042634126
driven_any_median4.651829818204731
driven_any_min1.9521536338951773
driven_lanedir_consec_max4.558914344570558
driven_lanedir_consec_mean3.70297492277423
driven_lanedir_consec_min1.788539979890152
driven_lanedir_max4.558914344570558
driven_lanedir_mean3.70297492277423
driven_lanedir_median3.908185982414876
driven_lanedir_min1.788539979890152
in-drivable-lane_max2.7000000000000153
in-drivable-lane_mean0.9400000000000066
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9521536338951773, "sim_physics": 0.07857549421248898, "survival_time": 7.7499999999999805, "driven_lanedir": 1.788539979890152, "sim_render-ego": 0.013023501057778636, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.2206960462754773, "deviation-heading": 1.572319036677893, "set_robot_commands": 0.00973239867917953, "deviation-center-line": 0.26886016740196267, "driven_lanedir_consec": 1.788539979890152, "sim_compute_sim_state": 0.005695569130682176, "sim_compute_performance-ego": 0.008206150608678018, "sim_compute_robot_state-ego": 0.00959469118425923}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.015413067581461, "sim_physics": 0.07719876668224596, "survival_time": 14.600000000000072, "driven_lanedir": 3.828126425158171, "sim_render-ego": 0.01302749898335705, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.2208167502324875, "deviation-heading": 2.5660136855593305, "set_robot_commands": 0.009533003584979332, "deviation-center-line": 0.6213086322148774, "driven_lanedir_consec": 3.828126425158171, "sim_compute_sim_state": 0.0054854824118418235, "sim_compute_performance-ego": 0.007863459521777008, "sim_compute_robot_state-ego": 0.009470201518437634}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.651829818204731, "sim_physics": 0.07685993353525798, "survival_time": 14.950000000000076, "driven_lanedir": 4.558914344570558, "sim_render-ego": 0.013083215554555256, "in-drivable-lane": 0, "agent_compute-ego": 0.22141369501749675, "deviation-heading": 2.4727579883128974, "set_robot_commands": 0.00963842471440633, "deviation-center-line": 0.8491838791029767, "driven_lanedir_consec": 4.558914344570558, "sim_compute_sim_state": 0.005694077014923095, "sim_compute_performance-ego": 0.008080646991729737, "sim_compute_robot_state-ego": 0.009620477358500162}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.658565884389769, "sim_physics": 0.07952657699584961, "survival_time": 14.950000000000076, "driven_lanedir": 4.431107881837393, "sim_render-ego": 0.014200698534647624, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.22090404033660888, "deviation-heading": 2.4390447548449856, "set_robot_commands": 0.009920079708099366, "deviation-center-line": 0.6427660824562942, "driven_lanedir_consec": 4.431107881837393, "sim_compute_sim_state": 0.005819242000579834, "sim_compute_performance-ego": 0.008348969618479411, "sim_compute_robot_state-ego": 0.00990254243214925}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.6669521172459225, "sim_physics": 0.07776787996292114, "survival_time": 14.950000000000076, "driven_lanedir": 3.908185982414876, "sim_render-ego": 0.012719671726226806, "in-drivable-lane": 2.7000000000000153, "agent_compute-ego": 0.2215564529101054, "deviation-heading": 3.21859142979319, "set_robot_commands": 0.009822269280751549, "deviation-center-line": 0.7073466872295378, "driven_lanedir_consec": 3.908185982414876, "sim_compute_sim_state": 0.005655091603597005, "sim_compute_performance-ego": 0.007990413506825765, "sim_compute_robot_state-ego": 0.00964286963144938}}
set_robot_commands_max0.009920079708099366
set_robot_commands_mean0.009729235193483222
set_robot_commands_median0.00973239867917953
set_robot_commands_min0.009533003584979332
sim_compute_performance-ego_max0.008348969618479411
sim_compute_performance-ego_mean0.008097928049497988
sim_compute_performance-ego_median0.008080646991729737
sim_compute_performance-ego_min0.007863459521777008
sim_compute_robot_state-ego_max0.00990254243214925
sim_compute_robot_state-ego_mean0.009646156424959132
sim_compute_robot_state-ego_median0.009620477358500162
sim_compute_robot_state-ego_min0.009470201518437634
sim_compute_sim_state_max0.005819242000579834
sim_compute_sim_state_mean0.005669892432324787
sim_compute_sim_state_median0.005694077014923095
sim_compute_sim_state_min0.0054854824118418235
sim_physics_max0.07952657699584961
sim_physics_mean0.07798573027775273
sim_physics_median0.07776787996292114
sim_physics_min0.07685993353525798
sim_render-ego_max0.014200698534647624
sim_render-ego_mean0.013210917171313074
sim_render-ego_median0.01302749898335705
sim_render-ego_min0.012719671726226806
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.440000000000056
survival_time_min7.7499999999999805
260564572miksazchameleon-3aido3-LF-sim-validationstep1-simulationhost-errorno-0:12:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1563, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1619, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4572/step1-simulation-ip-172-31-46-148-10491-job26056/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-0-0/camera.mp4.metadata.yaml']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.