Duckietown Challenges Home Challenges Submissions

Submission 10794

Submission10794
Competingyes
Challengeaido5-LF-sim-validation
UserAyman Shams 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57857
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57857

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
57857LFv-simsuccessyes0:47:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013885920688969012
agent_compute-ego0_mean0.013598070305451862
agent_compute-ego0_median0.013646315277664984
agent_compute-ego0_min0.013213729977508469
complete-iteration_max0.3912422541873243
complete-iteration_mean0.3322712652986989
complete-iteration_median0.33629158742223353
complete-iteration_min0.26525963216300413
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.999261873548573e-06
get_duckie_state_mean1.8305226626940115e-06
get_duckie_state_median1.8910702618830016e-06
get_duckie_state_min1.540688253461471e-06
get_robot_state_max0.0044342566290862554
get_robot_state_mean0.004169094522827174
get_robot_state_median0.004164481043914871
get_robot_state_min0.003913159374392698
get_state_dump_max0.005264518858491133
get_state_dump_mean0.0050724912047088394
get_state_dump_median0.005055469537555526
get_state_dump_min0.004914506885233171
get_ui_image_max0.03908108354706649
get_ui_image_mean0.03336085382845876
get_ui_image_median0.03303585352250479
get_ui_image_min0.028290624721758965
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.029910468141998877, "step_physics": 0.23737926526827977, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005000068980589398, "get_robot_state": 0.004165820535473978, "sim_render-ego0": 0.004234706035363089, "get_duckie_state": 1.999261873548573e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013447128465828748, "complete-iteration": 0.30846713027985867, "set_robot_commands": 0.002477459268307904, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009399652282562385, "sim_compute_performance-ego0": 0.002343939305542907}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03908108354706649, "step_physics": 0.30708995707128367, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.005110870094521655, "get_robot_state": 0.004163141552355764, "sim_render-ego0": 0.004297772216161622, "get_duckie_state": 1.8374707478468465e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013845502089501222, "complete-iteration": 0.3912422541873243, "set_robot_commands": 0.0024092937885573464, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012805457119143672, "sim_compute_performance-ego0": 0.0023337262159183955}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03616123890301071, "step_physics": 0.28455919727099926, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005264518858491133, "get_robot_state": 0.0044342566290862554, "sim_render-ego0": 0.0043953419922789765, "get_duckie_state": 1.944669775919156e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.013885920688969012, "complete-iteration": 0.3641160445646085, "set_robot_commands": 0.0025922118575249387, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010272312521636734, "sim_compute_performance-ego0": 0.002435787631311981}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.028290624721758965, "step_physics": 0.19995308259841704, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004914506885233171, "get_robot_state": 0.003913159374392698, "sim_render-ego0": 0.003979338694373138, "get_duckie_state": 1.540688253461471e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.013213729977508469, "complete-iteration": 0.26525963216300413, "set_robot_commands": 0.0023481403163430298, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00649489967352544, "sim_compute_performance-ego0": 0.002059877762488779}}
set_robot_commands_max0.0025922118575249387
set_robot_commands_mean0.002456776307683305
set_robot_commands_median0.0024433765284326255
set_robot_commands_min0.0023481403163430298
sim_compute_performance-ego0_max0.002435787631311981
sim_compute_performance-ego0_mean0.0022933327288155157
sim_compute_performance-ego0_median0.002338832760730651
sim_compute_performance-ego0_min0.002059877762488779
sim_compute_sim_state_max0.012805457119143672
sim_compute_sim_state_mean0.009743080399217058
sim_compute_sim_state_median0.00983598240209956
sim_compute_sim_state_min0.00649489967352544
sim_render-ego0_max0.0043953419922789765
sim_render-ego0_mean0.004226789734544207
sim_render-ego0_median0.004266239125762355
sim_render-ego0_min0.003979338694373138
simulation-passed1
step_physics_max0.30708995707128367
step_physics_mean0.2572453755522449
step_physics_median0.2609692312696395
step_physics_min0.19995308259841704
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
57854LFv-simsuccessyes0:44:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
57853LFv-simhost-erroryes0:33:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 803, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 45, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 265, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 272, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 163, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 149, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/aido5-LF-sim-validation/submission10794/LFv-sim-nogpu-prod-07_bf5d8637257e-job57853-a-wd/challenge-evaluation-output/episodes/LF-norm-techtrack-000/log.gs2.cbor' -> '/tmp/tmpvl5xl3yylog.gs2.cbor'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
57852LFv-simerroryes0:22:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 323, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 302, in read_and_draw
    draw_static(
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/svg_drawing/misc.py", line 355, in draw_static
    f.write(html)
OSError: [Errno 28] No space left on device

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
57850LFv-simhost-erroryes0:23:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible