Duckietown Challenges Home Challenges Submissions

Submission 11601

Submission11601
Competingyes
Challengeaido5-LF-sim-validation
UserJean-Sébastien Grondin 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 54287
Next
User labelsim-exercise-2
Admin priority50
Blessingn/a
User priority50

54287

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
54287LFv-simsuccessyes0:28:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.352416319083252
survival_time_median55.174999999999
deviation-center-line_median1.7338464226629915
in-drivable-lane_median32.02499999999935


other stats
agent_compute-ego0_max0.012830386650155326
agent_compute-ego0_mean0.012589615512786844
agent_compute-ego0_median0.012593538872402813
agent_compute-ego0_min0.012340997656186422
complete-iteration_max0.30018571217854817
complete-iteration_mean0.2458990501133769
complete-iteration_median0.23908016533587123
complete-iteration_min0.205250157603217
deviation-center-line_max2.09239612944691
deviation-center-line_mean1.4302356091866706
deviation-center-line_min0.16085346197378936
deviation-heading_max14.341442554673254
deviation-heading_mean8.9926857991988
deviation-heading_median9.985540710640702
deviation-heading_min1.658219220840542
driven_any_max12.504811691058126
driven_any_mean9.051802596715646
driven_any_median11.415209357843866
driven_any_min0.8719799801167221
driven_lanedir_consec_max3.272602292300917
driven_lanedir_consec_mean2.11893701908899
driven_lanedir_consec_min0.4983131458885377
driven_lanedir_max3.986561316841666
driven_lanedir_mean3.058941507729533
driven_lanedir_median3.875445784093964
driven_lanedir_min0.4983131458885377
get_duckie_state_max1.4327821277436756e-06
get_duckie_state_mean1.3371813207939205e-06
get_duckie_state_median1.3094162762313955e-06
get_duckie_state_min1.297110602969215e-06
get_robot_state_max0.003789611501955768
get_robot_state_mean0.003692204400629383
get_robot_state_median0.003683966550671616
get_robot_state_min0.003611272999218532
get_state_dump_max0.004850977943057106
get_state_dump_mean0.004702370643009932
get_state_dump_median0.004680472647121407
get_state_dump_min0.004597559334739806
get_ui_image_max0.03544680504571824
get_ui_image_mean0.030581914270549886
get_ui_image_median0.03041258104131839
get_ui_image_min0.026055689953844514
in-drivable-lane_max36.74999999999862
in-drivable-lane_mean25.674999999999333
in-drivable-lane_min1.8999999999999932
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.335859846711813, "get_ui_image": 0.0277858842459936, "step_physics": 0.14976112331662858, "survival_time": 50.34999999999928, "driven_lanedir": 3.794325658971368, "get_state_dump": 0.004597559334739806, "get_robot_state": 0.003611272999218532, "sim_render-ego0": 0.0036777998246843857, "get_duckie_state": 1.297110602969215e-06, "in-drivable-lane": 29.09999999999932, "deviation-heading": 8.834101067648751, "agent_compute-ego0": 0.012340997656186422, "complete-iteration": 0.2153963077635992, "set_robot_commands": 0.0021657018907486445, "deviation-center-line": 1.66534631852761, "driven_lanedir_consec": 1.982370474032104, "sim_compute_sim_state": 0.009431421283691647, "sim_compute_performance-ego0": 0.0019392297854499212}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8719799801167221, "get_ui_image": 0.03544680504571824, "step_physics": 0.22490136509849912, "survival_time": 5.1999999999999895, "driven_lanedir": 0.4983131458885377, "get_state_dump": 0.004850977943057106, "get_robot_state": 0.003702919823782784, "sim_render-ego0": 0.003787381308419364, "get_duckie_state": 1.4327821277436756e-06, "in-drivable-lane": 1.8999999999999932, "deviation-heading": 1.658219220840542, "agent_compute-ego0": 0.01272847538902646, "complete-iteration": 0.30018571217854817, "set_robot_commands": 0.0022381873357863653, "deviation-center-line": 0.16085346197378936, "driven_lanedir_consec": 0.4983131458885377, "sim_compute_sim_state": 0.010418878282819476, "sim_compute_performance-ego0": 0.002016487575712658}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.49455886897592, "get_ui_image": 0.03303927783664319, "step_physics": 0.18817135019167375, "survival_time": 59.99999999999873, "driven_lanedir": 3.95656590921656, "get_state_dump": 0.004660759242150706, "get_robot_state": 0.003789611501955768, "sim_render-ego0": 0.003907566562878103, "get_duckie_state": 1.317555461696145e-06, "in-drivable-lane": 36.74999999999862, "deviation-heading": 11.136980353632657, "agent_compute-ego0": 0.012830386650155326, "complete-iteration": 0.26276402290814327, "set_robot_commands": 0.0022959951357877225, "deviation-center-line": 1.802346526798373, "driven_lanedir_consec": 3.272602292300917, "sim_compute_sim_state": 0.011883650890099417, "sim_compute_performance-ego0": 0.002095417218045529}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.504811691058126, "get_ui_image": 0.026055689953844514, "step_physics": 0.14405771080004384, "survival_time": 59.99999999999873, "driven_lanedir": 3.986561316841666, "get_state_dump": 0.004700186052092109, "get_robot_state": 0.003665013277560448, "sim_render-ego0": 0.003734689072506513, "get_duckie_state": 1.3012770907666462e-06, "in-drivable-lane": 34.94999999999939, "deviation-heading": 14.341442554673254, "agent_compute-ego0": 0.01245860235577916, "complete-iteration": 0.205250157603217, "set_robot_commands": 0.0021854050451273923, "deviation-center-line": 2.09239612944691, "driven_lanedir_consec": 2.7224621641344005, "sim_compute_sim_state": 0.00635764124391478, "sim_compute_performance-ego0": 0.0019498464963914552}}
set_robot_commands_max0.0022959951357877225
set_robot_commands_mean0.0022213223518625313
set_robot_commands_median0.002211796190456879
set_robot_commands_min0.0021657018907486445
sim_compute_performance-ego0_max0.002095417218045529
sim_compute_performance-ego0_mean0.002000245268899891
sim_compute_performance-ego0_median0.0019831670360520564
sim_compute_performance-ego0_min0.0019392297854499212
sim_compute_sim_state_max0.011883650890099417
sim_compute_sim_state_mean0.00952289792513133
sim_compute_sim_state_median0.009925149783255562
sim_compute_sim_state_min0.00635764124391478
sim_render-ego0_max0.003907566562878103
sim_render-ego0_mean0.0037768591921220913
sim_render-ego0_median0.003761035190462938
sim_render-ego0_min0.0036777998246843857
simulation-passed1
step_physics_max0.22490136509849912
step_physics_mean0.17672288735171132
step_physics_median0.16896623675415118
step_physics_min0.14405771080004384
survival_time_max59.99999999999873
survival_time_mean43.88749999999918
survival_time_min5.1999999999999895
No reset possible
54284LFv-simsuccessyes0:23:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
49347LFv-simerrorno0:02:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140161081537824
- M:video_aido:cmdline(in:/;out:/) 140161116283040
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
43078LFv-simsuccessno0:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
43077LFv-simsuccessno0:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
43076LFv-simsuccessno0:09:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible