Duckietown Challenges Home Challenges Submissions

Submission 10831

Submission10831
Competingyes
Challengeaido5-LF-sim-validation
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57781
Next
User labelreal-exercise-1
Admin priority50
Blessingn/a
User priority50

57781

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57781LFv-simsuccessyes0:13:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7114630094220298
survival_time_median23.6250000000002
deviation-center-line_median0.3975456515437843
in-drivable-lane_median11.40000000000013


other stats
agent_compute-ego0_max0.013053707315140411
agent_compute-ego0_mean0.012466994651544576
agent_compute-ego0_median0.01248485268423708
agent_compute-ego0_min0.011844565922563726
complete-iteration_max0.20517643340333497
complete-iteration_mean0.18260960505346904
complete-iteration_median0.1832218508589714
complete-iteration_min0.15881828509259838
deviation-center-line_max0.5877703460001774
deviation-center-line_mean0.3866771271672208
deviation-center-line_min0.16384685958113712
deviation-heading_max2.8011884069661184
deviation-heading_mean2.045161543693366
deviation-heading_median2.0195093856971713
deviation-heading_min1.340438996413003
driven_any_max5.673191981273219
driven_any_mean3.4975314183700945
driven_any_median3.5228119907805397
driven_any_min1.271309710646079
driven_lanedir_consec_max2.1490414857823823
driven_lanedir_consec_mean1.5675637833353522
driven_lanedir_consec_min0.6982876287149669
driven_lanedir_max2.1490414857823823
driven_lanedir_mean1.5675637833353522
driven_lanedir_median1.7114630094220298
driven_lanedir_min0.6982876287149669
get_duckie_state_max1.254909766648344e-06
get_duckie_state_mean1.2241855472917913e-06
get_duckie_state_median1.2308803159198295e-06
get_duckie_state_min1.1800717906791623e-06
get_robot_state_max0.0037326796716000855
get_robot_state_mean0.0036521747533868054
get_robot_state_median0.003660708551841093
get_robot_state_min0.0035546022382649508
get_state_dump_max0.00462401270152566
get_state_dump_mean0.004563336839704798
get_state_dump_median0.004582501152154249
get_state_dump_min0.004464332352985035
get_ui_image_max0.03544160705840516
get_ui_image_mean0.03032263804649603
get_ui_image_median0.029772633346576018
get_ui_image_min0.02630367843442694
in-drivable-lane_max22.70000000000026
in-drivable-lane_mean12.00000000000014
in-drivable-lane_min2.5000000000000355
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.436860328326119, "get_ui_image": 0.02685376392169432, "step_physics": 0.10540276562625712, "survival_time": 17.550000000000114, "driven_lanedir": 2.1490414857823823, "get_state_dump": 0.004464332352985035, "get_robot_state": 0.0035546022382649508, "sim_render-ego0": 0.003688078712333333, "get_duckie_state": 1.2110580097545276e-06, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 2.8011884069661184, "agent_compute-ego0": 0.011844565922563726, "complete-iteration": 0.16932005638426, "set_robot_commands": 0.0020975755019621415, "deviation-center-line": 0.5877703460001774, "driven_lanedir_consec": 2.1490414857823823, "sim_compute_sim_state": 0.009382448413155296, "sim_compute_performance-ego0": 0.0019492764364589343}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.271309710646079, "get_ui_image": 0.03544160705840516, "step_physics": 0.130686474417498, "survival_time": 8.299999999999983, "driven_lanedir": 0.6982876287149669, "get_state_dump": 0.00462401270152566, "get_robot_state": 0.003640754494124544, "sim_render-ego0": 0.003881972706960347, "get_duckie_state": 1.254909766648344e-06, "in-drivable-lane": 3.8499999999999903, "deviation-heading": 1.340438996413003, "agent_compute-ego0": 0.012774583108410864, "complete-iteration": 0.20517643340333497, "set_robot_commands": 0.0022206720477806596, "deviation-center-line": 0.16384685958113712, "driven_lanedir_consec": 0.6982876287149669, "sim_compute_sim_state": 0.009846373232538829, "sim_compute_performance-ego0": 0.001975126609116971}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.60876365323496, "get_ui_image": 0.03269150277145771, "step_physics": 0.1231690302616408, "survival_time": 29.700000000000287, "driven_lanedir": 1.801545723560999, "get_state_dump": 0.004564833039997005, "get_robot_state": 0.0037326796716000855, "sim_render-ego0": 0.004073611427755917, "get_duckie_state": 1.1800717906791623e-06, "in-drivable-lane": 18.95000000000027, "deviation-heading": 1.5708177875398774, "agent_compute-ego0": 0.013053707315140411, "complete-iteration": 0.1971236453336828, "set_robot_commands": 0.002275452894323012, "deviation-center-line": 0.3834683472804087, "driven_lanedir_consec": 1.801545723560999, "sim_compute_sim_state": 0.011430385333149372, "sim_compute_performance-ego0": 0.0020458361681769876}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.673191981273219, "get_ui_image": 0.02630367843442694, "step_physics": 0.0972341413020364, "survival_time": 32.90000000000027, "driven_lanedir": 1.6213802952830605, "get_state_dump": 0.004600169264311494, "get_robot_state": 0.0036806626095576426, "sim_render-ego0": 0.003938096065260753, "get_duckie_state": 1.2507026220851314e-06, "in-drivable-lane": 22.70000000000026, "deviation-heading": 2.468200983854465, "agent_compute-ego0": 0.012195122260063298, "complete-iteration": 0.15881828509259838, "set_robot_commands": 0.002190361616282253, "deviation-center-line": 0.41162295580716, "driven_lanedir_consec": 1.6213802952830605, "sim_compute_sim_state": 0.006574109761957334, "sim_compute_performance-ego0": 0.0020168254516555253}}
set_robot_commands_max0.002275452894323012
set_robot_commands_mean0.0021960155150870164
set_robot_commands_median0.002205516832031456
set_robot_commands_min0.0020975755019621415
sim_compute_performance-ego0_max0.0020458361681769876
sim_compute_performance-ego0_mean0.0019967661663521045
sim_compute_performance-ego0_median0.001995976030386248
sim_compute_performance-ego0_min0.0019492764364589343
sim_compute_sim_state_max0.011430385333149372
sim_compute_sim_state_mean0.009308329185200206
sim_compute_sim_state_median0.009614410822847062
sim_compute_sim_state_min0.006574109761957334
sim_render-ego0_max0.004073611427755917
sim_render-ego0_mean0.003895439728077587
sim_render-ego0_median0.0039100343861105495
sim_render-ego0_min0.003688078712333333
simulation-passed1
step_physics_max0.130686474417498
step_physics_mean0.11412310290185808
step_physics_median0.11428589794394894
step_physics_min0.0972341413020364
survival_time_max32.90000000000027
survival_time_mean22.11250000000016
survival_time_min8.299999999999983
No reset possible
51578LFv-simerrorno0:08:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140044975660096
- M:video_aido:cmdline(in:/;out:/) 140044975652432
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51566LFv-simerrorno0:07:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139778916143360
- M:video_aido:cmdline(in:/;out:/) 139778916608608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51562LFv-simerrorno0:06:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140442073902336
- M:video_aido:cmdline(in:/;out:/) 140442073923696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40886LFv-simsuccessno0:08:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38071LFv-simsuccessno0:12:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38069LFv-simsuccessno0:12:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38068LFv-simsuccessno0:11:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible