Duckietown Challenges Home Challenges Submissions

Submission 10060

Submission10060
Competingyes
Challengeaido5-LF-sim-validation
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57975
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

57975

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57975LFv-simsuccessyes0:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2793296721394496
survival_time_median20.90000000000016
deviation-center-line_median0.4282125091815885
in-drivable-lane_median13.90000000000015


other stats
agent_compute-ego0_max0.012594940701151282
agent_compute-ego0_mean0.012403388880678564
agent_compute-ego0_median0.012438641180298624
agent_compute-ego0_min0.012141332460965723
complete-iteration_max0.22701075165360063
complete-iteration_mean0.1862394194372771
complete-iteration_median0.1813165248238652
complete-iteration_min0.1553138764477773
deviation-center-line_max0.47803608401383335
deviation-center-line_mean0.43009401039350714
deviation-center-line_min0.38591493919701825
deviation-heading_max4.2194113943136875
deviation-heading_mean2.691728547434204
deviation-heading_median2.43309237762149
deviation-heading_min1.6813180401801475
driven_any_max6.862279441194016
driven_any_mean4.474331759175945
driven_any_median4.927535714466617
driven_any_min1.1799761665765305
driven_lanedir_consec_max2.115374111158261
driven_lanedir_consec_mean1.3746395211687004
driven_lanedir_consec_min0.8245246292376412
driven_lanedir_max2.115374111158261
driven_lanedir_mean1.3746395211687004
driven_lanedir_median1.2793296721394496
driven_lanedir_min0.8245246292376412
get_duckie_state_max1.434043601707176e-06
get_duckie_state_mean1.3086084099387562e-06
get_duckie_state_median1.3289551286331867e-06
get_duckie_state_min1.1424797807814758e-06
get_robot_state_max0.0035483579602391046
get_robot_state_mean0.003540672783001949
get_robot_state_median0.0035441018486195245
get_robot_state_min0.003526129474529641
get_state_dump_max0.00449013613103851
get_state_dump_mean0.004414621498863973
get_state_dump_median0.004452890615368492
get_state_dump_min0.0042625686336803985
get_ui_image_max0.03589292808815285
get_ui_image_mean0.030569533782393084
get_ui_image_median0.030197947772016787
get_ui_image_min0.025989311497385908
in-drivable-lane_max21.950000000000212
in-drivable-lane_mean12.437500000000128
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.168026473298973, "get_ui_image": 0.027784628675163136, "step_physics": 0.10732057397765232, "survival_time": 17.25000000000011, "driven_lanedir": 2.115374111158261, "get_state_dump": 0.0042625686336803985, "get_robot_state": 0.003526129474529641, "sim_render-ego0": 0.0035624669466404555, "get_duckie_state": 1.1424797807814758e-06, "in-drivable-lane": 8.250000000000117, "deviation-heading": 1.6813180401801475, "agent_compute-ego0": 0.012141332460965723, "complete-iteration": 0.17268980583014515, "set_robot_commands": 0.002093076016861579, "deviation-center-line": 0.4632772545436013, "driven_lanedir_consec": 2.115374111158261, "sim_compute_sim_state": 0.01009910023970411, "sim_compute_performance-ego0": 0.0018296613858614357}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.1799761665765305, "get_ui_image": 0.03589292808815285, "step_physics": 0.1526998007739032, "survival_time": 6.699999999999984, "driven_lanedir": 1.1252867099143788, "get_state_dump": 0.00445285196657534, "get_robot_state": 0.0035446290616635923, "sim_render-ego0": 0.0036746289994981553, "get_duckie_state": 1.434043601707176e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.842021770843398, "agent_compute-ego0": 0.012587729206791631, "complete-iteration": 0.22701075165360063, "set_robot_commands": 0.0021841790941026476, "deviation-center-line": 0.47803608401383335, "driven_lanedir_consec": 1.1252867099143788, "sim_compute_sim_state": 0.009952728836624711, "sim_compute_performance-ego0": 0.0019371350606282552}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.687044955634262, "get_ui_image": 0.032611266868870434, "step_physics": 0.11777146948062309, "survival_time": 24.550000000000217, "driven_lanedir": 0.8245246292376412, "get_state_dump": 0.00449013613103851, "get_robot_state": 0.003543574635575457, "sim_render-ego0": 0.003700769529110048, "get_duckie_state": 1.337470077886814e-06, "in-drivable-lane": 19.550000000000185, "deviation-heading": 4.2194113943136875, "agent_compute-ego0": 0.012594940701151282, "complete-iteration": 0.1899432438175853, "set_robot_commands": 0.0021679018571124815, "deviation-center-line": 0.38591493919701825, "driven_lanedir_consec": 0.8245246292376412, "sim_compute_sim_state": 0.011095403655757749, "sim_compute_performance-ego0": 0.001889056306544358}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.862279441194016, "get_ui_image": 0.025989311497385908, "step_physics": 0.09529550565659792, "survival_time": 28.650000000000272, "driven_lanedir": 1.4333726343645203, "get_state_dump": 0.004452929264161645, "get_robot_state": 0.0035483579602391046, "sim_render-ego0": 0.003668847815084956, "get_duckie_state": 1.3204401793795595e-06, "in-drivable-lane": 21.950000000000212, "deviation-heading": 3.024162984399582, "agent_compute-ego0": 0.012289553153805616, "complete-iteration": 0.1553138764477773, "set_robot_commands": 0.002147400420717246, "deviation-center-line": 0.3931477638195757, "driven_lanedir_consec": 1.4333726343645203, "sim_compute_sim_state": 0.005937047536364831, "sim_compute_performance-ego0": 0.001903886994418367}}
set_robot_commands_max0.0021841790941026476
set_robot_commands_mean0.002148139347198489
set_robot_commands_median0.002157651138914864
set_robot_commands_min0.002093076016861579
sim_compute_performance-ego0_max0.0019371350606282552
sim_compute_performance-ego0_mean0.001889934936863104
sim_compute_performance-ego0_median0.0018964716504813624
sim_compute_performance-ego0_min0.0018296613858614357
sim_compute_sim_state_max0.011095403655757749
sim_compute_sim_state_mean0.009271070067112853
sim_compute_sim_state_median0.010025914538164413
sim_compute_sim_state_min0.005937047536364831
sim_render-ego0_max0.003700769529110048
sim_render-ego0_mean0.003651678322583404
sim_render-ego0_median0.003671738407291555
sim_render-ego0_min0.0035624669466404555
simulation-passed1
step_physics_max0.1526998007739032
step_physics_mean0.11827183747219414
step_physics_median0.11254602172913768
step_physics_min0.09529550565659792
survival_time_max28.650000000000272
survival_time_mean19.287500000000147
survival_time_min6.699999999999984
No reset possible
51906LFv-simerrorno0:02:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140439229058928
- M:video_aido:cmdline(in:/;out:/) 140439229539472
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
41519LFv-simsuccessno0:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
37173LFv-simsuccessno0:09:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
36591LFv-simsuccessno0:08:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible