Duckietown Challenges Home Challenges Submissions

Submission 10061

Submission10061
Competingyes
Challengeaido5-LF-sim-validation
UserFernanda Custodio Pereira do Carmo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57990
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57990

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57990LFv-simsuccessyes0:27:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.822490419925343
survival_time_median52.87499999999913
deviation-center-line_median3.37207043136626
in-drivable-lane_median9.674999999999708


other stats
agent_compute-ego0_max0.03583047927964438
agent_compute-ego0_mean0.018364386879897457
agent_compute-ego0_median0.012798563502543416
agent_compute-ego0_min0.012029941234858604
complete-iteration_max0.19330914141768116
complete-iteration_mean0.17748000915811757
complete-iteration_median0.18071727016543945
complete-iteration_min0.1551763548839102
deviation-center-line_max4.847534747279224
deviation-center-line_mean3.051639975297573
deviation-center-line_min0.6148842911785494
deviation-heading_max6.668163742509854
deviation-heading_mean4.851782908378222
deviation-heading_median5.845855466900577
deviation-heading_min1.0472569572018773
driven_any_max10.079317251582156
driven_any_mean7.447507456277781
driven_any_median8.25478077160518
driven_any_min3.2011510303186093
driven_lanedir_consec_max8.652129950617487
driven_lanedir_consec_mean5.901983572286772
driven_lanedir_consec_min1.310823498678917
driven_lanedir_max8.652129950617487
driven_lanedir_mean5.901983572286772
driven_lanedir_median6.822490419925343
driven_lanedir_min1.310823498678917
get_duckie_state_max1.980086504402807e-06
get_duckie_state_mean1.9098351094449355e-06
get_duckie_state_median1.9531756538380102e-06
get_duckie_state_min1.7529026257009133e-06
get_robot_state_max0.0038498135112779103
get_robot_state_mean0.003640970538841675
get_robot_state_median0.0036238984030531407
get_robot_state_min0.003466271837982508
get_state_dump_max0.004714218236632266
get_state_dump_mean0.004578946222241864
get_state_dump_median0.004610326923875734
get_state_dump_min0.004380912804583725
get_ui_image_max0.034633573550577605
get_ui_image_mean0.029335002054159183
get_ui_image_median0.029278908107843934
get_ui_image_min0.02414861845037125
in-drivable-lane_max12.150000000000173
in-drivable-lane_mean9.249999999999858
in-drivable-lane_min5.499999999999847
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.079317251582156, "get_ui_image": 0.026590152346621345, "step_physics": 0.09155734095545633, "survival_time": 59.99999999999873, "driven_lanedir": 8.652129950617487, "get_state_dump": 0.004545452394255195, "get_robot_state": 0.003601970323217997, "sim_render-ego0": 0.0037317432829184296, "get_duckie_state": 1.940699441546107e-06, "in-drivable-lane": 7.599999999999696, "deviation-heading": 6.169705147078137, "agent_compute-ego0": 0.012029941234858604, "complete-iteration": 0.1551763548839102, "set_robot_commands": 0.002121635718111392, "deviation-center-line": 4.847534747279224, "driven_lanedir_consec": 8.652129950617487, "sim_compute_sim_state": 0.008993800534098274, "sim_compute_performance-ego0": 0.0019249781085291472}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.2011510303186093, "get_ui_image": 0.034633573550577605, "step_physics": 0.11787518635211788, "survival_time": 20.60000000000016, "driven_lanedir": 1.310823498678917, "get_state_dump": 0.004714218236632266, "get_robot_state": 0.003645826482888284, "sim_render-ego0": 0.0038044308346062536, "get_duckie_state": 1.980086504402807e-06, "in-drivable-lane": 12.150000000000173, "deviation-heading": 1.0472569572018773, "agent_compute-ego0": 0.012788433716891753, "complete-iteration": 0.19330914141768116, "set_robot_commands": 0.002142482461998595, "deviation-center-line": 0.6148842911785494, "driven_lanedir_consec": 1.310823498678917, "sim_compute_sim_state": 0.011669609794893796, "sim_compute_performance-ego0": 0.0019507437006324605}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.9631550472794785, "get_ui_image": 0.03196766386906653, "step_physics": 0.11747932668336092, "survival_time": 45.74999999999954, "driven_lanedir": 5.151402074721798, "get_state_dump": 0.004675201453496275, "get_robot_state": 0.0038498135112779103, "sim_render-ego0": 0.003938582786826588, "get_duckie_state": 1.965651866129913e-06, "in-drivable-lane": 11.74999999999972, "deviation-heading": 5.5220057867230175, "agent_compute-ego0": 0.012808693288195082, "complete-iteration": 0.192154553259304, "set_robot_commands": 0.0022682878127785228, "deviation-center-line": 2.6300887859900963, "driven_lanedir_consec": 5.151402074721798, "sim_compute_sim_state": 0.012992756856060444, "sim_compute_performance-ego0": 0.0020883419107662017}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.54640649593088, "get_ui_image": 0.02414861845037125, "step_physics": 0.08818550530718725, "survival_time": 59.99999999999873, "driven_lanedir": 8.493578765128888, "get_state_dump": 0.004380912804583725, "get_robot_state": 0.003466271837982508, "sim_render-ego0": 0.0035552944767782827, "get_duckie_state": 1.7529026257009133e-06, "in-drivable-lane": 5.499999999999847, "deviation-heading": 6.668163742509854, "agent_compute-ego0": 0.03583047927964438, "complete-iteration": 0.16927998707157488, "set_robot_commands": 0.0020270683088469367, "deviation-center-line": 4.114052076742423, "driven_lanedir_consec": 8.493578765128888, "sim_compute_sim_state": 0.005815699733762717, "sim_compute_performance-ego0": 0.0017900526473960908}}
set_robot_commands_max0.0022682878127785228
set_robot_commands_mean0.0021398685754338616
set_robot_commands_median0.002132059090054994
set_robot_commands_min0.0020270683088469367
sim_compute_performance-ego0_max0.0020883419107662017
sim_compute_performance-ego0_mean0.0019385290918309751
sim_compute_performance-ego0_median0.0019378609045808035
sim_compute_performance-ego0_min0.0017900526473960908
sim_compute_sim_state_max0.012992756856060444
sim_compute_sim_state_mean0.009867966729703808
sim_compute_sim_state_median0.010331705164496037
sim_compute_sim_state_min0.005815699733762717
sim_render-ego0_max0.003938582786826588
sim_render-ego0_mean0.003757512845282388
sim_render-ego0_median0.0037680870587623416
sim_render-ego0_min0.0035552944767782827
simulation-passed1
step_physics_max0.11787518635211788
step_physics_mean0.1037743398245306
step_physics_median0.10451833381940864
step_physics_min0.08818550530718725
survival_time_max59.99999999999873
survival_time_mean46.58749999999929
survival_time_min20.60000000000016
No reset possible
51909LFv-simerrorno0:04:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139931410502560
- M:video_aido:cmdline(in:/;out:/) 139931410502032
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
41518LFv-simsuccessno0:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
37174LFv-simsuccessno0:10:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
36593LFv-simsuccessno0:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
36592LFv-simsuccessno0:11:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible