Duckietown Challenges Home Challenges Submissions

Submission 10960

Submission10960
Competingyes
Challengeaido5-LF-sim-validation
UserHimanshu Arora 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57328
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57328

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57328LFv-simsuccessyes0:36:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.755512725763792
survival_time_median59.99999999999873
deviation-center-line_median3.193721705347145
in-drivable-lane_median10.5999999999998


other stats
agent_compute-ego0_max0.08648877814695409
agent_compute-ego0_mean0.05400429180879355
agent_compute-ego0_median0.058460072414960394
agent_compute-ego0_min0.01260824425829936
complete-iteration_max0.27353604012583815
complete-iteration_mean0.2211549615027272
complete-iteration_median0.21166212551620872
complete-iteration_min0.1877595548526532
deviation-center-line_max3.441322012288808
deviation-center-line_mean3.1560160645238735
deviation-center-line_min2.795298835112396
deviation-heading_max13.208659504837463
deviation-heading_mean12.791514087612718
deviation-heading_median12.92195655704348
deviation-heading_min12.113483731526443
driven_any_max11.064885577105152
driven_any_mean10.346969876349927
driven_any_median10.627380288245009
driven_any_min9.068233351804556
driven_lanedir_consec_max6.725407343808097
driven_lanedir_consec_mean5.36207672843945
driven_lanedir_consec_min3.2118741184221204
driven_lanedir_max9.079651082776152
driven_lanedir_mean7.95406013741141
driven_lanedir_median7.904533824597812
driven_lanedir_min6.927521817673865
get_duckie_state_max1.3344293827816013e-06
get_duckie_state_mean1.2681239967592443e-06
get_duckie_state_median1.275468313356937e-06
get_duckie_state_min1.1871299775415018e-06
get_robot_state_max0.003694261142752947
get_robot_state_mean0.0036117317913175366
get_robot_state_median0.0036255537203803926
get_robot_state_min0.003501558581756414
get_state_dump_max0.00471388311012897
get_state_dump_mean0.004613776992515212
get_state_dump_median0.004648693410709932
get_state_dump_min0.004443838038512015
get_ui_image_max0.03395104825149269
get_ui_image_mean0.02979074837161239
get_ui_image_median0.02962395769670345
get_ui_image_min0.02596402984154995
in-drivable-lane_max18.44999999999976
in-drivable-lane_mean12.29999999999978
in-drivable-lane_min9.549999999999764
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.064885577105152, "get_ui_image": 0.02740616881777901, "step_physics": 0.10165325707936664, "survival_time": 59.99999999999873, "driven_lanedir": 9.079651082776152, "get_state_dump": 0.00471388311012897, "get_robot_state": 0.003657227253338181, "sim_render-ego0": 0.0038137693984820185, "get_duckie_state": 1.3028652245158656e-06, "in-drivable-lane": 9.549999999999764, "deviation-heading": 12.698294513146449, "agent_compute-ego0": 0.03233683317726002, "complete-iteration": 0.1877595548526532, "set_robot_commands": 0.0022063322805742935, "deviation-center-line": 2.795298835112396, "driven_lanedir_consec": 5.789576154943033, "sim_compute_sim_state": 0.00984790005552878, "sim_compute_performance-ego0": 0.0020358228961395086}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.330730296774757, "get_ui_image": 0.03395104825149269, "step_physics": 0.1287818403664874, "survival_time": 59.99999999999873, "driven_lanedir": 6.927521817673865, "get_state_dump": 0.004443838038512015, "get_robot_state": 0.003501558581756414, "sim_render-ego0": 0.00364928718014224, "get_duckie_state": 1.1871299775415018e-06, "in-drivable-lane": 18.44999999999976, "deviation-heading": 13.208659504837463, "agent_compute-ego0": 0.08458331165266077, "complete-iteration": 0.27353604012583815, "set_robot_commands": 0.0021262160943608596, "deviation-center-line": 3.0169724281247827, "driven_lanedir_consec": 3.2118741184221204, "sim_compute_sim_state": 0.010530942881931175, "sim_compute_performance-ego0": 0.001877223919273713}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.924030279715256, "get_ui_image": 0.0318417465756279, "step_physics": 0.1167301472577326, "survival_time": 59.99999999999873, "driven_lanedir": 8.826497071671188, "get_state_dump": 0.004643563128430877, "get_robot_state": 0.003694261142752947, "sim_render-ego0": 0.0038334513385528137, "get_duckie_state": 1.3344293827816013e-06, "in-drivable-lane": 10.699999999999998, "deviation-heading": 12.113483731526443, "agent_compute-ego0": 0.01260824425829936, "complete-iteration": 0.1885640772058009, "set_robot_commands": 0.00216357197789328, "deviation-center-line": 3.3704709825695076, "driven_lanedir_consec": 6.725407343808097, "sim_compute_sim_state": 0.010963711710794086, "sim_compute_performance-ego0": 0.001988918755473344}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.068233351804556, "get_ui_image": 0.02596402984154995, "step_physics": 0.10031524697184108, "survival_time": 52.54999999999915, "driven_lanedir": 6.982570577524436, "get_state_dump": 0.004653823692988987, "get_robot_state": 0.0035938801874226037, "sim_render-ego0": 0.0036936694678244937, "get_duckie_state": 1.2480714021980083e-06, "in-drivable-lane": 10.4999999999996, "deviation-heading": 13.145618600940516, "agent_compute-ego0": 0.08648877814695409, "complete-iteration": 0.23476017382661651, "set_robot_commands": 0.0022372913904516417, "deviation-center-line": 3.441322012288808, "driven_lanedir_consec": 5.7214492965845505, "sim_compute_sim_state": 0.005853221896936685, "sim_compute_performance-ego0": 0.0018653645261612229}}
set_robot_commands_max0.0022372913904516417
set_robot_commands_mean0.002183352935820018
set_robot_commands_median0.0021849521292337864
set_robot_commands_min0.0021262160943608596
sim_compute_performance-ego0_max0.0020358228961395086
sim_compute_performance-ego0_mean0.0019418325242619471
sim_compute_performance-ego0_median0.0019330713373735288
sim_compute_performance-ego0_min0.0018653645261612229
sim_compute_sim_state_max0.010963711710794086
sim_compute_sim_state_mean0.00929894413629768
sim_compute_sim_state_median0.010189421468729976
sim_compute_sim_state_min0.005853221896936685
sim_render-ego0_max0.0038334513385528137
sim_render-ego0_mean0.003747544346250391
sim_render-ego0_median0.003753719433153256
sim_render-ego0_min0.00364928718014224
simulation-passed1
step_physics_max0.1287818403664874
step_physics_mean0.11187012291885694
step_physics_median0.10919170216854962
step_physics_min0.10031524697184108
survival_time_max59.99999999999873
survival_time_mean58.13749999999884
survival_time_min52.54999999999915
No reset possible
51094LFv-simerrorno0:03:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139722408201952
- M:video_aido:cmdline(in:/;out:/) 139722407539952
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51085LFv-simerrorno0:06:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139980357963680
- M:video_aido:cmdline(in:/;out:/) 139980347279392
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51081LFv-simerrorno0:02:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140677676666064
- M:video_aido:cmdline(in:/;out:/) 140677676666784
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40540LFv-simsuccessno0:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40538LFv-simsuccessno0:10:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39834LFv-simsuccessno0:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38549LFv-simsuccessno0:09:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38548LFv-simsuccessno0:11:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible