Duckietown Challenges Home Challenges Submissions

Submission 11045

Submission11045
Competingyes
Challengeaido5-LF-sim-validation
UserBhavya Patwa 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 56979
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

56979

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
56979LFv-simsuccessyes0:24:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.423241119801212
survival_time_median40.14999999999967
deviation-center-line_median1.2237636068275957
in-drivable-lane_median11.25000000000016


other stats
agent_compute-ego0_max0.012688317628049138
agent_compute-ego0_mean0.01221108659023355
agent_compute-ego0_median0.012095273320134842
agent_compute-ego0_min0.011965482092615384
complete-iteration_max0.19894250019176588
complete-iteration_mean0.18139664733123023
complete-iteration_median0.18322312920840816
complete-iteration_min0.16019783071633878
deviation-center-line_max1.70224764388127
deviation-center-line_mean1.2301125753574849
deviation-center-line_min0.7706754438934779
deviation-heading_max13.201256968504396
deviation-heading_mean7.991483425791287
deviation-heading_median6.9063653164167675
deviation-heading_min4.951946101827219
driven_any_max5.329585632509499
driven_any_mean3.800797662164461
driven_any_median3.793661665266468
driven_any_min2.286281685615407
driven_lanedir_consec_max3.665393939993251
driven_lanedir_consec_mean2.5667573461556388
driven_lanedir_consec_min1.75515320502688
driven_lanedir_max3.665393939993251
driven_lanedir_mean2.5667573461556388
driven_lanedir_median2.423241119801212
driven_lanedir_min1.75515320502688
get_duckie_state_max2.03100603018234e-06
get_duckie_state_mean1.9187801532919223e-06
get_duckie_state_median1.8917415520929968e-06
get_duckie_state_min1.860631478799356e-06
get_robot_state_max0.0036929002893504818
get_robot_state_mean0.003554919673516053
get_robot_state_median0.0035541656033095913
get_robot_state_min0.0034184471980945484
get_state_dump_max0.004657520509477871
get_state_dump_mean0.004517307776292674
get_state_dump_median0.004505200799754723
get_state_dump_min0.0044013089961833785
get_ui_image_max0.03334975564802015
get_ui_image_mean0.029480122777564857
get_ui_image_median0.029579312498889752
get_ui_image_min0.025412110464459754
in-drivable-lane_max22.39999999999947
in-drivable-lane_mean11.937499999999956
in-drivable-lane_min2.8500000000000405
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.57173854336769, "get_ui_image": 0.02708317183736545, "step_physics": 0.10797873139381409, "survival_time": 26.750000000000245, "driven_lanedir": 1.75515320502688, "get_state_dump": 0.004438696957346219, "get_robot_state": 0.0035071888966346854, "sim_render-ego0": 0.0036685738100934386, "get_duckie_state": 1.8828840398076756e-06, "in-drivable-lane": 8.850000000000126, "deviation-heading": 4.951946101827219, "agent_compute-ego0": 0.011965482092615384, "complete-iteration": 0.1718969167168461, "set_robot_commands": 0.0020412193305456815, "deviation-center-line": 0.9511352046037148, "driven_lanedir_consec": 1.75515320502688, "sim_compute_sim_state": 0.009281763834739798, "sim_compute_performance-ego0": 0.0018527223103082}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.286281685615407, "get_ui_image": 0.03334975564802015, "step_physics": 0.12776765039375235, "survival_time": 22.15000000000018, "driven_lanedir": 1.873644705740616, "get_state_dump": 0.0044013089961833785, "get_robot_state": 0.0034184471980945484, "sim_render-ego0": 0.0036686444067740224, "get_duckie_state": 1.860631478799356e-06, "in-drivable-lane": 2.8500000000000405, "deviation-heading": 5.86674343516079, "agent_compute-ego0": 0.012043069611798535, "complete-iteration": 0.19894250019176588, "set_robot_commands": 0.002026119210698583, "deviation-center-line": 0.7706754438934779, "driven_lanedir_consec": 1.873644705740616, "sim_compute_sim_state": 0.010334393999598047, "sim_compute_performance-ego0": 0.0018513245625538868}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.329585632509499, "get_ui_image": 0.032075453160414054, "step_physics": 0.12285277492074824, "survival_time": 53.549999999999095, "driven_lanedir": 2.9728375338618083, "get_state_dump": 0.004657520509477871, "get_robot_state": 0.0036929002893504818, "sim_render-ego0": 0.003879157464895675, "get_duckie_state": 2.03100603018234e-06, "in-drivable-lane": 22.39999999999947, "deviation-heading": 7.945987197672744, "agent_compute-ego0": 0.012688317628049138, "complete-iteration": 0.1945493416999703, "set_robot_commands": 0.0022233571134396453, "deviation-center-line": 1.4963920090514766, "driven_lanedir_consec": 2.9728375338618083, "sim_compute_sim_state": 0.010453104305623184, "sim_compute_performance-ego0": 0.001943245085317697}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.0155847871652455, "get_ui_image": 0.025412110464459754, "step_physics": 0.10057014926684886, "survival_time": 59.99999999999873, "driven_lanedir": 3.665393939993251, "get_state_dump": 0.004571704642163228, "get_robot_state": 0.0036011423099844976, "sim_render-ego0": 0.0037725599084071177, "get_duckie_state": 1.9005990643783176e-06, "in-drivable-lane": 13.650000000000194, "deviation-heading": 13.201256968504396, "agent_compute-ego0": 0.012147477028471148, "complete-iteration": 0.16019783071633878, "set_robot_commands": 0.002188247804538495, "deviation-center-line": 1.70224764388127, "driven_lanedir_consec": 3.665393939993251, "sim_compute_sim_state": 0.005926503825445755, "sim_compute_performance-ego0": 0.00192710640626982}}
set_robot_commands_max0.0022233571134396453
set_robot_commands_mean0.0021197358648056015
set_robot_commands_median0.002114733567542088
set_robot_commands_min0.002026119210698583
sim_compute_performance-ego0_max0.001943245085317697
sim_compute_performance-ego0_mean0.001893599591112401
sim_compute_performance-ego0_median0.00188991435828901
sim_compute_performance-ego0_min0.0018513245625538868
sim_compute_sim_state_max0.010453104305623184
sim_compute_sim_state_mean0.008998941491351695
sim_compute_sim_state_median0.009808078917168922
sim_compute_sim_state_min0.005926503825445755
sim_render-ego0_max0.003879157464895675
sim_render-ego0_mean0.003747233897542564
sim_render-ego0_median0.00372060215759057
sim_render-ego0_min0.0036685738100934386
simulation-passed1
step_physics_max0.12776765039375235
step_physics_mean0.1147923264937909
step_physics_median0.11541575315728116
step_physics_min0.10057014926684886
survival_time_max59.99999999999873
survival_time_mean40.61249999999957
survival_time_min22.15000000000018
No reset possible
50813LFv-simerrorno0:07:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139791090979456
- M:video_aido:cmdline(in:/;out:/) 139791091077808
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
50807LFv-simerrorno0:09:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140245075888400
- M:video_aido:cmdline(in:/;out:/) 140245074333760
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
50806LFv-simerrorno0:08:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140631506175984
- M:video_aido:cmdline(in:/;out:/) 140631505997488
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40372LFv-simsuccessno0:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39719LFv-simsuccessno0:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38802LFv-simsuccessno0:05:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38801LFv-simsuccessno0:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible