Submission 6847

Submission

6847

Competing

yes

Challenge

aido5-LF-sim-validation

User

Liam Paull 🇨🇦

Date submitted

2020-10-18 21:30:58+00:00

Last status update

2021-12-04 20:52:37+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 58527

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

58527

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

58527

LFv-sim

success

yes

2020-12-04 00:13:49+00:00

2020-12-04 00:49:18+00:00

0:35:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.199799238659958
survival_time_median	59.99999999999873
deviation-center-line_median	3.7318697333274047
in-drivable-lane_median	4.149999999999846

other stats

agent_compute-ego0_max	0.012766385058578505
agent_compute-ego0_mean	0.012349342873054775
agent_compute-ego0_median	0.012492470697598294
agent_compute-ego0_min	0.011646045038444018
complete-iteration_max	0.21488402328522976
complete-iteration_mean	0.1850880195358016
complete-iteration_median	0.18580335443164783
complete-iteration_min	0.15386134599468096
deviation-center-line_max	4.295744428109565
deviation-center-line_mean	3.65381144917302
deviation-center-line_min	2.855761901927705
deviation-heading_max	12.094012130429492
deviation-heading_mean	10.446082521816756
deviation-heading_median	10.897658178073817
deviation-heading_min	7.895001600689901
driven_any_max	7.921119043226048
driven_any_mean	7.919339129753699
driven_any_median	7.920917289168868
driven_any_min	7.914402897451014
driven_lanedir_consec_max	7.163010239766431
driven_lanedir_consec_mean	6.193762333278199
driven_lanedir_consec_min	5.212440616026455
driven_lanedir_max	7.163010239766431
driven_lanedir_mean	6.977793770115135
driven_lanedir_median	7.073748634320695
driven_lanedir_min	6.6006675720527195
get_duckie_state_max	1.3449507688701798e-06
get_duckie_state_mean	1.288919425030533e-06
get_duckie_state_median	1.291351254834025e-06
get_duckie_state_min	1.2280244215839014e-06
get_robot_state_max	0.003751948513059592
get_robot_state_mean	0.003670221562191013
get_robot_state_median	0.0037016383217931487
get_robot_state_min	0.003525661092118161
get_state_dump_max	0.004713501759512438
get_state_dump_mean	0.004623681778316196
get_state_dump_median	0.004621204984475929
get_state_dump_min	0.004538815384800487
get_ui_image_max	0.036022598400004796
get_ui_image_mean	0.030649829615561987
get_ui_image_median	0.03059550129702248
get_ui_image_min	0.02538571746819819
in-drivable-lane_max	6.499999999999719
in-drivable-lane_mean	4.587499999999806
in-drivable-lane_min	3.549999999999814
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.921119043226048, "get_ui_image": 0.028695074346639236, "step_physics": 0.10694603876309232, "survival_time": 59.99999999999873, "driven_lanedir": 7.096075236205976, "get_state_dump": 0.004632180576816784, "get_robot_state": 0.003751948513059592, "sim_render-ego0": 0.0038080985698969935, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 4.199999999999779, "deviation-heading": 7.895001600689901, "agent_compute-ego0": 0.012439364299091272, "complete-iteration": 0.17367412803770602, "set_robot_commands": 0.00225250985005019, "deviation-center-line": 3.3524205782647907, "driven_lanedir_consec": 5.212440616026455, "sim_compute_sim_state": 0.00906638440045588, "sim_compute_performance-ego0": 0.0019935422098507592}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920951171276801, "get_ui_image": 0.036022598400004796, "step_physics": 0.137030432762254, "survival_time": 59.99999999999873, "driven_lanedir": 7.163010239766431, "get_state_dump": 0.004713501759512438, "get_robot_state": 0.003677878947579593, "sim_render-ego0": 0.003810291584087947, "get_duckie_state": 1.3449507688701798e-06, "in-drivable-lane": 3.549999999999814, "deviation-heading": 11.268760427572834, "agent_compute-ego0": 0.012766385058578505, "complete-iteration": 0.21488402328522976, "set_robot_commands": 0.002195243136670369, "deviation-center-line": 4.111318888390018, "driven_lanedir_consec": 7.163010239766431, "sim_compute_sim_state": 0.01255007409533295, "sim_compute_performance-ego0": 0.002029421327513124}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914402897451014, "get_ui_image": 0.03249592824740573, "step_physics": 0.12481543622743478, "survival_time": 59.99999999999873, "driven_lanedir": 6.6006675720527195, "get_state_dump": 0.004610229392135074, "get_robot_state": 0.003725397696006705, "sim_render-ego0": 0.003811116222537229, "get_duckie_state": 1.2280244215839014e-06, "in-drivable-lane": 6.499999999999719, "deviation-heading": 12.094012130429492, "agent_compute-ego0": 0.012545577096105315, "complete-iteration": 0.19793258082558968, "set_robot_commands": 0.0022522972386445133, "deviation-center-line": 2.855761901927705, "driven_lanedir_consec": 5.515701403811265, "sim_compute_sim_state": 0.011556723234953234, "sim_compute_performance-ego0": 0.0020334091313574136}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920883407060934, "get_ui_image": 0.02538571746819819, "step_physics": 0.0951392692292759, "survival_time": 59.99999999999873, "driven_lanedir": 7.051422032435414, "get_state_dump": 0.004538815384800487, "get_robot_state": 0.003525661092118161, "sim_render-ego0": 0.0036420030061847263, "get_duckie_state": 1.2550226953206313e-06, "in-drivable-lane": 4.099999999999912, "deviation-heading": 10.526555928574796, "agent_compute-ego0": 0.011646045038444018, "complete-iteration": 0.15386134599468096, "set_robot_commands": 0.0021344855067930452, "deviation-center-line": 4.295744428109565, "driven_lanedir_consec": 6.88389707350865, "sim_compute_sim_state": 0.005900028841779393, "sim_compute_performance-ego0": 0.0018700211371708473}}
set_robot_commands_max	0.00225250985005019
set_robot_commands_mean	0.0022086339330395295
set_robot_commands_median	0.002223770187657441
set_robot_commands_min	0.0021344855067930452
sim_compute_performance-ego0_max	0.0020334091313574136
sim_compute_performance-ego0_mean	0.001981598451473036
sim_compute_performance-ego0_median	0.0020114817686819417
sim_compute_performance-ego0_min	0.0018700211371708473
sim_compute_sim_state_max	0.01255007409533295
sim_compute_sim_state_mean	0.009768302643130364
sim_compute_sim_state_median	0.010311553817704556
sim_compute_sim_state_min	0.005900028841779393
sim_render-ego0_max	0.003811116222537229
sim_render-ego0_mean	0.003767877345676724
sim_render-ego0_median	0.00380919507699247
sim_render-ego0_min	0.0036420030061847263
simulation-passed	1
step_physics_max	0.137030432762254
step_physics_mean	0.11598279424551423
step_physics_median	0.11588073749526356
step_physics_min	0.0951392692292759
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58524

LFv-sim

success

yes

2020-12-04 00:12:47+00:00

2020-12-04 00:49:48+00:00

0:37:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52480

LFv-sim

error

2020-12-02 11:45:21+00:00

2020-12-02 11:52:35+00:00

0:07:14

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140070564584272
- M:video_aido:cmdline(in:/;out:/) 140070564582640
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52479

LFv-sim

error

2020-12-02 11:45:11+00:00

2020-12-02 11:57:18+00:00

0:12:07

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140596213881344
- M:video_aido:cmdline(in:/;out:/) 140596213880816
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52470

LFv-sim

error

2020-12-02 11:43:45+00:00

2020-12-02 11:52:49+00:00

0:09:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140604355104288
- M:video_aido:cmdline(in:/;out:/) 140604355127952
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52463

LFv-sim

error

2020-12-02 11:43:21+00:00

2020-12-02 11:49:39+00:00

0:06:18

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139978857229376
- M:video_aido:cmdline(in:/;out:/) 139978857581296
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52460

LFv-sim

error

2020-12-02 11:42:57+00:00

2020-12-02 11:53:45+00:00

0:10:48

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140597693228560
- M:video_aido:cmdline(in:/;out:/) 140597693106016
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52456

LFv-sim

error

2020-12-02 11:42:19+00:00

2020-12-02 11:54:35+00:00

0:12:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140631904408912
- M:video_aido:cmdline(in:/;out:/) 140631904409296
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

41794

LFv-sim

success

2020-11-08 14:52:32+00:00

2020-11-08 15:01:20+00:00

0:08:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38343

LFv-sim

success

2020-11-04 02:29:18+00:00

2020-11-04 02:38:14+00:00

0:08:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38342

LFv-sim

success

2020-11-04 02:28:43+00:00

2020-11-04 02:45:18+00:00

0:16:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38341

LFv-sim

success

2020-11-04 02:28:02+00:00

2020-11-04 02:36:49+00:00

0:08:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36442

LFv-sim

success

2020-11-02 05:38:33+00:00

2020-11-02 05:47:28+00:00

0:08:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35859

LFv-sim

success

2020-11-01 04:30:42+00:00

2020-11-01 04:31:38+00:00

0:00:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35442

LFv-sim

error

2020-10-31 07:33:18+00:00

2020-10-31 07:55:18+00:00

0:22:00

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission6847/LFv-sim-reg04-c054faef3177-1-job35442:

File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission6847/LFv-sim-reg04-c054faef3177-1-job35442/challenge-results/challenge_results.yaml' does not exist.

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

List of all files:

 -/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission6847/LFv-sim-reg04-c054faef3177-1-job35442/docker-compose.original.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission6847/LFv-sim-reg04-c054faef3177-1-job35442/docker-compose.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission6847/LFv-sim-reg04-c054faef3177-1-job35442/logs/challenges-runner/stdout.log
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission6847/LFv-sim-reg04-c054faef3177-1-job35442/logs/challenges-runner/stderr.log

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35126

LFv-sim

success

2020-10-29 13:16:32+00:00

2020-10-29 13:40:16+00:00

0:23:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33460

LFv-sim

success

2020-10-19 20:42:18+00:00

2020-10-19 21:09:18+00:00

0:27:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33443

LFv-sim

success

2020-10-18 21:32:21+00:00

2020-10-18 21:47:03+00:00

0:14:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33442

LFv-sim

success

2020-10-18 21:31:50+00:00

2020-10-18 21:44:15+00:00

0:12:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible