Duckietown Challenges Home Challenges Submissions

Submission 17652

Submission17652
Competingyes
Challengeaido-LFI-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105446 sim-1of4: 106842 sim-2of4: 105445 sim-3of4: 105443
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

106842

Click the images to see detailed statistics about the episode.

4way-000

105446

Click the images to see detailed statistics about the episode.

4way-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
106842sim-1of4successyes0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median0.9
driven_lanedir_consec_median0.39017518658850303
deviation-center-line_median0.17124897035562547


other stats
deviation-center-line_max0.17124897035562547
deviation-center-line_mean0.17124897035562547
deviation-center-line_min0.17124897035562547
deviation-heading_max1.7031418047241604
deviation-heading_mean1.7031418047241604
deviation-heading_median1.7031418047241604
deviation-heading_min1.7031418047241604
distance-from-start_max0.40285563030398
distance-from-start_mean0.40285563030398
distance-from-start_median0.40285563030398
distance-from-start_min0.40285563030398
driven_any_max0.4240764502839632
driven_any_mean0.4240764502839632
driven_any_median0.4240764502839632
driven_any_min0.4240764502839632
driven_lanedir_consec_max0.39017518658850303
driven_lanedir_consec_mean0.39017518658850303
driven_lanedir_consec_min0.39017518658850303
driven_lanedir_max0.39017518658850303
driven_lanedir_mean0.39017518658850303
driven_lanedir_median0.39017518658850303
driven_lanedir_min0.39017518658850303
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4240764502839632, "survival_time": 3.7499999999999942, "driven_lanedir": 0.39017518658850303, "in-drivable-lane": 0.9, "deviation-heading": 1.7031418047241604, "distance-from-start": 0.40285563030398, "deviation-center-line": 0.17124897035562547, "driven_lanedir_consec": 0.39017518658850303}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
106831sim-1of4successyes0:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105446sim-0of4successyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median0.9
driven_lanedir_consec_median0.39017518658850303
deviation-center-line_median0.17124897035562547


other stats
deviation-center-line_max0.17124897035562547
deviation-center-line_mean0.17124897035562547
deviation-center-line_min0.17124897035562547
deviation-heading_max1.7031418047241604
deviation-heading_mean1.7031418047241604
deviation-heading_median1.7031418047241604
deviation-heading_min1.7031418047241604
distance-from-start_max0.40285563030398
distance-from-start_mean0.40285563030398
distance-from-start_median0.40285563030398
distance-from-start_min0.40285563030398
driven_any_max0.4240764502839632
driven_any_mean0.4240764502839632
driven_any_median0.4240764502839632
driven_any_min0.4240764502839632
driven_lanedir_consec_max0.39017518658850303
driven_lanedir_consec_mean0.39017518658850303
driven_lanedir_consec_min0.39017518658850303
driven_lanedir_max0.39017518658850303
driven_lanedir_mean0.39017518658850303
driven_lanedir_median0.39017518658850303
driven_lanedir_min0.39017518658850303
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4240764502839632, "survival_time": 3.7499999999999942, "driven_lanedir": 0.39017518658850303, "in-drivable-lane": 0.9, "deviation-heading": 1.7031418047241604, "distance-from-start": 0.40285563030398, "deviation-center-line": 0.17124897035562547, "driven_lanedir_consec": 0.39017518658850303}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
105445sim-2of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
105443sim-3of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
105439sim-2of4successyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105437sim-0of4successyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105436sim-3of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105433sim-3of4successyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105432sim-2of4successyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105430sim-0of4successyes0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105427sim-3of4successyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105426sim-2of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105425sim-0of4successyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105423sim-2of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105420sim-2of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105419sim-0of4successyes0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103671sim-1of4host-errorno0:01:20
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103652sim-1of4host-errorno0:03:03
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103302sim-1of4host-errorno0:01:00
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103293sim-1of4host-errorno0:01:04
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103279sim-1of4host-errorno0:01:13
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103275sim-0of4failedno0:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103267sim-1of4host-errorno0:01:01
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103262sim-0of4host-errorno0:01:02
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103256sim-1of4host-errorno0:01:01
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103250sim-0of4host-errorno0:01:26
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103247sim-1of4host-errorno0:01:10
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103236sim-1of4host-errorno0:01:14
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103226sim-1of4host-errorno0:01:02
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103216sim-1of4host-errorno0:01:03
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103206sim-1of4host-errorno0:01:02
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103198sim-3of4successno0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103197sim-0of4host-errorno0:01:01
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103196sim-2of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103190sim-3of4successno0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103187sim-0of4host-errorno0:01:04
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103185sim-2of4successno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103180sim-0of4host-errorno0:01:01
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103177sim-3of4successno0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103176sim-2of4successno0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible