Duckietown Challenges Home Challenges Submissions

Submission 26433

Submission26433
Competingyes
Challengelx22-BV1
Useruser8371
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of5: 186727 sim-1of5: 186719 sim-2of5: 186731 sim-3of5: 186726 sim-4of5: 186730
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

186731

Click the images to see detailed statistics about the episode.

d45

186730

Click the images to see detailed statistics about the episode.

d60

186727

Click the images to see detailed statistics about the episode.

d30

186719

Click the images to see detailed statistics about the episode.

d45

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
186731sim-2of5successyes0:06:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.566262311520331


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.566262311520331
distance-from-start_median3.566262311520331
distance-from-start_min3.566262311520331
driven_any_max3.621077970201592
driven_any_mean3.621077970201592
driven_any_median3.621077970201592
driven_any_min3.621077970201592
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max12.35000000000004
in-drivable-lane_mean12.35000000000004
in-drivable-lane_median12.35000000000004
in-drivable-lane_min12.35000000000004
per-episodes
details{"d45-ego0": {"driven_any": 3.621077970201592, "survival_time": 12.35000000000004, "driven_lanedir": 0.0, "in-drivable-lane": 12.35000000000004, "deviation-heading": 0.0, "distance-from-start": 3.566262311520331, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max12.35000000000004
survival_time_mean12.35000000000004
survival_time_median12.35000000000004
survival_time_min12.35000000000004
No reset possible
186730sim-4of5successyes0:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.623422503691039


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.623422503691039
distance-from-start_median5.623422503691039
distance-from-start_min5.623422503691039
driven_any_max5.6740608231273395
driven_any_mean5.6740608231273395
driven_any_median5.6740608231273395
driven_any_min5.6740608231273395
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max19.30000000000014
in-drivable-lane_mean19.30000000000014
in-drivable-lane_median19.30000000000014
in-drivable-lane_min19.30000000000014
per-episodes
details{"d60-ego0": {"driven_any": 5.6740608231273395, "survival_time": 19.30000000000014, "driven_lanedir": 0.0, "in-drivable-lane": 19.30000000000014, "deviation-heading": 0.0, "distance-from-start": 5.623422503691039, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max19.30000000000014
survival_time_mean19.30000000000014
survival_time_median19.30000000000014
survival_time_min19.30000000000014
No reset possible
186727sim-0of5successyes0:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.480456351037066


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.480456351037066
distance-from-start_median5.480456351037066
distance-from-start_min5.480456351037066
driven_any_max5.83338488144271
driven_any_mean5.83338488144271
driven_any_median5.83338488144271
driven_any_min5.83338488144271
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max20.00000000000015
in-drivable-lane_mean20.00000000000015
in-drivable-lane_median20.00000000000015
in-drivable-lane_min20.00000000000015
per-episodes
details{"d30-ego0": {"driven_any": 5.83338488144271, "survival_time": 20.00000000000015, "driven_lanedir": 0.0, "in-drivable-lane": 20.00000000000015, "deviation-heading": 0.0, "distance-from-start": 5.480456351037066, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max20.00000000000015
survival_time_mean20.00000000000015
survival_time_median20.00000000000015
survival_time_min20.00000000000015
No reset possible
186726sim-3of5failedyes0:03:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186725sim-2of5successyes0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186724sim-3of5successyes0:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186721sim-4of5successyes0:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186720sim-2of5successyes0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186719sim-1of5successyes0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.017835066593789


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.017835066593789
distance-from-start_median5.017835066593789
distance-from-start_min5.017835066593789
driven_any_max5.266981702922765
driven_any_mean5.266981702922765
driven_any_median5.266981702922765
driven_any_min5.266981702922765
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max17.700000000000117
in-drivable-lane_mean17.700000000000117
in-drivable-lane_median17.700000000000117
in-drivable-lane_min17.700000000000117
per-episodes
details{"d45-ego0": {"driven_any": 5.266981702922765, "survival_time": 17.700000000000117, "driven_lanedir": 0.0, "in-drivable-lane": 17.700000000000117, "deviation-heading": 0.0, "distance-from-start": 5.017835066593789, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max17.700000000000117
survival_time_mean17.700000000000117
survival_time_median17.700000000000117
survival_time_min17.700000000000117
No reset possible