Duckietown Challenges Home Challenges Submissions

Submission 13610

Submission13610
Competingyes
Challengeaido-LF-sim-testing
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105081 sim-1of4: 105101 sim-2of4: 105083 sim-3of4: 105063
Next
User labelmobile-segmentation-pedestrian
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
105101sim-1of4successyes0:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median25.472212570655977
survival_time_median59.99999999999873
deviation-center-line_median2.668128462541588
in-drivable-lane_median0.40000000000000024


other stats
deviation-center-line_max2.668128462541588
deviation-center-line_mean2.668128462541588
deviation-center-line_min2.668128462541588
deviation-heading_max10.57661288988884
deviation-heading_mean10.57661288988884
deviation-heading_median10.57661288988884
deviation-heading_min10.57661288988884
distance-from-start_max3.328908442570271
distance-from-start_mean3.328908442570271
distance-from-start_median3.328908442570271
distance-from-start_min3.328908442570271
driven_any_max26.26822839111565
driven_any_mean26.26822839111565
driven_any_median26.26822839111565
driven_any_min26.26822839111565
driven_lanedir_consec_max25.472212570655977
driven_lanedir_consec_mean25.472212570655977
driven_lanedir_consec_min25.472212570655977
driven_lanedir_max25.472212570655977
driven_lanedir_mean25.472212570655977
driven_lanedir_median25.472212570655977
driven_lanedir_min25.472212570655977
in-drivable-lane_max0.40000000000000024
in-drivable-lane_mean0.40000000000000024
in-drivable-lane_min0.40000000000000024
per-episodes
details{"zigzag-000-ego0": {"driven_any": 26.26822839111565, "survival_time": 59.99999999999873, "driven_lanedir": 25.472212570655977, "in-drivable-lane": 0.40000000000000024, "deviation-heading": 10.57661288988884, "distance-from-start": 3.328908442570271, "deviation-center-line": 2.668128462541588, "driven_lanedir_consec": 25.472212570655977}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105088sim-1of4successyes0:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105083sim-2of4successyes0:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median25.75227314705349
survival_time_median59.99999999999873
deviation-center-line_median2.6248027774405593
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.6248027774405593
deviation-center-line_mean2.6248027774405593
deviation-center-line_min2.6248027774405593
deviation-heading_max11.0447206559116
deviation-heading_mean11.0447206559116
deviation-heading_median11.0447206559116
deviation-heading_min11.0447206559116
distance-from-start_max4.026695721170917
distance-from-start_mean4.026695721170917
distance-from-start_median4.026695721170917
distance-from-start_min4.026695721170917
driven_any_max26.354395419841865
driven_any_mean26.354395419841865
driven_any_median26.354395419841865
driven_any_min26.354395419841865
driven_lanedir_consec_max25.75227314705349
driven_lanedir_consec_mean25.75227314705349
driven_lanedir_consec_min25.75227314705349
driven_lanedir_max25.75227314705349
driven_lanedir_mean25.75227314705349
driven_lanedir_median25.75227314705349
driven_lanedir_min25.75227314705349
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 26.354395419841865, "survival_time": 59.99999999999873, "driven_lanedir": 25.75227314705349, "in-drivable-lane": 0.0, "deviation-heading": 11.0447206559116, "distance-from-start": 4.026695721170917, "deviation-center-line": 2.6248027774405593, "driven_lanedir_consec": 25.75227314705349}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105081sim-0of4successyes0:06:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median25.6153103191453
survival_time_median59.99999999999873
deviation-center-line_median3.5326935677464997
in-drivable-lane_median0.8999999999999782


other stats
deviation-center-line_max3.5326935677464997
deviation-center-line_mean3.5326935677464997
deviation-center-line_min3.5326935677464997
deviation-heading_max10.654952232926489
deviation-heading_mean10.654952232926489
deviation-heading_median10.654952232926489
deviation-heading_min10.654952232926489
distance-from-start_max1.0665053307026593
distance-from-start_mean1.0665053307026593
distance-from-start_median1.0665053307026593
distance-from-start_min1.0665053307026593
driven_any_max26.5891972588576
driven_any_mean26.5891972588576
driven_any_median26.5891972588576
driven_any_min26.5891972588576
driven_lanedir_consec_max25.6153103191453
driven_lanedir_consec_mean25.6153103191453
driven_lanedir_consec_min25.6153103191453
driven_lanedir_max25.6153103191453
driven_lanedir_mean25.6153103191453
driven_lanedir_median25.6153103191453
driven_lanedir_min25.6153103191453
in-drivable-lane_max0.8999999999999782
in-drivable-lane_mean0.8999999999999782
in-drivable-lane_min0.8999999999999782
per-episodes
details{"loop2-000-ego0": {"driven_any": 26.5891972588576, "survival_time": 59.99999999999873, "driven_lanedir": 25.6153103191453, "in-drivable-lane": 0.8999999999999782, "deviation-heading": 10.654952232926489, "distance-from-start": 1.0665053307026593, "deviation-center-line": 3.5326935677464997, "driven_lanedir_consec": 25.6153103191453}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105068sim-1of4timeoutyes----No reset possible
105063sim-3of4successyes0:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median26.02143294649163
survival_time_median59.99999999999873
deviation-center-line_median2.4791315132620353
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.4791315132620353
deviation-center-line_mean2.4791315132620353
deviation-center-line_min2.4791315132620353
deviation-heading_max10.982862989275066
deviation-heading_mean10.982862989275066
deviation-heading_median10.982862989275066
deviation-heading_min10.982862989275066
distance-from-start_max2.565886403689877
distance-from-start_mean2.565886403689877
distance-from-start_median2.565886403689877
distance-from-start_min2.565886403689877
driven_any_max26.60397427974376
driven_any_mean26.60397427974376
driven_any_median26.60397427974376
driven_any_min26.60397427974376
driven_lanedir_consec_max26.02143294649163
driven_lanedir_consec_mean26.02143294649163
driven_lanedir_consec_min26.02143294649163
driven_lanedir_max26.02143294649163
driven_lanedir_mean26.02143294649163
driven_lanedir_median26.02143294649163
driven_lanedir_min26.02143294649163
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 26.60397427974376, "survival_time": 59.99999999999873, "driven_lanedir": 26.02143294649163, "in-drivable-lane": 0.0, "deviation-heading": 10.982862989275066, "distance-from-start": 2.565886403689877, "deviation-center-line": 2.4791315132620353, "driven_lanedir_consec": 26.02143294649163}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
62330348failedyes0:03:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62329348failedyes0:03:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible