Duckietown Challenges Home Challenges Submissions

Submission 13617

Submission13617
Competingyes
Challengeaido-LFP-sim-validation
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104999 sim-1of4: 104991 sim-2of4: 104995 sim-3of4: 104997
Next
User labelmobile-segmentation-pedestrian
Admin priority50
Blessingn/a
User priority50

104999

Click the images to see detailed statistics about the episode.

loop2-000

104997

Click the images to see detailed statistics about the episode.

loop-000

104995

Click the images to see detailed statistics about the episode.

autolab-000

104991

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
104999sim-0of4successyes0:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.700000000000074
in-drivable-lane_median0.0
driven_lanedir_consec_median5.903909043342057
deviation-center-line_median0.6909118435483796


other stats
deviation-center-line_max0.6909118435483796
deviation-center-line_mean0.6909118435483796
deviation-center-line_min0.6909118435483796
deviation-heading_max2.6510381319279026
deviation-heading_mean2.6510381319279026
deviation-heading_median2.6510381319279026
deviation-heading_min2.6510381319279026
distance-from-start_max1.0521671459303483
distance-from-start_mean1.0521671459303483
distance-from-start_median1.0521671459303483
distance-from-start_min1.0521671459303483
driven_any_max6.046201580920749
driven_any_mean6.046201580920749
driven_any_median6.046201580920749
driven_any_min6.046201580920749
driven_lanedir_consec_max5.903909043342057
driven_lanedir_consec_mean5.903909043342057
driven_lanedir_consec_min5.903909043342057
driven_lanedir_max5.903909043342057
driven_lanedir_mean5.903909043342057
driven_lanedir_median5.903909043342057
driven_lanedir_min5.903909043342057
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.046201580920749, "survival_time": 14.700000000000074, "driven_lanedir": 5.903909043342057, "in-drivable-lane": 0.0, "deviation-heading": 2.6510381319279026, "distance-from-start": 1.0521671459303483, "deviation-center-line": 0.6909118435483796, "driven_lanedir_consec": 5.903909043342057}}
simulation-passed1
survival_time_max14.700000000000074
survival_time_mean14.700000000000074
survival_time_min14.700000000000074
No reset possible
104997sim-3of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.049999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2855247340893274
deviation-center-line_median0.2427381748008715


other stats
deviation-center-line_max0.2427381748008715
deviation-center-line_mean0.2427381748008715
deviation-center-line_min0.2427381748008715
deviation-heading_max0.953381240655559
deviation-heading_mean0.953381240655559
deviation-heading_median0.953381240655559
deviation-heading_min0.953381240655559
distance-from-start_max1.004979488083897
distance-from-start_mean1.004979488083897
distance-from-start_median1.004979488083897
distance-from-start_min1.004979488083897
driven_any_max1.3347829140546126
driven_any_mean1.3347829140546126
driven_any_median1.3347829140546126
driven_any_min1.3347829140546126
driven_lanedir_consec_max1.2855247340893274
driven_lanedir_consec_mean1.2855247340893274
driven_lanedir_consec_min1.2855247340893274
driven_lanedir_max1.2855247340893274
driven_lanedir_mean1.2855247340893274
driven_lanedir_median1.2855247340893274
driven_lanedir_min1.2855247340893274
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3347829140546126, "survival_time": 4.049999999999994, "driven_lanedir": 1.2855247340893274, "in-drivable-lane": 0.0, "deviation-heading": 0.953381240655559, "distance-from-start": 1.004979488083897, "deviation-center-line": 0.2427381748008715, "driven_lanedir_consec": 1.2855247340893274}}
simulation-passed1
survival_time_max4.049999999999994
survival_time_mean4.049999999999994
survival_time_min4.049999999999994
No reset possible
104995sim-2of4successyes0:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.40000000000004
in-drivable-lane_median1.000000000000005
driven_lanedir_consec_median4.424824019370146
deviation-center-line_median0.7625703352734509


other stats
deviation-center-line_max0.7625703352734509
deviation-center-line_mean0.7625703352734509
deviation-center-line_min0.7625703352734509
deviation-heading_max2.326548546063651
deviation-heading_mean2.326548546063651
deviation-heading_median2.326548546063651
deviation-heading_min2.326548546063651
distance-from-start_max3.4872098131973583
distance-from-start_mean3.4872098131973583
distance-from-start_median3.4872098131973583
distance-from-start_min3.4872098131973583
driven_any_max4.974555849460786
driven_any_mean4.974555849460786
driven_any_median4.974555849460786
driven_any_min4.974555849460786
driven_lanedir_consec_max4.424824019370146
driven_lanedir_consec_mean4.424824019370146
driven_lanedir_consec_min4.424824019370146
driven_lanedir_max4.424824019370146
driven_lanedir_mean4.424824019370146
driven_lanedir_median4.424824019370146
driven_lanedir_min4.424824019370146
in-drivable-lane_max1.000000000000005
in-drivable-lane_mean1.000000000000005
in-drivable-lane_min1.000000000000005
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.974555849460786, "survival_time": 12.40000000000004, "driven_lanedir": 4.424824019370146, "in-drivable-lane": 1.000000000000005, "deviation-heading": 2.326548546063651, "distance-from-start": 3.4872098131973583, "deviation-center-line": 0.7625703352734509, "driven_lanedir_consec": 4.424824019370146}}
simulation-passed1
survival_time_max12.40000000000004
survival_time_mean12.40000000000004
survival_time_min12.40000000000004
No reset possible
104991sim-1of4successyes0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.95000000000002
in-drivable-lane_median0.0
driven_lanedir_consec_median4.1563656380277445
deviation-center-line_median0.5864528157161716


other stats
deviation-center-line_max0.5864528157161716
deviation-center-line_mean0.5864528157161716
deviation-center-line_min0.5864528157161716
deviation-heading_max2.049303735928189
deviation-heading_mean2.049303735928189
deviation-heading_median2.049303735928189
deviation-heading_min2.049303735928189
distance-from-start_max3.375347768476297
distance-from-start_mean3.375347768476297
distance-from-start_median3.375347768476297
distance-from-start_min3.375347768476297
driven_any_max4.244858864617868
driven_any_mean4.244858864617868
driven_any_median4.244858864617868
driven_any_min4.244858864617868
driven_lanedir_consec_max4.1563656380277445
driven_lanedir_consec_mean4.1563656380277445
driven_lanedir_consec_min4.1563656380277445
driven_lanedir_max4.1563656380277445
driven_lanedir_mean4.1563656380277445
driven_lanedir_median4.1563656380277445
driven_lanedir_min4.1563656380277445
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.244858864617868, "survival_time": 10.95000000000002, "driven_lanedir": 4.1563656380277445, "in-drivable-lane": 0.0, "deviation-heading": 2.049303735928189, "distance-from-start": 3.375347768476297, "deviation-center-line": 0.5864528157161716, "driven_lanedir_consec": 4.1563656380277445}}
simulation-passed1
survival_time_max10.95000000000002
survival_time_mean10.95000000000002
survival_time_min10.95000000000002
No reset possible
104989sim-0of4successyes0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104987sim-3of4successyes0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104986sim-2of4successyes0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104984sim-0of4successyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104981sim-2of4successyes0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104979sim-3of4successyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104978sim-0of4successyes0:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62319350failedyes0:04:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible