Duckietown Challenges Home Challenges Submissions

Submission 13647

Submission13647
Competingyes
Challengeaido-LFP-sim-validation
UserJean-Sébastien Grondin 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104816 sim-1of4: 104820 sim-2of4: 104819 sim-3of4: 104817
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

104820

Click the images to see detailed statistics about the episode.

autolab-000

104819

Click the images to see detailed statistics about the episode.

loop-000

104817

Click the images to see detailed statistics about the episode.

zigzag-000

104816

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
104820sim-1of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7999999999999945
in-drivable-lane_median0.0
driven_lanedir_consec_median1.1810339894749924
deviation-center-line_median0.16937233366781504


other stats
deviation-center-line_max0.16937233366781504
deviation-center-line_mean0.16937233366781504
deviation-center-line_min0.16937233366781504
deviation-heading_max0.6960852797907721
deviation-heading_mean0.6960852797907721
deviation-heading_median0.6960852797907721
deviation-heading_min0.6960852797907721
distance-from-start_max1.0944952496322993
distance-from-start_mean1.0944952496322993
distance-from-start_median1.0944952496322993
distance-from-start_min1.0944952496322993
driven_any_max1.2183351759762964
driven_any_mean1.2183351759762964
driven_any_median1.2183351759762964
driven_any_min1.2183351759762964
driven_lanedir_consec_max1.1810339894749924
driven_lanedir_consec_mean1.1810339894749924
driven_lanedir_consec_min1.1810339894749924
driven_lanedir_max1.1810339894749924
driven_lanedir_mean1.1810339894749924
driven_lanedir_median1.1810339894749924
driven_lanedir_min1.1810339894749924
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.2183351759762964, "survival_time": 3.7999999999999945, "driven_lanedir": 1.1810339894749924, "in-drivable-lane": 0.0, "deviation-heading": 0.6960852797907721, "distance-from-start": 1.0944952496322993, "deviation-center-line": 0.16937233366781504, "driven_lanedir_consec": 1.1810339894749924}}
simulation-passed1
survival_time_max3.7999999999999945
survival_time_mean3.7999999999999945
survival_time_min3.7999999999999945
No reset possible
104819sim-2of4successyes0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.199999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2571541253401464
deviation-center-line_median0.2095134343214549


other stats
deviation-center-line_max0.2095134343214549
deviation-center-line_mean0.2095134343214549
deviation-center-line_min0.2095134343214549
deviation-heading_max1.195744178365586
deviation-heading_mean1.195744178365586
deviation-heading_median1.195744178365586
deviation-heading_min1.195744178365586
distance-from-start_max0.976478925912074
distance-from-start_mean0.976478925912074
distance-from-start_median0.976478925912074
distance-from-start_min0.976478925912074
driven_any_max1.3210165031593015
driven_any_mean1.3210165031593015
driven_any_median1.3210165031593015
driven_any_min1.3210165031593015
driven_lanedir_consec_max1.2571541253401464
driven_lanedir_consec_mean1.2571541253401464
driven_lanedir_consec_min1.2571541253401464
driven_lanedir_max1.2571541253401464
driven_lanedir_mean1.2571541253401464
driven_lanedir_median1.2571541253401464
driven_lanedir_min1.2571541253401464
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3210165031593015, "survival_time": 4.199999999999993, "driven_lanedir": 1.2571541253401464, "in-drivable-lane": 0.0, "deviation-heading": 1.195744178365586, "distance-from-start": 0.976478925912074, "deviation-center-line": 0.2095134343214549, "driven_lanedir_consec": 1.2571541253401464}}
simulation-passed1
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_min4.199999999999993
No reset possible
104817sim-3of4successyes0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.300000000000082
in-drivable-lane_median7.449999999999996
driven_lanedir_consec_median2.738516198608308
deviation-center-line_median0.5232438010438184


other stats
deviation-center-line_max0.5232438010438184
deviation-center-line_mean0.5232438010438184
deviation-center-line_min0.5232438010438184
deviation-heading_max2.379801866681779
deviation-heading_mean2.379801866681779
deviation-heading_median2.379801866681779
deviation-heading_min2.379801866681779
distance-from-start_max2.0892582355422413
distance-from-start_mean2.0892582355422413
distance-from-start_median2.0892582355422413
distance-from-start_min2.0892582355422413
driven_any_max6.164648639152087
driven_any_mean6.164648639152087
driven_any_median6.164648639152087
driven_any_min6.164648639152087
driven_lanedir_consec_max2.738516198608308
driven_lanedir_consec_mean2.738516198608308
driven_lanedir_consec_min2.738516198608308
driven_lanedir_max2.738516198608308
driven_lanedir_mean2.738516198608308
driven_lanedir_median2.738516198608308
driven_lanedir_min2.738516198608308
in-drivable-lane_max7.449999999999996
in-drivable-lane_mean7.449999999999996
in-drivable-lane_min7.449999999999996
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.164648639152087, "survival_time": 15.300000000000082, "driven_lanedir": 2.738516198608308, "in-drivable-lane": 7.449999999999996, "deviation-heading": 2.379801866681779, "distance-from-start": 2.0892582355422413, "deviation-center-line": 0.5232438010438184, "driven_lanedir_consec": 2.738516198608308}}
simulation-passed1
survival_time_max15.300000000000082
survival_time_mean15.300000000000082
survival_time_min15.300000000000082
No reset possible
104816sim-0of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.699999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median2.4081993926627634
deviation-center-line_median0.2994875853833524


other stats
deviation-center-line_max0.2994875853833524
deviation-center-line_mean0.2994875853833524
deviation-center-line_min0.2994875853833524
deviation-heading_max1.3441193112101562
deviation-heading_mean1.3441193112101562
deviation-heading_median1.3441193112101562
deviation-heading_min1.3441193112101562
distance-from-start_max0.983652056320438
distance-from-start_mean0.983652056320438
distance-from-start_median0.983652056320438
distance-from-start_min0.983652056320438
driven_any_max2.474721565424479
driven_any_mean2.474721565424479
driven_any_median2.474721565424479
driven_any_min2.474721565424479
driven_lanedir_consec_max2.4081993926627634
driven_lanedir_consec_mean2.4081993926627634
driven_lanedir_consec_min2.4081993926627634
driven_lanedir_max2.4081993926627634
driven_lanedir_mean2.4081993926627634
driven_lanedir_median2.4081993926627634
driven_lanedir_min2.4081993926627634
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.474721565424479, "survival_time": 6.699999999999984, "driven_lanedir": 2.4081993926627634, "in-drivable-lane": 0.0, "deviation-heading": 1.3441193112101562, "distance-from-start": 0.983652056320438, "deviation-center-line": 0.2994875853833524, "driven_lanedir_consec": 2.4081993926627634}}
simulation-passed1
survival_time_max6.699999999999984
survival_time_mean6.699999999999984
survival_time_min6.699999999999984
No reset possible
104815sim-2of4successyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104814sim-1of4successyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104813sim-0of4successyes0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104812sim-2of4successyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104811sim-3of4successyes0:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62321350successyes0:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62318350failedyes0:04:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible