Duckietown Challenges Home Challenges Submissions

Submission 18349

Submission18349
Competingyes
Challengeaido-LFVI_multi-sim-validation
UserBence Haromi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 120783 sim-1of4: 120784 sim-2of4: 120786 sim-3of4: 120787
Next
User label005-0.8
Admin priority50
Blessingn/a
User priority50

120784

Click the images to see detailed statistics about the episode.

4way-000

120783

Click the images to see detailed statistics about the episode.

4way-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
120787sim-3of4successyes0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
120786sim-2of4successyes0:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
120785sim-2of4successyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
120784sim-1of4successyes0:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.100000000000193
in-drivable-lane_median0.5250000000000004
driven_lanedir_consec_median5.353530914808135
deviation-center-line_median1.033718383285312


other stats
deviation-center-line_max3.247966144482447
deviation-center-line_mean1.4309025005473792
deviation-center-line_min0.4082070911364459
deviation-heading_max5.204021483815746
deviation-heading_mean3.8576767724237713
deviation-heading_median4.67423687404456
deviation-heading_min0.8782118577902184
distance-from-start_max2.504451227328294
distance-from-start_mean1.962861183606165
distance-from-start_median2.1721694057597594
distance-from-start_min1.0026546955768454
driven_any_max8.7725209352265
driven_any_mean5.323606705099594
driven_any_median5.755644611641569
driven_any_min1.010616661888735
driven_lanedir_consec_max7.766637752251876
driven_lanedir_consec_mean4.79134764444463
driven_lanedir_consec_min0.6916909959103751
driven_lanedir_max7.766705263706932
driven_lanedir_mean4.868139976701348
driven_lanedir_median5.353646279135537
driven_lanedir_min0.9985620848273852
in-drivable-lane_max1.9499999999999984
in-drivable-lane_mean0.7499999999999998
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.573152909220451, "survival_time": 23.100000000000193, "driven_lanedir": 3.064391301972075, "in-drivable-lane": 1.0500000000000007, "deviation-heading": 4.659216547426145, "distance-from-start": 2.210207364647818, "deviation-center-line": 0.4082070911364459, "driven_lanedir_consec": 3.064220430196427}, "4way-000-ego1": {"driven_any": 8.7725209352265, "survival_time": 23.100000000000193, "driven_lanedir": 7.642901256298999, "in-drivable-lane": 1.9499999999999984, "deviation-heading": 5.204021483815746, "distance-from-start": 2.1341314468717, "deviation-center-line": 1.0999787347918346, "driven_lanedir_consec": 7.642841399419843}, "4way-000-ego2": {"driven_any": 7.938136314062686, "survival_time": 23.100000000000193, "driven_lanedir": 7.766705263706932, "in-drivable-lane": 0.0, "deviation-heading": 4.689257200662975, "distance-from-start": 2.504451227328294, "deviation-center-line": 0.9674580317787894, "driven_lanedir_consec": 7.766637752251876}, "4way-000-ego3": {"driven_any": 1.010616661888735, "survival_time": 23.100000000000193, "driven_lanedir": 0.9985620848273852, "in-drivable-lane": 0.0, "deviation-heading": 0.8782118577902184, "distance-from-start": 1.0026546955768454, "deviation-center-line": 3.247966144482447, "driven_lanedir_consec": 0.6916909959103751}}
simulation-passed1
survival_time_max23.100000000000193
survival_time_mean23.100000000000193
survival_time_min23.100000000000193
No reset possible
120783sim-0of4successyes0:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.65000000000016
in-drivable-lane_median0.5500000000000003
driven_lanedir_consec_median1.8717630192967445
deviation-center-line_median0.7709464106983657


other stats
deviation-center-line_max2.761555108367721
deviation-center-line_mean1.0917340293762745
deviation-center-line_min0.06348818774064538
deviation-heading_max4.808099097322867
deviation-heading_mean2.3246551311813892
deviation-heading_median2.045763640039125
deviation-heading_min0.3989941473244401
distance-from-start_max2.516755398135932
distance-from-start_mean1.6132013901540392
distance-from-start_median1.6080503595015505
distance-from-start_min0.7199494434771244
driven_any_max8.034706240633513
driven_any_mean3.3507259850982836
driven_any_median2.2988847651164797
driven_any_min0.7704281695266618
driven_lanedir_consec_max7.854675636164803
driven_lanedir_consec_mean2.940732760341592
driven_lanedir_consec_min0.1647293666080767
driven_lanedir_max7.85481368995902
driven_lanedir_mean3.0172083956383204
driven_lanedir_median2.024645262993093
driven_lanedir_min0.1647293666080767
in-drivable-lane_max19.90000000000016
in-drivable-lane_mean5.25000000000004
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.585747184080134, "survival_time": 20.65000000000016, "driven_lanedir": 3.0492454726191625, "in-drivable-lane": 1.1000000000000003, "deviation-heading": 4.808099097322867, "distance-from-start": 2.212376371478351, "deviation-center-line": 0.5524392240209199, "driven_lanedir_consec": 3.0491699545285336}, "4way-000-ego1": {"driven_any": 0.7704281695266618, "survival_time": 20.65000000000016, "driven_lanedir": 0.1647293666080767, "in-drivable-lane": 19.90000000000016, "deviation-heading": 0.3989941473244401, "distance-from-start": 0.7199494434771244, "deviation-center-line": 0.06348818774064538, "driven_lanedir_consec": 0.1647293666080767}, "4way-000-ego2": {"driven_any": 8.034706240633513, "survival_time": 20.65000000000016, "driven_lanedir": 7.85481368995902, "in-drivable-lane": 0.0, "deviation-heading": 3.653573151142497, "distance-from-start": 2.516755398135932, "deviation-center-line": 0.9894535973758114, "driven_lanedir_consec": 7.854675636164803}, "4way-000-ego3": {"driven_any": 1.0120223461528255, "survival_time": 20.65000000000016, "driven_lanedir": 1.0000450533670235, "in-drivable-lane": 0.0, "deviation-heading": 0.4379541289357527, "distance-from-start": 1.0037243475247493, "deviation-center-line": 2.761555108367721, "driven_lanedir_consec": 0.6943560840649547}}
simulation-passed1
survival_time_max20.65000000000016
survival_time_mean20.65000000000016
survival_time_min20.65000000000016
No reset possible
120782sim-0of4failedyes0:04:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible