Duckietown Challenges Home Challenges Submissions

Submission 28727

Submission28727
Competingyes
Challengelx22-visservoing
Useruser9970
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim: 199192
Next
User labellx22-visservoing
Admin priority50
Blessingn/a
User priority50

199192

Click the images to see detailed statistics about the episode.

LF-small-loop-000

LF-small-loop-001

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
199192simsuccessyes1:18:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median6.100000000000019
deviation-center-line_median0.4126375521062335
driven_lanedir_consec_median0.4945309768941392
survival_time_median12.000000000000036


other stats
deviation-center-line_max0.6101633755180376
deviation-center-line_mean0.4126375521062335
deviation-center-line_min0.21511172869442935
deviation-heading_max3.3449030412280387
deviation-heading_mean2.1833637770346934
deviation-heading_median2.1833637770346934
deviation-heading_min1.0218245128413486
distance-from-start_max1.3243007301997067
distance-from-start_mean1.080612160229065
distance-from-start_median1.080612160229065
distance-from-start_min0.8369235902584234
driven_any_max1.3794497888372108
driven_any_mean1.1278770087809962
driven_any_median1.1278770087809962
driven_any_min0.8763042287247818
driven_lanedir_consec_max0.618197124861923
driven_lanedir_consec_mean0.4945309768941392
driven_lanedir_consec_min0.3708648289263554
driven_lanedir_max0.618197124861923
driven_lanedir_mean0.4945309768941392
driven_lanedir_median0.4945309768941392
driven_lanedir_min0.3708648289263554
in-drivable-lane_max6.950000000000033
in-drivable-lane_mean6.100000000000019
in-drivable-lane_min5.250000000000006
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 0.8763042287247818, "survival_time": 9.45, "driven_lanedir": 0.3708648289263554, "in-drivable-lane": 5.250000000000006, "deviation-heading": 1.0218245128413486, "distance-from-start": 0.8369235902584234, "deviation-center-line": 0.21511172869442935, "driven_lanedir_consec": 0.3708648289263554}, "LF-small-loop-001-ego0": {"driven_any": 1.3794497888372108, "survival_time": 14.550000000000072, "driven_lanedir": 0.618197124861923, "in-drivable-lane": 6.950000000000033, "deviation-heading": 3.3449030412280387, "distance-from-start": 1.3243007301997067, "deviation-center-line": 0.6101633755180376, "driven_lanedir_consec": 0.618197124861923}}
simulation-passed1
survival_time_max14.550000000000072
survival_time_mean12.000000000000036
survival_time_min9.45
No reset possible
199191simfailedyes0:03:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 325, in read_reply
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout of 120 violated while waiting for None.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199190simfailedyes0:06:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 325, in read_reply
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout of 120 violated while waiting for None.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199185simhost-erroryes0:12:12
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-03-6.3.0-job199185-917106, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-03-6.3.0-job199185-917106', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible