Duckietown Challenges Home Challenges Submissions

Evaluator 4959

ID4959
evaluatornogpu-production-2-04
ownerI don't have one 😀
machinenogpu-production-2_659bcc8a8ce6
processnogpu-production-2-04_659bcc8a8ce6
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success4 60584
# timeout
# failed
# error2 60801
# aborted
# host-error6 60773
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6111613305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval1-visualizesuccessnonogpu-production-2-040:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.8288935715228986
survival_time6.044058561325073
deviation-center-line0.3735540951800487
in-drivable-lane0.0


other stats
deviation-heading1.0508295096100084
driven_any0.8418747801453247
driven_lanedir0.8288935715228986
visualized-eval1-passed1
No reset possible
6106512909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval0-visualizesuccessnonogpu-production-2-040:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.49801086567438024
survival_time27.034405946731567
deviation-center-line1.1183575436854314
in-drivable-lane16.956703186035156


other stats
deviation-heading10.131819537025788
driven_any1.2897950650940726
driven_lanedir0.49801086567438024
visualized-eval0-passed1
No reset possible
6104613304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval1-visualizehost-errornonogpu-production-2-040:01:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6094113289Bea Baselines 🐤baseline-duckietownaido5-LFP-real-validationeval0-visualizeerrornonogpu-production-2-040:00:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 174, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 301, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 350, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140288442615504
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6090113305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval1-videoshost-errornonogpu-production-2-040:01:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6087813304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval2-videoshost-errornonogpu-production-2-040:01:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6085813304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval0-videoshost-errornonogpu-production-2-040:01:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6080113304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval1-visualizeerrornonogpu-production-2-040:01:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 209, in evaluate_robotarium_log
    make_video_robot(dirname=dirname, robot_name=robot_name, t0=t0, t1=t1, outd=outd, out=out_robot)
  File "/project/evaluate_robotarium_log.py", line 378, in make_video_robot
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140112948600736
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6078613304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval0-visualizehost-errornonogpu-production-2-040:01:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6077313305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval2-visualizehost-errornonogpu-production-2-040:01:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6063013305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval1-videossuccessnonogpu-production-2-040:02:02
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6058413290Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-real-validationeval0-videossuccessnonogpu-production-2-040:02:50
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible