Duckietown Challenges Home Challenges Submissions

Evaluator 5249

ID5249
evaluatornogpu-production-b-spot-0-07
ownerI don't have one 😀
machinenogpu-production-b-spot-0_4247e90835f9
processnogpu-production-b-spot-0-07_4247e90835f9
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success68 77144
# timeout
# failed6 77343
# error11 77852
# aborted12 77328
# host-error6 77348
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)184.7 GB
RAM free (MB)151.0 GB
Disk (MB)969.3 GB
Disk available (MB)292.1 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7802614018Shengjie Hu 🇨🇭baseline-duckietownaido-LF-real-validationeval1-visualizesuccessnonogpu-production-b-spot-0-070:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec10.872712586216725
survival_time59.000086307525635
deviation-center-line2.725336317629284
in-drivable-lane0.0


other stats
deviation-heading8.736812976791402
distance-from-start2.1505360878663624
driven_any11.102967623543895
driven_lanedir10.872712586216725
visualized-eval1-passed1
No reset possible
7802514018Shengjie Hu 🇨🇭baseline-duckietownaido-LF-real-validationeval1-visualizesuccessnonogpu-production-b-spot-0-070:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec10.872712586216725
survival_time59.000086307525635
deviation-center-line2.725336317629284
in-drivable-lane0.0


other stats
deviation-heading8.736812976791402
distance-from-start2.1505360878663624
driven_any11.102967623543895
driven_lanedir10.872712586216725
visualized-eval1-passed1
No reset possible
7802314018Shengjie Hu 🇨🇭baseline-duckietownaido-LF-real-validationeval1-visualizesuccessnonogpu-production-b-spot-0-070:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec10.872712586216725
survival_time59.000086307525635
deviation-center-line2.725336317629284
in-drivable-lane0.0


other stats
deviation-heading8.736812976791402
distance-from-start2.1505360878663624
driven_any11.102967623543895
driven_lanedir10.872712586216725
visualized-eval1-passed1
No reset possible
7802114794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec11.680644557070762
survival_time58.99994516372681
deviation-center-line4.483630028716501
in-drivable-lane0.0


other stats
deviation-heading6.418361807776
distance-from-start2.358330722567591
driven_any11.84481549755438
driven_lanedir11.680644557070762
visualized-eval0-passed1
No reset possible
7801814794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec11.680644557070762
survival_time58.99994516372681
deviation-center-line4.483630028716501
in-drivable-lane0.0


other stats
deviation-heading6.418361807776
distance-from-start2.358330722567591
driven_any11.84481549755438
driven_lanedir11.680644557070762
visualized-eval0-passed1
No reset possible
7801714018Shengjie Hu 🇨🇭baseline-duckietownaido-LF-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.883509570626593
survival_time7.000141859054565
deviation-center-line0.33626901306175794
in-drivable-lane1.8999783992767336


other stats
deviation-heading1.5355709652098135
distance-from-start1.2488814763311362
driven_any1.3519530803825228
driven_lanedir0.883509570626593
visualized-eval0-passed1
No reset possible
7801514018Shengjie Hu 🇨🇭baseline-duckietownaido-LF-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.883509570626593
survival_time7.000141859054565
deviation-center-line0.33626901306175794
in-drivable-lane1.8999783992767336


other stats
deviation-heading1.5355709652098135
distance-from-start1.2488814763311362
driven_any1.3519530803825228
driven_lanedir0.883509570626593
visualized-eval0-passed1
No reset possible
7801214018Shengjie Hu 🇨🇭baseline-duckietownaido-LF-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.883509570626593
survival_time7.000141859054565
deviation-center-line0.33626901306175794
in-drivable-lane1.8999783992767336


other stats
deviation-heading1.5355709652098135
distance-from-start1.2488814763311362
driven_any1.3519530803825228
driven_lanedir0.883509570626593
visualized-eval0-passed1
No reset possible
7801015749Shengjie Hu 🇨🇭baseline-duckietownaido-LFru-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.41586437805394727
survival_time58.49801731109619
deviation-center-line1.2427682284698134
in-drivable-lane42.00748896598816


other stats
deviation-heading19.65393914181173
distance-from-start1.7155597739481412
driven_any4.668375376286597
driven_lanedir0.46583887457419904
visualized-eval0-passed1
No reset possible
7800915749Shengjie Hu 🇨🇭baseline-duckietownaido-LFru-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.41586437805394727
survival_time58.49801731109619
deviation-center-line1.2427682284698134
in-drivable-lane42.00748896598816


other stats
deviation-heading19.65393914181173
distance-from-start1.7155597739481412
driven_any4.668375376286597
driven_lanedir0.46583887457419904
visualized-eval0-passed1
No reset possible
7799214794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval2-videosabortednonogpu-production-b-spot-0-070:04:48
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7799115748Andrea Daniele 🇮🇹baseline-duckietownaido-LF-real-validationeval2-visualizeabortednonogpu-production-b-spot-0-070:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec3.689836410615352
survival_time58.90035891532898
deviation-center-line3.3147376557384596
in-drivable-lane12.495794534683228


other stats
deviation-heading9.644451275662444
distance-from-start1.914850753509628
driven_any7.835857185849559
driven_lanedir6.2497497321730675
visualized-eval2-passed1
No reset possible
7798614794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval2-visualizehost-errornonogpu-production-b-spot-0-070:01:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7798314794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval2-visualizehost-errornonogpu-production-b-spot-0-070:01:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7798014794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval2-visualizehost-errornonogpu-production-b-spot-0-070:01:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7797314018Shengjie Hu 🇨🇭baseline-duckietownaido-LF-real-validationeval1-videosabortednonogpu-production-b-spot-0-070:03:04
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7796714018Shengjie Hu 🇨🇭baseline-duckietownaido-LF-real-validationeval1-videosabortednonogpu-production-b-spot-0-070:03:18
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7796315748Andrea Daniele 🇮🇹baseline-duckietownaido-LF-real-validationeval1-videosabortednonogpu-production-b-spot-0-070:04:12
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7794615748Andrea Daniele 🇮🇹baseline-duckietownaido-LF-real-validationeval0-visualizeabortednonogpu-production-b-spot-0-070:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.9947456956788432
survival_time12.102936506271362
deviation-center-line0.5878463460225878
in-drivable-lane5.103032827377319


other stats
deviation-heading1.021595535704961
distance-from-start1.4312849585898155
driven_any1.497849442174627
driven_lanedir0.9947456956788432
visualized-eval0-passed1
No reset possible
7794315748Andrea Daniele 🇮🇹baseline-duckietownaido-LF-real-validationeval0-visualizeabortednonogpu-production-b-spot-0-070:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.9947456956788432
survival_time12.102936506271362
deviation-center-line0.5878463460225878
in-drivable-lane5.103032827377319


other stats
deviation-heading1.021595535704961
distance-from-start1.4312849585898155
driven_any1.497849442174627
driven_lanedir0.9947456956788432
visualized-eval0-passed1
No reset possible
7794115748Andrea Daniele 🇮🇹baseline-duckietownaido-LF-real-validationeval0-visualizeabortednonogpu-production-b-spot-0-070:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.9947456956788432
survival_time12.102936506271362
deviation-center-line0.5878463460225878
in-drivable-lane5.103032827377319


other stats
deviation-heading1.021595535704961
distance-from-start1.4312849585898155
driven_any1.497849442174627
driven_lanedir0.9947456956788432
visualized-eval0-passed1
No reset possible
7793814796Bea Baselines 🐤baseline-duckietownaido-LFV_multi-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.2072884522357168
survival_time3.833363135655721
deviation-center-line0.07011317124289072
in-drivable-lane0.5000051657358805


other stats
deviation-heading0.49687165478750384
distance-from-start0.2390041060018312
driven_any0.2605800723844943
driven_lanedir0.2072884522357168
visualized-eval0-passed1
No reset possible
7793714796Bea Baselines 🐤baseline-duckietownaido-LFV_multi-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.2072884522357168
survival_time3.833363135655721
deviation-center-line0.07011317124289072
in-drivable-lane0.5000051657358805


other stats
deviation-heading0.49687165478750384
distance-from-start0.2390041060018312
driven_any0.2605800723844943
driven_lanedir0.2072884522357168
visualized-eval0-passed1
No reset possible
7793314796Bea Baselines 🐤baseline-duckietownaido-LFV_multi-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.2072884522357168
survival_time3.833363135655721
deviation-center-line0.07011317124289072
in-drivable-lane0.5000051657358805


other stats
deviation-heading0.49687165478750384
distance-from-start0.2390041060018312
driven_any0.2605800723844943
driven_lanedir0.2072884522357168
visualized-eval0-passed1
No reset possible
7793014796Bea Baselines 🐤baseline-duckietownaido-LFV_multi-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.2072884522357168
survival_time3.833363135655721
deviation-center-line0.07011317124289072
in-drivable-lane0.5000051657358805


other stats
deviation-heading0.49687165478750384
distance-from-start0.2390041060018312
driven_any0.2605800723844943
driven_lanedir0.2072884522357168
visualized-eval0-passed1
No reset possible
7792214794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval1-videosabortednonogpu-production-b-spot-0-070:06:03
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7791814795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-070:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.8815817974125577
survival_time20.399778366088867
deviation-center-line0.6184571124714398
in-drivable-lane7.399988651275635


other stats
deviation-heading1.1485227849077762
distance-from-start2.4266143223248395
driven_any2.8763012909981693
driven_lanedir1.8815817974125577
visualized-eval0-passed1
No reset possible
7791514795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval1-visualizeerrornonogpu-production-b-spot-0-070:00:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 239, in evaluate_robotarium_log
    make_video_robot(dirname=dirname, robot_name=robot_name, t0=t0, t1=t1, outd=outd, out=out_robot)
  File "/project/evaluate_robotarium_log.py", line 421, in make_video_robot
    for t in data['topics']:
KeyError: 'topics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7791214795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval1-visualizeerrornonogpu-production-b-spot-0-070:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 239, in evaluate_robotarium_log
    make_video_robot(dirname=dirname, robot_name=robot_name, t0=t0, t1=t1, outd=outd, out=out_robot)
  File "/project/evaluate_robotarium_log.py", line 421, in make_video_robot
    for t in data['topics']:
KeyError: 'topics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7790614796Bea Baselines 🐤baseline-duckietownaido-LFV_multi-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:00:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7fcb8708a3d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fcb8708a3d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[3]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\xfc\xd1u\xe6\xec,\xa7\xbc\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ ego1:
│              │ │ dict[5]
│              │ │ │ color: green
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego1
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\xf0?\x1a\x92', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ ego2:
│              │ │ dict[5]
│              │ │ │ color: blue
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego2
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\xfc\xd1u\xe6\xec,\xa7\xbc\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0, ego1, ego2]
│              │ scenario_name: LFV_multi-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7790214796Bea Baselines 🐤baseline-duckietownaido-LFV_multi-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:00:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7f8c324d93d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f8c324d93d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[3]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\xfc\xd1u\xe6\xec,\xa7\xbc\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ ego1:
│              │ │ dict[5]
│              │ │ │ color: green
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego1
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\xf0?\x1a\x92', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ ego2:
│              │ │ dict[5]
│              │ │ │ color: blue
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego2
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\xfc\xd1u\xe6\xec,\xa7\xbc\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0, ego1, ego2]
│              │ scenario_name: LFV_multi-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7790114796Bea Baselines 🐤baseline-duckietownaido-LFV_multi-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:00:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7f9971ff93d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f9971ff93d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[3]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\xfc\xd1u\xe6\xec,\xa7\xbc\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ ego1:
│              │ │ dict[5]
│              │ │ │ color: green
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego1
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\xf0?\x1a\x92', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ ego2:
│              │ │ dict[5]
│              │ │ │ color: blue
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego2
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\xfc\xd1u\xe6\xec,\xa7\xbc\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0, ego1, ego2]
│              │ scenario_name: LFV_multi-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7789114795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval2-videossuccessnonogpu-production-b-spot-0-070:06:35
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7786614795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval0-videossuccessnonogpu-production-b-spot-0-070:03:13
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7786014794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval1-videossuccessnonogpu-production-b-spot-0-070:05:28
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7785814794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:00:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7f4548a0a3d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f4548a0a3d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[1]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x07\\\x143&\xa6\x91<\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0]
│              │ scenario_name: LF-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7785714794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:00:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7f36c53c53d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f36c53c53d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[1]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x07\\\x143&\xa6\x91<\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0]
│              │ scenario_name: LF-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7785614794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:00:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7fd9c0d713d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fd9c0d713d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[1]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x07\\\x143&\xa6\x91<\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0]
│              │ scenario_name: LF-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7785514794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:00:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7f00ad88d3d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f00ad88d3d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[1]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x07\\\x143&\xa6\x91<\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0]
│              │ scenario_name: LF-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7785414794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:00:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7f98ab5003d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f98ab5003d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[1]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x07\\\x143&\xa6\x91<\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0]
│              │ scenario_name: LF-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7785214794Bea Baselines 🐤baseline-duckietownaido-LF-real-validationeval0-visualizeerrornonogpu-production-b-spot-0-070:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7f822d7883d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f822d7883d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[1]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\x07\\\x143&\xa6\x91<\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies: {}
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0]
│              │ scenario_name: LF-real-validation-000

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7784514795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval2-videossuccessnonogpu-production-b-spot-0-070:06:00
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7783614795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval1-videossuccessnonogpu-production-b-spot-0-070:04:18
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7782614795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval0-videossuccessnonogpu-production-b-spot-0-070:01:54
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7782114795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval0-videossuccessnonogpu-production-b-spot-0-070:02:57
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7780615742Martin Cote 🇨🇦template-rosmooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:13:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median6.774999999999902
deviation-center-line_median2.646568651107817
driven_lanedir_consec_median2.686664944078892
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.014532121988657016
agent_compute-ego0_mean0.014333649340716133
agent_compute-ego0_median0.014333649340716133
agent_compute-ego0_min0.014135176692775246
complete-iteration_max0.1244286494290799
complete-iteration_mean0.12386273345184962
complete-iteration_median0.12386273345184962
complete-iteration_min0.12329681747461932
deviation-center-line_max2.6728334418976964
deviation-center-line_mean2.646568651107817
deviation-center-line_min2.6203038603179376
deviation-heading_max32.26904410068087
deviation-heading_mean32.22752464231664
deviation-heading_median32.22752464231664
deviation-heading_min32.1860051839524
distance-from-start_max1.0281235272270015
distance-from-start_mean0.7679393750532588
distance-from-start_median0.7679393750532588
distance-from-start_min0.5077552228795159
driven_any_max6.2465519322610605
driven_any_mean6.243944797179916
driven_any_median6.243944797179916
driven_any_min6.241337662098771
driven_lanedir_consec_max2.7099487635945474
driven_lanedir_consec_mean2.686664944078892
driven_lanedir_consec_min2.663381124563237
driven_lanedir_max4.356989710271918
driven_lanedir_mean4.247550751267669
driven_lanedir_median4.247550751267669
driven_lanedir_min4.13811179226342
get_duckie_state_max1.1140758250774094e-06
get_duckie_state_mean1.1137780499994308e-06
get_duckie_state_median1.1137780499994308e-06
get_duckie_state_min1.1134802749214522e-06
get_robot_state_max0.003182483255416527
get_robot_state_mean0.0031339011521859528
get_robot_state_median0.0031339011521859528
get_robot_state_min0.003085319048955379
get_state_dump_max0.003972127773084807
get_state_dump_mean0.003970118188341889
get_state_dump_median0.003970118188341889
get_state_dump_min0.00396810860359897
get_ui_image_max0.039165468636797825
get_ui_image_mean0.03774810383262285
get_ui_image_median0.03774810383262285
get_ui_image_min0.03633073902844787
in-drivable-lane_max7.4499999999999105
in-drivable-lane_mean6.774999999999902
in-drivable-lane_min6.099999999999893
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.2465519322610605, "get_ui_image": 0.039165468636797825, "step_physics": 0.0542327067337862, "survival_time": 59.99999999999873, "driven_lanedir": 4.356989710271918, "get_state_dump": 0.00396810860359897, "get_robot_state": 0.003085319048955379, "sim_render-ego0": 0.0031374999625200435, "get_duckie_state": 1.1140758250774094e-06, "in-drivable-lane": 6.099999999999893, "deviation-heading": 32.1860051839524, "agent_compute-ego0": 0.014135176692775246, "complete-iteration": 0.1244286494290799, "set_robot_commands": 0.0020790229133523376, "distance-from-start": 0.5077552228795159, "deviation-center-line": 2.6728334418976964, "driven_lanedir_consec": 2.663381124563237, "sim_compute_sim_state": 0.002999411534508698, "sim_compute_performance-ego0": 0.0015521109054527314}, "LF-small-loop-001-ego0": {"driven_any": 6.241337662098771, "get_ui_image": 0.03633073902844787, "step_physics": 0.05437579639349055, "survival_time": 59.99999999999873, "driven_lanedir": 4.13811179226342, "get_state_dump": 0.003972127773084807, "get_robot_state": 0.003182483255416527, "sim_render-ego0": 0.003208108587527057, "get_duckie_state": 1.1134802749214522e-06, "in-drivable-lane": 7.4499999999999105, "deviation-heading": 32.26904410068087, "agent_compute-ego0": 0.014532121988657016, "complete-iteration": 0.12329681747461932, "set_robot_commands": 0.002249064790914696, "distance-from-start": 1.0281235272270015, "deviation-center-line": 2.6203038603179376, "driven_lanedir_consec": 2.7099487635945474, "sim_compute_sim_state": 0.003750081264803947, "sim_compute_performance-ego0": 0.0016188542114308634}}
set_robot_commands_max0.002249064790914696
set_robot_commands_mean0.002164043852133517
set_robot_commands_median0.002164043852133517
set_robot_commands_min0.0020790229133523376
sim_compute_performance-ego0_max0.0016188542114308634
sim_compute_performance-ego0_mean0.0015854825584417974
sim_compute_performance-ego0_median0.0015854825584417974
sim_compute_performance-ego0_min0.0015521109054527314
sim_compute_sim_state_max0.003750081264803947
sim_compute_sim_state_mean0.003374746399656323
sim_compute_sim_state_median0.003374746399656323
sim_compute_sim_state_min0.002999411534508698
sim_render-ego0_max0.003208108587527057
sim_render-ego0_mean0.0031728042750235504
sim_render-ego0_median0.0031728042750235504
sim_render-ego0_min0.0031374999625200435
simulation-passed1
step_physics_max0.05437579639349055
step_physics_mean0.05430425156363837
step_physics_median0.05430425156363837
step_physics_min0.0542327067337862
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7779515737Liam Paull 🇨🇦objdet exercisemooc-objdetsimsuccessnonogpu-production-b-spot-0-070:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.250000000000124
driven_lanedir_consec_median4.81066756257857


other stats
agent_compute-ego0_max0.01684563201770448
agent_compute-ego0_mean0.01631504171524032
agent_compute-ego0_median0.01631504171524032
agent_compute-ego0_min0.01578445141277616
complete-iteration_max0.2045874470158627
complete-iteration_mean0.19801875818194004
complete-iteration_median0.19801875818194004
complete-iteration_min0.19145006934801737
deviation-center-line_max0.26774333024025004
deviation-center-line_mean0.21555488127470093
deviation-center-line_median0.21555488127470093
deviation-center-line_min0.16336643230915182
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.739343004227582
distance-from-start_mean4.810621862412031
distance-from-start_median4.810621862412031
distance-from-start_min2.8819007205964793
driven_any_max6.739343004227582
driven_any_mean4.810621862412031
driven_any_median4.810621862412031
driven_any_min2.8819007205964793
driven_lanedir_consec_max6.739416256114824
driven_lanedir_consec_mean4.81066756257857
driven_lanedir_consec_min2.8819188690423156
driven_lanedir_max6.739416256114824
driven_lanedir_mean4.81066756257857
driven_lanedir_median4.81066756257857
driven_lanedir_min2.8819188690423156
get_duckie_state_max0.020982079338609128
get_duckie_state_mean0.019043712276862676
get_duckie_state_median0.019043712276862676
get_duckie_state_min0.017105345215116228
get_robot_state_max0.003440974051492256
get_robot_state_mean0.0032483633971752083
get_robot_state_median0.0032483633971752083
get_robot_state_min0.00305575274285816
get_state_dump_max0.007059238458934583
get_state_dump_mean0.006836761657456706
get_state_dump_median0.006836761657456706
get_state_dump_min0.006614284855978829
get_ui_image_max0.0523533442663768
get_ui_image_mean0.05217480022108545
get_ui_image_median0.05217480022108545
get_ui_image_min0.0519962561757941
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.739343004227582, "get_ui_image": 0.0523533442663768, "step_physics": 0.06759835330266802, "survival_time": 25.150000000000222, "driven_lanedir": 6.739416256114824, "get_state_dump": 0.006614284855978829, "get_robot_state": 0.00305575274285816, "sim_render-ego0": 0.0031407607926262748, "get_duckie_state": 0.017105345215116228, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.01578445141277616, "complete-iteration": 0.19145006934801737, "set_robot_commands": 0.001757220143363589, "distance-from-start": 6.739343004227582, "deviation-center-line": 0.16336643230915182, "driven_lanedir_consec": 6.739416256114824, "sim_compute_sim_state": 0.022369852614781215, "sim_compute_performance-ego0": 0.0015930400954352485}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.8819007205964793, "get_ui_image": 0.0519962561757941, "step_physics": 0.06980205837048982, "survival_time": 11.350000000000026, "driven_lanedir": 2.8819188690423156, "get_state_dump": 0.007059238458934583, "get_robot_state": 0.003440974051492256, "sim_render-ego0": 0.0036306402139496385, "get_duckie_state": 0.020982079338609128, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.01684563201770448, "complete-iteration": 0.2045874470158627, "set_robot_commands": 0.002040186472106398, "distance-from-start": 2.8819007205964793, "deviation-center-line": 0.26774333024025004, "driven_lanedir_consec": 2.8819188690423156, "sim_compute_sim_state": 0.02661698952055814, "sim_compute_performance-ego0": 0.0020622830641897102}}
set_robot_commands_max0.002040186472106398
set_robot_commands_mean0.0018987033077349936
set_robot_commands_median0.0018987033077349936
set_robot_commands_min0.001757220143363589
sim_compute_performance-ego0_max0.0020622830641897102
sim_compute_performance-ego0_mean0.0018276615798124792
sim_compute_performance-ego0_median0.0018276615798124792
sim_compute_performance-ego0_min0.0015930400954352485
sim_compute_sim_state_max0.02661698952055814
sim_compute_sim_state_mean0.024493421067669677
sim_compute_sim_state_median0.024493421067669677
sim_compute_sim_state_min0.022369852614781215
sim_render-ego0_max0.0036306402139496385
sim_render-ego0_mean0.0033857005032879566
sim_render-ego0_median0.0033857005032879566
sim_render-ego0_min0.0031407607926262748
simulation-passed1
step_physics_max0.06980205837048982
step_physics_mean0.06870020583657892
step_physics_median0.06870020583657892
step_physics_min0.06759835330266802
survival_time_max25.150000000000222
survival_time_mean18.250000000000124
survival_time_min11.350000000000026
No reset possible
7779115735Kristoffer Nilssontemplate-rosmooc-visservoingsimfailednonogpu-production-b-spot-0-070:02:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7778715733Kristoffer Nilssontemplate-rosmooc-visservoingsimfailednonogpu-production-b-spot-0-070:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7777415726Haridas P Texercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-070:09:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.5352895342123105


other stats
agent_compute-ego0_max0.010428851381465714
agent_compute-ego0_mean0.010428851381465714
agent_compute-ego0_median0.010428851381465714
agent_compute-ego0_min0.010428851381465714
complete-iteration_max0.2497711224621705
complete-iteration_mean0.2497711224621705
complete-iteration_median0.2497711224621705
complete-iteration_min0.2497711224621705
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.5352895342123105
distance-from-start_median4.5352895342123105
distance-from-start_min4.5352895342123105
driven_any_max4.842802305090722
driven_any_mean4.842802305090722
driven_any_median4.842802305090722
driven_any_min4.842802305090722
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0918242916196174
get_duckie_state_mean0.0918242916196174
get_duckie_state_median0.0918242916196174
get_duckie_state_min0.0918242916196174
get_robot_state_max0.003454887727917442
get_robot_state_mean0.003454887727917442
get_robot_state_median0.003454887727917442
get_robot_state_min0.003454887727917442
get_state_dump_max0.018301706930991823
get_state_dump_mean0.018301706930991823
get_state_dump_median0.018301706930991823
get_state_dump_min0.018301706930991823
get_ui_image_max0.0384090667311991
get_ui_image_mean0.0384090667311991
get_ui_image_median0.0384090667311991
get_ui_image_min0.0384090667311991
in-drivable-lane_max47.09999999999946
in-drivable-lane_mean47.09999999999946
in-drivable-lane_median47.09999999999946
in-drivable-lane_min47.09999999999946
per-episodes
details{"d50-ego0": {"driven_any": 4.842802305090722, "get_ui_image": 0.0384090667311991, "step_physics": 0.07049211489939361, "survival_time": 47.09999999999946, "driven_lanedir": 0.0, "get_state_dump": 0.018301706930991823, "get_robot_state": 0.003454887727917442, "sim_render-ego0": 0.003389011637909162, "get_duckie_state": 0.0918242916196174, "in-drivable-lane": 47.09999999999946, "deviation-heading": 0.0, "agent_compute-ego0": 0.010428851381465714, "complete-iteration": 0.2497711224621705, "set_robot_commands": 0.00195034816940162, "distance-from-start": 4.5352895342123105, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00968405044976373, "sim_compute_performance-ego0": 0.0017490245378156482}}
set_robot_commands_max0.00195034816940162
set_robot_commands_mean0.00195034816940162
set_robot_commands_median0.00195034816940162
set_robot_commands_min0.00195034816940162
sim_compute_performance-ego0_max0.0017490245378156482
sim_compute_performance-ego0_mean0.0017490245378156482
sim_compute_performance-ego0_median0.0017490245378156482
sim_compute_performance-ego0_min0.0017490245378156482
sim_compute_sim_state_max0.00968405044976373
sim_compute_sim_state_mean0.00968405044976373
sim_compute_sim_state_median0.00968405044976373
sim_compute_sim_state_min0.00968405044976373
sim_render-ego0_max0.003389011637909162
sim_render-ego0_mean0.003389011637909162
sim_render-ego0_median0.003389011637909162
sim_render-ego0_min0.003389011637909162
simulation-passed1
step_physics_max0.07049211489939361
step_physics_mean0.07049211489939361
step_physics_median0.07049211489939361
step_physics_min0.07049211489939361
survival_time_max47.09999999999946
survival_time_mean47.09999999999946
survival_time_median47.09999999999946
survival_time_min47.09999999999946
No reset possible
7776815724Vijay Vamsi Gandluriexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-070:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.1700129972685458


other stats
agent_compute-ego0_max0.01061861094306497
agent_compute-ego0_mean0.01061861094306497
agent_compute-ego0_median0.01061861094306497
agent_compute-ego0_min0.01061861094306497
complete-iteration_max0.26638463805703555
complete-iteration_mean0.26638463805703555
complete-iteration_median0.26638463805703555
complete-iteration_min0.26638463805703555
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.1700129972685458
distance-from-start_median1.1700129972685458
distance-from-start_min1.1700129972685458
driven_any_max1.1865474502700883
driven_any_mean1.1865474502700883
driven_any_median1.1865474502700883
driven_any_min1.1865474502700883
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09304175517138312
get_duckie_state_mean0.09304175517138312
get_duckie_state_median0.09304175517138312
get_duckie_state_min0.09304175517138312
get_robot_state_max0.003541271826800178
get_robot_state_mean0.003541271826800178
get_robot_state_median0.003541271826800178
get_robot_state_min0.003541271826800178
get_state_dump_max0.018553921755622416
get_state_dump_mean0.018553921755622416
get_state_dump_median0.018553921755622416
get_state_dump_min0.018553921755622416
get_ui_image_max0.04157556225271786
get_ui_image_mean0.04157556225271786
get_ui_image_median0.04157556225271786
get_ui_image_min0.04157556225271786
in-drivable-lane_max8.449999999999985
in-drivable-lane_mean8.449999999999985
in-drivable-lane_median8.449999999999985
in-drivable-lane_min8.449999999999985
per-episodes
details{"d50-ego0": {"driven_any": 1.1865474502700883, "get_ui_image": 0.04157556225271786, "step_physics": 0.0823610039318309, "survival_time": 8.449999999999985, "driven_lanedir": 0.0, "get_state_dump": 0.018553921755622416, "get_robot_state": 0.003541271826800178, "sim_render-ego0": 0.0035273187300738167, "get_duckie_state": 0.09304175517138312, "in-drivable-lane": 8.449999999999985, "deviation-heading": 0.0, "agent_compute-ego0": 0.01061861094306497, "complete-iteration": 0.26638463805703555, "set_robot_commands": 0.0020067495458266312, "distance-from-start": 1.1700129972685458, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009267868715174056, "sim_compute_performance-ego0": 0.0017910129883710077}}
set_robot_commands_max0.0020067495458266312
set_robot_commands_mean0.0020067495458266312
set_robot_commands_median0.0020067495458266312
set_robot_commands_min0.0020067495458266312
sim_compute_performance-ego0_max0.0017910129883710077
sim_compute_performance-ego0_mean0.0017910129883710077
sim_compute_performance-ego0_median0.0017910129883710077
sim_compute_performance-ego0_min0.0017910129883710077
sim_compute_sim_state_max0.009267868715174056
sim_compute_sim_state_mean0.009267868715174056
sim_compute_sim_state_median0.009267868715174056
sim_compute_sim_state_min0.009267868715174056
sim_render-ego0_max0.0035273187300738167
sim_render-ego0_mean0.0035273187300738167
sim_render-ego0_median0.0035273187300738167
sim_render-ego0_min0.0035273187300738167
simulation-passed1
step_physics_max0.0823610039318309
step_physics_mean0.0823610039318309
step_physics_median0.0823610039318309
step_physics_min0.0823610039318309
survival_time_max8.449999999999985
survival_time_mean8.449999999999985
survival_time_median8.449999999999985
survival_time_min8.449999999999985
No reset possible
7775315713Tin Yen Niehtemplate-rosmooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:15:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median2.5129246695047143
driven_lanedir_consec_median6.143367321902819
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.014680676416592436
agent_compute-ego0_mean0.014408064523803304
agent_compute-ego0_median0.014408064523803304
agent_compute-ego0_min0.014135452631014171
complete-iteration_max0.13012095414827904
complete-iteration_mean0.1299008640222605
complete-iteration_median0.1299008640222605
complete-iteration_min0.12968077389624197
deviation-center-line_max3.0455821582955864
deviation-center-line_mean2.5129246695047143
deviation-center-line_min1.980267180713842
deviation-heading_max10.098458478633312
deviation-heading_mean8.73141193774485
deviation-heading_median8.73141193774485
deviation-heading_min7.36436539685639
distance-from-start_max1.6431699182198558
distance-from-start_mean1.3558265563273426
distance-from-start_median1.3558265563273426
distance-from-start_min1.0684831944348294
driven_any_max6.2483575432019585
driven_any_mean6.245750885028635
driven_any_median6.245750885028635
driven_any_min6.243144226855312
driven_lanedir_consec_max6.169440035932556
driven_lanedir_consec_mean6.143367321902819
driven_lanedir_consec_min6.11729460787308
driven_lanedir_max6.169440035932556
driven_lanedir_mean6.143367321902819
driven_lanedir_median6.143367321902819
driven_lanedir_min6.11729460787308
get_duckie_state_max1.5128959128501311e-06
get_duckie_state_mean1.4264418818770003e-06
get_duckie_state_median1.4264418818770003e-06
get_duckie_state_min1.3399878509038691e-06
get_robot_state_max0.00332165340102781
get_robot_state_mean0.003292761277795136
get_robot_state_median0.003292761277795136
get_robot_state_min0.0032638691545624618
get_state_dump_max0.004355778404318423
get_state_dump_mean0.004274772565430348
get_state_dump_median0.004274772565430348
get_state_dump_min0.004193766726542273
get_ui_image_max0.03824351669648208
get_ui_image_mean0.03812512529581215
get_ui_image_median0.03812512529581215
get_ui_image_min0.03800673389514221
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.2483575432019585, "get_ui_image": 0.03800673389514221, "step_physics": 0.057996705013151274, "survival_time": 59.99999999999873, "driven_lanedir": 6.11729460787308, "get_state_dump": 0.004355778404318423, "get_robot_state": 0.00332165340102781, "sim_render-ego0": 0.003349352438781382, "get_duckie_state": 1.5128959128501311e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.098458478633312, "agent_compute-ego0": 0.014680676416592436, "complete-iteration": 0.12968077389624197, "set_robot_commands": 0.0023637308268423976, "distance-from-start": 1.0684831944348294, "deviation-center-line": 1.980267180713842, "driven_lanedir_consec": 6.11729460787308, "sim_compute_sim_state": 0.00365912924201959, "sim_compute_performance-ego0": 0.0018456508277556385}, "LF-small-loop-001-ego0": {"driven_any": 6.243144226855312, "get_ui_image": 0.03824351669648208, "step_physics": 0.05931969010561928, "survival_time": 59.99999999999873, "driven_lanedir": 6.169440035932556, "get_state_dump": 0.004193766726542273, "get_robot_state": 0.0032638691545624618, "sim_render-ego0": 0.003249621808181496, "get_duckie_state": 1.3399878509038691e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.36436539685639, "agent_compute-ego0": 0.014135452631014171, "complete-iteration": 0.13012095414827904, "set_robot_commands": 0.002240463458528924, "distance-from-start": 1.6431699182198558, "deviation-center-line": 3.0455821582955864, "driven_lanedir_consec": 6.169440035932556, "sim_compute_sim_state": 0.003615189750029781, "sim_compute_performance-ego0": 0.0017672389075718356}}
set_robot_commands_max0.0023637308268423976
set_robot_commands_mean0.0023020971426856605
set_robot_commands_median0.0023020971426856605
set_robot_commands_min0.002240463458528924
sim_compute_performance-ego0_max0.0018456508277556385
sim_compute_performance-ego0_mean0.0018064448676637368
sim_compute_performance-ego0_median0.0018064448676637368
sim_compute_performance-ego0_min0.0017672389075718356
sim_compute_sim_state_max0.00365912924201959
sim_compute_sim_state_mean0.003637159496024686
sim_compute_sim_state_median0.003637159496024686
sim_compute_sim_state_min0.003615189750029781
sim_render-ego0_max0.003349352438781382
sim_render-ego0_mean0.0032994871234814393
sim_render-ego0_median0.0032994871234814393
sim_render-ego0_min0.003249621808181496
simulation-passed1
step_physics_max0.05931969010561928
step_physics_mean0.05865819755938528
step_physics_median0.05865819755938528
step_physics_min0.057996705013151274
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7774915709Haydar Talibtemplate-rosmooc-modconsimsuccessnonogpu-production-b-spot-0-070:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median16.450000000000138
deviation-center-line_median0.3013295857591166
driven_lanedir_consec_median0.2675596199947119
survival_time_median19.625000000000146


other stats
agent_compute-ego0_max0.02718187295473539
agent_compute-ego0_mean0.021793282618429503
agent_compute-ego0_median0.021793282618429503
agent_compute-ego0_min0.016404692282123625
complete-iteration_max0.21453529901993584
complete-iteration_mean0.20389427916000016
complete-iteration_median0.20389427916000016
complete-iteration_min0.1932532593000645
deviation-center-line_max0.43070356495327144
deviation-center-line_mean0.3013295857591166
deviation-center-line_min0.17195560656496173
deviation-heading_max3.6692865905186633
deviation-heading_mean2.8172667403322063
deviation-heading_median2.8172667403322063
deviation-heading_min1.9652468901457496
distance-from-start_max2.405221132349775
distance-from-start_mean2.064198343784645
distance-from-start_median2.064198343784645
distance-from-start_min1.723175555219515
driven_any_max3.1180854580443356
driven_any_mean2.5904813180206774
driven_any_median2.5904813180206774
driven_any_min2.062877177997019
driven_lanedir_consec_max0.4205162154310554
driven_lanedir_consec_mean0.2675596199947119
driven_lanedir_consec_min0.11460302455836846
driven_lanedir_max0.4205162154310554
driven_lanedir_mean0.2675596199947119
driven_lanedir_median0.2675596199947119
driven_lanedir_min0.11460302455836846
get_duckie_state_max2.067313235030215e-06
get_duckie_state_mean1.8419628660992448e-06
get_duckie_state_median1.8419628660992448e-06
get_duckie_state_min1.616612497168275e-06
get_robot_state_max0.0033888017010485004
get_robot_state_mean0.0032942055852595298
get_robot_state_median0.0032942055852595298
get_robot_state_min0.003199609469470559
get_state_dump_max0.004384947128784962
get_state_dump_mean0.004204028680023489
get_state_dump_median0.004204028680023489
get_state_dump_min0.0040231102312620155
get_ui_image_max0.06293027115683271
get_ui_image_mean0.06292356536041083
get_ui_image_median0.06292356536041083
get_ui_image_min0.06291685956398896
in-drivable-lane_max18.800000000000185
in-drivable-lane_mean16.450000000000138
in-drivable-lane_min14.100000000000094
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.1180854580443356, "get_ui_image": 0.06293027115683271, "step_physics": 0.08290934613627246, "survival_time": 23.350000000000197, "driven_lanedir": 0.4205162154310554, "get_state_dump": 0.004384947128784962, "get_robot_state": 0.0033888017010485004, "sim_render-ego0": 0.0035978856249752208, "get_duckie_state": 2.067313235030215e-06, "in-drivable-lane": 18.800000000000185, "deviation-heading": 3.6692865905186633, "agent_compute-ego0": 0.02718187295473539, "complete-iteration": 0.21453529901993584, "set_robot_commands": 0.0021182079600472734, "distance-from-start": 2.405221132349775, "deviation-center-line": 0.43070356495327144, "driven_lanedir_consec": 0.4205162154310554, "sim_compute_sim_state": 0.025962776098495875, "sim_compute_performance-ego0": 0.001960311689947406}, "LF-full-loop-001-ego0": {"driven_any": 2.062877177997019, "get_ui_image": 0.06291685956398896, "step_physics": 0.07381215887757304, "survival_time": 15.900000000000093, "driven_lanedir": 0.11460302455836846, "get_state_dump": 0.0040231102312620155, "get_robot_state": 0.003199609469470559, "sim_render-ego0": 0.003407327358999222, "get_duckie_state": 1.616612497168275e-06, "in-drivable-lane": 14.100000000000094, "deviation-heading": 1.9652468901457496, "agent_compute-ego0": 0.016404692282123625, "complete-iteration": 0.1932532593000645, "set_robot_commands": 0.001908474955065497, "distance-from-start": 1.723175555219515, "deviation-center-line": 0.17195560656496173, "driven_lanedir_consec": 0.11460302455836846, "sim_compute_sim_state": 0.025735226544466885, "sim_compute_performance-ego0": 0.0017616434904475196}}
set_robot_commands_max0.0021182079600472734
set_robot_commands_mean0.0020133414575563852
set_robot_commands_median0.0020133414575563852
set_robot_commands_min0.001908474955065497
sim_compute_performance-ego0_max0.001960311689947406
sim_compute_performance-ego0_mean0.0018609775901974625
sim_compute_performance-ego0_median0.0018609775901974625
sim_compute_performance-ego0_min0.0017616434904475196
sim_compute_sim_state_max0.025962776098495875
sim_compute_sim_state_mean0.02584900132148138
sim_compute_sim_state_median0.02584900132148138
sim_compute_sim_state_min0.025735226544466885
sim_render-ego0_max0.0035978856249752208
sim_render-ego0_mean0.003502606491987222
sim_render-ego0_median0.003502606491987222
sim_render-ego0_min0.003407327358999222
simulation-passed1
step_physics_max0.08290934613627246
step_physics_mean0.07836075250692276
step_physics_median0.07836075250692276
step_physics_min0.07381215887757304
survival_time_max23.350000000000197
survival_time_mean19.625000000000146
survival_time_min15.900000000000093
No reset possible
7774115704Haydar Talibexercises_braitenbergmooc-BV1sim-4of5successnonogpu-production-b-spot-0-070:10:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.508199381866037


other stats
agent_compute-ego0_max0.010328603922377815
agent_compute-ego0_mean0.010328603922377815
agent_compute-ego0_median0.010328603922377815
agent_compute-ego0_min0.010328603922377815
complete-iteration_max0.28241022401407895
complete-iteration_mean0.28241022401407895
complete-iteration_median0.28241022401407895
complete-iteration_min0.28241022401407895
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.508199381866037
distance-from-start_median4.508199381866037
distance-from-start_min4.508199381866037
driven_any_max4.731423870379641
driven_any_mean4.731423870379641
driven_any_median4.731423870379641
driven_any_min4.731423870379641
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11829532532767392
get_duckie_state_mean0.11829532532767392
get_duckie_state_median0.11829532532767392
get_duckie_state_min0.11829532532767392
get_robot_state_max0.0035070743687841714
get_robot_state_mean0.0035070743687841714
get_robot_state_median0.0035070743687841714
get_robot_state_min0.0035070743687841714
get_state_dump_max0.020789349307426305
get_state_dump_mean0.020789349307426305
get_state_dump_median0.020789349307426305
get_state_dump_min0.020789349307426305
get_ui_image_max0.04257005338962628
get_ui_image_mean0.04257005338962628
get_ui_image_median0.04257005338962628
get_ui_image_min0.04257005338962628
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 4.731423870379641, "get_ui_image": 0.04257005338962628, "step_physics": 0.07110235375428973, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.020789349307426305, "get_robot_state": 0.0035070743687841714, "sim_render-ego0": 0.003443112480551079, "get_duckie_state": 0.11829532532767392, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010328603922377815, "complete-iteration": 0.28241022401407895, "set_robot_commands": 0.0020424871023846706, "distance-from-start": 4.508199381866037, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008426987459816404, "sim_compute_performance-ego0": 0.0018093454946983268}}
set_robot_commands_max0.0020424871023846706
set_robot_commands_mean0.0020424871023846706
set_robot_commands_median0.0020424871023846706
set_robot_commands_min0.0020424871023846706
sim_compute_performance-ego0_max0.0018093454946983268
sim_compute_performance-ego0_mean0.0018093454946983268
sim_compute_performance-ego0_median0.0018093454946983268
sim_compute_performance-ego0_min0.0018093454946983268
sim_compute_sim_state_max0.008426987459816404
sim_compute_sim_state_mean0.008426987459816404
sim_compute_sim_state_median0.008426987459816404
sim_compute_sim_state_min0.008426987459816404
sim_render-ego0_max0.003443112480551079
sim_render-ego0_mean0.003443112480551079
sim_render-ego0_median0.003443112480551079
sim_render-ego0_min0.003443112480551079
simulation-passed1
step_physics_max0.07110235375428973
step_physics_mean0.07110235375428973
step_physics_median0.07110235375428973
step_physics_min0.07110235375428973
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7773815703Juan Ramireztemplate-rosmooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:12:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median3.6999999999999353
deviation-center-line_median1.6254137607498007
driven_lanedir_consec_median4.580616257681494
survival_time_median49.22499999999934


other stats
agent_compute-ego0_max0.014838389607218953
agent_compute-ego0_mean0.01462550147155673
agent_compute-ego0_median0.01462550147155673
agent_compute-ego0_min0.014412613335894506
complete-iteration_max0.12702552931649344
complete-iteration_mean0.1254902717317627
complete-iteration_median0.1254902717317627
complete-iteration_min0.12395501414703192
deviation-center-line_max1.6511907939239197
deviation-center-line_mean1.6254137607498007
deviation-center-line_min1.5996367275756818
deviation-heading_max8.533672731178877
deviation-heading_mean7.718848184556483
deviation-heading_median7.718848184556483
deviation-heading_min6.904023637934091
distance-from-start_max1.6087383380287303
distance-from-start_mean1.3802781318762285
distance-from-start_median1.3802781318762285
distance-from-start_min1.1518179257237269
driven_any_max6.248310126959271
driven_any_mean5.079548208016631
driven_any_median5.079548208016631
driven_any_min3.9107862890739926
driven_lanedir_consec_max6.176001685094395
driven_lanedir_consec_mean4.580616257681494
driven_lanedir_consec_min2.985230830268593
driven_lanedir_max6.176001685094395
driven_lanedir_mean4.580616257681494
driven_lanedir_median4.580616257681494
driven_lanedir_min2.985230830268593
get_duckie_state_max1.2939626520330257e-06
get_duckie_state_mean1.179998715598274e-06
get_duckie_state_median1.179998715598274e-06
get_duckie_state_min1.0660347791635226e-06
get_robot_state_max0.00326680208181406
get_robot_state_mean0.0031763946690222117
get_robot_state_median0.0031763946690222117
get_robot_state_min0.003085987256230363
get_state_dump_max0.004095469821583141
get_state_dump_mean0.003967446668549947
get_state_dump_median0.003967446668549947
get_state_dump_min0.0038394235155167528
get_ui_image_max0.038542292100206
get_ui_image_mean0.038015309129798266
get_ui_image_median0.038015309129798266
get_ui_image_min0.03748832615939054
in-drivable-lane_max7.399999999999871
in-drivable-lane_mean3.6999999999999353
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.248310126959271, "get_ui_image": 0.038542292100206, "step_physics": 0.05393328198187556, "survival_time": 59.99999999999873, "driven_lanedir": 6.176001685094395, "get_state_dump": 0.0038394235155167528, "get_robot_state": 0.003085987256230363, "sim_render-ego0": 0.0030039130996208606, "get_duckie_state": 1.0660347791635226e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.904023637934091, "agent_compute-ego0": 0.014412613335894506, "complete-iteration": 0.12395501414703192, "set_robot_commands": 0.002205636479475417, "distance-from-start": 1.1518179257237269, "deviation-center-line": 1.5996367275756818, "driven_lanedir_consec": 6.176001685094395, "sim_compute_sim_state": 0.0033265027674310513, "sim_compute_performance-ego0": 0.00153641041669123}, "LF-small-loop-001-ego0": {"driven_any": 3.9107862890739926, "get_ui_image": 0.03748832615939054, "step_physics": 0.05659834905104204, "survival_time": 38.44999999999995, "driven_lanedir": 2.985230830268593, "get_state_dump": 0.004095469821583141, "get_robot_state": 0.00326680208181406, "sim_render-ego0": 0.0032123039295146993, "get_duckie_state": 1.2939626520330257e-06, "in-drivable-lane": 7.399999999999871, "deviation-heading": 8.533672731178877, "agent_compute-ego0": 0.014838389607218953, "complete-iteration": 0.12702552931649344, "set_robot_commands": 0.002279314747104397, "distance-from-start": 1.6087383380287303, "deviation-center-line": 1.6511907939239197, "driven_lanedir_consec": 2.985230830268593, "sim_compute_sim_state": 0.003438078273426403, "sim_compute_performance-ego0": 0.0017259086881365095}}
set_robot_commands_max0.002279314747104397
set_robot_commands_mean0.002242475613289907
set_robot_commands_median0.002242475613289907
set_robot_commands_min0.002205636479475417
sim_compute_performance-ego0_max0.0017259086881365095
sim_compute_performance-ego0_mean0.0016311595524138695
sim_compute_performance-ego0_median0.0016311595524138695
sim_compute_performance-ego0_min0.00153641041669123
sim_compute_sim_state_max0.003438078273426403
sim_compute_sim_state_mean0.003382290520428727
sim_compute_sim_state_median0.003382290520428727
sim_compute_sim_state_min0.0033265027674310513
sim_render-ego0_max0.0032123039295146993
sim_render-ego0_mean0.00310810851456778
sim_render-ego0_median0.00310810851456778
sim_render-ego0_min0.0030039130996208606
simulation-passed1
step_physics_max0.05659834905104204
step_physics_mean0.0552658155164588
step_physics_median0.0552658155164588
step_physics_min0.05393328198187556
survival_time_max59.99999999999873
survival_time_mean49.22499999999934
survival_time_min38.44999999999995
No reset possible
7772615695Tin Yen Niehtemplate-rosmooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:14:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median2.5433149212148827
driven_lanedir_consec_median6.1332721874809
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.014188148695463742
agent_compute-ego0_mean0.01394815657359178
agent_compute-ego0_median0.01394815657359178
agent_compute-ego0_min0.01370816445171982
complete-iteration_max0.12460957220650833
complete-iteration_mean0.12409908368525954
complete-iteration_median0.12409908368525954
complete-iteration_min0.12358859516401076
deviation-center-line_max2.7281413904199723
deviation-center-line_mean2.5433149212148827
deviation-center-line_min2.3584884520097935
deviation-heading_max10.167469817722992
deviation-heading_mean8.944148866264253
deviation-heading_median8.944148866264253
deviation-heading_min7.720827914805513
distance-from-start_max1.6398908642350296
distance-from-start_mean1.352878987726846
distance-from-start_median1.352878987726846
distance-from-start_min1.0658671112186628
driven_any_max6.248352317290556
driven_any_mean6.245744207733694
driven_any_median6.245744207733694
driven_any_min6.243136098176833
driven_lanedir_consec_max6.154021912383389
driven_lanedir_consec_mean6.1332721874809
driven_lanedir_consec_min6.1125224625784105
driven_lanedir_max6.154021912383389
driven_lanedir_mean6.1332721874809
driven_lanedir_median6.1332721874809
driven_lanedir_min6.1125224625784105
get_duckie_state_max1.2173045187766704e-06
get_duckie_state_mean1.150305126231477e-06
get_duckie_state_median1.150305126231477e-06
get_duckie_state_min1.0833057336862837e-06
get_robot_state_max0.003172755539169121
get_robot_state_mean0.0031161721203349013
get_robot_state_median0.0031161721203349013
get_robot_state_min0.003059588701500682
get_state_dump_max0.003976513404433277
get_state_dump_mean0.003970644059129599
get_state_dump_median0.003970644059129599
get_state_dump_min0.003964774713825921
get_ui_image_max0.03769716751962578
get_ui_image_mean0.037596436960314034
get_ui_image_median0.037596436960314034
get_ui_image_min0.0374957064010023
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.248352317290556, "get_ui_image": 0.0374957064010023, "step_physics": 0.054940045822867746, "survival_time": 59.99999999999873, "driven_lanedir": 6.1125224625784105, "get_state_dump": 0.003964774713825921, "get_robot_state": 0.003059588701500682, "sim_render-ego0": 0.003053772955711041, "get_duckie_state": 1.0833057336862837e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.167469817722992, "agent_compute-ego0": 0.01370816445171982, "complete-iteration": 0.12358859516401076, "set_robot_commands": 0.0023946521879731368, "distance-from-start": 1.0658671112186628, "deviation-center-line": 2.3584884520097935, "driven_lanedir_consec": 6.1125224625784105, "sim_compute_sim_state": 0.0033468896403697807, "sim_compute_performance-ego0": 0.0015536255880160494}, "LF-small-loop-001-ego0": {"driven_any": 6.243136098176833, "get_ui_image": 0.03769716751962578, "step_physics": 0.05488203467179298, "survival_time": 59.99999999999873, "driven_lanedir": 6.154021912383389, "get_state_dump": 0.003976513404433277, "get_robot_state": 0.003172755539169121, "sim_render-ego0": 0.0031658602594634476, "get_duckie_state": 1.2173045187766704e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.720827914805513, "agent_compute-ego0": 0.014188148695463742, "complete-iteration": 0.12460957220650833, "set_robot_commands": 0.0022711368722780657, "distance-from-start": 1.6398908642350296, "deviation-center-line": 2.7281413904199723, "driven_lanedir_consec": 6.154021912383389, "sim_compute_sim_state": 0.003511697029094712, "sim_compute_performance-ego0": 0.001666245909158038}}
set_robot_commands_max0.0023946521879731368
set_robot_commands_mean0.0023328945301256013
set_robot_commands_median0.0023328945301256013
set_robot_commands_min0.0022711368722780657
sim_compute_performance-ego0_max0.001666245909158038
sim_compute_performance-ego0_mean0.0016099357485870438
sim_compute_performance-ego0_median0.0016099357485870438
sim_compute_performance-ego0_min0.0015536255880160494
sim_compute_sim_state_max0.003511697029094712
sim_compute_sim_state_mean0.003429293334732246
sim_compute_sim_state_median0.003429293334732246
sim_compute_sim_state_min0.0033468896403697807
sim_render-ego0_max0.0031658602594634476
sim_render-ego0_mean0.003109816607587244
sim_render-ego0_median0.003109816607587244
sim_render-ego0_min0.003053772955711041
simulation-passed1
step_physics_max0.054940045822867746
step_physics_mean0.05491104024733036
step_physics_median0.05491104024733036
step_physics_min0.05488203467179298
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7763715681Haydar Talibexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-070:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1181164991377894


other stats
agent_compute-ego0_max0.01044427600220172
agent_compute-ego0_mean0.01044427600220172
agent_compute-ego0_median0.01044427600220172
agent_compute-ego0_min0.01044427600220172
complete-iteration_max0.23020884520816107
complete-iteration_mean0.23020884520816107
complete-iteration_median0.23020884520816107
complete-iteration_min0.23020884520816107
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1181164991377894
distance-from-start_median2.1181164991377894
distance-from-start_min2.1181164991377894
driven_any_max2.5344358947964483
driven_any_mean2.5344358947964483
driven_any_median2.5344358947964483
driven_any_min2.5344358947964483
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0790783631540563
get_duckie_state_mean0.0790783631540563
get_duckie_state_median0.0790783631540563
get_duckie_state_min0.0790783631540563
get_robot_state_max0.003481914353196638
get_robot_state_mean0.003481914353196638
get_robot_state_median0.003481914353196638
get_robot_state_min0.003481914353196638
get_state_dump_max0.0152062325582017
get_state_dump_mean0.0152062325582017
get_state_dump_median0.0152062325582017
get_state_dump_min0.0152062325582017
get_ui_image_max0.03619820566943092
get_ui_image_mean0.03619820566943092
get_ui_image_median0.03619820566943092
get_ui_image_min0.03619820566943092
in-drivable-lane_max34.200000000000195
in-drivable-lane_mean34.200000000000195
in-drivable-lane_median34.200000000000195
in-drivable-lane_min34.200000000000195
per-episodes
details{"d40-ego0": {"driven_any": 2.5344358947964483, "get_ui_image": 0.03619820566943092, "step_physics": 0.06975125326727429, "survival_time": 34.200000000000195, "driven_lanedir": 0.0, "get_state_dump": 0.0152062325582017, "get_robot_state": 0.003481914353196638, "sim_render-ego0": 0.003442715554341783, "get_duckie_state": 0.0790783631540563, "in-drivable-lane": 34.200000000000195, "deviation-heading": 0.0, "agent_compute-ego0": 0.01044427600220172, "complete-iteration": 0.23020884520816107, "set_robot_commands": 0.0020435841414180116, "distance-from-start": 2.1181164991377894, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008661885853231388, "sim_compute_performance-ego0": 0.00181342285044872}}
set_robot_commands_max0.0020435841414180116
set_robot_commands_mean0.0020435841414180116
set_robot_commands_median0.0020435841414180116
set_robot_commands_min0.0020435841414180116
sim_compute_performance-ego0_max0.00181342285044872
sim_compute_performance-ego0_mean0.00181342285044872
sim_compute_performance-ego0_median0.00181342285044872
sim_compute_performance-ego0_min0.00181342285044872
sim_compute_sim_state_max0.008661885853231388
sim_compute_sim_state_mean0.008661885853231388
sim_compute_sim_state_median0.008661885853231388
sim_compute_sim_state_min0.008661885853231388
sim_render-ego0_max0.003442715554341783
sim_render-ego0_mean0.003442715554341783
sim_render-ego0_median0.003442715554341783
sim_render-ego0_min0.003442715554341783
simulation-passed1
step_physics_max0.06975125326727429
step_physics_mean0.06975125326727429
step_physics_median0.06975125326727429
step_physics_min0.06975125326727429
survival_time_max34.200000000000195
survival_time_mean34.200000000000195
survival_time_median34.200000000000195
survival_time_min34.200000000000195
No reset possible
7763515680Haydar Talibexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-070:08:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.3854774129847893


other stats
agent_compute-ego0_max0.01054706422613622
agent_compute-ego0_mean0.01054706422613622
agent_compute-ego0_median0.01054706422613622
agent_compute-ego0_min0.01054706422613622
complete-iteration_max0.1997450988159688
complete-iteration_mean0.1997450988159688
complete-iteration_median0.1997450988159688
complete-iteration_min0.1997450988159688
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.3854774129847893
distance-from-start_median3.3854774129847893
distance-from-start_min3.3854774129847893
driven_any_max4.721099913046856
driven_any_mean4.721099913046856
driven_any_median4.721099913046856
driven_any_min4.721099913046856
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05503002709889789
get_duckie_state_mean0.05503002709889789
get_duckie_state_median0.05503002709889789
get_duckie_state_min0.05503002709889789
get_robot_state_max0.0034114361603393047
get_robot_state_mean0.0034114361603393047
get_robot_state_median0.0034114361603393047
get_robot_state_min0.0034114361603393047
get_state_dump_max0.012890919559107136
get_state_dump_mean0.012890919559107136
get_state_dump_median0.012890919559107136
get_state_dump_min0.012890919559107136
get_ui_image_max0.03468705672804859
get_ui_image_mean0.03468705672804859
get_ui_image_median0.03468705672804859
get_ui_image_min0.03468705672804859
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 4.721099913046856, "get_ui_image": 0.03468705672804859, "step_physics": 0.06864675514703984, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.012890919559107136, "get_robot_state": 0.0034114361603393047, "sim_render-ego0": 0.003387123817805942, "get_duckie_state": 0.05503002709889789, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.01054706422613622, "complete-iteration": 0.1997450988159688, "set_robot_commands": 0.0019714598056180194, "distance-from-start": 3.3854774129847893, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0073750910413553075, "sim_compute_performance-ego0": 0.001704898900930133}}
set_robot_commands_max0.0019714598056180194
set_robot_commands_mean0.0019714598056180194
set_robot_commands_median0.0019714598056180194
set_robot_commands_min0.0019714598056180194
sim_compute_performance-ego0_max0.001704898900930133
sim_compute_performance-ego0_mean0.001704898900930133
sim_compute_performance-ego0_median0.001704898900930133
sim_compute_performance-ego0_min0.001704898900930133
sim_compute_sim_state_max0.0073750910413553075
sim_compute_sim_state_mean0.0073750910413553075
sim_compute_sim_state_median0.0073750910413553075
sim_compute_sim_state_min0.0073750910413553075
sim_render-ego0_max0.003387123817805942
sim_render-ego0_mean0.003387123817805942
sim_render-ego0_median0.003387123817805942
sim_render-ego0_min0.003387123817805942
simulation-passed1
step_physics_max0.06864675514703984
step_physics_mean0.06864675514703984
step_physics_median0.06864675514703984
step_physics_min0.06864675514703984
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7762715678Haydar Talibexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-070:10:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6143196316006545


other stats
agent_compute-ego0_max0.010652424393843653
agent_compute-ego0_mean0.010652424393843653
agent_compute-ego0_median0.010652424393843653
agent_compute-ego0_min0.010652424393843653
complete-iteration_max0.20970978466894705
complete-iteration_mean0.20970978466894705
complete-iteration_median0.20970978466894705
complete-iteration_min0.20970978466894705
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6143196316006545
distance-from-start_median2.6143196316006545
distance-from-start_min2.6143196316006545
driven_any_max4.5528250905160315
driven_any_mean4.5528250905160315
driven_any_median4.5528250905160315
driven_any_min4.5528250905160315
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05618586627569524
get_duckie_state_mean0.05618586627569524
get_duckie_state_median0.05618586627569524
get_duckie_state_min0.05618586627569524
get_robot_state_max0.00350185675386783
get_robot_state_mean0.00350185675386783
get_robot_state_median0.00350185675386783
get_robot_state_min0.00350185675386783
get_state_dump_max0.01309748255739998
get_state_dump_mean0.01309748255739998
get_state_dump_median0.01309748255739998
get_state_dump_min0.01309748255739998
get_ui_image_max0.03507661640792961
get_ui_image_mean0.03507661640792961
get_ui_image_median0.03507661640792961
get_ui_image_min0.03507661640792961
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 4.5528250905160315, "get_ui_image": 0.03507661640792961, "step_physics": 0.0749654088985116, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.01309748255739998, "get_robot_state": 0.00350185675386783, "sim_render-ego0": 0.0034719504087195605, "get_duckie_state": 0.05618586627569524, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010652424393843653, "complete-iteration": 0.20970978466894705, "set_robot_commands": 0.002009531341921181, "distance-from-start": 2.6143196316006545, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00888964397325603, "sim_compute_performance-ego0": 0.0017660263674543063}}
set_robot_commands_max0.002009531341921181
set_robot_commands_mean0.002009531341921181
set_robot_commands_median0.002009531341921181
set_robot_commands_min0.002009531341921181
sim_compute_performance-ego0_max0.0017660263674543063
sim_compute_performance-ego0_mean0.0017660263674543063
sim_compute_performance-ego0_median0.0017660263674543063
sim_compute_performance-ego0_min0.0017660263674543063
sim_compute_sim_state_max0.00888964397325603
sim_compute_sim_state_mean0.00888964397325603
sim_compute_sim_state_median0.00888964397325603
sim_compute_sim_state_min0.00888964397325603
sim_render-ego0_max0.0034719504087195605
sim_render-ego0_mean0.0034719504087195605
sim_render-ego0_median0.0034719504087195605
sim_render-ego0_min0.0034719504087195605
simulation-passed1
step_physics_max0.0749654088985116
step_physics_mean0.0749654088985116
step_physics_median0.0749654088985116
step_physics_min0.0749654088985116
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7761515673Dimitrios Dimopoulosexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-070:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.039673297112887


other stats
agent_compute-ego0_max0.010550050191508911
agent_compute-ego0_mean0.010550050191508911
agent_compute-ego0_median0.010550050191508911
agent_compute-ego0_min0.010550050191508911
complete-iteration_max0.21409331565921744
complete-iteration_mean0.21409331565921744
complete-iteration_median0.21409331565921744
complete-iteration_min0.21409331565921744
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.039673297112887
distance-from-start_median6.039673297112887
distance-from-start_min6.039673297112887
driven_any_max6.058094881617779
driven_any_mean6.058094881617779
driven_any_median6.058094881617779
driven_any_min6.058094881617779
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.06058421673126591
get_duckie_state_mean0.06058421673126591
get_duckie_state_median0.06058421673126591
get_duckie_state_min0.06058421673126591
get_robot_state_max0.003629043264296448
get_robot_state_mean0.003629043264296448
get_robot_state_median0.003629043264296448
get_robot_state_min0.003629043264296448
get_state_dump_max0.012898688756146475
get_state_dump_mean0.012898688756146475
get_state_dump_median0.012898688756146475
get_state_dump_min0.012898688756146475
get_ui_image_max0.03804517747129051
get_ui_image_mean0.03804517747129051
get_ui_image_median0.03804517747129051
get_ui_image_min0.03804517747129051
in-drivable-lane_max41.1499999999998
in-drivable-lane_mean41.1499999999998
in-drivable-lane_median41.1499999999998
in-drivable-lane_min41.1499999999998
per-episodes
details{"d30-ego0": {"driven_any": 6.058094881617779, "get_ui_image": 0.03804517747129051, "step_physics": 0.07337821860915249, "survival_time": 41.1499999999998, "driven_lanedir": 0.0, "get_state_dump": 0.012898688756146475, "get_robot_state": 0.003629043264296448, "sim_render-ego0": 0.0034448180383848913, "get_duckie_state": 0.06058421673126591, "in-drivable-lane": 41.1499999999998, "deviation-heading": 0.0, "agent_compute-ego0": 0.010550050191508911, "complete-iteration": 0.21409331565921744, "set_robot_commands": 0.0021082533216013493, "distance-from-start": 6.039673297112887, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007494637399043852, "sim_compute_performance-ego0": 0.0018689528252314597}}
set_robot_commands_max0.0021082533216013493
set_robot_commands_mean0.0021082533216013493
set_robot_commands_median0.0021082533216013493
set_robot_commands_min0.0021082533216013493
sim_compute_performance-ego0_max0.0018689528252314597
sim_compute_performance-ego0_mean0.0018689528252314597
sim_compute_performance-ego0_median0.0018689528252314597
sim_compute_performance-ego0_min0.0018689528252314597
sim_compute_sim_state_max0.007494637399043852
sim_compute_sim_state_mean0.007494637399043852
sim_compute_sim_state_median0.007494637399043852
sim_compute_sim_state_min0.007494637399043852
sim_render-ego0_max0.0034448180383848913
sim_render-ego0_mean0.0034448180383848913
sim_render-ego0_median0.0034448180383848913
sim_render-ego0_min0.0034448180383848913
simulation-passed1
step_physics_max0.07337821860915249
step_physics_mean0.07337821860915249
step_physics_median0.07337821860915249
step_physics_min0.07337821860915249
survival_time_max41.1499999999998
survival_time_mean41.1499999999998
survival_time_median41.1499999999998
survival_time_min41.1499999999998
No reset possible
7761015669Mark Goodalltemplate-rosmooc-modconsimsuccessnonogpu-production-b-spot-0-070:12:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median19.150000000000137
deviation-center-line_median1.4241276937097191
driven_lanedir_consec_median2.522037175503832
survival_time_median37.1999999999994


other stats
agent_compute-ego0_max0.025962540350984675
agent_compute-ego0_mean0.02130957515924516
agent_compute-ego0_median0.02130957515924516
agent_compute-ego0_min0.016656609967505644
complete-iteration_max0.19853730721834997
complete-iteration_mean0.19267178881316016
complete-iteration_median0.19267178881316016
complete-iteration_min0.1868062704079704
deviation-center-line_max2.8482553874194383
deviation-center-line_mean1.4241276937097191
deviation-center-line_min0.0
deviation-heading_max0.8763656767069452
deviation-heading_mean0.4381828383534726
deviation-heading_median0.4381828383534726
deviation-heading_min0.0
distance-from-start_max8.338164013631788
distance-from-start_mean5.0948901325040845
distance-from-start_median5.0948901325040845
distance-from-start_min1.8516162513763803
driven_any_max8.338225046305105
driven_any_mean5.095737243067047
driven_any_median5.095737243067047
driven_any_min1.8532494398289887
driven_lanedir_consec_max5.044074351007664
driven_lanedir_consec_mean2.522037175503832
driven_lanedir_consec_min0.0
driven_lanedir_max5.044074351007664
driven_lanedir_mean2.522037175503832
driven_lanedir_median2.522037175503832
driven_lanedir_min0.0
get_duckie_state_max1.4154242039917907e-06
get_duckie_state_mean1.35944455005899e-06
get_duckie_state_median1.35944455005899e-06
get_duckie_state_min1.3034648961261895e-06
get_robot_state_max0.0030719004700340614
get_robot_state_mean0.003057228020020464
get_robot_state_median0.003057228020020464
get_robot_state_min0.003042555570006867
get_state_dump_max0.003918727371317461
get_state_dump_mean0.003876842220660808
get_state_dump_median0.003876842220660808
get_state_dump_min0.003834957070004157
get_ui_image_max0.06135883914937981
get_ui_image_mean0.06120775046010517
get_ui_image_median0.06120775046010517
get_ui_image_min0.06105666177083051
in-drivable-lane_max23.900000000000205
in-drivable-lane_mean19.150000000000137
in-drivable-lane_min14.40000000000007
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.338225046305105, "get_ui_image": 0.06135883914937981, "step_physics": 0.07177432292109226, "survival_time": 59.99999999999873, "driven_lanedir": 5.044074351007664, "get_state_dump": 0.003918727371317461, "get_robot_state": 0.003042555570006867, "sim_render-ego0": 0.0030964040240082117, "get_duckie_state": 1.4154242039917907e-06, "in-drivable-lane": 23.900000000000205, "deviation-heading": 0.8763656767069452, "agent_compute-ego0": 0.025962540350984675, "complete-iteration": 0.19853730721834997, "set_robot_commands": 0.0017769009147853676, "distance-from-start": 8.338164013631788, "deviation-center-line": 2.8482553874194383, "driven_lanedir_consec": 5.044074351007664, "sim_compute_sim_state": 0.02594467920625736, "sim_compute_performance-ego0": 0.0015867951509855273}, "LF-full-loop-001-ego0": {"driven_any": 1.8532494398289887, "get_ui_image": 0.06105666177083051, "step_physics": 0.07315989101634306, "survival_time": 14.40000000000007, "driven_lanedir": 0.0, "get_state_dump": 0.003834957070004157, "get_robot_state": 0.0030719004700340614, "sim_render-ego0": 0.003209930802711566, "get_duckie_state": 1.3034648961261895e-06, "in-drivable-lane": 14.40000000000007, "deviation-heading": 0.0, "agent_compute-ego0": 0.016656609967505644, "complete-iteration": 0.1868062704079704, "set_robot_commands": 0.001781935510338384, "distance-from-start": 1.8516162513763803, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022396828476532932, "sim_compute_performance-ego0": 0.0015655331133146188}}
set_robot_commands_max0.001781935510338384
set_robot_commands_mean0.0017794182125618755
set_robot_commands_median0.0017794182125618755
set_robot_commands_min0.0017769009147853676
sim_compute_performance-ego0_max0.0015867951509855273
sim_compute_performance-ego0_mean0.0015761641321500731
sim_compute_performance-ego0_median0.0015761641321500731
sim_compute_performance-ego0_min0.0015655331133146188
sim_compute_sim_state_max0.02594467920625736
sim_compute_sim_state_mean0.024170753841395144
sim_compute_sim_state_median0.024170753841395144
sim_compute_sim_state_min0.022396828476532932
sim_render-ego0_max0.003209930802711566
sim_render-ego0_mean0.003153167413359889
sim_render-ego0_median0.003153167413359889
sim_render-ego0_min0.0030964040240082117
simulation-passed1
step_physics_max0.07315989101634306
step_physics_mean0.07246710696871766
step_physics_median0.07246710696871766
step_physics_min0.07177432292109226
survival_time_max59.99999999999873
survival_time_mean37.1999999999994
survival_time_min14.40000000000007
No reset possible
7760015664riccardo maggioniexercises_braitenbergmooc-BV1sim-4of5successnonogpu-production-b-spot-0-070:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1536161012382284


other stats
agent_compute-ego0_max0.01048121384211949
agent_compute-ego0_mean0.01048121384211949
agent_compute-ego0_median0.01048121384211949
agent_compute-ego0_min0.01048121384211949
complete-iteration_max0.30003780364990235
complete-iteration_mean0.30003780364990235
complete-iteration_median0.30003780364990235
complete-iteration_min0.30003780364990235
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1536161012382284
distance-from-start_median2.1536161012382284
distance-from-start_min2.1536161012382284
driven_any_max2.696391716373133
driven_any_mean2.696391716373133
driven_any_median2.696391716373133
driven_any_min2.696391716373133
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.12180166278566631
get_duckie_state_mean0.12180166278566631
get_duckie_state_median0.12180166278566631
get_duckie_state_min0.12180166278566631
get_robot_state_max0.003778726373400007
get_robot_state_mean0.003778726373400007
get_robot_state_median0.003778726373400007
get_robot_state_min0.003778726373400007
get_state_dump_max0.021658684866768977
get_state_dump_mean0.021658684866768977
get_state_dump_median0.021658684866768977
get_state_dump_min0.021658684866768977
get_ui_image_max0.0434277868270874
get_ui_image_mean0.0434277868270874
get_ui_image_median0.0434277868270874
get_ui_image_min0.0434277868270874
in-drivable-lane_max34.95000000000015
in-drivable-lane_mean34.95000000000015
in-drivable-lane_median34.95000000000015
in-drivable-lane_min34.95000000000015
per-episodes
details{"d60-ego0": {"driven_any": 2.696391716373133, "get_ui_image": 0.0434277868270874, "step_physics": 0.08228652783802577, "survival_time": 34.95000000000015, "driven_lanedir": 0.0, "get_state_dump": 0.021658684866768977, "get_robot_state": 0.003778726373400007, "sim_render-ego0": 0.003531303746359689, "get_duckie_state": 0.12180166278566631, "in-drivable-lane": 34.95000000000015, "deviation-heading": 0.0, "agent_compute-ego0": 0.01048121384211949, "complete-iteration": 0.30003780364990235, "set_robot_commands": 0.0021264467920575824, "distance-from-start": 2.1536161012382284, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008914706025804792, "sim_compute_performance-ego0": 0.0019264677592686244}}
set_robot_commands_max0.0021264467920575824
set_robot_commands_mean0.0021264467920575824
set_robot_commands_median0.0021264467920575824
set_robot_commands_min0.0021264467920575824
sim_compute_performance-ego0_max0.0019264677592686244
sim_compute_performance-ego0_mean0.0019264677592686244
sim_compute_performance-ego0_median0.0019264677592686244
sim_compute_performance-ego0_min0.0019264677592686244
sim_compute_sim_state_max0.008914706025804792
sim_compute_sim_state_mean0.008914706025804792
sim_compute_sim_state_median0.008914706025804792
sim_compute_sim_state_min0.008914706025804792
sim_render-ego0_max0.003531303746359689
sim_render-ego0_mean0.003531303746359689
sim_render-ego0_median0.003531303746359689
sim_render-ego0_min0.003531303746359689
simulation-passed1
step_physics_max0.08228652783802577
step_physics_mean0.08228652783802577
step_physics_median0.08228652783802577
step_physics_min0.08228652783802577
survival_time_max34.95000000000015
survival_time_mean34.95000000000015
survival_time_median34.95000000000015
survival_time_min34.95000000000015
No reset possible
7759315662Andrey Naydenkotemplate-rosmooc-visservoingsimfailednonogpu-production-b-spot-0-070:02:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7759115661Nahuel Villalbatemplate-rosmooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:15:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median21.824999999999463
deviation-center-line_median2.0059969211151207
driven_lanedir_consec_median3.378608678701121
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.01448588228344818
agent_compute-ego0_mean0.014402229124858517
agent_compute-ego0_median0.014402229124858517
agent_compute-ego0_min0.014318575966268851
complete-iteration_max0.1231898937892358
complete-iteration_mean0.12260247914618395
complete-iteration_median0.12260247914618395
complete-iteration_min0.12201506450313215
deviation-center-line_max2.458066308644802
deviation-center-line_mean2.0059969211151207
deviation-center-line_min1.55392753358544
deviation-heading_max26.97894483546834
deviation-heading_mean16.901638222643186
deviation-heading_median16.901638222643186
deviation-heading_min6.824331609818032
distance-from-start_max1.5653224612853478
distance-from-start_mean1.282756118426428
distance-from-start_median1.282756118426428
distance-from-start_min1.0001897755675082
driven_any_max6.24730671585629
driven_any_mean6.244310026852364
driven_any_median6.244310026852364
driven_any_min6.241313337848439
driven_lanedir_consec_max5.365164471831013
driven_lanedir_consec_mean3.378608678701121
driven_lanedir_consec_min1.392052885571228
driven_lanedir_max5.365164471831013
driven_lanedir_mean3.378608678701121
driven_lanedir_median3.378608678701121
driven_lanedir_min1.392052885571228
get_duckie_state_max1.5059478276972966e-06
get_duckie_state_mean1.419692313442818e-06
get_duckie_state_median1.419692313442818e-06
get_duckie_state_min1.3334367991883392e-06
get_robot_state_max0.0033555584684398948
get_robot_state_mean0.003282797326652533
get_robot_state_median0.003282797326652533
get_robot_state_min0.0032100361848651717
get_state_dump_max0.004170350686993627
get_state_dump_mean0.004107814049542099
get_state_dump_median0.004107814049542099
get_state_dump_min0.004045277412090572
get_ui_image_max0.03685821343421142
get_ui_image_mean0.03679956712889532
get_ui_image_median0.03679956712889532
get_ui_image_min0.03674092082357923
in-drivable-lane_max43.649999999998926
in-drivable-lane_mean21.824999999999463
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.24730671585629, "get_ui_image": 0.03685821343421142, "step_physics": 0.05302063571126336, "survival_time": 59.99999999999873, "driven_lanedir": 1.392052885571228, "get_state_dump": 0.004045277412090572, "get_robot_state": 0.0032100361848651717, "sim_render-ego0": 0.003184243106127381, "get_duckie_state": 1.3334367991883392e-06, "in-drivable-lane": 43.649999999998926, "deviation-heading": 6.824331609818032, "agent_compute-ego0": 0.014318575966268851, "complete-iteration": 0.12201506450313215, "set_robot_commands": 0.002107841386882391, "distance-from-start": 1.0001897755675082, "deviation-center-line": 1.55392753358544, "driven_lanedir_consec": 1.392052885571228, "sim_compute_sim_state": 0.003467420852750068, "sim_compute_performance-ego0": 0.00171730024034435}, "LF-small-loop-001-ego0": {"driven_any": 6.241313337848439, "get_ui_image": 0.03674092082357923, "step_physics": 0.053293695060736335, "survival_time": 59.99999999999873, "driven_lanedir": 5.365164471831013, "get_state_dump": 0.004170350686993627, "get_robot_state": 0.0033555584684398948, "sim_render-ego0": 0.003367662032776133, "get_duckie_state": 1.5059478276972966e-06, "in-drivable-lane": 0.0, "deviation-heading": 26.97894483546834, "agent_compute-ego0": 0.01448588228344818, "complete-iteration": 0.1231898937892358, "set_robot_commands": 0.00215451802738898, "distance-from-start": 1.5653224612853478, "deviation-center-line": 2.458066308644802, "driven_lanedir_consec": 5.365164471831013, "sim_compute_sim_state": 0.003640708478662394, "sim_compute_performance-ego0": 0.00188716662912742}}
set_robot_commands_max0.00215451802738898
set_robot_commands_mean0.0021311797071356855
set_robot_commands_median0.0021311797071356855
set_robot_commands_min0.002107841386882391
sim_compute_performance-ego0_max0.00188716662912742
sim_compute_performance-ego0_mean0.001802233434735885
sim_compute_performance-ego0_median0.001802233434735885
sim_compute_performance-ego0_min0.00171730024034435
sim_compute_sim_state_max0.003640708478662394
sim_compute_sim_state_mean0.003554064665706231
sim_compute_sim_state_median0.003554064665706231
sim_compute_sim_state_min0.003467420852750068
sim_render-ego0_max0.003367662032776133
sim_render-ego0_mean0.003275952569451757
sim_render-ego0_median0.003275952569451757
sim_render-ego0_min0.003184243106127381
simulation-passed1
step_physics_max0.053293695060736335
step_physics_mean0.05315716538599985
step_physics_median0.05315716538599985
step_physics_min0.05302063571126336
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7758215659Ranai Srivastavexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-070:06:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.629433296703906


other stats
agent_compute-ego0_max0.010604015435803449
agent_compute-ego0_mean0.010604015435803449
agent_compute-ego0_median0.010604015435803449
agent_compute-ego0_min0.010604015435803449
complete-iteration_max0.26040833933533086
complete-iteration_mean0.26040833933533086
complete-iteration_median0.26040833933533086
complete-iteration_min0.26040833933533086
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.629433296703906
distance-from-start_median3.629433296703906
distance-from-start_min3.629433296703906
driven_any_max3.84704412862741
driven_any_mean3.84704412862741
driven_any_median3.84704412862741
driven_any_min3.84704412862741
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0946067875125986
get_duckie_state_mean0.0946067875125986
get_duckie_state_median0.0946067875125986
get_duckie_state_min0.0946067875125986
get_robot_state_max0.003543625538315161
get_robot_state_mean0.003543625538315161
get_robot_state_median0.003543625538315161
get_robot_state_min0.003543625538315161
get_state_dump_max0.018377074398965312
get_state_dump_mean0.018377074398965312
get_state_dump_median0.018377074398965312
get_state_dump_min0.018377074398965312
get_ui_image_max0.041709966426468674
get_ui_image_mean0.041709966426468674
get_ui_image_median0.041709966426468674
get_ui_image_min0.041709966426468674
in-drivable-lane_max24.500000000000213
in-drivable-lane_mean24.500000000000213
in-drivable-lane_median24.500000000000213
in-drivable-lane_min24.500000000000213
per-episodes
details{"d50-ego0": {"driven_any": 3.84704412862741, "get_ui_image": 0.041709966426468674, "step_physics": 0.0756661265542211, "survival_time": 24.500000000000213, "driven_lanedir": 0.0, "get_state_dump": 0.018377074398965312, "get_robot_state": 0.003543625538315161, "sim_render-ego0": 0.0033549364132696644, "get_duckie_state": 0.0946067875125986, "in-drivable-lane": 24.500000000000213, "deviation-heading": 0.0, "agent_compute-ego0": 0.010604015435803449, "complete-iteration": 0.26040833933533086, "set_robot_commands": 0.002000674696415359, "distance-from-start": 3.629433296703906, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008661756204733294, "sim_compute_performance-ego0": 0.0017891648830561434}}
set_robot_commands_max0.002000674696415359
set_robot_commands_mean0.002000674696415359
set_robot_commands_median0.002000674696415359
set_robot_commands_min0.002000674696415359
sim_compute_performance-ego0_max0.0017891648830561434
sim_compute_performance-ego0_mean0.0017891648830561434
sim_compute_performance-ego0_median0.0017891648830561434
sim_compute_performance-ego0_min0.0017891648830561434
sim_compute_sim_state_max0.008661756204733294
sim_compute_sim_state_mean0.008661756204733294
sim_compute_sim_state_median0.008661756204733294
sim_compute_sim_state_min0.008661756204733294
sim_render-ego0_max0.0033549364132696644
sim_render-ego0_mean0.0033549364132696644
sim_render-ego0_median0.0033549364132696644
sim_render-ego0_min0.0033549364132696644
simulation-passed1
step_physics_max0.0756661265542211
step_physics_mean0.0756661265542211
step_physics_median0.0756661265542211
step_physics_min0.0756661265542211
survival_time_max24.500000000000213
survival_time_mean24.500000000000213
survival_time_median24.500000000000213
survival_time_min24.500000000000213
No reset possible
7758015658Andrey Naydenkotemplate-rosmooc-visservoingsimfailednonogpu-production-b-spot-0-070:04:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7757815657Ed Murphyexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-070:09:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.579600000000537


other stats
agent_compute-ego0_max0.010159550856591064
agent_compute-ego0_mean0.010159550856591064
agent_compute-ego0_median0.010159550856591064
agent_compute-ego0_min0.010159550856591064
complete-iteration_max0.2028888470922084
complete-iteration_mean0.2028888470922084
complete-iteration_median0.2028888470922084
complete-iteration_min0.2028888470922084
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.579600000000537
distance-from-start_median3.579600000000537
distance-from-start_min3.579600000000537
driven_any_max3.5796000000006214
driven_any_mean3.5796000000006214
driven_any_median3.5796000000006214
driven_any_min3.5796000000006214
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0552111424375434
get_duckie_state_mean0.0552111424375434
get_duckie_state_median0.0552111424375434
get_duckie_state_min0.0552111424375434
get_robot_state_max0.0034112297029519063
get_robot_state_mean0.0034112297029519063
get_robot_state_median0.0034112297029519063
get_robot_state_min0.0034112297029519063
get_state_dump_max0.01283234700275202
get_state_dump_mean0.01283234700275202
get_state_dump_median0.01283234700275202
get_state_dump_min0.01283234700275202
get_ui_image_max0.03650639873063138
get_ui_image_mean0.03650639873063138
get_ui_image_median0.03650639873063138
get_ui_image_min0.03650639873063138
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 3.5796000000006214, "get_ui_image": 0.03650639873063138, "step_physics": 0.06935465762656892, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.01283234700275202, "get_robot_state": 0.0034112297029519063, "sim_render-ego0": 0.003316165207823945, "get_duckie_state": 0.0552111424375434, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010159550856591064, "complete-iteration": 0.2028888470922084, "set_robot_commands": 0.0019808558004285573, "distance-from-start": 3.579600000000537, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00829874685066725, "sim_compute_performance-ego0": 0.001722927792284709}}
set_robot_commands_max0.0019808558004285573
set_robot_commands_mean0.0019808558004285573
set_robot_commands_median0.0019808558004285573
set_robot_commands_min0.0019808558004285573
sim_compute_performance-ego0_max0.001722927792284709
sim_compute_performance-ego0_mean0.001722927792284709
sim_compute_performance-ego0_median0.001722927792284709
sim_compute_performance-ego0_min0.001722927792284709
sim_compute_sim_state_max0.00829874685066725
sim_compute_sim_state_mean0.00829874685066725
sim_compute_sim_state_median0.00829874685066725
sim_compute_sim_state_min0.00829874685066725
sim_render-ego0_max0.003316165207823945
sim_render-ego0_mean0.003316165207823945
sim_render-ego0_median0.003316165207823945
sim_render-ego0_min0.003316165207823945
simulation-passed1
step_physics_max0.06935465762656892
step_physics_mean0.06935465762656892
step_physics_median0.06935465762656892
step_physics_min0.06935465762656892
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7751315646Dimitrios Dimopoulosexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-070:12:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.606757543441872


other stats
agent_compute-ego0_max0.010510808919292009
agent_compute-ego0_mean0.010510808919292009
agent_compute-ego0_median0.010510808919292009
agent_compute-ego0_min0.010510808919292009
complete-iteration_max0.2678828475675813
complete-iteration_mean0.2678828475675813
complete-iteration_median0.2678828475675813
complete-iteration_min0.2678828475675813
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.606757543441872
distance-from-start_median3.606757543441872
distance-from-start_min3.606757543441872
driven_any_max3.787513737922658
driven_any_mean3.787513737922658
driven_any_median3.787513737922658
driven_any_min3.787513737922658
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09769512533049698
get_duckie_state_mean0.09769512533049698
get_duckie_state_median0.09769512533049698
get_duckie_state_min0.09769512533049698
get_robot_state_max0.003625428249794279
get_robot_state_mean0.003625428249794279
get_robot_state_median0.003625428249794279
get_robot_state_min0.003625428249794279
get_state_dump_max0.018598438996657245
get_state_dump_mean0.018598438996657245
get_state_dump_median0.018598438996657245
get_state_dump_min0.018598438996657245
get_ui_image_max0.04063102545885123
get_ui_image_mean0.04063102545885123
get_ui_image_median0.04063102545885123
get_ui_image_min0.04063102545885123
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 3.787513737922658, "get_ui_image": 0.04063102545885123, "step_physics": 0.08017928256877356, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.018598438996657245, "get_robot_state": 0.003625428249794279, "sim_render-ego0": 0.0034546242665490145, "get_duckie_state": 0.09769512533049698, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010510808919292009, "complete-iteration": 0.2678828475675813, "set_robot_commands": 0.002062979189184286, "distance-from-start": 3.606757543441872, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009185220478575591, "sim_compute_performance-ego0": 0.0018443866732912595}}
set_robot_commands_max0.002062979189184286
set_robot_commands_mean0.002062979189184286
set_robot_commands_median0.002062979189184286
set_robot_commands_min0.002062979189184286
sim_compute_performance-ego0_max0.0018443866732912595
sim_compute_performance-ego0_mean0.0018443866732912595
sim_compute_performance-ego0_median0.0018443866732912595
sim_compute_performance-ego0_min0.0018443866732912595
sim_compute_sim_state_max0.009185220478575591
sim_compute_sim_state_mean0.009185220478575591
sim_compute_sim_state_median0.009185220478575591
sim_compute_sim_state_min0.009185220478575591
sim_render-ego0_max0.0034546242665490145
sim_render-ego0_mean0.0034546242665490145
sim_render-ego0_median0.0034546242665490145
sim_render-ego0_min0.0034546242665490145
simulation-passed1
step_physics_max0.08017928256877356
step_physics_mean0.08017928256877356
step_physics_median0.08017928256877356
step_physics_min0.08017928256877356
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7750815644Awni Altabaaexercises_braitenbergaido-LFI-sim-testingsim-0of4successnonogpu-production-b-spot-0-070:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median26.200000000000237
in-drivable-lane_median19.300000000000253
driven_lanedir_consec_median0.4885448256504019
deviation-center-line_median0.4438780118269737


other stats
agent_compute-ego0_max0.010649233772641136
agent_compute-ego0_mean0.010649233772641136
agent_compute-ego0_median0.010649233772641136
agent_compute-ego0_min0.010649233772641136
complete-iteration_max0.14549738202776227
complete-iteration_mean0.14549738202776227
complete-iteration_median0.14549738202776227
complete-iteration_min0.14549738202776227
deviation-center-line_max0.4438780118269737
deviation-center-line_mean0.4438780118269737
deviation-center-line_min0.4438780118269737
deviation-heading_max2.0263297038579102
deviation-heading_mean2.0263297038579102
deviation-heading_median2.0263297038579102
deviation-heading_min2.0263297038579102
distance-from-start_max1.6753245956053366
distance-from-start_mean1.6753245956053366
distance-from-start_median1.6753245956053366
distance-from-start_min1.6753245956053366
driven_any_max1.6889036173049483
driven_any_mean1.6889036173049483
driven_any_median1.6889036173049483
driven_any_min1.6889036173049483
driven_lanedir_consec_max0.4885448256504019
driven_lanedir_consec_mean0.4885448256504019
driven_lanedir_consec_min0.4885448256504019
driven_lanedir_max0.4885448256504019
driven_lanedir_mean0.4885448256504019
driven_lanedir_median0.4885448256504019
driven_lanedir_min0.4885448256504019
get_duckie_state_max1.354217529296875e-06
get_duckie_state_mean1.354217529296875e-06
get_duckie_state_median1.354217529296875e-06
get_duckie_state_min1.354217529296875e-06
get_robot_state_max0.003246999922252837
get_robot_state_mean0.003246999922252837
get_robot_state_median0.003246999922252837
get_robot_state_min0.003246999922252837
get_state_dump_max0.004241647720336914
get_state_dump_mean0.004241647720336914
get_state_dump_median0.004241647720336914
get_state_dump_min0.004241647720336914
get_ui_image_max0.043448988596598306
get_ui_image_mean0.043448988596598306
get_ui_image_median0.043448988596598306
get_ui_image_min0.043448988596598306
in-drivable-lane_max19.300000000000253
in-drivable-lane_mean19.300000000000253
in-drivable-lane_min19.300000000000253
per-episodes
details{"LFI-norm-udem1-000-ego0": {"driven_any": 1.6889036173049483, "get_ui_image": 0.043448988596598306, "step_physics": 0.06814851079668317, "survival_time": 26.200000000000237, "driven_lanedir": 0.4885448256504019, "get_state_dump": 0.004241647720336914, "get_robot_state": 0.003246999922252837, "sim_render-ego0": 0.0034926764170328775, "get_duckie_state": 1.354217529296875e-06, "in-drivable-lane": 19.300000000000253, "deviation-heading": 2.0263297038579102, "agent_compute-ego0": 0.010649233772641136, "complete-iteration": 0.14549738202776227, "set_robot_commands": 0.0019357286180768697, "distance-from-start": 1.6753245956053366, "deviation-center-line": 0.4438780118269737, "driven_lanedir_consec": 0.4885448256504019, "sim_compute_sim_state": 0.008470261891682943, "sim_compute_performance-ego0": 0.0017796239398774646}}
set_robot_commands_max0.0019357286180768697
set_robot_commands_mean0.0019357286180768697
set_robot_commands_median0.0019357286180768697
set_robot_commands_min0.0019357286180768697
sim_compute_performance-ego0_max0.0017796239398774646
sim_compute_performance-ego0_mean0.0017796239398774646
sim_compute_performance-ego0_median0.0017796239398774646
sim_compute_performance-ego0_min0.0017796239398774646
sim_compute_sim_state_max0.008470261891682943
sim_compute_sim_state_mean0.008470261891682943
sim_compute_sim_state_median0.008470261891682943
sim_compute_sim_state_min0.008470261891682943
sim_render-ego0_max0.0034926764170328775
sim_render-ego0_mean0.0034926764170328775
sim_render-ego0_median0.0034926764170328775
sim_render-ego0_min0.0034926764170328775
simulation-passed1
step_physics_max0.06814851079668317
step_physics_mean0.06814851079668317
step_physics_median0.06814851079668317
step_physics_min0.06814851079668317
survival_time_max26.200000000000237
survival_time_mean26.200000000000237
survival_time_min26.200000000000237
No reset possible
7748515644Awni Altabaaexercises_braitenbergaido-LFI-sim-testingsim-0of4successnonogpu-production-b-spot-0-070:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median26.50000000000024
in-drivable-lane_median20.650000000000254
driven_lanedir_consec_median0.39704601890069213
deviation-center-line_median0.3809628983860667


other stats
agent_compute-ego0_max0.010540468769109409
agent_compute-ego0_mean0.010540468769109409
agent_compute-ego0_median0.010540468769109409
agent_compute-ego0_min0.010540468769109409
complete-iteration_max0.14950352693906163
complete-iteration_mean0.14950352693906163
complete-iteration_median0.14950352693906163
complete-iteration_min0.14950352693906163
deviation-center-line_max0.3809628983860667
deviation-center-line_mean0.3809628983860667
deviation-center-line_min0.3809628983860667
deviation-heading_max2.086607050280042
deviation-heading_mean2.086607050280042
deviation-heading_median2.086607050280042
deviation-heading_min2.086607050280042
distance-from-start_max1.672873166585923
distance-from-start_mean1.672873166585923
distance-from-start_median1.672873166585923
distance-from-start_min1.672873166585923
driven_any_max1.6941060199005935
driven_any_mean1.6941060199005935
driven_any_median1.6941060199005935
driven_any_min1.6941060199005935
driven_lanedir_consec_max0.39704601890069213
driven_lanedir_consec_mean0.39704601890069213
driven_lanedir_consec_min0.39704601890069213
driven_lanedir_max0.39704601890069213
driven_lanedir_mean0.39704601890069213
driven_lanedir_median0.39704601890069213
driven_lanedir_min0.39704601890069213
get_duckie_state_max1.7605258920098428e-06
get_duckie_state_mean1.7605258920098428e-06
get_duckie_state_median1.7605258920098428e-06
get_duckie_state_min1.7605258920098428e-06
get_robot_state_max0.003350063456878375
get_robot_state_mean0.003350063456878375
get_robot_state_median0.003350063456878375
get_robot_state_min0.003350063456878375
get_state_dump_max0.0043311141529550215
get_state_dump_mean0.0043311141529550215
get_state_dump_median0.0043311141529550215
get_state_dump_min0.0043311141529550215
get_ui_image_max0.04602593217192397
get_ui_image_mean0.04602593217192397
get_ui_image_median0.04602593217192397
get_ui_image_min0.04602593217192397
in-drivable-lane_max20.650000000000254
in-drivable-lane_mean20.650000000000254
in-drivable-lane_min20.650000000000254
per-episodes
details{"LFI-norm-udem1-000-ego0": {"driven_any": 1.6941060199005935, "get_ui_image": 0.04602593217192397, "step_physics": 0.06929271997929518, "survival_time": 26.50000000000024, "driven_lanedir": 0.39704601890069213, "get_state_dump": 0.0043311141529550215, "get_robot_state": 0.003350063456878375, "sim_render-ego0": 0.003511314338209939, "get_duckie_state": 1.7605258920098428e-06, "in-drivable-lane": 20.650000000000254, "deviation-heading": 2.086607050280042, "agent_compute-ego0": 0.010540468769109409, "complete-iteration": 0.14950352693906163, "set_robot_commands": 0.002004139840939624, "distance-from-start": 1.672873166585923, "deviation-center-line": 0.3809628983860667, "driven_lanedir_consec": 0.39704601890069213, "sim_compute_sim_state": 0.008589759384844936, "sim_compute_performance-ego0": 0.0017773503413083638}}
set_robot_commands_max0.002004139840939624
set_robot_commands_mean0.002004139840939624
set_robot_commands_median0.002004139840939624
set_robot_commands_min0.002004139840939624
sim_compute_performance-ego0_max0.0017773503413083638
sim_compute_performance-ego0_mean0.0017773503413083638
sim_compute_performance-ego0_median0.0017773503413083638
sim_compute_performance-ego0_min0.0017773503413083638
sim_compute_sim_state_max0.008589759384844936
sim_compute_sim_state_mean0.008589759384844936
sim_compute_sim_state_median0.008589759384844936
sim_compute_sim_state_min0.008589759384844936
sim_render-ego0_max0.003511314338209939
sim_render-ego0_mean0.003511314338209939
sim_render-ego0_median0.003511314338209939
sim_render-ego0_min0.003511314338209939
simulation-passed1
step_physics_max0.06929271997929518
step_physics_mean0.06929271997929518
step_physics_median0.06929271997929518
step_physics_min0.06929271997929518
survival_time_max26.50000000000024
survival_time_mean26.50000000000024
survival_time_min26.50000000000024
No reset possible
7747815645Awni Altabaaexercises_braitenbergaido-LFV-sim-validationsim-0of4successnonogpu-production-b-spot-0-070:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.600000000000088
in-drivable-lane_median9.9500000000001
driven_lanedir_consec_median0.3842879711994751
deviation-center-line_median0.3594688547045649


other stats
agent_compute-ego0_max0.010619332615178997
agent_compute-ego0_mean0.010619332615178997
agent_compute-ego0_median0.010619332615178997
agent_compute-ego0_min0.010619332615178997
agent_compute-npc0_max0.022592511039953266
agent_compute-npc0_mean0.022592511039953266
agent_compute-npc0_median0.022592511039953266
agent_compute-npc0_min0.022592511039953266
complete-iteration_max0.21850889102338605
complete-iteration_mean0.21850889102338605
complete-iteration_median0.21850889102338605
complete-iteration_min0.21850889102338605
deviation-center-line_max0.3594688547045649
deviation-center-line_mean0.3594688547045649
deviation-center-line_min0.3594688547045649
deviation-heading_max2.1071485664037755
deviation-heading_mean2.1071485664037755
deviation-heading_median2.1071485664037755
deviation-heading_min2.1071485664037755
distance-from-start_max1.0289932104850097
distance-from-start_mean1.0289932104850097
distance-from-start_median1.0289932104850097
distance-from-start_min1.0289932104850097
driven_any_max1.0445721025245809
driven_any_mean1.0445721025245809
driven_any_median1.0445721025245809
driven_any_min1.0445721025245809
driven_lanedir_consec_max0.3842879711994751
driven_lanedir_consec_mean0.3842879711994751
driven_lanedir_consec_min0.3842879711994751
driven_lanedir_max0.3842879711994751
driven_lanedir_mean0.3842879711994751
driven_lanedir_median0.3842879711994751
driven_lanedir_min0.3842879711994751
get_duckie_state_max1.144866212107503e-06
get_duckie_state_mean1.144866212107503e-06
get_duckie_state_median1.144866212107503e-06
get_duckie_state_min1.144866212107503e-06
get_robot_state_max0.0064970083510913785
get_robot_state_mean0.0064970083510913785
get_robot_state_median0.0064970083510913785
get_robot_state_min0.0064970083510913785
get_state_dump_max0.005698574998508246
get_state_dump_mean0.005698574998508246
get_state_dump_median0.005698574998508246
get_state_dump_min0.005698574998508246
get_ui_image_max0.04061529506890538
get_ui_image_mean0.04061529506890538
get_ui_image_median0.04061529506890538
get_ui_image_min0.04061529506890538
in-drivable-lane_max9.9500000000001
in-drivable-lane_mean9.9500000000001
in-drivable-lane_min9.9500000000001
per-episodes
details{"LFV-norm-small_loop-000-ego0": {"driven_any": 1.0445721025245809, "get_ui_image": 0.04061529506890538, "step_physics": 0.11052734402421945, "survival_time": 15.600000000000088, "driven_lanedir": 0.3842879711994751, "get_state_dump": 0.005698574998508246, "get_robot_state": 0.0064970083510913785, "sim_render-ego0": 0.003332620992447241, "sim_render-npc0": 0.0032298001237570668, "get_duckie_state": 1.144866212107503e-06, "in-drivable-lane": 9.9500000000001, "deviation-heading": 2.1071485664037755, "agent_compute-ego0": 0.010619332615178997, "agent_compute-npc0": 0.022592511039953266, "complete-iteration": 0.21850889102338605, "set_robot_commands": 0.0020065901759333503, "distance-from-start": 1.0289932104850097, "deviation-center-line": 0.3594688547045649, "driven_lanedir_consec": 0.3842879711994751, "sim_compute_sim_state": 0.008021465886515169, "sim_compute_performance-ego0": 0.0016886289127337666, "sim_compute_performance-npc0": 0.001644160419988175}}
set_robot_commands_max0.0020065901759333503
set_robot_commands_mean0.0020065901759333503
set_robot_commands_median0.0020065901759333503
set_robot_commands_min0.0020065901759333503
sim_compute_performance-ego0_max0.0016886289127337666
sim_compute_performance-ego0_mean0.0016886289127337666
sim_compute_performance-ego0_median0.0016886289127337666
sim_compute_performance-ego0_min0.0016886289127337666
sim_compute_performance-npc0_max0.001644160419988175
sim_compute_performance-npc0_mean0.001644160419988175
sim_compute_performance-npc0_median0.001644160419988175
sim_compute_performance-npc0_min0.001644160419988175
sim_compute_sim_state_max0.008021465886515169
sim_compute_sim_state_mean0.008021465886515169
sim_compute_sim_state_median0.008021465886515169
sim_compute_sim_state_min0.008021465886515169
sim_render-ego0_max0.003332620992447241
sim_render-ego0_mean0.003332620992447241
sim_render-ego0_median0.003332620992447241
sim_render-ego0_min0.003332620992447241
sim_render-npc0_max0.0032298001237570668
sim_render-npc0_mean0.0032298001237570668
sim_render-npc0_median0.0032298001237570668
sim_render-npc0_min0.0032298001237570668
simulation-passed1
step_physics_max0.11052734402421945
step_physics_mean0.11052734402421945
step_physics_median0.11052734402421945
step_physics_min0.11052734402421945
survival_time_max15.600000000000088
survival_time_mean15.600000000000088
survival_time_min15.600000000000088
No reset possible
7746715641Awni Altabaaexercises_braitenbergaido-LF-sim-validationsim-2of4successnonogpu-production-b-spot-0-070:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0237896947830862
survival_time_median25.250000000000224
deviation-center-line_median0.7330924973314292
in-drivable-lane_median11.150000000000157


other stats
agent_compute-ego0_max0.011002058097025152
agent_compute-ego0_mean0.011002058097025152
agent_compute-ego0_median0.011002058097025152
agent_compute-ego0_min0.011002058097025152
complete-iteration_max0.14771101267441458
complete-iteration_mean0.14771101267441458
complete-iteration_median0.14771101267441458
complete-iteration_min0.14771101267441458
deviation-center-line_max0.7330924973314292
deviation-center-line_mean0.7330924973314292
deviation-center-line_min0.7330924973314292
deviation-heading_max5.691925913699096
deviation-heading_mean5.691925913699096
deviation-heading_median5.691925913699096
deviation-heading_min5.691925913699096
distance-from-start_max2.0258198401952896
distance-from-start_mean2.0258198401952896
distance-from-start_median2.0258198401952896
distance-from-start_min2.0258198401952896
driven_any_max2.26584587390315
driven_any_mean2.26584587390315
driven_any_median2.26584587390315
driven_any_min2.26584587390315
driven_lanedir_consec_max1.0237896947830862
driven_lanedir_consec_mean1.0237896947830862
driven_lanedir_consec_min1.0237896947830862
driven_lanedir_max1.0330898230428252
driven_lanedir_mean1.0330898230428252
driven_lanedir_median1.0330898230428252
driven_lanedir_min1.0330898230428252
get_duckie_state_max1.0827784481727087e-06
get_duckie_state_mean1.0827784481727087e-06
get_duckie_state_median1.0827784481727087e-06
get_duckie_state_min1.0827784481727087e-06
get_robot_state_max0.0032199418591887584
get_robot_state_mean0.0032199418591887584
get_robot_state_median0.0032199418591887584
get_robot_state_min0.0032199418591887584
get_state_dump_max0.004190550962455659
get_state_dump_mean0.004190550962455659
get_state_dump_median0.004190550962455659
get_state_dump_min0.004190550962455659
get_ui_image_max0.04177388796222069
get_ui_image_mean0.04177388796222069
get_ui_image_median0.04177388796222069
get_ui_image_min0.04177388796222069
in-drivable-lane_max11.150000000000157
in-drivable-lane_mean11.150000000000157
in-drivable-lane_min11.150000000000157
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 2.26584587390315, "get_ui_image": 0.04177388796222069, "step_physics": 0.07132806891038013, "survival_time": 25.250000000000224, "driven_lanedir": 1.0330898230428252, "get_state_dump": 0.004190550962455659, "get_robot_state": 0.0032199418591887584, "sim_render-ego0": 0.00330614383983989, "get_duckie_state": 1.0827784481727087e-06, "in-drivable-lane": 11.150000000000157, "deviation-heading": 5.691925913699096, "agent_compute-ego0": 0.011002058097025152, "complete-iteration": 0.14771101267441458, "set_robot_commands": 0.001916126771406694, "distance-from-start": 2.0258198401952896, "deviation-center-line": 0.7330924973314292, "driven_lanedir_consec": 1.0237896947830862, "sim_compute_sim_state": 0.00922601354923173, "sim_compute_performance-ego0": 0.0016728352181053915}}
set_robot_commands_max0.001916126771406694
set_robot_commands_mean0.001916126771406694
set_robot_commands_median0.001916126771406694
set_robot_commands_min0.001916126771406694
sim_compute_performance-ego0_max0.0016728352181053915
sim_compute_performance-ego0_mean0.0016728352181053915
sim_compute_performance-ego0_median0.0016728352181053915
sim_compute_performance-ego0_min0.0016728352181053915
sim_compute_sim_state_max0.00922601354923173
sim_compute_sim_state_mean0.00922601354923173
sim_compute_sim_state_median0.00922601354923173
sim_compute_sim_state_min0.00922601354923173
sim_render-ego0_max0.00330614383983989
sim_render-ego0_mean0.00330614383983989
sim_render-ego0_median0.00330614383983989
sim_render-ego0_min0.00330614383983989
simulation-passed1
step_physics_max0.07132806891038013
step_physics_mean0.07132806891038013
step_physics_median0.07132806891038013
step_physics_min0.07132806891038013
survival_time_max25.250000000000224
survival_time_mean25.250000000000224
survival_time_min25.250000000000224
No reset possible
7745715637Awni Altabaaexercises_braitenbergmooc-BV1sim-4of5successnonogpu-production-b-spot-0-070:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.7497326624182463


other stats
agent_compute-ego0_max0.010193571508170131
agent_compute-ego0_mean0.010193571508170131
agent_compute-ego0_median0.010193571508170131
agent_compute-ego0_min0.010193571508170131
complete-iteration_max0.2661930303497008
complete-iteration_mean0.2661930303497008
complete-iteration_median0.2661930303497008
complete-iteration_min0.2661930303497008
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.7497326624182463
distance-from-start_median1.7497326624182463
distance-from-start_min1.7497326624182463
driven_any_max1.7786623749424868
driven_any_mean1.7786623749424868
driven_any_median1.7786623749424868
driven_any_min1.7786623749424868
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10681060662710044
get_duckie_state_mean0.10681060662710044
get_duckie_state_median0.10681060662710044
get_duckie_state_min0.10681060662710044
get_robot_state_max0.003258171330494095
get_robot_state_mean0.003258171330494095
get_robot_state_median0.003258171330494095
get_robot_state_min0.003258171330494095
get_state_dump_max0.01959532523250963
get_state_dump_mean0.01959532523250963
get_state_dump_median0.01959532523250963
get_state_dump_min0.01959532523250963
get_ui_image_max0.04107983619812502
get_ui_image_mean0.04107983619812502
get_ui_image_median0.04107983619812502
get_ui_image_min0.04107983619812502
in-drivable-lane_max24.850000000000215
in-drivable-lane_mean24.850000000000215
in-drivable-lane_median24.850000000000215
in-drivable-lane_min24.850000000000215
per-episodes
details{"d60-ego0": {"driven_any": 1.7786623749424868, "get_ui_image": 0.04107983619812502, "step_physics": 0.06998146681421732, "survival_time": 24.850000000000215, "driven_lanedir": 0.0, "get_state_dump": 0.01959532523250963, "get_robot_state": 0.003258171330494095, "sim_render-ego0": 0.003125191213615448, "get_duckie_state": 0.10681060662710044, "in-drivable-lane": 24.850000000000215, "deviation-heading": 0.0, "agent_compute-ego0": 0.010193571508170131, "complete-iteration": 0.2661930303497008, "set_robot_commands": 0.0018927457342186127, "distance-from-start": 1.7497326624182463, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008542358635898575, "sim_compute_performance-ego0": 0.0016374051810268415}}
set_robot_commands_max0.0018927457342186127
set_robot_commands_mean0.0018927457342186127
set_robot_commands_median0.0018927457342186127
set_robot_commands_min0.0018927457342186127
sim_compute_performance-ego0_max0.0016374051810268415
sim_compute_performance-ego0_mean0.0016374051810268415
sim_compute_performance-ego0_median0.0016374051810268415
sim_compute_performance-ego0_min0.0016374051810268415
sim_compute_sim_state_max0.008542358635898575
sim_compute_sim_state_mean0.008542358635898575
sim_compute_sim_state_median0.008542358635898575
sim_compute_sim_state_min0.008542358635898575
sim_render-ego0_max0.003125191213615448
sim_render-ego0_mean0.003125191213615448
sim_render-ego0_median0.003125191213615448
sim_render-ego0_min0.003125191213615448
simulation-passed1
step_physics_max0.06998146681421732
step_physics_mean0.06998146681421732
step_physics_median0.06998146681421732
step_physics_min0.06998146681421732
survival_time_max24.850000000000215
survival_time_mean24.850000000000215
survival_time_median24.850000000000215
survival_time_min24.850000000000215
No reset possible
7744515630Shengjie Hu 🇨🇭template-rosmooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:14:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median23.149999999999544
deviation-center-line_median3.0085355568129897
driven_lanedir_consec_median1.2114753264682996
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.01547689024951436
agent_compute-ego0_mean0.015374991717088431
agent_compute-ego0_median0.015374991717088431
agent_compute-ego0_min0.0152730931846625
complete-iteration_max0.13412358341963465
complete-iteration_mean0.13039985902104945
complete-iteration_median0.13039985902104945
complete-iteration_min0.12667613462246427
deviation-center-line_max3.3072344519179446
deviation-center-line_mean3.0085355568129897
deviation-center-line_min2.709836661708035
deviation-heading_max33.5632492187708
deviation-heading_mean27.819787391012103
deviation-heading_median27.819787391012103
deviation-heading_min22.076325563253405
distance-from-start_max0.39805927656612106
distance-from-start_mean0.3980199792959042
distance-from-start_median0.3980199792959042
distance-from-start_min0.39798068202568737
driven_any_max6.248247344461886
driven_any_mean6.245626849441546
driven_any_median6.245626849441546
driven_any_min6.243006354421206
driven_lanedir_consec_max1.5313838384638334
driven_lanedir_consec_mean1.2114753264682996
driven_lanedir_consec_min0.8915668144727655
driven_lanedir_max2.5839216044063087
driven_lanedir_mean2.529573045443235
driven_lanedir_median2.529573045443235
driven_lanedir_min2.475224486480162
get_duckie_state_max1.2397369079843945e-06
get_duckie_state_mean1.222664470180286e-06
get_duckie_state_median1.222664470180286e-06
get_duckie_state_min1.2055920323761771e-06
get_robot_state_max0.003288995415642299
get_robot_state_mean0.003241064447248905
get_robot_state_median0.003241064447248905
get_robot_state_min0.003193133478855511
get_state_dump_max0.004202557642394359
get_state_dump_mean0.004136933772192708
get_state_dump_median0.004136933772192708
get_state_dump_min0.004071309901991057
get_ui_image_max0.041656646601464925
get_ui_image_mean0.03954413560506803
get_ui_image_median0.03954413560506803
get_ui_image_min0.03743162460867114
in-drivable-lane_max25.84999999999947
in-drivable-lane_mean23.149999999999544
in-drivable-lane_min20.449999999999616
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.248247344461886, "get_ui_image": 0.041656646601464925, "step_physics": 0.05858495848859776, "survival_time": 59.99999999999873, "driven_lanedir": 2.475224486480162, "get_state_dump": 0.004202557642394359, "get_robot_state": 0.003288995415642299, "sim_render-ego0": 0.003236405954670648, "get_duckie_state": 1.2055920323761771e-06, "in-drivable-lane": 20.449999999999616, "deviation-heading": 33.5632492187708, "agent_compute-ego0": 0.01547689024951436, "complete-iteration": 0.13412358341963465, "set_robot_commands": 0.002755541487796221, "distance-from-start": 0.39805927656612106, "deviation-center-line": 3.3072344519179446, "driven_lanedir_consec": 1.5313838384638334, "sim_compute_sim_state": 0.003176599815425825, "sim_compute_performance-ego0": 0.0016682122172562903}, "LF-small-loop-001-ego0": {"driven_any": 6.243006354421206, "get_ui_image": 0.03743162460867114, "step_physics": 0.05552200115689827, "survival_time": 59.99999999999873, "driven_lanedir": 2.5839216044063087, "get_state_dump": 0.004071309901991057, "get_robot_state": 0.003193133478855511, "sim_render-ego0": 0.003151808849083792, "get_duckie_state": 1.2397369079843945e-06, "in-drivable-lane": 25.84999999999947, "deviation-heading": 22.076325563253405, "agent_compute-ego0": 0.0152730931846625, "complete-iteration": 0.12667613462246427, "set_robot_commands": 0.002623174311616438, "distance-from-start": 0.39798068202568737, "deviation-center-line": 2.709836661708035, "driven_lanedir_consec": 0.8915668144727655, "sim_compute_sim_state": 0.00368887042125794, "sim_compute_performance-ego0": 0.00164380677038188}}
set_robot_commands_max0.002755541487796221
set_robot_commands_mean0.00268935789970633
set_robot_commands_median0.00268935789970633
set_robot_commands_min0.002623174311616438
sim_compute_performance-ego0_max0.0016682122172562903
sim_compute_performance-ego0_mean0.001656009493819085
sim_compute_performance-ego0_median0.001656009493819085
sim_compute_performance-ego0_min0.00164380677038188
sim_compute_sim_state_max0.00368887042125794
sim_compute_sim_state_mean0.0034327351183418824
sim_compute_sim_state_median0.0034327351183418824
sim_compute_sim_state_min0.003176599815425825
sim_render-ego0_max0.003236405954670648
sim_render-ego0_mean0.0031941074018772197
sim_render-ego0_median0.0031941074018772197
sim_render-ego0_min0.003151808849083792
simulation-passed1
step_physics_max0.05858495848859776
step_physics_mean0.05705347982274801
step_physics_median0.05705347982274801
step_physics_min0.05552200115689827
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7744215629Shengjie Hu 🇨🇭objdet exercisemooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median1.8249999999999935
deviation-center-line_median0.10312417604506058
driven_lanedir_consec_median0.8309911655473405
survival_time_median5.249999999999989


other stats
agent_compute-ego0_max0.015008271865124972
agent_compute-ego0_mean0.014736880671303227
agent_compute-ego0_median0.014736880671303227
agent_compute-ego0_min0.014465489477481485
complete-iteration_max0.1312007116821577
complete-iteration_mean0.12692155365674002
complete-iteration_median0.12692155365674002
complete-iteration_min0.12264239563132232
deviation-center-line_max0.10572355586172828
deviation-center-line_mean0.10312417604506058
deviation-center-line_min0.10052479622839287
deviation-heading_max0.4193521943465078
deviation-heading_mean0.4133684269583483
deviation-heading_median0.4133684269583483
deviation-heading_min0.40738465957018893
distance-from-start_max1.1767994213216288
distance-from-start_mean1.1767994213216288
distance-from-start_median1.1767994213216288
distance-from-start_min1.1767994213216288
driven_any_max1.1767994213216288
driven_any_mean1.1767994213216288
driven_any_median1.1767994213216288
driven_any_min1.1767994213216288
driven_lanedir_consec_max0.8856406334353936
driven_lanedir_consec_mean0.8309911655473405
driven_lanedir_consec_min0.7763416976592876
driven_lanedir_max0.8856406334353936
driven_lanedir_mean0.8309911655473405
driven_lanedir_median0.8309911655473405
driven_lanedir_min0.7763416976592876
get_duckie_state_max1.5699638510650058e-06
get_duckie_state_mean1.4721222643582326e-06
get_duckie_state_median1.4721222643582326e-06
get_duckie_state_min1.3742806776514594e-06
get_robot_state_max0.003523325020412229
get_robot_state_mean0.003419849107850273
get_robot_state_median0.003419849107850273
get_robot_state_min0.0033163731952883164
get_state_dump_max0.004436364713704811
get_state_dump_mean0.0043043415501432605
get_state_dump_median0.0043043415501432605
get_state_dump_min0.004172318386581709
get_ui_image_max0.03976370478576084
get_ui_image_mean0.037896981779134496
get_ui_image_median0.037896981779134496
get_ui_image_min0.03603025877250815
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean1.8249999999999935
in-drivable-lane_min1.649999999999994
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.1767994213216288, "get_ui_image": 0.03976370478576084, "step_physics": 0.0590502900897332, "survival_time": 5.249999999999989, "driven_lanedir": 0.7763416976592876, "get_state_dump": 0.004172318386581709, "get_robot_state": 0.0033163731952883164, "sim_render-ego0": 0.0032852820630343456, "get_duckie_state": 1.3742806776514594e-06, "in-drivable-lane": 1.999999999999993, "deviation-heading": 0.4193521943465078, "agent_compute-ego0": 0.014465489477481485, "complete-iteration": 0.1312007116821577, "set_robot_commands": 0.0019247127029131043, "distance-from-start": 1.1767994213216288, "deviation-center-line": 0.10052479622839287, "driven_lanedir_consec": 0.7763416976592876, "sim_compute_sim_state": 0.003323973349805148, "sim_compute_performance-ego0": 0.0018131508017485995}, "LF-small-loop-001-ego0": {"driven_any": 1.1767994213216288, "get_ui_image": 0.03603025877250815, "step_physics": 0.051678308900797144, "survival_time": 5.249999999999989, "driven_lanedir": 0.8856406334353936, "get_state_dump": 0.004436364713704811, "get_robot_state": 0.003523325020412229, "sim_render-ego0": 0.0035947988618094968, "get_duckie_state": 1.5699638510650058e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 0.40738465957018893, "agent_compute-ego0": 0.015008271865124972, "complete-iteration": 0.12264239563132232, "set_robot_commands": 0.002144455909729004, "distance-from-start": 1.1767994213216288, "deviation-center-line": 0.10572355586172828, "driven_lanedir_consec": 0.8856406334353936, "sim_compute_sim_state": 0.00397357850704553, "sim_compute_performance-ego0": 0.0021505310850323373}}
set_robot_commands_max0.002144455909729004
set_robot_commands_mean0.0020345843063210543
set_robot_commands_median0.0020345843063210543
set_robot_commands_min0.0019247127029131043
sim_compute_performance-ego0_max0.0021505310850323373
sim_compute_performance-ego0_mean0.0019818409433904685
sim_compute_performance-ego0_median0.0019818409433904685
sim_compute_performance-ego0_min0.0018131508017485995
sim_compute_sim_state_max0.00397357850704553
sim_compute_sim_state_mean0.003648775928425339
sim_compute_sim_state_median0.003648775928425339
sim_compute_sim_state_min0.003323973349805148
sim_render-ego0_max0.0035947988618094968
sim_render-ego0_mean0.003440040462421921
sim_render-ego0_median0.003440040462421921
sim_render-ego0_min0.0032852820630343456
simulation-passed1
step_physics_max0.0590502900897332
step_physics_mean0.05536429949526517
step_physics_median0.05536429949526517
step_physics_min0.051678308900797144
survival_time_max5.249999999999989
survival_time_mean5.249999999999989
survival_time_min5.249999999999989
No reset possible
7743315621Liam Paull 🇨🇦template-rosmooc-objdetsimsuccessnonogpu-production-b-spot-0-070:18:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median0.0001430511474609375


other stats
agent_compute-ego0_max0.01784769621220953
agent_compute-ego0_mean0.017375167859384755
agent_compute-ego0_median0.017375167859384755
agent_compute-ego0_min0.016902639506559982
complete-iteration_max0.22744615548457037
complete-iteration_mean0.21564621621623423
complete-iteration_median0.21564621621623423
complete-iteration_min0.20384627694789817
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
get_duckie_state_max0.018826721510621133
get_duckie_state_mean0.018266778206646593
get_duckie_state_median0.018266778206646593
get_duckie_state_min0.01770683490267205
get_robot_state_max0.0033804971312206057
get_robot_state_mean0.003284950836016475
get_robot_state_median0.003284950836016475
get_robot_state_min0.003189404540812344
get_state_dump_max0.00728731945492048
get_state_dump_mean0.007103822610459657
get_state_dump_median0.007103822610459657
get_state_dump_min0.0069203257659988335
get_ui_image_max0.057318084742207016
get_ui_image_mean0.05651557693672021
get_ui_image_median0.05651557693672021
get_ui_image_min0.05571306913123341
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.05571306913123341, "step_physics": 0.07263981730217342, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "get_state_dump": 0.0069203257659988335, "get_robot_state": 0.003189404540812344, "sim_render-ego0": 0.0031573262242452983, "get_duckie_state": 0.01770683490267205, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.016902639506559982, "complete-iteration": 0.20384627694789817, "set_robot_commands": 0.0023687417858546224, "distance-from-start": 0.0, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 0.0001430511474609375, "sim_compute_sim_state": 0.02347486580936835, "sim_compute_performance-ego0": 0.0016896371341168534}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 0.0, "get_ui_image": 0.057318084742207016, "step_physics": 0.08365701517395731, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "get_state_dump": 0.00728731945492048, "get_robot_state": 0.0033804971312206057, "sim_render-ego0": 0.0034464836914672344, "get_duckie_state": 0.018826721510621133, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.01784769621220953, "complete-iteration": 0.22744615548457037, "set_robot_commands": 0.002476325737844399, "distance-from-start": 0.0, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 0.0001430511474609375, "sim_compute_sim_state": 0.031190111277800216, "sim_compute_performance-ego0": 0.00192173236017918}}
set_robot_commands_max0.002476325737844399
set_robot_commands_mean0.0024225337618495107
set_robot_commands_median0.0024225337618495107
set_robot_commands_min0.0023687417858546224
sim_compute_performance-ego0_max0.00192173236017918
sim_compute_performance-ego0_mean0.0018056847471480167
sim_compute_performance-ego0_median0.0018056847471480167
sim_compute_performance-ego0_min0.0016896371341168534
sim_compute_sim_state_max0.031190111277800216
sim_compute_sim_state_mean0.027332488543584284
sim_compute_sim_state_median0.027332488543584284
sim_compute_sim_state_min0.02347486580936835
sim_render-ego0_max0.0034464836914672344
sim_render-ego0_mean0.003301904957856266
sim_render-ego0_median0.003301904957856266
sim_render-ego0_min0.0031573262242452983
simulation-passed1
step_physics_max0.08365701517395731
step_physics_mean0.07814841623806537
step_physics_median0.07814841623806537
step_physics_min0.07263981730217342
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7742415613Liam Paull 🇨🇦objdet exercisemooc-objdetsimsuccessnonogpu-production-b-spot-0-070:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.250000000000124
driven_lanedir_consec_median4.81066756257857


other stats
agent_compute-ego0_max0.017272186184686327
agent_compute-ego0_mean0.01724682947497818
agent_compute-ego0_median0.01724682947497818
agent_compute-ego0_min0.017221472765270033
complete-iteration_max0.22261843037983728
complete-iteration_mean0.2216708210725633
complete-iteration_median0.2216708210725633
complete-iteration_min0.2207232117652893
deviation-center-line_max0.26774333024025004
deviation-center-line_mean0.21555488127470093
deviation-center-line_median0.21555488127470093
deviation-center-line_min0.16336643230915182
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.739343004227582
distance-from-start_mean4.810621862412031
distance-from-start_median4.810621862412031
distance-from-start_min2.8819007205964793
driven_any_max6.739343004227582
driven_any_mean4.810621862412031
driven_any_median4.810621862412031
driven_any_min2.8819007205964793
driven_lanedir_consec_max6.739416256114824
driven_lanedir_consec_mean4.81066756257857
driven_lanedir_consec_min2.8819188690423156
driven_lanedir_max6.739416256114824
driven_lanedir_mean4.81066756257857
driven_lanedir_median4.81066756257857
driven_lanedir_min2.8819188690423156
get_duckie_state_max0.01937165804076613
get_duckie_state_mean0.019207155395769136
get_duckie_state_median0.019207155395769136
get_duckie_state_min0.019042652750772143
get_robot_state_max0.0033980702099047208
get_robot_state_mean0.0033626094921091346
get_robot_state_median0.0033626094921091346
get_robot_state_min0.0033271487743135484
get_state_dump_max0.007290435464758622
get_state_dump_mean0.007247435319592979
get_state_dump_median0.007247435319592979
get_state_dump_min0.007204435174427335
get_ui_image_max0.05714629803385053
get_ui_image_mean0.05595340738469795
get_ui_image_median0.05595340738469795
get_ui_image_min0.05476051673554538
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.739343004227582, "get_ui_image": 0.05714629803385053, "step_physics": 0.08702906776988317, "survival_time": 25.150000000000222, "driven_lanedir": 6.739416256114824, "get_state_dump": 0.007204435174427335, "get_robot_state": 0.0033271487743135484, "sim_render-ego0": 0.003403259648217095, "get_duckie_state": 0.019042652750772143, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.017272186184686327, "complete-iteration": 0.22261843037983728, "set_robot_commands": 0.0020042558511098227, "distance-from-start": 6.739343004227582, "deviation-center-line": 0.16336643230915182, "driven_lanedir_consec": 6.739416256114824, "sim_compute_sim_state": 0.024202573867071243, "sim_compute_performance-ego0": 0.001892229394307212}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.8819007205964793, "get_ui_image": 0.05476051673554538, "step_physics": 0.0832987950559248, "survival_time": 11.350000000000026, "driven_lanedir": 2.8819188690423156, "get_state_dump": 0.007290435464758622, "get_robot_state": 0.0033980702099047208, "sim_render-ego0": 0.0034335454305013022, "get_duckie_state": 0.01937165804076613, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.017221472765270033, "complete-iteration": 0.2207232117652893, "set_robot_commands": 0.0019758552835698715, "distance-from-start": 2.8819007205964793, "deviation-center-line": 0.26774333024025004, "driven_lanedir_consec": 2.8819188690423156, "sim_compute_sim_state": 0.027983397768254863, "sim_compute_performance-ego0": 0.0018947103567290725}}
set_robot_commands_max0.0020042558511098227
set_robot_commands_mean0.001990055567339847
set_robot_commands_median0.001990055567339847
set_robot_commands_min0.0019758552835698715
sim_compute_performance-ego0_max0.0018947103567290725
sim_compute_performance-ego0_mean0.0018934698755181424
sim_compute_performance-ego0_median0.0018934698755181424
sim_compute_performance-ego0_min0.001892229394307212
sim_compute_sim_state_max0.027983397768254863
sim_compute_sim_state_mean0.026092985817663054
sim_compute_sim_state_median0.026092985817663054
sim_compute_sim_state_min0.024202573867071243
sim_render-ego0_max0.0034335454305013022
sim_render-ego0_mean0.003418402539359199
sim_render-ego0_median0.003418402539359199
sim_render-ego0_min0.003403259648217095
simulation-passed1
step_physics_max0.08702906776988317
step_physics_mean0.08516393141290399
step_physics_median0.08516393141290399
step_physics_min0.0832987950559248
survival_time_max25.150000000000222
survival_time_mean18.250000000000124
survival_time_min11.350000000000026
No reset possible
7742215611Liam Paull 🇨🇦template-rosmooc-objdetsimfailednonogpu-production-b-spot-0-070:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7741215604Liam Paull 🇨🇦objdet exercisemooc-objdetsimsuccessnonogpu-production-b-spot-0-070:18:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median55.97499999999896
driven_lanedir_consec_median7.311068411108038


other stats
agent_compute-ego0_max0.017693259624334483
agent_compute-ego0_mean0.01698629866512659
agent_compute-ego0_median0.01698629866512659
agent_compute-ego0_min0.016279337705918693
complete-iteration_max0.21709833282690785
complete-iteration_mean0.21149806667911183
complete-iteration_median0.21149806667911183
complete-iteration_min0.20589780053131587
deviation-center-line_max1.859693673633177
deviation-center-line_mean1.7589061359677771
deviation-center-line_median1.7589061359677771
deviation-center-line_min1.658118598302377
deviation-heading_max4.633968635133557
deviation-heading_mean3.647955677588886
deviation-heading_median3.647955677588886
deviation-heading_min2.6619427200442147
distance-from-start_max7.902664238332501
distance-from-start_mean7.3110196085574
distance-from-start_median7.3110196085574
distance-from-start_min6.719374978782298
driven_any_max7.914667053964355
driven_any_mean7.337074828336816
driven_any_median7.337074828336816
driven_any_min6.759482602709277
driven_lanedir_consec_max7.90284478653913
driven_lanedir_consec_mean7.311068411108038
driven_lanedir_consec_min6.719292035676946
driven_lanedir_max7.90284478653913
driven_lanedir_mean7.311068411108038
driven_lanedir_median7.311068411108038
driven_lanedir_min6.719292035676946
get_duckie_state_max0.018825168105272145
get_duckie_state_mean0.018194401287955415
get_duckie_state_median0.018194401287955415
get_duckie_state_min0.017563634470638686
get_robot_state_max0.0033590633135575513
get_robot_state_mean0.003250572818747124
get_robot_state_median0.003250572818747124
get_robot_state_min0.003142082323936698
get_state_dump_max0.007174217930206886
get_state_dump_mean0.006948606160440184
get_state_dump_median0.006948606160440184
get_state_dump_min0.006722994390673483
get_ui_image_max0.05815289799983685
get_ui_image_mean0.05601932466114108
get_ui_image_median0.05601932466114108
get_ui_image_min0.05388575132244532
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.759482602709277, "get_ui_image": 0.05815289799983685, "step_physics": 0.07929972731150113, "survival_time": 51.949999999999186, "driven_lanedir": 6.719292035676946, "get_state_dump": 0.007174217930206886, "get_robot_state": 0.0033590633135575513, "sim_render-ego0": 0.0033860862255096435, "get_duckie_state": 0.018825168105272145, "in-drivable-lane": 0.0, "deviation-heading": 4.633968635133557, "agent_compute-ego0": 0.017693259624334483, "complete-iteration": 0.21709833282690785, "set_robot_commands": 0.001995815680577205, "distance-from-start": 6.719374978782298, "deviation-center-line": 1.658118598302377, "driven_lanedir_consec": 6.719292035676946, "sim_compute_sim_state": 0.02525151968002319, "sim_compute_performance-ego0": 0.0018716763991575977}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 7.914667053964355, "get_ui_image": 0.05388575132244532, "step_physics": 0.07226278958570749, "survival_time": 59.99999999999873, "driven_lanedir": 7.90284478653913, "get_state_dump": 0.006722994390673483, "get_robot_state": 0.003142082323936698, "sim_render-ego0": 0.0031948839992805883, "get_duckie_state": 0.017563634470638686, "in-drivable-lane": 0.0, "deviation-heading": 2.6619427200442147, "agent_compute-ego0": 0.016279337705918693, "complete-iteration": 0.20589780053131587, "set_robot_commands": 0.0018475262151967475, "distance-from-start": 7.902664238332501, "deviation-center-line": 1.859693673633177, "driven_lanedir_consec": 7.90284478653913, "sim_compute_sim_state": 0.029228095111005215, "sim_compute_performance-ego0": 0.0016918805715543444}}
set_robot_commands_max0.001995815680577205
set_robot_commands_mean0.0019216709478869765
set_robot_commands_median0.0019216709478869765
set_robot_commands_min0.0018475262151967475
sim_compute_performance-ego0_max0.0018716763991575977
sim_compute_performance-ego0_mean0.001781778485355971
sim_compute_performance-ego0_median0.001781778485355971
sim_compute_performance-ego0_min0.0016918805715543444
sim_compute_sim_state_max0.029228095111005215
sim_compute_sim_state_mean0.027239807395514203
sim_compute_sim_state_median0.027239807395514203
sim_compute_sim_state_min0.02525151968002319
sim_render-ego0_max0.0033860862255096435
sim_render-ego0_mean0.003290485112395116
sim_render-ego0_median0.003290485112395116
sim_render-ego0_min0.0031948839992805883
simulation-passed1
step_physics_max0.07929972731150113
step_physics_mean0.07578125844860431
step_physics_median0.07578125844860431
step_physics_min0.07226278958570749
survival_time_max59.99999999999873
survival_time_mean55.97499999999896
survival_time_min51.949999999999186
No reset possible
7740915602Nisith Singhexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-070:09:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.814198414711285


other stats
agent_compute-ego0_max0.010427142658598914
agent_compute-ego0_mean0.010427142658598914
agent_compute-ego0_median0.010427142658598914
agent_compute-ego0_min0.010427142658598914
complete-iteration_max0.22645615181458384
complete-iteration_mean0.22645615181458384
complete-iteration_median0.22645615181458384
complete-iteration_min0.22645615181458384
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.814198414711285
distance-from-start_median3.814198414711285
distance-from-start_min3.814198414711285
driven_any_max4.201893236398122
driven_any_mean4.201893236398122
driven_any_median4.201893236398122
driven_any_min4.201893236398122
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07413753442819868
get_duckie_state_mean0.07413753442819868
get_duckie_state_median0.07413753442819868
get_duckie_state_min0.07413753442819868
get_robot_state_max0.003442278710332739
get_robot_state_mean0.003442278710332739
get_robot_state_median0.003442278710332739
get_robot_state_min0.003442278710332739
get_state_dump_max0.015613074108126956
get_state_dump_mean0.015613074108126956
get_state_dump_median0.015613074108126956
get_state_dump_min0.015613074108126956
get_ui_image_max0.037851575014493946
get_ui_image_mean0.037851575014493946
get_ui_image_median0.037851575014493946
get_ui_image_min0.037851575014493946
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 4.201893236398122, "get_ui_image": 0.037851575014493946, "step_physics": 0.06964233912198768, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.015613074108126956, "get_robot_state": 0.003442278710332739, "sim_render-ego0": 0.003338595413347764, "get_duckie_state": 0.07413753442819868, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010427142658598914, "complete-iteration": 0.22645615181458384, "set_robot_commands": 0.002011552242117063, "distance-from-start": 3.814198414711285, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008170180475582786, "sim_compute_performance-ego0": 0.001734173168846213}}
set_robot_commands_max0.002011552242117063
set_robot_commands_mean0.002011552242117063
set_robot_commands_median0.002011552242117063
set_robot_commands_min0.002011552242117063
sim_compute_performance-ego0_max0.001734173168846213
sim_compute_performance-ego0_mean0.001734173168846213
sim_compute_performance-ego0_median0.001734173168846213
sim_compute_performance-ego0_min0.001734173168846213
sim_compute_sim_state_max0.008170180475582786
sim_compute_sim_state_mean0.008170180475582786
sim_compute_sim_state_median0.008170180475582786
sim_compute_sim_state_min0.008170180475582786
sim_render-ego0_max0.003338595413347764
sim_render-ego0_mean0.003338595413347764
sim_render-ego0_median0.003338595413347764
sim_render-ego0_min0.003338595413347764
simulation-passed1
step_physics_max0.06964233912198768
step_physics_mean0.06964233912198768
step_physics_median0.06964233912198768
step_physics_min0.06964233912198768
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7740215599riccardo maggionitemplate-randomaido-hello-sim-validation370successyesnogpu-production-b-spot-0-070:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.010096864266829058
agent_compute-ego0_mean0.010096864266829058
agent_compute-ego0_median0.010096864266829058
agent_compute-ego0_min0.010096864266829058
complete-iteration_max0.11435836011713202
complete-iteration_mean0.11435836011713202
complete-iteration_median0.11435836011713202
complete-iteration_min0.11435836011713202
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.003991587595506148
get_duckie_state_mean0.003991587595506148
get_duckie_state_median0.003991587595506148
get_duckie_state_min0.003991587595506148
get_robot_state_max0.0033151073889298873
get_robot_state_mean0.0033151073889298873
get_robot_state_median0.0033151073889298873
get_robot_state_min0.0033151073889298873
get_state_dump_max0.004710164937106046
get_state_dump_mean0.004710164937106046
get_state_dump_median0.004710164937106046
get_state_dump_min0.004710164937106046
get_ui_image_max0.02209702946922996
get_ui_image_mean0.02209702946922996
get_ui_image_median0.02209702946922996
get_ui_image_min0.02209702946922996
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02209702946922996, "step_physics": 0.05886345559900457, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.004710164937106046, "get_robot_state": 0.0033151073889298873, "sim_render-ego0": 0.0033285997130654073, "get_duckie_state": 0.003991587595506148, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.010096864266829058, "complete-iteration": 0.11435836011713202, "set_robot_commands": 0.0018594210798090155, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004307172515175559, "sim_compute_performance-ego0": 0.0017105178399519486}}
set_robot_commands_max0.0018594210798090155
set_robot_commands_mean0.0018594210798090155
set_robot_commands_median0.0018594210798090155
set_robot_commands_min0.0018594210798090155
sim_compute_performance-ego0_max0.0017105178399519486
sim_compute_performance-ego0_mean0.0017105178399519486
sim_compute_performance-ego0_median0.0017105178399519486
sim_compute_performance-ego0_min0.0017105178399519486
sim_compute_sim_state_max0.004307172515175559
sim_compute_sim_state_mean0.004307172515175559
sim_compute_sim_state_median0.004307172515175559
sim_compute_sim_state_min0.004307172515175559
sim_render-ego0_max0.0033285997130654073
sim_render-ego0_mean0.0033285997130654073
sim_render-ego0_median0.0033285997130654073
sim_render-ego0_min0.0033285997130654073
simulation-passed1
step_physics_max0.05886345559900457
step_physics_mean0.05886345559900457
step_physics_median0.05886345559900457
step_physics_min0.05886345559900457
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7740015599riccardo maggionitemplate-randomaido-hello-sim-validation370successyesnogpu-production-b-spot-0-070:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.009975980628620497
agent_compute-ego0_mean0.009975980628620497
agent_compute-ego0_median0.009975980628620497
agent_compute-ego0_min0.009975980628620497
complete-iteration_max0.11391095139763573
complete-iteration_mean0.11391095139763573
complete-iteration_median0.11391095139763573
complete-iteration_min0.11391095139763573
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.003883123397827149
get_duckie_state_mean0.003883123397827149
get_duckie_state_median0.003883123397827149
get_duckie_state_min0.003883123397827149
get_robot_state_max0.0032441453500227494
get_robot_state_mean0.0032441453500227494
get_robot_state_median0.0032441453500227494
get_robot_state_min0.0032441453500227494
get_state_dump_max0.004666041244160046
get_state_dump_mean0.004666041244160046
get_state_dump_median0.004666041244160046
get_state_dump_min0.004666041244160046
get_ui_image_max0.022312630306590687
get_ui_image_mean0.022312630306590687
get_ui_image_median0.022312630306590687
get_ui_image_min0.022312630306590687
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.022312630306590687, "step_physics": 0.05853203751824119, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.004666041244160046, "get_robot_state": 0.0032441453500227494, "sim_render-ego0": 0.00338092717257413, "get_duckie_state": 0.003883123397827149, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.009975980628620497, "complete-iteration": 0.11391095139763573, "set_robot_commands": 0.0018546147779984908, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004255256869576194, "sim_compute_performance-ego0": 0.0017229210246693003}}
set_robot_commands_max0.0018546147779984908
set_robot_commands_mean0.0018546147779984908
set_robot_commands_median0.0018546147779984908
set_robot_commands_min0.0018546147779984908
sim_compute_performance-ego0_max0.0017229210246693003
sim_compute_performance-ego0_mean0.0017229210246693003
sim_compute_performance-ego0_median0.0017229210246693003
sim_compute_performance-ego0_min0.0017229210246693003
sim_compute_sim_state_max0.004255256869576194
sim_compute_sim_state_mean0.004255256869576194
sim_compute_sim_state_median0.004255256869576194
sim_compute_sim_state_min0.004255256869576194
sim_render-ego0_max0.00338092717257413
sim_render-ego0_mean0.00338092717257413
sim_render-ego0_median0.00338092717257413
sim_render-ego0_min0.00338092717257413
simulation-passed1
step_physics_max0.05853203751824119
step_physics_mean0.05853203751824119
step_physics_median0.05853203751824119
step_physics_min0.05853203751824119
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7739315596Liam Paull 🇨🇦objdet exercisemooc-objdetsimsuccessnonogpu-production-b-spot-0-070:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median35.449999999999754
driven_lanedir_consec_median4.809320304789006


other stats
agent_compute-ego0_max0.016776305739231372
agent_compute-ego0_mean0.01653808443584248
agent_compute-ego0_median0.01653808443584248
agent_compute-ego0_min0.016299863132453594
complete-iteration_max0.2062126958425144
complete-iteration_mean0.19957874110609705
complete-iteration_median0.19957874110609705
complete-iteration_min0.19294478636967968
deviation-center-line_max0.5107174537181925
deviation-center-line_mean0.41531492549180815
deviation-center-line_median0.41531492549180815
deviation-center-line_min0.3199123972654238
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.7379453802119595
distance-from-start_mean4.809224238396528
distance-from-start_median4.809224238396528
distance-from-start_min2.880503096581096
driven_any_max6.7379453802119595
driven_any_mean4.809224238396528
driven_any_median4.809224238396528
driven_any_min2.880503096581096
driven_lanedir_consec_max6.738098371751361
driven_lanedir_consec_mean4.809320304789006
driven_lanedir_consec_min2.880542237826651
driven_lanedir_max6.738098371751361
driven_lanedir_mean4.809320304789006
driven_lanedir_median4.809320304789006
driven_lanedir_min2.880542237826651
get_duckie_state_max0.01850363955519716
get_duckie_state_mean0.017872704810267863
get_duckie_state_median0.017872704810267863
get_duckie_state_min0.017241770065338568
get_robot_state_max0.003246591387805851
get_robot_state_mean0.003165726918818776
get_robot_state_median0.003165726918818776
get_robot_state_min0.0030848624498317012
get_state_dump_max0.006885568667117352
get_state_dump_mean0.006763150659091848
get_state_dump_median0.006763150659091848
get_state_dump_min0.006640732651066345
get_ui_image_max0.052737088796729864
get_ui_image_mean0.05272933594518459
get_ui_image_median0.05272933594518459
get_ui_image_min0.05272158309363932
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.7379453802119595, "get_ui_image": 0.05272158309363932, "step_physics": 0.06744017393061888, "survival_time": 49.24999999999934, "driven_lanedir": 6.738098371751361, "get_state_dump": 0.006640732651066345, "get_robot_state": 0.0030848624498317012, "sim_render-ego0": 0.0030587938204256564, "get_duckie_state": 0.017241770065338568, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.016299863132453594, "complete-iteration": 0.19294478636967968, "set_robot_commands": 0.001798910736795855, "distance-from-start": 6.7379453802119595, "deviation-center-line": 0.3199123972654238, "driven_lanedir_consec": 6.738098371751361, "sim_compute_sim_state": 0.02298239786291219, "sim_compute_performance-ego0": 0.0015970267823936972}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.880503096581096, "get_ui_image": 0.052737088796729864, "step_physics": 0.07283965178898402, "survival_time": 21.650000000000173, "driven_lanedir": 2.880542237826651, "get_state_dump": 0.006885568667117352, "get_robot_state": 0.003246591387805851, "sim_render-ego0": 0.003279651364972514, "get_duckie_state": 0.01850363955519716, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.016776305739231372, "complete-iteration": 0.2062126958425144, "set_robot_commands": 0.0019166277300926944, "distance-from-start": 2.880503096581096, "deviation-center-line": 0.5107174537181925, "driven_lanedir_consec": 2.880542237826651, "sim_compute_sim_state": 0.02819157580626176, "sim_compute_performance-ego0": 0.001746607815615043}}
set_robot_commands_max0.0019166277300926944
set_robot_commands_mean0.0018577692334442748
set_robot_commands_median0.0018577692334442748
set_robot_commands_min0.001798910736795855
sim_compute_performance-ego0_max0.001746607815615043
sim_compute_performance-ego0_mean0.0016718172990043702
sim_compute_performance-ego0_median0.0016718172990043702
sim_compute_performance-ego0_min0.0015970267823936972
sim_compute_sim_state_max0.02819157580626176
sim_compute_sim_state_mean0.025586986834586975
sim_compute_sim_state_median0.025586986834586975
sim_compute_sim_state_min0.02298239786291219
sim_render-ego0_max0.003279651364972514
sim_render-ego0_mean0.0031692225926990853
sim_render-ego0_median0.0031692225926990853
sim_render-ego0_min0.0030587938204256564
simulation-passed1
step_physics_max0.07283965178898402
step_physics_mean0.07013991285980145
step_physics_median0.07013991285980145
step_physics_min0.06744017393061888
survival_time_max49.24999999999934
survival_time_mean35.449999999999754
survival_time_min21.650000000000173
No reset possible
7739115593Roberto Bochettemplate-randomaido-hello-sim-validation370successyesnogpu-production-b-spot-0-070:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.010051282969388094
agent_compute-ego0_mean0.010051282969388094
agent_compute-ego0_median0.010051282969388094
agent_compute-ego0_min0.010051282969388094
complete-iteration_max0.1132579283280806
complete-iteration_mean0.1132579283280806
complete-iteration_median0.1132579283280806
complete-iteration_min0.1132579283280806
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.0038783062588084822
get_duckie_state_mean0.0038783062588084822
get_duckie_state_median0.0038783062588084822
get_duckie_state_min0.0038783062588084822
get_robot_state_max0.003190739588303999
get_robot_state_mean0.003190739588303999
get_robot_state_median0.003190739588303999
get_robot_state_min0.003190739588303999
get_state_dump_max0.004630847410722213
get_state_dump_mean0.004630847410722213
get_state_dump_median0.004630847410722213
get_state_dump_min0.004630847410722213
get_ui_image_max0.02207207679748535
get_ui_image_mean0.02207207679748535
get_ui_image_median0.02207207679748535
get_ui_image_min0.02207207679748535
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02207207679748535, "step_physics": 0.058148763396523216, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.004630847410722213, "get_robot_state": 0.003190739588303999, "sim_render-ego0": 0.003369607708670876, "get_duckie_state": 0.0038783062588084822, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.010051282969388094, "complete-iteration": 0.1132579283280806, "set_robot_commands": 0.0018526532433249731, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004252049055966464, "sim_compute_performance-ego0": 0.0017359040000221946}}
set_robot_commands_max0.0018526532433249731
set_robot_commands_mean0.0018526532433249731
set_robot_commands_median0.0018526532433249731
set_robot_commands_min0.0018526532433249731
sim_compute_performance-ego0_max0.0017359040000221946
sim_compute_performance-ego0_mean0.0017359040000221946
sim_compute_performance-ego0_median0.0017359040000221946
sim_compute_performance-ego0_min0.0017359040000221946
sim_compute_sim_state_max0.004252049055966464
sim_compute_sim_state_mean0.004252049055966464
sim_compute_sim_state_median0.004252049055966464
sim_compute_sim_state_min0.004252049055966464
sim_render-ego0_max0.003369607708670876
sim_render-ego0_mean0.003369607708670876
sim_render-ego0_median0.003369607708670876
sim_render-ego0_min0.003369607708670876
simulation-passed1
step_physics_max0.058148763396523216
step_physics_mean0.058148763396523216
step_physics_median0.058148763396523216
step_physics_min0.058148763396523216
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7739015593Roberto Bochettemplate-randomaido-hello-sim-validation370successyesnogpu-production-b-spot-0-070:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.009993385184894907
agent_compute-ego0_mean0.009993385184894907
agent_compute-ego0_median0.009993385184894907
agent_compute-ego0_min0.009993385184894907
complete-iteration_max0.11477285623550416
complete-iteration_mean0.11477285623550416
complete-iteration_median0.11477285623550416
complete-iteration_min0.11477285623550416
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.003876848654313521
get_duckie_state_mean0.003876848654313521
get_duckie_state_median0.003876848654313521
get_duckie_state_min0.003876848654313521
get_robot_state_max0.0032194419340653853
get_robot_state_mean0.0032194419340653853
get_robot_state_median0.0032194419340653853
get_robot_state_min0.0032194419340653853
get_state_dump_max0.0046943805434487085
get_state_dump_mean0.0046943805434487085
get_state_dump_median0.0046943805434487085
get_state_dump_min0.0046943805434487085
get_ui_image_max0.023289517922834915
get_ui_image_mean0.023289517922834915
get_ui_image_median0.023289517922834915
get_ui_image_min0.023289517922834915
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.023289517922834915, "step_physics": 0.05852538347244263, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.0046943805434487085, "get_robot_state": 0.0032194419340653853, "sim_render-ego0": 0.003309000622142445, "get_duckie_state": 0.003876848654313521, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.009993385184894907, "complete-iteration": 0.11477285623550416, "set_robot_commands": 0.0018401958725669167, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004253159869800915, "sim_compute_performance-ego0": 0.001694765957919034}}
set_robot_commands_max0.0018401958725669167
set_robot_commands_mean0.0018401958725669167
set_robot_commands_median0.0018401958725669167
set_robot_commands_min0.0018401958725669167
sim_compute_performance-ego0_max0.001694765957919034
sim_compute_performance-ego0_mean0.001694765957919034
sim_compute_performance-ego0_median0.001694765957919034
sim_compute_performance-ego0_min0.001694765957919034
sim_compute_sim_state_max0.004253159869800915
sim_compute_sim_state_mean0.004253159869800915
sim_compute_sim_state_median0.004253159869800915
sim_compute_sim_state_min0.004253159869800915
sim_render-ego0_max0.003309000622142445
sim_render-ego0_mean0.003309000622142445
sim_render-ego0_median0.003309000622142445
sim_render-ego0_min0.003309000622142445
simulation-passed1
step_physics_max0.05852538347244263
step_physics_mean0.05852538347244263
step_physics_median0.05852538347244263
step_physics_min0.05852538347244263
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7738715592Sampsa RantaFly! Z! Fly! Flappity flap...mooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:15:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median0.6112059456392942
driven_lanedir_consec_median6.2306830352329765
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.01459047836030552
agent_compute-ego0_mean0.014534859434948873
agent_compute-ego0_median0.014534859434948873
agent_compute-ego0_min0.014479240509592229
complete-iteration_max0.1324931902254154
complete-iteration_mean0.12927628188804227
complete-iteration_median0.12927628188804227
complete-iteration_min0.12605937355066915
deviation-center-line_max0.9260442966693292
deviation-center-line_mean0.6112059456392942
deviation-center-line_min0.2963675946092592
deviation-heading_max4.068517777666936
deviation-heading_mean2.9937260184054626
deviation-heading_median2.9937260184054626
deviation-heading_min1.9189342591439893
distance-from-start_max1.595125061617498
distance-from-start_mean1.3620110769572509
distance-from-start_median1.3620110769572509
distance-from-start_min1.128897092297004
driven_any_max6.248349365924925
driven_any_mean6.245754876578557
driven_any_median6.245754876578557
driven_any_min6.243160387232188
driven_lanedir_consec_max6.2417512476384385
driven_lanedir_consec_mean6.2306830352329765
driven_lanedir_consec_min6.219614822827514
driven_lanedir_max6.2417512476384385
driven_lanedir_mean6.2306830352329765
driven_lanedir_median6.2306830352329765
driven_lanedir_min6.219614822827514
get_duckie_state_max1.6147349895188254e-06
get_duckie_state_mean1.5635176761064997e-06
get_duckie_state_median1.5635176761064997e-06
get_duckie_state_min1.5123003626941742e-06
get_robot_state_max0.003390915884165641
get_robot_state_mean0.0033477727419927057
get_robot_state_median0.0033477727419927057
get_robot_state_min0.003304629599819771
get_state_dump_max0.004329387393224051
get_state_dump_mean0.0042123134487574545
get_state_dump_median0.0042123134487574545
get_state_dump_min0.004095239504290858
get_ui_image_max0.0388534875039157
get_ui_image_mean0.03798198699951172
get_ui_image_median0.03798198699951172
get_ui_image_min0.03711048649510774
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.248349365924925, "get_ui_image": 0.0388534875039157, "step_physics": 0.05967677681769658, "survival_time": 59.99999999999873, "driven_lanedir": 6.2417512476384385, "get_state_dump": 0.004329387393224051, "get_robot_state": 0.003390915884165641, "sim_render-ego0": 0.0034248495379852117, "get_duckie_state": 1.6147349895188254e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9189342591439893, "agent_compute-ego0": 0.01459047836030552, "complete-iteration": 0.1324931902254154, "set_robot_commands": 0.002437941736226078, "distance-from-start": 1.128897092297004, "deviation-center-line": 0.2963675946092592, "driven_lanedir_consec": 6.2417512476384385, "sim_compute_sim_state": 0.0037347962715345855, "sim_compute_performance-ego0": 0.00195587683875396}, "LF-small-loop-001-ego0": {"driven_any": 6.243160387232188, "get_ui_image": 0.03711048649510774, "step_physics": 0.05567138538471765, "survival_time": 59.99999999999873, "driven_lanedir": 6.219614822827514, "get_state_dump": 0.004095239504290858, "get_robot_state": 0.003304629599819771, "sim_render-ego0": 0.003321841197843655, "get_duckie_state": 1.5123003626941742e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.068517777666936, "agent_compute-ego0": 0.014479240509592229, "complete-iteration": 0.12605937355066915, "set_robot_commands": 0.0024646869011465257, "distance-from-start": 1.595125061617498, "deviation-center-line": 0.9260442966693292, "driven_lanedir_consec": 6.219614822827514, "sim_compute_sim_state": 0.0036550826772265782, "sim_compute_performance-ego0": 0.0018631427313862592}}
set_robot_commands_max0.0024646869011465257
set_robot_commands_mean0.0024513143186863018
set_robot_commands_median0.0024513143186863018
set_robot_commands_min0.002437941736226078
sim_compute_performance-ego0_max0.00195587683875396
sim_compute_performance-ego0_mean0.0019095097850701096
sim_compute_performance-ego0_median0.0019095097850701096
sim_compute_performance-ego0_min0.0018631427313862592
sim_compute_sim_state_max0.0037347962715345855
sim_compute_sim_state_mean0.003694939474380582
sim_compute_sim_state_median0.003694939474380582
sim_compute_sim_state_min0.0036550826772265782
sim_render-ego0_max0.0034248495379852117
sim_render-ego0_mean0.003373345367914433
sim_render-ego0_median0.003373345367914433
sim_render-ego0_min0.003321841197843655
simulation-passed1
step_physics_max0.05967677681769658
step_physics_mean0.057674081101207114
step_physics_median0.057674081101207114
step_physics_min0.05567138538471765
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7738215591Matt Giovanettiexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-070:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.560850023424454


other stats
agent_compute-ego0_max0.010595948001236396
agent_compute-ego0_mean0.010595948001236396
agent_compute-ego0_median0.010595948001236396
agent_compute-ego0_min0.010595948001236396
complete-iteration_max0.2530367554579446
complete-iteration_mean0.2530367554579446
complete-iteration_median0.2530367554579446
complete-iteration_min0.2530367554579446
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.560850023424454
distance-from-start_median4.560850023424454
distance-from-start_min4.560850023424454
driven_any_max4.912193290947155
driven_any_mean4.912193290947155
driven_any_median4.912193290947155
driven_any_min4.912193290947155
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09203896274510497
get_duckie_state_mean0.09203896274510497
get_duckie_state_median0.09203896274510497
get_duckie_state_min0.09203896274510497
get_robot_state_max0.0035211703026259613
get_robot_state_mean0.0035211703026259613
get_robot_state_median0.0035211703026259613
get_robot_state_min0.0035211703026259613
get_state_dump_max0.01839537709454208
get_state_dump_mean0.01839537709454208
get_state_dump_median0.01839537709454208
get_state_dump_min0.01839537709454208
get_ui_image_max0.037534564236312434
get_ui_image_mean0.037534564236312434
get_ui_image_median0.037534564236312434
get_ui_image_min0.037534564236312434
in-drivable-lane_max50.899999999999245
in-drivable-lane_mean50.899999999999245
in-drivable-lane_median50.899999999999245
in-drivable-lane_min50.899999999999245
per-episodes
details{"d50-ego0": {"driven_any": 4.912193290947155, "get_ui_image": 0.037534564236312434, "step_physics": 0.07417377382078161, "survival_time": 50.899999999999245, "driven_lanedir": 0.0, "get_state_dump": 0.01839537709454208, "get_robot_state": 0.0035211703026259613, "sim_render-ego0": 0.0033122278874240982, "get_duckie_state": 0.09203896274510497, "in-drivable-lane": 50.899999999999245, "deviation-heading": 0.0, "agent_compute-ego0": 0.010595948001236396, "complete-iteration": 0.2530367554579446, "set_robot_commands": 0.0020369999074140404, "distance-from-start": 4.560850023424454, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009595389455059677, "sim_compute_performance-ego0": 0.0017408515099103365}}
set_robot_commands_max0.0020369999074140404
set_robot_commands_mean0.0020369999074140404
set_robot_commands_median0.0020369999074140404
set_robot_commands_min0.0020369999074140404
sim_compute_performance-ego0_max0.0017408515099103365
sim_compute_performance-ego0_mean0.0017408515099103365
sim_compute_performance-ego0_median0.0017408515099103365
sim_compute_performance-ego0_min0.0017408515099103365
sim_compute_sim_state_max0.009595389455059677
sim_compute_sim_state_mean0.009595389455059677
sim_compute_sim_state_median0.009595389455059677
sim_compute_sim_state_min0.009595389455059677
sim_render-ego0_max0.0033122278874240982
sim_render-ego0_mean0.0033122278874240982
sim_render-ego0_median0.0033122278874240982
sim_render-ego0_min0.0033122278874240982
simulation-passed1
step_physics_max0.07417377382078161
step_physics_mean0.07417377382078161
step_physics_median0.07417377382078161
step_physics_min0.07417377382078161
survival_time_max50.899999999999245
survival_time_mean50.899999999999245
survival_time_median50.899999999999245
survival_time_min50.899999999999245
No reset possible
7737915589Andrea Censi 🇨🇭objdet exercisemooc-objdetsimsuccessnonogpu-production-b-spot-0-070:06:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.250000000000124
driven_lanedir_consec_median4.81066756257857


other stats
agent_compute-ego0_max0.016942907843673437
agent_compute-ego0_mean0.01645252768357993
agent_compute-ego0_median0.01645252768357993
agent_compute-ego0_min0.015962147523486424
complete-iteration_max0.2232068662057843
complete-iteration_mean0.2146693666029096
complete-iteration_median0.2146693666029096
complete-iteration_min0.20613186700003489
deviation-center-line_max0.26774333024025004
deviation-center-line_mean0.21555488127470093
deviation-center-line_median0.21555488127470093
deviation-center-line_min0.16336643230915182
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.739343004227582
distance-from-start_mean4.810621862412031
distance-from-start_median4.810621862412031
distance-from-start_min2.8819007205964793
driven_any_max6.739343004227582
driven_any_mean4.810621862412031
driven_any_median4.810621862412031
driven_any_min2.8819007205964793
driven_lanedir_consec_max6.739416256114824
driven_lanedir_consec_mean4.81066756257857
driven_lanedir_consec_min2.8819188690423156
driven_lanedir_max6.739416256114824
driven_lanedir_mean4.81066756257857
driven_lanedir_median4.81066756257857
driven_lanedir_min2.8819188690423156
get_duckie_state_max0.018481097723308363
get_duckie_state_mean0.018007099728038538
get_duckie_state_median0.018007099728038538
get_duckie_state_min0.01753310173276871
get_robot_state_max0.003254705353787071
get_robot_state_mean0.0031751750804228695
get_robot_state_median0.0031751750804228695
get_robot_state_min0.0030956448070586676
get_state_dump_max0.007168059809166088
get_state_dump_mean0.006854975046768921
get_state_dump_median0.006854975046768921
get_state_dump_min0.006541890284371754
get_ui_image_max0.05573149835854246
get_ui_image_mean0.05472711382205026
get_ui_image_median0.05472711382205026
get_ui_image_min0.05372272928555807
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.739343004227582, "get_ui_image": 0.05372272928555807, "step_physics": 0.08038731463371761, "survival_time": 25.150000000000222, "driven_lanedir": 6.739416256114824, "get_state_dump": 0.006541890284371754, "get_robot_state": 0.0030956448070586676, "sim_render-ego0": 0.0031051853346446205, "get_duckie_state": 0.01753310173276871, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.015962147523486424, "complete-iteration": 0.20613186700003489, "set_robot_commands": 0.0018368377572014216, "distance-from-start": 6.739343004227582, "deviation-center-line": 0.16336643230915182, "driven_lanedir_consec": 6.739416256114824, "sim_compute_sim_state": 0.022245576457371782, "sim_compute_performance-ego0": 0.0016199733529772078}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.8819007205964793, "get_ui_image": 0.05573149835854246, "step_physics": 0.08737992717508684, "survival_time": 11.350000000000026, "driven_lanedir": 2.8819188690423156, "get_state_dump": 0.007168059809166088, "get_robot_state": 0.003254705353787071, "sim_render-ego0": 0.003297806831828335, "get_duckie_state": 0.018481097723308363, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.016942907843673437, "complete-iteration": 0.2232068662057843, "set_robot_commands": 0.0019278202140540408, "distance-from-start": 2.8819007205964793, "deviation-center-line": 0.26774333024025004, "driven_lanedir_consec": 2.8819188690423156, "sim_compute_sim_state": 0.027148350288993435, "sim_compute_performance-ego0": 0.0017872327252438194}}
set_robot_commands_max0.0019278202140540408
set_robot_commands_mean0.0018823289856277313
set_robot_commands_median0.0018823289856277313
set_robot_commands_min0.0018368377572014216
sim_compute_performance-ego0_max0.0017872327252438194
sim_compute_performance-ego0_mean0.0017036030391105136
sim_compute_performance-ego0_median0.0017036030391105136
sim_compute_performance-ego0_min0.0016199733529772078
sim_compute_sim_state_max0.027148350288993435
sim_compute_sim_state_mean0.024696963373182612
sim_compute_sim_state_median0.024696963373182612
sim_compute_sim_state_min0.022245576457371782
sim_render-ego0_max0.003297806831828335
sim_render-ego0_mean0.0032014960832364775
sim_render-ego0_median0.0032014960832364775
sim_render-ego0_min0.0031051853346446205
simulation-passed1
step_physics_max0.08737992717508684
step_physics_mean0.08388362090440223
step_physics_median0.08388362090440223
step_physics_min0.08038731463371761
survival_time_max25.150000000000222
survival_time_mean18.250000000000124
survival_time_min11.350000000000026
No reset possible
7735615585Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validationsim-0of4host-errornonogpu-production-b-spot-0-070:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7735415585Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validationsim-0of4host-errornonogpu-production-b-spot-0-070:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7734815585Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validationsim-2of4host-errornonogpu-production-b-spot-0-070:00:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7734315584Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validationsim-0of4failednonogpu-production-b-spot-0-070:02:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7733113798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesnogpu-production-b-spot-0-070:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7732913798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesnogpu-production-b-spot-0-070:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7732813798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesnogpu-production-b-spot-0-070:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7727215580Ryan Arya Pratamaexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-070:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.1411592592725155


other stats
agent_compute-ego0_max0.010492636897383284
agent_compute-ego0_mean0.010492636897383284
agent_compute-ego0_median0.010492636897383284
agent_compute-ego0_min0.010492636897383284
complete-iteration_max0.2275194538125984
complete-iteration_mean0.2275194538125984
complete-iteration_median0.2275194538125984
complete-iteration_min0.2275194538125984
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.1411592592725155
distance-from-start_median4.1411592592725155
distance-from-start_min4.1411592592725155
driven_any_max4.251263237869177
driven_any_mean4.251263237869177
driven_any_median4.251263237869177
driven_any_min4.251263237869177
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07403046125972598
get_duckie_state_mean0.07403046125972598
get_duckie_state_median0.07403046125972598
get_duckie_state_min0.07403046125972598
get_robot_state_max0.003446510094190815
get_robot_state_mean0.003446510094190815
get_robot_state_median0.003446510094190815
get_robot_state_min0.003446510094190815
get_state_dump_max0.015595704292278306
get_state_dump_mean0.015595704292278306
get_state_dump_median0.015595704292278306
get_state_dump_min0.015595704292278306
get_ui_image_max0.039030494737585415
get_ui_image_mean0.039030494737585415
get_ui_image_median0.039030494737585415
get_ui_image_min0.039030494737585415
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 4.251263237869177, "get_ui_image": 0.039030494737585415, "step_physics": 0.06961326039303947, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.015595704292278306, "get_robot_state": 0.003446510094190815, "sim_render-ego0": 0.003328015067793745, "get_duckie_state": 0.07403046125972598, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010492636897383284, "complete-iteration": 0.2275194538125984, "set_robot_commands": 0.0020464596204416243, "distance-from-start": 4.1411592592725155, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008106074464211951, "sim_compute_performance-ego0": 0.001735249725011465}}
set_robot_commands_max0.0020464596204416243
set_robot_commands_mean0.0020464596204416243
set_robot_commands_median0.0020464596204416243
set_robot_commands_min0.0020464596204416243
sim_compute_performance-ego0_max0.001735249725011465
sim_compute_performance-ego0_mean0.001735249725011465
sim_compute_performance-ego0_median0.001735249725011465
sim_compute_performance-ego0_min0.001735249725011465
sim_compute_sim_state_max0.008106074464211951
sim_compute_sim_state_mean0.008106074464211951
sim_compute_sim_state_median0.008106074464211951
sim_compute_sim_state_min0.008106074464211951
sim_render-ego0_max0.003328015067793745
sim_render-ego0_mean0.003328015067793745
sim_render-ego0_median0.003328015067793745
sim_render-ego0_min0.003328015067793745
simulation-passed1
step_physics_max0.06961326039303947
step_physics_mean0.06961326039303947
step_physics_median0.06961326039303947
step_physics_min0.06961326039303947
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7724415531Steve Novotnyexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-070:06:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.802764369443719


other stats
agent_compute-ego0_max0.01070070810766028
agent_compute-ego0_mean0.01070070810766028
agent_compute-ego0_median0.01070070810766028
agent_compute-ego0_min0.01070070810766028
complete-iteration_max0.2441748919903032
complete-iteration_mean0.2441748919903032
complete-iteration_median0.2441748919903032
complete-iteration_min0.2441748919903032
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.802764369443719
distance-from-start_median2.802764369443719
distance-from-start_min2.802764369443719
driven_any_max3.032040043019069
driven_any_mean3.032040043019069
driven_any_median3.032040043019069
driven_any_min3.032040043019069
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08218513783192474
get_duckie_state_mean0.08218513783192474
get_duckie_state_median0.08218513783192474
get_duckie_state_min0.08218513783192474
get_robot_state_max0.003560416010402193
get_robot_state_mean0.003560416010402193
get_robot_state_median0.003560416010402193
get_robot_state_min0.003560416010402193
get_state_dump_max0.017105867078640317
get_state_dump_mean0.017105867078640317
get_state_dump_median0.017105867078640317
get_state_dump_min0.017105867078640317
get_ui_image_max0.04038458766553226
get_ui_image_mean0.04038458766553226
get_ui_image_median0.04038458766553226
get_ui_image_min0.04038458766553226
in-drivable-lane_max37.200000000000024
in-drivable-lane_mean37.200000000000024
in-drivable-lane_median37.200000000000024
in-drivable-lane_min37.200000000000024
per-episodes
details{"d45-ego0": {"driven_any": 3.032040043019069, "get_ui_image": 0.04038458766553226, "step_physics": 0.07452409219421796, "survival_time": 37.200000000000024, "driven_lanedir": 0.0, "get_state_dump": 0.017105867078640317, "get_robot_state": 0.003560416010402193, "sim_render-ego0": 0.003354398676213002, "get_duckie_state": 0.08218513783192474, "in-drivable-lane": 37.200000000000024, "deviation-heading": 0.0, "agent_compute-ego0": 0.01070070810766028, "complete-iteration": 0.2441748919903032, "set_robot_commands": 0.002052329530651937, "distance-from-start": 2.802764369443719, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008435660880684053, "sim_compute_performance-ego0": 0.0017720894525515153}}
set_robot_commands_max0.002052329530651937
set_robot_commands_mean0.002052329530651937
set_robot_commands_median0.002052329530651937
set_robot_commands_min0.002052329530651937
sim_compute_performance-ego0_max0.0017720894525515153
sim_compute_performance-ego0_mean0.0017720894525515153
sim_compute_performance-ego0_median0.0017720894525515153
sim_compute_performance-ego0_min0.0017720894525515153
sim_compute_sim_state_max0.008435660880684053
sim_compute_sim_state_mean0.008435660880684053
sim_compute_sim_state_median0.008435660880684053
sim_compute_sim_state_min0.008435660880684053
sim_render-ego0_max0.003354398676213002
sim_render-ego0_mean0.003354398676213002
sim_render-ego0_median0.003354398676213002
sim_render-ego0_min0.003354398676213002
simulation-passed1
step_physics_max0.07452409219421796
step_physics_mean0.07452409219421796
step_physics_median0.07452409219421796
step_physics_min0.07452409219421796
survival_time_max37.200000000000024
survival_time_mean37.200000000000024
survival_time_median37.200000000000024
survival_time_min37.200000000000024
No reset possible
7723215534Nicola Carrinoexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-070:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.335635261966952


other stats
agent_compute-ego0_max0.011190017737911246
agent_compute-ego0_mean0.011190017737911246
agent_compute-ego0_median0.011190017737911246
agent_compute-ego0_min0.011190017737911246
complete-iteration_max0.29018322626749676
complete-iteration_mean0.29018322626749676
complete-iteration_median0.29018322626749676
complete-iteration_min0.29018322626749676
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.335635261966952
distance-from-start_median5.335635261966952
distance-from-start_min5.335635261966952
driven_any_max5.559594907130829
driven_any_mean5.559594907130829
driven_any_median5.559594907130829
driven_any_min5.559594907130829
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10508582551600568
get_duckie_state_mean0.10508582551600568
get_duckie_state_median0.10508582551600568
get_duckie_state_min0.10508582551600568
get_robot_state_max0.00400896665066649
get_robot_state_mean0.00400896665066649
get_robot_state_median0.00400896665066649
get_robot_state_min0.00400896665066649
get_state_dump_max0.02001225140135167
get_state_dump_mean0.02001225140135167
get_state_dump_median0.02001225140135167
get_state_dump_min0.02001225140135167
get_ui_image_max0.04530568042043912
get_ui_image_mean0.04530568042043912
get_ui_image_median0.04530568042043912
get_ui_image_min0.04530568042043912
in-drivable-lane_max17.650000000000116
in-drivable-lane_mean17.650000000000116
in-drivable-lane_median17.650000000000116
in-drivable-lane_min17.650000000000116
per-episodes
details{"d50-ego0": {"driven_any": 5.559594907130829, "get_ui_image": 0.04530568042043912, "step_physics": 0.08866152251507603, "survival_time": 17.650000000000116, "driven_lanedir": 0.0, "get_state_dump": 0.02001225140135167, "get_robot_state": 0.00400896665066649, "sim_render-ego0": 0.003663298773900264, "get_duckie_state": 0.10508582551600568, "in-drivable-lane": 17.650000000000116, "deviation-heading": 0.0, "agent_compute-ego0": 0.011190017737911246, "complete-iteration": 0.29018322626749676, "set_robot_commands": 0.0022023296625600696, "distance-from-start": 5.335635261966952, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007956510883266642, "sim_compute_performance-ego0": 0.0019917319723441775}}
set_robot_commands_max0.0022023296625600696
set_robot_commands_mean0.0022023296625600696
set_robot_commands_median0.0022023296625600696
set_robot_commands_min0.0022023296625600696
sim_compute_performance-ego0_max0.0019917319723441775
sim_compute_performance-ego0_mean0.0019917319723441775
sim_compute_performance-ego0_median0.0019917319723441775
sim_compute_performance-ego0_min0.0019917319723441775
sim_compute_sim_state_max0.007956510883266642
sim_compute_sim_state_mean0.007956510883266642
sim_compute_sim_state_median0.007956510883266642
sim_compute_sim_state_min0.007956510883266642
sim_render-ego0_max0.003663298773900264
sim_render-ego0_mean0.003663298773900264
sim_render-ego0_median0.003663298773900264
sim_render-ego0_min0.003663298773900264
simulation-passed1
step_physics_max0.08866152251507603
step_physics_mean0.08866152251507603
step_physics_median0.08866152251507603
step_physics_min0.08866152251507603
survival_time_max17.650000000000116
survival_time_mean17.650000000000116
survival_time_median17.650000000000116
survival_time_min17.650000000000116
No reset possible
7722015558Adriano Almeidatemplate-randomaido-LF-sim-validationsim-2of4successnonogpu-production-b-spot-0-070:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7066636954531781
survival_time_median8.349999999999984
deviation-center-line_median0.15823532814711416
in-drivable-lane_median6.049999999999985


other stats
agent_compute-ego0_max0.011595443600700014
agent_compute-ego0_mean0.011595443600700014
agent_compute-ego0_median0.011595443600700014
agent_compute-ego0_min0.011595443600700014
complete-iteration_max0.17347955703735352
complete-iteration_mean0.17347955703735352
complete-iteration_median0.17347955703735352
complete-iteration_min0.17347955703735352
deviation-center-line_max0.15823532814711416
deviation-center-line_mean0.15823532814711416
deviation-center-line_min0.15823532814711416
deviation-heading_max0.9829424167176616
deviation-heading_mean0.9829424167176616
deviation-heading_median0.9829424167176616
deviation-heading_min0.9829424167176616
distance-from-start_max3.203726500553977
distance-from-start_mean3.203726500553977
distance-from-start_median3.203726500553977
distance-from-start_min3.203726500553977
driven_any_max3.2533721755241913
driven_any_mean3.2533721755241913
driven_any_median3.2533721755241913
driven_any_min3.2533721755241913
driven_lanedir_consec_max0.7066636954531781
driven_lanedir_consec_mean0.7066636954531781
driven_lanedir_consec_min0.7066636954531781
driven_lanedir_max0.7066636954531781
driven_lanedir_mean0.7066636954531781
driven_lanedir_median0.7066636954531781
driven_lanedir_min0.7066636954531781
get_duckie_state_max2.472173599969773e-06
get_duckie_state_mean2.472173599969773e-06
get_duckie_state_median2.472173599969773e-06
get_duckie_state_min2.472173599969773e-06
get_robot_state_max0.003561371848696754
get_robot_state_mean0.003561371848696754
get_robot_state_median0.003561371848696754
get_robot_state_min0.003561371848696754
get_state_dump_max0.004799287943612961
get_state_dump_mean0.004799287943612961
get_state_dump_median0.004799287943612961
get_state_dump_min0.004799287943612961
get_ui_image_max0.04666363341467721
get_ui_image_mean0.04666363341467721
get_ui_image_median0.04666363341467721
get_ui_image_min0.04666363341467721
in-drivable-lane_max6.049999999999985
in-drivable-lane_mean6.049999999999985
in-drivable-lane_min6.049999999999985
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 3.2533721755241913, "get_ui_image": 0.04666363341467721, "step_physics": 0.08927907404445466, "survival_time": 8.349999999999984, "driven_lanedir": 0.7066636954531781, "get_state_dump": 0.004799287943612961, "get_robot_state": 0.003561371848696754, "sim_render-ego0": 0.003658797059740339, "get_duckie_state": 2.472173599969773e-06, "in-drivable-lane": 6.049999999999985, "deviation-heading": 0.9829424167176616, "agent_compute-ego0": 0.011595443600700014, "complete-iteration": 0.17347955703735352, "set_robot_commands": 0.002163799036116827, "distance-from-start": 3.203726500553977, "deviation-center-line": 0.15823532814711416, "driven_lanedir_consec": 0.7066636954531781, "sim_compute_sim_state": 0.00970834493637085, "sim_compute_performance-ego0": 0.0019521074635641916}}
set_robot_commands_max0.002163799036116827
set_robot_commands_mean0.002163799036116827
set_robot_commands_median0.002163799036116827
set_robot_commands_min0.002163799036116827
sim_compute_performance-ego0_max0.0019521074635641916
sim_compute_performance-ego0_mean0.0019521074635641916
sim_compute_performance-ego0_median0.0019521074635641916
sim_compute_performance-ego0_min0.0019521074635641916
sim_compute_sim_state_max0.00970834493637085
sim_compute_sim_state_mean0.00970834493637085
sim_compute_sim_state_median0.00970834493637085
sim_compute_sim_state_min0.00970834493637085
sim_render-ego0_max0.003658797059740339
sim_render-ego0_mean0.003658797059740339
sim_render-ego0_median0.003658797059740339
sim_render-ego0_min0.003658797059740339
simulation-passed1
step_physics_max0.08927907404445466
step_physics_mean0.08927907404445466
step_physics_median0.08927907404445466
step_physics_min0.08927907404445466
survival_time_max8.349999999999984
survival_time_mean8.349999999999984
survival_time_min8.349999999999984
No reset possible
7721215568Adriano Almeidatemplate-randommooc-BV1sim-0of5successnonogpu-production-b-spot-0-070:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.936659952183887


other stats
agent_compute-ego0_max0.0114238994573456
agent_compute-ego0_mean0.0114238994573456
agent_compute-ego0_median0.0114238994573456
agent_compute-ego0_min0.0114238994573456
complete-iteration_max0.27423348769642947
complete-iteration_mean0.27423348769642947
complete-iteration_median0.27423348769642947
complete-iteration_min0.27423348769642947
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.936659952183887
distance-from-start_median2.936659952183887
distance-from-start_min2.936659952183887
driven_any_max2.951704478527876
driven_any_mean2.951704478527876
driven_any_median2.951704478527876
driven_any_min2.951704478527876
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09881290423324685
get_duckie_state_mean0.09881290423324685
get_duckie_state_median0.09881290423324685
get_duckie_state_min0.09881290423324685
get_robot_state_max0.004031282624388053
get_robot_state_mean0.004031282624388053
get_robot_state_median0.004031282624388053
get_robot_state_min0.004031282624388053
get_state_dump_max0.02038244484296811
get_state_dump_mean0.02038244484296811
get_state_dump_median0.02038244484296811
get_state_dump_min0.02038244484296811
get_ui_image_max0.043524090760673574
get_ui_image_mean0.043524090760673574
get_ui_image_median0.043524090760673574
get_ui_image_min0.043524090760673574
in-drivable-lane_max7.599999999999981
in-drivable-lane_mean7.599999999999981
in-drivable-lane_median7.599999999999981
in-drivable-lane_min7.599999999999981
per-episodes
details{"d45-ego0": {"driven_any": 2.951704478527876, "get_ui_image": 0.043524090760673574, "step_physics": 0.07875844699884552, "survival_time": 7.599999999999981, "driven_lanedir": 0.0, "get_state_dump": 0.02038244484296811, "get_robot_state": 0.004031282624388053, "sim_render-ego0": 0.0035321089177349813, "get_duckie_state": 0.09881290423324685, "in-drivable-lane": 7.599999999999981, "deviation-heading": 0.0, "agent_compute-ego0": 0.0114238994573456, "complete-iteration": 0.27423348769642947, "set_robot_commands": 0.0020308401070389093, "distance-from-start": 2.936659952183887, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009733628603368023, "sim_compute_performance-ego0": 0.0019023605421477673}}
set_robot_commands_max0.0020308401070389093
set_robot_commands_mean0.0020308401070389093
set_robot_commands_median0.0020308401070389093
set_robot_commands_min0.0020308401070389093
sim_compute_performance-ego0_max0.0019023605421477673
sim_compute_performance-ego0_mean0.0019023605421477673
sim_compute_performance-ego0_median0.0019023605421477673
sim_compute_performance-ego0_min0.0019023605421477673
sim_compute_sim_state_max0.009733628603368023
sim_compute_sim_state_mean0.009733628603368023
sim_compute_sim_state_median0.009733628603368023
sim_compute_sim_state_min0.009733628603368023
sim_render-ego0_max0.0035321089177349813
sim_render-ego0_mean0.0035321089177349813
sim_render-ego0_median0.0035321089177349813
sim_render-ego0_min0.0035321089177349813
simulation-passed1
step_physics_max0.07875844699884552
step_physics_mean0.07875844699884552
step_physics_median0.07875844699884552
step_physics_min0.07875844699884552
survival_time_max7.599999999999981
survival_time_mean7.599999999999981
survival_time_median7.599999999999981
survival_time_min7.599999999999981
No reset possible
7718615576Adriano Almeidatemplate-randommooc-modcon-1simsuccessyesnogpu-production-b-spot-0-070:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.0
driven_lanedir_consec_median0.0
in-drivable-lane_median7.825000000000001
survival_time_median7.825000000000001


other stats
agent_compute-ego0_max0.01124738297372494
agent_compute-ego0_mean0.01073317788423609
agent_compute-ego0_median0.01073317788423609
agent_compute-ego0_min0.010218972794747238
complete-iteration_max0.19311124873611163
complete-iteration_mean0.19041054622462117
complete-iteration_median0.19041054622462117
complete-iteration_min0.18770984371313068
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.053958366592028
distance-from-start_mean2.9780867640081863
distance-from-start_median2.9780867640081863
distance-from-start_min1.9022151614243448
driven_any_max4.226593127497843
driven_any_mean3.066038229947092
driven_any_median3.066038229947092
driven_any_min1.9054833323963412
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.1441810279371637e-06
get_duckie_state_mean1.1411461791826884e-06
get_duckie_state_median1.1411461791826884e-06
get_duckie_state_min1.1381113304282137e-06
get_robot_state_max0.003438414267773898
get_robot_state_mean0.0033243431063069433
get_robot_state_median0.0033243431063069433
get_robot_state_min0.0032102719448399886
get_state_dump_max0.00437545101597624
get_state_dump_mean0.004288459557041404
get_state_dump_median0.004288459557041404
get_state_dump_min0.004201468098106567
get_ui_image_max0.053758911366732616
get_ui_image_mean0.05240884485943842
get_ui_image_median0.05240884485943842
get_ui_image_min0.05105877835214423
in-drivable-lane_max10.400000000000013
in-drivable-lane_mean7.825000000000001
in-drivable-lane_min5.249999999999989
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 4.226593127497843, "get_ui_image": 0.05105877835214423, "step_physics": 0.08548553708637731, "survival_time": 10.400000000000013, "driven_lanedir": 0.0, "get_state_dump": 0.004201468098106567, "get_robot_state": 0.0032102719448399886, "sim_render-ego0": 0.0034099081486606143, "get_duckie_state": 1.1441810279371637e-06, "in-drivable-lane": 10.400000000000013, "deviation-heading": 0.0, "agent_compute-ego0": 0.010218972794747238, "complete-iteration": 0.18770984371313068, "set_robot_commands": 0.0019321989214591431, "distance-from-start": 4.053958366592028, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02623528498781925, "sim_compute_performance-ego0": 0.0018757838381534555}, "LF-full-loop-001-ego0": {"driven_any": 1.9054833323963412, "get_ui_image": 0.053758911366732616, "step_physics": 0.08928583028181544, "survival_time": 5.249999999999989, "driven_lanedir": 0.0, "get_state_dump": 0.00437545101597624, "get_robot_state": 0.003438414267773898, "sim_render-ego0": 0.0036528920227626585, "get_duckie_state": 1.1381113304282137e-06, "in-drivable-lane": 5.249999999999989, "deviation-heading": 0.0, "agent_compute-ego0": 0.01124738297372494, "complete-iteration": 0.19311124873611163, "set_robot_commands": 0.0019928036995653835, "distance-from-start": 1.9022151614243448, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023355146624007315, "sim_compute_performance-ego0": 0.0019196046973174472}}
set_robot_commands_max0.0019928036995653835
set_robot_commands_mean0.001962501310512263
set_robot_commands_median0.001962501310512263
set_robot_commands_min0.0019321989214591431
sim_compute_performance-ego0_max0.0019196046973174472
sim_compute_performance-ego0_mean0.0018976942677354515
sim_compute_performance-ego0_median0.0018976942677354515
sim_compute_performance-ego0_min0.0018757838381534555
sim_compute_sim_state_max0.02623528498781925
sim_compute_sim_state_mean0.024795215805913283
sim_compute_sim_state_median0.024795215805913283
sim_compute_sim_state_min0.023355146624007315
sim_render-ego0_max0.0036528920227626585
sim_render-ego0_mean0.003531400085711636
sim_render-ego0_median0.003531400085711636
sim_render-ego0_min0.0034099081486606143
simulation-passed1
step_physics_max0.08928583028181544
step_physics_mean0.08738568368409638
step_physics_median0.08738568368409638
step_physics_min0.08548553708637731
survival_time_max10.400000000000013
survival_time_mean7.825000000000001
survival_time_min5.249999999999989
No reset possible
7715715576Adriano Almeidatemplate-randommooc-modcon-1simsuccessyesnogpu-production-b-spot-0-070:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.0
driven_lanedir_consec_median0.0
in-drivable-lane_median7.825000000000001
survival_time_median7.825000000000001


other stats
agent_compute-ego0_max0.012276028687099242
agent_compute-ego0_mean0.011305981167948847
agent_compute-ego0_median0.011305981167948847
agent_compute-ego0_min0.010335933648798454
complete-iteration_max0.20386239267745107
complete-iteration_mean0.1971861862410941
complete-iteration_median0.1971861862410941
complete-iteration_min0.1905099798047371
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.053958366592028
distance-from-start_mean2.9780867640081863
distance-from-start_median2.9780867640081863
distance-from-start_min1.9022151614243448
driven_any_max4.226593127497843
driven_any_mean3.066038229947092
driven_any_median3.066038229947092
driven_any_min1.9054833323963412
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.2910590981537442e-06
get_duckie_state_mean1.2815025531396524e-06
get_duckie_state_median1.2815025531396524e-06
get_duckie_state_min1.2719460081255606e-06
get_robot_state_max0.0034563541412353516
get_robot_state_mean0.00336003987983083
get_robot_state_median0.00336003987983083
get_robot_state_min0.003263725618426309
get_state_dump_max0.004555385067777813
get_state_dump_mean0.004411686545106234
get_state_dump_median0.004411686545106234
get_state_dump_min0.004267988022434654
get_ui_image_max0.05513104627717216
get_ui_image_mean0.05401091478442827
get_ui_image_median0.05401091478442827
get_ui_image_min0.05289078329168438
in-drivable-lane_max10.400000000000013
in-drivable-lane_mean7.825000000000001
in-drivable-lane_min5.249999999999989
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 4.226593127497843, "get_ui_image": 0.05289078329168438, "step_physics": 0.08586802551050506, "survival_time": 10.400000000000013, "driven_lanedir": 0.0, "get_state_dump": 0.004267988022434654, "get_robot_state": 0.003263725618426309, "sim_render-ego0": 0.003432292116886121, "get_duckie_state": 1.2719460081255606e-06, "in-drivable-lane": 10.400000000000013, "deviation-heading": 0.0, "agent_compute-ego0": 0.010335933648798454, "complete-iteration": 0.1905099798047371, "set_robot_commands": 0.001917737522764069, "distance-from-start": 4.053958366592028, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02658088469619386, "sim_compute_performance-ego0": 0.0018657155014111097}, "LF-full-loop-001-ego0": {"driven_any": 1.9054833323963412, "get_ui_image": 0.05513104627717216, "step_physics": 0.09656980127658484, "survival_time": 5.249999999999989, "driven_lanedir": 0.0, "get_state_dump": 0.004555385067777813, "get_robot_state": 0.0034563541412353516, "sim_render-ego0": 0.0038485774454080834, "get_duckie_state": 1.2910590981537442e-06, "in-drivable-lane": 5.249999999999989, "deviation-heading": 0.0, "agent_compute-ego0": 0.012276028687099242, "complete-iteration": 0.20386239267745107, "set_robot_commands": 0.00204356886305899, "distance-from-start": 1.9022151614243448, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023859903497515985, "sim_compute_performance-ego0": 0.0020203860300891806}}
set_robot_commands_max0.00204356886305899
set_robot_commands_mean0.0019806531929115294
set_robot_commands_median0.0019806531929115294
set_robot_commands_min0.001917737522764069
sim_compute_performance-ego0_max0.0020203860300891806
sim_compute_performance-ego0_mean0.0019430507657501451
sim_compute_performance-ego0_median0.0019430507657501451
sim_compute_performance-ego0_min0.0018657155014111097
sim_compute_sim_state_max0.02658088469619386
sim_compute_sim_state_mean0.02522039409685492
sim_compute_sim_state_median0.02522039409685492
sim_compute_sim_state_min0.023859903497515985
sim_render-ego0_max0.0038485774454080834
sim_render-ego0_mean0.003640434781147102
sim_render-ego0_median0.003640434781147102
sim_render-ego0_min0.003432292116886121
simulation-passed1
step_physics_max0.09656980127658484
step_physics_mean0.09121891339354496
step_physics_median0.09121891339354496
step_physics_min0.08586802551050506
survival_time_max10.400000000000013
survival_time_mean7.825000000000001
survival_time_min5.249999999999989
No reset possible
7714415578Adriano Almeidatemplate-randommooc-viscontrolsimsuccessyesnogpu-production-b-spot-0-070:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median1.4749999999999948
deviation-center-line_median0.10290845538839624
driven_lanedir_consec_median0.8124102136429856
survival_time_median3.699999999999995


other stats
agent_compute-ego0_max0.01087567965189616
agent_compute-ego0_mean0.0105443541208903
agent_compute-ego0_median0.0105443541208903
agent_compute-ego0_min0.01021302858988444
complete-iteration_max0.14047430674235026
complete-iteration_mean0.14031360944112142
complete-iteration_median0.14031360944112142
complete-iteration_min0.1401529121398926
deviation-center-line_max0.1136845552906736
deviation-center-line_mean0.10290845538839624
deviation-center-line_min0.09213235548611892
deviation-heading_max0.27368698690305954
deviation-heading_mean0.2600156845389547
deviation-heading_median0.2600156845389547
deviation-heading_min0.24634438217484983
distance-from-start_max1.186417060961268
distance-from-start_mean1.1838662171993262
distance-from-start_median1.1838662171993262
distance-from-start_min1.1813153734373842
driven_any_max1.190758815009246
driven_any_mean1.1871375087178495
driven_any_median1.1871375087178495
driven_any_min1.1835162024264536
driven_lanedir_consec_max0.8491951747780392
driven_lanedir_consec_mean0.8124102136429856
driven_lanedir_consec_min0.7756252525079319
driven_lanedir_max0.8491951747780392
driven_lanedir_mean0.8124102136429856
driven_lanedir_median0.8124102136429856
driven_lanedir_min0.7756252525079319
get_duckie_state_max1.4972686767578126e-06
get_duckie_state_mean1.4098485310872395e-06
get_duckie_state_median1.4098485310872395e-06
get_duckie_state_min1.3224283854166667e-06
get_robot_state_max0.0034259414672851564
get_robot_state_mean0.003419047991434733
get_robot_state_median0.003419047991434733
get_robot_state_min0.0034121545155843098
get_state_dump_max0.004563744862874349
get_state_dump_mean0.004494175910949708
get_state_dump_median0.004494175910949708
get_state_dump_min0.004424606959025065
get_ui_image_max0.04653152783711751
get_ui_image_mean0.044962979952494306
get_ui_image_median0.044962979952494306
get_ui_image_min0.043394432067871094
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean1.4749999999999948
in-drivable-lane_min1.399999999999995
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.190758815009246, "get_ui_image": 0.04653152783711751, "step_physics": 0.06471998850504557, "survival_time": 3.699999999999995, "driven_lanedir": 0.7756252525079319, "get_state_dump": 0.004424606959025065, "get_robot_state": 0.0034121545155843098, "sim_render-ego0": 0.003400729497273763, "get_duckie_state": 1.3224283854166667e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 0.24634438217484983, "agent_compute-ego0": 0.01087567965189616, "complete-iteration": 0.14047430674235026, "set_robot_commands": 0.0020208231608072917, "distance-from-start": 1.186417060961268, "deviation-center-line": 0.1136845552906736, "driven_lanedir_consec": 0.7756252525079319, "sim_compute_sim_state": 0.0032388114929199218, "sim_compute_performance-ego0": 0.0017638460795084635}, "LF-small-loop-001-ego0": {"driven_any": 1.1835162024264536, "get_ui_image": 0.043394432067871094, "step_physics": 0.06733644803365071, "survival_time": 3.699999999999995, "driven_lanedir": 0.8491951747780392, "get_state_dump": 0.004563744862874349, "get_robot_state": 0.0034259414672851564, "sim_render-ego0": 0.0034650580088297525, "get_duckie_state": 1.4972686767578126e-06, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.27368698690305954, "agent_compute-ego0": 0.01021302858988444, "complete-iteration": 0.1401529121398926, "set_robot_commands": 0.0020452435811360676, "distance-from-start": 1.1813153734373842, "deviation-center-line": 0.09213235548611892, "driven_lanedir_consec": 0.8491951747780392, "sim_compute_sim_state": 0.003775704701741536, "sim_compute_performance-ego0": 0.0018422412872314451}}
set_robot_commands_max0.0020452435811360676
set_robot_commands_mean0.0020330333709716797
set_robot_commands_median0.0020330333709716797
set_robot_commands_min0.0020208231608072917
sim_compute_performance-ego0_max0.0018422412872314451
sim_compute_performance-ego0_mean0.0018030436833699544
sim_compute_performance-ego0_median0.0018030436833699544
sim_compute_performance-ego0_min0.0017638460795084635
sim_compute_sim_state_max0.003775704701741536
sim_compute_sim_state_mean0.003507258097330729
sim_compute_sim_state_median0.003507258097330729
sim_compute_sim_state_min0.0032388114929199218
sim_render-ego0_max0.0034650580088297525
sim_render-ego0_mean0.0034328937530517575
sim_render-ego0_median0.0034328937530517575
sim_render-ego0_min0.003400729497273763
simulation-passed1
step_physics_max0.06733644803365071
step_physics_mean0.06602821826934814
step_physics_median0.06602821826934814
step_physics_min0.06471998850504557
survival_time_max3.699999999999995
survival_time_mean3.699999999999995
survival_time_min3.699999999999995
No reset possible