Duckietown Challenges Home Challenges Submissions

Evaluator 1885

ID1885
evaluatorreg10-d4835fbb66a3-1
ownerI don't have one 😀
machinearchimede
processreg10-d4835fbb66a3-1
versiond-c:6.1.5;d-c-r:6.0.29
first heard
last heard
statusinactive
# evaluating
# success4 33469
# timeout
# failed1 33467
# error10 33468
# aborted
# host-error1 33657
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
336578999Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simhost-errornoreg10-d4835fbb66a3-10:08:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 673, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1402, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1650, in upload
    copy_to_cache(realfile, sha256hex)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 272, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 163, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 149, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission8999/LFv-sim-reg10-d4835fbb66a3-1-job33657/docker-compose.yaml' -> '/tmp/duckietown/DT18/evaluator/cache/by-value/sha256hex/78e347b4ef20b4545241b8dce98305dacb07acabe165e917314bd70c8a6d72a4'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336548955Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:02
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336518899Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:23
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336498907Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:02
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336468843Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:11
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336448851Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:04
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336398803Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:12
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336358747Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:15
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336308691Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:11
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336258619Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:16
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335778135Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg10-d4835fbb66a3-10:26:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.058588868822116
survival_time_median14.950000000000076
deviation-center-line_median0.5795833724791655
in-drivable-lane_median6.000000000000085


other stats
agent_compute-ego_max0.04553768316904704
agent_compute-ego_mean0.027581718564176756
agent_compute-ego_median0.025717568680575995
agent_compute-ego_min0.02456377012687817
complete-iteration_max0.3132928069432577
complete-iteration_mean0.29926691334730615
complete-iteration_median0.2994516170024872
complete-iteration_min0.2864962609608968
deviation-center-line_max0.9164598921393186
deviation-center-line_mean0.5614711811479483
deviation-center-line_min0.16037924606473922
deviation-heading_max3.1200278352534614
deviation-heading_mean1.8309543737955465
deviation-heading_median1.6401552593366158
deviation-heading_min1.0315361115097663
driven_any_max1.9399847041395692
driven_any_mean1.9253883632384023
driven_any_median1.939908178510933
driven_any_min1.847056830161148
driven_lanedir_consec_max1.479173349965457
driven_lanedir_consec_mean0.9781544528644822
driven_lanedir_consec_min0.5911288865205526
driven_lanedir_max1.559089588854358
driven_lanedir_mean1.093486070826113
driven_lanedir_median1.1057895008040497
driven_lanedir_min0.6295458336429128
get_state_dump_max0.01821894963582357
get_state_dump_mean0.01551536702198697
get_state_dump_median0.01524830420811971
get_state_dump_min0.014435526362636631
get_ui_image_max0.06120906909306844
get_ui_image_mean0.0575148047582658
get_ui_image_median0.05848961671193441
get_ui_image_min0.049840034643809
in-drivable-lane_max9.700000000000088
in-drivable-lane_mean5.885000000000065
in-drivable-lane_min2.2000000000000313
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.9336816917867117, "get_ui_image": 0.049840034643809, "step_physics": 0.12753816763559978, "survival_time": 14.950000000000076, "driven_lanedir": 1.479173349965457, "get_state_dump": 0.01821894963582357, "sim_render-ego": 0.007485868136088054, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.02708184560139974, "deviation-heading": 1.691905950619879, "complete-iteration": 0.2864962609608968, "set_robot_commands": 0.006893986860911051, "deviation-center-line": 0.4944729086872736, "driven_lanedir_consec": 1.479173349965457, "sim_compute_sim_state": 0.02119965394337972, "sim_compute_performance-ego": 0.006358453432718913, "sim_compute_robot_state-ego": 0.011394943396250409, "sim_compute_robot_state-parked0": 0.010284283161163333}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.9398977160267168, "get_ui_image": 0.05497808615366618, "step_physics": 0.14204357544581095, "survival_time": 14.950000000000076, "driven_lanedir": 1.5098691549052166, "get_state_dump": 0.01579666296641032, "sim_render-ego": 0.006625986893971761, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.026029013792673743, "deviation-heading": 3.011074165186054, "complete-iteration": 0.2970132541656494, "set_robot_commands": 0.006443844636281331, "deviation-center-line": 0.9164598921393186, "driven_lanedir_consec": 0.5911288865205526, "sim_compute_sim_state": 0.020077015558878582, "sim_compute_performance-ego": 0.005527024269104004, "sim_compute_robot_state-ego": 0.00972954511642456, "sim_compute_robot_state-parked0": 0.009587931632995605}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.939913534578656, "get_ui_image": 0.05912038962046305, "step_physics": 0.14892693916956584, "survival_time": 14.950000000000076, "driven_lanedir": 1.559089588854358, "get_state_dump": 0.015171436468760171, "sim_render-ego": 0.006487766106923421, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.02535621166229248, "deviation-heading": 3.1200278352534614, "complete-iteration": 0.305129288037618, "set_robot_commands": 0.005941747824350993, "deviation-center-line": 0.9099946650722848, "driven_lanedir_consec": 1.326095558866558, "sim_compute_sim_state": 0.019576334158579508, "sim_compute_performance-ego": 0.005309587319691976, "sim_compute_robot_state-ego": 0.009752697149912516, "sim_compute_robot_state-parked0": 0.00931226094563802}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.939974772729296, "get_ui_image": 0.06120906909306844, "step_physics": 0.1460841147104899, "survival_time": 14.950000000000076, "driven_lanedir": 0.6334040887147059, "get_state_dump": 0.014773258368174237, "sim_render-ego": 0.006159599622090658, "in-drivable-lane": 9.700000000000088, "agent_compute-ego": 0.02560723145802816, "deviation-heading": 1.1998624594025755, "complete-iteration": 0.301889979839325, "set_robot_commands": 0.005842386086781819, "deviation-center-line": 0.31178280284802495, "driven_lanedir_consec": 0.6334040887147059, "sim_compute_sim_state": 0.018827176888783773, "sim_compute_performance-ego": 0.005174275239308675, "sim_compute_robot_state-ego": 0.009162277380625406, "sim_compute_robot_state-parked0": 0.008889843622843424}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.847056830161148, "get_ui_image": 0.0599519737979822, "step_physics": 0.14199571693152713, "survival_time": 14.250000000000068, "driven_lanedir": 0.6383017253696888, "get_state_dump": 0.014435526362636631, "sim_render-ego": 0.006562693077221252, "in-drivable-lane": 8.85000000000008, "agent_compute-ego": 0.02456377012687817, "deviation-heading": 1.0315361115097663, "complete-iteration": 0.29097762777094255, "set_robot_commands": 0.006157641661794562, "deviation-center-line": 0.17579659044498253, "driven_lanedir_consec": 0.6383017253696888, "sim_compute_sim_state": 0.013572843451248972, "sim_compute_performance-ego": 0.005250317590278492, "sim_compute_robot_state-ego": 0.009157817405566834, "sim_compute_robot_state-parked0": 0.00916467967786287}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.8935277407515896, "get_ui_image": 0.057137606078631255, "step_physics": 0.1367478705432317, "survival_time": 14.600000000000072, "driven_lanedir": 0.6295458336429128, "get_state_dump": 0.015632483240676252, "sim_render-ego": 0.006709472773826285, "in-drivable-lane": 9.250000000000083, "agent_compute-ego": 0.02582790590312383, "deviation-heading": 1.0571645626942372, "complete-iteration": 0.2883416038669952, "set_robot_commands": 0.006282044600134026, "deviation-center-line": 0.16037924606473922, "driven_lanedir_consec": 0.6295458336429128, "sim_compute_sim_state": 0.014361059012478344, "sim_compute_performance-ego": 0.005581137252180544, "sim_compute_robot_state-ego": 0.009770939611408808, "sim_compute_robot_state-parked0": 0.010117409163958403}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.9399028224432089, "get_ui_image": 0.05952847003936768, "step_physics": 0.1546533211072286, "survival_time": 14.950000000000076, "driven_lanedir": 1.1123604422543945, "get_state_dump": 0.015020962556203206, "sim_render-ego": 0.006415218512217204, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.024815467198689777, "deviation-heading": 1.8819158811151968, "complete-iteration": 0.31027799208958945, "set_robot_commands": 0.0059284845987955725, "deviation-center-line": 0.6583393874061927, "driven_lanedir_consec": 1.1123604422543945, "sim_compute_sim_state": 0.020040196577707926, "sim_compute_performance-ego": 0.005303484598795573, "sim_compute_robot_state-ego": 0.00911881446838379, "sim_compute_robot_state-parked0": 0.0092796262105306}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.9399714783936108, "get_ui_image": 0.05974490960439046, "step_physics": 0.15591566483179728, "survival_time": 14.950000000000076, "driven_lanedir": 1.0179591782905275, "get_state_dump": 0.014699753920237224, "sim_render-ego": 0.006180830796559652, "in-drivable-lane": 6.550000000000092, "agent_compute-ego": 0.025141383012135823, "deviation-heading": 1.5884045680533525, "complete-iteration": 0.31036799907684326, "set_robot_commands": 0.005692307949066162, "deviation-center-line": 0.5398869981034986, "driven_lanedir_consec": 1.0179591782905275, "sim_compute_sim_state": 0.019291019439697264, "sim_compute_performance-ego": 0.0050913468996683755, "sim_compute_robot_state-ego": 0.009283169110616048, "sim_compute_robot_state-parked0": 0.00916407346725464}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9399723413735184, "get_ui_image": 0.05577866474787394, "step_physics": 0.13549479722976684, "survival_time": 14.950000000000076, "driven_lanedir": 1.2559387869101644, "get_state_dump": 0.01607946475346883, "sim_render-ego": 0.006671574910481771, "in-drivable-lane": 4.600000000000065, "agent_compute-ego": 0.02585667371749878, "deviation-heading": 2.2830226368522553, "complete-iteration": 0.2888823207219442, "set_robot_commands": 0.006220071315765381, "deviation-center-line": 0.8283195738583353, "driven_lanedir_consec": 1.2543569056663215, "sim_compute_sim_state": 0.017105462551116942, "sim_compute_performance-ego": 0.005747834841410319, "sim_compute_robot_state-ego": 0.010098760922749837, "sim_compute_robot_state-parked0": 0.009652424653371176}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9399847041395692, "get_ui_image": 0.05785884380340576, "step_physics": 0.13983582735061645, "survival_time": 14.950000000000076, "driven_lanedir": 1.0992185593537045, "get_state_dump": 0.015325171947479248, "sim_render-ego": 0.0064702669779459635, "in-drivable-lane": 6.200000000000088, "agent_compute-ego": 0.04553768316904704, "deviation-heading": 1.4446295672686855, "complete-iteration": 0.3132928069432577, "set_robot_commands": 0.006156793435414632, "deviation-center-line": 0.6192797468548323, "driven_lanedir_consec": 1.0992185593537045, "sim_compute_sim_state": 0.01783056418100993, "sim_compute_performance-ego": 0.005285518964131673, "sim_compute_robot_state-ego": 0.009540924231211344, "sim_compute_robot_state-parked0": 0.00928305466969808}}
set_robot_commands_max0.006893986860911051
set_robot_commands_mean0.006155930896929553
set_robot_commands_median0.006157217548604597
set_robot_commands_min0.005692307949066162
sim_compute_performance-ego_max0.006358453432718913
sim_compute_performance-ego_mean0.005462898040728854
sim_compute_performance-ego_median0.005306535959243774
sim_compute_performance-ego_min0.0050913468996683755
sim_compute_robot_state-ego_max0.011394943396250409
sim_compute_robot_state-ego_mean0.009700988879314957
sim_compute_robot_state-ego_median0.009635234673817952
sim_compute_robot_state-ego_min0.00911881446838379
sim_compute_robot_state-parked0_max0.010284283161163333
sim_compute_robot_state-parked0_mean0.009473558720531614
sim_compute_robot_state-parked0_median0.00929765780766805
sim_compute_robot_state-parked0_min0.008889843622843424
sim_compute_sim_state_max0.02119965394337972
sim_compute_sim_state_mean0.018188132576288096
sim_compute_sim_state_median0.01905909816424052
sim_compute_sim_state_min0.013572843451248972
sim_render-ego_max0.007485868136088054
sim_render-ego_mean0.0065769277807326025
sim_render-ego_median0.006525229592072336
sim_render-ego_min0.006159599622090658
simulation-passed1
step_physics_max0.15591566483179728
step_physics_mean0.14292359949556346
step_physics_median0.14201964618866902
step_physics_min0.12753816763559978
survival_time_max14.950000000000076
survival_time_mean14.845000000000075
survival_time_min14.250000000000068
No reset possible
335237703Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simsuccessnoreg10-d4835fbb66a3-10:25:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9078895459598912
survival_time_median14.950000000000076
deviation-center-line_median0.4514764061907328
in-drivable-lane_median7.625000000000094


other stats
agent_compute-ego_max0.05676854928334554
agent_compute-ego_mean0.054401268753161536
agent_compute-ego_median0.0541120111336643
agent_compute-ego_min0.052486892541249594
complete-iteration_max0.31429097334543865
complete-iteration_mean0.3012534075177188
complete-iteration_median0.2994664288192206
complete-iteration_min0.2917556444803874
deviation-center-line_max1.0650749832029354
deviation-center-line_mean0.487973972343376
deviation-center-line_min0.16871797157347818
deviation-heading_max2.6975160137380243
deviation-heading_mean1.4878844533381603
deviation-heading_median1.3183603198394096
deviation-heading_min1.0205536072044243
driven_any_max1.9399980635850815
driven_any_mean1.898192130493762
driven_any_median1.939968033050531
driven_any_min1.727560293855811
driven_lanedir_consec_max1.8872794560334447
driven_lanedir_consec_mean1.018817011546136
driven_lanedir_consec_min0.5907533053947653
driven_lanedir_max1.8872794560334447
driven_lanedir_mean1.018817011546136
driven_lanedir_median0.9078895459598912
driven_lanedir_min0.5907533053947653
get_state_dump_max0.01839574416478475
get_state_dump_mean0.017372799128824702
get_state_dump_median0.01731721466051653
get_state_dump_min0.01680243730545044
get_ui_image_max0.05067631800969442
get_ui_image_mean0.04912673077348224
get_ui_image_median0.04907635966936748
get_ui_image_min0.047645331223805744
in-drivable-lane_max9.800000000000088
in-drivable-lane_mean6.38500000000007
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.933681678744252, "get_ui_image": 0.048124019304911295, "step_physics": 0.11202726205190022, "survival_time": 14.950000000000076, "driven_lanedir": 1.4886364551835405, "get_state_dump": 0.01839574416478475, "sim_render-ego": 0.007426110108693441, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.05395738442738851, "deviation-heading": 1.9830445490011943, "complete-iteration": 0.29677194674809776, "set_robot_commands": 0.0070082306861877445, "deviation-center-line": 0.5171202257514963, "driven_lanedir_consec": 1.4886364551835405, "sim_compute_sim_state": 0.021148718992869055, "sim_compute_performance-ego": 0.006329154968261719, "sim_compute_robot_state-ego": 0.011228187084197998, "sim_compute_robot_state-parked0": 0.010911568800608316}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.9399610401637668, "get_ui_image": 0.04884280602137248, "step_physics": 0.1142407218615214, "survival_time": 14.950000000000076, "driven_lanedir": 1.8872794560334447, "get_state_dump": 0.01760355552037557, "sim_render-ego": 0.007243922551472982, "in-drivable-lane": 0.0, "agent_compute-ego": 0.05676854928334554, "deviation-heading": 2.6975160137380243, "complete-iteration": 0.3004321018854777, "set_robot_commands": 0.006741880575815836, "deviation-center-line": 1.0650749832029354, "driven_lanedir_consec": 1.8872794560334447, "sim_compute_sim_state": 0.02090516408284505, "sim_compute_performance-ego": 0.006146831512451172, "sim_compute_robot_state-ego": 0.01109288533528646, "sim_compute_robot_state-parked0": 0.01063506523768107}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.9399777851716995, "get_ui_image": 0.047645331223805744, "step_physics": 0.11362348477045696, "survival_time": 14.950000000000076, "driven_lanedir": 1.0235342910413947, "get_state_dump": 0.017174562613169353, "sim_render-ego": 0.007080164750417074, "in-drivable-lane": 6.750000000000096, "agent_compute-ego": 0.05398079395294189, "deviation-heading": 1.3076238348679026, "complete-iteration": 0.2917556444803874, "set_robot_commands": 0.0064057652155558266, "deviation-center-line": 0.45593454781741455, "driven_lanedir_consec": 1.0235342910413947, "sim_compute_sim_state": 0.018872896830240887, "sim_compute_performance-ego": 0.005957481861114502, "sim_compute_robot_state-ego": 0.010633738835652669, "sim_compute_robot_state-parked0": 0.010176202456156414}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.9399617661502568, "get_ui_image": 0.049051746527353925, "step_physics": 0.12167922178904216, "survival_time": 14.950000000000076, "driven_lanedir": 0.9103007585362108, "get_state_dump": 0.017583283583323162, "sim_render-ego": 0.007052116394042969, "in-drivable-lane": 7.600000000000095, "agent_compute-ego": 0.05479571660359701, "deviation-heading": 1.3290968048109166, "complete-iteration": 0.3024505837758382, "set_robot_commands": 0.006430870691935222, "deviation-center-line": 0.4616627052663781, "driven_lanedir_consec": 0.9103007585362108, "sim_compute_sim_state": 0.018849053382873536, "sim_compute_performance-ego": 0.006054097016652425, "sim_compute_robot_state-ego": 0.010733550389607749, "sim_compute_robot_state-parked0": 0.010015353361765544}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.727560293855811, "get_ui_image": 0.04935674899526303, "step_physics": 0.1240586850527074, "survival_time": 13.350000000000056, "driven_lanedir": 0.6136123712356119, "get_state_dump": 0.017419283756156093, "sim_render-ego": 0.007174908891599277, "in-drivable-lane": 8.150000000000066, "agent_compute-ego": 0.053480267971195976, "deviation-heading": 1.0389964380421792, "complete-iteration": 0.29850075575296353, "set_robot_commands": 0.006450230709175939, "deviation-center-line": 0.1958902204687477, "driven_lanedir_consec": 0.6136123712356119, "sim_compute_sim_state": 0.013852800769305854, "sim_compute_performance-ego": 0.00597985406939903, "sim_compute_robot_state-ego": 0.010693756382117113, "sim_compute_robot_state-parked0": 0.009827738844053576}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.740837361828126, "get_ui_image": 0.04977858642663211, "step_physics": 0.1173856559739237, "survival_time": 13.450000000000056, "driven_lanedir": 0.6172543745334745, "get_state_dump": 0.01721514556487697, "sim_render-ego": 0.007348776749961881, "in-drivable-lane": 8.200000000000067, "agent_compute-ego": 0.0540935904563138, "deviation-heading": 1.0205536072044243, "complete-iteration": 0.2937577258255402, "set_robot_commands": 0.00654223594523717, "deviation-center-line": 0.16871797157347818, "driven_lanedir_consec": 0.6172543745334745, "sim_compute_sim_state": 0.014325731305827882, "sim_compute_performance-ego": 0.006120071978374042, "sim_compute_robot_state-ego": 0.010756696467062798, "sim_compute_robot_state-parked0": 0.009980674126777509}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.939974299950805, "get_ui_image": 0.049100972811381025, "step_physics": 0.13441410382588703, "survival_time": 14.950000000000076, "driven_lanedir": 0.7858429317397091, "get_state_dump": 0.017097253004709878, "sim_render-ego": 0.00704220453898112, "in-drivable-lane": 8.50000000000009, "agent_compute-ego": 0.05413043181101481, "deviation-heading": 1.1975652659639997, "complete-iteration": 0.31326126019159956, "set_robot_commands": 0.006396691799163818, "deviation-center-line": 0.44701826456405097, "driven_lanedir_consec": 0.7858429317397091, "sim_compute_sim_state": 0.018703544934590657, "sim_compute_performance-ego": 0.005959095954895019, "sim_compute_robot_state-ego": 0.010514042377471925, "sim_compute_robot_state-parked0": 0.009700133005777994}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.9399757626854068, "get_ui_image": 0.049864596525828045, "step_physics": 0.13409475008646646, "survival_time": 14.950000000000076, "driven_lanedir": 0.9054783333835714, "get_state_dump": 0.016999119917551677, "sim_render-ego": 0.007082923253377279, "in-drivable-lane": 7.6500000000000945, "agent_compute-ego": 0.05467661142349243, "deviation-heading": 1.1265321011827192, "complete-iteration": 0.31429097334543865, "set_robot_commands": 0.006439309120178222, "deviation-center-line": 0.442790668520096, "driven_lanedir_consec": 0.9054783333835714, "sim_compute_sim_state": 0.01856099128723145, "sim_compute_performance-ego": 0.005972677071889241, "sim_compute_robot_state-ego": 0.010497852961222333, "sim_compute_robot_state-parked0": 0.009892107645670572}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9399932528024129, "get_ui_image": 0.05067631800969442, "step_physics": 0.12345428069432576, "survival_time": 14.950000000000076, "driven_lanedir": 0.5907533053947653, "get_state_dump": 0.01680243730545044, "sim_render-ego": 0.0072462908426920575, "in-drivable-lane": 9.800000000000088, "agent_compute-ego": 0.05564244906107585, "deviation-heading": 1.5751964000318637, "complete-iteration": 0.304251401424408, "set_robot_commands": 0.00634637991587321, "deviation-center-line": 0.3806091833528441, "driven_lanedir_consec": 0.5907533053947653, "sim_compute_sim_state": 0.017146509488423667, "sim_compute_performance-ego": 0.006008226871490479, "sim_compute_robot_state-ego": 0.010678264300028485, "sim_compute_robot_state-parked0": 0.010044942696889242}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9399980635850815, "get_ui_image": 0.04882618188858032, "step_physics": 0.12002243757247924, "survival_time": 14.950000000000076, "driven_lanedir": 1.3654778383796375, "get_state_dump": 0.01743760585784912, "sim_render-ego": 0.007141191164652507, "in-drivable-lane": 4.20000000000006, "agent_compute-ego": 0.052486892541249594, "deviation-heading": 1.6027195185383791, "complete-iteration": 0.2970616817474365, "set_robot_commands": 0.006354763507843018, "deviation-center-line": 0.7449209529163189, "driven_lanedir_consec": 1.3654778383796375, "sim_compute_sim_state": 0.017561293443044027, "sim_compute_performance-ego": 0.006167127291361491, "sim_compute_robot_state-ego": 0.010886427561442057, "sim_compute_robot_state-parked0": 0.009968897501627603}}
set_robot_commands_max0.0070082306861877445
set_robot_commands_mean0.006511635816696601
set_robot_commands_median0.0064350899060567224
set_robot_commands_min0.00634637991587321
sim_compute_performance-ego_max0.006329154968261719
sim_compute_performance-ego_mean0.006069461859588911
sim_compute_performance-ego_median0.006031161944071451
sim_compute_performance-ego_min0.005957481861114502
sim_compute_robot_state-ego_max0.011228187084197998
sim_compute_robot_state-ego_mean0.01077154016940896
sim_compute_robot_state-ego_median0.010713653385862427
sim_compute_robot_state-ego_min0.010497852961222333
sim_compute_robot_state-parked0_max0.010911568800608316
sim_compute_robot_state-parked0_mean0.010115268367700783
sim_compute_robot_state-parked0_median0.009998013744271526
sim_compute_robot_state-parked0_min0.009700133005777994
sim_compute_sim_state_max0.021148718992869055
sim_compute_sim_state_mean0.017992670451725208
sim_compute_sim_state_median0.01863226811091105
sim_compute_sim_state_min0.013852800769305854
sim_render-ego_max0.007426110108693441
sim_render-ego_mean0.007183860924589058
sim_render-ego_median0.007158050028125891
sim_render-ego_min0.00704220453898112
simulation-passed1
step_physics_max0.13441410382588703
step_physics_mean0.12150006036787102
step_physics_median0.1208508296807607
step_physics_min0.11202726205190022
survival_time_max14.950000000000076
survival_time_mean14.640000000000072
survival_time_min13.350000000000056
No reset possible
334807199Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simsuccessnoreg10-d4835fbb66a3-10:25:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0538473579152976
survival_time_median14.950000000000076
deviation-center-line_median0.5275493379195012
in-drivable-lane_median6.35000000000009


other stats
agent_compute-ego_max0.028809924125671387
agent_compute-ego_mean0.027244578981897697
agent_compute-ego_median0.0270890208085378
agent_compute-ego_min0.02649705727895101
complete-iteration_max0.30266719659169516
complete-iteration_mean0.2858319376613001
complete-iteration_median0.2832581508159637
complete-iteration_min0.2744827464275562
deviation-center-line_max0.6919594722436487
deviation-center-line_mean0.4599222815067917
deviation-center-line_min0.18286049027491733
deviation-heading_max2.50152223264758
deviation-heading_mean1.5262960288993637
deviation-heading_median1.5040359713421665
deviation-heading_min1.029165101902093
driven_any_max1.9399991506480172
driven_any_mean1.9134593300754337
driven_any_median1.9399642607264065
driven_any_min1.7873084240188415
driven_lanedir_consec_max1.5244213055564302
driven_lanedir_consec_mean0.9928987161561558
driven_lanedir_consec_min0.4804484903552706
driven_lanedir_max1.5244213055564302
driven_lanedir_mean0.996943753956792
driven_lanedir_median1.0617657305896144
driven_lanedir_min0.4804484903552706
get_state_dump_max0.018498101234436036
get_state_dump_mean0.01708718416849186
get_state_dump_median0.01690560157748236
get_state_dump_min0.016470356782277425
get_ui_image_max0.05218169450759888
get_ui_image_mean0.05102305359845766
get_ui_image_median0.051118879318237304
get_ui_image_min0.049392924308776856
in-drivable-lane_max10.850000000000083
in-drivable-lane_mean6.610000000000075
in-drivable-lane_min2.600000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.933681634885511, "get_ui_image": 0.049494853019714354, "step_physics": 0.1212951914469401, "survival_time": 14.950000000000076, "driven_lanedir": 1.5244213055564302, "get_state_dump": 0.018498101234436036, "sim_render-ego": 0.007710074583689372, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.028809924125671387, "deviation-heading": 2.50152223264758, "complete-iteration": 0.2847592846552531, "set_robot_commands": 0.007077430884043376, "deviation-center-line": 0.6919594722436487, "driven_lanedir_consec": 1.5244213055564302, "sim_compute_sim_state": 0.022193503379821775, "sim_compute_performance-ego": 0.006534949938456217, "sim_compute_robot_state-ego": 0.011946188608805338, "sim_compute_robot_state-parked0": 0.0109712553024292}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.9399991506480172, "get_ui_image": 0.049392924308776856, "step_physics": 0.1273313029607137, "survival_time": 14.950000000000076, "driven_lanedir": 1.4925021901539994, "get_state_dump": 0.01783270835876465, "sim_render-ego": 0.007365384896596273, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.02805722157160441, "deviation-heading": 1.9939288872945975, "complete-iteration": 0.2861443877220154, "set_robot_commands": 0.0068511732419331865, "deviation-center-line": 0.5109641273994354, "driven_lanedir_consec": 1.4925021901539994, "sim_compute_sim_state": 0.02129080375035604, "sim_compute_performance-ego": 0.006168178717295329, "sim_compute_robot_state-ego": 0.011047012011210123, "sim_compute_robot_state-parked0": 0.010589814980824787}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.9399877635126304, "get_ui_image": 0.0512406587600708, "step_physics": 0.1246116065979004, "survival_time": 14.950000000000076, "driven_lanedir": 0.4804484903552706, "get_state_dump": 0.016628499825795492, "sim_render-ego": 0.007177194754282633, "in-drivable-lane": 10.850000000000083, "agent_compute-ego": 0.027154525915781658, "deviation-heading": 1.0616863801383534, "complete-iteration": 0.2792362586657206, "set_robot_commands": 0.006631724039713542, "deviation-center-line": 0.25638055495949097, "driven_lanedir_consec": 0.4804484903552706, "sim_compute_sim_state": 0.018747528394063313, "sim_compute_performance-ego": 0.005976599057515462, "sim_compute_robot_state-ego": 0.010570476055145264, "sim_compute_robot_state-parked0": 0.01028239091237386}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.9399631818281264, "get_ui_image": 0.050541363557179766, "step_physics": 0.1260418955485026, "survival_time": 14.950000000000076, "driven_lanedir": 1.0959558558592657, "get_state_dump": 0.017213468551635743, "sim_render-ego": 0.007254890600840251, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.027085984547932943, "deviation-heading": 1.6762852333540734, "complete-iteration": 0.280542688369751, "set_robot_commands": 0.006688461303710937, "deviation-center-line": 0.5510347157781962, "driven_lanedir_consec": 1.0801191105106318, "sim_compute_sim_state": 0.018738706906636555, "sim_compute_performance-ego": 0.005895263353983562, "sim_compute_robot_state-ego": 0.010672321319580078, "sim_compute_robot_state-parked0": 0.010194515387217204}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.833779592394148, "get_ui_image": 0.051701159864769385, "step_physics": 0.1247627120135951, "survival_time": 14.150000000000066, "driven_lanedir": 0.6271899097367106, "get_state_dump": 0.01655445840249213, "sim_render-ego": 0.0070978028192958224, "in-drivable-lane": 8.850000000000076, "agent_compute-ego": 0.026644314978232234, "deviation-heading": 1.029165101902093, "complete-iteration": 0.2744827464275562, "set_robot_commands": 0.006685182820781802, "deviation-center-line": 0.191393488400718, "driven_lanedir_consec": 0.6271899097367106, "sim_compute_sim_state": 0.01427257608609149, "sim_compute_performance-ego": 0.006005852466758485, "sim_compute_robot_state-ego": 0.010450887174572624, "sim_compute_robot_state-parked0": 0.010096161609824891}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.7873084240188415, "get_ui_image": 0.0520265689794568, "step_physics": 0.13041922234106754, "survival_time": 13.80000000000006, "driven_lanedir": 0.6302966797051427, "get_state_dump": 0.01698066186213839, "sim_render-ego": 0.007242462773253952, "in-drivable-lane": 8.450000000000072, "agent_compute-ego": 0.026897805324499157, "deviation-heading": 1.05907252278664, "complete-iteration": 0.2817570169766744, "set_robot_commands": 0.006579102813333705, "deviation-center-line": 0.18286049027491733, "driven_lanedir_consec": 0.6302966797051427, "sim_compute_sim_state": 0.014344328555507936, "sim_compute_performance-ego": 0.006074284297832544, "sim_compute_robot_state-ego": 0.010627087475596994, "sim_compute_robot_state-parked0": 0.010348708733268406}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.9399608636639731, "get_ui_image": 0.05052992343902587, "step_physics": 0.14657886664072672, "survival_time": 14.950000000000076, "driven_lanedir": 1.1153113000709909, "get_state_dump": 0.01716265916824341, "sim_render-ego": 0.007475299835205078, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.02709205706914266, "deviation-heading": 1.6734507307837276, "complete-iteration": 0.30266719659169516, "set_robot_commands": 0.006800698439280192, "deviation-center-line": 0.5722311051311881, "driven_lanedir_consec": 1.0930529270682123, "sim_compute_sim_state": 0.01922104517618815, "sim_compute_performance-ego": 0.006325381596883138, "sim_compute_robot_state-ego": 0.010860764980316162, "sim_compute_robot_state-parked0": 0.010401539007822673}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.939967163245665, "get_ui_image": 0.05099709987640381, "step_physics": 0.14483880519866943, "survival_time": 14.950000000000076, "driven_lanedir": 0.8581792178333458, "get_state_dump": 0.016830541292826334, "sim_render-ego": 0.007228130499521891, "in-drivable-lane": 7.9500000000000925, "agent_compute-ego": 0.02751751979192098, "deviation-heading": 1.2010711826442086, "complete-iteration": 0.2998677070935567, "set_robot_commands": 0.00653831958770752, "deviation-center-line": 0.4324829257014766, "driven_lanedir_consec": 0.8581792178333458, "sim_compute_sim_state": 0.01862959543863932, "sim_compute_performance-ego": 0.005904932816823323, "sim_compute_robot_state-ego": 0.010659309228261311, "sim_compute_robot_state-parked0": 0.010509360631306966}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9399653396246863, "get_ui_image": 0.05218169450759888, "step_physics": 0.12648838122685752, "survival_time": 14.950000000000076, "driven_lanedir": 1.1175569849768, "get_state_dump": 0.016700386206309002, "sim_render-ego": 0.007195180257161459, "in-drivable-lane": 5.900000000000084, "agent_compute-ego": 0.026689379215240477, "deviation-heading": 1.732156805541757, "complete-iteration": 0.2807936398188273, "set_robot_commands": 0.006616109212239583, "deviation-center-line": 0.6657813867392784, "driven_lanedir_consec": 1.1152017253218514, "sim_compute_sim_state": 0.017675835291544595, "sim_compute_performance-ego": 0.005991347630818685, "sim_compute_robot_state-ego": 0.01053750991821289, "sim_compute_robot_state-parked0": 0.010504232247670492}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9399801869327384, "get_ui_image": 0.05212428967158, "step_physics": 0.13480953534444173, "survival_time": 14.950000000000076, "driven_lanedir": 1.0275756053199636, "get_state_dump": 0.016470356782277425, "sim_render-ego": 0.007124791145324707, "in-drivable-lane": 6.750000000000096, "agent_compute-ego": 0.02649705727895101, "deviation-heading": 1.3346212119006051, "complete-iteration": 0.2880684502919515, "set_robot_commands": 0.006523119608561198, "deviation-center-line": 0.544134548439567, "driven_lanedir_consec": 1.0275756053199636, "sim_compute_sim_state": 0.017589057286580403, "sim_compute_performance-ego": 0.006045388380686442, "sim_compute_robot_state-ego": 0.01052475134531657, "sim_compute_robot_state-parked0": 0.010148590405782063}}
set_robot_commands_max0.007077430884043376
set_robot_commands_mean0.006699132195130504
set_robot_commands_median0.0066584534302476725
set_robot_commands_min0.006523119608561198
sim_compute_performance-ego_max0.006534949938456217
sim_compute_performance-ego_mean0.006092217825705319
sim_compute_performance-ego_median0.006025620423722464
sim_compute_performance-ego_min0.005895263353983562
sim_compute_robot_state-ego_max0.011946188608805338
sim_compute_robot_state-ego_mean0.010789630811701737
sim_compute_robot_state-ego_median0.010643198351929152
sim_compute_robot_state-ego_min0.010450887174572624
sim_compute_robot_state-parked0_max0.0109712553024292
sim_compute_robot_state-parked0_mean0.010404656921852056
sim_compute_robot_state-parked0_median0.010375123870545538
sim_compute_robot_state-parked0_min0.010096161609824891
sim_compute_sim_state_max0.022193503379821775
sim_compute_sim_state_mean0.01827029802654296
sim_compute_sim_state_median0.018684151172637935
sim_compute_sim_state_min0.01427257608609149
sim_render-ego_max0.007710074583689372
sim_render-ego_mean0.0072871212165171425
sim_render-ego_median0.007235296636387922
sim_render-ego_min0.0070978028192958224
simulation-passed1
step_physics_max0.14657886664072672
step_physics_mean0.1307177519319415
step_physics_median0.1269098420937856
step_physics_min0.1212951914469401
survival_time_max14.950000000000076
survival_time_mean14.755000000000075
survival_time_min13.80000000000006
No reset possible
334696871Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simsuccessnoreg10-d4835fbb66a3-10:20:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6430501145491379
survival_time_median10.90000000000002
deviation-center-line_median0.3525330450206732
in-drivable-lane_median2.225000000000011


other stats
agent_compute-ego_max0.02498880299654874
agent_compute-ego_mean0.023709157242376884
agent_compute-ego_median0.02343931441536788
agent_compute-ego_min0.023153449712174663
complete-iteration_max0.311591435881222
complete-iteration_mean0.29785725286383363
complete-iteration_median0.30292403402399926
complete-iteration_min0.2703941617130248
deviation-center-line_max0.9632944711251068
deviation-center-line_mean0.4630340322034023
deviation-center-line_min0.14192664544797587
deviation-heading_max2.098533601853976
deviation-heading_mean0.9754792675440108
deviation-heading_median0.7342551245090743
deviation-heading_min0.585297346117501
driven_any_max2.420991347968776
driven_any_mean1.6207752930494792
driven_any_median1.7473878924063322
driven_any_min0.6646238014128742
driven_lanedir_consec_max2.0163429659604093
driven_lanedir_consec_mean0.9238482055775374
driven_lanedir_consec_min0.4265885495638271
driven_lanedir_max2.0163429659604093
driven_lanedir_mean0.9238482055775374
driven_lanedir_median0.6430501145491379
driven_lanedir_min0.4265885495638271
get_state_dump_max0.019332745843682407
get_state_dump_mean0.01806471343181331
get_state_dump_median0.017989072286016573
get_state_dump_min0.01695867379506429
get_ui_image_max0.051468914205377754
get_ui_image_mean0.050382726683417735
get_ui_image_median0.05051932369725089
get_ui_image_min0.04944410847454536
in-drivable-lane_max10.500000000000083
in-drivable-lane_mean4.055000000000026
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.2994563656887796, "get_ui_image": 0.04944410847454536, "step_physics": 0.1376509055858705, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.01795326209649807, "sim_render-ego": 0.0073119358318607984, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.02345226159909876, "deviation-heading": 0.656882474004175, "complete-iteration": 0.29092199046437334, "set_robot_commands": 0.006682128441043016, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.020718035174579156, "sim_compute_performance-ego": 0.006083382339012332, "sim_compute_robot_state-ego": 0.010909628577348665, "sim_compute_robot_state-parked0": 0.010502662600540532}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.1953194191238845, "get_ui_image": 0.0508375685004627, "step_physics": 0.15531071757569032, "survival_time": 13.600000000000058, "driven_lanedir": 1.1856250938826185, "get_state_dump": 0.018306265859042894, "sim_render-ego": 0.007422758375897128, "in-drivable-lane": 6.050000000000077, "agent_compute-ego": 0.023538540391361013, "deviation-heading": 0.6506184484994173, "complete-iteration": 0.311591435881222, "set_robot_commands": 0.006368078729685615, "deviation-center-line": 0.7153797678025385, "driven_lanedir_consec": 1.1856250938826185, "sim_compute_sim_state": 0.022170500720248502, "sim_compute_performance-ego": 0.006192287101465113, "sim_compute_robot_state-ego": 0.01117899049730862, "sim_compute_robot_state-parked0": 0.010048606816460104}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7783468901478676, "get_ui_image": 0.050716187439712825, "step_physics": 0.1555688357820698, "survival_time": 5.09999999999999, "driven_lanedir": 0.4870179525099734, "get_state_dump": 0.01695867379506429, "sim_render-ego": 0.007216303956274893, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.023155415759367103, "deviation-heading": 0.7371537164253312, "complete-iteration": 0.3071237802505493, "set_robot_commands": 0.006905875953973508, "deviation-center-line": 0.31383033576316843, "driven_lanedir_consec": 0.4870179525099734, "sim_compute_sim_state": 0.01869891204086005, "sim_compute_performance-ego": 0.006080826123555501, "sim_compute_robot_state-ego": 0.010952108046587776, "sim_compute_robot_state-parked0": 0.01065370148303462}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.678601870577068, "get_ui_image": 0.050328412752472955, "step_physics": 0.1495145679859633, "survival_time": 4.449999999999992, "driven_lanedir": 0.4265885495638271, "get_state_dump": 0.017800708835044605, "sim_render-ego": 0.007563210605235582, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.023153449712174663, "deviation-heading": 0.7313565325928172, "complete-iteration": 0.3019209309910121, "set_robot_commands": 0.006595635682009579, "deviation-center-line": 0.2683902859812928, "driven_lanedir_consec": 0.4265885495638271, "sim_compute_sim_state": 0.0186280534508523, "sim_compute_performance-ego": 0.006359879890184724, "sim_compute_robot_state-ego": 0.011350516522868295, "sim_compute_robot_state-parked0": 0.010410590118236756}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.420991347968776, "get_ui_image": 0.050772811571757, "step_physics": 0.1522169621785482, "survival_time": 14.950000000000076, "driven_lanedir": 0.6446180995854834, "get_state_dump": 0.01774014949798584, "sim_render-ego": 0.007430936495463053, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.02410286823908488, "deviation-heading": 0.8468082391327437, "complete-iteration": 0.301361517906189, "set_robot_commands": 0.006480255921681722, "deviation-center-line": 0.14192664544797587, "driven_lanedir_consec": 0.6446180995854834, "sim_compute_sim_state": 0.015001036326090495, "sim_compute_performance-ego": 0.006176680723826091, "sim_compute_robot_state-ego": 0.011124277114868164, "sim_compute_robot_state-parked0": 0.010100971857706706}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.4072325102045298, "get_ui_image": 0.05071023464202881, "step_physics": 0.1541277058919271, "survival_time": 14.950000000000076, "driven_lanedir": 0.6414821295127923, "get_state_dump": 0.018024882475535076, "sim_render-ego": 0.007579862276713053, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.02467813014984131, "deviation-heading": 0.8474318367616545, "complete-iteration": 0.3049422804514567, "set_robot_commands": 0.006757165590922038, "deviation-center-line": 0.14728565348872835, "driven_lanedir_consec": 0.6414821295127923, "sim_compute_sim_state": 0.014826801617940267, "sim_compute_performance-ego": 0.006387005647023519, "sim_compute_robot_state-ego": 0.01116608222325643, "sim_compute_robot_state-parked0": 0.010468551317850749}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.411956006437587, "get_ui_image": 0.05013073841730754, "step_physics": 0.15415448745091756, "survival_time": 14.950000000000076, "driven_lanedir": 2.0163429659604093, "get_state_dump": 0.01808371861775716, "sim_render-ego": 0.0073699680964152015, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.02336780389149984, "deviation-heading": 2.098533601853976, "complete-iteration": 0.30733694156010943, "set_robot_commands": 0.006473016738891601, "deviation-center-line": 0.8309439677931447, "driven_lanedir_consec": 2.0163429659604093, "sim_compute_sim_state": 0.0201938525835673, "sim_compute_performance-ego": 0.006179229418436686, "sim_compute_robot_state-ego": 0.010893398920694988, "sim_compute_robot_state-parked0": 0.01027332623799642}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.410019798332097, "get_ui_image": 0.04993436892827352, "step_physics": 0.15182865619659425, "survival_time": 14.950000000000076, "driven_lanedir": 2.008955624758421, "get_state_dump": 0.01761022090911865, "sim_render-ego": 0.007276886304219563, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.023227932453155516, "deviation-heading": 2.0093607750461997, "complete-iteration": 0.3039271370569865, "set_robot_commands": 0.0063266674677530926, "deviation-center-line": 0.9632944711251068, "driven_lanedir_consec": 2.008955624758421, "sim_compute_sim_state": 0.020471618175506592, "sim_compute_performance-ego": 0.006111617088317871, "sim_compute_robot_state-ego": 0.010959555308024088, "sim_compute_robot_state-parked0": 0.009968121846516928}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.6646238014128742, "get_ui_image": 0.051468914205377754, "step_physics": 0.11934995380314914, "survival_time": 4.399999999999992, "driven_lanedir": 0.4333735891477426, "get_state_dump": 0.018836506388404152, "sim_render-ego": 0.007918715476989746, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02498880299654874, "deviation-heading": 0.5913497050062915, "complete-iteration": 0.279052352363413, "set_robot_commands": 0.007564514875411987, "deviation-center-line": 0.31869876800675323, "driven_lanedir_consec": 0.4333735891477426, "sim_compute_sim_state": 0.018017595464533024, "sim_compute_performance-ego": 0.006937823512337424, "sim_compute_robot_state-ego": 0.012222035364671186, "sim_compute_robot_state-parked0": 0.011507722464474764}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.9412049206013268, "get_ui_image": 0.04948392190223883, "step_physics": 0.1205006059536264, "survival_time": 6.0499999999999865, "driven_lanedir": 0.5069617153220096, "get_state_dump": 0.019332745843682407, "sim_render-ego": 0.007151733745228161, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.02342636723163699, "deviation-heading": 0.585297346117501, "complete-iteration": 0.2703941617130248, "set_robot_commands": 0.006834211428303364, "deviation-center-line": 0.3863673220345931, "driven_lanedir_consec": 0.5069617153220096, "sim_compute_sim_state": 0.016196562238961213, "sim_compute_performance-ego": 0.005866038897805963, "sim_compute_robot_state-ego": 0.010842512461764754, "sim_compute_robot_state-parked0": 0.010544410421828592}}
set_robot_commands_max0.007564514875411987
set_robot_commands_mean0.006698755082967552
set_robot_commands_median0.0066388820615262975
set_robot_commands_min0.0063266674677530926
sim_compute_performance-ego_max0.006937823512337424
sim_compute_performance-ego_mean0.006237477074196522
sim_compute_performance-ego_median0.006177955071131388
sim_compute_performance-ego_min0.005866038897805963
sim_compute_robot_state-ego_max0.012222035364671186
sim_compute_robot_state-ego_mean0.011159910503739295
sim_compute_robot_state-ego_median0.011041916211446129
sim_compute_robot_state-ego_min0.010842512461764754
sim_compute_robot_state-parked0_max0.011507722464474764
sim_compute_robot_state-parked0_mean0.010447866516464618
sim_compute_robot_state-parked0_median0.010439570718043752
sim_compute_robot_state-parked0_min0.009968121846516928
sim_compute_sim_state_max0.022170500720248502
sim_compute_sim_state_mean0.01849229677931389
sim_compute_sim_state_median0.01866348274585617
sim_compute_sim_state_min0.014826801617940267
sim_render-ego_max0.007918715476989746
sim_render-ego_mean0.007424231116429718
sim_render-ego_median0.0073963632361561645
sim_render-ego_min0.007151733745228161
simulation-passed1
step_physics_max0.1555688357820698
step_physics_mean0.1450223398404357
step_physics_median0.15202280918757122
step_physics_min0.11934995380314914
survival_time_max14.950000000000076
survival_time_mean10.16000000000003
survival_time_min4.399999999999992
No reset possible
334686875Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg10-d4835fbb66a3-10:01:06
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
334676848Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg10-d4835fbb66a3-10:04:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 443, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 16 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 213, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 447, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible