Duckietown Challenges Home Challenges Submissions

Evaluator 1891

ID1891
evaluatorreg02-0cba63545882-1
ownerI don't have one 😀
machinearchimede
processreg02-0cba63545882-1
versiond-c:6.1.5;d-c-r:6.0.29
first heard
last heard
statusinactive
# evaluating
# success4 33454
# timeout
# failed
# error19 33476
# aborted
# host-error2 33624
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
336699075Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornoreg02-0cba63545882-10:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 628, in get_cr
    os.makedirs(wd)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido5-LFV_multi-sim-validation/submission9075'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336248615Bea Baselines 🐤template-pytorchaido5-LF-sim-validationLFv-simhost-errornoreg02-0cba63545882-10:26:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 653, in get_cr
    cr = run_single(
  File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__
    next(self.gen)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 367, in setup_logging
    my_stderr.flush()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1343, in flush
    self.file.flush()
OSError: [Errno 28] No space left on device

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 673, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1402, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1650, in upload
    copy_to_cache(realfile, sha256hex)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 261, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/cache/by-value/sha256hex/33f78e7938eaaeb12aee1379bc76596227a656dc83a844cbd23dc9cc5299afc7'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336218623Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simerrornoreg02-0cba63545882-10:00:57
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336178635Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:00:59
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336158579Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:01
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336128575Bea Baselines 🐤template-tensorflowaido5-LF-sim-validationLFv-simerrornoreg02-0cba63545882-10:00:46
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336108527Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simerrornoreg02-0cba63545882-10:00:49
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336088467Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:17
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336068475Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:09
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336048415Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simerrornoreg02-0cba63545882-10:00:44
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335587911Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simsuccessnoreg02-0cba63545882-10:25:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.898153493079811
survival_time_median14.950000000000076
deviation-center-line_median0.4405705099974674
in-drivable-lane_median7.550000000000093


other stats
agent_compute-ego_max0.028385810057322183
agent_compute-ego_mean0.026893221919236848
agent_compute-ego_median0.02697019855181376
agent_compute-ego_min0.025439494450887043
complete-iteration_max0.31672797759373983
complete-iteration_mean0.289545448144277
complete-iteration_median0.2871187770366669
complete-iteration_min0.2707788944244385
deviation-center-line_max0.8579276673243739
deviation-center-line_mean0.463419711308937
deviation-center-line_min0.1542887470115099
deviation-heading_max3.74646285894366
deviation-heading_mean1.728568647399782
deviation-heading_median1.4770353771781457
deviation-heading_min1.0380123972054305
driven_any_max1.9399992364676184
driven_any_mean1.932679516502806
driven_any_median1.939941689979548
driven_any_min1.8736120969495955
driven_lanedir_consec_max1.8755432620962549
driven_lanedir_consec_mean0.9486213644307137
driven_lanedir_consec_min0.5596153122721437
driven_lanedir_max1.8755432620962549
driven_lanedir_mean0.9727105178183268
driven_lanedir_median0.9052093151615628
driven_lanedir_min0.5656363274703815
get_state_dump_max0.018556077587563273
get_state_dump_mean0.017183343580162373
get_state_dump_median0.01739157319068909
get_state_dump_min0.01568139950434367
get_ui_image_max0.05918543497721354
get_ui_image_mean0.05303755678382575
get_ui_image_median0.05101187944412232
get_ui_image_min0.04985333998998006
in-drivable-lane_max10.000000000000082
in-drivable-lane_mean6.845000000000075
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.933660107270367, "get_ui_image": 0.050842074553171794, "step_physics": 0.12697204669316609, "survival_time": 14.950000000000076, "driven_lanedir": 1.8755432620962549, "get_state_dump": 0.01748130718866984, "sim_render-ego": 0.007331477801005046, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026784551938374836, "deviation-heading": 2.8809753644634184, "complete-iteration": 0.2853715467453003, "set_robot_commands": 0.006884707609812419, "deviation-center-line": 0.8222790181087579, "driven_lanedir_consec": 1.8755432620962549, "sim_compute_sim_state": 0.02063187917073568, "sim_compute_performance-ego": 0.006311489741007487, "sim_compute_robot_state-ego": 0.011223207314809164, "sim_compute_robot_state-parked0": 0.010683517456054689}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.939915927834606, "get_ui_image": 0.05082467635472616, "step_physics": 0.12728731552759806, "survival_time": 14.950000000000076, "driven_lanedir": 0.9479644923167962, "get_state_dump": 0.017218927542368572, "sim_render-ego": 0.0071721959114074705, "in-drivable-lane": 7.1000000000000885, "agent_compute-ego": 0.026788235505421955, "deviation-heading": 1.60279973136638, "complete-iteration": 0.2841316254933675, "set_robot_commands": 0.006562947432200114, "deviation-center-line": 0.4274337068981544, "driven_lanedir_consec": 0.9162188786648844, "sim_compute_sim_state": 0.020550594329833985, "sim_compute_performance-ego": 0.006062596638997396, "sim_compute_robot_state-ego": 0.010897053877512611, "sim_compute_robot_state-parked0": 0.010542976061503092}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.9399698008113704, "get_ui_image": 0.05036949555079142, "step_physics": 0.12555550336837767, "survival_time": 14.950000000000076, "driven_lanedir": 0.9303305228283878, "get_state_dump": 0.017536234060923257, "sim_render-ego": 0.007361462116241455, "in-drivable-lane": 7.500000000000096, "agent_compute-ego": 0.02715216159820557, "deviation-heading": 1.2394185088949714, "complete-iteration": 0.28204769055048623, "set_robot_commands": 0.006858596801757813, "deviation-center-line": 0.4537073130967803, "driven_lanedir_consec": 0.9303305228283878, "sim_compute_sim_state": 0.019243652820587157, "sim_compute_performance-ego": 0.006331086158752441, "sim_compute_robot_state-ego": 0.010976067384084066, "sim_compute_robot_state-parked0": 0.010433119138081868}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.9399696394599972, "get_ui_image": 0.04989202260971069, "step_physics": 0.12949848413467407, "survival_time": 14.950000000000076, "driven_lanedir": 0.8568082841693587, "get_state_dump": 0.018210185368855793, "sim_render-ego": 0.007512447834014893, "in-drivable-lane": 8.050000000000093, "agent_compute-ego": 0.028385810057322183, "deviation-heading": 1.2102331365400396, "complete-iteration": 0.28886600732803347, "set_robot_commands": 0.006914803981781006, "deviation-center-line": 0.4165772502442127, "driven_lanedir_consec": 0.8568082841693587, "sim_compute_sim_state": 0.01980025291442871, "sim_compute_performance-ego": 0.006414710680643717, "sim_compute_robot_state-ego": 0.011295475959777833, "sim_compute_robot_state-parked0": 0.0107076366742452}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.8736120969495955, "get_ui_image": 0.05187699374030618, "step_physics": 0.11205781784849596, "survival_time": 14.45000000000007, "driven_lanedir": 0.6292640794101311, "get_state_dump": 0.018556077587563273, "sim_render-ego": 0.007796554004444796, "in-drivable-lane": 9.10000000000008, "agent_compute-ego": 0.027983032708349526, "deviation-heading": 1.0380123972054305, "complete-iteration": 0.2707788944244385, "set_robot_commands": 0.007363526466396028, "deviation-center-line": 0.17331016567968743, "driven_lanedir_consec": 0.6292640794101311, "sim_compute_sim_state": 0.015124469479887544, "sim_compute_performance-ego": 0.006826628450703869, "sim_compute_robot_state-ego": 0.011604016214918514, "sim_compute_robot_state-parked0": 0.011346054737130663}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.9399992364676184, "get_ui_image": 0.04985333998998006, "step_physics": 0.1214394195874532, "survival_time": 14.950000000000076, "driven_lanedir": 0.6442814426450617, "get_state_dump": 0.018259535630544027, "sim_render-ego": 0.007737118403116862, "in-drivable-lane": 9.450000000000088, "agent_compute-ego": 0.02744442145029704, "deviation-heading": 1.070500451800218, "complete-iteration": 0.2769138018290202, "set_robot_commands": 0.007294603983561198, "deviation-center-line": 0.1542887470115099, "driven_lanedir_consec": 0.6442814426450617, "sim_compute_sim_state": 0.014934117794036866, "sim_compute_performance-ego": 0.006626136302947998, "sim_compute_robot_state-ego": 0.011825023492177327, "sim_compute_robot_state-parked0": 0.011263000965118408}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.9399724548848876, "get_ui_image": 0.05118168433507283, "step_physics": 0.1411239322026571, "survival_time": 14.950000000000076, "driven_lanedir": 1.0244364479834291, "get_state_dump": 0.017301839192708335, "sim_render-ego": 0.007351984977722168, "in-drivable-lane": 6.550000000000093, "agent_compute-ego": 0.02724827527999878, "deviation-heading": 1.4759250330062312, "complete-iteration": 0.297723335425059, "set_robot_commands": 0.006616779963175456, "deviation-center-line": 0.49776962673922914, "driven_lanedir_consec": 1.0244364479834291, "sim_compute_sim_state": 0.019263849258422852, "sim_compute_performance-ego": 0.006060372193654379, "sim_compute_robot_state-ego": 0.011156779925028485, "sim_compute_robot_state-parked0": 0.01019574801127116}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.9399674521244896, "get_ui_image": 0.05916685501734416, "step_physics": 0.15784998337427775, "survival_time": 14.950000000000076, "driven_lanedir": 0.8800881074947375, "get_state_dump": 0.01568139950434367, "sim_render-ego": 0.006846659978230794, "in-drivable-lane": 7.600000000000089, "agent_compute-ego": 0.026246161460876462, "deviation-heading": 1.5432132704274115, "complete-iteration": 0.31672797759373983, "set_robot_commands": 0.006137280464172363, "deviation-center-line": 0.47559452845105904, "driven_lanedir_consec": 0.8800881074947375, "sim_compute_sim_state": 0.01965650955835978, "sim_compute_performance-ego": 0.005599684715270996, "sim_compute_robot_state-ego": 0.009703832467397054, "sim_compute_robot_state-parked0": 0.0096405561765035}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9398685095237085, "get_ui_image": 0.05918543497721354, "step_physics": 0.14171451012293498, "survival_time": 14.950000000000076, "driven_lanedir": 1.3727522117687287, "get_state_dump": 0.015817389488220215, "sim_render-ego": 0.006985976696014405, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.02546007474263509, "deviation-heading": 3.74646285894366, "complete-iteration": 0.29952241977055866, "set_robot_commands": 0.006253468195597331, "deviation-center-line": 0.8579276673243739, "driven_lanedir_consec": 1.1696273067427485, "sim_compute_sim_state": 0.01831810553868612, "sim_compute_performance-ego": 0.005814164479573568, "sim_compute_robot_state-ego": 0.009973684151967366, "sim_compute_robot_state-parked0": 0.00980255683263143}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9398599397014185, "get_ui_image": 0.057182990709940595, "step_physics": 0.14033800681432088, "survival_time": 14.950000000000076, "driven_lanedir": 0.5656363274703815, "get_state_dump": 0.01577054023742676, "sim_render-ego": 0.006708280245463053, "in-drivable-lane": 10.000000000000082, "agent_compute-ego": 0.025439494450887043, "deviation-heading": 1.4781457213500595, "complete-iteration": 0.2933711822827657, "set_robot_commands": 0.005826009114583333, "deviation-center-line": 0.3553090895356055, "driven_lanedir_consec": 0.5596153122721437, "sim_compute_sim_state": 0.017223076820373537, "sim_compute_performance-ego": 0.005509506861368815, "sim_compute_robot_state-ego": 0.009513733386993408, "sim_compute_robot_state-parked0": 0.009662367502848308}}
set_robot_commands_max0.007363526466396028
set_robot_commands_mean0.006671272401303706
set_robot_commands_median0.006737688382466634
set_robot_commands_min0.005826009114583333
sim_compute_performance-ego_max0.006826628450703869
sim_compute_performance-ego_mean0.006155637622292066
sim_compute_performance-ego_median0.0061870431900024414
sim_compute_performance-ego_min0.005509506861368815
sim_compute_robot_state-ego_max0.011825023492177327
sim_compute_robot_state-ego_mean0.010816887417466585
sim_compute_robot_state-ego_median0.011066423654556274
sim_compute_robot_state-ego_min0.009513733386993408
sim_compute_robot_state-parked0_max0.011346054737130663
sim_compute_robot_state-parked0_mean0.01042775335553883
sim_compute_robot_state-parked0_median0.01048804759979248
sim_compute_robot_state-parked0_min0.0096405561765035
sim_compute_sim_state_max0.02063187917073568
sim_compute_sim_state_mean0.018474650768535224
sim_compute_sim_state_median0.019253751039505003
sim_compute_sim_state_min0.014934117794036866
sim_render-ego_max0.007796554004444796
sim_render-ego_mean0.007280415796766094
sim_render-ego_median0.007341731389363606
sim_render-ego_min0.006708280245463053
simulation-passed1
step_physics_max0.15784998337427775
step_physics_mean0.13238370196739557
step_physics_median0.12839289983113605
step_physics_min0.11205781784849596
survival_time_max14.950000000000076
survival_time_mean14.900000000000077
survival_time_min14.45000000000007
No reset possible
335557923Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:01
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335537867Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:00
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335507875Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:19
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335477807Bea Baselines 🐤template-randomaido5-LF-sim-validationLFv-simerrornoreg02-0cba63545882-10:00:45
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335457816Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:05
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335397755Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:02
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335347759Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simerrornoreg02-0cba63545882-10:00:50
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335307711Bea Baselines 🐤template-randomaido5-LF-sim-validationLFv-simerrornoreg02-0cba63545882-10:00:48
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335257699Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:18
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335217683Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:14
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
334827207Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg02-0cba63545882-10:25:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9379742796711787
survival_time_median14.950000000000076
deviation-center-line_median0.5036752695466737
in-drivable-lane_median7.200000000000097


other stats
agent_compute-ego_max0.02772900660832723
agent_compute-ego_mean0.027083294641669097
agent_compute-ego_median0.02701553915611188
agent_compute-ego_min0.026334612369537352
complete-iteration_max0.3056605871518453
complete-iteration_mean0.28839468627893117
complete-iteration_median0.285661199873844
complete-iteration_min0.27814478635787965
deviation-center-line_max0.8434556249286244
deviation-center-line_mean0.5081603240280333
deviation-center-line_min0.19478370393633493
deviation-heading_max2.2808120511970693
deviation-heading_mean1.475170552012776
deviation-heading_median1.422483656195619
deviation-heading_min1.0111609186692627
driven_any_max1.9399907289008411
driven_any_mean1.9147722202906177
driven_any_median1.939940873599963
driven_any_min1.7607536904177643
driven_lanedir_consec_max1.1785318246502805
driven_lanedir_consec_mean0.9079641149211845
driven_lanedir_consec_min0.6174617796520019
driven_lanedir_max1.460747799063974
driven_lanedir_mean0.9587227207662558
driven_lanedir_median0.9641082915579776
driven_lanedir_min0.6174617796520019
get_state_dump_max0.02029492934544881
get_state_dump_mean0.01770129253906912
get_state_dump_median0.01729268789291382
get_state_dump_min0.016889191468556723
get_ui_image_max0.05258824189503987
get_ui_image_mean0.05123356051105392
get_ui_image_median0.05136719862620036
get_ui_image_min0.04964142481486002
in-drivable-lane_max9.250000000000082
in-drivable-lane_mean6.950000000000079
in-drivable-lane_min3.100000000000044
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.9336421143099431, "get_ui_image": 0.04964142481486002, "step_physics": 0.12155313730239868, "survival_time": 14.950000000000076, "driven_lanedir": 1.1439998360594723, "get_state_dump": 0.018361586729685464, "sim_render-ego": 0.0076741623878479005, "in-drivable-lane": 5.750000000000081, "agent_compute-ego": 0.027602821191151938, "deviation-heading": 1.546892881104707, "complete-iteration": 0.28293525536855063, "set_robot_commands": 0.007098172505696615, "deviation-center-line": 0.6158724608103414, "driven_lanedir_consec": 1.1439998360594723, "sim_compute_sim_state": 0.02163757006327311, "sim_compute_performance-ego": 0.0066656907399495445, "sim_compute_robot_state-ego": 0.011639208793640136, "sim_compute_robot_state-parked0": 0.01084126869837443}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.9399117946846784, "get_ui_image": 0.0514857276280721, "step_physics": 0.12929643789927164, "survival_time": 14.950000000000076, "driven_lanedir": 1.1637071685194735, "get_state_dump": 0.01795801003774007, "sim_render-ego": 0.007448175748189291, "in-drivable-lane": 5.400000000000051, "agent_compute-ego": 0.026723009745279948, "deviation-heading": 1.9517666004903969, "complete-iteration": 0.2902130611737569, "set_robot_commands": 0.007766051292419434, "deviation-center-line": 0.8434556249286244, "driven_lanedir_consec": 0.9383370844824506, "sim_compute_sim_state": 0.021088608105977374, "sim_compute_performance-ego": 0.006307268142700195, "sim_compute_robot_state-ego": 0.01136935313542684, "sim_compute_robot_state-parked0": 0.01055008331934611}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.9399803698416296, "get_ui_image": 0.05124866962432861, "step_physics": 0.12290636539459228, "survival_time": 14.950000000000076, "driven_lanedir": 0.9376114748599071, "get_state_dump": 0.016889191468556723, "sim_render-ego": 0.007218114535013835, "in-drivable-lane": 7.400000000000096, "agent_compute-ego": 0.026334612369537352, "deviation-heading": 1.46837121986485, "complete-iteration": 0.27814478635787965, "set_robot_commands": 0.0068681097030639645, "deviation-center-line": 0.4653968141103871, "driven_lanedir_consec": 0.9376114748599071, "sim_compute_sim_state": 0.01911207914352417, "sim_compute_performance-ego": 0.006086180210113526, "sim_compute_robot_state-ego": 0.010766079425811767, "sim_compute_robot_state-parked0": 0.010499215126037598}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.939971480180373, "get_ui_image": 0.050721139907836915, "step_physics": 0.13128307660420735, "survival_time": 14.950000000000076, "driven_lanedir": 0.7487307519542985, "get_state_dump": 0.02029492934544881, "sim_render-ego": 0.0072868545850118, "in-drivable-lane": 8.85000000000009, "agent_compute-ego": 0.02770451545715332, "deviation-heading": 1.2282120331791029, "complete-iteration": 0.291679630279541, "set_robot_commands": 0.00684127410252889, "deviation-center-line": 0.38544484550998576, "driven_lanedir_consec": 0.7487307519542985, "sim_compute_sim_state": 0.0194326647122701, "sim_compute_performance-ego": 0.006204435825347901, "sim_compute_robot_state-ego": 0.011100464661916096, "sim_compute_robot_state-parked0": 0.010595662593841553}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.7607536904177643, "get_ui_image": 0.05197705153156729, "step_physics": 0.12705896268872657, "survival_time": 13.600000000000058, "driven_lanedir": 0.6217071854639986, "get_state_dump": 0.016952692585832933, "sim_render-ego": 0.007280770470114315, "in-drivable-lane": 8.350000000000069, "agent_compute-ego": 0.0268163321649327, "deviation-heading": 1.0258000266007348, "complete-iteration": 0.27926237881183624, "set_robot_commands": 0.0067489699405782365, "deviation-center-line": 0.19478370393633493, "driven_lanedir_consec": 0.6217071854639986, "sim_compute_sim_state": 0.014640914166674894, "sim_compute_performance-ego": 0.0061663117478875555, "sim_compute_robot_state-ego": 0.010792075711138108, "sim_compute_robot_state-parked0": 0.01061241591677946}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.8736121760692188, "get_ui_image": 0.05224719509533945, "step_physics": 0.13016226134910716, "survival_time": 14.45000000000007, "driven_lanedir": 0.6174617796520019, "get_state_dump": 0.016918928152962125, "sim_render-ego": 0.007451209229993985, "in-drivable-lane": 9.250000000000082, "agent_compute-ego": 0.02711927602035364, "deviation-heading": 1.0111609186692627, "complete-iteration": 0.28357878523301916, "set_robot_commands": 0.006964636508981249, "deviation-center-line": 0.20280530369663177, "driven_lanedir_consec": 0.6174617796520019, "sim_compute_sim_state": 0.014861306517181923, "sim_compute_performance-ego": 0.006148481039027442, "sim_compute_robot_state-ego": 0.010951835803919598, "sim_compute_robot_state-parked0": 0.010539167892561652}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.9399699525152472, "get_ui_image": 0.050529348055521645, "step_physics": 0.14629501501719158, "survival_time": 14.950000000000076, "driven_lanedir": 0.9906051082560484, "get_state_dump": 0.01789872964223226, "sim_render-ego": 0.007656166553497315, "in-drivable-lane": 6.7500000000000915, "agent_compute-ego": 0.02772900660832723, "deviation-heading": 1.5999000899825058, "complete-iteration": 0.3056605871518453, "set_robot_commands": 0.006971569061279297, "deviation-center-line": 0.5122509989604399, "driven_lanedir_consec": 0.9906051082560484, "sim_compute_sim_state": 0.019705650011698404, "sim_compute_performance-ego": 0.006464195251464844, "sim_compute_robot_state-ego": 0.011463522911071776, "sim_compute_robot_state-parked0": 0.010723063151041668}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.9399004712745995, "get_ui_image": 0.05022706826527913, "step_physics": 0.1484108328819275, "survival_time": 14.950000000000076, "driven_lanedir": 1.460747799063974, "get_state_dump": 0.01730837901433309, "sim_render-ego": 0.0072863928476969405, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.026487484773000083, "deviation-heading": 2.2808120511970693, "complete-iteration": 0.3033459003766378, "set_robot_commands": 0.006643281777699788, "deviation-center-line": 0.7640183584291131, "driven_lanedir_consec": 1.1785318246502805, "sim_compute_sim_state": 0.019316355387369793, "sim_compute_performance-ego": 0.006193623542785644, "sim_compute_robot_state-ego": 0.010841317176818847, "sim_compute_robot_state-parked0": 0.010410184860229491}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9399907289008411, "get_ui_image": 0.05166973829269409, "step_physics": 0.12539060592651366, "survival_time": 14.950000000000076, "driven_lanedir": 0.9083196540700892, "get_state_dump": 0.017153481642405193, "sim_render-ego": 0.007420969804128011, "in-drivable-lane": 7.650000000000095, "agent_compute-ego": 0.026911802291870117, "deviation-heading": 1.262193606512746, "complete-iteration": 0.28138286352157593, "set_robot_commands": 0.006822346051534017, "deviation-center-line": 0.4950995401329077, "driven_lanedir_consec": 0.9083196540700892, "sim_compute_sim_state": 0.01808084090550741, "sim_compute_performance-ego": 0.006293721993764241, "sim_compute_robot_state-ego": 0.010818521976470949, "sim_compute_robot_state-parked0": 0.010599485238393148}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9399894247118787, "get_ui_image": 0.05258824189503987, "step_physics": 0.12962332804997762, "survival_time": 14.950000000000076, "driven_lanedir": 0.994336449763296, "get_state_dump": 0.017276996771494548, "sim_render-ego": 0.007505732377370199, "in-drivable-lane": 7.000000000000098, "agent_compute-ego": 0.027404085795084635, "deviation-heading": 1.3765960925263874, "complete-iteration": 0.2877436145146688, "set_robot_commands": 0.006919215520222982, "deviation-center-line": 0.6024755897655676, "driven_lanedir_consec": 0.994336449763296, "sim_compute_sim_state": 0.01816441535949707, "sim_compute_performance-ego": 0.006280867258707682, "sim_compute_robot_state-ego": 0.010909289518992104, "sim_compute_robot_state-parked0": 0.01084819237391154}}
set_robot_commands_max0.007766051292419434
set_robot_commands_mean0.006964362646400447
set_robot_commands_median0.006893662611643474
set_robot_commands_min0.006643281777699788
sim_compute_performance-ego_max0.0066656907399495445
sim_compute_performance-ego_mean0.006281077575174857
sim_compute_performance-ego_median0.006242651542027791
sim_compute_performance-ego_min0.006086180210113526
sim_compute_robot_state-ego_max0.011639208793640136
sim_compute_robot_state-ego_mean0.01106516691152062
sim_compute_robot_state-ego_median0.010930562661455851
sim_compute_robot_state-ego_min0.010766079425811767
sim_compute_robot_state-parked0_max0.01084819237391154
sim_compute_robot_state-parked0_mean0.010621873917051664
sim_compute_robot_state-parked0_median0.010597573916117351
sim_compute_robot_state-parked0_min0.010410184860229491
sim_compute_sim_state_max0.02163757006327311
sim_compute_sim_state_mean0.018604040437297423
sim_compute_sim_state_median0.019214217265446983
sim_compute_sim_state_min0.014640914166674894
sim_render-ego_max0.0076741623878479005
sim_render-ego_mean0.00742285485388636
sim_render-ego_median0.007434572776158651
sim_render-ego_min0.007218114535013835
simulation-passed1
step_physics_max0.1484108328819275
step_physics_mean0.13119800231139142
step_physics_median0.12945988297462463
step_physics_min0.12155313730239868
survival_time_max14.950000000000076
survival_time_mean14.765000000000075
survival_time_min13.600000000000058
No reset possible
334767152Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-0cba63545882-10:01:19
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
334616853Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-0cba63545882-10:24:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1378513612449312
survival_time_median14.950000000000076
deviation-center-line_median0.3555889258455104
in-drivable-lane_median7.475000000000088


other stats
agent_compute-ego_max0.02854167381922404
agent_compute-ego_mean0.027136612574704667
agent_compute-ego_median0.027072599331537883
agent_compute-ego_min0.026081769466400145
complete-iteration_max0.31707679212482925
complete-iteration_mean0.3072440089901177
complete-iteration_median0.31021655996640524
complete-iteration_min0.2890739340742095
deviation-center-line_max1.0891362345722853
deviation-center-line_mean0.4336375415950764
deviation-center-line_min0.19626649592417136
deviation-heading_max3.5899453468390052
deviation-heading_mean1.5774139019977615
deviation-heading_median1.4766005553665007
deviation-heading_min0.6582581469329672
driven_any_max3.0631263324536686
driven_any_mean2.6981648870474606
driven_any_median3.0581020371506833
driven_any_min1.1617124565280146
driven_lanedir_consec_max2.5614560872087484
driven_lanedir_consec_mean1.2282875205811163
driven_lanedir_consec_min0.42271192042547245
driven_lanedir_max2.5614560872087484
driven_lanedir_mean1.237509646415979
driven_lanedir_median1.1378513612449312
driven_lanedir_min0.42271192042547245
get_state_dump_max0.019188138643900555
get_state_dump_mean0.0182161542461032
get_state_dump_median0.01822653734383463
get_state_dump_min0.017334689299265543
get_ui_image_max0.05132302717000496
get_ui_image_mean0.05032944868236473
get_ui_image_median0.050344087812635635
get_ui_image_min0.04889134407043457
in-drivable-lane_max11.600000000000051
in-drivable-lane_mean6.675000000000051
in-drivable-lane_min1.7500000000000018
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 3.0531355936853837, "get_ui_image": 0.04990767240524292, "step_physics": 0.14997960646947223, "survival_time": 14.950000000000076, "driven_lanedir": 0.6362747054389242, "get_state_dump": 0.01832054853439331, "sim_render-ego": 0.00780162493387858, "in-drivable-lane": 11.45000000000008, "agent_compute-ego": 0.02854167381922404, "deviation-heading": 0.6582581469329672, "complete-iteration": 0.3108765610059102, "set_robot_commands": 0.006706022421518962, "deviation-center-line": 0.19626649592417136, "driven_lanedir_consec": 0.6362747054389242, "sim_compute_sim_state": 0.021008926232655843, "sim_compute_performance-ego": 0.00657386302947998, "sim_compute_robot_state-ego": 0.011578001181284587, "sim_compute_robot_state-parked0": 0.010227016607920327}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 3.063095347246803, "get_ui_image": 0.05098935524622599, "step_physics": 0.14320326407750447, "survival_time": 14.950000000000076, "driven_lanedir": 2.5614560872087484, "get_state_dump": 0.01821847915649414, "sim_render-ego": 0.007637198766072591, "in-drivable-lane": 1.7500000000000018, "agent_compute-ego": 0.026970364252726236, "deviation-heading": 3.5899453468390052, "complete-iteration": 0.3042277447382609, "set_robot_commands": 0.006732175350189209, "deviation-center-line": 0.8905966331007968, "driven_lanedir_consec": 2.5614560872087484, "sim_compute_sim_state": 0.02200575590133667, "sim_compute_performance-ego": 0.006501659552256267, "sim_compute_robot_state-ego": 0.01140539566675822, "sim_compute_robot_state-parked0": 0.010335687001546225}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 3.0631119598126952, "get_ui_image": 0.04993626912434896, "step_physics": 0.15338436683019002, "survival_time": 14.950000000000076, "driven_lanedir": 1.1641302573473946, "get_state_dump": 0.019188138643900555, "sim_render-ego": 0.007804825305938721, "in-drivable-lane": 9.00000000000009, "agent_compute-ego": 0.02797694603602091, "deviation-heading": 0.848499828757095, "complete-iteration": 0.31397546847661334, "set_robot_commands": 0.006470675468444824, "deviation-center-line": 0.363623550576645, "driven_lanedir_consec": 1.1641302573473946, "sim_compute_sim_state": 0.020638906955718996, "sim_compute_performance-ego": 0.006629294554392497, "sim_compute_robot_state-ego": 0.011540191173553468, "sim_compute_robot_state-parked0": 0.01018210252126058}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 3.063068480615983, "get_ui_image": 0.05026835123697917, "step_physics": 0.15620169242223103, "survival_time": 14.950000000000076, "driven_lanedir": 1.2206664455329332, "get_state_dump": 0.018540085156758625, "sim_render-ego": 0.007309565544128418, "in-drivable-lane": 8.450000000000085, "agent_compute-ego": 0.027199451128641763, "deviation-heading": 1.437930012342403, "complete-iteration": 0.3143841401735942, "set_robot_commands": 0.006292046705881755, "deviation-center-line": 0.34755430111437574, "driven_lanedir_consec": 1.189060950366935, "sim_compute_sim_state": 0.020558067162831622, "sim_compute_performance-ego": 0.006358744303385417, "sim_compute_robot_state-ego": 0.01139923890431722, "sim_compute_robot_state-parked0": 0.010041750272115072}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.4488842891867146, "get_ui_image": 0.050279564327663846, "step_physics": 0.16429585101557712, "survival_time": 7.649999999999981, "driven_lanedir": 0.6961355239128488, "get_state_dump": 0.01867176037208707, "sim_render-ego": 0.007575859431347816, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.02669436168047338, "deviation-heading": 1.772503268172528, "complete-iteration": 0.31707679212482925, "set_robot_commands": 0.00663921412299661, "deviation-center-line": 0.2159277030353033, "driven_lanedir_consec": 0.6525134063523639, "sim_compute_sim_state": 0.014418577057084226, "sim_compute_performance-ego": 0.006497194564420414, "sim_compute_robot_state-ego": 0.012001645331289256, "sim_compute_robot_state-parked0": 0.009788955738341886}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.1617124565280146, "get_ui_image": 0.05132302717000496, "step_physics": 0.1360994968093744, "survival_time": 5.949999999999987, "driven_lanedir": 0.6337962280141316, "get_state_dump": 0.018234595531175117, "sim_render-ego": 0.007403019095669274, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.02633200773671895, "deviation-heading": 1.5152710983905984, "complete-iteration": 0.2890739340742095, "set_robot_commands": 0.006834460907623547, "deviation-center-line": 0.20964257769419783, "driven_lanedir_consec": 0.61680258239199, "sim_compute_sim_state": 0.015019889639205293, "sim_compute_performance-ego": 0.006347908693201402, "sim_compute_robot_state-ego": 0.011208604363834156, "sim_compute_robot_state-parked0": 0.010058308849815562}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 3.029147969191939, "get_ui_image": 0.04889134407043457, "step_physics": 0.1555554954210917, "survival_time": 14.950000000000076, "driven_lanedir": 1.1115724651424677, "get_state_dump": 0.017691756884257, "sim_render-ego": 0.0071112934748331705, "in-drivable-lane": 9.250000000000089, "agent_compute-ego": 0.02694497267405192, "deviation-heading": 0.6756095427858589, "complete-iteration": 0.3096080668767293, "set_robot_commands": 0.0063114086786905926, "deviation-center-line": 0.3813708764760125, "driven_lanedir_consec": 1.1115724651424677, "sim_compute_sim_state": 0.020020186106363937, "sim_compute_performance-ego": 0.005947452386220296, "sim_compute_robot_state-ego": 0.011028058528900146, "sim_compute_robot_state-parked0": 0.009900836149851482}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.973260020663068, "get_ui_image": 0.050408611297607424, "step_physics": 0.15540560483932497, "survival_time": 14.950000000000076, "driven_lanedir": 0.42271192042547245, "get_state_dump": 0.01798044761021932, "sim_render-ego": 0.007425185839335124, "in-drivable-lane": 11.600000000000051, "agent_compute-ego": 0.02744974454243978, "deviation-heading": 2.1558334975800117, "complete-iteration": 0.31082505305608116, "set_robot_commands": 0.006295429865519206, "deviation-center-line": 0.2421863409204812, "driven_lanedir_consec": 0.42271192042547245, "sim_compute_sim_state": 0.01840434710184733, "sim_compute_performance-ego": 0.006206145286560058, "sim_compute_robot_state-ego": 0.010982271830240885, "sim_compute_robot_state-parked0": 0.010059426625569662}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 3.0631263324536686, "get_ui_image": 0.05056304375330607, "step_physics": 0.1480164631207784, "survival_time": 14.950000000000076, "driven_lanedir": 2.259950466609326, "get_state_dump": 0.017981041272481284, "sim_render-ego": 0.007312436898549397, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.026081769466400145, "deviation-heading": 1.757722667754564, "complete-iteration": 0.30401487509409586, "set_robot_commands": 0.006656982898712158, "deviation-center-line": 1.0891362345722853, "driven_lanedir_consec": 2.259950466609326, "sim_compute_sim_state": 0.019256712595621745, "sim_compute_performance-ego": 0.006187455654144287, "sim_compute_robot_state-ego": 0.011570548216501872, "sim_compute_robot_state-parked0": 0.010178142388661705}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 3.0631064210903363, "get_ui_image": 0.050727248191833496, "step_physics": 0.1428652262687683, "survival_time": 14.950000000000076, "driven_lanedir": 1.6684023645275412, "get_state_dump": 0.017334689299265543, "sim_render-ego": 0.007266777356465658, "in-drivable-lane": 6.500000000000092, "agent_compute-ego": 0.027174834410349527, "deviation-heading": 1.362565610422584, "complete-iteration": 0.29837745428085327, "set_robot_commands": 0.006665075620015462, "deviation-center-line": 0.4000707025364953, "driven_lanedir_consec": 1.6684023645275412, "sim_compute_sim_state": 0.018910460472106937, "sim_compute_performance-ego": 0.006105871995290121, "sim_compute_robot_state-ego": 0.010920101801554364, "sim_compute_robot_state-parked0": 0.01019724210103353}}
set_robot_commands_max0.006834460907623547
set_robot_commands_mean0.0065603492039592315
set_robot_commands_median0.006648098510854385
set_robot_commands_min0.006292046705881755
sim_compute_performance-ego_max0.006629294554392497
sim_compute_performance-ego_mean0.006335559001935075
sim_compute_performance-ego_median0.006353326498293409
sim_compute_performance-ego_min0.005947452386220296
sim_compute_robot_state-ego_max0.012001645331289256
sim_compute_robot_state-ego_mean0.011363405699823418
sim_compute_robot_state-ego_median0.01140231728553772
sim_compute_robot_state-ego_min0.010920101801554364
sim_compute_robot_state-parked0_max0.010335687001546225
sim_compute_robot_state-parked0_mean0.010096946825611602
sim_compute_robot_state-parked0_median0.010118784507115682
sim_compute_robot_state-parked0_min0.009788955738341886
sim_compute_sim_state_max0.02200575590133667
sim_compute_sim_state_mean0.01902418292247726
sim_compute_sim_state_median0.01963844935099284
sim_compute_sim_state_min0.014418577057084226
sim_render-ego_max0.007804825305938721
sim_render-ego_mean0.007464778664621874
sim_render-ego_median0.007414102467502199
sim_render-ego_min0.0071112934748331705
simulation-passed1
step_physics_max0.16429585101557712
step_physics_mean0.15050070672743124
step_physics_median0.15168198664983112
step_physics_min0.1360994968093744
survival_time_max14.950000000000076
survival_time_mean13.32000000000006
survival_time_min5.949999999999987
No reset possible
334546854Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-0cba63545882-10:22:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.355292293341586
survival_time_median14.950000000000076
deviation-center-line_median0.7697495101903009
in-drivable-lane_median4.375000000000022


other stats
agent_compute-ego_max0.03302102247873942
agent_compute-ego_mean0.03200698077829368
agent_compute-ego_median0.0318659778436025
agent_compute-ego_min0.030879587107311098
complete-iteration_max0.27457778374354047
complete-iteration_mean0.2599454009047903
complete-iteration_median0.2580941387017568
complete-iteration_min0.2506439933887107
deviation-center-line_max1.057071215645266
deviation-center-line_mean0.6664192857057083
deviation-center-line_min0.19340442902373295
deviation-heading_max2.6557337358300503
deviation-heading_mean1.6347982837473325
deviation-heading_median1.4609475495956836
deviation-heading_min0.7721981656092478
driven_any_max2.2665382973678447
driven_any_mean2.032415783581555
driven_any_median2.204135049430076
driven_any_min1.183464271268439
driven_lanedir_consec_max2.0394597813322513
driven_lanedir_consec_mean1.3061144675767544
driven_lanedir_consec_min0.5892936828338827
driven_lanedir_max2.0394597813322513
driven_lanedir_mean1.3061539746756077
driven_lanedir_median1.355292293341586
driven_lanedir_min0.5896887538224139
get_state_dump_max0.021592747370402017
get_state_dump_mean0.021365479495317426
get_state_dump_median0.02134269967620626
get_state_dump_min0.021154014269510905
get_ui_image_max0.04871425628662109
get_ui_image_mean0.04754237348583718
get_ui_image_median0.047439570824305215
get_ui_image_min0.046811954975128175
in-drivable-lane_max10.450000000000085
in-drivable-lane_mean4.790000000000043
in-drivable-lane_min1.149999999999996
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 2.088221621494051, "get_ui_image": 0.04871425628662109, "step_physics": 0.09365431388219198, "survival_time": 14.950000000000076, "driven_lanedir": 0.684815132081303, "get_state_dump": 0.02125412305196126, "sim_render-ego": 0.009207344055175782, "in-drivable-lane": 10.450000000000085, "agent_compute-ego": 0.03301758925120036, "deviation-heading": 0.7721981656092478, "complete-iteration": 0.27457778374354047, "set_robot_commands": 0.009138786792755128, "deviation-center-line": 0.24417688011397137, "driven_lanedir_consec": 0.684815132081303, "sim_compute_sim_state": 0.02378874540328979, "sim_compute_performance-ego": 0.007916804949442545, "sim_compute_robot_state-ego": 0.01395404020945231, "sim_compute_robot_state-parked0": 0.013667294184366862}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.2665382973678447, "get_ui_image": 0.04726344188054403, "step_physics": 0.09172996044158936, "survival_time": 14.950000000000076, "driven_lanedir": 2.0394597813322513, "get_state_dump": 0.021227568785349527, "sim_render-ego": 0.008085833390553793, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.03166066884994507, "deviation-heading": 1.9549411643751693, "complete-iteration": 0.2587737488746643, "set_robot_commands": 0.006579083601633708, "deviation-center-line": 0.913084601800734, "driven_lanedir_consec": 2.0394597813322513, "sim_compute_sim_state": 0.023076369762420657, "sim_compute_performance-ego": 0.006519204775492351, "sim_compute_robot_state-ego": 0.010637004375457764, "sim_compute_robot_state-parked0": 0.011734561125437418}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.202788645241231, "get_ui_image": 0.04744744062423706, "step_physics": 0.09011461973190309, "survival_time": 14.950000000000076, "driven_lanedir": 1.5756250610714435, "get_state_dump": 0.02147996664047241, "sim_render-ego": 0.007932395140329996, "in-drivable-lane": 3.5500000000000496, "agent_compute-ego": 0.03302102247873942, "deviation-heading": 2.452007768478182, "complete-iteration": 0.2574145285288493, "set_robot_commands": 0.006612323919932048, "deviation-center-line": 0.8625836542909079, "driven_lanedir_consec": 1.5756250610714435, "sim_compute_sim_state": 0.02185978174209595, "sim_compute_performance-ego": 0.006505440870920817, "sim_compute_robot_state-ego": 0.01047360102335612, "sim_compute_robot_state-parked0": 0.011692136923472086}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.1556663708185724, "get_ui_image": 0.0473914909362793, "step_physics": 0.09004596710205078, "survival_time": 14.950000000000076, "driven_lanedir": 1.415103059653982, "get_state_dump": 0.021154014269510905, "sim_render-ego": 0.008039248784383139, "in-drivable-lane": 3.950000000000051, "agent_compute-ego": 0.03176324446996053, "deviation-heading": 2.6244867850570692, "complete-iteration": 0.25628304640452065, "set_robot_commands": 0.006704405943552653, "deviation-center-line": 0.920636718938006, "driven_lanedir_consec": 1.415103059653982, "sim_compute_sim_state": 0.021678908665974935, "sim_compute_performance-ego": 0.006562876701354981, "sim_compute_robot_state-ego": 0.010948901971181231, "sim_compute_robot_state-parked0": 0.011733121871948242}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.5263898706455037, "get_ui_image": 0.04797429173857301, "step_physics": 0.09053310850164392, "survival_time": 9.099999999999994, "driven_lanedir": 0.615671491379301, "get_state_dump": 0.021392485597631433, "sim_render-ego": 0.008124254562042571, "in-drivable-lane": 5.25, "agent_compute-ego": 0.03155247195736392, "deviation-heading": 0.7868764711489243, "complete-iteration": 0.25201564961737327, "set_robot_commands": 0.006593320395920303, "deviation-center-line": 0.19340442902373295, "driven_lanedir_consec": 0.615671491379301, "sim_compute_sim_state": 0.01669545488043146, "sim_compute_performance-ego": 0.006419800140045501, "sim_compute_robot_state-ego": 0.01069794644366254, "sim_compute_robot_state-parked0": 0.011762173621209113}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.183464271268439, "get_ui_image": 0.047725419777666214, "step_physics": 0.09023496319103792, "survival_time": 8.649999999999988, "driven_lanedir": 0.5896887538224139, "get_state_dump": 0.02145139054755944, "sim_render-ego": 0.007953485312489416, "in-drivable-lane": 4.799999999999994, "agent_compute-ego": 0.030879587107311098, "deviation-heading": 0.9669539348161976, "complete-iteration": 0.2506439933887107, "set_robot_commands": 0.00667867770773827, "deviation-center-line": 0.20985697888305943, "driven_lanedir_consec": 0.5892936828338827, "sim_compute_sim_state": 0.016601438467213184, "sim_compute_performance-ego": 0.00644156285104035, "sim_compute_robot_state-ego": 0.010788721845329152, "sim_compute_robot_state-parked0": 0.011628426568356552}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.229848315292156, "get_ui_image": 0.04743170102437337, "step_physics": 0.10140972216924032, "survival_time": 14.950000000000076, "driven_lanedir": 1.784944302862862, "get_state_dump": 0.02129291375478109, "sim_render-ego": 0.007885178724924724, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.032146130402882896, "deviation-heading": 2.6557337358300503, "complete-iteration": 0.26797675689061484, "set_robot_commands": 0.006615819931030273, "deviation-center-line": 0.982082143940945, "driven_lanedir_consec": 1.784944302862862, "sim_compute_sim_state": 0.02204762538274129, "sim_compute_performance-ego": 0.006413480440775553, "sim_compute_robot_state-ego": 0.010842060248057048, "sim_compute_robot_state-parked0": 0.01162917137145996}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.2054814536189205, "get_ui_image": 0.047171633243560794, "step_physics": 0.10123318592707316, "survival_time": 14.950000000000076, "driven_lanedir": 1.8820204338309163, "get_state_dump": 0.02127929131189982, "sim_render-ego": 0.007898624738057454, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.03192506949106852, "deviation-heading": 2.264180254531156, "complete-iteration": 0.26724446058273316, "set_robot_commands": 0.006644076506296794, "deviation-center-line": 1.057071215645266, "driven_lanedir_consec": 1.8820204338309163, "sim_compute_sim_state": 0.021859740416208903, "sim_compute_performance-ego": 0.006411545276641846, "sim_compute_robot_state-ego": 0.010827418168385824, "sim_compute_robot_state-parked0": 0.011732462247212729}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 2.2144378229807806, "get_ui_image": 0.04749210437138875, "step_physics": 0.09257784684499104, "survival_time": 14.950000000000076, "driven_lanedir": 1.2954815270291895, "get_state_dump": 0.021592747370402017, "sim_render-ego": 0.008175060749053956, "in-drivable-lane": 7.000000000000098, "agent_compute-ego": 0.031806886196136475, "deviation-heading": 0.933229550525258, "complete-iteration": 0.25993460178375244, "set_robot_commands": 0.007327366669972738, "deviation-center-line": 0.6769153660896938, "driven_lanedir_consec": 1.2954815270291895, "sim_compute_sim_state": 0.02044278621673584, "sim_compute_performance-ego": 0.006826410293579102, "sim_compute_robot_state-ego": 0.011481645107269288, "sim_compute_robot_state-parked0": 0.01195126454035441}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 2.2513211670880495, "get_ui_image": 0.046811954975128175, "step_physics": 0.08963293234507243, "survival_time": 14.950000000000076, "driven_lanedir": 1.1787302036924148, "get_state_dump": 0.021530293623606363, "sim_render-ego": 0.007989447911580403, "in-drivable-lane": 7.750000000000095, "agent_compute-ego": 0.03229713757832845, "deviation-heading": 0.9373750071020684, "complete-iteration": 0.25458943923314414, "set_robot_commands": 0.006632016499837239, "deviation-center-line": 0.6043808683307668, "driven_lanedir_consec": 1.1787302036924148, "sim_compute_sim_state": 0.0204841677347819, "sim_compute_performance-ego": 0.006538224220275879, "sim_compute_robot_state-ego": 0.010719289779663086, "sim_compute_robot_state-parked0": 0.011693065961201983}}
set_robot_commands_max0.009138786792755128
set_robot_commands_mean0.006952587796866916
set_robot_commands_median0.006638046503067017
set_robot_commands_min0.006579083601633708
sim_compute_performance-ego_max0.007916804949442545
sim_compute_performance-ego_mean0.0066555350519568925
sim_compute_performance-ego_median0.006512322823206584
sim_compute_performance-ego_min0.006411545276641846
sim_compute_robot_state-ego_max0.01395404020945231
sim_compute_robot_state-ego_mean0.011137062917181436
sim_compute_robot_state-ego_median0.010808070006857486
sim_compute_robot_state-ego_min0.01047360102335612
sim_compute_robot_state-parked0_max0.013667294184366862
sim_compute_robot_state-parked0_mean0.011922367841501936
sim_compute_robot_state-parked0_median0.011732792059580483
sim_compute_robot_state-parked0_min0.011628426568356552
sim_compute_sim_state_max0.02378874540328979
sim_compute_sim_state_mean0.020853501867189393
sim_compute_sim_state_median0.02176932454109192
sim_compute_sim_state_min0.016601438467213184
sim_render-ego_max0.009207344055175782
sim_render-ego_mean0.008129087336859124
sim_render-ego_median0.008014348347981771
sim_render-ego_min0.007885178724924724
simulation-passed1
step_physics_max0.10140972216924032
step_physics_mean0.0931166620136794
step_physics_median0.09113153447161663
step_physics_min0.08963293234507243
survival_time_max14.950000000000076
survival_time_mean13.73500000000006
survival_time_min8.649999999999988
No reset possible