Duckietown Challenges Home Challenges Submissions

Evaluator 2327

ID2327
evaluatorafdaniele04-b953b5d8021c-1
ownerI don't have one πŸ˜€
machinebox0
processafdaniele04-b953b5d8021c-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success34 42484
# timeout1 43362
# failed7 42877
# error12 42519
# aborted5 43777
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4410511781Kaiyi ChenΒ πŸ‡ΊπŸ‡ΈKK Netaido5-LF-sim-validationLFv-simfailednoafdaniele04-b953b5d8021c-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4408311779Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:07:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7123446303575955
survival_time_median13.575000000000058
deviation-center-line_median0.3287522071435293
in-drivable-lane_median5.575000000000038


other stats
agent_compute-ego_max0.01645812193552653
agent_compute-ego_mean0.015749831642796485
agent_compute-ego_median0.015840021522041333
agent_compute-ego_min0.014861161591576749
complete-iteration_max0.1899270780881246
complete-iteration_mean0.17969200149314477
complete-iteration_median0.17934146722918304
complete-iteration_min0.17015799342608842
deviation-center-line_max0.7098689072639285
deviation-center-line_mean0.385793101215007
deviation-center-line_min0.17579908330904082
deviation-heading_max2.9281538831176603
deviation-heading_mean1.7164200629943844
deviation-heading_median1.6587077701467978
deviation-heading_min0.6201108285662824
driven_any_max3.780354335824317
driven_any_mean3.1714333854592587
driven_any_median3.114025043225913
driven_any_min2.6773291195608913
driven_lanedir_consec_max3.4393895914539216
driven_lanedir_consec_mean1.9123912738549171
driven_lanedir_consec_min0.7854862432505558
driven_lanedir_max3.4393895914539216
driven_lanedir_mean1.9123912738549171
driven_lanedir_median1.7123446303575955
driven_lanedir_min0.7854862432505558
get_duckie_state_max1.8858909606933592e-06
get_duckie_state_mean1.8525970749821752e-06
get_duckie_state_median1.854987806110291e-06
get_duckie_state_min1.8145217270147605e-06
get_robot_state_max0.009910234610239665
get_robot_state_mean0.009783970062198534
get_robot_state_median0.00982953151067098
get_robot_state_min0.009566582617212514
get_state_dump_max0.007782847117008775
get_state_dump_mean0.007747417845800692
get_state_dump_median0.007763019402821859
get_state_dump_min0.007680785460550277
get_ui_image_max0.031700913111368814
get_ui_image_mean0.030700606819532787
get_ui_image_median0.030767475800080733
get_ui_image_min0.02956656256660086
in-drivable-lane_max10.000000000000052
in-drivable-lane_mean5.762500000000039
in-drivable-lane_min1.900000000000027
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.6773291195608913, "get_ui_image": 0.031298247250643646, "step_physics": 0.0819317005467757, "survival_time": 10.450000000000014, "driven_lanedir": 1.3965801898193937, "get_state_dump": 0.007782847117008775, "sim_render-ego": 0.004599834743298982, "get_robot_state": 0.009909868240356444, "get_duckie_state": 1.8503106952283944e-06, "in-drivable-lane": 5.650000000000023, "agent_compute-ego": 0.015353099010777816, "deviation-heading": 0.6201108285662824, "complete-iteration": 0.17983718237808446, "set_robot_commands": 0.0037518414584073153, "deviation-center-line": 0.17579908330904082, "driven_lanedir_consec": 1.3965801898193937, "sim_compute_sim_state": 0.022041709799515575, "sim_compute_performance-ego": 0.0030723941383179296}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.780354335824317, "get_ui_image": 0.03023670434951782, "step_physics": 0.08098973274230957, "survival_time": 14.950000000000076, "driven_lanedir": 3.4393895914539216, "get_state_dump": 0.007772608598073324, "sim_render-ego": 0.004564563433329265, "get_robot_state": 0.009910234610239665, "get_duckie_state": 1.8858909606933592e-06, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.01632694403330485, "deviation-heading": 2.9281538831176603, "complete-iteration": 0.17884575208028158, "set_robot_commands": 0.0036057281494140626, "deviation-center-line": 0.7098689072639285, "driven_lanedir_consec": 3.4393895914539216, "sim_compute_sim_state": 0.02216996908187866, "sim_compute_performance-ego": 0.003174636363983154}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0603689013378625, "get_ui_image": 0.031700913111368814, "step_physics": 0.09106467803319296, "survival_time": 14.950000000000076, "driven_lanedir": 0.7854862432505558, "get_state_dump": 0.0077534302075703936, "sim_render-ego": 0.004807593822479248, "get_robot_state": 0.009749194780985517, "get_duckie_state": 1.8596649169921877e-06, "in-drivable-lane": 10.000000000000052, "agent_compute-ego": 0.01645812193552653, "deviation-heading": 2.5206690441845754, "complete-iteration": 0.1899270780881246, "set_robot_commands": 0.003813447952270508, "deviation-center-line": 0.3873161193488004, "driven_lanedir_consec": 0.7854862432505558, "sim_compute_sim_state": 0.02144279479980469, "sim_compute_performance-ego": 0.003042012055714925}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1676811851139632, "get_ui_image": 0.02956656256660086, "step_physics": 0.07489482105755416, "survival_time": 12.200000000000038, "driven_lanedir": 2.0281090708957974, "get_state_dump": 0.007680785460550277, "sim_render-ego": 0.004349069517166888, "get_robot_state": 0.009566582617212514, "get_duckie_state": 1.8145217270147605e-06, "in-drivable-lane": 5.500000000000054, "agent_compute-ego": 0.014861161591576749, "deviation-heading": 0.7967464961090204, "complete-iteration": 0.17015799342608842, "set_robot_commands": 0.003671908964876269, "deviation-center-line": 0.27018829493825824, "driven_lanedir_consec": 2.0281090708957974, "sim_compute_sim_state": 0.022690198460563284, "sim_compute_performance-ego": 0.0027822197460737387}}
set_robot_commands_max0.003813447952270508
set_robot_commands_mean0.0037107316312420383
set_robot_commands_median0.003711875211641792
set_robot_commands_min0.0036057281494140626
sim_compute_performance-ego_max0.003174636363983154
sim_compute_performance-ego_mean0.003017815576022437
sim_compute_performance-ego_median0.0030572030970164275
sim_compute_performance-ego_min0.0027822197460737387
sim_compute_sim_state_max0.022690198460563284
sim_compute_sim_state_mean0.02208616803544055
sim_compute_sim_state_median0.02210583944069712
sim_compute_sim_state_min0.02144279479980469
sim_render-ego_max0.004807593822479248
sim_render-ego_mean0.004580265379068596
sim_render-ego_median0.004582199088314124
sim_render-ego_min0.004349069517166888
simulation-passed1
step_physics_max0.09106467803319296
step_physics_mean0.0822202330949581
step_physics_median0.08146071664454263
step_physics_min0.07489482105755416
survival_time_max14.950000000000076
survival_time_mean13.13750000000005
survival_time_min10.450000000000014
No reset possible
4404411778Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7798473662391885
survival_time_median14.950000000000076
deviation-center-line_median0.5595102733491254
in-drivable-lane_median2.7750000000000097


other stats
agent_compute-ego_max0.018852496147155763
agent_compute-ego_mean0.017219918201554496
agent_compute-ego_median0.01695124036111172
agent_compute-ego_min0.016124695936838785
complete-iteration_max0.25112924373374795
complete-iteration_mean0.21497130979157092
complete-iteration_median0.21200699925422667
complete-iteration_min0.18474199692408244
deviation-center-line_max0.7256904446464078
deviation-center-line_mean0.5722035624776927
deviation-center-line_min0.4441032585661124
deviation-heading_max2.907924535995227
deviation-heading_mean2.3460407665922345
deviation-heading_median2.449726955219398
deviation-heading_min1.576784619934915
driven_any_max3.980096468744335
driven_any_mean3.4898699590264672
driven_any_median3.5477853243733772
driven_any_min2.8838127186147795
driven_lanedir_consec_max3.56154339142369
driven_lanedir_consec_mean2.637612021580029
driven_lanedir_consec_min1.4292099624180503
driven_lanedir_max3.56154339142369
driven_lanedir_mean2.637612021580029
driven_lanedir_median2.7798473662391885
driven_lanedir_min1.4292099624180503
get_duckie_state_max1.6790515971633624e-06
get_duckie_state_mean1.5951664942615437e-06
get_duckie_state_median1.5711784362792968e-06
get_duckie_state_min1.5592575073242188e-06
get_robot_state_max0.011262634595235188
get_robot_state_mean0.010601196727662717
get_robot_state_median0.01059035746556408
get_robot_state_min0.009961437384287517
get_state_dump_max0.008603252329916324
get_state_dump_mean0.008132266143582902
get_state_dump_median0.008088798125584919
get_state_dump_min0.007748215993245443
get_ui_image_max0.041399682467838504
get_ui_image_mean0.03622301382463683
get_ui_image_median0.03608195463816325
get_ui_image_min0.031328463554382326
in-drivable-lane_max7.150000000000004
in-drivable-lane_mean3.5625000000000067
in-drivable-lane_min1.5500000000000025
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.821728933825577, "get_ui_image": 0.04002647002538045, "step_physics": 0.11195926825205484, "survival_time": 14.950000000000076, "driven_lanedir": 2.928550331415974, "get_state_dump": 0.0083505908648173, "sim_render-ego": 0.005297703742980957, "get_robot_state": 0.011262634595235188, "get_duckie_state": 1.5751520792643229e-06, "in-drivable-lane": 3.850000000000016, "agent_compute-ego": 0.018852496147155763, "deviation-heading": 2.183502331765441, "complete-iteration": 0.23349001328150432, "set_robot_commands": 0.003851929505666097, "deviation-center-line": 0.5180635748739664, "driven_lanedir_consec": 2.928550331415974, "sim_compute_sim_state": 0.030538268089294433, "sim_compute_performance-ego": 0.0032555882136027017}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.980096468744335, "get_ui_image": 0.031328463554382326, "step_physics": 0.08477676788965861, "survival_time": 14.950000000000076, "driven_lanedir": 3.56154339142369, "get_state_dump": 0.007827005386352538, "sim_render-ego": 0.00473935604095459, "get_robot_state": 0.009961437384287517, "get_duckie_state": 1.5672047932942708e-06, "in-drivable-lane": 1.7000000000000035, "agent_compute-ego": 0.016124695936838785, "deviation-heading": 2.907924535995227, "complete-iteration": 0.18474199692408244, "set_robot_commands": 0.003662033081054688, "deviation-center-line": 0.6009569718242844, "driven_lanedir_consec": 3.56154339142369, "sim_compute_sim_state": 0.02307699998219808, "sim_compute_performance-ego": 0.0031498193740844725}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.273841714921177, "get_ui_image": 0.032137439250946045, "step_physics": 0.0898634958267212, "survival_time": 14.950000000000076, "driven_lanedir": 1.4292099624180503, "get_state_dump": 0.007748215993245443, "sim_render-ego": 0.00486630121866862, "get_robot_state": 0.010060782432556151, "get_duckie_state": 1.5592575073242188e-06, "in-drivable-lane": 7.150000000000004, "agent_compute-ego": 0.01683765967686971, "deviation-heading": 2.715951578673355, "complete-iteration": 0.19052398522694905, "set_robot_commands": 0.003652168909708659, "deviation-center-line": 0.7256904446464078, "driven_lanedir_consec": 1.4292099624180503, "sim_compute_sim_state": 0.022223099867502847, "sim_compute_performance-ego": 0.003029020627339681}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8838127186147795, "get_ui_image": 0.041399682467838504, "step_physics": 0.12289669603671668, "survival_time": 10.600000000000016, "driven_lanedir": 2.6311444010624023, "get_state_dump": 0.008603252329916324, "sim_render-ego": 0.00494566503560768, "get_robot_state": 0.011119932498572007, "get_duckie_state": 1.6790515971633624e-06, "in-drivable-lane": 1.5500000000000025, "agent_compute-ego": 0.01706482104535373, "deviation-heading": 1.576784619934915, "complete-iteration": 0.25112924373374795, "set_robot_commands": 0.0037269491069721727, "deviation-center-line": 0.4441032585661124, "driven_lanedir_consec": 2.6311444010624023, "sim_compute_sim_state": 0.037957585082863864, "sim_compute_performance-ego": 0.003316219122904652}}
set_robot_commands_max0.003851929505666097
set_robot_commands_mean0.003723270150850404
set_robot_commands_median0.00369449109401343
set_robot_commands_min0.003652168909708659
sim_compute_performance-ego_max0.003316219122904652
sim_compute_performance-ego_mean0.003187661834482877
sim_compute_performance-ego_median0.003202703793843587
sim_compute_performance-ego_min0.003029020627339681
sim_compute_sim_state_max0.037957585082863864
sim_compute_sim_state_mean0.028448988255464804
sim_compute_sim_state_median0.026807634035746257
sim_compute_sim_state_min0.022223099867502847
sim_render-ego_max0.005297703742980957
sim_render-ego_mean0.004962256509552961
sim_render-ego_median0.00490598312713815
sim_render-ego_min0.00473935604095459
simulation-passed1
step_physics_max0.12289669603671668
step_physics_mean0.10237405700128784
step_physics_median0.100911382039388
step_physics_min0.08477676788965861
survival_time_max14.950000000000076
survival_time_mean13.862500000000065
survival_time_min10.600000000000016
No reset possible
4396711772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simabortednoafdaniele04-b953b5d8021c-10:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4396611772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simabortednoafdaniele04-b953b5d8021c-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4396511772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simabortednoafdaniele04-b953b5d8021c-10:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4396411772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simabortednoafdaniele04-b953b5d8021c-10:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4386811764Ayman ShamsΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01474200407663981
agent_compute-ego_mean0.013857510884602863
agent_compute-ego_median0.013906894127527871
agent_compute-ego_min0.0128742512067159
complete-iteration_max0.14793968200683594
complete-iteration_mean0.14564790884653725
complete-iteration_median0.14732118169466654
complete-iteration_min0.14000958998998006
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.4217694600423176e-06
get_duckie_state_mean1.354217529296875e-06
get_duckie_state_median1.3967355092366537e-06
get_duckie_state_min1.201629638671875e-06
get_robot_state_max0.009048717816670736
get_robot_state_mean0.00884495755036672
get_robot_state_median0.008904765844345092
get_robot_state_min0.008521580696105957
get_state_dump_max0.00750670591990153
get_state_dump_mean0.007328614791234334
get_state_dump_median0.007273326317469278
get_state_dump_min0.007261100610097249
get_ui_image_max0.026523772875467935
get_ui_image_mean0.025279440482457477
get_ui_image_median0.025608081817626954
get_ui_image_min0.023377825419108073
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.025635510285695395, "step_physics": 0.06499788284301758, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.00750670591990153, "sim_render-ego": 0.004058250586191813, "get_robot_state": 0.009048717816670736, "get_duckie_state": 1.4217694600423176e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014108408292134602, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.14684609174728394, "set_robot_commands": 0.0035587024688720705, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.015091656843821208, "sim_compute_performance-ego": 0.002752213478088379}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.025580653349558512, "step_physics": 0.06601732969284058, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.007261100610097249, "sim_render-ego": 0.004268235365549724, "get_robot_state": 0.00893032709757487, "get_duckie_state": 1.384417215983073e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01474200407663981, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.14793968200683594, "set_robot_commands": 0.0036156773567199703, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.014583412806193036, "sim_compute_performance-ego": 0.0028505373001098634}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.026523772875467935, "step_physics": 0.06606607834498088, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.007283929983774821, "sim_render-ego": 0.004037603537241618, "get_robot_state": 0.008879204591115316, "get_duckie_state": 1.4090538024902344e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013705379962921142, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.14779627164204914, "set_robot_commands": 0.003303960959116618, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.015093465646107992, "sim_compute_performance-ego": 0.0028129847844441734}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.023377825419108073, "step_physics": 0.06354674180348714, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.007262722651163737, "sim_render-ego": 0.003725638389587402, "get_robot_state": 0.008521580696105957, "get_duckie_state": 1.201629638671875e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0128742512067159, "deviation-heading": 0.486072248607516, "complete-iteration": 0.14000958998998006, "set_robot_commands": 0.0029441054662068685, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.015237027804056804, "sim_compute_performance-ego": 0.002434259255727132}}
set_robot_commands_max0.0036156773567199703
set_robot_commands_mean0.003355611562728882
set_robot_commands_median0.0034313317139943443
set_robot_commands_min0.0029441054662068685
sim_compute_performance-ego_max0.0028505373001098634
sim_compute_performance-ego_mean0.002712498704592387
sim_compute_performance-ego_median0.002782599131266276
sim_compute_performance-ego_min0.002434259255727132
sim_compute_sim_state_max0.015237027804056804
sim_compute_sim_state_mean0.01500139077504476
sim_compute_sim_state_median0.0150925612449646
sim_compute_sim_state_min0.014583412806193036
sim_render-ego_max0.004268235365549724
sim_render-ego_mean0.0040224319696426395
sim_render-ego_median0.004047927061716716
sim_render-ego_min0.003725638389587402
simulation-passed1
step_physics_max0.06606607834498088
step_physics_mean0.06515700817108154
step_physics_median0.06550760626792908
step_physics_min0.06354674180348714
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4379311744Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.155135474913016
survival_time_median14.950000000000076
deviation-center-line_median0.6827396258225591
in-drivable-lane_median4.225000000000058


other stats
agent_compute-ego_max0.012023953596750896
agent_compute-ego_mean0.011543092882009248
agent_compute-ego_median0.011480099757512413
agent_compute-ego_min0.01118821841626128
complete-iteration_max0.1315696180359391
complete-iteration_mean0.1274472533786264
complete-iteration_median0.12682311336199442
complete-iteration_min0.12457316875457763
deviation-center-line_max0.9302136043289906
deviation-center-line_mean0.6830186325941497
deviation-center-line_min0.43638167440249026
deviation-heading_max3.827607463430509
deviation-heading_mean2.9352725622743803
deviation-heading_median2.846788753371277
deviation-heading_min2.219905278924459
driven_any_max3.3509854919230526
driven_any_mean3.1110576830750274
driven_any_median3.101297436698518
driven_any_min2.890650366980021
driven_lanedir_consec_max3.0254763991100058
driven_lanedir_consec_mean2.216974488367801
driven_lanedir_consec_min1.5321506045351647
driven_lanedir_max3.0254763991100058
driven_lanedir_mean2.216974488367801
driven_lanedir_median2.155135474913016
driven_lanedir_min1.5321506045351647
get_duckie_state_max1.1531511942545571e-06
get_duckie_state_mean1.0903971911133487e-06
get_duckie_state_median1.0824794611654992e-06
get_duckie_state_min1.0434786478678386e-06
get_robot_state_max0.008243402640024822
get_robot_state_mean0.008175544861919624
get_robot_state_median0.008181077885562067
get_robot_state_min0.008096621036529542
get_state_dump_max0.007085655530293783
get_state_dump_mean0.006922020600190175
get_state_dump_median0.006893788746894227
get_state_dump_min0.006814849376678467
get_ui_image_max0.02269299463792281
get_ui_image_mean0.022312472155599884
get_ui_image_median0.022261749903361
get_ui_image_min0.02203339417775472
in-drivable-lane_max6.1000000000000325
in-drivable-lane_mean4.037500000000039
in-drivable-lane_min1.6000000000000068
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.3509854919230526, "get_ui_image": 0.022141302426656087, "step_physics": 0.053347853819529216, "survival_time": 14.950000000000076, "driven_lanedir": 3.0254763991100058, "get_state_dump": 0.006874123414357503, "sim_render-ego": 0.0036201675732930503, "get_robot_state": 0.008128310044606527, "get_duckie_state": 1.1531511942545571e-06, "in-drivable-lane": 1.6000000000000068, "agent_compute-ego": 0.011431070963541666, "deviation-heading": 2.699004084633587, "complete-iteration": 0.12457316875457763, "set_robot_commands": 0.002771787643432617, "deviation-center-line": 0.9302136043289906, "driven_lanedir_consec": 3.0254763991100058, "sim_compute_sim_state": 0.013855892817179362, "sim_compute_performance-ego": 0.0023259925842285156}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.263548681022342, "get_ui_image": 0.02203339417775472, "step_physics": 0.055433492660522464, "survival_time": 14.950000000000076, "driven_lanedir": 2.1328200028789657, "get_state_dump": 0.006814849376678467, "sim_render-ego": 0.003630905946095784, "get_robot_state": 0.008096621036529542, "get_duckie_state": 1.0434786478678386e-06, "in-drivable-lane": 5.400000000000077, "agent_compute-ego": 0.012023953596750896, "deviation-heading": 2.9945734221089664, "complete-iteration": 0.1264043092727661, "set_robot_commands": 0.002662490208943685, "deviation-center-line": 0.5345790879908119, "driven_lanedir_consec": 2.1328200028789657, "sim_compute_sim_state": 0.013325727780659994, "sim_compute_performance-ego": 0.002305506865183512}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.939046192374693, "get_ui_image": 0.02238219738006592, "step_physics": 0.05579764127731323, "survival_time": 14.950000000000076, "driven_lanedir": 1.5321506045351647, "get_state_dump": 0.007085655530293783, "sim_render-ego": 0.003639864921569824, "get_robot_state": 0.008243402640024822, "get_duckie_state": 1.0585784912109376e-06, "in-drivable-lane": 6.1000000000000325, "agent_compute-ego": 0.011529128551483154, "deviation-heading": 3.827607463430509, "complete-iteration": 0.12724191745122274, "set_robot_commands": 0.0026882815361022948, "deviation-center-line": 0.8309001636543062, "driven_lanedir_consec": 1.5321506045351647, "sim_compute_sim_state": 0.01347443660100301, "sim_compute_performance-ego": 0.002323284943898519}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.890650366980021, "get_ui_image": 0.02269299463792281, "step_physics": 0.057680954617902264, "survival_time": 12.100000000000035, "driven_lanedir": 2.177450946947067, "get_state_dump": 0.006913454079430951, "sim_render-ego": 0.003611505524186064, "get_robot_state": 0.008233845726517607, "get_duckie_state": 1.1063804311200607e-06, "in-drivable-lane": 3.05000000000004, "agent_compute-ego": 0.01118821841626128, "deviation-heading": 2.219905278924459, "complete-iteration": 0.1315696180359391, "set_robot_commands": 0.0026979347891058804, "deviation-center-line": 0.43638167440249026, "driven_lanedir_consec": 2.177450946947067, "sim_compute_sim_state": 0.016158591617237438, "sim_compute_performance-ego": 0.0023142099380493164}}
set_robot_commands_max0.002771787643432617
set_robot_commands_mean0.002705123544396119
set_robot_commands_median0.002693108162604088
set_robot_commands_min0.002662490208943685
sim_compute_performance-ego_max0.0023259925842285156
sim_compute_performance-ego_mean0.0023172485828399656
sim_compute_performance-ego_median0.0023187474409739174
sim_compute_performance-ego_min0.002305506865183512
sim_compute_sim_state_max0.016158591617237438
sim_compute_sim_state_mean0.014203662204019953
sim_compute_sim_state_median0.013665164709091186
sim_compute_sim_state_min0.013325727780659994
sim_render-ego_max0.003639864921569824
sim_render-ego_mean0.00362561099128618
sim_render-ego_median0.003625536759694417
sim_render-ego_min0.003611505524186064
simulation-passed1
step_physics_max0.057680954617902264
step_physics_mean0.05556498559381679
step_physics_median0.05561556696891785
step_physics_min0.053347853819529216
survival_time_max14.950000000000076
survival_time_mean14.237500000000068
survival_time_min12.100000000000035
No reset possible
4378611743Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.83132713214289
survival_time_median14.950000000000076
deviation-center-line_median0.7505272096642476
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.012429814338684082
agent_compute-ego_mean0.011951168830217754
agent_compute-ego_median0.011859585046768187
agent_compute-ego_min0.011655690888650552
complete-iteration_max0.13193568865458172
complete-iteration_mean0.12571631493526775
complete-iteration_median0.12403723324056624
complete-iteration_min0.12285510460535684
deviation-center-line_max1.3524871859354806
deviation-center-line_mean0.8223460353011112
deviation-center-line_min0.435842535940469
deviation-heading_max6.075952616173626
deviation-heading_mean3.2289944518982296
deviation-heading_median2.5519169159120336
deviation-heading_min1.7361913595952263
driven_any_max2.3515903419679565
driven_any_mean2.1073168470962327
driven_any_median2.1104496171879963
driven_any_min1.8567778120409824
driven_lanedir_consec_max2.3004224573531205
driven_lanedir_consec_mean1.685041924552658
driven_lanedir_consec_min0.7770909765717327
driven_lanedir_max2.3004224573531205
driven_lanedir_mean1.912633425223772
driven_lanedir_median1.9668747165543956
driven_lanedir_min1.4163618104331763
get_duckie_state_max1.5314420064290364e-06
get_duckie_state_mean1.4739248256322425e-06
get_duckie_state_median1.5079975128173829e-06
get_duckie_state_min1.3482622704651678e-06
get_robot_state_max0.008316365083058675
get_robot_state_mean0.008206880119516686
get_robot_state_median0.008178256803898484
get_robot_state_min0.0081546417872111
get_state_dump_max0.007213540077209472
get_state_dump_mean0.006992400305934001
get_state_dump_median0.006979663009379801
get_state_dump_min0.006796735127766927
get_ui_image_max0.022360014120737712
get_ui_image_mean0.022178566179941836
get_ui_image_median0.02213193520361333
get_ui_image_min0.02209038019180298
in-drivable-lane_max2.1500000000000306
in-drivable-lane_mean0.6125000000000074
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8567778120409824, "get_ui_image": 0.022129091112894784, "step_physics": 0.05284891690749789, "survival_time": 11.450000000000028, "driven_lanedir": 1.4163618104331763, "get_state_dump": 0.006849940687287843, "sim_render-ego": 0.003601925862408101, "get_robot_state": 0.008185991553760512, "get_duckie_state": 1.3482622704651678e-06, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.011655690888650552, "deviation-heading": 2.2765109713094693, "complete-iteration": 0.12415475616288496, "set_robot_commands": 0.0027233461105146783, "deviation-center-line": 0.435842535940469, "driven_lanedir_consec": 1.4163618104331763, "sim_compute_sim_state": 0.01375650943106439, "sim_compute_performance-ego": 0.002324416647831946}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.3110212547571445, "get_ui_image": 0.02209038019180298, "step_physics": 0.05285249551137288, "survival_time": 14.950000000000076, "driven_lanedir": 2.2462924538526035, "get_state_dump": 0.006796735127766927, "sim_render-ego": 0.003626083532969157, "get_robot_state": 0.0081546417872111, "get_duckie_state": 1.5266736348470052e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01184517780939738, "deviation-heading": 2.8273228605145975, "complete-iteration": 0.12391971031824749, "set_robot_commands": 0.002715976238250732, "deviation-center-line": 0.7895058417336565, "driven_lanedir_consec": 2.2462924538526035, "sim_compute_sim_state": 0.013423960208892822, "sim_compute_performance-ego": 0.002333699862162272}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.909877979618848, "get_ui_image": 0.022360014120737712, "step_physics": 0.05200833002726237, "survival_time": 14.950000000000076, "driven_lanedir": 1.687456979256188, "get_state_dump": 0.007109385331471761, "sim_render-ego": 0.0035798438390096028, "get_robot_state": 0.008170522054036459, "get_duckie_state": 1.5314420064290364e-06, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.011873992284138995, "deviation-heading": 6.075952616173626, "complete-iteration": 0.12285510460535684, "set_robot_commands": 0.0026870950063069663, "deviation-center-line": 0.7115485775948387, "driven_lanedir_consec": 0.7770909765717327, "sim_compute_sim_state": 0.012680598100026448, "sim_compute_performance-ego": 0.002305891513824463}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.3515903419679565, "get_ui_image": 0.022134779294331868, "step_physics": 0.05671332518259684, "survival_time": 14.950000000000076, "driven_lanedir": 2.3004224573531205, "get_state_dump": 0.007213540077209472, "sim_render-ego": 0.003628253142038981, "get_robot_state": 0.008316365083058675, "get_duckie_state": 1.4893213907877605e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012429814338684082, "deviation-heading": 1.7361913595952263, "complete-iteration": 0.13193568865458172, "set_robot_commands": 0.0027268799146016437, "deviation-center-line": 1.3524871859354806, "driven_lanedir_consec": 2.3004224573531205, "sim_compute_sim_state": 0.016354784965515137, "sim_compute_performance-ego": 0.002336289087931315}}
set_robot_commands_max0.0027268799146016437
set_robot_commands_mean0.002713324317418505
set_robot_commands_median0.0027196611743827053
set_robot_commands_min0.0026870950063069663
sim_compute_performance-ego_max0.002336289087931315
sim_compute_performance-ego_mean0.002325074277937499
sim_compute_performance-ego_median0.0023290582549971087
sim_compute_performance-ego_min0.002305891513824463
sim_compute_sim_state_max0.016354784965515137
sim_compute_sim_state_mean0.0140539631763747
sim_compute_sim_state_median0.013590234819978604
sim_compute_sim_state_min0.012680598100026448
sim_render-ego_max0.003628253142038981
sim_render-ego_mean0.00360902659410646
sim_render-ego_median0.0036140046976886287
sim_render-ego_min0.0035798438390096028
simulation-passed1
step_physics_max0.05671332518259684
step_physics_mean0.053605766907182495
step_physics_median0.05285070620943538
step_physics_min0.05200833002726237
survival_time_max14.950000000000076
survival_time_mean14.075000000000063
survival_time_min11.450000000000028
No reset possible
4377711739Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simabortednoafdaniele04-b953b5d8021c-10:05:12
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The job has been aborted.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4374511728Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.548090496206739
survival_time_median14.950000000000076
deviation-center-line_median0.7571130776765715
in-drivable-lane_median0.3999999999999986


other stats
agent_compute-ego_max0.01207301404216502
agent_compute-ego_mean0.011889305577026344
agent_compute-ego_median0.011979340314865111
agent_compute-ego_min0.011525527636210123
complete-iteration_max0.1308909265200297
complete-iteration_mean0.12715394702288185
complete-iteration_median0.1271549872557322
complete-iteration_min0.12341488706003322
deviation-center-line_max0.869801639775941
deviation-center-line_mean0.6739741374811548
deviation-center-line_min0.3118687547955348
deviation-heading_max3.663977088941129
deviation-heading_mean2.3114498876299563
deviation-heading_median2.2096254890348854
deviation-heading_min1.1625714835089251
driven_any_max3.6133341780820754
driven_any_mean2.6099972393628024
driven_any_median2.918904484064527
driven_any_min0.98884581124008
driven_lanedir_consec_max3.5435286363851297
driven_lanedir_consec_mean2.3847561166426257
driven_lanedir_consec_min0.8993148377718927
driven_lanedir_max3.5435286363851297
driven_lanedir_mean2.3847561166426257
driven_lanedir_median2.548090496206739
driven_lanedir_min0.8993148377718927
get_duckie_state_max1.7043387535775062e-06
get_duckie_state_mean1.6185749482006916e-06
get_duckie_state_median1.6049544016520182e-06
get_duckie_state_min1.560052235921224e-06
get_robot_state_max0.008495517296366172
get_robot_state_mean0.008234583070569306
get_robot_state_median0.008167776266733805
get_robot_state_min0.00810726245244344
get_state_dump_max0.007252926031748453
get_state_dump_mean0.006946974038684329
get_state_dump_median0.006879218895443202
get_state_dump_min0.0067765323321024576
get_ui_image_max0.022288492520650228
get_ui_image_mean0.022183503927570757
get_ui_image_median0.022217281305357175
get_ui_image_min0.022010960578918454
in-drivable-lane_max4.550000000000032
in-drivable-lane_mean1.3375000000000072
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.98884581124008, "get_ui_image": 0.02218658853285383, "step_physics": 0.05150063675228912, "survival_time": 5.04999999999999, "driven_lanedir": 0.8993148377718927, "get_state_dump": 0.006961409408267181, "sim_render-ego": 0.0036193474684611407, "get_robot_state": 0.008495517296366172, "get_duckie_state": 1.7043387535775062e-06, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.01207301404216502, "deviation-heading": 1.1625714835089251, "complete-iteration": 0.12341488706003322, "set_robot_commands": 0.0028073528025409963, "deviation-center-line": 0.3118687547955348, "driven_lanedir_consec": 0.8993148377718927, "sim_compute_sim_state": 0.013309098706387057, "sim_compute_performance-ego": 0.002378813110955871}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.523564727241451, "get_ui_image": 0.022010960578918454, "step_physics": 0.05339141845703125, "survival_time": 14.950000000000076, "driven_lanedir": 3.4651785049760235, "get_state_dump": 0.0067765323321024576, "sim_render-ego": 0.003575305143992106, "get_robot_state": 0.00810726245244344, "get_duckie_state": 1.5672047932942708e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011961628595987955, "deviation-heading": 2.230858878196308, "complete-iteration": 0.12462012529373168, "set_robot_commands": 0.0026406447092692056, "deviation-center-line": 0.6750662075168711, "driven_lanedir_consec": 3.4651785049760235, "sim_compute_sim_state": 0.013752293586730958, "sim_compute_performance-ego": 0.002321742375691732}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.314244240887603, "get_ui_image": 0.022288492520650228, "step_physics": 0.05811324596405029, "survival_time": 14.950000000000076, "driven_lanedir": 1.6310024874374554, "get_state_dump": 0.006797028382619222, "sim_render-ego": 0.003657998243967692, "get_robot_state": 0.008123584588368734, "get_duckie_state": 1.560052235921224e-06, "in-drivable-lane": 4.550000000000032, "agent_compute-ego": 0.011997052033742269, "deviation-heading": 3.663977088941129, "complete-iteration": 0.12968984921773274, "set_robot_commands": 0.0027017895380655925, "deviation-center-line": 0.839159947836272, "driven_lanedir_consec": 1.6310024874374554, "sim_compute_sim_state": 0.013595585028330486, "sim_compute_performance-ego": 0.0023321859041849774}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.6133341780820754, "get_ui_image": 0.022247974077860513, "step_physics": 0.05624956687291463, "survival_time": 14.950000000000076, "driven_lanedir": 3.5435286363851297, "get_state_dump": 0.007252926031748453, "sim_render-ego": 0.003633201122283935, "get_robot_state": 0.008211967945098876, "get_duckie_state": 1.6427040100097655e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011525527636210123, "deviation-heading": 2.1883920998734623, "complete-iteration": 0.1308909265200297, "set_robot_commands": 0.0027405150731404622, "deviation-center-line": 0.869801639775941, "driven_lanedir_consec": 3.5435286363851297, "sim_compute_sim_state": 0.016602845986684163, "sim_compute_performance-ego": 0.0023428757985432943}}
set_robot_commands_max0.0028073528025409963
set_robot_commands_mean0.0027225755307540636
set_robot_commands_median0.0027211523056030274
set_robot_commands_min0.0026406447092692056
sim_compute_performance-ego_max0.002378813110955871
sim_compute_performance-ego_mean0.002343904297343969
sim_compute_performance-ego_median0.002337530851364136
sim_compute_performance-ego_min0.002321742375691732
sim_compute_sim_state_max0.016602845986684163
sim_compute_sim_state_mean0.014314955827033163
sim_compute_sim_state_median0.013673939307530724
sim_compute_sim_state_min0.013309098706387057
sim_render-ego_max0.003657998243967692
sim_render-ego_mean0.003621462994676219
sim_render-ego_median0.003626274295372538
sim_render-ego_min0.003575305143992106
simulation-passed1
step_physics_max0.05811324596405029
step_physics_mean0.054813717011571325
step_physics_median0.054820492664972936
step_physics_min0.05150063675228912
survival_time_max14.950000000000076
survival_time_mean12.475000000000056
survival_time_min5.04999999999999
No reset possible
4373411726Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.639058469285787
survival_time_median14.950000000000076
deviation-center-line_median0.8147431107849848
in-drivable-lane_median3.2750000000000425


other stats
agent_compute-ego_max0.011991400718688964
agent_compute-ego_mean0.011645412955965316
agent_compute-ego_median0.011598203409285772
agent_compute-ego_min0.011393844286600749
complete-iteration_max0.12823497295379638
complete-iteration_mean0.1253251517102832
complete-iteration_median0.12530793195679074
complete-iteration_min0.12244976997375488
deviation-center-line_max0.916909161104114
deviation-center-line_mean0.767152500758558
deviation-center-line_min0.5222146203601485
deviation-heading_max6.654881018988008
deviation-heading_mean5.451244219344465
deviation-heading_median6.006019796064449
deviation-heading_min3.138056266260957
driven_any_max2.9837710663944907
driven_any_mean2.4382086507486167
driven_any_median2.640121310171088
driven_any_min1.4888209162578003
driven_lanedir_consec_max1.8546144811077347
driven_lanedir_consec_mean1.5674188923474042
driven_lanedir_consec_min1.1369441497103083
driven_lanedir_max1.8546144811077347
driven_lanedir_mean1.5674188923474042
driven_lanedir_median1.639058469285787
driven_lanedir_min1.1369441497103083
get_duckie_state_max1.159736088344029e-06
get_duckie_state_mean1.0951927730015349e-06
get_duckie_state_median1.0975201924641927e-06
get_duckie_state_min1.025994618733724e-06
get_robot_state_max0.00835716724395752
get_robot_state_mean0.00819826364517212
get_robot_state_median0.008151970704396567
get_robot_state_min0.008131945927937825
get_state_dump_max0.006998917034694126
get_state_dump_mean0.006866015933808826
get_state_dump_median0.0068356370925903315
get_state_dump_min0.006793872515360514
get_ui_image_max0.022468910898481097
get_ui_image_mean0.0222183191492444
get_ui_image_median0.02214947779973348
get_ui_image_min0.02210541009902954
in-drivable-lane_max3.650000000000039
in-drivable-lane_mean2.6625000000000307
in-drivable-lane_min0.4499999999999984
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4888209162578003, "get_ui_image": 0.022468910898481097, "step_physics": 0.052683656556265696, "survival_time": 6.999999999999983, "driven_lanedir": 1.1369441497103083, "get_state_dump": 0.006998917034694126, "sim_render-ego": 0.0036416888236999513, "get_robot_state": 0.00835716724395752, "get_duckie_state": 1.159736088344029e-06, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.011767942564828056, "deviation-heading": 3.138056266260957, "complete-iteration": 0.12489262989589146, "set_robot_commands": 0.002834221294948033, "deviation-center-line": 0.5222146203601485, "driven_lanedir_consec": 1.1369441497103083, "sim_compute_sim_state": 0.013679446492876326, "sim_compute_performance-ego": 0.0023849521364484516}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.376617552133843, "get_ui_image": 0.02210541009902954, "step_physics": 0.05211350679397583, "survival_time": 14.950000000000076, "driven_lanedir": 1.505366790431338, "get_state_dump": 0.006816115379333496, "sim_render-ego": 0.003605497678120931, "get_robot_state": 0.008156972726186117, "get_duckie_state": 1.0736783345540364e-06, "in-drivable-lane": 3.450000000000041, "agent_compute-ego": 0.011393844286600749, "deviation-heading": 6.654881018988008, "complete-iteration": 0.12244976997375488, "set_robot_commands": 0.0027450132369995117, "deviation-center-line": 0.8075208134755362, "driven_lanedir_consec": 1.505366790431338, "sim_compute_sim_state": 0.0131102720896403, "sim_compute_performance-ego": 0.002327735424041748}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.903625068208333, "get_ui_image": 0.022177470525105793, "step_physics": 0.05421204964319865, "survival_time": 14.950000000000076, "driven_lanedir": 1.7727501481402357, "get_state_dump": 0.006793872515360514, "sim_render-ego": 0.003658550580342611, "get_robot_state": 0.008131945927937825, "get_duckie_state": 1.025994618733724e-06, "in-drivable-lane": 3.650000000000039, "agent_compute-ego": 0.011991400718688964, "deviation-heading": 5.87311577600239, "complete-iteration": 0.12572323401769003, "set_robot_commands": 0.0027080337206522626, "deviation-center-line": 0.8219654080944335, "driven_lanedir_consec": 1.7727501481402357, "sim_compute_sim_state": 0.01365930159886678, "sim_compute_performance-ego": 0.002315817674001058}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9837710663944907, "get_ui_image": 0.022121485074361166, "step_physics": 0.054767626921335855, "survival_time": 14.950000000000076, "driven_lanedir": 1.8546144811077347, "get_state_dump": 0.006855158805847168, "sim_render-ego": 0.003635501066843669, "get_robot_state": 0.008146968682607015, "get_duckie_state": 1.121362050374349e-06, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.011428464253743487, "deviation-heading": 6.138923816126509, "complete-iteration": 0.12823497295379638, "set_robot_commands": 0.002682331403096517, "deviation-center-line": 0.916909161104114, "driven_lanedir_consec": 1.8546144811077347, "sim_compute_sim_state": 0.016199932098388672, "sim_compute_performance-ego": 0.0023215031623840332}}
set_robot_commands_max0.002834221294948033
set_robot_commands_mean0.0027423999139240813
set_robot_commands_median0.002726523478825887
set_robot_commands_min0.002682331403096517
sim_compute_performance-ego_max0.0023849521364484516
sim_compute_performance-ego_mean0.0023375020992188224
sim_compute_performance-ego_median0.0023246192932128906
sim_compute_performance-ego_min0.002315817674001058
sim_compute_sim_state_max0.016199932098388672
sim_compute_sim_state_mean0.01416223806994302
sim_compute_sim_state_median0.013669374045871556
sim_compute_sim_state_min0.0131102720896403
sim_render-ego_max0.003658550580342611
sim_render-ego_mean0.0036353095372517906
sim_render-ego_median0.00363859494527181
sim_render-ego_min0.003605497678120931
simulation-passed1
step_physics_max0.054767626921335855
step_physics_mean0.05344420997869401
step_physics_median0.05344785309973217
step_physics_min0.05211350679397583
survival_time_max14.950000000000076
survival_time_mean12.962500000000052
survival_time_min6.999999999999983
No reset possible
4371011718Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.283730205110545
survival_time_median12.625000000000044
deviation-center-line_median0.8638223215948977
in-drivable-lane_median0.6500000000000004


other stats
agent_compute-ego_max0.016242368221282957
agent_compute-ego_mean0.015471824700778358
agent_compute-ego_median0.015378263583075268
agent_compute-ego_min0.014888403415679931
complete-iteration_max0.1916951182342711
complete-iteration_mean0.1712916006293222
complete-iteration_median0.1722731866304157
complete-iteration_min0.14892491102218627
deviation-center-line_max1.1142949975050598
deviation-center-line_mean0.8410412596173189
deviation-center-line_min0.5222253977744201
deviation-heading_max6.03851816404899
deviation-heading_mean4.66521163214553
deviation-heading_median4.700516932166785
deviation-heading_min3.221294500199563
driven_any_max3.701592523233116
driven_any_mean2.9834836484992677
driven_any_median3.0273294887244284
driven_any_min2.1776830933150984
driven_lanedir_consec_max3.2749240335943703
driven_lanedir_consec_mean2.3982011530670215
driven_lanedir_consec_min1.7504201684526266
driven_lanedir_max3.2749240335943703
driven_lanedir_mean2.3982011530670215
driven_lanedir_median2.283730205110545
driven_lanedir_min1.7504201684526266
get_duckie_state_max1.5114034925188335e-06
get_duckie_state_mean1.46362567135321e-06
get_duckie_state_median1.4638437808138651e-06
get_duckie_state_min1.415411631266276e-06
get_robot_state_max0.010263176797663124
get_robot_state_mean0.009818507144559162
get_robot_state_median0.010036917726198831
get_robot_state_min0.008937016328175862
get_state_dump_max0.007943858702977499
get_state_dump_mean0.007684504961697414
get_state_dump_median0.007748599600251824
get_state_dump_min0.007296961943308512
get_ui_image_max0.0328556185676938
get_ui_image_mean0.029285893885008008
get_ui_image_median0.028855189482371014
get_ui_image_min0.02657757800759621
in-drivable-lane_max2.75000000000003
in-drivable-lane_mean1.0125000000000075
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.701592523233116, "get_ui_image": 0.026606123447418212, "step_physics": 0.06461981137593588, "survival_time": 14.950000000000076, "driven_lanedir": 3.2749240335943703, "get_state_dump": 0.007296961943308512, "sim_render-ego": 0.00400888999303182, "get_robot_state": 0.008937016328175862, "get_duckie_state": 1.415411631266276e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014888403415679931, "deviation-heading": 6.03851816404899, "complete-iteration": 0.14892491102218627, "set_robot_commands": 0.003446641763051351, "deviation-center-line": 1.0715194989928616, "driven_lanedir_consec": 3.2749240335943703, "sim_compute_sim_state": 0.016351250012715656, "sim_compute_performance-ego": 0.0026832135518391927}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.7408414012700706, "get_ui_image": 0.02657757800759621, "step_physics": 0.06642855718297866, "survival_time": 10.300000000000011, "driven_lanedir": 1.7504201684526266, "get_state_dump": 0.00781066209367178, "sim_render-ego": 0.004294475305427626, "get_robot_state": 0.010263176797663124, "get_duckie_state": 1.4733342291081993e-06, "in-drivable-lane": 2.75000000000003, "agent_compute-ego": 0.015122189105135722, "deviation-heading": 3.221294500199563, "complete-iteration": 0.15554399050555182, "set_robot_commands": 0.0035308587898328467, "deviation-center-line": 0.5222253977744201, "driven_lanedir_consec": 1.7504201684526266, "sim_compute_sim_state": 0.018639996213820377, "sim_compute_performance-ego": 0.002785649114442103}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.3138175761787863, "get_ui_image": 0.031104255517323813, "step_physics": 0.08869356314341227, "survival_time": 14.950000000000076, "driven_lanedir": 2.804229335110673, "get_state_dump": 0.007686537106831868, "sim_render-ego": 0.004683615366617839, "get_robot_state": 0.009963228702545164, "get_duckie_state": 1.4543533325195312e-06, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.016242368221282957, "deviation-heading": 5.951905025996489, "complete-iteration": 0.18900238275527953, "set_robot_commands": 0.0035969352722167967, "deviation-center-line": 1.1142949975050598, "driven_lanedir_consec": 2.804229335110673, "sim_compute_sim_state": 0.023906529744466144, "sim_compute_performance-ego": 0.00303133487701416}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.1776830933150984, "get_ui_image": 0.0328556185676938, "step_physics": 0.08600952937489464, "survival_time": 8.399999999999984, "driven_lanedir": 1.7632310751104163, "get_state_dump": 0.007943858702977499, "sim_render-ego": 0.004488794576554071, "get_robot_state": 0.0101106067498525, "get_duckie_state": 1.5114034925188335e-06, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.015634338061014812, "deviation-heading": 3.4491288383370797, "complete-iteration": 0.1916951182342711, "set_robot_commands": 0.003567157756714594, "deviation-center-line": 0.6561251441969339, "driven_lanedir_consec": 1.7632310751104163, "sim_compute_sim_state": 0.02787759332429795, "sim_compute_performance-ego": 0.0030972020966666086}}
set_robot_commands_max0.0035969352722167967
set_robot_commands_mean0.003535398395453897
set_robot_commands_median0.0035490082732737203
set_robot_commands_min0.003446641763051351
sim_compute_performance-ego_max0.0030972020966666086
sim_compute_performance-ego_mean0.002899349909990516
sim_compute_performance-ego_median0.002908491995728132
sim_compute_performance-ego_min0.0026832135518391927
sim_compute_sim_state_max0.02787759332429795
sim_compute_sim_state_mean0.02169384232382503
sim_compute_sim_state_median0.02127326297914326
sim_compute_sim_state_min0.016351250012715656
sim_render-ego_max0.004683615366617839
sim_render-ego_mean0.004368943810407838
sim_render-ego_median0.004391634940990848
sim_render-ego_min0.00400888999303182
simulation-passed1
step_physics_max0.08869356314341227
step_physics_mean0.07643786526930536
step_physics_median0.07621904327893665
step_physics_min0.06461981137593588
survival_time_max14.950000000000076
survival_time_mean12.150000000000038
survival_time_min8.399999999999984
No reset possible
4370311719Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:05:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5697050173690077
survival_time_median11.950000000000037
deviation-center-line_median0.7041454477342579
in-drivable-lane_median2.950000000000015


other stats
agent_compute-ego_max0.013508203824361166
agent_compute-ego_mean0.012006608951632294
agent_compute-ego_median0.011558808349075987
agent_compute-ego_min0.01140061528401604
complete-iteration_max0.14583855549494426
complete-iteration_mean0.12885512149345807
complete-iteration_median0.12359362501129244
complete-iteration_min0.1223946804563031
deviation-center-line_max1.006551015341888
deviation-center-line_mean0.6893461080208825
deviation-center-line_min0.34254252127312607
deviation-heading_max5.580828034852844
deviation-heading_mean3.969964008618029
deviation-heading_median4.323103163153331
deviation-heading_min1.6528216733126089
driven_any_max3.912794078460076
driven_any_mean3.1977139205169256
driven_any_median3.1604541763187166
driven_any_min2.557153250970193
driven_lanedir_consec_max2.179271241445381
driven_lanedir_consec_mean1.5346374393712423
driven_lanedir_consec_min0.8198684813015731
driven_lanedir_max2.9332564356795565
driven_lanedir_mean1.9674730786738397
driven_lanedir_median1.73614447987259
driven_lanedir_min1.4643469192706215
get_duckie_state_max1.7730394999186198e-06
get_duckie_state_mean1.6996715092086175e-06
get_duckie_state_median1.6877284040998977e-06
get_duckie_state_min1.6501897287160549e-06
get_robot_state_max0.008758440017700195
get_robot_state_mean0.00832949507436664
get_robot_state_median0.008207232756003182
get_robot_state_min0.008145074767760005
get_state_dump_max0.007284050485695222
get_state_dump_mean0.007073893952904138
get_state_dump_median0.0070518187357454885
get_state_dump_min0.006907887854430353
get_ui_image_max0.024584932327270503
get_ui_image_mean0.022840214144563633
get_ui_image_median0.022339445793690245
get_ui_image_min0.022097032663603536
in-drivable-lane_max3.999999999999992
in-drivable-lane_mean2.9750000000000125
in-drivable-lane_min2.0000000000000284
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.557153250970193, "get_ui_image": 0.022343431200299944, "step_physics": 0.051582307231669525, "survival_time": 7.349999999999982, "driven_lanedir": 1.4643469192706215, "get_state_dump": 0.006923513347599782, "sim_render-ego": 0.0036875358244188782, "get_robot_state": 0.008210775803546516, "get_duckie_state": 1.7046117458213754e-06, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.011588219882679636, "deviation-heading": 1.6528216733126089, "complete-iteration": 0.1234851921496748, "set_robot_commands": 0.002800034827926532, "deviation-center-line": 0.34254252127312607, "driven_lanedir_consec": 1.4643469192706215, "sim_compute_sim_state": 0.013905727944406523, "sim_compute_performance-ego": 0.002368424214473387}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.199575560916468, "get_ui_image": 0.022097032663603536, "step_physics": 0.051713366695887136, "survival_time": 11.450000000000028, "driven_lanedir": 1.6750631154673932, "get_state_dump": 0.006907887854430353, "sim_render-ego": 0.00358309287691741, "get_robot_state": 0.008203689708459846, "get_duckie_state": 1.6501897287160549e-06, "in-drivable-lane": 3.6500000000000377, "agent_compute-ego": 0.01140061528401604, "deviation-heading": 4.11325862573915, "complete-iteration": 0.1223946804563031, "set_robot_commands": 0.002681931033405154, "deviation-center-line": 0.6881952061419911, "driven_lanedir_consec": 1.6750631154673932, "sim_compute_sim_state": 0.013418817103689936, "sim_compute_performance-ego": 0.002311592018760448}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.121332791720966, "get_ui_image": 0.02233546038708055, "step_physics": 0.053082094613806786, "survival_time": 12.450000000000042, "driven_lanedir": 1.797225844277787, "get_state_dump": 0.007284050485695222, "sim_render-ego": 0.00359822564335712, "get_robot_state": 0.008145074767760005, "get_duckie_state": 1.67084506237842e-06, "in-drivable-lane": 3.999999999999992, "agent_compute-ego": 0.011529396815472338, "deviation-heading": 4.5329477005675125, "complete-iteration": 0.1237020578729101, "set_robot_commands": 0.0027671951845467807, "deviation-center-line": 0.7200956893265248, "driven_lanedir_consec": 0.8198684813015731, "sim_compute_sim_state": 0.012570256688987397, "sim_compute_performance-ego": 0.002314214246818818}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.912794078460076, "get_ui_image": 0.024584932327270503, "step_physics": 0.06350771586100261, "survival_time": 14.950000000000076, "driven_lanedir": 2.9332564356795565, "get_state_dump": 0.007180124123891195, "sim_render-ego": 0.003915590445200602, "get_robot_state": 0.008758440017700195, "get_duckie_state": 1.7730394999186198e-06, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.013508203824361166, "deviation-heading": 5.580828034852844, "complete-iteration": 0.14583855549494426, "set_robot_commands": 0.0033457271258036294, "deviation-center-line": 1.006551015341888, "driven_lanedir_consec": 2.179271241445381, "sim_compute_sim_state": 0.018130260308583578, "sim_compute_performance-ego": 0.0028241491317749024}}
set_robot_commands_max0.0033457271258036294
set_robot_commands_mean0.0028987220429205237
set_robot_commands_median0.0027836150062366563
set_robot_commands_min0.002681931033405154
sim_compute_performance-ego_max0.0028241491317749024
sim_compute_performance-ego_mean0.002454594902956889
sim_compute_performance-ego_median0.0023413192306461026
sim_compute_performance-ego_min0.002311592018760448
sim_compute_sim_state_max0.018130260308583578
sim_compute_sim_state_mean0.014506265511416858
sim_compute_sim_state_median0.013662272524048228
sim_compute_sim_state_min0.012570256688987397
sim_render-ego_max0.003915590445200602
sim_render-ego_mean0.0036961111974735026
sim_render-ego_median0.0036428807338879992
sim_render-ego_min0.00358309287691741
simulation-passed1
step_physics_max0.06350771586100261
step_physics_mean0.05497137110059151
step_physics_median0.05239773065484696
step_physics_min0.051582307231669525
survival_time_max14.950000000000076
survival_time_mean11.550000000000033
survival_time_min7.349999999999982
No reset possible
4367911714Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1556214352809473
survival_time_median14.950000000000076
deviation-center-line_median0.5879945109379396
in-drivable-lane_median4.700000000000062


other stats
agent_compute-ego_max0.01568289120992025
agent_compute-ego_mean0.013696553933807134
agent_compute-ego_median0.013738114833831788
agent_compute-ego_min0.011627094857644717
complete-iteration_max0.19258113145828248
complete-iteration_mean0.15293490881487826
complete-iteration_median0.14881024599075315
complete-iteration_min0.12153801181972426
deviation-center-line_max0.6609192004529953
deviation-center-line_mean0.5400677033203024
deviation-center-line_min0.3233625909523349
deviation-heading_max3.196924642900801
deviation-heading_mean1.7062729534529455
deviation-heading_median1.3144717926684248
deviation-heading_min0.9992235855741322
driven_any_max3.441600862009339
driven_any_mean2.9904789464626935
driven_any_median3.2180354059006957
driven_any_min2.084244112040044
driven_lanedir_consec_max2.73086482052227
driven_lanedir_consec_mean2.2009117779445235
driven_lanedir_consec_min1.7615394206939317
driven_lanedir_max2.73086482052227
driven_lanedir_mean2.2009117779445235
driven_lanedir_median2.1556214352809473
driven_lanedir_min1.7615394206939317
get_duckie_state_max1.3597806294759114e-06
get_duckie_state_mean1.1764503432066916e-06
get_duckie_state_median1.1801719665527342e-06
get_duckie_state_min9.85676810245386e-07
get_robot_state_max0.010138076146443685
get_robot_state_mean0.009066940295349563
get_robot_state_median0.009021934668223064
get_robot_state_min0.008085815698508449
get_state_dump_max0.007901398340861003
get_state_dump_mean0.007287824591267562
get_state_dump_median0.007242136001586914
get_state_dump_min0.006765628021035418
get_ui_image_max0.03131891091664632
get_ui_image_mean0.02619206291583827
get_ui_image_median0.02570178870653413
get_ui_image_min0.02204576333363851
in-drivable-lane_max7.0500000000000655
in-drivable-lane_mean4.287500000000047
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.4368442890554323, "get_ui_image": 0.02204576333363851, "step_physics": 0.05463968753814697, "survival_time": 14.950000000000076, "driven_lanedir": 2.73086482052227, "get_state_dump": 0.006800151666005452, "sim_render-ego": 0.003670640786488851, "get_robot_state": 0.00813644011815389, "get_duckie_state": 1.0561943054199218e-06, "in-drivable-lane": 4.550000000000065, "agent_compute-ego": 0.011884675025939942, "deviation-heading": 1.23984582501193, "complete-iteration": 0.1268252944946289, "set_robot_commands": 0.0027726602554321287, "deviation-center-line": 0.6609192004529953, "driven_lanedir_consec": 2.73086482052227, "sim_compute_sim_state": 0.014449779987335204, "sim_compute_performance-ego": 0.0023445892333984375}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.084244112040044, "get_ui_image": 0.022078050062960427, "step_physics": 0.051682958666910264, "survival_time": 7.449999999999981, "driven_lanedir": 1.7615394206939317, "get_state_dump": 0.006765628021035418, "sim_render-ego": 0.003568514881518063, "get_robot_state": 0.008085815698508449, "get_duckie_state": 9.85676810245386e-07, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.011627094857644717, "deviation-heading": 1.3890977603249195, "complete-iteration": 0.12153801181972426, "set_robot_commands": 0.0026474159035906695, "deviation-center-line": 0.3233625909523349, "driven_lanedir_consec": 1.7615394206939317, "sim_compute_sim_state": 0.012687302275792064, "sim_compute_performance-ego": 0.0023125130058134964}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.9992265227459587, "get_ui_image": 0.02932552735010783, "step_physics": 0.07732070684432983, "survival_time": 14.950000000000076, "driven_lanedir": 1.8486814956232895, "get_state_dump": 0.007901398340861003, "sim_render-ego": 0.004576339721679688, "get_robot_state": 0.010138076146443685, "get_duckie_state": 1.3041496276855468e-06, "in-drivable-lane": 4.85000000000006, "agent_compute-ego": 0.01568289120992025, "deviation-heading": 3.196924642900801, "complete-iteration": 0.17079519748687744, "set_robot_commands": 0.003632522424062093, "deviation-center-line": 0.6520939715908486, "driven_lanedir_consec": 1.8486814956232895, "sim_compute_sim_state": 0.019294649759928385, "sim_compute_performance-ego": 0.0028267002105712893}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.441600862009339, "get_ui_image": 0.03131891091664632, "step_physics": 0.08866520245869955, "survival_time": 14.950000000000076, "driven_lanedir": 2.4625613749386046, "get_state_dump": 0.007684120337168376, "sim_render-ego": 0.004585716724395752, "get_robot_state": 0.009907429218292236, "get_duckie_state": 1.3597806294759114e-06, "in-drivable-lane": 7.0500000000000655, "agent_compute-ego": 0.015591554641723631, "deviation-heading": 0.9992235855741322, "complete-iteration": 0.19258113145828248, "set_robot_commands": 0.003642306327819824, "deviation-center-line": 0.5238950502850308, "driven_lanedir_consec": 2.4625613749386046, "sim_compute_sim_state": 0.02804571310679118, "sim_compute_performance-ego": 0.0030406856536865233}}
set_robot_commands_max0.003642306327819824
set_robot_commands_mean0.003173726227726179
set_robot_commands_median0.003202591339747111
set_robot_commands_min0.0026474159035906695
sim_compute_performance-ego_max0.0030406856536865233
sim_compute_performance-ego_mean0.0026311220258674367
sim_compute_performance-ego_median0.002585644721984863
sim_compute_performance-ego_min0.0023125130058134964
sim_compute_sim_state_max0.02804571310679118
sim_compute_sim_state_mean0.018619361282461708
sim_compute_sim_state_median0.016872214873631795
sim_compute_sim_state_min0.012687302275792064
sim_render-ego_max0.004585716724395752
sim_render-ego_mean0.004100303028520588
sim_render-ego_median0.00412349025408427
sim_render-ego_min0.003568514881518063
simulation-passed1
step_physics_max0.08866520245869955
step_physics_mean0.06807713887702166
step_physics_median0.0659801971912384
step_physics_min0.051682958666910264
survival_time_max14.950000000000076
survival_time_mean13.075000000000053
survival_time_min7.449999999999981
No reset possible
4359111695Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:07:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.7602596957741703
survival_time_median14.950000000000076
deviation-center-line_median0.9675731097614064
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.015894087950388592
agent_compute-ego_mean0.0143951819340388
agent_compute-ego_median0.014068001906077068
agent_compute-ego_min0.013550635973612469
complete-iteration_max0.1794406795501709
complete-iteration_mean0.15878513236840566
complete-iteration_median0.15302759448687236
complete-iteration_min0.14964466094970702
deviation-center-line_max1.0101453291313964
deviation-center-line_mean0.8315595065227346
deviation-center-line_min0.380946477436729
deviation-heading_max3.206143691423279
deviation-heading_mean2.517353231143232
deviation-heading_median2.7749729574219097
deviation-heading_min1.3133233183058306
driven_any_max4.801094656114009
driven_any_mean4.405019171953777
driven_any_median4.490075724027278
driven_any_min3.8388305836465384
driven_lanedir_consec_max4.586947116482028
driven_lanedir_consec_mean3.5923788685768665
driven_lanedir_consec_min2.2620489662770966
driven_lanedir_max4.586947116482028
driven_lanedir_mean3.5923788685768665
driven_lanedir_median3.7602596957741703
driven_lanedir_min2.2620489662770966
get_duckie_state_max1.4861424763997396e-06
get_duckie_state_mean1.4092524846394855e-06
get_duckie_state_median1.4030933380126953e-06
get_duckie_state_min1.3446807861328124e-06
get_robot_state_max0.009821178118387858
get_robot_state_mean0.00909924586613973
get_robot_state_median0.00894451340039571
get_robot_state_min0.008686778545379638
get_state_dump_max0.008070966402689617
get_state_dump_mean0.007477827469507854
get_state_dump_median0.007322620153427124
get_state_dump_min0.007195103168487549
get_ui_image_max0.030166236559549968
get_ui_image_mean0.02719542880853017
get_ui_image_median0.02665594180425008
get_ui_image_min0.025303595066070557
in-drivable-lane_max8.900000000000091
in-drivable-lane_mean3.2000000000000366
in-drivable-lane_min0.5000000000000071
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.801094656114009, "get_ui_image": 0.025303595066070557, "step_physics": 0.06591378609339396, "survival_time": 14.950000000000076, "driven_lanedir": 4.586947116482028, "get_state_dump": 0.007195103168487549, "sim_render-ego": 0.004163973331451416, "get_robot_state": 0.008879849910736084, "get_duckie_state": 1.4217694600423176e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.01448552926381429, "deviation-heading": 3.206143691423279, "complete-iteration": 0.14964466094970702, "set_robot_commands": 0.003463273048400879, "deviation-center-line": 0.9952170551260664, "driven_lanedir_consec": 4.586947116482028, "sim_compute_sim_state": 0.0174094820022583, "sim_compute_performance-ego": 0.002744375864664714}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.558638034474097, "get_ui_image": 0.02710883061091105, "step_physics": 0.06666526953379313, "survival_time": 14.950000000000076, "driven_lanedir": 4.080180560109023, "get_state_dump": 0.00738813320795695, "sim_render-ego": 0.004035305976867676, "get_robot_state": 0.00900917689005534, "get_duckie_state": 1.384417215983073e-06, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.013650474548339843, "deviation-heading": 2.8115370991674027, "complete-iteration": 0.1510481039683024, "set_robot_commands": 0.0035381285349527993, "deviation-center-line": 0.9399291643967465, "driven_lanedir_consec": 4.080180560109023, "sim_compute_sim_state": 0.01689761956532796, "sim_compute_performance-ego": 0.0026684959729512533}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.8388305836465384, "get_ui_image": 0.030166236559549968, "step_physics": 0.08139782746632894, "survival_time": 14.950000000000076, "driven_lanedir": 3.440338831439318, "get_state_dump": 0.008070966402689617, "sim_render-ego": 0.004693489869435628, "get_robot_state": 0.009821178118387858, "get_duckie_state": 1.4861424763997396e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.015894087950388592, "deviation-heading": 2.7384088156764164, "complete-iteration": 0.1794406795501709, "set_robot_commands": 0.003649125099182129, "deviation-center-line": 1.0101453291313964, "driven_lanedir_consec": 3.440338831439318, "sim_compute_sim_state": 0.022588146527608235, "sim_compute_performance-ego": 0.003067004680633545}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.421513413580461, "get_ui_image": 0.026203052997589113, "step_physics": 0.06974076986312866, "survival_time": 14.950000000000076, "driven_lanedir": 2.2620489662770966, "get_state_dump": 0.007257107098897298, "sim_render-ego": 0.004091966152191162, "get_robot_state": 0.008686778545379638, "get_duckie_state": 1.3446807861328124e-06, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.013550635973612469, "deviation-heading": 1.3133233183058306, "complete-iteration": 0.1550070850054423, "set_robot_commands": 0.0034473514556884765, "deviation-center-line": 0.380946477436729, "driven_lanedir_consec": 2.2620489662770966, "sim_compute_sim_state": 0.019289923508961995, "sim_compute_performance-ego": 0.0026515881220499677}}
set_robot_commands_max0.003649125099182129
set_robot_commands_mean0.003524469534556071
set_robot_commands_median0.0035007007916768394
set_robot_commands_min0.0034473514556884765
sim_compute_performance-ego_max0.003067004680633545
sim_compute_performance-ego_mean0.0027828661600748698
sim_compute_performance-ego_median0.0027064359188079833
sim_compute_performance-ego_min0.0026515881220499677
sim_compute_sim_state_max0.022588146527608235
sim_compute_sim_state_mean0.019046292901039125
sim_compute_sim_state_median0.018349702755610143
sim_compute_sim_state_min0.01689761956532796
sim_render-ego_max0.004693489869435628
sim_render-ego_mean0.004246183832486471
sim_render-ego_median0.004127969741821289
sim_render-ego_min0.004035305976867676
simulation-passed1
step_physics_max0.08139782746632894
step_physics_mean0.07092941323916117
step_physics_median0.0682030196984609
step_physics_min0.06591378609339396
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4356811692Bhavya PatwaΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.358733222111887
survival_time_median14.950000000000076
deviation-center-line_median0.6128312255681438
in-drivable-lane_median1.3000000000000165


other stats
agent_compute-ego_max0.016031978925069173
agent_compute-ego_mean0.015191240310668944
agent_compute-ego_median0.015853293339411417
agent_compute-ego_min0.013026395638783772
complete-iteration_max0.1875042208035787
complete-iteration_mean0.17700215578079226
complete-iteration_median0.18463119546572365
complete-iteration_min0.15124201138814292
deviation-center-line_max0.67260335859477
deviation-center-line_mean0.601149272218882
deviation-center-line_min0.5063312791444706
deviation-heading_max3.08882008005886
deviation-heading_mean2.946381039936531
deviation-heading_median2.9772706119901713
deviation-heading_min2.742162855706924
driven_any_max3.0630101223166286
driven_any_mean3.0604731351612764
driven_any_median3.0629054066582637
driven_any_min3.053071605011949
driven_lanedir_consec_max2.691503619898441
driven_lanedir_consec_mean2.298373540740977
driven_lanedir_consec_min1.7845240988416922
driven_lanedir_max2.747443545004023
driven_lanedir_mean2.472053517545511
driven_lanedir_median2.678123213168165
driven_lanedir_min1.7845240988416922
get_duckie_state_max1.670519510904948e-06
get_duckie_state_mean1.4533599217732747e-06
get_duckie_state_median1.4436244964599609e-06
get_duckie_state_min1.2556711832682292e-06
get_robot_state_max0.010005364418029784
get_robot_state_mean0.009643354614575704
get_robot_state_median0.0098926309744517
get_robot_state_min0.008782792091369628
get_state_dump_max0.007956593831380209
get_state_dump_mean0.007690551082293192
get_state_dump_median0.007820141315460206
get_state_dump_min0.007165327866872151
get_ui_image_max0.03274824857711792
get_ui_image_mean0.03069172898928324
get_ui_image_median0.031790941556294756
get_ui_image_min0.026436784267425534
in-drivable-lane_max5.300000000000021
in-drivable-lane_mean2.1750000000000163
in-drivable-lane_min0.8000000000000114
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.053071605011949, "get_ui_image": 0.03143568356831868, "step_physics": 0.08504498720169068, "survival_time": 14.950000000000076, "driven_lanedir": 2.664742806437889, "get_state_dump": 0.007956593831380209, "sim_render-ego": 0.004496034781138102, "get_robot_state": 0.010005364418029784, "get_duckie_state": 1.670519510904948e-06, "in-drivable-lane": 1.3500000000000147, "agent_compute-ego": 0.016031978925069173, "deviation-heading": 2.742162855706924, "complete-iteration": 0.18576678037643432, "set_robot_commands": 0.003622846603393554, "deviation-center-line": 0.5705446187976843, "driven_lanedir_consec": 2.664742806437889, "sim_compute_sim_state": 0.02398714542388916, "sim_compute_performance-ego": 0.003093125820159912}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0630101223166286, "get_ui_image": 0.03214619954427083, "step_physics": 0.08418163537979126, "survival_time": 14.950000000000076, "driven_lanedir": 2.691503619898441, "get_state_dump": 0.007883071899414062, "sim_render-ego": 0.004511466821034749, "get_robot_state": 0.009908198515574135, "get_duckie_state": 1.4400482177734375e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.0158964204788208, "deviation-heading": 3.0179299543250293, "complete-iteration": 0.183495610555013, "set_robot_commands": 0.003778700033823649, "deviation-center-line": 0.6551178323386034, "driven_lanedir_consec": 2.691503619898441, "sim_compute_sim_state": 0.022087214787801103, "sim_compute_performance-ego": 0.0030075963338216144}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0628663344602773, "get_ui_image": 0.03274824857711792, "step_physics": 0.08739892880121868, "survival_time": 14.950000000000076, "driven_lanedir": 1.7845240988416922, "get_state_dump": 0.007757210731506347, "sim_render-ego": 0.004715531667073568, "get_robot_state": 0.009877063433329263, "get_duckie_state": 1.4472007751464844e-06, "in-drivable-lane": 5.300000000000021, "agent_compute-ego": 0.015810166200002033, "deviation-heading": 3.08882008005886, "complete-iteration": 0.1875042208035787, "set_robot_commands": 0.003703160285949707, "deviation-center-line": 0.67260335859477, "driven_lanedir_consec": 1.7845240988416922, "sim_compute_sim_state": 0.022374864419301352, "sim_compute_performance-ego": 0.0030225118001302085}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.06294447885625, "get_ui_image": 0.026436784267425534, "step_physics": 0.06807667016983032, "survival_time": 14.950000000000076, "driven_lanedir": 2.747443545004023, "get_state_dump": 0.007165327866872151, "sim_render-ego": 0.00385086456934611, "get_robot_state": 0.008782792091369628, "get_duckie_state": 1.2556711832682292e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.013026395638783772, "deviation-heading": 2.9366112696553133, "complete-iteration": 0.15124201138814292, "set_robot_commands": 0.0033613244692484536, "deviation-center-line": 0.5063312791444706, "driven_lanedir_consec": 2.0527236377858857, "sim_compute_sim_state": 0.01792709986368815, "sim_compute_performance-ego": 0.002525533040364583}}
set_robot_commands_max0.003778700033823649
set_robot_commands_mean0.0036165078481038408
set_robot_commands_median0.003663003444671631
set_robot_commands_min0.0033613244692484536
sim_compute_performance-ego_max0.003093125820159912
sim_compute_performance-ego_mean0.0029121917486190797
sim_compute_performance-ego_median0.003015054066975911
sim_compute_performance-ego_min0.002525533040364583
sim_compute_sim_state_max0.02398714542388916
sim_compute_sim_state_mean0.021594081123669943
sim_compute_sim_state_median0.02223103960355123
sim_compute_sim_state_min0.01792709986368815
sim_render-ego_max0.004715531667073568
sim_render-ego_mean0.004393474459648133
sim_render-ego_median0.0045037508010864254
sim_render-ego_min0.00385086456934611
simulation-passed1
step_physics_max0.08739892880121868
step_physics_mean0.08117555538813273
step_physics_median0.08461331129074097
step_physics_min0.06807667016983032
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4354611688Bhavya PatwaΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6489195412233375
survival_time_median14.950000000000076
deviation-center-line_median0.3007993846285925
in-drivable-lane_median1.7500000000000249


other stats
agent_compute-ego_max0.014064659277598065
agent_compute-ego_mean0.01256240407625834
agent_compute-ego_median0.012428973118464153
agent_compute-ego_min0.011327010790507
complete-iteration_max0.1473347266515096
complete-iteration_mean0.13359038372834525
complete-iteration_median0.12939019719759623
complete-iteration_min0.12824641386667887
deviation-center-line_max0.3866370619736816
deviation-center-line_mean0.27612531042416755
deviation-center-line_min0.11626541046580369
deviation-heading_max3.0412208320285155
deviation-heading_mean2.3602690035943032
deviation-heading_median2.525065499952422
deviation-heading_min1.3497241824438542
driven_any_max1.9399314881088456
driven_any_mean1.938263158011594
driven_any_median1.9397639529961084
driven_any_min1.9335932379453131
driven_lanedir_consec_max1.895460086982874
driven_lanedir_consec_mean1.403161471987941
driven_lanedir_consec_min0.41934671852221506
driven_lanedir_max1.895460086982874
driven_lanedir_mean1.403161471987941
driven_lanedir_median1.6489195412233375
driven_lanedir_min0.41934671852221506
get_duckie_state_max1.3629595438639323e-06
get_duckie_state_mean1.1440118153889975e-06
get_duckie_state_median1.1217594146728516e-06
get_duckie_state_min9.69568888346354e-07
get_robot_state_max0.009156715075174968
get_robot_state_mean0.008498385151227314
get_robot_state_median0.008363551298777262
get_robot_state_min0.008109722932179769
get_state_dump_max0.007480636437733968
get_state_dump_mean0.007081683079401652
get_state_dump_median0.007041407823562622
get_state_dump_min0.006763280232747396
get_ui_image_max0.02567463239034017
get_ui_image_mean0.023590801954269408
get_ui_image_median0.02325990080833435
get_ui_image_min0.022168773810068765
in-drivable-lane_max10.900000000000084
in-drivable-lane_mean3.6000000000000334
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9335932379453131, "get_ui_image": 0.02567463239034017, "step_physics": 0.0632825779914856, "survival_time": 14.950000000000076, "driven_lanedir": 1.4113903844928588, "get_state_dump": 0.007480636437733968, "sim_render-ego": 0.0042673722902933755, "get_robot_state": 0.009156715075174968, "get_duckie_state": 1.3629595438639323e-06, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.014064659277598065, "deviation-heading": 2.5701487471517743, "complete-iteration": 0.1473347266515096, "set_robot_commands": 0.0035314448674519856, "deviation-center-line": 0.3703496329737105, "driven_lanedir_consec": 1.4113903844928588, "sim_compute_sim_state": 0.016988728046417236, "sim_compute_performance-ego": 0.0028020103772481283}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399314881088456, "get_ui_image": 0.02426047166188558, "step_physics": 0.054073543548583985, "survival_time": 14.950000000000076, "driven_lanedir": 1.895460086982874, "get_state_dump": 0.007286598682403564, "sim_render-ego": 0.00373473326365153, "get_robot_state": 0.008599499861399332, "get_duckie_state": 1.179377237955729e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0127770733833313, "deviation-heading": 2.479982252753069, "complete-iteration": 0.12965037822723388, "set_robot_commands": 0.0029130045572916667, "deviation-center-line": 0.23124913628347457, "driven_lanedir_consec": 1.895460086982874, "sim_compute_sim_state": 0.013492382367451986, "sim_compute_performance-ego": 0.002431360880533854}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9396164496873491, "get_ui_image": 0.02225932995478312, "step_physics": 0.05724084297815959, "survival_time": 14.950000000000076, "driven_lanedir": 0.41934671852221506, "get_state_dump": 0.006763280232747396, "sim_render-ego": 0.003686516284942627, "get_robot_state": 0.008109722932179769, "get_duckie_state": 1.064141591389974e-06, "in-drivable-lane": 10.900000000000084, "agent_compute-ego": 0.012080872853597003, "deviation-heading": 1.3497241824438542, "complete-iteration": 0.12824641386667887, "set_robot_commands": 0.0026568380991617837, "deviation-center-line": 0.11626541046580369, "driven_lanedir_consec": 0.41934671852221506, "sim_compute_sim_state": 0.013040544191996257, "sim_compute_performance-ego": 0.00233126958211263}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399114563048672, "get_ui_image": 0.022168773810068765, "step_physics": 0.05604122559229533, "survival_time": 14.950000000000076, "driven_lanedir": 1.8864486979538169, "get_state_dump": 0.00679621696472168, "sim_render-ego": 0.0036347405115763343, "get_robot_state": 0.008127602736155192, "get_duckie_state": 9.69568888346354e-07, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011327010790507, "deviation-heading": 3.0412208320285155, "complete-iteration": 0.12913001616795858, "set_robot_commands": 0.002806879679361979, "deviation-center-line": 0.3866370619736816, "driven_lanedir_consec": 1.8864486979538169, "sim_compute_sim_state": 0.015817670822143554, "sim_compute_performance-ego": 0.002332398891448975}}
set_robot_commands_max0.0035314448674519856
set_robot_commands_mean0.0029770418008168535
set_robot_commands_median0.002859942118326823
set_robot_commands_min0.0026568380991617837
sim_compute_performance-ego_max0.0028020103772481283
sim_compute_performance-ego_mean0.002474259932835897
sim_compute_performance-ego_median0.0023818798859914147
sim_compute_performance-ego_min0.00233126958211263
sim_compute_sim_state_max0.016988728046417236
sim_compute_sim_state_mean0.014834831357002256
sim_compute_sim_state_median0.01465502659479777
sim_compute_sim_state_min0.013040544191996257
sim_render-ego_max0.0042673722902933755
sim_render-ego_mean0.003830840587615967
sim_render-ego_median0.0037106247742970783
sim_render-ego_min0.0036347405115763343
simulation-passed1
step_physics_max0.0632825779914856
step_physics_mean0.057659547527631125
step_physics_median0.05664103428522746
step_physics_min0.054073543548583985
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4345511675Mo KleitΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.710521518702566
survival_time_median12.32500000000004
deviation-center-line_median0.516134710260653
in-drivable-lane_median3.700000000000019


other stats
agent_compute-ego_max0.01673270304997762
agent_compute-ego_mean0.01573416913254966
agent_compute-ego_median0.015569774541113484
agent_compute-ego_min0.01506442439799406
complete-iteration_max0.18926586707433063
complete-iteration_mean0.18240398483464876
complete-iteration_median0.1843120370724161
complete-iteration_min0.1717259981194321
deviation-center-line_max0.6873688697143546
deviation-center-line_mean0.4606094263723113
deviation-center-line_min0.12279941525358434
deviation-heading_max2.6326678982378544
deviation-heading_mean1.8575293555122037
deviation-heading_median2.2466225150991623
deviation-heading_min0.30420449361263546
driven_any_max5.77828850069051
driven_any_mean4.028620148630998
driven_any_median4.75751810280666
driven_any_min0.8211558882201597
driven_lanedir_consec_max3.617950191185989
driven_lanedir_consec_mean2.392484156791254
driven_lanedir_consec_min0.5309433985738934
driven_lanedir_max3.617950191185989
driven_lanedir_mean2.392484156791254
driven_lanedir_median2.710521518702566
driven_lanedir_min0.5309433985738934
get_duckie_state_max1.9215967550695657e-06
get_duckie_state_mean1.8966304802412384e-06
get_duckie_state_median1.8930933812875376e-06
get_duckie_state_min1.8787384033203125e-06
get_robot_state_max0.01008912165959676
get_robot_state_mean0.009770297891418108
get_robot_state_median0.009922796813787991
get_robot_state_min0.00914647627849968
get_state_dump_max0.007771689097086589
get_state_dump_mean0.007630444669326183
get_state_dump_median0.007696584279699464
get_state_dump_min0.007356921020819217
get_ui_image_max0.03163334850437385
get_ui_image_mean0.03072399356597483
get_ui_image_median0.030894884327018403
get_ui_image_min0.02947285710548868
in-drivable-lane_max6.850000000000065
in-drivable-lane_mean3.7375000000000256
in-drivable-lane_min0.6999999999999984
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.8211558882201597, "get_ui_image": 0.02947285710548868, "step_physics": 0.07800542578405263, "survival_time": 2.4499999999999993, "driven_lanedir": 0.5309433985738934, "get_state_dump": 0.007356921020819217, "sim_render-ego": 0.004456948260871732, "get_robot_state": 0.00914647627849968, "get_duckie_state": 1.902482947524713e-06, "in-drivable-lane": 0.6999999999999984, "agent_compute-ego": 0.01506442439799406, "deviation-heading": 0.30420449361263546, "complete-iteration": 0.1717259981194321, "set_robot_commands": 0.004042834651713468, "deviation-center-line": 0.12279941525358434, "driven_lanedir_consec": 0.5309433985738934, "sim_compute_sim_state": 0.020995636375582948, "sim_compute_performance-ego": 0.0030992079754264988}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.843717400754953, "get_ui_image": 0.030484686809706972, "step_physics": 0.0832352144309724, "survival_time": 12.550000000000043, "driven_lanedir": 2.532555395236133, "get_state_dump": 0.007752071813758151, "sim_render-ego": 0.00480976427693766, "get_robot_state": 0.01008517048748366, "get_duckie_state": 1.9215967550695657e-06, "in-drivable-lane": 5.300000000000021, "agent_compute-ego": 0.015587040152682726, "deviation-heading": 2.245593771414689, "complete-iteration": 0.18153339648151776, "set_robot_commands": 0.003703003385627412, "deviation-center-line": 0.48548862924344094, "driven_lanedir_consec": 2.532555395236133, "sim_compute_sim_state": 0.022669638295572593, "sim_compute_performance-ego": 0.00311569008694227}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.77828850069051, "get_ui_image": 0.031305081844329834, "step_physics": 0.08586857477823893, "survival_time": 14.950000000000076, "driven_lanedir": 2.8884876421689993, "get_state_dump": 0.007771689097086589, "sim_render-ego": 0.004629216194152832, "get_robot_state": 0.01008912165959676, "get_duckie_state": 1.8787384033203125e-06, "in-drivable-lane": 6.850000000000065, "agent_compute-ego": 0.01673270304997762, "deviation-heading": 2.2476512587836357, "complete-iteration": 0.18926586707433063, "set_robot_commands": 0.003788626194000244, "deviation-center-line": 0.546780791277865, "driven_lanedir_consec": 2.8884876421689993, "sim_compute_sim_state": 0.026010464827219644, "sim_compute_performance-ego": 0.0029761544863382977}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.671318804858369, "get_ui_image": 0.03163334850437385, "step_physics": 0.08534740613511771, "survival_time": 12.100000000000035, "driven_lanedir": 3.617950191185989, "get_state_dump": 0.007641096745640778, "sim_render-ego": 0.0043049893103355216, "get_robot_state": 0.009760423140092327, "get_duckie_state": 1.8837038150503616e-06, "in-drivable-lane": 2.1000000000000165, "agent_compute-ego": 0.015552508929544243, "deviation-heading": 2.6326678982378544, "complete-iteration": 0.18709067766331444, "set_robot_commands": 0.003709742845582568, "deviation-center-line": 0.6873688697143546, "driven_lanedir_consec": 3.617950191185989, "sim_compute_sim_state": 0.026114557400222657, "sim_compute_performance-ego": 0.002934012531248991}}
set_robot_commands_max0.004042834651713468
set_robot_commands_mean0.003811051769230923
set_robot_commands_median0.003749184519791406
set_robot_commands_min0.003703003385627412
sim_compute_performance-ego_max0.00311569008694227
sim_compute_performance-ego_mean0.0030312662699890146
sim_compute_performance-ego_median0.0030376812308823982
sim_compute_performance-ego_min0.002934012531248991
sim_compute_sim_state_max0.026114557400222657
sim_compute_sim_state_mean0.02394757422464946
sim_compute_sim_state_median0.02434005156139612
sim_compute_sim_state_min0.020995636375582948
sim_render-ego_max0.00480976427693766
sim_render-ego_mean0.004550229510574436
sim_render-ego_median0.004543082227512282
sim_render-ego_min0.0043049893103355216
simulation-passed1
step_physics_max0.08586857477823893
step_physics_mean0.08311415528209543
step_physics_median0.08429131028304505
step_physics_min0.07800542578405263
survival_time_max14.950000000000076
survival_time_mean10.512500000000038
survival_time_min2.4499999999999993
No reset possible
4343711671Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:08:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.759795731831763
survival_time_median14.950000000000076
deviation-center-line_median0.8167746045531139
in-drivable-lane_median2.5000000000000124


other stats
agent_compute-ego_max0.015760924021402997
agent_compute-ego_mean0.014947591821352642
agent_compute-ego_median0.015213937759399412
agent_compute-ego_min0.01360156774520874
complete-iteration_max0.1838990290959676
complete-iteration_mean0.16945441246032714
complete-iteration_median0.17187078118324278
complete-iteration_min0.1501770583788554
deviation-center-line_max0.9647229440236768
deviation-center-line_mean0.8233855033293818
deviation-center-line_min0.6952698601876228
deviation-heading_max4.240978545483828
deviation-heading_mean2.856392119877038
deviation-heading_median2.635452852955918
deviation-heading_min1.913684228112488
driven_any_max4.949550589159736
driven_any_mean4.525146942068558
driven_any_median4.748224061089175
driven_any_min3.654589056936143
driven_lanedir_consec_max4.229430722510674
driven_lanedir_consec_mean3.741264068284791
driven_lanedir_consec_min3.2160340869649624
driven_lanedir_max4.229430722510674
driven_lanedir_mean3.741264068284791
driven_lanedir_median3.759795731831763
driven_lanedir_min3.2160340869649624
get_duckie_state_max1.4750162760416666e-06
get_duckie_state_mean1.3788541158040364e-06
get_duckie_state_median1.397132873535156e-06
get_duckie_state_min1.2461344401041666e-06
get_robot_state_max0.010452837149302164
get_robot_state_mean0.0098513662815094
get_robot_state_median0.010085593461990356
get_robot_state_min0.00878144105275472
get_state_dump_max0.008179865678151448
get_state_dump_mean0.00774515946706136
get_state_dump_median0.007811201413472493
get_state_dump_min0.007178369363149007
get_ui_image_max0.032486992677052816
get_ui_image_mean0.02933134476343791
get_ui_image_median0.029889390468597413
get_ui_image_min0.025059605439503987
in-drivable-lane_max3.8500000000000103
in-drivable-lane_mean2.500000000000008
in-drivable-lane_min1.149999999999996
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.923000370661031, "get_ui_image": 0.032486992677052816, "step_physics": 0.0831650972366333, "survival_time": 14.950000000000076, "driven_lanedir": 4.229430722510674, "get_state_dump": 0.007757035891215006, "sim_render-ego": 0.004676760832468669, "get_robot_state": 0.010452837149302164, "get_duckie_state": 1.4440218607584635e-06, "in-drivable-lane": 2.4500000000000135, "agent_compute-ego": 0.015760924021402997, "deviation-heading": 2.6693286698418675, "complete-iteration": 0.1838990290959676, "set_robot_commands": 0.003551506201426188, "deviation-center-line": 0.7979734690437099, "driven_lanedir_consec": 4.229430722510674, "sim_compute_sim_state": 0.02298488696416219, "sim_compute_performance-ego": 0.002967680295308431}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.949550589159736, "get_ui_image": 0.03073125203450521, "step_physics": 0.07871608336766561, "survival_time": 14.950000000000076, "driven_lanedir": 3.2160340869649624, "get_state_dump": 0.00786536693572998, "sim_render-ego": 0.004350103537241618, "get_robot_state": 0.01004088322321574, "get_duckie_state": 1.4750162760416666e-06, "in-drivable-lane": 3.8500000000000103, "agent_compute-ego": 0.014968945185343424, "deviation-heading": 4.240978545483828, "complete-iteration": 0.1761152704556783, "set_robot_commands": 0.003679319222768147, "deviation-center-line": 0.9647229440236768, "driven_lanedir_consec": 3.2160340869649624, "sim_compute_sim_state": 0.02264404296875, "sim_compute_performance-ego": 0.003020058472951253}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.654589056936143, "get_ui_image": 0.029047528902689617, "step_physics": 0.07558027823766073, "survival_time": 14.950000000000076, "driven_lanedir": 3.395551964006566, "get_state_dump": 0.008179865678151448, "sim_render-ego": 0.004312392870585124, "get_robot_state": 0.010130303700764974, "get_duckie_state": 1.350243886311849e-06, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.015458930333455405, "deviation-heading": 2.601577036069968, "complete-iteration": 0.1676262919108073, "set_robot_commands": 0.0036628198623657226, "deviation-center-line": 0.8355757400625178, "driven_lanedir_consec": 3.395551964006566, "sim_compute_sim_state": 0.018327758312225342, "sim_compute_performance-ego": 0.0028282690048217775}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.573447751517319, "get_ui_image": 0.025059605439503987, "step_physics": 0.06622599522272746, "survival_time": 14.950000000000076, "driven_lanedir": 4.124039499656961, "get_state_dump": 0.007178369363149007, "sim_render-ego": 0.004058561325073242, "get_robot_state": 0.00878144105275472, "get_duckie_state": 1.2461344401041666e-06, "in-drivable-lane": 2.5500000000000114, "agent_compute-ego": 0.01360156774520874, "deviation-heading": 1.913684228112488, "complete-iteration": 0.1501770583788554, "set_robot_commands": 0.003413997491200765, "deviation-center-line": 0.6952698601876228, "driven_lanedir_consec": 4.124039499656961, "sim_compute_sim_state": 0.01910713831583659, "sim_compute_performance-ego": 0.0026579793294270833}}
set_robot_commands_max0.003679319222768147
set_robot_commands_mean0.003576910694440206
set_robot_commands_median0.003607163031895955
set_robot_commands_min0.003413997491200765
sim_compute_performance-ego_max0.003020058472951253
sim_compute_performance-ego_mean0.002868496775627136
sim_compute_performance-ego_median0.0028979746500651044
sim_compute_performance-ego_min0.0026579793294270833
sim_compute_sim_state_max0.02298488696416219
sim_compute_sim_state_mean0.02076595664024353
sim_compute_sim_state_median0.020875590642293294
sim_compute_sim_state_min0.018327758312225342
sim_render-ego_max0.004676760832468669
sim_render-ego_mean0.0043494546413421625
sim_render-ego_median0.004331248203913371
sim_render-ego_min0.004058561325073242
simulation-passed1
step_physics_max0.0831650972366333
step_physics_mean0.07592186351617178
step_physics_median0.07714818080266317
step_physics_min0.06622599522272746
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4340611670Mo KleitΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5577552767443295
survival_time_median14.950000000000076
deviation-center-line_median0.5653437789250217
in-drivable-lane_median3.150000000000035


other stats
agent_compute-ego_max0.011912314097086587
agent_compute-ego_mean0.011605079968770346
agent_compute-ego_median0.011620523929595948
agent_compute-ego_min0.011266957918802898
complete-iteration_max0.1369328761100769
complete-iteration_mean0.12909230291843413
complete-iteration_median0.1281839919090271
complete-iteration_min0.12306835174560549
deviation-center-line_max0.7804181782669292
deviation-center-line_mean0.5729256912245847
deviation-center-line_min0.3805970287813659
deviation-heading_max3.6090260541725954
deviation-heading_mean2.675028080111339
deviation-heading_median2.721319643100836
deviation-heading_min1.64844698007109
driven_any_max3.879779812634754
driven_any_mean3.8764136193345777
driven_any_median3.8795029448410143
driven_any_min3.8668687750215263
driven_lanedir_consec_max3.275777971166688
driven_lanedir_consec_mean2.424573761774191
driven_lanedir_consec_min1.3070065224414178
driven_lanedir_max3.275777971166688
driven_lanedir_mean2.5462399624421876
driven_lanedir_median2.8010876780803224
driven_lanedir_min1.3070065224414178
get_duckie_state_max1.0633468627929687e-06
get_duckie_state_mean1.0085105895996097e-06
get_duckie_state_median1.0057290395100912e-06
get_duckie_state_min9.592374165852865e-07
get_robot_state_max0.009189222653706869
get_robot_state_mean0.008405889272689818
get_robot_state_median0.00815282901128133
get_robot_state_min0.008128676414489746
get_state_dump_max0.007014034589131673
get_state_dump_mean0.006863271792729696
get_state_dump_median0.006817216078440348
get_state_dump_min0.006804620424906413
get_ui_image_max0.023035217920939127
get_ui_image_mean0.022414018710454304
get_ui_image_median0.02226619084676107
get_ui_image_min0.022088475227355957
in-drivable-lane_max9.30000000000009
in-drivable-lane_mean4.3750000000000435
in-drivable-lane_min1.9000000000000128
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.8668687750215263, "get_ui_image": 0.02218816041946411, "step_physics": 0.05445776065190633, "survival_time": 14.950000000000076, "driven_lanedir": 2.5932701360086066, "get_state_dump": 0.006804620424906413, "sim_render-ego": 0.003642549514770507, "get_robot_state": 0.008129543463389078, "get_duckie_state": 1.0633468627929687e-06, "in-drivable-lane": 4.050000000000039, "agent_compute-ego": 0.011541148026784262, "deviation-heading": 2.9382916381927617, "complete-iteration": 0.1259572903315226, "set_robot_commands": 0.002720284461975098, "deviation-center-line": 0.4189090862334248, "driven_lanedir_consec": 2.5932701360086066, "sim_compute_sim_state": 0.014067958196004232, "sim_compute_performance-ego": 0.002331585884094238}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879779812634754, "get_ui_image": 0.022088475227355957, "step_physics": 0.052495447794596355, "survival_time": 14.950000000000076, "driven_lanedir": 3.275777971166688, "get_state_dump": 0.006811387538909912, "sim_render-ego": 0.0036168805758158367, "get_robot_state": 0.008128676414489746, "get_duckie_state": 9.592374165852865e-07, "in-drivable-lane": 1.9000000000000128, "agent_compute-ego": 0.011266957918802898, "deviation-heading": 2.5043476480089097, "complete-iteration": 0.12306835174560549, "set_robot_commands": 0.0027141380310058594, "deviation-center-line": 0.7117784716166187, "driven_lanedir_consec": 3.275777971166688, "sim_compute_sim_state": 0.013538384437561037, "sim_compute_performance-ego": 0.002332286834716797}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.8793393922403383, "get_ui_image": 0.022344221274058024, "step_physics": 0.058429216543833415, "survival_time": 14.950000000000076, "driven_lanedir": 1.3070065224414178, "get_state_dump": 0.006823044617970784, "sim_render-ego": 0.003683621088663737, "get_robot_state": 0.008176114559173584, "get_duckie_state": 9.60826873779297e-07, "in-drivable-lane": 9.30000000000009, "agent_compute-ego": 0.011699899832407634, "deviation-heading": 1.64844698007109, "complete-iteration": 0.1304106934865316, "set_robot_commands": 0.002701466878255208, "deviation-center-line": 0.3805970287813659, "driven_lanedir_consec": 1.3070065224414178, "sim_compute_sim_state": 0.014146033922831218, "sim_compute_performance-ego": 0.0023316097259521483}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.8796664974416912, "get_ui_image": 0.023035217920939127, "step_physics": 0.059470825990041096, "survival_time": 14.950000000000076, "driven_lanedir": 3.0089052201520383, "get_state_dump": 0.007014034589131673, "sim_render-ego": 0.003856794834136963, "get_robot_state": 0.009189222653706869, "get_duckie_state": 1.0506312052408851e-06, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.011912314097086587, "deviation-heading": 3.6090260541725954, "complete-iteration": 0.1369328761100769, "set_robot_commands": 0.0027989912033081054, "deviation-center-line": 0.7804181782669292, "driven_lanedir_consec": 2.5222404174800523, "sim_compute_sim_state": 0.01710059404373169, "sim_compute_performance-ego": 0.0024770132700602213}}
set_robot_commands_max0.0027989912033081054
set_robot_commands_mean0.0027337201436360677
set_robot_commands_median0.002717211246490479
set_robot_commands_min0.002701466878255208
sim_compute_performance-ego_max0.0024770132700602213
sim_compute_performance-ego_mean0.002368123928705851
sim_compute_performance-ego_median0.002331948280334473
sim_compute_performance-ego_min0.002331585884094238
sim_compute_sim_state_max0.01710059404373169
sim_compute_sim_state_mean0.014713242650032043
sim_compute_sim_state_median0.014106996059417724
sim_compute_sim_state_min0.013538384437561037
sim_render-ego_max0.003856794834136963
sim_render-ego_mean0.0036999615033467617
sim_render-ego_median0.0036630853017171226
sim_render-ego_min0.0036168805758158367
simulation-passed1
step_physics_max0.059470825990041096
step_physics_mean0.05621331274509431
step_physics_median0.05644348859786987
step_physics_min0.052495447794596355
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4338811665Bhavya PatwaΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6006279280798794
survival_time_median8.624999999999988
deviation-center-line_median0.2640509484300048
in-drivable-lane_median2.9500000000000086


other stats
agent_compute-ego_max0.01691300298538676
agent_compute-ego_mean0.016155817238542976
agent_compute-ego_median0.016532988476030755
agent_compute-ego_min0.014644289016723632
complete-iteration_max0.19220072150230408
complete-iteration_mean0.18357517828244793
complete-iteration_median0.18167151461349673
complete-iteration_min0.1787569624004942
deviation-center-line_max0.4102356658105483
deviation-center-line_mean0.25357967601535425
deviation-center-line_min0.07598114139085899
deviation-heading_max1.5084054365503687
deviation-heading_mean1.0689365228736702
deviation-heading_median1.192484069497955
deviation-heading_min0.38237251594840216
driven_any_max2.8361124250436753
driven_any_mean2.5997997697575363
driven_any_median2.592160216869015
driven_any_min2.3787662202484396
driven_lanedir_consec_max2.0139540301308285
driven_lanedir_consec_mean1.4624905667263883
driven_lanedir_consec_min0.6347523806149656
driven_lanedir_max2.0139540301308285
driven_lanedir_mean1.4624905667263883
driven_lanedir_median1.6006279280798794
driven_lanedir_min0.6347523806149656
get_duckie_state_max1.4435161243785512e-06
get_duckie_state_mean1.3966750993732774e-06
get_duckie_state_median1.4075305726793075e-06
get_duckie_state_min1.3281231277559432e-06
get_robot_state_max0.01031619493215362
get_robot_state_mean0.010075814286989669
get_robot_state_median0.010114731987317403
get_robot_state_min0.009757598241170248
get_state_dump_max0.007986227671305338
get_state_dump_mean0.007762046439678554
get_state_dump_median0.007779011461469863
get_state_dump_min0.007503935164469152
get_ui_image_max0.03147957086563111
get_ui_image_mean0.030534863296461982
get_ui_image_median0.03085213188988543
get_ui_image_min0.028955618540445965
in-drivable-lane_max5.899999999999981
in-drivable-lane_mean3.375000000000002
in-drivable-lane_min1.7000000000000108
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3787662202484396, "get_ui_image": 0.028955618540445965, "step_physics": 0.0791657577861439, "survival_time": 8.249999999999982, "driven_lanedir": 1.234554864751499, "get_state_dump": 0.007986227671305338, "sim_render-ego": 0.00466422312187426, "get_robot_state": 0.010097519556681317, "get_duckie_state": 1.4435161243785512e-06, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.016238150452122544, "deviation-heading": 0.8822109675029498, "complete-iteration": 0.1787569624004942, "set_robot_commands": 0.003802620280872692, "deviation-center-line": 0.2026616845092221, "driven_lanedir_consec": 1.234554864751499, "sim_compute_sim_state": 0.024625044158010773, "sim_compute_performance-ego": 0.003123124440511068}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.6205991454702, "get_ui_image": 0.03099715312321981, "step_physics": 0.08682150178485447, "survival_time": 8.999999999999993, "driven_lanedir": 1.96670099140826, "get_state_dump": 0.007663411564297147, "sim_render-ego": 0.0046280278099907765, "get_robot_state": 0.009757598241170248, "get_duckie_state": 1.4119678073459202e-06, "in-drivable-lane": 1.7000000000000108, "agent_compute-ego": 0.014644289016723632, "deviation-heading": 1.5027571714929602, "complete-iteration": 0.1822345018386841, "set_robot_commands": 0.003631842136383057, "deviation-center-line": 0.32544021235078757, "driven_lanedir_consec": 1.96670099140826, "sim_compute_sim_state": 0.021113581127590604, "sim_compute_performance-ego": 0.002878341409895155}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8361124250436753, "get_ui_image": 0.030707110656551056, "step_physics": 0.08349433559581546, "survival_time": 8.14999999999998, "driven_lanedir": 0.6347523806149656, "get_state_dump": 0.007503935164469152, "sim_render-ego": 0.00474187786593759, "get_robot_state": 0.01031619493215362, "get_duckie_state": 1.3281231277559432e-06, "in-drivable-lane": 5.899999999999981, "agent_compute-ego": 0.01691300298538676, "deviation-heading": 0.38237251594840216, "complete-iteration": 0.1811085273883094, "set_robot_commands": 0.0036348726120463176, "deviation-center-line": 0.07598114139085899, "driven_lanedir_consec": 0.6347523806149656, "sim_compute_sim_state": 0.020607290092421456, "sim_compute_performance-ego": 0.0030904269657252023}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.56372128826783, "get_ui_image": 0.03147957086563111, "step_physics": 0.08675820231437684, "survival_time": 10.000000000000009, "driven_lanedir": 2.0139540301308285, "get_state_dump": 0.007894611358642578, "sim_render-ego": 0.00465878963470459, "get_robot_state": 0.010131944417953492, "get_duckie_state": 1.4030933380126953e-06, "in-drivable-lane": 2.3500000000000263, "agent_compute-ego": 0.016827826499938966, "deviation-heading": 1.5084054365503687, "complete-iteration": 0.19220072150230408, "set_robot_commands": 0.0036857521533966062, "deviation-center-line": 0.4102356658105483, "driven_lanedir_consec": 2.0139540301308285, "sim_compute_sim_state": 0.027568365335464477, "sim_compute_performance-ego": 0.0030944299697875976}}
set_robot_commands_max0.003802620280872692
set_robot_commands_mean0.003688771795674668
set_robot_commands_median0.003660312382721462
set_robot_commands_min0.003631842136383057
sim_compute_performance-ego_max0.003123124440511068
sim_compute_performance-ego_mean0.003046580696479756
sim_compute_performance-ego_median0.0030924284677564
sim_compute_performance-ego_min0.002878341409895155
sim_compute_sim_state_max0.027568365335464477
sim_compute_sim_state_mean0.02347857017837183
sim_compute_sim_state_median0.02286931264280069
sim_compute_sim_state_min0.020607290092421456
sim_render-ego_max0.00474187786593759
sim_render-ego_mean0.004673229608126804
sim_render-ego_median0.004661506378289425
sim_render-ego_min0.0046280278099907765
simulation-passed1
step_physics_max0.08682150178485447
step_physics_mean0.08405994937029766
step_physics_median0.08512626895509615
step_physics_min0.0791657577861439
survival_time_max10.000000000000009
survival_time_mean8.84999999999999
survival_time_min8.14999999999998
No reset possible
4336611665Bhavya PatwaΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6005685902899556
survival_time_median9.349999999999998
deviation-center-line_median0.2799362294382673
in-drivable-lane_median3.5250000000000097


other stats
agent_compute-ego_max0.01866336186726888
agent_compute-ego_mean0.016591937020839394
agent_compute-ego_median0.016167189985597116
agent_compute-ego_min0.015370006244894452
complete-iteration_max0.2253342906634013
complete-iteration_mean0.1949862545554794
complete-iteration_median0.18757168198347104
complete-iteration_min0.17946736359157445
deviation-center-line_max0.370137305593389
deviation-center-line_mean0.2530565130698225
deviation-center-line_min0.0822162878093665
deviation-heading_max1.9666026802486896
deviation-heading_mean1.1128460866949377
deviation-heading_median1.0307308143856488
deviation-heading_min0.4233200377597629
driven_any_max3.1553117763351413
driven_any_mean2.405282276453057
driven_any_median2.391679783277607
driven_any_min1.6824577629218724
driven_lanedir_consec_max2.0195029496358328
driven_lanedir_consec_mean1.4612075960096873
driven_lanedir_consec_min0.624190253823005
driven_lanedir_max2.0195029496358328
driven_lanedir_mean1.4612075960096873
driven_lanedir_median1.6005685902899556
driven_lanedir_min0.624190253823005
get_duckie_state_max1.7579396565755208e-06
get_duckie_state_mean1.608151388062342e-06
get_duckie_state_median1.6024018908976414e-06
get_duckie_state_min1.469862113878565e-06
get_robot_state_max0.011239906946818036
get_robot_state_mean0.01028166175866531
get_robot_state_median0.010064367121769889
get_robot_state_min0.009758005844303436
get_state_dump_max0.008369197212689295
get_state_dump_mean0.008073820491070357
get_state_dump_median0.008085179544961182
get_state_dump_min0.007755725661669772
get_ui_image_max0.03689671834309896
get_ui_image_mean0.03338240657286776
get_ui_image_median0.03297319760712298
get_ui_image_min0.03068651273412612
in-drivable-lane_max9.60000000000008
in-drivable-lane_mean4.312500000000025
in-drivable-lane_min0.5999999999999996
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.1553117763351413, "get_ui_image": 0.03689671834309896, "step_physics": 0.10771997451782228, "survival_time": 14.950000000000076, "driven_lanedir": 1.353407786622689, "get_state_dump": 0.008262135187784831, "sim_render-ego": 0.005322413444519043, "get_robot_state": 0.011239906946818036, "get_duckie_state": 1.7579396565755208e-06, "in-drivable-lane": 9.60000000000008, "agent_compute-ego": 0.01866336186726888, "deviation-heading": 1.4422887420261274, "complete-iteration": 0.2253342906634013, "set_robot_commands": 0.0036452770233154296, "deviation-center-line": 0.2949057790233592, "driven_lanedir_consec": 1.353407786622689, "sim_compute_sim_state": 0.030182464917500818, "sim_compute_performance-ego": 0.003307313124338786}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.134736082899482, "get_ui_image": 0.033962072770288385, "step_physics": 0.08116241905586852, "survival_time": 8.14999999999998, "driven_lanedir": 1.847729393957222, "get_state_dump": 0.007755725661669772, "sim_render-ego": 0.004455692197647563, "get_robot_state": 0.009758005844303436, "get_duckie_state": 1.4714668133507477e-06, "in-drivable-lane": 0.5999999999999996, "agent_compute-ego": 0.016052263646038033, "deviation-heading": 1.9666026802486896, "complete-iteration": 0.17946736359157445, "set_robot_commands": 0.003819167248310487, "deviation-center-line": 0.370137305593389, "driven_lanedir_consec": 1.847729393957222, "sim_compute_sim_state": 0.01964622772544439, "sim_compute_performance-ego": 0.002762076313510263}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.6824577629218724, "get_ui_image": 0.03068651273412612, "step_physics": 0.08759421746707657, "survival_time": 5.14999999999999, "driven_lanedir": 0.624190253823005, "get_state_dump": 0.007908223902137534, "sim_render-ego": 0.004519809796972182, "get_robot_state": 0.009929106073472109, "get_duckie_state": 1.469862113878565e-06, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.016282116325156203, "deviation-heading": 0.4233200377597629, "complete-iteration": 0.18461260054875345, "set_robot_commands": 0.003517463369276917, "deviation-center-line": 0.0822162878093665, "driven_lanedir_consec": 0.624190253823005, "sim_compute_sim_state": 0.020879926033390377, "sim_compute_performance-ego": 0.003201493939149727}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6486234836557316, "get_ui_image": 0.031984322443957575, "step_physics": 0.08521390074237263, "survival_time": 10.550000000000017, "driven_lanedir": 2.0195029496358328, "get_state_dump": 0.008369197212689295, "sim_render-ego": 0.00468636350044142, "get_robot_state": 0.010199628170067664, "get_duckie_state": 1.733336968444535e-06, "in-drivable-lane": 4.15000000000003, "agent_compute-ego": 0.015370006244894452, "deviation-heading": 0.6191728867451703, "complete-iteration": 0.1905307634181886, "set_robot_commands": 0.0038178690236891615, "deviation-center-line": 0.2649666798531754, "driven_lanedir_consec": 2.0195029496358328, "sim_compute_sim_state": 0.027622051148618, "sim_compute_performance-ego": 0.0031713004360831745}}
set_robot_commands_max0.003819167248310487
set_robot_commands_mean0.0036999441661479983
set_robot_commands_median0.003731573023502296
set_robot_commands_min0.003517463369276917
sim_compute_performance-ego_max0.003307313124338786
sim_compute_performance-ego_mean0.003110545953270487
sim_compute_performance-ego_median0.0031863971876164507
sim_compute_performance-ego_min0.002762076313510263
sim_compute_sim_state_max0.030182464917500818
sim_compute_sim_state_mean0.024582667456238397
sim_compute_sim_state_median0.02425098859100419
sim_compute_sim_state_min0.01964622772544439
sim_render-ego_max0.005322413444519043
sim_render-ego_mean0.004746069734895052
sim_render-ego_median0.004603086648706801
sim_render-ego_min0.004455692197647563
simulation-passed1
step_physics_max0.10771997451782228
step_physics_mean0.090422627945785
step_physics_median0.0864040591047246
step_physics_min0.08116241905586852
survival_time_max14.950000000000076
survival_time_mean9.700000000000015
survival_time_min5.14999999999999
No reset possible
4336211665Bhavya PatwaΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simtimeoutnoafdaniele04-b953b5d8021c-10:00:52
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4333411661Dishank BansalΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:09:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7868432562903025
survival_time_median14.950000000000076
deviation-center-line_median0.664163908620748
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01627861976623535
agent_compute-ego_mean0.014854511221249898
agent_compute-ego_median0.01577472647031148
agent_compute-ego_min0.011589972178141277
complete-iteration_max0.23042837460835777
complete-iteration_mean0.1994774619738261
complete-iteration_median0.2144169612725576
complete-iteration_min0.1386475507418315
deviation-center-line_max0.7287634579017853
deviation-center-line_mean0.64493558974808
deviation-center-line_min0.5226510838490387
deviation-heading_max2.7037173736213354
deviation-heading_mean2.321035018181851
deviation-heading_median2.2355536923818375
deviation-heading_min2.1093153143423917
driven_any_max2.980652740239239
driven_any_mean2.7895871801653263
driven_any_median2.8303062661925225
driven_any_min2.5170834480370226
driven_lanedir_consec_max2.942375809220933
driven_lanedir_consec_mean2.742137454834947
driven_lanedir_consec_min2.4524874975382516
driven_lanedir_max2.942375809220933
driven_lanedir_mean2.742137454834947
driven_lanedir_median2.7868432562903025
driven_lanedir_min2.4524874975382516
get_duckie_state_max1.6339619954427084e-06
get_duckie_state_mean1.5097856521606444e-06
get_duckie_state_median1.5445550282796224e-06
get_duckie_state_min1.316070556640625e-06
get_robot_state_max0.01086543639500936
get_robot_state_mean0.01013301968574524
get_robot_state_median0.010614920059839885
get_robot_state_min0.00843680222829183
get_state_dump_max0.008175930976867675
get_state_dump_mean0.007849267323811849
get_state_dump_median0.008108701705932617
get_state_dump_min0.007003734906514486
get_ui_image_max0.03882757902145386
get_ui_image_mean0.03504839380582174
get_ui_image_median0.03721037030220032
get_ui_image_min0.026945255597432455
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.7105821039472766, "get_ui_image": 0.026945255597432455, "step_physics": 0.06070072730382284, "survival_time": 14.950000000000076, "driven_lanedir": 2.6692643084786916, "get_state_dump": 0.007003734906514486, "sim_render-ego": 0.0037392020225524903, "get_robot_state": 0.00843680222829183, "get_duckie_state": 1.316070556640625e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011589972178141277, "deviation-heading": 2.16772195859468, "complete-iteration": 0.1386475507418315, "set_robot_commands": 0.0031554460525512694, "deviation-center-line": 0.7024805231345197, "driven_lanedir_consec": 2.6692643084786916, "sim_compute_sim_state": 0.01454968531926473, "sim_compute_performance-ego": 0.002439610958099365}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.950030428437768, "get_ui_image": 0.03670748074849447, "step_physics": 0.0996643582979838, "survival_time": 14.950000000000076, "driven_lanedir": 2.9044222041019134, "get_state_dump": 0.008127976258595784, "sim_render-ego": 0.0050979328155517575, "get_robot_state": 0.010638534228007, "get_duckie_state": 1.529852549235026e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01627861976623535, "deviation-heading": 2.303385426168995, "complete-iteration": 0.210747979482015, "set_robot_commands": 0.003796975612640381, "deviation-center-line": 0.5226510838490387, "driven_lanedir_consec": 2.9044222041019134, "sim_compute_sim_state": 0.02711192051569621, "sim_compute_performance-ego": 0.003224325974782308}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5170834480370226, "get_ui_image": 0.03771325985590617, "step_physics": 0.10475480079650878, "survival_time": 14.950000000000076, "driven_lanedir": 2.4524874975382516, "get_state_dump": 0.00808942715326945, "sim_render-ego": 0.005159589449564616, "get_robot_state": 0.01086543639500936, "get_duckie_state": 1.5592575073242188e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01581572453180949, "deviation-heading": 2.7037173736213354, "complete-iteration": 0.21808594306310017, "set_robot_commands": 0.003942883809407552, "deviation-center-line": 0.6258472941069764, "driven_lanedir_consec": 2.4524874975382516, "sim_compute_sim_state": 0.027965141932169597, "sim_compute_performance-ego": 0.0036774396896362303}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.980652740239239, "get_ui_image": 0.03882757902145386, "step_physics": 0.10966358423233032, "survival_time": 14.950000000000076, "driven_lanedir": 2.942375809220933, "get_state_dump": 0.008175930976867675, "sim_render-ego": 0.005003193219502767, "get_robot_state": 0.01059130589167277, "get_duckie_state": 1.6339619954427084e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015733728408813475, "deviation-heading": 2.1093153143423917, "complete-iteration": 0.23042837460835777, "set_robot_commands": 0.003707774480183919, "deviation-center-line": 0.7287634579017853, "driven_lanedir_consec": 2.942375809220933, "sim_compute_sim_state": 0.03542243162790934, "sim_compute_performance-ego": 0.00320042610168457}}
set_robot_commands_max0.003942883809407552
set_robot_commands_mean0.00365076998869578
set_robot_commands_median0.00375237504641215
set_robot_commands_min0.0031554460525512694
sim_compute_performance-ego_max0.0036774396896362303
sim_compute_performance-ego_mean0.0031354506810506184
sim_compute_performance-ego_median0.0032123760382334393
sim_compute_performance-ego_min0.002439610958099365
sim_compute_sim_state_max0.03542243162790934
sim_compute_sim_state_mean0.02626229484875997
sim_compute_sim_state_median0.027538531223932905
sim_compute_sim_state_min0.01454968531926473
sim_render-ego_max0.005159589449564616
sim_render-ego_mean0.004749979376792907
sim_render-ego_median0.005050563017527262
sim_render-ego_min0.0037392020225524903
simulation-passed1
step_physics_max0.10966358423233032
step_physics_mean0.09369586765766144
step_physics_median0.1022095795472463
step_physics_min0.06070072730382284
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4331511659Bhavya PatwaΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6057552517099445
survival_time_median8.49999999999999
deviation-center-line_median0.19626079303296856
in-drivable-lane_median2.0500000000000043


other stats
agent_compute-ego_max0.016014530059488063
agent_compute-ego_mean0.015086085706570388
agent_compute-ego_median0.015527692004407324
agent_compute-ego_min0.013274428757978844
complete-iteration_max0.18221899478331857
complete-iteration_mean0.1646853147136645
complete-iteration_median0.17309814227597742
complete-iteration_min0.13032597951938452
deviation-center-line_max0.3595382056017289
deviation-center-line_mean0.20886525911212145
deviation-center-line_min0.0834012447808198
deviation-heading_max1.5808393415541664
deviation-heading_mean0.9877481018803362
deviation-heading_median0.9806939379247812
deviation-heading_min0.408765190117616
driven_any_max2.3765485428519257
driven_any_mean2.0465669123703796
driven_any_median2.2100564172120154
driven_any_min1.3896062722055629
driven_lanedir_consec_max1.981834804361879
driven_lanedir_consec_mean1.4486828182448548
driven_lanedir_consec_min0.6013859651976513
driven_lanedir_max1.981834804361879
driven_lanedir_mean1.4486828182448548
driven_lanedir_median1.6057552517099445
driven_lanedir_min0.6013859651976513
get_duckie_state_max1.4071879179581352e-06
get_duckie_state_mean1.3488544431659652e-06
get_duckie_state_median1.3715088969529275e-06
get_duckie_state_min1.2452120607998704e-06
get_robot_state_max0.0101985153944596
get_robot_state_mean0.009489951170340329
get_robot_state_median0.00966338316599528
get_robot_state_min0.008434522954911148
get_state_dump_max0.007763650106347125
get_state_dump_mean0.007507422624595297
get_state_dump_median0.007546078145893571
get_state_dump_min0.007173884100246924
get_ui_image_max0.03174183161362358
get_ui_image_mean0.02832786799232224
get_ui_image_median0.02929927937274736
get_ui_image_min0.022971081610170672
in-drivable-lane_max5.10000000000001
in-drivable-lane_mean2.525000000000004
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3765485428519257, "get_ui_image": 0.022971081610170672, "step_physics": 0.054489989354820446, "survival_time": 9.650000000000002, "driven_lanedir": 1.350826188096237, "get_state_dump": 0.007173884100246924, "sim_render-ego": 0.003811282815093203, "get_robot_state": 0.008434522954911148, "get_duckie_state": 1.2452120607998704e-06, "in-drivable-lane": 5.10000000000001, "agent_compute-ego": 0.013274428757978844, "deviation-heading": 0.6031181204395188, "complete-iteration": 0.13032597951938452, "set_robot_commands": 0.0029746065485662747, "deviation-center-line": 0.15156805949416297, "driven_lanedir_consec": 1.350826188096237, "sim_compute_sim_state": 0.01466223118836398, "sim_compute_performance-ego": 0.002442947941122895}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.340101117712724, "get_ui_image": 0.02906178790617754, "step_physics": 0.07721735066908567, "survival_time": 9.349999999999998, "driven_lanedir": 1.981834804361879, "get_state_dump": 0.007495305117438821, "sim_render-ego": 0.004612940517976323, "get_robot_state": 0.00950758597430061, "get_duckie_state": 1.3514636034634023e-06, "in-drivable-lane": 1.8000000000000167, "agent_compute-ego": 0.016014530059488063, "deviation-heading": 1.5808393415541664, "complete-iteration": 0.170669481716054, "set_robot_commands": 0.0039190570300913115, "deviation-center-line": 0.3595382056017289, "driven_lanedir_consec": 1.981834804361879, "sim_compute_sim_state": 0.01983364508113759, "sim_compute_performance-ego": 0.0029160377176050195}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.3896062722055629, "get_ui_image": 0.03174183161362358, "step_physics": 0.08259572412656702, "survival_time": 4.599999999999992, "driven_lanedir": 0.6013859651976513, "get_state_dump": 0.007763650106347125, "sim_render-ego": 0.004437578761059305, "get_robot_state": 0.0101985153944596, "get_duckie_state": 1.4071879179581352e-06, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.015713665796362835, "deviation-heading": 0.408765190117616, "complete-iteration": 0.18221899478331857, "set_robot_commands": 0.0037997883299122686, "deviation-center-line": 0.0834012447808198, "driven_lanedir_consec": 0.6013859651976513, "sim_compute_sim_state": 0.02279009248899377, "sim_compute_performance-ego": 0.0030848021092622175}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.080011716711307, "get_ui_image": 0.02953677083931717, "step_physics": 0.07819404009900062, "survival_time": 7.649999999999981, "driven_lanedir": 1.860684315323652, "get_state_dump": 0.00759685117434832, "sim_render-ego": 0.004321620355244555, "get_robot_state": 0.00981918035768995, "get_duckie_state": 1.391554190442453e-06, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.01534171821245181, "deviation-heading": 1.3582697554100434, "complete-iteration": 0.1755268028359008, "set_robot_commands": 0.0035714900571536395, "deviation-center-line": 0.24095352657177416, "driven_lanedir_consec": 1.860684315323652, "sim_compute_sim_state": 0.024289383607752183, "sim_compute_performance-ego": 0.0027614138484780303}}
set_robot_commands_max0.0039190570300913115
set_robot_commands_mean0.0035662354914308735
set_robot_commands_median0.003685639193532954
set_robot_commands_min0.0029746065485662747
sim_compute_performance-ego_max0.0030848021092622175
sim_compute_performance-ego_mean0.00280130040411704
sim_compute_performance-ego_median0.002838725783041525
sim_compute_performance-ego_min0.002442947941122895
sim_compute_sim_state_max0.024289383607752183
sim_compute_sim_state_mean0.02039383809156188
sim_compute_sim_state_median0.02131186878506568
sim_compute_sim_state_min0.01466223118836398
sim_render-ego_max0.004612940517976323
sim_render-ego_mean0.0042958556123433465
sim_render-ego_median0.004379599558151931
sim_render-ego_min0.003811282815093203
simulation-passed1
step_physics_max0.08259572412656702
step_physics_mean0.07312427606236843
step_physics_median0.07770569538404315
step_physics_min0.054489989354820446
survival_time_max9.650000000000002
survival_time_mean7.812499999999993
survival_time_min4.599999999999992
No reset possible
4318711628Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.724964267842215
survival_time_median14.950000000000076
deviation-center-line_median0.4653992348665475
in-drivable-lane_median3.1500000000000212


other stats
agent_compute-ego_max0.012101366519927978
agent_compute-ego_mean0.011988601491139674
agent_compute-ego_median0.012066698869069418
agent_compute-ego_min0.011719641706491882
complete-iteration_max0.1316691772143046
complete-iteration_mean0.1285536532333769
complete-iteration_median0.12857962742075874
complete-iteration_min0.12538618087768555
deviation-center-line_max0.8905554940164447
deviation-center-line_mean0.5009525318943118
deviation-center-line_min0.1824561638277074
deviation-heading_max3.31311485433073
deviation-heading_mean2.183272018626607
deviation-heading_median2.3406337203176877
deviation-heading_min0.7387057795403229
driven_any_max3.809146085115319
driven_any_mean3.477493661458694
driven_any_median3.5306387974098774
driven_any_min3.0395509658997013
driven_lanedir_consec_max3.443088259599222
driven_lanedir_consec_mean2.384293804101545
driven_lanedir_consec_min0.6441584211225277
driven_lanedir_max3.443088259599222
driven_lanedir_mean2.38854766455602
driven_lanedir_median2.724964267842215
driven_lanedir_min0.6611738629404295
get_duckie_state_max1.1730194091796877e-06
get_duckie_state_mean1.017537060988282e-06
get_duckie_state_median9.90006016914715e-07
get_duckie_state_min9.171168009440104e-07
get_robot_state_max0.008242692191170176
get_robot_state_mean0.008151941309066248
get_robot_state_median0.008146067063013712
get_robot_state_min0.008072938919067383
get_state_dump_max0.006878860196353055
get_state_dump_mean0.006816007743497952
get_state_dump_median0.006809503634770711
get_state_dump_min0.006766163508097331
get_ui_image_max0.02279798890000398
get_ui_image_mean0.022298111480588256
get_ui_image_median0.022160210609436036
get_ui_image_min0.022074035803476968
in-drivable-lane_max11.65000000000007
in-drivable-lane_mean4.725000000000032
in-drivable-lane_min0.9500000000000136
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.809146085115319, "get_ui_image": 0.022162554264068605, "step_physics": 0.054416867891947426, "survival_time": 14.950000000000076, "driven_lanedir": 3.443088259599222, "get_state_dump": 0.0068139958381652835, "sim_render-ego": 0.003641863663991293, "get_robot_state": 0.008161269028981526, "get_duckie_state": 1.1730194091796877e-06, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.01206476052602132, "deviation-heading": 2.9605616310311325, "complete-iteration": 0.12667890866597495, "set_robot_commands": 0.002701656023661296, "deviation-center-line": 0.8905554940164447, "driven_lanedir_consec": 3.443088259599222, "sim_compute_sim_state": 0.014292017618815104, "sim_compute_performance-ego": 0.002348606586456299}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.699848081532302, "get_ui_image": 0.022074035803476968, "step_physics": 0.05382983922958374, "survival_time": 14.950000000000076, "driven_lanedir": 3.405014256430059, "get_state_dump": 0.006805011431376139, "sim_render-ego": 0.0035915255546569826, "get_robot_state": 0.008072938919067383, "get_duckie_state": 1.0053316752115886e-06, "in-drivable-lane": 1.5500000000000007, "agent_compute-ego": 0.012101366519927978, "deviation-heading": 3.31311485433073, "complete-iteration": 0.12538618087768555, "set_robot_commands": 0.0026852893829345703, "deviation-center-line": 0.6966985159439995, "driven_lanedir_consec": 3.405014256430059, "sim_compute_sim_state": 0.013829513390858968, "sim_compute_performance-ego": 0.0023203253746032714}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.3614295132874523, "get_ui_image": 0.022157866954803467, "step_physics": 0.05980503479639689, "survival_time": 14.950000000000076, "driven_lanedir": 0.6611738629404295, "get_state_dump": 0.006766163508097331, "sim_render-ego": 0.00366942564646403, "get_robot_state": 0.008130865097045898, "get_duckie_state": 9.171168009440104e-07, "in-drivable-lane": 11.65000000000007, "agent_compute-ego": 0.012068637212117511, "deviation-heading": 1.720705809604243, "complete-iteration": 0.1316691772143046, "set_robot_commands": 0.0027030150095621744, "deviation-center-line": 0.1824561638277074, "driven_lanedir_consec": 0.6441584211225277, "sim_compute_sim_state": 0.013951452573140462, "sim_compute_performance-ego": 0.0023403231302897135}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0395509658997013, "get_ui_image": 0.02279798890000398, "step_physics": 0.05542243419764851, "survival_time": 11.350000000000026, "driven_lanedir": 2.044914279254371, "get_state_dump": 0.006878860196353055, "sim_render-ego": 0.003627320218191273, "get_robot_state": 0.008242692191170176, "get_duckie_state": 9.746803586178414e-07, "in-drivable-lane": 4.750000000000042, "agent_compute-ego": 0.011719641706491882, "deviation-heading": 0.7387057795403229, "complete-iteration": 0.1304803461755425, "set_robot_commands": 0.002629429233231734, "deviation-center-line": 0.23409995378909557, "driven_lanedir_consec": 2.044914279254371, "sim_compute_sim_state": 0.016754245968117063, "sim_compute_performance-ego": 0.002330345204223095}}
set_robot_commands_max0.0027030150095621744
set_robot_commands_mean0.0026798474123474435
set_robot_commands_median0.002693472703297933
set_robot_commands_min0.002629429233231734
sim_compute_performance-ego_max0.002348606586456299
sim_compute_performance-ego_mean0.0023349000738930948
sim_compute_performance-ego_median0.002335334167256405
sim_compute_performance-ego_min0.0023203253746032714
sim_compute_sim_state_max0.016754245968117063
sim_compute_sim_state_mean0.0147068073877329
sim_compute_sim_state_median0.014121735095977785
sim_compute_sim_state_min0.013829513390858968
sim_render-ego_max0.00366942564646403
sim_render-ego_mean0.0036325337708258943
sim_render-ego_median0.0036345919410912825
sim_render-ego_min0.0035915255546569826
simulation-passed1
step_physics_max0.05980503479639689
step_physics_mean0.05586854402889414
step_physics_median0.05491965104479797
step_physics_min0.05382983922958374
survival_time_max14.950000000000076
survival_time_mean14.050000000000065
survival_time_min11.350000000000026
No reset possible
4315511621Mo KleitΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4692937392450325
survival_time_median14.950000000000076
deviation-center-line_median1.0773479893977995
in-drivable-lane_median0.9000000000000128


other stats
agent_compute-ego_max0.01289929469426473
agent_compute-ego_mean0.012064803044001262
agent_compute-ego_median0.011962461868921916
agent_compute-ego_min0.011434993743896484
complete-iteration_max0.150864421526591
complete-iteration_mean0.1328540656963984
complete-iteration_median0.12873890837033589
complete-iteration_min0.1230740245183309
deviation-center-line_max1.266643129041033
deviation-center-line_mean0.9328018691094196
deviation-center-line_min0.3098683686010453
deviation-heading_max4.849160047585628
deviation-heading_mean3.972389938425189
deviation-heading_median4.7585664817156355
deviation-heading_min1.523266742683855
driven_any_max1.9397927246313296
driven_any_mean1.9364294484764144
driven_any_median1.9397488603988444
driven_any_min1.9264273484766392
driven_lanedir_consec_max1.7049638752191514
driven_lanedir_consec_mean1.2780613238475416
driven_lanedir_consec_min0.46869394168094947
driven_lanedir_max1.7049638752191514
driven_lanedir_mean1.3690040836549306
driven_lanedir_median1.6511792588598109
driven_lanedir_min0.46869394168094947
get_duckie_state_max1.1730194091796877e-06
get_duckie_state_mean1.081426938374837e-06
get_duckie_state_median1.0665257771809894e-06
get_duckie_state_min1.0196367899576822e-06
get_robot_state_max0.00870862086613973
get_robot_state_mean0.008302493492762247
get_robot_state_median0.008188990354537963
get_robot_state_min0.008123372395833333
get_state_dump_max0.007214241027832032
get_state_dump_mean0.006899589498837789
get_state_dump_median0.006806328694025676
get_state_dump_min0.006771459579467774
get_ui_image_max0.02580413818359375
get_ui_image_mean0.023096970915794372
get_ui_image_median0.022284276882807416
get_ui_image_min0.02201519171396891
in-drivable-lane_max10.600000000000083
in-drivable-lane_mean3.275000000000027
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9264273484766392, "get_ui_image": 0.02201519171396891, "step_physics": 0.05495080550511678, "survival_time": 14.950000000000076, "driven_lanedir": 1.6559855523859657, "get_state_dump": 0.006800736586252848, "sim_render-ego": 0.003637404441833496, "get_robot_state": 0.008147391478220621, "get_duckie_state": 1.0538101196289062e-06, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.01172706921895345, "deviation-heading": 4.740597491884231, "complete-iteration": 0.12594101349512735, "set_robot_commands": 0.0027555688222249347, "deviation-center-line": 1.049951717721428, "driven_lanedir_consec": 1.2922145131564085, "sim_compute_sim_state": 0.013489744663238525, "sim_compute_performance-ego": 0.0023383728663126627}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.93977164437627, "get_ui_image": 0.022039155165354412, "step_physics": 0.052924640973409015, "survival_time": 14.950000000000076, "driven_lanedir": 1.6463729653336563, "get_state_dump": 0.006771459579467774, "sim_render-ego": 0.003613096078236898, "get_robot_state": 0.008123372395833333, "get_duckie_state": 1.0792414347330729e-06, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.011434993743896484, "deviation-heading": 4.77653547154704, "complete-iteration": 0.1230740245183309, "set_robot_commands": 0.0026927534739176434, "deviation-center-line": 1.1047442610741716, "driven_lanedir_consec": 1.6463729653336563, "sim_compute_sim_state": 0.01307522137959798, "sim_compute_performance-ego": 0.0023197499910990395}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9397260764214188, "get_ui_image": 0.022529398600260417, "step_physics": 0.05949748992919922, "survival_time": 14.950000000000076, "driven_lanedir": 0.46869394168094947, "get_state_dump": 0.0068119208017985025, "sim_render-ego": 0.003715769449869792, "get_robot_state": 0.008230589230855305, "get_duckie_state": 1.0196367899576822e-06, "in-drivable-lane": 10.600000000000083, "agent_compute-ego": 0.01219785451889038, "deviation-heading": 1.523266742683855, "complete-iteration": 0.13153680324554445, "set_robot_commands": 0.0027422960599263507, "deviation-center-line": 0.3098683686010453, "driven_lanedir_consec": 0.46869394168094947, "sim_compute_sim_state": 0.013395966688791913, "sim_compute_performance-ego": 0.0023352742195129395}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9397927246313296, "get_ui_image": 0.02580413818359375, "step_physics": 0.06827832142512004, "survival_time": 14.950000000000076, "driven_lanedir": 1.7049638752191514, "get_state_dump": 0.007214241027832032, "sim_render-ego": 0.004020116329193115, "get_robot_state": 0.00870862086613973, "get_duckie_state": 1.1730194091796877e-06, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.01289929469426473, "deviation-heading": 4.849160047585628, "complete-iteration": 0.150864421526591, "set_robot_commands": 0.003404855728149414, "deviation-center-line": 1.266643129041033, "driven_lanedir_consec": 1.7049638752191514, "sim_compute_sim_state": 0.01789862076441447, "sim_compute_performance-ego": 0.002547624111175537}}
set_robot_commands_max0.003404855728149414
set_robot_commands_mean0.0028988685210545855
set_robot_commands_median0.002748932441075643
set_robot_commands_min0.0026927534739176434
sim_compute_performance-ego_max0.002547624111175537
sim_compute_performance-ego_mean0.002385255297025045
sim_compute_performance-ego_median0.002336823542912801
sim_compute_performance-ego_min0.0023197499910990395
sim_compute_sim_state_max0.01789862076441447
sim_compute_sim_state_mean0.01446488837401072
sim_compute_sim_state_median0.013442855676015218
sim_compute_sim_state_min0.01307522137959798
sim_render-ego_max0.004020116329193115
sim_render-ego_mean0.0037465965747833256
sim_render-ego_median0.003676586945851644
sim_render-ego_min0.003613096078236898
simulation-passed1
step_physics_max0.06827832142512004
step_physics_mean0.058912814458211255
step_physics_median0.057224147717158
step_physics_min0.052924640973409015
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4310711605Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:09:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6313993033193197
survival_time_median14.950000000000076
deviation-center-line_median0.37659635534442976
in-drivable-lane_median6.800000000000031


other stats
agent_compute-ego_max0.04216160853703817
agent_compute-ego_mean0.024163372852111776
agent_compute-ego_median0.018516022240529294
agent_compute-ego_min0.01745983839035034
complete-iteration_max0.25674012025197346
complete-iteration_mean0.2354172258168622
complete-iteration_median0.23234971284866335
complete-iteration_min0.22022935731814855
deviation-center-line_max0.9889064002447748
deviation-center-line_mean0.5044440067467532
deviation-center-line_min0.27567691605337835
deviation-heading_max4.595114999605362
deviation-heading_mean2.490805831067868
deviation-heading_median1.9971261119603336
deviation-heading_min1.373856100745444
driven_any_max4.594695498429771
driven_any_mean4.134656427747346
driven_any_median4.586611195784831
driven_any_min2.7707078209899487
driven_lanedir_consec_max3.403773886828996
driven_lanedir_consec_mean1.885777473167903
driven_lanedir_consec_min0.8765373992039753
driven_lanedir_max3.403773886828996
driven_lanedir_mean1.888841401129878
driven_lanedir_median1.6318142296412128
driven_lanedir_min0.887963258408091
get_duckie_state_max1.5362103780110675e-06
get_duckie_state_mean1.462033537567639e-06
get_duckie_state_median1.456340154012044e-06
get_duckie_state_min1.3992434642353996e-06
get_robot_state_max0.01122686783472697
get_robot_state_mean0.01111769509445774
get_robot_state_median0.011109142941855344
get_robot_state_min0.011025626659393313
get_state_dump_max0.00868394374847412
get_state_dump_mean0.008430620943262277
get_state_dump_median0.008393569389979046
get_state_dump_min0.0082514012446169
get_ui_image_max0.04024667739868164
get_ui_image_mean0.039285498228880875
get_ui_image_median0.039192134936650594
get_ui_image_min0.03851104564354068
in-drivable-lane_max9.15000000000008
in-drivable-lane_mean6.3625000000000425
in-drivable-lane_min2.700000000000026
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.578992602437702, "get_ui_image": 0.04024667739868164, "step_physics": 0.11391157706578572, "survival_time": 14.950000000000076, "driven_lanedir": 1.66026168847245, "get_state_dump": 0.00868394374847412, "sim_render-ego": 0.005546184380849203, "get_robot_state": 0.01122686783472697, "get_duckie_state": 1.5362103780110675e-06, "in-drivable-lane": 8.700000000000074, "agent_compute-ego": 0.01745983839035034, "deviation-heading": 1.6829022268620464, "complete-iteration": 0.2375230344136556, "set_robot_commands": 0.003916134834289551, "deviation-center-line": 0.4046432396088619, "driven_lanedir_consec": 1.6594318358286635, "sim_compute_sim_state": 0.03293698787689209, "sim_compute_performance-ego": 0.0035031668345133463}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.594229789131959, "get_ui_image": 0.03958063443501791, "step_physics": 0.10756901423136392, "survival_time": 14.950000000000076, "driven_lanedir": 3.403773886828996, "get_state_dump": 0.008350218931833903, "sim_render-ego": 0.0049883794784545896, "get_robot_state": 0.011025626659393313, "get_duckie_state": 1.4813741048177082e-06, "in-drivable-lane": 2.700000000000026, "agent_compute-ego": 0.01817156235376994, "deviation-heading": 4.595114999605362, "complete-iteration": 0.22717639128367104, "set_robot_commands": 0.003855599562327067, "deviation-center-line": 0.9889064002447748, "driven_lanedir_consec": 3.403773886828996, "sim_compute_sim_state": 0.03032552162806193, "sim_compute_performance-ego": 0.00321886936823527}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7707078209899487, "get_ui_image": 0.03851104564354068, "step_physics": 0.10542224925723884, "survival_time": 9.149999999999997, "driven_lanedir": 0.887963258408091, "get_state_dump": 0.0082514012446169, "sim_render-ego": 0.004823661241375032, "get_robot_state": 0.011046078687157136, "get_duckie_state": 1.3992434642353996e-06, "in-drivable-lane": 4.899999999999989, "agent_compute-ego": 0.018860482127288653, "deviation-heading": 2.3113499970586204, "complete-iteration": 0.22022935731814855, "set_robot_commands": 0.0037504284759688248, "deviation-center-line": 0.27567691605337835, "driven_lanedir_consec": 0.8765373992039753, "sim_compute_sim_state": 0.026151106005809343, "sim_compute_performance-ego": 0.0033204086491319}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.594695498429771, "get_ui_image": 0.03880363543828329, "step_physics": 0.10394269545873006, "survival_time": 14.950000000000076, "driven_lanedir": 1.6033667708099757, "get_state_dump": 0.008436919848124187, "sim_render-ego": 0.005410441557566325, "get_robot_state": 0.011172207196553548, "get_duckie_state": 1.43130620320638e-06, "in-drivable-lane": 9.15000000000008, "agent_compute-ego": 0.04216160853703817, "deviation-heading": 1.373856100745444, "complete-iteration": 0.25674012025197346, "set_robot_commands": 0.0034168036778767902, "deviation-center-line": 0.34854947107999756, "driven_lanedir_consec": 1.6033667708099757, "sim_compute_sim_state": 0.039887345631917315, "sim_compute_performance-ego": 0.0034163379669189453}}
set_robot_commands_max0.003916134834289551
set_robot_commands_mean0.003734741637615558
set_robot_commands_median0.0038030140191479458
set_robot_commands_min0.0034168036778767902
sim_compute_performance-ego_max0.0035031668345133463
sim_compute_performance-ego_mean0.0033646957046998653
sim_compute_performance-ego_median0.003368373308025423
sim_compute_performance-ego_min0.00321886936823527
sim_compute_sim_state_max0.039887345631917315
sim_compute_sim_state_mean0.03232524028567017
sim_compute_sim_state_median0.03163125475247701
sim_compute_sim_state_min0.026151106005809343
sim_render-ego_max0.005546184380849203
sim_render-ego_mean0.005192166664561287
sim_render-ego_median0.005199410518010457
sim_render-ego_min0.004823661241375032
simulation-passed1
step_physics_max0.11391157706578572
step_physics_mean0.10771138400327962
step_physics_median0.10649563174430138
step_physics_min0.10394269545873006
survival_time_max14.950000000000076
survival_time_mean13.500000000000057
survival_time_min9.149999999999997
No reset possible
4304011590Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:07:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.015425841013590494
agent_compute-ego_mean0.014589920441309611
agent_compute-ego_median0.014781739314397175
agent_compute-ego_min0.013370362122853596
complete-iteration_max0.1751902174949646
complete-iteration_mean0.16825922787189482
complete-iteration_median0.17021024028460183
complete-iteration_min0.15742621342341104
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.423358917236328e-06
get_duckie_state_mean1.337726910909017e-06
get_duckie_state_median1.3566017150878903e-06
get_duckie_state_min1.2143452962239584e-06
get_robot_state_max0.01049562931060791
get_robot_state_mean0.00964379052321116
get_robot_state_median0.009657335678736369
get_robot_state_min0.008764861424763997
get_state_dump_max0.007716363271077474
get_state_dump_mean0.007536147634188335
get_state_dump_median0.007586044867833455
get_state_dump_min0.007256137530008952
get_ui_image_max0.03185328880945842
get_ui_image_mean0.02993754804134369
get_ui_image_median0.030281647841135663
get_ui_image_min0.02733360767364502
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.029256373246510824, "step_physics": 0.07693880160649617, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.007716363271077474, "sim_render-ego": 0.00435259739557902, "get_robot_state": 0.00958129326502482, "get_duckie_state": 1.423358917236328e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015425841013590494, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.16977866013844808, "set_robot_commands": 0.003560632864634196, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.019870500564575195, "sim_compute_performance-ego": 0.0029822643597920734}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03185328880945842, "step_physics": 0.08028833071390788, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.007622451782226563, "sim_render-ego": 0.004477894306182862, "get_robot_state": 0.01049562931060791, "get_duckie_state": 1.3685226440429688e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015126051902770997, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.1751902174949646, "set_robot_commands": 0.003837540149688721, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01847264766693115, "sim_compute_performance-ego": 0.0029198479652404784}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.0313069224357605, "step_physics": 0.07806405862172444, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.007549637953440348, "sim_render-ego": 0.004331177075703939, "get_robot_state": 0.009733378092447917, "get_duckie_state": 1.3446807861328124e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014437426726023356, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.17064182043075565, "set_robot_commands": 0.003522055149078369, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.01874588251113891, "sim_compute_performance-ego": 0.0028490384419759115}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.02733360767364502, "step_physics": 0.07355349540710449, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.007256137530008952, "sim_render-ego": 0.0040424545605977375, "get_robot_state": 0.008764861424763997, "get_duckie_state": 1.2143452962239584e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013370362122853596, "deviation-heading": 0.486072248607516, "complete-iteration": 0.15742621342341104, "set_robot_commands": 0.0033772826194763184, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.016887399355570477, "sim_compute_performance-ego": 0.0027449520428975424}}
set_robot_commands_max0.003837540149688721
set_robot_commands_mean0.003574377695719401
set_robot_commands_median0.0035413440068562826
set_robot_commands_min0.0033772826194763184
sim_compute_performance-ego_max0.0029822643597920734
sim_compute_performance-ego_mean0.002874025702476501
sim_compute_performance-ego_median0.002884443203608195
sim_compute_performance-ego_min0.0027449520428975424
sim_compute_sim_state_max0.019870500564575195
sim_compute_sim_state_mean0.018494107524553938
sim_compute_sim_state_median0.018609265089035033
sim_compute_sim_state_min0.016887399355570477
sim_render-ego_max0.004477894306182862
sim_render-ego_mean0.0043010308345158895
sim_render-ego_median0.004341887235641479
sim_render-ego_min0.0040424545605977375
simulation-passed1
step_physics_max0.08028833071390788
step_physics_mean0.07721117158730825
step_physics_median0.07750143011411031
step_physics_min0.07355349540710449
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4302311585Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele04-b953b5d8021c-10:03:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 176 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4301311584Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele04-b953b5d8021c-10:04:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 315 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4299911582Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele04-b953b5d8021c-10:03:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 122 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4299611580Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoafdaniele04-b953b5d8021c-10:04:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 344 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4296911574Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4099386055519227
survival_time_median14.950000000000076
deviation-center-line_median1.0832541146637005
in-drivable-lane_median4.025000000000023


other stats
agent_compute-ego_max0.0922675879796346
agent_compute-ego_mean0.09212730288505554
agent_compute-ego_median0.09210604071617126
agent_compute-ego_min0.09202954212824505
complete-iteration_max0.20926379044850668
complete-iteration_mean0.20659073849519097
complete-iteration_median0.2069344679514567
complete-iteration_min0.20323022762934367
deviation-center-line_max1.695269492312096
deviation-center-line_mean1.0544050756830303
deviation-center-line_min0.3558425810926251
deviation-heading_max6.053978049657616
deviation-heading_mean3.6351232437245784
deviation-heading_median3.793041380743732
deviation-heading_min0.9004321637532345
driven_any_max4.530750378078334
driven_any_mean3.6247070304091986
driven_any_median3.753754416552763
driven_any_min2.460568910452935
driven_lanedir_consec_max2.9044819540740727
driven_lanedir_consec_mean2.4667301362470617
driven_lanedir_consec_min2.142561379810327
driven_lanedir_max3.152403343392888
driven_lanedir_mean2.909793680132207
driven_lanedir_median3.0429988713888654
driven_lanedir_min2.400773634358208
get_duckie_state_max1.1237462361653645e-06
get_duckie_state_mean1.0772546132405595e-06
get_duckie_state_median1.0788440704345704e-06
get_duckie_state_min1.0275840759277345e-06
get_robot_state_max0.008153650760650635
get_robot_state_mean0.008069684704144795
get_robot_state_median0.008049539327621459
get_robot_state_min0.008026009400685628
get_state_dump_max0.0067668938636779785
get_state_dump_mean0.006717805663744608
get_state_dump_median0.006712845166524251
get_state_dump_min0.0066786384582519535
get_ui_image_max0.022102542718251548
get_ui_image_mean0.02196703632672628
get_ui_image_median0.021964066823323566
get_ui_image_min0.02183746894200643
in-drivable-lane_max8.650000000000091
in-drivable-lane_mean4.212500000000034
in-drivable-lane_min0.15000000000000213
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.3545357241076528, "get_ui_image": 0.021878496011098227, "step_physics": 0.05593168576558431, "survival_time": 14.950000000000076, "driven_lanedir": 3.0323871881523727, "get_state_dump": 0.0067668938636779785, "sim_render-ego": 0.003675325711568197, "get_robot_state": 0.008153650760650635, "get_duckie_state": 1.1237462361653645e-06, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.0922675879796346, "deviation-heading": 6.053978049657616, "complete-iteration": 0.20814085960388184, "set_robot_commands": 0.003233368396759033, "deviation-center-line": 1.695269492312096, "driven_lanedir_consec": 2.9044819540740727, "sim_compute_sim_state": 0.01381570021311442, "sim_compute_performance-ego": 0.002346683343251546}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.460568910452935, "get_ui_image": 0.02183746894200643, "step_physics": 0.051856324672698975, "survival_time": 14.950000000000076, "driven_lanedir": 2.400773634358208, "get_state_dump": 0.0066786384582519535, "sim_render-ego": 0.003656432628631592, "get_robot_state": 0.008026009400685628, "get_duckie_state": 1.1110305786132813e-06, "in-drivable-lane": 8.650000000000091, "agent_compute-ego": 0.09202954212824505, "deviation-heading": 0.9004321637532345, "complete-iteration": 0.20323022762934367, "set_robot_commands": 0.003377478917439779, "deviation-center-line": 0.3558425810926251, "driven_lanedir_consec": 2.400773634358208, "sim_compute_sim_state": 0.013373228708902994, "sim_compute_performance-ego": 0.0023235185941060383}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.152973108997873, "get_ui_image": 0.02204963763554891, "step_physics": 0.05400641441345215, "survival_time": 14.950000000000076, "driven_lanedir": 3.152403343392888, "get_state_dump": 0.0067087705930074055, "sim_render-ego": 0.0036557801564534504, "get_robot_state": 0.008034138679504395, "get_duckie_state": 1.0466575622558593e-06, "in-drivable-lane": 3.750000000000043, "agent_compute-ego": 0.0921344272295634, "deviation-heading": 3.795240679448277, "complete-iteration": 0.2057280762990316, "set_robot_commands": 0.00334636926651001, "deviation-center-line": 0.985803743912023, "driven_lanedir_consec": 2.142561379810327, "sim_compute_sim_state": 0.013385325272878012, "sim_compute_performance-ego": 0.0023351462682088217}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.530750378078334, "get_ui_image": 0.022102542718251548, "step_physics": 0.054910141626993814, "survival_time": 14.950000000000076, "driven_lanedir": 3.053610554625358, "get_state_dump": 0.006716919740041097, "sim_render-ego": 0.003627974192301432, "get_robot_state": 0.008064939975738525, "get_duckie_state": 1.0275840759277345e-06, "in-drivable-lane": 4.300000000000002, "agent_compute-ego": 0.09207765420277914, "deviation-heading": 3.790842082039188, "complete-iteration": 0.20926379044850668, "set_robot_commands": 0.0033364860216776528, "deviation-center-line": 1.1807044854153774, "driven_lanedir_consec": 2.4191035767456377, "sim_compute_sim_state": 0.01602455218633016, "sim_compute_performance-ego": 0.0023302221298217773}}
set_robot_commands_max0.003377478917439779
set_robot_commands_mean0.0033234256505966188
set_robot_commands_median0.0033414276440938313
set_robot_commands_min0.003233368396759033
sim_compute_performance-ego_max0.002346683343251546
sim_compute_performance-ego_mean0.002333892583847046
sim_compute_performance-ego_median0.0023326841990152997
sim_compute_performance-ego_min0.0023235185941060383
sim_compute_sim_state_max0.01602455218633016
sim_compute_sim_state_mean0.014149701595306397
sim_compute_sim_state_median0.013600512742996215
sim_compute_sim_state_min0.013373228708902994
sim_render-ego_max0.003675325711568197
sim_render-ego_mean0.003653878172238668
sim_render-ego_median0.003656106392542521
sim_render-ego_min0.003627974192301432
simulation-passed1
step_physics_max0.05593168576558431
step_physics_mean0.05417614161968232
step_physics_median0.05445827802022298
step_physics_min0.051856324672698975
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4294211568Dishank BansalΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele04-b953b5d8021c-10:06:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 768 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4293611566Olga (Ge Ya) XuΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1996684612749524
survival_time_median14.950000000000076
deviation-center-line_median0.6498069619171544
in-drivable-lane_median7.775000000000043


other stats
agent_compute-ego_max0.01436187505722046
agent_compute-ego_mean0.01405414362748464
agent_compute-ego_median0.014138548374176024
agent_compute-ego_min0.013577602704366048
complete-iteration_max0.15588635126749675
complete-iteration_mean0.15224120517571768
complete-iteration_median0.1520380373795827
complete-iteration_min0.1490023946762085
deviation-center-line_max0.892909203255445
deviation-center-line_mean0.6700676246325983
deviation-center-line_min0.48774737144063907
deviation-heading_max2.6532283024599295
deviation-heading_mean2.1209006193417603
deviation-heading_median2.355502155785941
deviation-heading_min1.1193698633352296
driven_any_max4.357915993908564
driven_any_mean3.7656523337233616
driven_any_median3.8108797205611906
driven_any_min3.082933899862501
driven_lanedir_consec_max3.0791806821185057
driven_lanedir_consec_mean2.1590546575650125
driven_lanedir_consec_min1.157701025591639
driven_lanedir_max3.0791806821185057
driven_lanedir_mean2.1590546575650125
driven_lanedir_median2.1996684612749524
driven_lanedir_min1.157701025591639
get_duckie_state_max1.442432403564453e-06
get_duckie_state_mean1.352628072102865e-06
get_duckie_state_median1.3399124145507813e-06
get_duckie_state_min1.2882550557454427e-06
get_robot_state_max0.009009090264638264
get_robot_state_mean0.008888829946517945
get_robot_state_median0.008891820907592773
get_robot_state_min0.008762587706247965
get_state_dump_max0.007321425278981527
get_state_dump_mean0.007273761232693989
get_state_dump_median0.007272361914316813
get_state_dump_min0.007228895823160808
get_ui_image_max0.026979947884877523
get_ui_image_mean0.026111992200215657
get_ui_image_median0.026226235230763756
get_ui_image_min0.0250155504544576
in-drivable-lane_max9.400000000000045
in-drivable-lane_mean7.13750000000004
in-drivable-lane_min3.60000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.357915993908564, "get_ui_image": 0.0250155504544576, "step_physics": 0.06766586939493816, "survival_time": 14.950000000000076, "driven_lanedir": 2.258713130142519, "get_state_dump": 0.007264804840087891, "sim_render-ego": 0.004082818031311036, "get_robot_state": 0.008830306529998779, "get_duckie_state": 1.442432403564453e-06, "in-drivable-lane": 9.200000000000054, "agent_compute-ego": 0.01436187505722046, "deviation-heading": 1.1193698633352296, "complete-iteration": 0.15068850994110108, "set_robot_commands": 0.0035161439577738444, "deviation-center-line": 0.5179837364874122, "driven_lanedir_consec": 2.258713130142519, "sim_compute_sim_state": 0.01715925693511963, "sim_compute_performance-ego": 0.0027065141995747883}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.8388255657098105, "get_ui_image": 0.02667965888977051, "step_physics": 0.06676790555318196, "survival_time": 14.950000000000076, "driven_lanedir": 3.0791806821185057, "get_state_dump": 0.007321425278981527, "sim_render-ego": 0.0040014870961507165, "get_robot_state": 0.009009090264638264, "get_duckie_state": 1.3566017150878907e-06, "in-drivable-lane": 3.60000000000003, "agent_compute-ego": 0.013577602704366048, "deviation-heading": 2.5116552888377455, "complete-iteration": 0.1490023946762085, "set_robot_commands": 0.0032652807235717773, "deviation-center-line": 0.892909203255445, "driven_lanedir_consec": 3.0791806821185057, "sim_compute_sim_state": 0.015678486824035644, "sim_compute_performance-ego": 0.002615954081217448}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.082933899862501, "get_ui_image": 0.025772811571757, "step_physics": 0.0700397769610087, "survival_time": 14.950000000000076, "driven_lanedir": 1.157701025591639, "get_state_dump": 0.007228895823160808, "sim_render-ego": 0.004083199501037598, "get_robot_state": 0.008953335285186768, "get_duckie_state": 1.2882550557454427e-06, "in-drivable-lane": 9.400000000000045, "agent_compute-ego": 0.014239600499471029, "deviation-heading": 2.199349022734137, "complete-iteration": 0.15338756481806437, "set_robot_commands": 0.003376911481221517, "deviation-center-line": 0.48774737144063907, "driven_lanedir_consec": 1.157701025591639, "sim_compute_sim_state": 0.016984712282816568, "sim_compute_performance-ego": 0.002621484597524007}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.782933875412571, "get_ui_image": 0.026979947884877523, "step_physics": 0.06954903920491537, "survival_time": 14.950000000000076, "driven_lanedir": 2.1406237924073857, "get_state_dump": 0.007279918988545736, "sim_render-ego": 0.003955930868784587, "get_robot_state": 0.008762587706247965, "get_duckie_state": 1.3232231140136718e-06, "in-drivable-lane": 6.350000000000031, "agent_compute-ego": 0.014037496248881022, "deviation-heading": 2.6532283024599295, "complete-iteration": 0.15588635126749675, "set_robot_commands": 0.003428675333658854, "deviation-center-line": 0.7816301873468965, "driven_lanedir_consec": 2.1406237924073857, "sim_compute_sim_state": 0.019212463696797688, "sim_compute_performance-ego": 0.0025939186414082843}}
set_robot_commands_max0.0035161439577738444
set_robot_commands_mean0.0033967528740564985
set_robot_commands_median0.003402793407440185
set_robot_commands_min0.0032652807235717773
sim_compute_performance-ego_max0.0027065141995747883
sim_compute_performance-ego_mean0.002634467879931132
sim_compute_performance-ego_median0.0026187193393707275
sim_compute_performance-ego_min0.0025939186414082843
sim_compute_sim_state_max0.019212463696797688
sim_compute_sim_state_mean0.01725872993469238
sim_compute_sim_state_median0.017071984608968097
sim_compute_sim_state_min0.015678486824035644
sim_render-ego_max0.004083199501037598
sim_render-ego_mean0.0040308588743209845
sim_render-ego_median0.0040421525637308765
sim_render-ego_min0.003955930868784587
simulation-passed1
step_physics_max0.0700397769610087
step_physics_mean0.06850564777851104
step_physics_median0.06860745429992676
step_physics_min0.06676790555318196
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4287711551Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoafdaniele04-b953b5d8021c-10:03:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 158 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4286311550Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5342229611623677
survival_time_median14.950000000000076
deviation-center-line_median0.814943163270955
in-drivable-lane_median2.525


other stats
agent_compute-ego_max0.01460976759592692
agent_compute-ego_mean0.012868923466919846
agent_compute-ego_median0.012733511924743653
agent_compute-ego_min0.01139890242226516
complete-iteration_max0.1510275944073995
complete-iteration_mean0.1402073304990173
complete-iteration_median0.13959684116427906
complete-iteration_min0.1306080452601115
deviation-center-line_max1.298219947544465
deviation-center-line_mean0.8346583381181004
deviation-center-line_min0.410527078386027
deviation-heading_max3.728154422991397
deviation-heading_mean2.9182155931717673
deviation-heading_median3.400268592785536
deviation-heading_min1.1441707641246002
driven_any_max4.832646261044461
driven_any_mean4.0753483437375975
driven_any_median4.369843521911223
driven_any_min2.729060070083482
driven_lanedir_consec_max3.6973468939571528
driven_lanedir_consec_mean3.255625470358892
driven_lanedir_consec_min2.2567090651536805
driven_lanedir_max3.6973468939571528
driven_lanedir_mean3.255625470358892
driven_lanedir_median3.5342229611623677
driven_lanedir_min2.2567090651536805
get_duckie_state_max1.8644332885742188e-06
get_duckie_state_mean1.6749383025028537e-06
get_duckie_state_median1.7265478769938152e-06
get_duckie_state_min1.3822241674495648e-06
get_robot_state_max0.009073561827341717
get_robot_state_mean0.008653497049577125
get_robot_state_median0.008704965909322102
get_robot_state_min0.00813049455232258
get_state_dump_max0.007409512996673584
get_state_dump_mean0.007136732284529802
get_state_dump_median0.007179839213689168
get_state_dump_min0.00677773771406729
get_ui_image_max0.02611814022064209
get_ui_image_mean0.023861347615467345
get_ui_image_median0.023605711062749224
get_ui_image_min0.022115828115728837
in-drivable-lane_max3.4000000000000306
in-drivable-lane_mean2.4500000000000064
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.673433355859402, "get_ui_image": 0.024647127787272138, "step_physics": 0.06623035192489624, "survival_time": 14.950000000000076, "driven_lanedir": 3.6973468939571528, "get_state_dump": 0.007409512996673584, "sim_render-ego": 0.0042948126792907715, "get_robot_state": 0.009073561827341717, "get_duckie_state": 1.8644332885742188e-06, "in-drivable-lane": 3.4000000000000306, "agent_compute-ego": 0.01460976759592692, "deviation-heading": 3.221818217609843, "complete-iteration": 0.1510275944073995, "set_robot_commands": 0.003597428798675537, "deviation-center-line": 0.7567642273905834, "driven_lanedir_consec": 3.6973468939571528, "sim_compute_sim_state": 0.018142959276835124, "sim_compute_performance-ego": 0.00293808380762736}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.832646261044461, "get_ui_image": 0.02611814022064209, "step_physics": 0.06346863349278768, "survival_time": 14.950000000000076, "driven_lanedir": 3.645548896352436, "get_state_dump": 0.007277713616689046, "sim_render-ego": 0.004119200706481934, "get_robot_state": 0.008973058859507242, "get_duckie_state": 1.8588701883951823e-06, "in-drivable-lane": 3.150000000000003, "agent_compute-ego": 0.01344882329305013, "deviation-heading": 3.5787189679612283, "complete-iteration": 0.14680147806803384, "set_robot_commands": 0.0034490688641866047, "deviation-center-line": 0.8731220991513264, "driven_lanedir_consec": 3.645548896352436, "sim_compute_sim_state": 0.017052640914916994, "sim_compute_performance-ego": 0.0028081409136454264}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.066253687963044, "get_ui_image": 0.022564294338226317, "step_physics": 0.05648753801981608, "survival_time": 14.950000000000076, "driven_lanedir": 3.4228970259722993, "get_state_dump": 0.0070819648106892905, "sim_render-ego": 0.0037391002972920737, "get_robot_state": 0.008436872959136962, "get_duckie_state": 1.594225565592448e-06, "in-drivable-lane": 1.8999999999999968, "agent_compute-ego": 0.012018200556437174, "deviation-heading": 3.728154422991397, "complete-iteration": 0.1306080452601115, "set_robot_commands": 0.0028838706016540527, "deviation-center-line": 1.298219947544465, "driven_lanedir_consec": 3.4228970259722993, "sim_compute_sim_state": 0.014914105733235676, "sim_compute_performance-ego": 0.00240219513575236}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.729060070083482, "get_ui_image": 0.022115828115728837, "step_physics": 0.05893669550931906, "survival_time": 7.89999999999998, "driven_lanedir": 2.2567090651536805, "get_state_dump": 0.00677773771406729, "sim_render-ego": 0.0036185527149635026, "get_robot_state": 0.00813049455232258, "get_duckie_state": 1.3822241674495648e-06, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.01139890242226516, "deviation-heading": 1.1441707641246002, "complete-iteration": 0.1323922042605243, "set_robot_commands": 0.0027512598641311068, "deviation-center-line": 0.410527078386027, "driven_lanedir_consec": 2.2567090651536805, "sim_compute_sim_state": 0.016262495065037207, "sim_compute_performance-ego": 0.0023242974583106706}}
set_robot_commands_max0.003597428798675537
set_robot_commands_mean0.003170407032161826
set_robot_commands_median0.0031664697329203285
set_robot_commands_min0.0027512598641311068
sim_compute_performance-ego_max0.00293808380762736
sim_compute_performance-ego_mean0.002618179328833954
sim_compute_performance-ego_median0.0026051680246988933
sim_compute_performance-ego_min0.0023242974583106706
sim_compute_sim_state_max0.018142959276835124
sim_compute_sim_state_mean0.01659305024750625
sim_compute_sim_state_median0.0166575679899771
sim_compute_sim_state_min0.014914105733235676
sim_render-ego_max0.0042948126792907715
sim_render-ego_mean0.00394291659950707
sim_render-ego_median0.0039291505018870035
sim_render-ego_min0.0036185527149635026
simulation-passed1
step_physics_max0.06623035192489624
step_physics_mean0.061280804736704775
step_physics_median0.06120266450105337
step_physics_min0.05648753801981608
survival_time_max14.950000000000076
survival_time_mean13.187500000000052
survival_time_min7.89999999999998
No reset possible
4278811537Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9515367684322564
survival_time_median14.950000000000076
deviation-center-line_median0.6098684259277649
in-drivable-lane_median3.0250000000000323


other stats
agent_compute-ego_max0.014914416472117106
agent_compute-ego_mean0.014194443027178446
agent_compute-ego_median0.014459426005681356
agent_compute-ego_min0.012944503625233968
complete-iteration_max0.15647795677185058
complete-iteration_mean0.14495845278104147
complete-iteration_median0.14405155420303345
complete-iteration_min0.13525274594624836
deviation-center-line_max0.7138027293712819
deviation-center-line_mean0.512705815801169
deviation-center-line_min0.1172836819778646
deviation-heading_max3.3470099166248186
deviation-heading_mean2.5205735778313483
deviation-heading_median2.7358819623644544
deviation-heading_min1.2635204699716671
driven_any_max3.0629879569611935
driven_any_mean2.434184917136089
driven_any_median3.0579702768862527
driven_any_min0.5578111578106572
driven_lanedir_consec_max2.7133886641931664
driven_lanedir_consec_mean1.6843143376030492
driven_lanedir_consec_min0.12079514935451718
driven_lanedir_max2.7133886641931664
driven_lanedir_mean1.6888442474863634
driven_lanedir_median1.9515367684322564
driven_lanedir_min0.1389147888877742
get_duckie_state_max1.3073285420735675e-06
get_duckie_state_mean1.2602408727010092e-06
get_duckie_state_median1.2747446695963542e-06
get_duckie_state_min1.1841456095377604e-06
get_robot_state_max0.00901212771733602
get_robot_state_mean0.008814192016919454
get_robot_state_median0.00883423686027527
get_robot_state_min0.00857616662979126
get_state_dump_max0.007385220527648926
get_state_dump_mean0.007265456318855285
get_state_dump_median0.007269911368687947
get_state_dump_min0.007136782010396321
get_ui_image_max0.02620101451873779
get_ui_image_mean0.024706469575564067
get_ui_image_median0.02438223759333293
get_ui_image_min0.02386038859685262
in-drivable-lane_max4.700000000000054
in-drivable-lane_mean2.9625000000000337
in-drivable-lane_min1.1000000000000156
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.053028017928193, "get_ui_image": 0.02386038859685262, "step_physics": 0.06344450950622559, "survival_time": 14.950000000000076, "driven_lanedir": 1.9508562063308852, "get_state_dump": 0.007385220527648926, "sim_render-ego": 0.004000338713328043, "get_robot_state": 0.00901212771733602, "get_duckie_state": 1.2826919555664062e-06, "in-drivable-lane": 4.700000000000054, "agent_compute-ego": 0.014143048922220866, "deviation-heading": 2.396656190087612, "complete-iteration": 0.1443257268269857, "set_robot_commands": 0.0033569987614949543, "deviation-center-line": 0.5194350432222805, "driven_lanedir_consec": 1.9508562063308852, "sim_compute_sim_state": 0.016405508518218995, "sim_compute_performance-ego": 0.002636539141337077}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0629879569611935, "get_ui_image": 0.02428919474283854, "step_physics": 0.06219225168228149, "survival_time": 14.950000000000076, "driven_lanedir": 2.7133886641931664, "get_state_dump": 0.007333145936330159, "sim_render-ego": 0.00403023878733317, "get_robot_state": 0.008904023965199789, "get_duckie_state": 1.3073285420735675e-06, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.014914416472117106, "deviation-heading": 3.3470099166248186, "complete-iteration": 0.1437773815790812, "set_robot_commands": 0.003541077772776286, "deviation-center-line": 0.7003018086332494, "driven_lanedir_consec": 2.7133886641931664, "sim_compute_sim_state": 0.015805083910624185, "sim_compute_performance-ego": 0.002680225372314453}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.5578111578106572, "get_ui_image": 0.02447528044382731, "step_physics": 0.05904789765675863, "survival_time": 2.9999999999999973, "driven_lanedir": 0.1389147888877742, "get_state_dump": 0.007136782010396321, "sim_render-ego": 0.00373388131459554, "get_robot_state": 0.00857616662979126, "get_duckie_state": 1.1841456095377604e-06, "in-drivable-lane": 1.399999999999998, "agent_compute-ego": 0.012944503625233968, "deviation-heading": 1.2635204699716671, "complete-iteration": 0.13525274594624836, "set_robot_commands": 0.00332341194152832, "deviation-center-line": 0.1172836819778646, "driven_lanedir_consec": 0.12079514935451718, "sim_compute_sim_state": 0.013503050804138184, "sim_compute_performance-ego": 0.0024285117785135904}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0629125358443123, "get_ui_image": 0.02620101451873779, "step_physics": 0.07045676231384278, "survival_time": 14.950000000000076, "driven_lanedir": 1.952217330533628, "get_state_dump": 0.007206676801045735, "sim_render-ego": 0.004057372411092122, "get_robot_state": 0.00876444975535075, "get_duckie_state": 1.266797383626302e-06, "in-drivable-lane": 4.650000000000066, "agent_compute-ego": 0.014775803089141844, "deviation-heading": 3.0751077346412967, "complete-iteration": 0.15647795677185058, "set_robot_commands": 0.0034563438097635906, "deviation-center-line": 0.7138027293712819, "driven_lanedir_consec": 1.952217330533628, "sim_compute_sim_state": 0.01882757107416789, "sim_compute_performance-ego": 0.0026473530133565267}}
set_robot_commands_max0.003541077772776286
set_robot_commands_mean0.0034194580713907876
set_robot_commands_median0.0034066712856292724
set_robot_commands_min0.00332341194152832
sim_compute_performance-ego_max0.002680225372314453
sim_compute_performance-ego_mean0.0025981573263804117
sim_compute_performance-ego_median0.0026419460773468018
sim_compute_performance-ego_min0.0024285117785135904
sim_compute_sim_state_max0.01882757107416789
sim_compute_sim_state_mean0.016135303576787313
sim_compute_sim_state_median0.01610529621442159
sim_compute_sim_state_min0.013503050804138184
sim_render-ego_max0.004057372411092122
sim_render-ego_mean0.00395545780658722
sim_render-ego_median0.004015288750330607
sim_render-ego_min0.00373388131459554
simulation-passed1
step_physics_max0.07045676231384278
step_physics_mean0.06378535528977712
step_physics_median0.06281838059425354
step_physics_min0.05904789765675863
survival_time_max14.950000000000076
survival_time_mean11.96250000000006
survival_time_min2.9999999999999973
No reset possible
4276311531Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:06:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4271311516Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:05:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4270611513Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.179218962150066
survival_time_median14.950000000000076
deviation-center-line_median0.4347849758386384
in-drivable-lane_median0.4750000000000067


other stats
agent_compute-ego_max0.011512030760447184
agent_compute-ego_mean0.011261041868816725
agent_compute-ego_median0.011252736250559487
agent_compute-ego_min0.011026664213700728
complete-iteration_max0.13086008230845134
complete-iteration_mean0.12500638951788415
complete-iteration_median0.12384695450464885
complete-iteration_min0.1214715667537876
deviation-center-line_max0.5002193439873158
deviation-center-line_mean0.37884133394550834
deviation-center-line_min0.14557604011744055
deviation-heading_max1.4888920707212543
deviation-heading_mean1.2538812141560385
deviation-heading_median1.236598704326466
deviation-heading_min1.0534353772499674
driven_any_max3.360519452282819
driven_any_mean2.845518830069546
driven_any_median3.28976091019668
driven_any_min1.4420340476020068
driven_lanedir_consec_max3.3469254741489607
driven_lanedir_consec_mean2.5934835207710005
driven_lanedir_consec_min0.6685706846349092
driven_lanedir_max3.3469254741489607
driven_lanedir_mean2.5944125207508018
driven_lanedir_median3.179218962150066
driven_lanedir_min0.6722866845541154
get_duckie_state_max1.1277198791503907e-06
get_duckie_state_mean1.0902217495969403e-06
get_duckie_state_median1.0863939921061198e-06
get_duckie_state_min1.060379135025131e-06
get_robot_state_max0.008167572816212972
get_robot_state_mean0.00812972963689924
get_robot_state_median0.008134494622548422
get_robot_state_min0.00808235648628715
get_state_dump_max0.006815321445465088
get_state_dump_mean0.006785408637740396
get_state_dump_median0.0067815899848937995
get_state_dump_min0.006763133135708896
get_ui_image_max0.0223208724201976
get_ui_image_mean0.022137311963768273
get_ui_image_median0.022141844431559244
get_ui_image_min0.021944686571756997
in-drivable-lane_max3.8499999999999863
in-drivable-lane_mean1.2
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.2656761087684902, "get_ui_image": 0.021944686571756997, "step_physics": 0.05342131535212199, "survival_time": 14.950000000000076, "driven_lanedir": 3.062401093127087, "get_state_dump": 0.006815321445465088, "sim_render-ego": 0.003628466924031575, "get_robot_state": 0.008167572816212972, "get_duckie_state": 1.1277198791503907e-06, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.011317519346872966, "deviation-heading": 1.4888920707212543, "complete-iteration": 0.1244018014272054, "set_robot_commands": 0.002760058244069417, "deviation-center-line": 0.4650959713674118, "driven_lanedir_consec": 3.062401093127087, "sim_compute_sim_state": 0.01392755428949992, "sim_compute_performance-ego": 0.002340372403462728}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.360519452282819, "get_ui_image": 0.02209820826848348, "step_physics": 0.052368027369181315, "survival_time": 14.950000000000076, "driven_lanedir": 3.3469254741489607, "get_state_dump": 0.006780161062876384, "sim_render-ego": 0.0036210831006368, "get_robot_state": 0.008154133160909016, "get_duckie_state": 1.110235850016276e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011512030760447184, "deviation-heading": 1.1600291458667782, "complete-iteration": 0.12329210758209228, "set_robot_commands": 0.002764301300048828, "deviation-center-line": 0.404473980309865, "driven_lanedir_consec": 3.3469254741489607, "sim_compute_sim_state": 0.013581656614939371, "sim_compute_performance-ego": 0.0023329647382100424}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.4420340476020068, "get_ui_image": 0.0223208724201976, "step_physics": 0.05183773941093391, "survival_time": 7.149999999999983, "driven_lanedir": 0.6722866845541154, "get_state_dump": 0.006763133135708896, "sim_render-ego": 0.003595073739965479, "get_robot_state": 0.00808235648628715, "get_duckie_state": 1.060379135025131e-06, "in-drivable-lane": 3.8499999999999863, "agent_compute-ego": 0.011026664213700728, "deviation-heading": 1.0534353772499674, "complete-iteration": 0.1214715667537876, "set_robot_commands": 0.0026666434494765487, "deviation-center-line": 0.14557604011744055, "driven_lanedir_consec": 0.6685706846349092, "sim_compute_sim_state": 0.01279571173074362, "sim_compute_performance-ego": 0.0023027316673652275}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.3138457116248703, "get_ui_image": 0.02218548059463501, "step_physics": 0.0569771949450175, "survival_time": 14.950000000000076, "driven_lanedir": 3.296036831173045, "get_state_dump": 0.0067830189069112146, "sim_render-ego": 0.003627369403839111, "get_robot_state": 0.008114856084187825, "get_duckie_state": 1.0625521341959636e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011187953154246012, "deviation-heading": 1.313168262786154, "complete-iteration": 0.13086008230845134, "set_robot_commands": 0.0027309950192769368, "deviation-center-line": 0.5002193439873158, "driven_lanedir_consec": 3.296036831173045, "sim_compute_sim_state": 0.016839348475138346, "sim_compute_performance-ego": 0.0023325522740681964}}
set_robot_commands_max0.002764301300048828
set_robot_commands_mean0.0027304995032179325
set_robot_commands_median0.002745526631673177
set_robot_commands_min0.0026666434494765487
sim_compute_performance-ego_max0.002340372403462728
sim_compute_performance-ego_mean0.0023271552707765488
sim_compute_performance-ego_median0.002332758506139119
sim_compute_performance-ego_min0.0023027316673652275
sim_compute_sim_state_max0.016839348475138346
sim_compute_sim_state_mean0.014286067777580316
sim_compute_sim_state_median0.013754605452219643
sim_compute_sim_state_min0.01279571173074362
sim_render-ego_max0.003628466924031575
sim_render-ego_mean0.003617998292118242
sim_render-ego_median0.003624226252237956
sim_render-ego_min0.003595073739965479
simulation-passed1
step_physics_max0.0569771949450175
step_physics_mean0.05365106926931368
step_physics_median0.05289467136065165
step_physics_min0.05183773941093391
survival_time_max14.950000000000076
survival_time_mean13.000000000000052
survival_time_min7.149999999999983
No reset possible
4270411511Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:01:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4269911510Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.7137283866088193
survival_time_median14.950000000000076
deviation-center-line_median0.8237136128103958
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012357102235158283
agent_compute-ego_mean0.01206226984659831
agent_compute-ego_median0.012018821239471436
agent_compute-ego_min0.011854334672292074
complete-iteration_max0.13010777076085409
complete-iteration_mean0.12649184902509053
complete-iteration_median0.12577711900075278
complete-iteration_min0.12430538733800252
deviation-center-line_max0.9356783755365696
deviation-center-line_mean0.8298109860845427
deviation-center-line_min0.7361383431808098
deviation-heading_max2.874905455602615
deviation-heading_mean2.185067040537022
deviation-heading_median2.1670019313784774
deviation-heading_min1.5313588437885166
driven_any_max4.087199500491787
driven_any_mean3.691842247440891
driven_any_median3.79942389362218
driven_any_min3.0813217020274184
driven_lanedir_consec_max3.845002411901564
driven_lanedir_consec_mean3.56950989203672
driven_lanedir_consec_min3.0055803830276773
driven_lanedir_max3.845002411901564
driven_lanedir_mean3.56950989203672
driven_lanedir_median3.7137283866088193
driven_lanedir_min3.0055803830276773
get_duckie_state_max1.1277198791503907e-06
get_duckie_state_mean1.0583798090616865e-06
get_duckie_state_median1.0677178700764974e-06
get_duckie_state_min9.703636169433594e-07
get_robot_state_max0.008447214762369792
get_robot_state_mean0.008199715614318847
get_robot_state_median0.008131675322850546
get_robot_state_min0.008088297049204508
get_state_dump_max0.006822415987650553
get_state_dump_mean0.0067797215779622395
get_state_dump_median0.0067728042602539056
get_state_dump_min0.006750861803690593
get_ui_image_max0.022136558691660563
get_ui_image_mean0.02203942894935608
get_ui_image_median0.02203576604525248
get_ui_image_min0.021949625015258788
in-drivable-lane_max1.849999999999998
in-drivable-lane_mean0.46249999999999947
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.714897361522245, "get_ui_image": 0.021949625015258788, "step_physics": 0.05277285575866699, "survival_time": 14.950000000000076, "driven_lanedir": 3.657010834765657, "get_state_dump": 0.006754525502522786, "sim_render-ego": 0.00360865036646525, "get_robot_state": 0.008105034033457439, "get_duckie_state": 1.0863939921061198e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012074500719706217, "deviation-heading": 2.3748427038428868, "complete-iteration": 0.12464411576588948, "set_robot_commands": 0.0026955898602803547, "deviation-center-line": 0.8393856115807112, "driven_lanedir_consec": 3.657010834765657, "sim_compute_sim_state": 0.014289480845133463, "sim_compute_performance-ego": 0.002321479320526123}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.883950425722114, "get_ui_image": 0.02197888374328613, "step_physics": 0.05256355841954549, "survival_time": 14.950000000000076, "driven_lanedir": 3.845002411901564, "get_state_dump": 0.006750861803690593, "sim_render-ego": 0.003603003025054932, "get_robot_state": 0.008088297049204508, "get_duckie_state": 1.1277198791503907e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012357102235158283, "deviation-heading": 1.9591611589140676, "complete-iteration": 0.12430538733800252, "set_robot_commands": 0.002723995049794515, "deviation-center-line": 0.7361383431808098, "driven_lanedir_consec": 3.845002411901564, "sim_compute_sim_state": 0.013854268391927084, "sim_compute_performance-ego": 0.0023120903968811037}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0813217020274184, "get_ui_image": 0.022136558691660563, "step_physics": 0.05513828913370768, "survival_time": 14.950000000000076, "driven_lanedir": 3.0055803830276773, "get_state_dump": 0.006822415987650553, "sim_render-ego": 0.003622612953186035, "get_robot_state": 0.008158316612243652, "get_duckie_state": 9.703636169433594e-07, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011963141759236656, "deviation-heading": 2.874905455602615, "complete-iteration": 0.12691012223561604, "set_robot_commands": 0.002675340970357259, "deviation-center-line": 0.8080416140400803, "driven_lanedir_consec": 3.0055803830276773, "sim_compute_sim_state": 0.014014739195505778, "sim_compute_performance-ego": 0.0023043537139892578}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.087199500491787, "get_ui_image": 0.022092648347218833, "step_physics": 0.055391565163930255, "survival_time": 14.950000000000076, "driven_lanedir": 3.770445938451982, "get_state_dump": 0.006791083017985026, "sim_render-ego": 0.0036115582784016927, "get_robot_state": 0.008447214762369792, "get_duckie_state": 1.049041748046875e-06, "in-drivable-lane": 1.849999999999998, "agent_compute-ego": 0.011854334672292074, "deviation-heading": 1.5313588437885166, "complete-iteration": 0.13010777076085409, "set_robot_commands": 0.002668728033701579, "deviation-center-line": 0.9356783755365696, "driven_lanedir_consec": 3.770445938451982, "sim_compute_sim_state": 0.016873552799224853, "sim_compute_performance-ego": 0.0023024280865987143}}
set_robot_commands_max0.002723995049794515
set_robot_commands_mean0.002690913478533427
set_robot_commands_median0.002685465415318807
set_robot_commands_min0.002668728033701579
sim_compute_performance-ego_max0.002321479320526123
sim_compute_performance-ego_mean0.0023100878794987995
sim_compute_performance-ego_median0.0023082220554351807
sim_compute_performance-ego_min0.0023024280865987143
sim_compute_sim_state_max0.016873552799224853
sim_compute_sim_state_mean0.014758010307947794
sim_compute_sim_state_median0.01415211002031962
sim_compute_sim_state_min0.013854268391927084
sim_render-ego_max0.003622612953186035
sim_render-ego_mean0.0036114561557769776
sim_render-ego_median0.003610104322433472
sim_render-ego_min0.003603003025054932
simulation-passed1
step_physics_max0.055391565163930255
step_physics_mean0.05396656711896261
step_physics_median0.05395557244618734
step_physics_min0.05256355841954549
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4269111507Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:05:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4268511503Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:05:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4264011497Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:02:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4262211498Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:05:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4260811494Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:06:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4258911491Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:05:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4258411490Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:07:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.772529196608021
survival_time_median14.950000000000076
deviation-center-line_median0.607878096477974
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01395322561264038
agent_compute-ego_mean0.0131688791513443
agent_compute-ego_median0.013529607852300007
agent_compute-ego_min0.0116630752881368
complete-iteration_max0.14767900149027507
complete-iteration_mean0.1429059330622355
complete-iteration_median0.14521244366963704
complete-iteration_min0.1335198434193929
deviation-center-line_max0.702689390486291
deviation-center-line_mean0.6031134713385715
deviation-center-line_min0.49400830191204687
deviation-heading_max3.490715032651871
deviation-heading_mean2.802535928036275
deviation-heading_median2.7957356851652104
deviation-heading_min2.127957309162807
driven_any_max2.858817629349665
driven_any_mean2.8564994567352446
driven_any_median2.858802746255576
driven_any_min2.849574705080162
driven_lanedir_consec_max2.806937889679766
driven_lanedir_consec_mean2.660831760659533
driven_lanedir_consec_min2.291330759742325
driven_lanedir_max2.806937889679766
driven_lanedir_mean2.660831760659533
driven_lanedir_median2.772529196608021
driven_lanedir_min2.291330759742325
get_duckie_state_max2.117156982421875e-06
get_duckie_state_mean2.0468235015869143e-06
get_duckie_state_median2.086162567138672e-06
get_duckie_state_min1.8978118896484377e-06
get_robot_state_max0.009185229142506916
get_robot_state_mean0.00884371558825175
get_robot_state_median0.008909762700398763
get_robot_state_min0.008370107809702555
get_state_dump_max0.007323137919108073
get_state_dump_mean0.0072035080194473265
get_state_dump_median0.0072452839215596514
get_state_dump_min0.00700032631556193
get_ui_image_max0.025892531077067057
get_ui_image_mean0.024745650490125014
get_ui_image_median0.02535980145136515
get_ui_image_min0.02237046798070272
in-drivable-lane_max2.5000000000000355
in-drivable-lane_mean0.6250000000000089
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.849574705080162, "get_ui_image": 0.025892531077067057, "step_physics": 0.06318395535151164, "survival_time": 14.950000000000076, "driven_lanedir": 2.806937889679766, "get_state_dump": 0.007289868990580241, "sim_render-ego": 0.003943442503611247, "get_robot_state": 0.0088268248240153, "get_duckie_state": 2.1115938822428387e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013493027687072754, "deviation-heading": 2.127957309162807, "complete-iteration": 0.1449137568473816, "set_robot_commands": 0.0035227704048156738, "deviation-center-line": 0.5696670758077795, "driven_lanedir_consec": 2.806937889679766, "sim_compute_sim_state": 0.016004393100738524, "sim_compute_performance-ego": 0.002672230402628581}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.858817629349665, "get_ui_image": 0.025294516881306964, "step_physics": 0.06416403532028198, "survival_time": 14.950000000000076, "driven_lanedir": 2.757728323404687, "get_state_dump": 0.007200698852539062, "sim_render-ego": 0.003977522850036621, "get_robot_state": 0.009185229142506916, "get_duckie_state": 2.117156982421875e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01395322561264038, "deviation-heading": 3.490715032651871, "complete-iteration": 0.1455111304918925, "set_robot_commands": 0.003509061336517334, "deviation-center-line": 0.702689390486291, "driven_lanedir_consec": 2.757728323404687, "sim_compute_sim_state": 0.015486586888631184, "sim_compute_performance-ego": 0.0026542115211486816}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.85879451310341, "get_ui_image": 0.02542508602142334, "step_physics": 0.0657497771581014, "survival_time": 14.950000000000076, "driven_lanedir": 2.787330069811355, "get_state_dump": 0.007323137919108073, "sim_render-ego": 0.004085402488708496, "get_robot_state": 0.008992700576782227, "get_duckie_state": 2.060731252034505e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013566188017527262, "deviation-heading": 2.8764410521064336, "complete-iteration": 0.14767900149027507, "set_robot_commands": 0.0034026145935058595, "deviation-center-line": 0.49400830191204687, "driven_lanedir_consec": 2.787330069811355, "sim_compute_sim_state": 0.016372116406758626, "sim_compute_performance-ego": 0.0026750596364339195}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8588109794077416, "get_ui_image": 0.02237046798070272, "step_physics": 0.05849892536799113, "survival_time": 14.950000000000076, "driven_lanedir": 2.291330759742325, "get_state_dump": 0.00700032631556193, "sim_render-ego": 0.0037296454111735025, "get_robot_state": 0.008370107809702555, "get_duckie_state": 1.8978118896484377e-06, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.0116630752881368, "deviation-heading": 2.7150303182239877, "complete-iteration": 0.1335198434193929, "set_robot_commands": 0.002790842056274414, "deviation-center-line": 0.6460891171481685, "driven_lanedir_consec": 2.291330759742325, "sim_compute_sim_state": 0.01663231372833252, "sim_compute_performance-ego": 0.00238447109858195}}
set_robot_commands_max0.0035227704048156738
set_robot_commands_mean0.00330632209777832
set_robot_commands_median0.0034558379650115965
set_robot_commands_min0.002790842056274414
sim_compute_performance-ego_max0.0026750596364339195
sim_compute_performance-ego_mean0.002596493164698283
sim_compute_performance-ego_median0.0026632209618886312
sim_compute_performance-ego_min0.00238447109858195
sim_compute_sim_state_max0.01663231372833252
sim_compute_sim_state_mean0.016123852531115212
sim_compute_sim_state_median0.016188254753748577
sim_compute_sim_state_min0.015486586888631184
sim_render-ego_max0.004085402488708496
sim_render-ego_mean0.003934003313382466
sim_render-ego_median0.003960482676823933
sim_render-ego_min0.0037296454111735025
simulation-passed1
step_physics_max0.0657497771581014
step_physics_mean0.06289917329947153
step_physics_median0.06367399533589681
step_physics_min0.05849892536799113
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4256911488Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:06:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4256111487Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7002262654602864
survival_time_median14.950000000000076
deviation-center-line_median0.7319407724727505
in-drivable-lane_median0.2250000000000032


other stats
agent_compute-ego_max0.01742555061976115
agent_compute-ego_mean0.016120913028717043
agent_compute-ego_median0.016515496571858725
agent_compute-ego_min0.014027108351389568
complete-iteration_max0.1923303524653117
complete-iteration_mean0.17670605222384136
complete-iteration_median0.1770521326859792
complete-iteration_min0.1603895910580953
deviation-center-line_max0.8047609324678042
deviation-center-line_mean0.7007082015815806
deviation-center-line_min0.5341903289130177
deviation-heading_max2.403919624477372
deviation-heading_mean1.7864348303134965
deviation-heading_median1.6238209297281956
deviation-heading_min1.4941778373202237
driven_any_max2.947807658061914
driven_any_mean2.808071554846262
driven_any_median2.8042380913284912
driven_any_min2.6760023786661513
driven_lanedir_consec_max2.92073414614649
driven_lanedir_consec_mean2.601197900976284
driven_lanedir_consec_min2.0836049268380727
driven_lanedir_max2.92073414614649
driven_lanedir_mean2.601197900976284
driven_lanedir_median2.7002262654602864
driven_lanedir_min2.0836049268380727
get_duckie_state_max1.9701321919759115e-06
get_duckie_state_mean1.9009908040364584e-06
get_duckie_state_median1.8926461537679037e-06
get_duckie_state_min1.8485387166341145e-06
get_robot_state_max0.010096509456634522
get_robot_state_mean0.009627906680107117
get_robot_state_median0.00960625688234965
get_robot_state_min0.009202603499094646
get_state_dump_max0.007751419544219971
get_state_dump_mean0.007694084644317627
get_state_dump_median0.007724080880482992
get_state_dump_min0.007576757272084554
get_ui_image_max0.032848687171936036
get_ui_image_mean0.02954570750395457
get_ui_image_median0.02937976757685343
get_ui_image_min0.026574607690175375
in-drivable-lane_max3.7500000000000537
in-drivable-lane_mean1.050000000000015
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.908464907658635, "get_ui_image": 0.02665690978368123, "step_physics": 0.07041582504908243, "survival_time": 14.950000000000076, "driven_lanedir": 2.785264197141104, "get_state_dump": 0.007717224756876627, "sim_render-ego": 0.004315474033355713, "get_robot_state": 0.009289190769195555, "get_duckie_state": 1.9701321919759115e-06, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.015634915033976238, "deviation-heading": 1.4941778373202237, "complete-iteration": 0.1603895910580953, "set_robot_commands": 0.003609297275543213, "deviation-center-line": 0.7958491720226972, "driven_lanedir_consec": 2.785264197141104, "sim_compute_sim_state": 0.019792146682739258, "sim_compute_performance-ego": 0.0028724702199300132}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.947807658061914, "get_ui_image": 0.03210262537002564, "step_physics": 0.08817906459172567, "survival_time": 14.950000000000076, "driven_lanedir": 2.92073414614649, "get_state_dump": 0.007730937004089356, "sim_render-ego": 0.004863100051879883, "get_robot_state": 0.009923322995503744, "get_duckie_state": 1.932779947916667e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01742555061976115, "deviation-heading": 1.6000372587758938, "complete-iteration": 0.19030305703481035, "set_robot_commands": 0.003736594518025716, "deviation-center-line": 0.8047609324678042, "driven_lanedir_consec": 2.92073414614649, "sim_compute_sim_state": 0.023086903095245363, "sim_compute_performance-ego": 0.003164416154225667}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.6760023786661513, "get_ui_image": 0.032848687171936036, "step_physics": 0.0889501937230428, "survival_time": 14.950000000000076, "driven_lanedir": 2.615188333779469, "get_state_dump": 0.007751419544219971, "sim_render-ego": 0.00488612174987793, "get_robot_state": 0.010096509456634522, "get_duckie_state": 1.8525123596191403e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01739607810974121, "deviation-heading": 2.403919624477372, "complete-iteration": 0.1923303524653117, "set_robot_commands": 0.003744637171427409, "deviation-center-line": 0.6680323729228037, "driven_lanedir_consec": 2.615188333779469, "sim_compute_sim_state": 0.02343883514404297, "sim_compute_performance-ego": 0.0031261491775512696}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.700011274998348, "get_ui_image": 0.026574607690175375, "step_physics": 0.07485198974609375, "survival_time": 14.950000000000076, "driven_lanedir": 2.0836049268380727, "get_state_dump": 0.007576757272084554, "sim_render-ego": 0.004273973306020101, "get_robot_state": 0.009202603499094646, "get_duckie_state": 1.8485387166341145e-06, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.014027108351389568, "deviation-heading": 1.6476046006804972, "complete-iteration": 0.16380120833714804, "set_robot_commands": 0.003804903030395508, "deviation-center-line": 0.5341903289130177, "driven_lanedir_consec": 2.0836049268380727, "sim_compute_sim_state": 0.02061295747756958, "sim_compute_performance-ego": 0.002785526911417643}}
set_robot_commands_max0.003804903030395508
set_robot_commands_mean0.0037238579988479615
set_robot_commands_median0.0037406158447265622
set_robot_commands_min0.003609297275543213
sim_compute_performance-ego_max0.003164416154225667
sim_compute_performance-ego_mean0.0029871406157811484
sim_compute_performance-ego_median0.0029993096987406412
sim_compute_performance-ego_min0.002785526911417643
sim_compute_sim_state_max0.02343883514404297
sim_compute_sim_state_mean0.021732710599899292
sim_compute_sim_state_median0.02184993028640747
sim_compute_sim_state_min0.019792146682739258
sim_render-ego_max0.00488612174987793
sim_render-ego_mean0.004584667285283407
sim_render-ego_median0.004589287042617797
sim_render-ego_min0.004273973306020101
simulation-passed1
step_physics_max0.0889501937230428
step_physics_mean0.08059926827748616
step_physics_median0.08151552716890971
step_physics_min0.07041582504908243
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4253811483Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:05:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4251911477Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele04-b953b5d8021c-10:05:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4249811470Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:06:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2863789219676138
survival_time_median14.950000000000076
deviation-center-line_median0.6512734031169546
in-drivable-lane_median4.3250000000000615


other stats
agent_compute-ego_max0.01234621524810791
agent_compute-ego_mean0.011641753514607748
agent_compute-ego_median0.011508971452713013
agent_compute-ego_min0.011202855904897054
complete-iteration_max0.13217691898345948
complete-iteration_mean0.12757134159406028
complete-iteration_median0.12780402978261313
complete-iteration_min0.12250038782755532
deviation-center-line_max1.1583949836726084
deviation-center-line_mean0.64827908986695
deviation-center-line_min0.13217456956128246
deviation-heading_max2.9227562017921973
deviation-heading_mean2.3988825263327107
deviation-heading_median2.507470772287344
deviation-heading_min1.657832358963958
driven_any_max1.9399505271766224
driven_any_mean1.9383289180372796
driven_any_median1.9398642918957143
driven_any_min1.9336365611810675
driven_lanedir_consec_max1.5549681441445835
driven_lanedir_consec_mean1.060673516966811
driven_lanedir_consec_min0.11496807978743184
driven_lanedir_max1.5549681441445835
driven_lanedir_mean1.0629154017351046
driven_lanedir_median1.2908626915042012
driven_lanedir_min0.11496807978743184
get_duckie_state_max1.1245409647623698e-06
get_duckie_state_mean1.0518232981363931e-06
get_duckie_state_median1.0307629903157552e-06
get_duckie_state_min1.0212262471516929e-06
get_robot_state_max0.008203574021657308
get_robot_state_mean0.008147711555163065
get_robot_state_median0.00814367691675822
get_robot_state_min0.008099918365478515
get_state_dump_max0.006870835622151693
get_state_dump_mean0.0068123171726862585
get_state_dump_median0.006796274185180664
get_state_dump_min0.006785884698232015
get_ui_image_max0.022691608270009357
get_ui_image_mean0.022291874090830485
get_ui_image_median0.022231698830922443
get_ui_image_min0.02201249043146769
in-drivable-lane_max12.550000000000082
in-drivable-lane_mean5.862500000000059
in-drivable-lane_min2.250000000000032
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336365611810675, "get_ui_image": 0.022124460538228353, "step_physics": 0.05263143062591553, "survival_time": 14.950000000000076, "driven_lanedir": 1.4357254297289388, "get_state_dump": 0.00679232915242513, "sim_render-ego": 0.003611331780751546, "get_robot_state": 0.008099918365478515, "get_duckie_state": 1.1245409647623698e-06, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.011516878604888916, "deviation-heading": 2.7370134192602538, "complete-iteration": 0.12368525822957356, "set_robot_commands": 0.002885406017303467, "deviation-center-line": 1.1583949836726084, "driven_lanedir_consec": 1.4357254297289388, "sim_compute_sim_state": 0.013624718189239502, "sim_compute_performance-ego": 0.002322374184926351}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399505271766224, "get_ui_image": 0.02201249043146769, "step_physics": 0.05247972249984741, "survival_time": 14.950000000000076, "driven_lanedir": 1.1459999532794634, "get_state_dump": 0.006800219217936198, "sim_render-ego": 0.003616716066996257, "get_robot_state": 0.008100870450337729, "get_duckie_state": 1.0228157043457031e-06, "in-drivable-lane": 5.550000000000079, "agent_compute-ego": 0.01150106430053711, "deviation-heading": 1.657832358963958, "complete-iteration": 0.12250038782755532, "set_robot_commands": 0.002727390925089518, "deviation-center-line": 0.8147797945081562, "driven_lanedir_consec": 1.1370324142062889, "sim_compute_sim_state": 0.012860801219940186, "sim_compute_performance-ego": 0.0023238070805867515}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9398637195660529, "get_ui_image": 0.022338937123616537, "step_physics": 0.05987502495447795, "survival_time": 14.950000000000076, "driven_lanedir": 0.11496807978743184, "get_state_dump": 0.006785884698232015, "sim_render-ego": 0.0037114508946736657, "get_robot_state": 0.00818648338317871, "get_duckie_state": 1.0212262471516929e-06, "in-drivable-lane": 12.550000000000082, "agent_compute-ego": 0.01234621524810791, "deviation-heading": 2.277928125314434, "complete-iteration": 0.13192280133565268, "set_robot_commands": 0.0027292887369791668, "deviation-center-line": 0.13217456956128246, "driven_lanedir_consec": 0.11496807978743184, "sim_compute_sim_state": 0.013538469473520914, "sim_compute_performance-ego": 0.0023328510920206705}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9398648642253755, "get_ui_image": 0.022691608270009357, "step_physics": 0.05854345480600993, "survival_time": 14.950000000000076, "driven_lanedir": 1.5549681441445835, "get_state_dump": 0.006870835622151693, "sim_render-ego": 0.0036093743642171224, "get_robot_state": 0.008203574021657308, "get_duckie_state": 1.0387102762858072e-06, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.011202855904897054, "deviation-heading": 2.9227562017921973, "complete-iteration": 0.13217691898345948, "set_robot_commands": 0.002764914830525716, "deviation-center-line": 0.487767011725753, "driven_lanedir_consec": 1.5549681441445835, "sim_compute_sim_state": 0.015883254210154216, "sim_compute_performance-ego": 0.0023282829920450846}}
set_robot_commands_max0.002885406017303467
set_robot_commands_mean0.002776750127474467
set_robot_commands_median0.0027471017837524415
set_robot_commands_min0.002727390925089518
sim_compute_performance-ego_max0.0023328510920206705
sim_compute_performance-ego_mean0.0023268288373947143
sim_compute_performance-ego_median0.002326045036315918
sim_compute_performance-ego_min0.002322374184926351
sim_compute_sim_state_max0.015883254210154216
sim_compute_sim_state_mean0.013976810773213704
sim_compute_sim_state_median0.013581593831380207
sim_compute_sim_state_min0.012860801219940186
sim_render-ego_max0.0037114508946736657
sim_render-ego_mean0.0036372182766596472
sim_render-ego_median0.003614023923873901
sim_render-ego_min0.0036093743642171224
simulation-passed1
step_physics_max0.05987502495447795
step_physics_mean0.0558824082215627
step_physics_median0.05558744271596273
step_physics_min0.05247972249984741
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4248411467Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LF-sim-validationLFv-simsuccessnoafdaniele04-b953b5d8021c-10:13:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2090441452740572
survival_time_median14.950000000000076
deviation-center-line_median1.4339566489340894
in-drivable-lane_median0.4750000000000067


other stats
agent_compute-ego_max0.23756280740102131
agent_compute-ego_mean0.2332158440351486
agent_compute-ego_median0.2334003221988678
agent_compute-ego_min0.22849992434183755
complete-iteration_max0.3886126708984375
complete-iteration_mean0.3825893998146057
complete-iteration_median0.38314818700154624
complete-iteration_min0.3754485543568929
deviation-center-line_max1.5733501224154267
deviation-center-line_mean1.399804974930136
deviation-center-line_min1.1579564794369388
deviation-heading_max3.056557413076886
deviation-heading_mean1.8332479277518383
deviation-heading_median1.5326033588923842
deviation-heading_min1.2112275801457
driven_any_max3.527518612134369
driven_any_mean3.011379596025075
driven_any_median3.254068462848023
driven_any_min2.009862846269884
driven_lanedir_consec_max3.417248075128853
driven_lanedir_consec_mean2.9324646793750446
driven_lanedir_consec_min1.8945223518232115
driven_lanedir_max3.417248075128853
driven_lanedir_mean2.9324646793750446
driven_lanedir_median3.2090441452740572
driven_lanedir_min1.8945223518232115
get_duckie_state_max1.2501080830891929e-06
get_duckie_state_mean1.2244780858357743e-06
get_duckie_state_median1.23898188273112e-06
get_duckie_state_min1.1698404947916666e-06
get_robot_state_max0.009897053241729736
get_robot_state_mean0.009468740224838255
get_robot_state_median0.00940169413884481
get_robot_state_min0.009174519379933676
get_state_dump_max0.007655014197031656
get_state_dump_mean0.007455808520317077
get_state_dump_median0.007423210144042968
get_state_dump_min0.007321799596150716
get_ui_image_max0.02602373520533244
get_ui_image_mean0.025551406145095823
get_ui_image_median0.025498114426930743
get_ui_image_min0.02518566052118937
in-drivable-lane_max2.0000000000000053
in-drivable-lane_mean0.7375000000000047
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0733273324291437, "get_ui_image": 0.025264416535695392, "step_physics": 0.06895654757817586, "survival_time": 14.950000000000076, "driven_lanedir": 3.053787923074423, "get_state_dump": 0.007655014197031656, "sim_render-ego": 0.005424807866414388, "get_robot_state": 0.009897053241729736, "get_duckie_state": 1.1698404947916666e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.23756280740102131, "deviation-heading": 1.6094213046744728, "complete-iteration": 0.38519360303878786, "set_robot_commands": 0.00523759126663208, "deviation-center-line": 1.5733501224154267, "driven_lanedir_consec": 3.053787923074423, "sim_compute_sim_state": 0.021367597579956057, "sim_compute_performance-ego": 0.003752399285634358}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.4348095932669027, "get_ui_image": 0.02602373520533244, "step_physics": 0.0716432785987854, "survival_time": 14.950000000000076, "driven_lanedir": 3.417248075128853, "get_state_dump": 0.007497300306955973, "sim_render-ego": 0.004907364050547282, "get_robot_state": 0.009614692529042564, "get_duckie_state": 1.2501080830891929e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.22849992434183755, "deviation-heading": 1.455785413110296, "complete-iteration": 0.3754485543568929, "set_robot_commands": 0.005017321109771728, "deviation-center-line": 1.3577585739264986, "driven_lanedir_consec": 3.417248075128853, "sim_compute_sim_state": 0.01867669741312663, "sim_compute_performance-ego": 0.0034909462928771973}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.009862846269884, "get_ui_image": 0.02518566052118937, "step_physics": 0.07469263871510824, "survival_time": 14.950000000000076, "driven_lanedir": 1.8945223518232115, "get_state_dump": 0.007349119981129964, "sim_render-ego": 0.004929945468902588, "get_robot_state": 0.009174519379933676, "get_duckie_state": 1.2501080830891929e-06, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.23189722140630087, "deviation-heading": 3.056557413076886, "complete-iteration": 0.3811027709643046, "set_robot_commands": 0.005266505082448324, "deviation-center-line": 1.51015472394168, "driven_lanedir_consec": 1.8945223518232115, "sim_compute_sim_state": 0.01895049254099528, "sim_compute_performance-ego": 0.003579728603363037}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.527518612134369, "get_ui_image": 0.025731812318166097, "step_physics": 0.07488415638605754, "survival_time": 14.950000000000076, "driven_lanedir": 3.364300367473691, "get_state_dump": 0.007321799596150716, "sim_render-ego": 0.0049715550740559895, "get_robot_state": 0.009188695748647054, "get_duckie_state": 1.227855682373047e-06, "in-drivable-lane": 2.0000000000000053, "agent_compute-ego": 0.2349034229914347, "deviation-heading": 1.2112275801457, "complete-iteration": 0.3886126708984375, "set_robot_commands": 0.005238081614176432, "deviation-center-line": 1.1579564794369388, "driven_lanedir_consec": 3.364300367473691, "sim_compute_sim_state": 0.02274993578592936, "sim_compute_performance-ego": 0.0035450045267740884}}
set_robot_commands_max0.005266505082448324
set_robot_commands_mean0.005189874768257141
set_robot_commands_median0.005237836440404256
set_robot_commands_min0.005017321109771728
sim_compute_performance-ego_max0.003752399285634358
sim_compute_performance-ego_mean0.00359201967716217
sim_compute_performance-ego_median0.0035623665650685627
sim_compute_performance-ego_min0.0034909462928771973
sim_compute_sim_state_max0.02274993578592936
sim_compute_sim_state_mean0.02043618083000183
sim_compute_sim_state_median0.020159045060475667
sim_compute_sim_state_min0.01867669741312663
sim_render-ego_max0.005424807866414388
sim_render-ego_mean0.005058418114980062
sim_render-ego_median0.004950750271479289
sim_render-ego_min0.004907364050547282
simulation-passed1
step_physics_max0.07488415638605754
step_physics_mean0.07254415531953176
step_physics_median0.07316795865694682
step_physics_min0.06895654757817586
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible