Duckietown Challenges Home Challenges Submissions

Evaluator 2313

ID2313
evaluatorafdaniele15-b9b1aef9b8fb-1
ownerI don't have one πŸ˜€
machinebox1
processafdaniele15-b9b1aef9b8fb-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success77 42490
# timeout
# failed19 42844
# error15 42513
# aborted5 42866
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID
submission
user
user label
challenge
step
status
up to date
evaluator
date started
date completed
duration
message
4411311782Kaiyi Chen πŸ‡ΊπŸ‡ΈKK Netaido5-LF-sim-validationLFv-simabortednoafdaniele15-b9b1aef9b8fb-10:01:15
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4411111781Kaiyi Chen πŸ‡ΊπŸ‡ΈKK Netaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:01:02
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4410811781Kaiyi Chen πŸ‡ΊπŸ‡ΈKK Netaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:01:00
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4410111781Kaiyi Chen πŸ‡ΊπŸ‡ΈKK Netaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:01:00
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4409411780Kaiyi Chen πŸ‡ΊπŸ‡ΈKK Netaido5-LF-sim-validationLFv-simabortednoafdaniele15-b9b1aef9b8fb-10:01:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 236, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 35, in init
             ||     self.check_tensorflow_gpu()
             ||   File "solution.py", line 51, in check_tensorflow_gpu
             ||     raise RuntimeError(msg)
             || RuntimeError: Could not find gpu device.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 35, in init
             || |     self.check_tensorflow_gpu()
             || |   File "solution.py", line 51, in check_tensorflow_gpu
             || |     raise RuntimeError(msg)
             || | RuntimeError: Could not find gpu device.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4408011779Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.969229906673166
survival_time_median14.950000000000076
deviation-center-line_median0.31575435140144287
in-drivable-lane_median6.4750000000000725


other stats
agent_compute-ego_max0.02830049435297648
agent_compute-ego_mean0.02654264623733079
agent_compute-ego_median0.02600753336770764
agent_compute-ego_min0.025855023860931397
complete-iteration_max0.3708840719858805
complete-iteration_mean0.3221876797832372
complete-iteration_median0.3226721433316314
complete-iteration_min0.27252236048380535
deviation-center-line_max0.5844293028392642
deviation-center-line_mean0.334694613992221
deviation-center-line_min0.12284045032673424
deviation-heading_max3.200215276402826
deviation-heading_mean1.63157879273938
deviation-heading_median1.272305532614615
deviation-heading_min0.7814888293254643
driven_any_max3.775085206140485
driven_any_mean3.3761574595638324
driven_any_median3.378426070798264
driven_any_min2.972692490518317
driven_lanedir_consec_max3.041859644156458
driven_lanedir_consec_mean1.9102353836716404
driven_lanedir_consec_min0.6606220771837716
driven_lanedir_max3.064156061807473
driven_lanedir_mean1.9160567746901889
driven_lanedir_median1.969229906673166
driven_lanedir_min0.6616112236069502
get_duckie_state_max3.009637196858724e-06
get_duckie_state_mean2.9050730262341357e-06
get_duckie_state_median2.926190694173177e-06
get_duckie_state_min2.7582735197314656e-06
get_robot_state_max0.023795694510142008
get_robot_state_mean0.022504636178123063
get_robot_state_median0.023461969951206668
get_robot_state_min0.019298910299936932
get_state_dump_max0.020363193353017173
get_state_dump_mean0.019988562843789616
get_state_dump_median0.020002907080630378
get_state_dump_min0.019585243860880532
get_ui_image_max0.0631786314646403
get_ui_image_mean0.05284854417232955
get_ui_image_median0.053099258446460657
get_ui_image_min0.04201702833175659
in-drivable-lane_max12.350000000000076
in-drivable-lane_mean7.12500000000006
in-drivable-lane_min3.2000000000000206
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.775085206140485, "get_ui_image": 0.0631786314646403, "step_physics": 0.1670807178815206, "survival_time": 14.950000000000076, "driven_lanedir": 3.064156061807473, "get_state_dump": 0.020363193353017173, "sim_render-ego": 0.010343345801035565, "get_robot_state": 0.023418128490448, "get_duckie_state": 3.009637196858724e-06, "in-drivable-lane": 3.2000000000000206, "agent_compute-ego": 0.02830049435297648, "deviation-heading": 3.200215276402826, "complete-iteration": 0.3708840719858805, "set_robot_commands": 0.008611203034718832, "deviation-center-line": 0.5844293028392642, "driven_lanedir_consec": 3.041859644156458, "sim_compute_sim_state": 0.0428387713432312, "sim_compute_performance-ego": 0.006569215456644694}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.972692490518317, "get_ui_image": 0.056310130961270514, "step_physics": 0.1365056556637816, "survival_time": 11.950000000000037, "driven_lanedir": 1.9810299416051376, "get_state_dump": 0.02001007231708351, "sim_render-ego": 0.010051442988248052, "get_robot_state": 0.023505811411965345, "get_duckie_state": 2.7582735197314656e-06, "in-drivable-lane": 4.300000000000054, "agent_compute-ego": 0.0259213906451748, "deviation-heading": 1.7501600739303045, "complete-iteration": 0.32585280011388545, "set_robot_commands": 0.007861980334485425, "deviation-center-line": 0.44105321269977504, "driven_lanedir_consec": 1.9810299416051376, "sim_compute_sim_state": 0.03925176245398102, "sim_compute_performance-ego": 0.006259656850264163}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5753205202482716, "get_ui_image": 0.0498883859316508, "step_physics": 0.13584322532018026, "survival_time": 14.950000000000076, "driven_lanedir": 0.6616112236069502, "get_state_dump": 0.019995741844177246, "sim_render-ego": 0.010150155226389568, "get_robot_state": 0.023795694510142008, "get_duckie_state": 2.9317537943522136e-06, "in-drivable-lane": 12.350000000000076, "agent_compute-ego": 0.02609367609024048, "deviation-heading": 0.7944509912989256, "complete-iteration": 0.3194914865493774, "set_robot_commands": 0.008185457388559978, "deviation-center-line": 0.12284045032673424, "driven_lanedir_consec": 0.6606220771837716, "sim_compute_sim_state": 0.03890358686447144, "sim_compute_performance-ego": 0.006456046899159749}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.181531621348256, "get_ui_image": 0.04201702833175659, "step_physics": 0.1054526201883952, "survival_time": 14.950000000000076, "driven_lanedir": 1.9574298717411944, "get_state_dump": 0.019585243860880532, "sim_render-ego": 0.008390503724416097, "get_robot_state": 0.019298910299936932, "get_duckie_state": 2.9206275939941406e-06, "in-drivable-lane": 8.650000000000091, "agent_compute-ego": 0.025855023860931397, "deviation-heading": 0.7814888293254643, "complete-iteration": 0.27252236048380535, "set_robot_commands": 0.006751956939697265, "deviation-center-line": 0.19045549010311064, "driven_lanedir_consec": 1.9574298717411944, "sim_compute_sim_state": 0.0389369535446167, "sim_compute_performance-ego": 0.006051325003306071}}
set_robot_commands_max0.008611203034718832
set_robot_commands_mean0.007852649424365376
set_robot_commands_median0.008023718861522701
set_robot_commands_min0.006751956939697265
sim_compute_performance-ego_max0.006569215456644694
sim_compute_performance-ego_mean0.0063340610523436695
sim_compute_performance-ego_median0.006357851874711956
sim_compute_performance-ego_min0.006051325003306071
sim_compute_sim_state_max0.0428387713432312
sim_compute_sim_state_mean0.03998276855157509
sim_compute_sim_state_median0.03909435799929886
sim_compute_sim_state_min0.03890358686447144
sim_render-ego_max0.010343345801035565
sim_render-ego_mean0.00973386193502232
sim_render-ego_median0.01010079910731881
sim_render-ego_min0.008390503724416097
simulation-passed1
step_physics_max0.1670807178815206
step_physics_mean0.1362205547634694
step_physics_median0.1361744404919809
step_physics_min0.1054526201883952
survival_time_max14.950000000000076
survival_time_mean14.200000000000069
survival_time_min11.950000000000037
No reset possible
4406511779Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6284845891463104
survival_time_median12.25000000000004
deviation-center-line_median0.3006603758675744
in-drivable-lane_median5.125000000000038


other stats
agent_compute-ego_max0.02613283201241593
agent_compute-ego_mean0.02549341284802032
agent_compute-ego_median0.025714474804056277
agent_compute-ego_min0.024411869771552807
complete-iteration_max0.3332911984192278
complete-iteration_mean0.29644016225536196
complete-iteration_median0.28802587342984753
complete-iteration_min0.276417703742525
deviation-center-line_max0.5665764800285628
deviation-center-line_mean0.3430054763129564
deviation-center-line_min0.20412467348811403
deviation-heading_max2.0714841920904763
deviation-heading_mean1.5673425815304245
deviation-heading_median1.7560728557466452
deviation-heading_min0.685740422537932
driven_any_max3.005394449773817
driven_any_mean2.8611759976537527
driven_any_median2.907304602347173
driven_any_min2.6247003361468484
driven_lanedir_consec_max1.9470515888973992
driven_lanedir_consec_mean1.461213463147187
driven_lanedir_consec_min0.6408330853987272
driven_lanedir_max1.9470515888973992
driven_lanedir_mean1.4630664522634191
driven_lanedir_median1.6284845891463104
driven_lanedir_min0.6482450418636557
get_duckie_state_max3.1716320144227776e-06
get_duckie_state_mean2.994896268277779e-06
get_duckie_state_median2.959617510999097e-06
get_duckie_state_min2.8887180366901436e-06
get_robot_state_max0.02345597893623129
get_robot_state_mean0.021881832565598076
get_robot_state_median0.0220554739418891
get_robot_state_min0.019960403442382812
get_state_dump_max0.020283548831939696
get_state_dump_mean0.02001498806605371
get_state_dump_median0.020060964779587617
get_state_dump_min0.019654473873099897
get_ui_image_max0.05363516428480587
get_ui_image_mean0.04782255595553625
get_ui_image_median0.04686179335671242
get_ui_image_min0.043931472823914304
in-drivable-lane_max11.200000000000069
in-drivable-lane_mean6.31250000000005
in-drivable-lane_min3.800000000000054
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.6247003361468484, "get_ui_image": 0.04612480751191727, "step_physics": 0.11055411834909458, "survival_time": 9.900000000000006, "driven_lanedir": 1.3321925052534265, "get_state_dump": 0.019654473873099897, "sim_render-ego": 0.00874240229828189, "get_robot_state": 0.019960403442382812, "get_duckie_state": 2.8887180366901436e-06, "in-drivable-lane": 5.100000000000015, "agent_compute-ego": 0.024411869771552807, "deviation-heading": 0.685740422537932, "complete-iteration": 0.2791136358723496, "set_robot_commands": 0.006895256764961012, "deviation-center-line": 0.20412467348811403, "driven_lanedir_consec": 1.3321925052534265, "sim_compute_sim_state": 0.03656785656707456, "sim_compute_performance-ego": 0.006029361426228225}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9904750613312925, "get_ui_image": 0.043931472823914304, "step_physics": 0.106464822928744, "survival_time": 12.550000000000043, "driven_lanedir": 1.9247766730391944, "get_state_dump": 0.019974705707504453, "sim_render-ego": 0.009157157989137202, "get_robot_state": 0.02217301809455294, "get_duckie_state": 3.1716320144227776e-06, "in-drivable-lane": 5.150000000000062, "agent_compute-ego": 0.02566967067490536, "deviation-heading": 1.5739071083032474, "complete-iteration": 0.276417703742525, "set_robot_commands": 0.007741242290967964, "deviation-center-line": 0.35066812807093994, "driven_lanedir_consec": 1.9247766730391944, "sim_compute_sim_state": 0.03499753351705483, "sim_compute_performance-ego": 0.006128701555776406}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.005394449773817, "get_ui_image": 0.04759877920150757, "step_physics": 0.12109088818232218, "survival_time": 14.950000000000076, "driven_lanedir": 0.6482450418636557, "get_state_dump": 0.020283548831939696, "sim_render-ego": 0.009354581038157145, "get_robot_state": 0.02193792978922526, "get_duckie_state": 2.987384796142578e-06, "in-drivable-lane": 11.200000000000069, "agent_compute-ego": 0.025759278933207196, "deviation-heading": 2.0714841920904763, "complete-iteration": 0.2969381109873454, "set_robot_commands": 0.007407286167144775, "deviation-center-line": 0.2506526236642088, "driven_lanedir_consec": 0.6408330853987272, "sim_compute_sim_state": 0.03720970630645752, "sim_compute_performance-ego": 0.006122857729593913}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.824134143363054, "get_ui_image": 0.05363516428480587, "step_physics": 0.1391439258304101, "survival_time": 11.950000000000037, "driven_lanedir": 1.9470515888973992, "get_state_dump": 0.02014722385167078, "sim_render-ego": 0.01015027896130933, "get_robot_state": 0.02345597893623129, "get_duckie_state": 2.931850225855616e-06, "in-drivable-lane": 3.800000000000054, "agent_compute-ego": 0.02613283201241593, "deviation-heading": 1.938238603190043, "complete-iteration": 0.3332911984192278, "set_robot_commands": 0.008011093698286112, "deviation-center-line": 0.5665764800285628, "driven_lanedir_consec": 1.9470515888973992, "sim_compute_sim_state": 0.046124281743580325, "sim_compute_performance-ego": 0.006315846822251834}}
set_robot_commands_max0.008011093698286112
set_robot_commands_mean0.007513719730339966
set_robot_commands_median0.00757426422905637
set_robot_commands_min0.006895256764961012
sim_compute_performance-ego_max0.006315846822251834
sim_compute_performance-ego_mean0.006149191883462595
sim_compute_performance-ego_median0.00612577964268516
sim_compute_performance-ego_min0.006029361426228225
sim_compute_sim_state_max0.046124281743580325
sim_compute_sim_state_mean0.0387248445335418
sim_compute_sim_state_median0.03688878143676603
sim_compute_sim_state_min0.03499753351705483
sim_render-ego_max0.01015027896130933
sim_render-ego_mean0.009351105071721391
sim_render-ego_median0.009255869513647172
sim_render-ego_min0.00874240229828189
simulation-passed1
step_physics_max0.1391439258304101
step_physics_mean0.11931343882264273
step_physics_median0.11582250326570838
step_physics_min0.106464822928744
survival_time_max14.950000000000076
survival_time_mean12.33750000000004
survival_time_min9.900000000000006
No reset possible
4405111778Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0949808651072734
survival_time_median14.42500000000007
deviation-center-line_median0.5168009313281787
in-drivable-lane_median2.625000000000022


other stats
agent_compute-ego_max0.02668788035710653
agent_compute-ego_mean0.02512791626092964
agent_compute-ego_median0.02479833913935746
agent_compute-ego_min0.024227106407897114
complete-iteration_max0.3561263688405355
complete-iteration_mean0.3147822927722581
complete-iteration_median0.3075287531394259
complete-iteration_min0.2879452959696452
deviation-center-line_max0.9298453388045028
deviation-center-line_mean0.5458946281711705
deviation-center-line_min0.2201313112238214
deviation-heading_max2.7535383504474784
deviation-heading_mean1.9736545380185648
deviation-heading_median2.053257969039664
deviation-heading_min1.0345638635474528
driven_any_max3.712540989062008
driven_any_mean3.111436787078698
driven_any_median3.27839612598693
driven_any_min2.176413907278924
driven_lanedir_consec_max3.437459606354411
driven_lanedir_consec_mean2.286362342834408
driven_lanedir_consec_min1.5180280347686737
driven_lanedir_max3.437459606354411
driven_lanedir_mean2.286362342834408
driven_lanedir_median2.0949808651072734
driven_lanedir_min1.5180280347686737
get_duckie_state_max2.9579798380533853e-06
get_duckie_state_mean2.8866584485598725e-06
get_duckie_state_median2.875393384123502e-06
get_duckie_state_min2.8378671879391017e-06
get_robot_state_max0.022995766003926596
get_robot_state_mean0.022220830394953775
get_robot_state_median0.02213014657125927
get_robot_state_min0.021627262433369956
get_state_dump_max0.020037445227305096
get_state_dump_mean0.019902600259149767
get_state_dump_median0.019953660888758967
get_state_dump_min0.019665634031776045
get_ui_image_max0.061572166283925374
get_ui_image_mean0.05102291299431644
get_ui_image_median0.04847055223642035
get_ui_image_min0.045578381220499675
in-drivable-lane_max8.750000000000028
in-drivable-lane_mean3.700000000000017
in-drivable-lane_min0.7999999999999972
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.712540989062008, "get_ui_image": 0.061572166283925374, "step_physics": 0.15796790997187296, "survival_time": 14.950000000000076, "driven_lanedir": 3.437459606354411, "get_state_dump": 0.019882968266805013, "sim_render-ego": 0.009988934993743896, "get_robot_state": 0.022995766003926596, "get_duckie_state": 2.884864807128906e-06, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.02668788035710653, "deviation-heading": 2.7535383504474784, "complete-iteration": 0.3561263688405355, "set_robot_commands": 0.008150520324707032, "deviation-center-line": 0.9298453388045028, "driven_lanedir_consec": 3.437459606354411, "sim_compute_sim_state": 0.04208581686019897, "sim_compute_performance-ego": 0.006607280572255452}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.176413907278924, "get_ui_image": 0.0482898183064918, "step_physics": 0.12414449698304476, "survival_time": 7.299999999999982, "driven_lanedir": 1.848875528783843, "get_state_dump": 0.020024353510712925, "sim_render-ego": 0.01022542992683306, "get_robot_state": 0.022562118425761182, "get_duckie_state": 2.865921961118097e-06, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.024227106407897114, "deviation-heading": 1.0345638635474528, "complete-iteration": 0.29853949971394994, "set_robot_commands": 0.007415222795042273, "deviation-center-line": 0.2201313112238214, "driven_lanedir_consec": 1.848875528783843, "sim_compute_sim_state": 0.03497702618167825, "sim_compute_performance-ego": 0.006487928024710041}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.435615093273846, "get_ui_image": 0.045578381220499675, "step_physics": 0.11579567909240723, "survival_time": 14.950000000000076, "driven_lanedir": 1.5180280347686737, "get_state_dump": 0.020037445227305096, "sim_render-ego": 0.009238105614980062, "get_robot_state": 0.021627262433369956, "get_duckie_state": 2.9579798380533853e-06, "in-drivable-lane": 8.750000000000028, "agent_compute-ego": 0.02492602507273356, "deviation-heading": 1.6290369748172018, "complete-iteration": 0.2879452959696452, "set_robot_commands": 0.007258709271748861, "deviation-center-line": 0.4091567855228879, "driven_lanedir_consec": 1.5180280347686737, "sim_compute_sim_state": 0.037126088937123616, "sim_compute_performance-ego": 0.006173794269561768}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1211771587000143, "get_ui_image": 0.0486512861663489, "step_physics": 0.1336899635603102, "survival_time": 13.900000000000064, "driven_lanedir": 2.3410862014307043, "get_state_dump": 0.019665634031776045, "sim_render-ego": 0.009522172186872084, "get_robot_state": 0.021698174716757355, "get_duckie_state": 2.8378671879391017e-06, "in-drivable-lane": 4.1000000000000485, "agent_compute-ego": 0.02467065320598136, "deviation-heading": 2.4774789632621257, "complete-iteration": 0.31651800656490187, "set_robot_commands": 0.007365371683518664, "deviation-center-line": 0.6244450771334696, "driven_lanedir_consec": 2.3410862014307043, "sim_compute_sim_state": 0.04474755585622445, "sim_compute_performance-ego": 0.006320940504828803}}
set_robot_commands_max0.008150520324707032
set_robot_commands_mean0.007547456018754208
set_robot_commands_median0.007390297239280468
set_robot_commands_min0.007258709271748861
sim_compute_performance-ego_max0.006607280572255452
sim_compute_performance-ego_mean0.006397485842839015
sim_compute_performance-ego_median0.006404434264769422
sim_compute_performance-ego_min0.006173794269561768
sim_compute_sim_state_max0.04474755585622445
sim_compute_sim_state_mean0.03973412195880632
sim_compute_sim_state_median0.0396059528986613
sim_compute_sim_state_min0.03497702618167825
sim_render-ego_max0.01022542992683306
sim_render-ego_mean0.009743660680607277
sim_render-ego_median0.00975555359030799
sim_render-ego_min0.009238105614980062
simulation-passed1
step_physics_max0.15796790997187296
step_physics_mean0.13289951240190878
step_physics_median0.12891723027167748
step_physics_min0.11579567909240723
survival_time_max14.950000000000076
survival_time_mean12.77500000000005
survival_time_min7.299999999999982
No reset possible
4402211777Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.534937853863472
survival_time_median14.950000000000076
deviation-center-line_median0.5039415958389999
in-drivable-lane_median2.550000000000024


other stats
agent_compute-ego_max0.02771497329076131
agent_compute-ego_mean0.026643028708926417
agent_compute-ego_median0.02669521024352626
agent_compute-ego_min0.025466721057891845
complete-iteration_max0.37474998474121096
complete-iteration_mean0.332041167428619
complete-iteration_median0.3266948600819236
complete-iteration_min0.3000249648094177
deviation-center-line_max0.8604760084228693
deviation-center-line_mean0.5260771250861077
deviation-center-line_min0.23594930024356148
deviation-heading_max2.831692140917676
deviation-heading_mean2.3429575916553587
deviation-heading_median2.709958877519915
deviation-heading_min1.1202204706639285
driven_any_max3.9333522405721073
driven_any_mean3.365649674146927
driven_any_median3.4767033299533887
driven_any_min2.5758397961088235
driven_lanedir_consec_max3.669687370141253
driven_lanedir_consec_mean2.350585216280445
driven_lanedir_consec_min0.6627777872535813
driven_lanedir_max3.669687370141253
driven_lanedir_mean2.3542874342589477
driven_lanedir_median2.534937853863472
driven_lanedir_min0.6775866591675942
get_duckie_state_max2.880096435546875e-06
get_duckie_state_mean2.7473035611604387e-06
get_duckie_state_median2.7325278834292764e-06
get_duckie_state_min2.644062042236328e-06
get_robot_state_max0.023879029750823975
get_robot_state_mean0.02297804059689505
get_robot_state_median0.023142274220784503
get_robot_state_min0.02174858419518722
get_state_dump_max0.02040666421254476
get_state_dump_mean0.02002710100851561
get_state_dump_median0.01995781143506368
get_state_dump_min0.019786116951390317
get_ui_image_max0.05981609344482422
get_ui_image_mean0.052920007935741496
get_ui_image_median0.05224478926574975
get_ui_image_min0.047374359766642254
in-drivable-lane_max10.900000000000055
in-drivable-lane_mean4.250000000000028
in-drivable-lane_min1.000000000000008
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.713596737393266, "get_ui_image": 0.047374359766642254, "step_physics": 0.1222646204630534, "survival_time": 14.950000000000076, "driven_lanedir": 3.1925082983293636, "get_state_dump": 0.02003551959991455, "sim_render-ego": 0.009408694903055828, "get_robot_state": 0.02309002637863159, "get_duckie_state": 2.808570861816406e-06, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.025466721057891845, "deviation-heading": 2.6119849364964427, "complete-iteration": 0.3000249648094177, "set_robot_commands": 0.007507999738057454, "deviation-center-line": 0.7504017163511805, "driven_lanedir_consec": 3.1925082983293636, "sim_compute_sim_state": 0.03839128812154134, "sim_compute_performance-ego": 0.006308840910593669}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.5758397961088235, "get_ui_image": 0.05132076991231818, "step_physics": 0.13054406642913818, "survival_time": 9.5, "driven_lanedir": 1.877367409397581, "get_state_dump": 0.019786116951390317, "sim_render-ego": 0.009520021237825091, "get_robot_state": 0.02174858419518722, "get_duckie_state": 2.6564849050421463e-06, "in-drivable-lane": 2.800000000000016, "agent_compute-ego": 0.0257279119993511, "deviation-heading": 1.1202204706639285, "complete-iteration": 0.31024983807613976, "set_robot_commands": 0.007731245693407561, "deviation-center-line": 0.23594930024356148, "driven_lanedir_consec": 1.877367409397581, "sim_compute_sim_state": 0.037427089088841486, "sim_compute_performance-ego": 0.006267386988589638}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2398099225135115, "get_ui_image": 0.053168808619181315, "step_physics": 0.15028618892033896, "survival_time": 14.950000000000076, "driven_lanedir": 0.6775866591675942, "get_state_dump": 0.01988010327021281, "sim_render-ego": 0.010326112906138102, "get_robot_state": 0.023879029750823975, "get_duckie_state": 2.880096435546875e-06, "in-drivable-lane": 10.900000000000055, "agent_compute-ego": 0.02771497329076131, "deviation-heading": 2.8079328185433874, "complete-iteration": 0.3431398820877075, "set_robot_commands": 0.008099624315897624, "deviation-center-line": 0.2574814753268194, "driven_lanedir_consec": 0.6627777872535813, "sim_compute_sim_state": 0.042913444836934406, "sim_compute_performance-ego": 0.006688516934712728}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.9333522405721073, "get_ui_image": 0.05981609344482422, "step_physics": 0.1676330558458964, "survival_time": 14.950000000000076, "driven_lanedir": 3.669687370141253, "get_state_dump": 0.02040666421254476, "sim_render-ego": 0.010402747790018716, "get_robot_state": 0.023194522062937414, "get_duckie_state": 2.644062042236328e-06, "in-drivable-lane": 1.000000000000008, "agent_compute-ego": 0.027662508487701416, "deviation-heading": 2.831692140917676, "complete-iteration": 0.37474998474121096, "set_robot_commands": 0.008398760159810384, "deviation-center-line": 0.8604760084228693, "driven_lanedir_consec": 3.669687370141253, "sim_compute_sim_state": 0.05043541351954142, "sim_compute_performance-ego": 0.006617956161499024}}
set_robot_commands_max0.008398760159810384
set_robot_commands_mean0.007934407476793255
set_robot_commands_median0.007915435004652593
set_robot_commands_min0.007507999738057454
sim_compute_performance-ego_max0.006688516934712728
sim_compute_performance-ego_mean0.006470675248848765
sim_compute_performance-ego_median0.006463398536046347
sim_compute_performance-ego_min0.006267386988589638
sim_compute_sim_state_max0.05043541351954142
sim_compute_sim_state_mean0.04229180889171466
sim_compute_sim_state_median0.040652366479237874
sim_compute_sim_state_min0.037427089088841486
sim_render-ego_max0.010402747790018716
sim_render-ego_mean0.009914394209259436
sim_render-ego_median0.009923067071981598
sim_render-ego_min0.009408694903055828
simulation-passed1
step_physics_max0.1676330558458964
step_physics_mean0.14268198291460674
step_physics_median0.14041512767473857
step_physics_min0.1222646204630534
survival_time_max14.950000000000076
survival_time_mean13.58750000000006
survival_time_min9.5
No reset possible
4399411777Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:12:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3451024710846124
survival_time_median14.950000000000076
deviation-center-line_median0.7023898787484462
in-drivable-lane_median1.8250000000000153


other stats
agent_compute-ego_max0.02583715597788493
agent_compute-ego_mean0.025516312321027117
agent_compute-ego_median0.025497533480326337
agent_compute-ego_min0.025233026345570883
complete-iteration_max0.3224698487917582
complete-iteration_mean0.30376766085624696
complete-iteration_median0.3058305589358012
complete-iteration_min0.2809396767616272
deviation-center-line_max0.9419534461318252
deviation-center-line_mean0.6625747017874097
deviation-center-line_min0.30356560352092143
deviation-heading_max3.3106530164135264
deviation-heading_mean2.586584435261184
deviation-heading_median2.9166674762407885
deviation-heading_min1.2023497721496326
driven_any_max3.934203444100545
driven_any_mean3.6028340708158577
driven_any_median3.73692322774526
driven_any_min3.0032863836723656
driven_lanedir_consec_max3.76184578190768
driven_lanedir_consec_mean2.765023606219811
driven_lanedir_consec_min0.6080437008023397
driven_lanedir_max3.76184578190768
driven_lanedir_mean2.765023606219811
driven_lanedir_median3.3451024710846124
driven_lanedir_min0.6080437008023397
get_duckie_state_max4.40835952758789e-06
get_duckie_state_mean4.3038527170817055e-06
get_duckie_state_median4.301865895589193e-06
get_duckie_state_min4.203319549560547e-06
get_robot_state_max0.02372605562210083
get_robot_state_mean0.023392420411109924
get_robot_state_median0.023548256556193033
get_robot_state_min0.0227471129099528
get_state_dump_max0.02020659844080607
get_state_dump_mean0.01983166555563609
get_state_dump_median0.01980736573537191
get_state_dump_min0.019505332310994467
get_ui_image_max0.049749677181243894
get_ui_image_mean0.04831774870554606
get_ui_image_median0.04952469825744629
get_ui_image_min0.04447192112604777
in-drivable-lane_max11.500000000000082
in-drivable-lane_mean3.812500000000029
in-drivable-lane_min0.10000000000000142
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.636288170231309, "get_ui_image": 0.04447192112604777, "step_physics": 0.10788201729456584, "survival_time": 14.950000000000076, "driven_lanedir": 3.2039459483366595, "get_state_dump": 0.019598995844523112, "sim_render-ego": 0.009477203687032063, "get_robot_state": 0.023372582594553628, "get_duckie_state": 4.40835952758789e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.025616398652394613, "deviation-heading": 2.971205317294204, "complete-iteration": 0.2809396767616272, "set_robot_commands": 0.007742541631062826, "deviation-center-line": 0.8534152727565628, "driven_lanedir_consec": 3.2039459483366595, "sim_compute_sim_state": 0.03641083558400472, "sim_compute_performance-ego": 0.006187735398610433}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.837558285259211, "get_ui_image": 0.04965899229049683, "step_physics": 0.12364476998647056, "survival_time": 14.950000000000076, "driven_lanedir": 3.4862589938325654, "get_state_dump": 0.020015735626220704, "sim_render-ego": 0.009796524047851562, "get_robot_state": 0.02372605562210083, "get_duckie_state": 4.203319549560547e-06, "in-drivable-lane": 1.9000000000000057, "agent_compute-ego": 0.025233026345570883, "deviation-heading": 2.8621296351873733, "complete-iteration": 0.3044474490483602, "set_robot_commands": 0.0077605541547139485, "deviation-center-line": 0.5513644847403296, "driven_lanedir_consec": 3.4862589938325654, "sim_compute_sim_state": 0.03814754565556844, "sim_compute_performance-ego": 0.006291683514912923}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0032863836723656, "get_ui_image": 0.04939040422439575, "step_physics": 0.12836166540781657, "survival_time": 14.950000000000076, "driven_lanedir": 0.6080437008023397, "get_state_dump": 0.019505332310994467, "sim_render-ego": 0.009733611742655437, "get_robot_state": 0.0227471129099528, "get_duckie_state": 4.3352444966634115e-06, "in-drivable-lane": 11.500000000000082, "agent_compute-ego": 0.025378668308258055, "deviation-heading": 1.2023497721496326, "complete-iteration": 0.3072136688232422, "set_robot_commands": 0.007648549874623617, "deviation-center-line": 0.30356560352092143, "driven_lanedir_consec": 0.6080437008023397, "sim_compute_sim_state": 0.03798610925674439, "sim_compute_performance-ego": 0.006288364728291829}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.934203444100545, "get_ui_image": 0.049749677181243894, "step_physics": 0.13408560355504354, "survival_time": 14.950000000000076, "driven_lanedir": 3.76184578190768, "get_state_dump": 0.02020659844080607, "sim_render-ego": 0.009702502886454264, "get_robot_state": 0.023723930517832437, "get_duckie_state": 4.268487294514974e-06, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.02583715597788493, "deviation-heading": 3.3106530164135264, "complete-iteration": 0.3224698487917582, "set_robot_commands": 0.007805492877960205, "deviation-center-line": 0.9419534461318252, "driven_lanedir_consec": 3.76184578190768, "sim_compute_sim_state": 0.04485211690266927, "sim_compute_performance-ego": 0.006330631573994955}}
set_robot_commands_max0.007805492877960205
set_robot_commands_mean0.007739284634590149
set_robot_commands_median0.0077515478928883875
set_robot_commands_min0.007648549874623617
sim_compute_performance-ego_max0.006330631573994955
sim_compute_performance-ego_mean0.006274603803952536
sim_compute_performance-ego_median0.006290024121602376
sim_compute_performance-ego_min0.006187735398610433
sim_compute_sim_state_max0.04485211690266927
sim_compute_sim_state_mean0.0393491518497467
sim_compute_sim_state_median0.038066827456156416
sim_compute_sim_state_min0.03641083558400472
sim_render-ego_max0.009796524047851562
sim_render-ego_mean0.00967746059099833
sim_render-ego_median0.00971805731455485
sim_render-ego_min0.009477203687032063
simulation-passed1
step_physics_max0.13408560355504354
step_physics_mean0.12349351406097411
step_physics_median0.12600321769714357
step_physics_min0.10788201729456584
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4398111776Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.693779323097224
survival_time_median14.950000000000076
deviation-center-line_median0.9004417313052215
in-drivable-lane_median3.0249999999999995


other stats
agent_compute-ego_max0.026258474191029862
agent_compute-ego_mean0.02573190879130709
agent_compute-ego_median0.02570804397265116
agent_compute-ego_min0.025253073028896168
complete-iteration_max0.30866820335388184
complete-iteration_mean0.29479264550882833
complete-iteration_median0.2945375159080478
complete-iteration_min0.2814273468653361
deviation-center-line_max1.1731211039790062
deviation-center-line_mean0.8073834153338308
deviation-center-line_min0.25552909474587415
deviation-heading_max2.7440387783745126
deviation-heading_mean1.984487741300376
deviation-heading_median2.389267536993516
deviation-heading_min0.4153771128399595
driven_any_max3.955060135227785
driven_any_mean3.143775521563975
driven_any_median3.1504373317460423
driven_any_min2.31916728753603
driven_lanedir_consec_max3.668976136927145
driven_lanedir_consec_mean2.611699406468997
driven_lanedir_consec_min1.3902628427543955
driven_lanedir_max3.668976136927145
driven_lanedir_mean2.611699406468997
driven_lanedir_median2.693779323097224
driven_lanedir_min1.3902628427543955
get_duckie_state_max2.884070078531901e-06
get_duckie_state_mean2.8080698372661204e-06
get_duckie_state_median2.8057893117268883e-06
get_duckie_state_min2.736630647078804e-06
get_robot_state_max0.023711838722229005
get_robot_state_mean0.023059576067371648
get_robot_state_median0.02303139510362045
get_robot_state_min0.022463675340016684
get_state_dump_max0.02005705237388611
get_state_dump_mean0.01976901024580002
get_state_dump_median0.019762471914291382
get_state_dump_min0.0194940447807312
get_ui_image_max0.04852519353230794
get_ui_image_mean0.04642224891894105
get_ui_image_median0.04608168172663536
get_ui_image_min0.045000438690185544
in-drivable-lane_max4.95000000000007
in-drivable-lane_mean2.750000000000017
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.31916728753603, "get_ui_image": 0.045111494219821434, "step_physics": 0.1103937574054884, "survival_time": 9.199999999999996, "driven_lanedir": 1.3902628427543955, "get_state_dump": 0.02005705237388611, "sim_render-ego": 0.009485261595767475, "get_robot_state": 0.02285756235537322, "get_duckie_state": 2.736630647078804e-06, "in-drivable-lane": 4.500000000000004, "agent_compute-ego": 0.025253073028896168, "deviation-heading": 0.4153771128399595, "complete-iteration": 0.28384996626688086, "set_robot_commands": 0.007746665374092434, "deviation-center-line": 0.25552909474587415, "driven_lanedir_consec": 1.3902628427543955, "sim_compute_sim_state": 0.036729471838992576, "sim_compute_performance-ego": 0.00604129874187967}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.553976241933283, "get_ui_image": 0.045000438690185544, "step_physics": 0.10778738419214884, "survival_time": 14.950000000000076, "driven_lanedir": 3.472158546334124, "get_state_dump": 0.0194940447807312, "sim_render-ego": 0.009708396593729657, "get_robot_state": 0.023711838722229005, "get_duckie_state": 2.884070078531901e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025486753781636555, "deviation-heading": 2.7440387783745126, "complete-iteration": 0.2814273468653361, "set_robot_commands": 0.008091704845428467, "deviation-center-line": 1.1731211039790062, "driven_lanedir_consec": 3.472158546334124, "sim_compute_sim_state": 0.03586637020111084, "sim_compute_performance-ego": 0.0061032772064208984}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.746898421558801, "get_ui_image": 0.04852519353230794, "step_physics": 0.13059425115585327, "survival_time": 14.950000000000076, "driven_lanedir": 1.915400099860324, "get_state_dump": 0.01953812122344971, "sim_render-ego": 0.009597840309143069, "get_robot_state": 0.022463675340016684, "get_duckie_state": 2.8475125630696615e-06, "in-drivable-lane": 4.95000000000007, "agent_compute-ego": 0.026258474191029862, "deviation-heading": 2.55395543253092, "complete-iteration": 0.30866820335388184, "set_robot_commands": 0.007587027549743652, "deviation-center-line": 0.9762900221859904, "driven_lanedir_consec": 1.915400099860324, "sim_compute_sim_state": 0.03774222056070964, "sim_compute_performance-ego": 0.006186480522155762}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.955060135227785, "get_ui_image": 0.0470518692334493, "step_physics": 0.12201717615127564, "survival_time": 14.950000000000076, "driven_lanedir": 3.668976136927145, "get_state_dump": 0.019986822605133056, "sim_render-ego": 0.009498035113016765, "get_robot_state": 0.023205227851867676, "get_duckie_state": 2.7640660603841147e-06, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.02592933416366577, "deviation-heading": 2.224579641456112, "complete-iteration": 0.3052250655492147, "set_robot_commands": 0.007738486925760905, "deviation-center-line": 0.8245934404244526, "driven_lanedir_consec": 3.668976136927145, "sim_compute_sim_state": 0.043433248202006024, "sim_compute_performance-ego": 0.006186784903208415}}
set_robot_commands_max0.008091704845428467
set_robot_commands_mean0.007790971173756364
set_robot_commands_median0.007742576149926669
set_robot_commands_min0.007587027549743652
sim_compute_performance-ego_max0.006186784903208415
sim_compute_performance-ego_mean0.006129460343416186
sim_compute_performance-ego_median0.00614487886428833
sim_compute_performance-ego_min0.00604129874187967
sim_compute_sim_state_max0.043433248202006024
sim_compute_sim_state_mean0.03844282770070477
sim_compute_sim_state_median0.03723584619985111
sim_compute_sim_state_min0.03586637020111084
sim_render-ego_max0.009708396593729657
sim_render-ego_mean0.00957238340291424
sim_render-ego_median0.009547937711079917
sim_render-ego_min0.009485261595767475
simulation-passed1
step_physics_max0.13059425115585327
step_physics_mean0.11769814222619154
step_physics_median0.116205466778382
step_physics_min0.10778738419214884
survival_time_max14.950000000000076
survival_time_mean13.512500000000056
survival_time_min9.199999999999996
No reset possible
4392811772Ehsan Ahmadi πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simabortednoafdaniele15-b9b1aef9b8fb-10:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4389711771Dishank Bansal πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.012593558876298
survival_time_median14.950000000000076
deviation-center-line_median0.7458285566036089
in-drivable-lane_median3.100000000000039


other stats
agent_compute-ego_max0.02582317034403483
agent_compute-ego_mean0.02524427970250448
agent_compute-ego_median0.025216052532196047
agent_compute-ego_min0.024721843401590983
complete-iteration_max0.2888999128341675
complete-iteration_mean0.268554847240448
complete-iteration_median0.26254202365875245
complete-iteration_min0.26023542881011963
deviation-center-line_max0.889291031548405
deviation-center-line_mean0.6742128187806647
deviation-center-line_min0.31590313036703593
deviation-heading_max4.78458537866252
deviation-heading_mean3.5885153396216065
deviation-heading_median4.089207897733887
deviation-heading_min1.3910601843561323
driven_any_max4.894188597887835
driven_any_mean4.512815439065462
driven_any_median4.549101817573181
driven_any_min4.058869523227651
driven_lanedir_consec_max4.014023251239281
driven_lanedir_consec_mean3.0601729572340797
driven_lanedir_consec_min2.2014814599444414
driven_lanedir_max4.014023251239281
driven_lanedir_mean3.0601729572340797
driven_lanedir_median3.012593558876298
driven_lanedir_min2.2014814599444414
get_duckie_state_max2.929369608561198e-06
get_duckie_state_mean2.899169921875e-06
get_duckie_state_median2.8995672861735023e-06
get_duckie_state_min2.8681755065917967e-06
get_robot_state_max0.022898614406585693
get_robot_state_mean0.019965239564577734
get_robot_state_median0.01903519868850708
get_robot_state_min0.0188919464747111
get_state_dump_max0.01961860418319702
get_state_dump_mean0.019240566094716388
get_state_dump_median0.0191996423403422
get_state_dump_min0.01894437551498413
get_ui_image_max0.043989261786142986
get_ui_image_mean0.04231572508811951
get_ui_image_median0.04192952275276184
get_ui_image_min0.04141459306081136
in-drivable-lane_max8.300000000000093
in-drivable-lane_mean4.100000000000044
in-drivable-lane_min1.900000000000004
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.631546066380756, "get_ui_image": 0.0421489683787028, "step_physics": 0.10134416103363036, "survival_time": 14.950000000000076, "driven_lanedir": 4.014023251239281, "get_state_dump": 0.019229934215545655, "sim_render-ego": 0.008290987014770507, "get_robot_state": 0.018990346590677897, "get_duckie_state": 2.9166539510091144e-06, "in-drivable-lane": 1.900000000000004, "agent_compute-ego": 0.024721843401590983, "deviation-heading": 4.052187612946977, "complete-iteration": 0.26154730637868245, "set_robot_commands": 0.006431073347727458, "deviation-center-line": 0.7077628423539093, "driven_lanedir_consec": 4.014023251239281, "sim_compute_sim_state": 0.03438184340794881, "sim_compute_performance-ego": 0.005827550093332926}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.466657568765605, "get_ui_image": 0.041710077126820885, "step_physics": 0.1005820878346761, "survival_time": 14.950000000000076, "driven_lanedir": 3.4938893283100825, "get_state_dump": 0.019169350465138752, "sim_render-ego": 0.008272798061370849, "get_robot_state": 0.019080050786336265, "get_duckie_state": 2.929369608561198e-06, "in-drivable-lane": 2.450000000000034, "agent_compute-ego": 0.02524810155232747, "deviation-heading": 4.126228182520798, "complete-iteration": 0.26023542881011963, "set_robot_commands": 0.006578420003255208, "deviation-center-line": 0.889291031548405, "driven_lanedir_consec": 3.4938893283100825, "sim_compute_sim_state": 0.03352805534998576, "sim_compute_performance-ego": 0.005883353551228841}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.058869523227651, "get_ui_image": 0.04141459306081136, "step_physics": 0.10314461549123129, "survival_time": 14.950000000000076, "driven_lanedir": 2.5312977894425135, "get_state_dump": 0.01894437551498413, "sim_render-ego": 0.008475724856058757, "get_robot_state": 0.0188919464747111, "get_duckie_state": 2.8824806213378906e-06, "in-drivable-lane": 3.750000000000045, "agent_compute-ego": 0.025184003512064616, "deviation-heading": 4.78458537866252, "complete-iteration": 0.26353674093882246, "set_robot_commands": 0.006963044007619222, "deviation-center-line": 0.7838942708533087, "driven_lanedir_consec": 2.5312977894425135, "sim_compute_sim_state": 0.03445791085561117, "sim_compute_performance-ego": 0.005877405007680257}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.894188597887835, "get_ui_image": 0.043989261786142986, "step_physics": 0.11203985532124836, "survival_time": 14.950000000000076, "driven_lanedir": 2.2014814599444414, "get_state_dump": 0.01961860418319702, "sim_render-ego": 0.009369425773620606, "get_robot_state": 0.022898614406585693, "get_duckie_state": 2.8681755065917967e-06, "in-drivable-lane": 8.300000000000093, "agent_compute-ego": 0.02582317034403483, "deviation-heading": 1.3910601843561323, "complete-iteration": 0.2888999128341675, "set_robot_commands": 0.007710897922515869, "deviation-center-line": 0.31590313036703593, "driven_lanedir_consec": 2.2014814599444414, "sim_compute_sim_state": 0.0411800742149353, "sim_compute_performance-ego": 0.006091781457265218}}
set_robot_commands_max0.007710897922515869
set_robot_commands_mean0.00692085882027944
set_robot_commands_median0.006770732005437215
set_robot_commands_min0.006431073347727458
sim_compute_performance-ego_max0.006091781457265218
sim_compute_performance-ego_mean0.005920022527376811
sim_compute_performance-ego_median0.00588037927945455
sim_compute_performance-ego_min0.005827550093332926
sim_compute_sim_state_max0.0411800742149353
sim_compute_sim_state_mean0.03588697095712026
sim_compute_sim_state_median0.03441987713177999
sim_compute_sim_state_min0.03352805534998576
sim_render-ego_max0.009369425773620606
sim_render-ego_mean0.008602233926455179
sim_render-ego_median0.008383355935414633
sim_render-ego_min0.008272798061370849
simulation-passed1
step_physics_max0.11203985532124836
step_physics_mean0.10427767992019651
step_physics_median0.10224438826243082
step_physics_min0.1005820878346761
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4388111770Dishank Bansal πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.9353478017384687
survival_time_median14.950000000000076
deviation-center-line_median0.7685602456020099
in-drivable-lane_median0.70000000000001


other stats
agent_compute-ego_max0.025882096126161772
agent_compute-ego_mean0.025365797637522905
agent_compute-ego_median0.0254409130414327
agent_compute-ego_min0.024699268341064454
complete-iteration_max0.3192883491516113
complete-iteration_mean0.28255865196386976
complete-iteration_median0.27512475768725075
complete-iteration_min0.26069674332936604
deviation-center-line_max0.9051227157841786
deviation-center-line_mean0.6823424741412206
deviation-center-line_min0.28712668957668397
deviation-heading_max3.3055720894613225
deviation-heading_mean2.4354643213908083
deviation-heading_median2.743347620090431
deviation-heading_min0.9495899559210482
driven_any_max4.956817710857831
driven_any_mean4.030907123471969
driven_any_median4.1647626692442214
driven_any_min2.837285444541599
driven_lanedir_consec_max4.834299649160166
driven_lanedir_consec_mean3.772002666396717
driven_lanedir_consec_min2.383015412949762
driven_lanedir_max4.834299649160166
driven_lanedir_mean3.772002666396717
driven_lanedir_median3.9353478017384687
driven_lanedir_min2.383015412949762
get_duckie_state_max3.017584482828776e-06
get_duckie_state_mean2.876917521158854e-06
get_duckie_state_median2.8475125630696615e-06
get_duckie_state_min2.7950604756673176e-06
get_robot_state_max0.02181331207012308
get_robot_state_mean0.020468691114721625
get_robot_state_median0.02038059194882711
get_robot_state_min0.01930026849110921
get_state_dump_max0.019810636043548584
get_state_dump_mean0.01947947828249
get_state_dump_median0.01948516782672926
get_state_dump_min0.01913694143295288
get_ui_image_max0.04803707188573377
get_ui_image_mean0.044268266524391614
get_ui_image_median0.04350989063580831
get_ui_image_min0.04201621294021606
in-drivable-lane_max1.5999999999999943
in-drivable-lane_mean0.7500000000000036
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.956817710857831, "get_ui_image": 0.04201621294021606, "step_physics": 0.10032782713572184, "survival_time": 14.950000000000076, "driven_lanedir": 4.834299649160166, "get_state_dump": 0.01913694143295288, "sim_render-ego": 0.008240825335184733, "get_robot_state": 0.01930026849110921, "get_duckie_state": 3.017584482828776e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024699268341064454, "deviation-heading": 2.84085723895945, "complete-iteration": 0.26069674332936604, "set_robot_commands": 0.006560369332631429, "deviation-center-line": 0.9051227157841786, "driven_lanedir_consec": 4.834299649160166, "sim_compute_sim_state": 0.03437940279642741, "sim_compute_performance-ego": 0.005851794878641764}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.518323045779868, "get_ui_image": 0.04301804145177206, "step_physics": 0.10252331733703614, "survival_time": 14.950000000000076, "driven_lanedir": 4.390073347968594, "get_state_dump": 0.019226930936177573, "sim_render-ego": 0.008820373217264811, "get_robot_state": 0.020922113259633383, "get_duckie_state": 2.8816858927408853e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025659106572469077, "deviation-heading": 3.3055720894613225, "complete-iteration": 0.2684887893994649, "set_robot_commands": 0.00734731117884318, "deviation-center-line": 0.6958062894846946, "driven_lanedir_consec": 4.390073347968594, "sim_compute_sim_state": 0.03480230569839478, "sim_compute_performance-ego": 0.0059886749585469565}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.811202292708575, "get_ui_image": 0.044001739819844565, "step_physics": 0.1133411161104838, "survival_time": 14.950000000000076, "driven_lanedir": 3.4806222555083433, "get_state_dump": 0.019810636043548584, "sim_render-ego": 0.008964908123016358, "get_robot_state": 0.01983907063802083, "get_duckie_state": 2.7950604756673176e-06, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.02522271951039632, "deviation-heading": 2.645838001221412, "complete-iteration": 0.2817607259750366, "set_robot_commands": 0.0074199406305948895, "deviation-center-line": 0.8413142017193251, "driven_lanedir_consec": 3.4806222555083433, "sim_compute_sim_state": 0.03675387700398763, "sim_compute_performance-ego": 0.006230013370513916}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.837285444541599, "get_ui_image": 0.04803707188573377, "step_physics": 0.13688183981796792, "survival_time": 7.249999999999982, "driven_lanedir": 2.383015412949762, "get_state_dump": 0.019743404717280946, "sim_render-ego": 0.009553769539142476, "get_robot_state": 0.02181331207012308, "get_duckie_state": 2.8133392333984377e-06, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.025882096126161772, "deviation-heading": 0.9495899559210482, "complete-iteration": 0.3192883491516113, "set_robot_commands": 0.007583039382408405, "deviation-center-line": 0.28712668957668397, "driven_lanedir_consec": 2.383015412949762, "sim_compute_sim_state": 0.04335948187729408, "sim_compute_performance-ego": 0.006259929722753064}}
set_robot_commands_max0.007583039382408405
set_robot_commands_mean0.007227665131119476
set_robot_commands_median0.007383625904719035
set_robot_commands_min0.006560369332631429
sim_compute_performance-ego_max0.006259929722753064
sim_compute_performance-ego_mean0.006082603232613925
sim_compute_performance-ego_median0.006109344164530436
sim_compute_performance-ego_min0.005851794878641764
sim_compute_sim_state_max0.04335948187729408
sim_compute_sim_state_mean0.037323766844025975
sim_compute_sim_state_median0.0357780913511912
sim_compute_sim_state_min0.03437940279642741
sim_render-ego_max0.009553769539142476
sim_render-ego_mean0.008894969053652096
sim_render-ego_median0.008892640670140586
sim_render-ego_min0.008240825335184733
simulation-passed1
step_physics_max0.13688183981796792
step_physics_mean0.11326852510030244
step_physics_median0.10793221672375997
step_physics_min0.10032782713572184
survival_time_max14.950000000000076
survival_time_mean13.025000000000055
survival_time_min7.249999999999982
No reset possible
4385211761Ayman Shams πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:04:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 218 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4384411759Ayman Shams πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7910206304739127
survival_time_median13.100000000000051
deviation-center-line_median0.3563060891541488
in-drivable-lane_median2.700000000000019


other stats
agent_compute-ego_max0.02574605941772461
agent_compute-ego_mean0.025397583911052117
agent_compute-ego_median0.02535879373550415
agent_compute-ego_min0.02512668875547556
complete-iteration_max0.27345543066660566
complete-iteration_mean0.26161800753611786
complete-iteration_median0.25918205539385475
complete-iteration_min0.2546524886901562
deviation-center-line_max0.7218735843005575
deviation-center-line_mean0.4028315086061751
deviation-center-line_min0.17684027181584527
deviation-heading_max1.136549792480973
deviation-heading_mean0.9712006063103142
deviation-heading_median0.967812175861682
deviation-heading_min0.8126282810369196
driven_any_max1.9399996348261297
driven_any_mean1.4919667305801314
driven_any_median1.6912084493259547
driven_any_min0.6454503888424866
driven_lanedir_consec_max1.9186849132848784
driven_lanedir_consec_mean0.9784847897486044
driven_lanedir_consec_min0.4132129847617136
driven_lanedir_max1.9186849132848784
driven_lanedir_mean0.9784847897486044
driven_lanedir_median0.7910206304739127
driven_lanedir_min0.4132129847617136
get_duckie_state_max3.1799740261501735e-06
get_duckie_state_mean3.1303264137007236e-06
get_duckie_state_median3.126110786046737e-06
get_duckie_state_min3.089110056559245e-06
get_robot_state_max0.01905525647676908
get_robot_state_mean0.01900412040388482
get_robot_state_median0.01900258872244093
get_robot_state_min0.018956047693888343
get_state_dump_max0.01932563887702094
get_state_dump_mean0.0191474334602682
get_state_dump_median0.01914826075236003
get_state_dump_min0.018967573459331807
get_ui_image_max0.04219802067830013
get_ui_image_mean0.04190579402650524
get_ui_image_median0.04186603864034017
get_ui_image_min0.04169307814704047
in-drivable-lane_max9.500000000000089
in-drivable-lane_mean3.725000000000032
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4424172638257804, "get_ui_image": 0.04169307814704047, "step_physics": 0.09959498193528916, "survival_time": 11.250000000000025, "driven_lanedir": 0.9389695775069216, "get_state_dump": 0.01932563887702094, "sim_render-ego": 0.008261069191826714, "get_robot_state": 0.01900721655951606, "get_duckie_state": 3.1799740261501735e-06, "in-drivable-lane": 3.750000000000043, "agent_compute-ego": 0.025246321360270184, "deviation-heading": 0.8126282810369196, "complete-iteration": 0.2587443097432454, "set_robot_commands": 0.006909743414984809, "deviation-center-line": 0.7218735843005575, "driven_lanedir_consec": 0.9389695775069216, "sim_compute_sim_state": 0.03254283269246419, "sim_compute_performance-ego": 0.005978841781616211}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6454503888424866, "get_ui_image": 0.04219802067830013, "step_physics": 0.09831242148692793, "survival_time": 5.1999999999999895, "driven_lanedir": 0.4132129847617136, "get_state_dump": 0.018967573459331807, "sim_render-ego": 0.008260128589776846, "get_robot_state": 0.01905525647676908, "get_duckie_state": 3.097149041982798e-06, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.02512668875547556, "deviation-heading": 0.8842443267371751, "complete-iteration": 0.2546524886901562, "set_robot_commands": 0.006710034150343675, "deviation-center-line": 0.3181776078572893, "driven_lanedir_consec": 0.4132129847617136, "sim_compute_sim_state": 0.02998960935152494, "sim_compute_performance-ego": 0.005852596117899968}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9399996348261297, "get_ui_image": 0.041969260374705, "step_physics": 0.10120290279388428, "survival_time": 14.950000000000076, "driven_lanedir": 0.6430716834409038, "get_state_dump": 0.019233371416727704, "sim_render-ego": 0.008199694156646729, "get_robot_state": 0.018997960885365803, "get_duckie_state": 3.155072530110677e-06, "in-drivable-lane": 9.500000000000089, "agent_compute-ego": 0.02574605941772461, "deviation-heading": 1.0513800249861889, "complete-iteration": 0.25961980104446414, "set_robot_commands": 0.006767600377400716, "deviation-center-line": 0.17684027181584527, "driven_lanedir_consec": 0.6430716834409038, "sim_compute_sim_state": 0.031396634578704834, "sim_compute_performance-ego": 0.005923859278361003}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399996348261288, "get_ui_image": 0.041762816905975345, "step_physics": 0.11005500713984172, "survival_time": 14.950000000000076, "driven_lanedir": 1.9186849132848784, "get_state_dump": 0.01906315008799235, "sim_render-ego": 0.008306932449340821, "get_robot_state": 0.018956047693888343, "get_duckie_state": 3.089110056559245e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02547126611073812, "deviation-heading": 1.136549792480973, "complete-iteration": 0.27345543066660566, "set_robot_commands": 0.00660488764444987, "deviation-center-line": 0.3944345704510082, "driven_lanedir_consec": 1.9186849132848784, "sim_compute_sim_state": 0.03720040877660115, "sim_compute_performance-ego": 0.005852415561676026}}
set_robot_commands_max0.006909743414984809
set_robot_commands_mean0.006748066396794768
set_robot_commands_median0.006738817263872196
set_robot_commands_min0.00660488764444987
sim_compute_performance-ego_max0.005978841781616211
sim_compute_performance-ego_mean0.005901928184888302
sim_compute_performance-ego_median0.005888227698130485
sim_compute_performance-ego_min0.005852415561676026
sim_compute_sim_state_max0.03720040877660115
sim_compute_sim_state_mean0.032782371349823786
sim_compute_sim_state_median0.031969733635584516
sim_compute_sim_state_min0.02998960935152494
sim_render-ego_max0.008306932449340821
sim_render-ego_mean0.008256956096897777
sim_render-ego_median0.00826059889080178
sim_render-ego_min0.008199694156646729
simulation-passed1
step_physics_max0.11005500713984172
step_physics_mean0.10229132833898576
step_physics_median0.10039894236458673
step_physics_min0.09831242148692793
survival_time_max14.950000000000076
survival_time_mean11.58750000000004
survival_time_min5.1999999999999895
No reset possible
4384311758Ayman Shams πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:09:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7910198591033284
survival_time_median13.100000000000051
deviation-center-line_median0.3563495327788391
in-drivable-lane_median2.700000000000019


other stats
agent_compute-ego_max0.0826175610224406
agent_compute-ego_mean0.06769296489464931
agent_compute-ego_median0.06988895659263317
agent_compute-ego_min0.0483763853708903
complete-iteration_max0.3279176346460978
complete-iteration_mean0.302699738962528
complete-iteration_median0.30030110244567576
complete-iteration_min0.2822791163126628
deviation-center-line_max0.7218813793379725
deviation-center-line_mean0.4028548253134531
deviation-center-line_min0.17683885635816174
deviation-heading_max1.136456556669024
deviation-heading_mean0.9713029858291846
deviation-heading_median0.9680552615119368
deviation-heading_min0.812644863623841
driven_any_max1.9399996330380092
driven_any_mean1.491966729081306
driven_any_median1.6912084474456837
driven_any_min0.6454503883958473
driven_lanedir_consec_max1.9186847490066188
driven_lanedir_consec_mean0.9784806586975732
driven_lanedir_consec_min0.4131981675770175
driven_lanedir_max1.9186847490066188
driven_lanedir_mean0.9784806586975732
driven_lanedir_median0.7910198591033284
driven_lanedir_min0.4131981675770175
get_duckie_state_max3.0994415283203125e-06
get_duckie_state_mean3.004272778828939e-06
get_duckie_state_median2.996524175008138e-06
get_duckie_state_min2.924601236979167e-06
get_robot_state_max0.019413216114044188
get_robot_state_mean0.019191539835216653
get_robot_state_median0.01913850082291497
get_robot_state_min0.01907594158099248
get_state_dump_max0.01934512668185764
get_state_dump_mean0.019187364435603475
get_state_dump_median0.019152086820357885
get_state_dump_min0.019100157419840495
get_ui_image_max0.04234992311551021
get_ui_image_mean0.0422132238236248
get_ui_image_median0.04227807627783882
get_ui_image_min0.04194681962331136
in-drivable-lane_max9.500000000000089
in-drivable-lane_mean3.725000000000032
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4424172618533695, "get_ui_image": 0.042248626285129126, "step_physics": 0.09977751943800184, "survival_time": 11.250000000000025, "driven_lanedir": 0.9389674539410052, "get_state_dump": 0.01934512668185764, "sim_render-ego": 0.008212095896402994, "get_robot_state": 0.019083631303575304, "get_duckie_state": 3.0994415283203125e-06, "in-drivable-lane": 3.750000000000043, "agent_compute-ego": 0.0483763853708903, "deviation-heading": 0.812644863623841, "complete-iteration": 0.2822791163126628, "set_robot_commands": 0.006717777252197266, "deviation-center-line": 0.7218813793379725, "driven_lanedir_consec": 0.9389674539410052, "sim_compute_sim_state": 0.03245128631591797, "sim_compute_performance-ego": 0.005885788599650065}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6454503883958473, "get_ui_image": 0.04234992311551021, "step_physics": 0.09760131744238046, "survival_time": 5.1999999999999895, "driven_lanedir": 0.4131981675770175, "get_state_dump": 0.019107130857614372, "sim_render-ego": 0.008093214952028714, "get_robot_state": 0.01907594158099248, "get_duckie_state": 3.039836883544922e-06, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.07488608131041893, "deviation-heading": 0.8847340546717286, "complete-iteration": 0.3037435389482058, "set_robot_commands": 0.00697053625033452, "deviation-center-line": 0.3183349243700995, "driven_lanedir_consec": 0.4131981675770175, "sim_compute_sim_state": 0.029686377598689154, "sim_compute_performance-ego": 0.005790533927770762}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9399996330380092, "get_ui_image": 0.042307526270548505, "step_physics": 0.09904889027277627, "survival_time": 14.950000000000076, "driven_lanedir": 0.6430722642656514, "get_state_dump": 0.019100157419840495, "sim_render-ego": 0.008148933251698812, "get_robot_state": 0.01919337034225464, "get_duckie_state": 2.924601236979167e-06, "in-drivable-lane": 9.500000000000089, "agent_compute-ego": 0.06489183187484741, "deviation-heading": 1.0513764683521452, "complete-iteration": 0.29685866594314575, "set_robot_commands": 0.007181344827016194, "deviation-center-line": 0.17683885635816174, "driven_lanedir_consec": 0.6430722642656514, "sim_compute_sim_state": 0.030983861287434897, "sim_compute_performance-ego": 0.005820783774058024}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939999633037998, "get_ui_image": 0.04194681962331136, "step_physics": 0.1076922090848287, "survival_time": 14.950000000000076, "driven_lanedir": 1.9186847490066188, "get_state_dump": 0.0191970427831014, "sim_render-ego": 0.008151756127675375, "get_robot_state": 0.019413216114044188, "get_duckie_state": 2.953211466471354e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0826175610224406, "deviation-heading": 1.136456556669024, "complete-iteration": 0.3279176346460978, "set_robot_commands": 0.006754536628723145, "deviation-center-line": 0.3943641411875786, "driven_lanedir_consec": 1.9186847490066188, "sim_compute_sim_state": 0.036189130942026776, "sim_compute_performance-ego": 0.005776368776957194}}
set_robot_commands_max0.007181344827016194
set_robot_commands_mean0.006906048739567781
set_robot_commands_median0.006862536439528832
set_robot_commands_min0.006717777252197266
sim_compute_performance-ego_max0.005885788599650065
sim_compute_performance-ego_mean0.005818368769609011
sim_compute_performance-ego_median0.005805658850914393
sim_compute_performance-ego_min0.005776368776957194
sim_compute_sim_state_max0.036189130942026776
sim_compute_sim_state_mean0.032327664036017195
sim_compute_sim_state_median0.03171757380167643
sim_compute_sim_state_min0.029686377598689154
sim_render-ego_max0.008212095896402994
sim_render-ego_mean0.008151500056951474
sim_render-ego_median0.008150344689687092
sim_render-ego_min0.008093214952028714
simulation-passed1
step_physics_max0.1076922090848287
step_physics_mean0.1010299840594968
step_physics_median0.09941320485538908
step_physics_min0.09760131744238046
survival_time_max14.950000000000076
survival_time_mean11.58750000000004
survival_time_min5.1999999999999895
No reset possible
4383811757Ayman Shams πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:06:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 438 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4383711756Ayman Shams πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:04:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 144 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4383411754Γ‰tienne Boucher πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.388024881983519
survival_time_median14.950000000000076
deviation-center-line_median0.6724638150659913
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.024714662233988445
agent_compute-ego_mean0.024605097341068263
agent_compute-ego_median0.02462940090403493
agent_compute-ego_min0.024446925322214763
complete-iteration_max0.29972789287567136
complete-iteration_mean0.2880730856975213
complete-iteration_median0.2859379967053731
complete-iteration_min0.2806884565036675
deviation-center-line_max0.7334148337599173
deviation-center-line_mean0.6075339038888377
deviation-center-line_min0.35179315166345054
deviation-heading_max3.116582706589755
deviation-heading_mean2.5329851389053184
deviation-heading_median2.6804337982092505
deviation-heading_min1.6544902526130183
driven_any_max2.464717171935547
driven_any_mean2.4075232879089974
driven_any_median2.4515790240637285
driven_any_min2.2622179315729847
driven_lanedir_consec_max2.4084984303583945
driven_lanedir_consec_mean2.11890143434149
driven_lanedir_consec_min1.2910575430405282
driven_lanedir_max2.4084984303583945
driven_lanedir_mean2.11890143434149
driven_lanedir_median2.388024881983519
driven_lanedir_min1.2910575430405282
get_duckie_state_max3.052813540525542e-06
get_duckie_state_mean2.9997683392532934e-06
get_duckie_state_median3.007650375366211e-06
get_duckie_state_min2.9309590657552083e-06
get_robot_state_max0.023887001673380533
get_robot_state_mean0.023081085880597433
get_robot_state_median0.023286463816960652
get_robot_state_min0.02186441421508789
get_state_dump_max0.02001444352069024
get_state_dump_mean0.01972123824655643
get_state_dump_median0.019643290837605795
get_state_dump_min0.019583927790323898
get_ui_image_max0.04576985994974772
get_ui_image_mean0.044971372177973305
get_ui_image_median0.04509200153902155
get_ui_image_min0.043931625684102374
in-drivable-lane_max5.350000000000076
in-drivable-lane_mean1.337500000000019
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2622179315729847, "get_ui_image": 0.04509789741347197, "step_physics": 0.11037562782034224, "survival_time": 13.550000000000058, "driven_lanedir": 1.2910575430405282, "get_state_dump": 0.02001444352069024, "sim_render-ego": 0.009239411442042276, "get_robot_state": 0.02186441421508789, "get_duckie_state": 3.052813540525542e-06, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.024592768222203555, "deviation-heading": 1.6544902526130183, "complete-iteration": 0.2806884565036675, "set_robot_commands": 0.00739944025159322, "deviation-center-line": 0.35179315166345054, "driven_lanedir_consec": 1.2910575430405282, "sim_compute_sim_state": 0.035789384173291194, "sim_compute_performance-ego": 0.006139395421721399}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.464717171935547, "get_ui_image": 0.04576985994974772, "step_physics": 0.11275600592295328, "survival_time": 14.950000000000076, "driven_lanedir": 2.4077729056864516, "get_state_dump": 0.019583927790323898, "sim_render-ego": 0.00978433847427368, "get_robot_state": 0.02315406878789266, "get_duckie_state": 3.01361083984375e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024714662233988445, "deviation-heading": 2.8272577531060996, "complete-iteration": 0.2853822461764018, "set_robot_commands": 0.007976338068644206, "deviation-center-line": 0.6853164536747346, "driven_lanedir_consec": 2.4077729056864516, "sim_compute_sim_state": 0.035259471734364826, "sim_compute_performance-ego": 0.006205617586771647}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.443524252767684, "get_ui_image": 0.043931625684102374, "step_physics": 0.1137427830696106, "survival_time": 14.950000000000076, "driven_lanedir": 2.368276858280586, "get_state_dump": 0.01958669662475586, "sim_render-ego": 0.009865784645080566, "get_robot_state": 0.023887001673380533, "get_duckie_state": 2.9309590657552083e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024666033585866293, "deviation-heading": 3.116582706589755, "complete-iteration": 0.2864937472343445, "set_robot_commands": 0.00791711409886678, "deviation-center-line": 0.659611176457248, "driven_lanedir_consec": 2.368276858280586, "sim_compute_sim_state": 0.036636516253153485, "sim_compute_performance-ego": 0.006081588268280029}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4596337953597733, "get_ui_image": 0.04508610566457113, "step_physics": 0.12169801394144694, "survival_time": 14.950000000000076, "driven_lanedir": 2.4084984303583945, "get_state_dump": 0.01969988505045573, "sim_render-ego": 0.009809636274973553, "get_robot_state": 0.023418858846028647, "get_duckie_state": 3.001689910888672e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024446925322214763, "deviation-heading": 2.533609843312401, "complete-iteration": 0.29972789287567136, "set_robot_commands": 0.007809051672617594, "deviation-center-line": 0.7334148337599173, "driven_lanedir_consec": 2.4084984303583945, "sim_compute_sim_state": 0.04137076377868652, "sim_compute_performance-ego": 0.0062102460861206054}}
set_robot_commands_max0.007976338068644206
set_robot_commands_mean0.00777548602293045
set_robot_commands_median0.007863082885742188
set_robot_commands_min0.00739944025159322
sim_compute_performance-ego_max0.0062102460861206054
sim_compute_performance-ego_mean0.00615921184072342
sim_compute_performance-ego_median0.0061725065042465225
sim_compute_performance-ego_min0.006081588268280029
sim_compute_sim_state_max0.04137076377868652
sim_compute_sim_state_mean0.037264033984874
sim_compute_sim_state_median0.036212950213222336
sim_compute_sim_state_min0.035259471734364826
sim_render-ego_max0.009865784645080566
sim_render-ego_mean0.00967479270909252
sim_render-ego_median0.009796987374623615
sim_render-ego_min0.009239411442042276
simulation-passed1
step_physics_max0.12169801394144694
step_physics_mean0.11464310768858826
step_physics_median0.11324939449628194
step_physics_min0.11037562782034224
survival_time_max14.950000000000076
survival_time_mean14.600000000000072
survival_time_min13.550000000000058
No reset possible
4382311752Olga (Ge Ya) Xu πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9666054496782723
survival_time_median14.950000000000076
deviation-center-line_median0.6634299537905188
in-drivable-lane_median6.175000000000056


other stats
agent_compute-ego_max0.026101115544637045
agent_compute-ego_mean0.02547258257865906
agent_compute-ego_median0.025322635173797608
agent_compute-ego_min0.02514394442240397
complete-iteration_max0.2805575211842855
complete-iteration_mean0.266872727672259
complete-iteration_median0.2628933862845103
complete-iteration_min0.26114661693573
deviation-center-line_max0.785479663342092
deviation-center-line_mean0.6621296892621379
deviation-center-line_min0.5361791861254221
deviation-heading_max2.833474514486437
deviation-heading_mean2.2992088827795256
deviation-heading_median2.25996919232149
deviation-heading_min1.8434226319886833
driven_any_max4.002090516984669
driven_any_mean3.6637218202085897
driven_any_median3.560131985818475
driven_any_min3.5325327922127405
driven_lanedir_consec_max2.6134713621470462
driven_lanedir_consec_mean1.9690089820674397
driven_lanedir_consec_min1.3293536667661685
driven_lanedir_max2.6134713621470462
driven_lanedir_mean1.9690089820674397
driven_lanedir_median1.9666054496782723
driven_lanedir_min1.3293536667661685
get_duckie_state_max3.0382474263509116e-06
get_duckie_state_mean2.991954485575358e-06
get_duckie_state_median2.9969215393066407e-06
get_duckie_state_min2.9357274373372394e-06
get_robot_state_max0.023221894900004068
get_robot_state_mean0.02013912002245585
get_robot_state_median0.019135514895121258
get_robot_state_min0.019063555399576822
get_state_dump_max0.01935384511947632
get_state_dump_mean0.01920268138249715
get_state_dump_median0.019202781518300377
get_state_dump_min0.01905131737391154
get_ui_image_max0.04300581375757853
get_ui_image_mean0.042314326763153075
get_ui_image_median0.04221031188964844
get_ui_image_min0.0418308695157369
in-drivable-lane_max8.800000000000056
in-drivable-lane_mean6.6125000000000576
in-drivable-lane_min5.30000000000006
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5861341542422704, "get_ui_image": 0.04223762989044189, "step_physics": 0.10224747816721598, "survival_time": 14.950000000000076, "driven_lanedir": 2.1998934938071315, "get_state_dump": 0.019155224959055583, "sim_render-ego": 0.008203688462575277, "get_robot_state": 0.019063555399576822, "get_duckie_state": 2.991358439127604e-06, "in-drivable-lane": 5.30000000000006, "agent_compute-ego": 0.025225863456726075, "deviation-heading": 2.398037172066379, "complete-iteration": 0.2621047830581665, "set_robot_commands": 0.0066130844751993816, "deviation-center-line": 0.785479663342092, "driven_lanedir_consec": 2.1998934938071315, "sim_compute_sim_state": 0.033316033681233724, "sim_compute_performance-ego": 0.005851427714029948}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.534129817394679, "get_ui_image": 0.04218299388885498, "step_physics": 0.10105039834976196, "survival_time": 14.950000000000076, "driven_lanedir": 1.7333174055494134, "get_state_dump": 0.01905131737391154, "sim_render-ego": 0.008559101422627767, "get_robot_state": 0.01919961452484131, "get_duckie_state": 3.002484639485677e-06, "in-drivable-lane": 6.950000000000055, "agent_compute-ego": 0.02514394442240397, "deviation-heading": 2.833474514486437, "complete-iteration": 0.26114661693573, "set_robot_commands": 0.00676945686340332, "deviation-center-line": 0.6753487200958498, "driven_lanedir_consec": 1.7333174055494134, "sim_compute_sim_state": 0.03304826656977335, "sim_compute_performance-ego": 0.005951948960622152}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5325327922127405, "get_ui_image": 0.0418308695157369, "step_physics": 0.10227406104405722, "survival_time": 14.950000000000076, "driven_lanedir": 1.3293536667661685, "get_state_dump": 0.019250338077545167, "sim_render-ego": 0.008261399269104004, "get_robot_state": 0.01907141526540121, "get_duckie_state": 2.9357274373372394e-06, "in-drivable-lane": 8.800000000000056, "agent_compute-ego": 0.026101115544637045, "deviation-heading": 2.1219012125766024, "complete-iteration": 0.2636819895108541, "set_robot_commands": 0.006729605197906494, "deviation-center-line": 0.5361791861254221, "driven_lanedir_consec": 1.3293536667661685, "sim_compute_sim_state": 0.03414140780766805, "sim_compute_performance-ego": 0.005829034646352132}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.002090516984669, "get_ui_image": 0.04300581375757853, "step_physics": 0.10539070685704548, "survival_time": 14.950000000000076, "driven_lanedir": 2.6134713621470462, "get_state_dump": 0.01935384511947632, "sim_render-ego": 0.009514200687408448, "get_robot_state": 0.023221894900004068, "get_duckie_state": 3.0382474263509116e-06, "in-drivable-lane": 5.400000000000057, "agent_compute-ego": 0.02541940689086914, "deviation-heading": 1.8434226319886833, "complete-iteration": 0.2805575211842855, "set_robot_commands": 0.00798337459564209, "deviation-center-line": 0.6515111874851879, "driven_lanedir_consec": 2.6134713621470462, "sim_compute_sim_state": 0.04043899218241374, "sim_compute_performance-ego": 0.006037726402282715}}
set_robot_commands_max0.00798337459564209
set_robot_commands_mean0.007023880283037821
set_robot_commands_median0.006749531030654907
set_robot_commands_min0.0066130844751993816
sim_compute_performance-ego_max0.006037726402282715
sim_compute_performance-ego_mean0.005917534430821736
sim_compute_performance-ego_median0.0059016883373260495
sim_compute_performance-ego_min0.005829034646352132
sim_compute_sim_state_max0.04043899218241374
sim_compute_sim_state_mean0.03523617506027221
sim_compute_sim_state_median0.03372872074445089
sim_compute_sim_state_min0.03304826656977335
sim_render-ego_max0.009514200687408448
sim_render-ego_mean0.008634597460428873
sim_render-ego_median0.008410250345865886
sim_render-ego_min0.008203688462575277
simulation-passed1
step_physics_max0.10539070685704548
step_physics_mean0.10274066110452015
step_physics_median0.1022607696056366
step_physics_min0.10105039834976196
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4381511752Olga (Ge Ya) Xu πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3470671429210936
survival_time_median14.950000000000076
deviation-center-line_median0.786317908661851
in-drivable-lane_median5.150000000000053


other stats
agent_compute-ego_max0.02608946959177653
agent_compute-ego_mean0.025583983461062113
agent_compute-ego_median0.02553044279416402
agent_compute-ego_min0.02518557866414388
complete-iteration_max0.29116520245869953
complete-iteration_mean0.28358958343664803
complete-iteration_median0.2810935052235921
complete-iteration_min0.2810061208407084
deviation-center-line_max1.1882754774984148
deviation-center-line_mean0.8405620825431402
deviation-center-line_min0.6013370353504437
deviation-heading_max3.2268396939401724
deviation-heading_mean2.564342429884467
deviation-heading_median2.575418116047282
deviation-heading_min1.8796937935031317
driven_any_max3.9646149758718736
driven_any_mean3.649243022343005
driven_any_median3.657733413182452
driven_any_min3.31689028713524
driven_lanedir_consec_max2.9955198265157272
driven_lanedir_consec_mean2.2528150223638788
driven_lanedir_consec_min1.3216059770976016
driven_lanedir_max2.9955198265157272
driven_lanedir_mean2.2528150223638788
driven_lanedir_median2.3470671429210936
driven_lanedir_min1.3216059770976016
get_duckie_state_max3.0803680419921875e-06
get_duckie_state_mean3.003080685933431e-06
get_duckie_state_median3.0481815338134766e-06
get_duckie_state_min2.835591634114583e-06
get_robot_state_max0.023288609981536864
get_robot_state_mean0.02074642539024353
get_robot_state_median0.020015279452006023
get_robot_state_min0.019666532675425213
get_state_dump_max0.020099287033081056
get_state_dump_mean0.01985662639141083
get_state_dump_median0.019797031482060752
get_state_dump_min0.019733155568440755
get_ui_image_max0.04661238193511963
get_ui_image_mean0.04553554534912109
get_ui_image_median0.04582793315251668
get_ui_image_min0.04387393315633138
in-drivable-lane_max7.700000000000028
in-drivable-lane_mean5.150000000000042
in-drivable-lane_min2.600000000000037
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.751859663373087, "get_ui_image": 0.04387393315633138, "step_physics": 0.1080666748682658, "survival_time": 14.950000000000076, "driven_lanedir": 2.9955198265157272, "get_state_dump": 0.019814236164093016, "sim_render-ego": 0.009530445734659831, "get_robot_state": 0.023288609981536864, "get_duckie_state": 3.028710683186849e-06, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.02608946959177653, "deviation-heading": 2.0407650229164953, "complete-iteration": 0.2811328331629435, "set_robot_commands": 0.007749088605244954, "deviation-center-line": 1.1882754774984148, "driven_lanedir_consec": 2.9955198265157272, "sim_compute_sim_state": 0.03622057994206746, "sim_compute_performance-ego": 0.006313854058583577}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.563607162991817, "get_ui_image": 0.04661238193511963, "step_physics": 0.11256271044413248, "survival_time": 14.950000000000076, "driven_lanedir": 1.9402662414782912, "get_state_dump": 0.020099287033081056, "sim_render-ego": 0.008681376775105795, "get_robot_state": 0.019666532675425213, "get_duckie_state": 3.0803680419921875e-06, "in-drivable-lane": 5.950000000000044, "agent_compute-ego": 0.02546584288279215, "deviation-heading": 3.1100712091780687, "complete-iteration": 0.2810541772842407, "set_robot_commands": 0.006993542512257894, "deviation-center-line": 0.8180649841599884, "driven_lanedir_consec": 1.9402662414782912, "sim_compute_sim_state": 0.03469979604085287, "sim_compute_performance-ego": 0.006091912587483724}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.31689028713524, "get_ui_image": 0.04580883502960205, "step_physics": 0.11138976414998372, "survival_time": 14.950000000000076, "driven_lanedir": 1.3216059770976016, "get_state_dump": 0.019779826800028485, "sim_render-ego": 0.008934136231740315, "get_robot_state": 0.02017947594324748, "get_duckie_state": 3.0676523844401043e-06, "in-drivable-lane": 7.700000000000028, "agent_compute-ego": 0.02559504270553589, "deviation-heading": 3.2268396939401724, "complete-iteration": 0.2810061208407084, "set_robot_commands": 0.007104474703470866, "deviation-center-line": 0.6013370353504437, "driven_lanedir_consec": 1.3216059770976016, "sim_compute_sim_state": 0.03600037177403768, "sim_compute_performance-ego": 0.006032370726267497}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.9646149758718736, "get_ui_image": 0.04584703127543131, "step_physics": 0.11777165571848552, "survival_time": 14.950000000000076, "driven_lanedir": 2.753868044363895, "get_state_dump": 0.019733155568440755, "sim_render-ego": 0.008755177656809488, "get_robot_state": 0.019851082960764568, "get_duckie_state": 2.835591634114583e-06, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.02518557866414388, "deviation-heading": 1.8796937935031317, "complete-iteration": 0.29116520245869953, "set_robot_commands": 0.007138697306315104, "deviation-center-line": 0.7545708331637138, "driven_lanedir_consec": 2.753868044363895, "sim_compute_sim_state": 0.04058129866917928, "sim_compute_performance-ego": 0.006118966738382975}}
set_robot_commands_max0.007749088605244954
set_robot_commands_mean0.007246450781822205
set_robot_commands_median0.0071215860048929845
set_robot_commands_min0.006993542512257894
sim_compute_performance-ego_max0.006313854058583577
sim_compute_performance-ego_mean0.006139276027679444
sim_compute_performance-ego_median0.0061054396629333495
sim_compute_performance-ego_min0.006032370726267497
sim_compute_sim_state_max0.04058129866917928
sim_compute_sim_state_mean0.03687551160653432
sim_compute_sim_state_median0.03611047585805257
sim_compute_sim_state_min0.03469979604085287
sim_render-ego_max0.009530445734659831
sim_render-ego_mean0.008975284099578859
sim_render-ego_median0.0088446569442749
sim_render-ego_min0.008681376775105795
simulation-passed1
step_physics_max0.11777165571848552
step_physics_mean0.11244770129521688
step_physics_median0.1119762372970581
step_physics_min0.1080666748682658
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4380711750Olga (Ge Ya) Xu πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3494156883709354
survival_time_median14.950000000000076
deviation-center-line_median0.74880446288605
in-drivable-lane_median3.600000000000032


other stats
agent_compute-ego_max0.0261985445022583
agent_compute-ego_mean0.02577305773893992
agent_compute-ego_median0.025678553183873496
agent_compute-ego_min0.025536580085754393
complete-iteration_max0.2933605909347534
complete-iteration_mean0.2863413393497467
complete-iteration_median0.284984245300293
complete-iteration_min0.28203627586364743
deviation-center-line_max0.9141190809513694
deviation-center-line_mean0.7401537935288508
deviation-center-line_min0.5488871673919342
deviation-heading_max2.9065193804985348
deviation-heading_mean1.839238043735313
deviation-heading_median1.6914110288142632
deviation-heading_min1.067610736814191
driven_any_max3.5980438126656935
driven_any_mean3.2663184651631783
driven_any_median3.2353413314667767
driven_any_min2.996547385053467
driven_lanedir_consec_max2.947386315886302
driven_lanedir_consec_mean2.213310228385507
driven_lanedir_consec_min1.207023220913854
driven_lanedir_max2.947386315886302
driven_lanedir_mean2.213310228385507
driven_lanedir_median2.3494156883709354
driven_lanedir_min1.207023220913854
get_duckie_state_max2.826849619547526e-06
get_duckie_state_mean2.7869145075480144e-06
get_duckie_state_median2.7771790822347005e-06
get_duckie_state_min2.7664502461751302e-06
get_robot_state_max0.022328373591105143
get_robot_state_mean0.020351756811141968
get_robot_state_median0.019736053546269738
get_robot_state_min0.019606546560923255
get_state_dump_max0.019928989410400392
get_state_dump_mean0.019756810267766316
get_state_dump_median0.019777414401372272
get_state_dump_min0.01954342285792033
get_ui_image_max0.046328069368998206
get_ui_image_mean0.045591929554939264
get_ui_image_median0.045529818932215374
get_ui_image_min0.04498001098632813
in-drivable-lane_max8.20000000000004
in-drivable-lane_mean4.475000000000035
in-drivable-lane_min2.5000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.25891296271091, "get_ui_image": 0.04498001098632813, "step_physics": 0.11409595966339112, "survival_time": 14.950000000000076, "driven_lanedir": 2.3961659175221977, "get_state_dump": 0.01973527749379476, "sim_render-ego": 0.008793799082438152, "get_robot_state": 0.019734117190043133, "get_duckie_state": 2.777576446533203e-06, "in-drivable-lane": 3.5500000000000504, "agent_compute-ego": 0.025536580085754393, "deviation-heading": 1.3106959927918282, "complete-iteration": 0.28203627586364743, "set_robot_commands": 0.007170379956563314, "deviation-center-line": 0.8504503170101757, "driven_lanedir_consec": 2.3961659175221977, "sim_compute_sim_state": 0.035735920270284015, "sim_compute_performance-ego": 0.006078823407491048}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2117697002226437, "get_ui_image": 0.045865431626637775, "step_physics": 0.11445687770843506, "survival_time": 14.950000000000076, "driven_lanedir": 2.302665459219673, "get_state_dump": 0.019928989410400392, "sim_render-ego": 0.008876187006632487, "get_robot_state": 0.019606546560923255, "get_duckie_state": 2.776781717936198e-06, "in-drivable-lane": 3.6500000000000137, "agent_compute-ego": 0.025670196215311688, "deviation-heading": 2.072126064836698, "complete-iteration": 0.2830169415473938, "set_robot_commands": 0.007213701407114664, "deviation-center-line": 0.9141190809513694, "driven_lanedir_consec": 2.302665459219673, "sim_compute_sim_state": 0.035074427127838134, "sim_compute_performance-ego": 0.006151019732157389}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.996547385053467, "get_ui_image": 0.045194206237792967, "step_physics": 0.11307138045628866, "survival_time": 14.950000000000076, "driven_lanedir": 1.207023220913854, "get_state_dump": 0.01954342285792033, "sim_render-ego": 0.00952842394510905, "get_robot_state": 0.022328373591105143, "get_duckie_state": 2.826849619547526e-06, "in-drivable-lane": 8.20000000000004, "agent_compute-ego": 0.0261985445022583, "deviation-heading": 2.9065193804985348, "complete-iteration": 0.28695154905319215, "set_robot_commands": 0.007656435966491699, "deviation-center-line": 0.5488871673919342, "driven_lanedir_consec": 1.207023220913854, "sim_compute_sim_state": 0.03710590442021688, "sim_compute_performance-ego": 0.006149441401163737}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5980438126656935, "get_ui_image": 0.046328069368998206, "step_physics": 0.11864164272944132, "survival_time": 14.950000000000076, "driven_lanedir": 2.947386315886302, "get_state_dump": 0.019819551308949787, "sim_render-ego": 0.00871387799580892, "get_robot_state": 0.01973798990249634, "get_duckie_state": 2.7664502461751302e-06, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.025686910152435304, "deviation-heading": 1.067610736814191, "complete-iteration": 0.2933605909347534, "set_robot_commands": 0.006985092957814534, "deviation-center-line": 0.6471586087619242, "driven_lanedir_consec": 2.947386315886302, "sim_compute_sim_state": 0.041194814840952554, "sim_compute_performance-ego": 0.006080709298451742}}
set_robot_commands_max0.007656435966491699
set_robot_commands_mean0.007256402571996053
set_robot_commands_median0.007192040681838989
set_robot_commands_min0.006985092957814534
sim_compute_performance-ego_max0.006151019732157389
sim_compute_performance-ego_mean0.0061149984598159795
sim_compute_performance-ego_median0.006115075349807739
sim_compute_performance-ego_min0.006078823407491048
sim_compute_sim_state_max0.041194814840952554
sim_compute_sim_state_mean0.037277766664822895
sim_compute_sim_state_median0.036420912345250446
sim_compute_sim_state_min0.035074427127838134
sim_render-ego_max0.00952842394510905
sim_render-ego_mean0.008978072007497152
sim_render-ego_median0.00883499304453532
sim_render-ego_min0.00871387799580892
simulation-passed1
step_physics_max0.11864164272944132
step_physics_mean0.11506646513938903
step_physics_median0.1142764186859131
step_physics_min0.11307138045628866
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4380211748Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦real-exercise-2aido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:09:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 837 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4379811746Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7725215013790163
survival_time_median14.950000000000076
deviation-center-line_median0.7863601550787201
in-drivable-lane_median0.47500000000000053


other stats
agent_compute-ego_max0.02591612748801708
agent_compute-ego_mean0.025847088129570088
agent_compute-ego_median0.02582761804262797
agent_compute-ego_min0.025816988945007325
complete-iteration_max0.2719586571057638
complete-iteration_mean0.2644891952164471
complete-iteration_median0.2626386960347493
complete-iteration_min0.260720731690526
deviation-center-line_max1.061526773504994
deviation-center-line_mean0.766904446105869
deviation-center-line_min0.433370700761042
deviation-heading_max4.906370898149582
deviation-heading_mean3.409864942911632
deviation-heading_median3.661279785386231
deviation-heading_min1.4105293027244852
driven_any_max3.1801086494589046
driven_any_mean2.632386996179795
driven_any_median2.9993358673698607
driven_any_min1.3507676005205536
driven_lanedir_consec_max3.089427119868148
driven_lanedir_consec_mean1.9469074284601315
driven_lanedir_consec_min1.1531595912143449
driven_lanedir_max3.089427119868148
driven_lanedir_mean2.3954535548012585
driven_lanedir_median2.6696137540612703
driven_lanedir_min1.1531595912143449
get_duckie_state_max4.076957702636719e-06
get_duckie_state_mean4.0564251442750295e-06
get_duckie_state_median4.057350258032481e-06
get_duckie_state_min4.034042358398438e-06
get_robot_state_max0.01920938491821289
get_robot_state_mean0.01914939781030019
get_robot_state_median0.019148506720860797
get_robot_state_min0.019091192881266275
get_state_dump_max0.019505228847265244
get_state_dump_mean0.0193354586387674
get_state_dump_median0.019348955154418944
get_state_dump_min0.01913869539896647
get_ui_image_max0.04244289733469486
get_ui_image_mean0.04207772060607871
get_ui_image_median0.0421094556649526
get_ui_image_min0.041649073759714765
in-drivable-lane_max0.7500000000000107
in-drivable-lane_mean0.425000000000003
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.3507676005205536, "get_ui_image": 0.04244289733469486, "step_physics": 0.10055836290121078, "survival_time": 6.399999999999985, "driven_lanedir": 1.1531595912143449, "get_state_dump": 0.019505228847265244, "sim_render-ego": 0.008121108636260033, "get_robot_state": 0.01920938491821289, "get_duckie_state": 4.0512531995773315e-06, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.02591612748801708, "deviation-heading": 1.4105293027244852, "complete-iteration": 0.260720731690526, "set_robot_commands": 0.006456861272454262, "deviation-center-line": 0.433370700761042, "driven_lanedir_consec": 1.1531595912143449, "sim_compute_sim_state": 0.03237213008105755, "sim_compute_performance-ego": 0.005954604595899582}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.1801086494589046, "get_ui_image": 0.04229381084442139, "step_physics": 0.10141209840774536, "survival_time": 14.950000000000076, "driven_lanedir": 3.089427119868148, "get_state_dump": 0.01913869539896647, "sim_render-ego": 0.008219107786814372, "get_robot_state": 0.01918540636698405, "get_duckie_state": 4.076957702636719e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025816988945007325, "deviation-heading": 3.159457010319573, "complete-iteration": 0.2616261053085327, "set_robot_commands": 0.006827011903127034, "deviation-center-line": 0.7702290646643372, "driven_lanedir_consec": 3.089427119868148, "sim_compute_sim_state": 0.03262554963429769, "sim_compute_performance-ego": 0.005920570691426595}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8929626192573155, "get_ui_image": 0.041649073759714765, "step_physics": 0.10366111119588216, "survival_time": 14.950000000000076, "driven_lanedir": 2.5326269842827505, "get_state_dump": 0.019401167233784992, "sim_render-ego": 0.008225739002227783, "get_robot_state": 0.01911160707473755, "get_duckie_state": 4.06344731648763e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.025830855369567873, "deviation-heading": 4.163102560452889, "complete-iteration": 0.263651286760966, "set_robot_commands": 0.006989015738169352, "deviation-center-line": 0.8024912454931031, "driven_lanedir_consec": 1.8185680382492913, "sim_compute_sim_state": 0.032737029393514, "sim_compute_performance-ego": 0.005862666765848796}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.105709115482406, "get_ui_image": 0.041925100485483806, "step_physics": 0.10736201683680216, "survival_time": 14.950000000000076, "driven_lanedir": 2.80660052383979, "get_state_dump": 0.019296743075052896, "sim_render-ego": 0.008384928703308106, "get_robot_state": 0.019091192881266275, "get_duckie_state": 4.034042358398438e-06, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.02582438071568807, "deviation-heading": 4.906370898149582, "complete-iteration": 0.2719586571057638, "set_robot_commands": 0.006730898221333822, "deviation-center-line": 1.061526773504994, "driven_lanedir_consec": 1.7264749645087418, "sim_compute_sim_state": 0.037252662181854246, "sim_compute_performance-ego": 0.005905556678771973}}
set_robot_commands_max0.006989015738169352
set_robot_commands_mean0.006750946783771117
set_robot_commands_median0.006778955062230428
set_robot_commands_min0.006456861272454262
sim_compute_performance-ego_max0.005954604595899582
sim_compute_performance-ego_mean0.005910849682986736
sim_compute_performance-ego_median0.005913063685099284
sim_compute_performance-ego_min0.005862666765848796
sim_compute_sim_state_max0.037252662181854246
sim_compute_sim_state_mean0.03374684282268087
sim_compute_sim_state_median0.032681289513905844
sim_compute_sim_state_min0.03237213008105755
sim_render-ego_max0.008384928703308106
sim_render-ego_mean0.008237721032152574
sim_render-ego_median0.008222423394521079
sim_render-ego_min0.008121108636260033
simulation-passed1
step_physics_max0.10736201683680216
step_physics_mean0.10324839733541012
step_physics_median0.10253660480181376
step_physics_min0.10055836290121078
survival_time_max14.950000000000076
survival_time_mean12.812500000000052
survival_time_min6.399999999999985
No reset possible
4378511743Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1138757118198432
survival_time_median14.950000000000076
deviation-center-line_median0.908666091075099
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.026025235652923584
agent_compute-ego_mean0.025492586493492127
agent_compute-ego_median0.025451662143071492
agent_compute-ego_min0.025041786034901935
complete-iteration_max0.30084980964660646
complete-iteration_mean0.2879530348380407
complete-iteration_median0.28447850306828815
complete-iteration_min0.2820053235689799
deviation-center-line_max0.9957404603501552
deviation-center-line_mean0.8793285914654525
deviation-center-line_min0.704241723361457
deviation-heading_max7.050755804595051
deviation-heading_mean4.125656688924127
deviation-heading_median3.307364175094196
deviation-heading_min2.8371426009130656
driven_any_max2.2554936966378696
driven_any_mean2.0688762634916693
driven_any_median2.215614873297914
driven_any_min1.58878161073298
driven_lanedir_consec_max2.1949607789657395
driven_lanedir_consec_mean1.7562917827592268
driven_lanedir_consec_min0.6024549284314814
driven_lanedir_max2.1949607789657395
driven_lanedir_mean1.9487544171007325
driven_lanedir_median2.1138757118198432
driven_lanedir_min1.372305465797504
get_duckie_state_max4.398822784423828e-06
get_duckie_state_mean4.3173631032307945e-06
get_duckie_state_median4.320542017618816e-06
get_duckie_state_min4.229545593261718e-06
get_robot_state_max0.024104940096537273
get_robot_state_mean0.022963300546010333
get_robot_state_median0.02290830492973327
get_robot_state_min0.021931652228037515
get_state_dump_max0.02014794190724691
get_state_dump_mean0.019792163968086245
get_state_dump_median0.01969656507174174
get_state_dump_min0.019627583821614582
get_ui_image_max0.04609994967778524
get_ui_image_mean0.04537648340066275
get_ui_image_median0.04550966382026672
get_ui_image_min0.04438665628433228
in-drivable-lane_max0.5999999999999979
in-drivable-lane_mean0.14999999999999947
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.251066387864824, "get_ui_image": 0.04505513191223145, "step_physics": 0.10947097539901732, "survival_time": 14.950000000000076, "driven_lanedir": 2.1949607789657395, "get_state_dump": 0.02014794190724691, "sim_render-ego": 0.01004581610361735, "get_robot_state": 0.023329980373382568, "get_duckie_state": 4.38531239827474e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026025235652923584, "deviation-heading": 2.883672692446956, "complete-iteration": 0.28557710647583007, "set_robot_commands": 0.007850847244262694, "deviation-center-line": 0.9957404603501552, "driven_lanedir_consec": 2.1949607789657395, "sim_compute_sim_state": 0.037162214914957685, "sim_compute_performance-ego": 0.006311988830566407}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.2554936966378696, "get_ui_image": 0.04438665628433228, "step_physics": 0.1124509334564209, "survival_time": 14.950000000000076, "driven_lanedir": 2.108170107588126, "get_state_dump": 0.019627583821614582, "sim_render-ego": 0.009268552462259928, "get_robot_state": 0.022486629486083983, "get_duckie_state": 4.398822784423828e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025041786034901935, "deviation-heading": 3.731055657741436, "complete-iteration": 0.2820053235689799, "set_robot_commands": 0.007435605525970459, "deviation-center-line": 0.973303958473564, "driven_lanedir_consec": 2.108170107588126, "sim_compute_sim_state": 0.034941291014353434, "sim_compute_performance-ego": 0.006193296909332275}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.58878161073298, "get_ui_image": 0.04609994967778524, "step_physics": 0.10939397652943927, "survival_time": 14.950000000000076, "driven_lanedir": 1.372305465797504, "get_state_dump": 0.01963352839152018, "sim_render-ego": 0.009807599385579428, "get_robot_state": 0.024104940096537273, "get_duckie_state": 4.255771636962891e-06, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.025806734561920164, "deviation-heading": 7.050755804595051, "complete-iteration": 0.2833798996607463, "set_robot_commands": 0.007809568246205648, "deviation-center-line": 0.704241723361457, "driven_lanedir_consec": 0.6024549284314814, "sim_compute_sim_state": 0.03435418923695882, "sim_compute_performance-ego": 0.006194041570027669}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.180163358731004, "get_ui_image": 0.045964195728302, "step_physics": 0.1238599197069804, "survival_time": 14.950000000000076, "driven_lanedir": 2.11958131605156, "get_state_dump": 0.0197596017519633, "sim_render-ego": 0.009132588704427083, "get_robot_state": 0.021931652228037515, "get_duckie_state": 4.229545593261718e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02509658972422282, "deviation-heading": 2.8371426009130656, "complete-iteration": 0.30084980964660646, "set_robot_commands": 0.007428974310557048, "deviation-center-line": 0.8440282236766339, "driven_lanedir_consec": 2.11958131605156, "sim_compute_sim_state": 0.04132867654164632, "sim_compute_performance-ego": 0.006172607739766439}}
set_robot_commands_max0.007850847244262694
set_robot_commands_mean0.007631248831748963
set_robot_commands_median0.007622586886088053
set_robot_commands_min0.007428974310557048
sim_compute_performance-ego_max0.006311988830566407
sim_compute_performance-ego_mean0.006217983762423197
sim_compute_performance-ego_median0.006193669239679973
sim_compute_performance-ego_min0.006172607739766439
sim_compute_sim_state_max0.04132867654164632
sim_compute_sim_state_mean0.03694659292697906
sim_compute_sim_state_median0.03605175296465555
sim_compute_sim_state_min0.03435418923695882
sim_render-ego_max0.01004581610361735
sim_render-ego_mean0.009563639163970948
sim_render-ego_median0.009538075923919675
sim_render-ego_min0.009132588704427083
simulation-passed1
step_physics_max0.1238599197069804
step_physics_mean0.11379395127296447
step_physics_median0.11096095442771912
step_physics_min0.10939397652943927
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4376311735Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:12:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9829424309738477
survival_time_median14.950000000000076
deviation-center-line_median0.884216456493659
in-drivable-lane_median3.3250000000000166


other stats
agent_compute-ego_max0.028620277245839435
agent_compute-ego_mean0.027365694587750972
agent_compute-ego_median0.027179663867401564
agent_compute-ego_min0.026483173370361327
complete-iteration_max0.3613097906112671
complete-iteration_mean0.3464319955602253
complete-iteration_median0.34758078600862896
complete-iteration_min0.3292566196123759
deviation-center-line_max0.9464218399963767
deviation-center-line_mean0.7448977493979441
deviation-center-line_min0.26473624460808165
deviation-heading_max4.830400117412446
deviation-heading_mean3.356267745585194
deviation-heading_median3.7146317315469055
deviation-heading_min1.1654074018345182
driven_any_max3.830125623425726
driven_any_mean3.3805359136477344
driven_any_median3.77344937781962
driven_any_min2.1451192755259716
driven_lanedir_consec_max2.6886446685995815
driven_lanedir_consec_mean2.02155130873978
driven_lanedir_consec_min1.4316757044118438
driven_lanedir_max3.049624192492505
driven_lanedir_mean2.362164059929092
driven_lanedir_median2.4836781714060097
driven_lanedir_min1.4316757044118438
get_duckie_state_max4.1023890177408855e-06
get_duckie_state_mean3.915220427570297e-06
get_duckie_state_median3.9859612782796225e-06
get_duckie_state_min3.586570135981059e-06
get_robot_state_max0.023625291188557943
get_robot_state_mean0.022979847261373944
get_robot_state_median0.02303298075993856
get_robot_state_min0.02222813633706072
get_state_dump_max0.020446197986602785
get_state_dump_mean0.01991019637607556
get_state_dump_median0.01995509289151473
get_state_dump_min0.01928440173467
get_ui_image_max0.057448184490203856
get_ui_image_mean0.0545328078524386
get_ui_image_median0.05505621033035023
get_ui_image_min0.050570626258850095
in-drivable-lane_max5.2000000000000615
in-drivable-lane_mean3.4500000000000215
in-drivable-lane_min1.949999999999993
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.830125623425726, "get_ui_image": 0.050570626258850095, "step_physics": 0.14200708627700806, "survival_time": 14.950000000000076, "driven_lanedir": 3.049624192492505, "get_state_dump": 0.020266721248626707, "sim_render-ego": 0.010179744561513266, "get_robot_state": 0.023076840241750083, "get_duckie_state": 4.1023890177408855e-06, "in-drivable-lane": 2.100000000000004, "agent_compute-ego": 0.026483173370361327, "deviation-heading": 4.830400117412446, "complete-iteration": 0.3292566196123759, "set_robot_commands": 0.008029155731201172, "deviation-center-line": 0.8902216116915146, "driven_lanedir_consec": 2.6886446685995815, "sim_compute_sim_state": 0.04200702428817749, "sim_compute_performance-ego": 0.006465169588724772}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.81229138447421, "get_ui_image": 0.05568512280782064, "step_physics": 0.15160759369532267, "survival_time": 14.950000000000076, "driven_lanedir": 2.4958019637407873, "get_state_dump": 0.020446197986602785, "sim_render-ego": 0.0101468022664388, "get_robot_state": 0.023625291188557943, "get_duckie_state": 3.996690114339192e-06, "in-drivable-lane": 5.2000000000000615, "agent_compute-ego": 0.02737349033355713, "deviation-heading": 3.516252871571029, "complete-iteration": 0.3469750070571899, "set_robot_commands": 0.008409430980682373, "deviation-center-line": 0.8782113012958033, "driven_lanedir_consec": 2.4958019637407873, "sim_compute_sim_state": 0.04286049048105875, "sim_compute_performance-ego": 0.006646101474761963}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.7346073711650303, "get_ui_image": 0.057448184490203856, "step_physics": 0.16600587844848633, "survival_time": 14.950000000000076, "driven_lanedir": 2.471554379071232, "get_state_dump": 0.01928440173467, "sim_render-ego": 0.010322848161061604, "get_robot_state": 0.022989121278127033, "get_duckie_state": 3.975232442220052e-06, "in-drivable-lane": 4.550000000000029, "agent_compute-ego": 0.028620277245839435, "deviation-heading": 3.913010591522782, "complete-iteration": 0.3613097906112671, "set_robot_commands": 0.008552538553873697, "deviation-center-line": 0.9464218399963767, "driven_lanedir_consec": 1.4700828982069083, "sim_compute_sim_state": 0.04120400508244832, "sim_compute_performance-ego": 0.006706671714782715}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.1451192755259716, "get_ui_image": 0.05442729785287981, "step_physics": 0.15076179127041384, "survival_time": 6.949999999999983, "driven_lanedir": 1.4316757044118438, "get_state_dump": 0.01964346453440275, "sim_render-ego": 0.011195748830013138, "get_robot_state": 0.02222813633706072, "get_duckie_state": 3.586570135981059e-06, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.026985837401245997, "deviation-heading": 1.1654074018345182, "complete-iteration": 0.34818656496006806, "set_robot_commands": 0.00816516739001377, "deviation-center-line": 0.26473624460808165, "driven_lanedir_consec": 1.4316757044118438, "sim_compute_sim_state": 0.0477429362509748, "sim_compute_performance-ego": 0.006865636907893119}}
set_robot_commands_max0.008552538553873697
set_robot_commands_mean0.008289073163942753
set_robot_commands_median0.008287299185348072
set_robot_commands_min0.008029155731201172
sim_compute_performance-ego_max0.006865636907893119
sim_compute_performance-ego_mean0.006670894921540642
sim_compute_performance-ego_median0.0066763865947723385
sim_compute_performance-ego_min0.006465169588724772
sim_compute_sim_state_max0.0477429362509748
sim_compute_sim_state_mean0.04345361402566485
sim_compute_sim_state_median0.042433757384618125
sim_compute_sim_state_min0.04120400508244832
sim_render-ego_max0.011195748830013138
sim_render-ego_mean0.010461285954756703
sim_render-ego_median0.010251296361287434
sim_render-ego_min0.0101468022664388
simulation-passed1
step_physics_max0.16600587844848633
step_physics_mean0.1525955874228077
step_physics_median0.15118469248286823
step_physics_min0.14200708627700806
survival_time_max14.950000000000076
survival_time_mean12.950000000000054
survival_time_min6.949999999999983
No reset possible
4374911730Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.86931544879094
survival_time_median14.950000000000076
deviation-center-line_median0.33189399136943554
in-drivable-lane_median6.275000000000068


other stats
agent_compute-ego_max0.025401883125305176
agent_compute-ego_mean0.025024396989850088
agent_compute-ego_median0.024958604574203493
agent_compute-ego_min0.02477849568568819
complete-iteration_max0.2962192559242249
complete-iteration_mean0.28643349611000735
complete-iteration_median0.2866938901590609
complete-iteration_min0.2761269481976827
deviation-center-line_max0.899427871532128
deviation-center-line_mean0.450075461544669
deviation-center-line_min0.2370859919076767
deviation-heading_max3.653655189658489
deviation-heading_mean1.9213999950258769
deviation-heading_median1.5153158186334297
deviation-heading_min1.0013131531781592
driven_any_max3.171199583087494
driven_any_mean2.601789326506345
driven_any_median2.6765640679367255
driven_any_min1.8828295870644365
driven_lanedir_consec_max2.614761784203533
driven_lanedir_consec_mean1.913823948515484
driven_lanedir_consec_min1.3019031122765237
driven_lanedir_max2.660229955889142
driven_lanedir_mean1.9251909914368863
driven_lanedir_median1.86931544879094
driven_lanedir_min1.3019031122765237
get_duckie_state_max3.0533472696940104e-06
get_duckie_state_mean2.9379475660838527e-06
get_duckie_state_median2.9187100227113254e-06
get_duckie_state_min2.86102294921875e-06
get_robot_state_max0.024198219489259837
get_robot_state_mean0.02187364908834381
get_robot_state_median0.02170947670936585
get_robot_state_min0.019877423445383707
get_state_dump_max0.01994239739857274
get_state_dump_mean0.019808231622681416
get_state_dump_median0.019833831389745076
get_state_dump_min0.01962286631266276
get_ui_image_max0.04557326316833496
get_ui_image_mean0.04510387151650209
get_ui_image_median0.04518279809180137
get_ui_image_min0.04447662671407064
in-drivable-lane_max7.600000000000096
in-drivable-lane_mean5.587500000000066
in-drivable-lane_min2.2000000000000313
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8828295870644365, "get_ui_image": 0.045023305782144, "step_physics": 0.1107214763451414, "survival_time": 12.050000000000036, "driven_lanedir": 1.3019031122765237, "get_state_dump": 0.01994239739857274, "sim_render-ego": 0.009671311160835487, "get_robot_state": 0.024198219489259837, "get_duckie_state": 2.970833996024864e-06, "in-drivable-lane": 6.400000000000048, "agent_compute-ego": 0.02477849568568819, "deviation-heading": 1.3122042490096602, "complete-iteration": 0.2856013943050907, "set_robot_commands": 0.0082719909699626, "deviation-center-line": 0.2370859919076767, "driven_lanedir_consec": 1.3019031122765237, "sim_compute_sim_state": 0.03660259998685592, "sim_compute_performance-ego": 0.006216180769734363}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9085660674139286, "get_ui_image": 0.04534229040145874, "step_physics": 0.108913094997406, "survival_time": 14.950000000000076, "driven_lanedir": 1.9786517133613928, "get_state_dump": 0.019847277800242105, "sim_render-ego": 0.008721990585327149, "get_robot_state": 0.019877423445383707, "get_duckie_state": 3.0533472696940104e-06, "in-drivable-lane": 7.600000000000096, "agent_compute-ego": 0.025070191224416095, "deviation-heading": 1.0013131531781592, "complete-iteration": 0.2761269481976827, "set_robot_commands": 0.006970396041870117, "deviation-center-line": 0.2377208325518526, "driven_lanedir_consec": 1.9786517133613928, "sim_compute_sim_state": 0.03509485085805257, "sim_compute_performance-ego": 0.006112507979075114}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.444562068459523, "get_ui_image": 0.04447662671407064, "step_physics": 0.11716837088267008, "survival_time": 14.950000000000076, "driven_lanedir": 1.7599791842204875, "get_state_dump": 0.019820384979248047, "sim_render-ego": 0.00931095043818156, "get_robot_state": 0.02174985726674398, "get_duckie_state": 2.86102294921875e-06, "in-drivable-lane": 6.150000000000087, "agent_compute-ego": 0.025401883125305176, "deviation-heading": 1.718427388257199, "complete-iteration": 0.287786386013031, "set_robot_commands": 0.007482484976450602, "deviation-center-line": 0.4260671501870184, "driven_lanedir_consec": 1.7599791842204875, "sim_compute_sim_state": 0.035767964522043866, "sim_compute_performance-ego": 0.006434578895568848}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.171199583087494, "get_ui_image": 0.04557326316833496, "step_physics": 0.1204758063952128, "survival_time": 14.950000000000076, "driven_lanedir": 2.660229955889142, "get_state_dump": 0.01962286631266276, "sim_render-ego": 0.009215192794799805, "get_robot_state": 0.021669096151987713, "get_duckie_state": 2.8665860493977865e-06, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.024847017923990886, "deviation-heading": 3.653655189658489, "complete-iteration": 0.2962192559242249, "set_robot_commands": 0.007440191109975179, "deviation-center-line": 0.899427871532128, "driven_lanedir_consec": 2.614761784203533, "sim_compute_sim_state": 0.041080029010772706, "sim_compute_performance-ego": 0.006124405860900879}}
set_robot_commands_max0.0082719909699626
set_robot_commands_mean0.007541265774564624
set_robot_commands_median0.00746133804321289
set_robot_commands_min0.006970396041870117
sim_compute_performance-ego_max0.006434578895568848
sim_compute_performance-ego_mean0.006221918376319801
sim_compute_performance-ego_median0.006170293315317621
sim_compute_performance-ego_min0.006112507979075114
sim_compute_sim_state_max0.041080029010772706
sim_compute_sim_state_mean0.03713636109443126
sim_compute_sim_state_median0.03618528225444989
sim_compute_sim_state_min0.03509485085805257
sim_render-ego_max0.009671311160835487
sim_render-ego_mean0.009229861244786
sim_render-ego_median0.009263071616490684
sim_render-ego_min0.008721990585327149
simulation-passed1
step_physics_max0.1204758063952128
step_physics_mean0.11431968715510758
step_physics_median0.11394492361390574
step_physics_min0.108913094997406
survival_time_max14.950000000000076
survival_time_mean14.225000000000064
survival_time_min12.050000000000036
No reset possible
4373611726Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1557084697985258
survival_time_median13.65000000000006
deviation-center-line_median0.5368236038425235
in-drivable-lane_median3.1000000000000165


other stats
agent_compute-ego_max0.02912359873453776
agent_compute-ego_mean0.026305931025427
agent_compute-ego_median0.025801286806783535
agent_compute-ego_min0.02449755175360318
complete-iteration_max0.3612020397186279
complete-iteration_mean0.333672676751649
complete-iteration_median0.3342480911207907
complete-iteration_min0.3049924850463867
deviation-center-line_max0.9469748740969264
deviation-center-line_mean0.5676508362333836
deviation-center-line_min0.24998126315156097
deviation-heading_max6.781824203679925
deviation-heading_mean4.216747926689893
deviation-heading_median4.215288006924437
deviation-heading_min1.6545914892307692
driven_any_max3.2511134117978857
driven_any_mean2.3674749500496106
driven_any_median2.3451141890988048
driven_any_min1.5285580102029477
driven_lanedir_consec_max1.7165711112889082
driven_lanedir_consec_mean1.188105112304176
driven_lanedir_consec_min0.7244323983307449
driven_lanedir_max1.7165711112889082
driven_lanedir_mean1.188105112304176
driven_lanedir_median1.1557084697985258
driven_lanedir_min0.7244323983307449
get_duckie_state_max2.965927124023438e-06
get_duckie_state_mean2.8702744421771863e-06
get_duckie_state_median2.8795259351356225e-06
get_duckie_state_min2.756118774414062e-06
get_robot_state_max0.023699766000111897
get_robot_state_mean0.022657596966088513
get_robot_state_median0.022933263923475132
get_robot_state_min0.021064094017291892
get_state_dump_max0.01985821559511382
get_state_dump_mean0.019638699793433943
get_state_dump_median0.019644152720769248
get_state_dump_min0.01940827813708348
get_ui_image_max0.0563008983929952
get_ui_image_mean0.05405884071924526
get_ui_image_median0.05420978792604969
get_ui_image_min0.05151488863188645
in-drivable-lane_max10.800000000000084
in-drivable-lane_mean4.32500000000003
in-drivable-lane_min0.30000000000000426
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.5285580102029477, "get_ui_image": 0.05151488863188645, "step_physics": 0.12826570642405544, "survival_time": 7.249999999999982, "driven_lanedir": 1.011227728031583, "get_state_dump": 0.01985821559511382, "sim_render-ego": 0.009104376825793035, "get_robot_state": 0.021064094017291892, "get_duckie_state": 2.831426160088901e-06, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.02449755175360318, "deviation-heading": 2.1264326120430885, "complete-iteration": 0.3049924850463867, "set_robot_commands": 0.007695053363668508, "deviation-center-line": 0.32047969878219074, "driven_lanedir_consec": 1.011227728031583, "sim_compute_sim_state": 0.036322577246304215, "sim_compute_performance-ego": 0.006498964901628166}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.410646103231462, "get_ui_image": 0.054655510584513345, "step_physics": 0.13901285807291666, "survival_time": 14.950000000000076, "driven_lanedir": 1.300189211565469, "get_state_dump": 0.019577781359354656, "sim_render-ego": 0.009945378303527833, "get_robot_state": 0.023233189582824703, "get_duckie_state": 2.965927124023438e-06, "in-drivable-lane": 4.20000000000004, "agent_compute-ego": 0.02532244364420573, "deviation-heading": 6.781824203679925, "complete-iteration": 0.3251963464419047, "set_robot_commands": 0.008114507993062337, "deviation-center-line": 0.7531675089028562, "driven_lanedir_consec": 1.300189211565469, "sim_compute_sim_state": 0.03878444910049438, "sim_compute_performance-ego": 0.006372265815734864}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2511134117978857, "get_ui_image": 0.0563008983929952, "step_physics": 0.1629583756128947, "survival_time": 14.950000000000076, "driven_lanedir": 0.7244323983307449, "get_state_dump": 0.019710524082183836, "sim_render-ego": 0.010503760973612468, "get_robot_state": 0.023699766000111897, "get_duckie_state": 2.756118774414062e-06, "in-drivable-lane": 10.800000000000084, "agent_compute-ego": 0.02912359873453776, "deviation-heading": 1.6545914892307692, "complete-iteration": 0.3612020397186279, "set_robot_commands": 0.008429785569508871, "deviation-center-line": 0.24998126315156097, "driven_lanedir_consec": 0.7244323983307449, "sim_compute_sim_state": 0.043592482407887774, "sim_compute_performance-ego": 0.006703074773152669}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.2795822749661476, "get_ui_image": 0.05376406526758603, "step_physics": 0.14963743754244044, "survival_time": 12.35000000000004, "driven_lanedir": 1.7165711112889082, "get_state_dump": 0.01940827813708348, "sim_render-ego": 0.009855222122871925, "get_robot_state": 0.02263333826412556, "get_duckie_state": 2.927625710182344e-06, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.02628012996936134, "deviation-heading": 6.304143401805785, "complete-iteration": 0.3432998357996767, "set_robot_commands": 0.008305980126384782, "deviation-center-line": 0.9469748740969264, "driven_lanedir_consec": 1.7165711112889082, "sim_compute_sim_state": 0.0468866139771002, "sim_compute_performance-ego": 0.00635143523274163}}
set_robot_commands_max0.008429785569508871
set_robot_commands_mean0.008136331763156125
set_robot_commands_median0.00821024405972356
set_robot_commands_min0.007695053363668508
sim_compute_performance-ego_max0.006703074773152669
sim_compute_performance-ego_mean0.006481435180814332
sim_compute_performance-ego_median0.006435615358681515
sim_compute_performance-ego_min0.00635143523274163
sim_compute_sim_state_max0.0468866139771002
sim_compute_sim_state_mean0.04139653068294665
sim_compute_sim_state_median0.04118846575419108
sim_compute_sim_state_min0.036322577246304215
sim_render-ego_max0.010503760973612468
sim_render-ego_mean0.009852184556451316
sim_render-ego_median0.00990030021319988
sim_render-ego_min0.009104376825793035
simulation-passed1
step_physics_max0.1629583756128947
step_physics_mean0.1449685944130768
step_physics_median0.14432514780767855
step_physics_min0.12826570642405544
survival_time_max14.950000000000076
survival_time_mean12.375000000000044
survival_time_min7.249999999999982
No reset possible
4372311723Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.257018740153748
survival_time_median14.950000000000076
deviation-center-line_median0.6823944555965795
in-drivable-lane_median0.30000000000000426


other stats
agent_compute-ego_max0.026152819792429605
agent_compute-ego_mean0.025462600986162823
agent_compute-ego_median0.02535217046737671
agent_compute-ego_min0.02499324321746826
complete-iteration_max0.29449105978012086
complete-iteration_mean0.2848027990261714
complete-iteration_median0.2887792174021403
complete-iteration_min0.267161701520284
deviation-center-line_max0.7911327753651118
deviation-center-line_mean0.6797777413741758
deviation-center-line_min0.5631892789384323
deviation-heading_max2.4261051198681978
deviation-heading_mean2.371068235444661
deviation-heading_median2.3711035058095966
deviation-heading_min2.3159608102912523
driven_any_max3.4688183399608334
driven_any_mean3.123153837790439
driven_any_median3.3412411602949925
driven_any_min2.3413146906109374
driven_lanedir_consec_max3.394923644403327
driven_lanedir_consec_mean2.884459604917754
driven_lanedir_consec_min1.6288772949601928
driven_lanedir_max3.394923644403327
driven_lanedir_mean2.884459604917754
driven_lanedir_median3.257018740153748
driven_lanedir_min1.6288772949601928
get_duckie_state_max2.853075663248698e-06
get_duckie_state_mean2.816915512084961e-06
get_duckie_state_median2.8173128763834635e-06
get_duckie_state_min2.7799606323242188e-06
get_robot_state_max0.02436216672261556
get_robot_state_mean0.021838277777036032
get_robot_state_median0.02166482965151469
get_robot_state_min0.019661285082499185
get_state_dump_max0.02033752918243408
get_state_dump_mean0.01971518635749817
get_state_dump_median0.019641268650690713
get_state_dump_min0.019240678946177165
get_ui_image_max0.045960265000661214
get_ui_image_mean0.04448191662629446
get_ui_image_median0.04456933736801147
get_ui_image_min0.042828726768493655
in-drivable-lane_max6.000000000000085
in-drivable-lane_mean1.6500000000000234
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.2249285745740703, "get_ui_image": 0.042828726768493655, "step_physics": 0.10329541047414144, "survival_time": 14.950000000000076, "driven_lanedir": 3.166496965337639, "get_state_dump": 0.019240678946177165, "sim_render-ego": 0.008355926672617595, "get_robot_state": 0.019661285082499185, "get_duckie_state": 2.8363863627115885e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026152819792429605, "deviation-heading": 2.384831068490688, "complete-iteration": 0.267161701520284, "set_robot_commands": 0.007085665067036947, "deviation-center-line": 0.6590643456232251, "driven_lanedir_consec": 3.166496965337639, "sim_compute_sim_state": 0.034415589173634846, "sim_compute_performance-ego": 0.005936275323232015}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.457553746015915, "get_ui_image": 0.044289124011993405, "step_physics": 0.11124471187591552, "survival_time": 14.950000000000076, "driven_lanedir": 3.394923644403327, "get_state_dump": 0.01966498851776123, "sim_render-ego": 0.0096235195795695, "get_robot_state": 0.02436216672261556, "get_duckie_state": 2.853075663248698e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025255286693573, "deviation-heading": 2.3573759431285057, "complete-iteration": 0.2853032326698303, "set_robot_commands": 0.007655123074849447, "deviation-center-line": 0.7911327753651118, "driven_lanedir_consec": 3.394923644403327, "sim_compute_sim_state": 0.03680787960688273, "sim_compute_performance-ego": 0.00621489683787028}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.3413146906109374, "get_ui_image": 0.04484955072402954, "step_physics": 0.11840585152308146, "survival_time": 14.950000000000076, "driven_lanedir": 1.6288772949601928, "get_state_dump": 0.02033752918243408, "sim_render-ego": 0.009811304410298665, "get_robot_state": 0.023466420968373616, "get_duckie_state": 2.7799606323242188e-06, "in-drivable-lane": 6.000000000000085, "agent_compute-ego": 0.02544905424118042, "deviation-heading": 2.3159608102912523, "complete-iteration": 0.2922552021344503, "set_robot_commands": 0.007717239061991374, "deviation-center-line": 0.5631892789384323, "driven_lanedir_consec": 1.6288772949601928, "sim_compute_sim_state": 0.03582189877827962, "sim_compute_performance-ego": 0.006208563645680745}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.4688183399608334, "get_ui_image": 0.045960265000661214, "step_physics": 0.12028019984563192, "survival_time": 14.950000000000076, "driven_lanedir": 3.347540514969857, "get_state_dump": 0.0196175487836202, "sim_render-ego": 0.00894625981648763, "get_robot_state": 0.019863238334655763, "get_duckie_state": 2.7982393900553385e-06, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.02499324321746826, "deviation-heading": 2.4261051198681978, "complete-iteration": 0.29449105978012086, "set_robot_commands": 0.006950472195943197, "deviation-center-line": 0.705724565569934, "driven_lanedir_consec": 3.347540514969857, "sim_compute_sim_state": 0.041483829816182455, "sim_compute_performance-ego": 0.0062082171440124515}}
set_robot_commands_max0.007717239061991374
set_robot_commands_mean0.007352124849955241
set_robot_commands_median0.007370394070943196
set_robot_commands_min0.006950472195943197
sim_compute_performance-ego_max0.00621489683787028
sim_compute_performance-ego_mean0.006141988237698874
sim_compute_performance-ego_median0.006208390394846598
sim_compute_performance-ego_min0.005936275323232015
sim_compute_sim_state_max0.041483829816182455
sim_compute_sim_state_mean0.037132299343744915
sim_compute_sim_state_median0.036314889192581176
sim_compute_sim_state_min0.034415589173634846
sim_render-ego_max0.009811304410298665
sim_render-ego_mean0.009184252619743347
sim_render-ego_median0.009284889698028565
sim_render-ego_min0.008355926672617595
simulation-passed1
step_physics_max0.12028019984563192
step_physics_mean0.1133065434296926
step_physics_median0.11482528169949847
step_physics_min0.10329541047414144
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4371611721Melisande Tengsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:13:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5852188629358517
survival_time_median14.950000000000076
deviation-center-line_median0.5500509659461502
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.029379854202270503
agent_compute-ego_mean0.028163750569025675
agent_compute-ego_median0.028405208587646485
agent_compute-ego_min0.026464730898539224
complete-iteration_max0.37622251907984416
complete-iteration_mean0.35190833230813345
complete-iteration_median0.35118856390317277
complete-iteration_min0.329033682346344
deviation-center-line_max0.7780249903959773
deviation-center-line_mean0.5208322860245025
deviation-center-line_min0.20520222180973213
deviation-heading_max4.167273437144325
deviation-heading_mean2.6171256706592816
deviation-heading_median2.168426925670261
deviation-heading_min1.96437539415228
driven_any_max1.7982480539099923
driven_any_mean1.6851129381731829
driven_any_median1.7067430193391488
driven_any_min1.5287176601044423
driven_lanedir_consec_max1.775594404304636
driven_lanedir_consec_mean1.4572062887325172
driven_lanedir_consec_min0.8827930247537293
driven_lanedir_max1.775594404304636
driven_lanedir_mean1.4572062887325172
driven_lanedir_median1.5852188629358517
driven_lanedir_min0.8827930247537293
get_duckie_state_max2.925395965576172e-06
get_duckie_state_mean2.8820832570393883e-06
get_duckie_state_median2.889235814412435e-06
get_duckie_state_min2.82446543375651e-06
get_robot_state_max0.024173916180928547
get_robot_state_mean0.023626962701479595
get_robot_state_median0.023551814953486124
get_robot_state_min0.02323030471801758
get_state_dump_max0.020289056301116944
get_state_dump_mean0.02000950972239177
get_state_dump_median0.01995065887769063
get_state_dump_min0.019847664833068848
get_ui_image_max0.06336718877156576
get_ui_image_mean0.058396489818890895
get_ui_image_median0.05878915071487427
get_ui_image_min0.05264046907424927
in-drivable-lane_max6.350000000000026
in-drivable-lane_mean1.5875000000000066
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.5287176601044423, "get_ui_image": 0.05264046907424927, "step_physics": 0.14019150495529176, "survival_time": 14.950000000000076, "driven_lanedir": 1.4222866420239235, "get_state_dump": 0.01993099848429362, "sim_render-ego": 0.010031329790751138, "get_robot_state": 0.02371154308319092, "get_duckie_state": 2.85943349202474e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027615044116973877, "deviation-heading": 4.167273437144325, "complete-iteration": 0.329033682346344, "set_robot_commands": 0.008123102188110352, "deviation-center-line": 0.7780249903959773, "driven_lanedir_consec": 1.4222866420239235, "sim_compute_sim_state": 0.04010281244913737, "sim_compute_performance-ego": 0.006509318351745606}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.77248618548102, "get_ui_image": 0.06199318250020345, "step_physics": 0.15864454269409178, "survival_time": 14.950000000000076, "driven_lanedir": 1.7481510838477798, "get_state_dump": 0.01997031927108765, "sim_render-ego": 0.010538953145345052, "get_robot_state": 0.024173916180928547, "get_duckie_state": 2.9190381368001304e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029195373058319093, "deviation-heading": 2.1479950413202906, "complete-iteration": 0.3616435861587524, "set_robot_commands": 0.008660918871561686, "deviation-center-line": 0.20520222180973213, "driven_lanedir_consec": 1.7481510838477798, "sim_compute_sim_state": 0.04145753145217895, "sim_compute_performance-ego": 0.006824232737223307}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.6409998531972776, "get_ui_image": 0.06336718877156576, "step_physics": 0.17348483482996624, "survival_time": 14.950000000000076, "driven_lanedir": 0.8827930247537293, "get_state_dump": 0.019847664833068848, "sim_render-ego": 0.010644276142120362, "get_robot_state": 0.02323030471801758, "get_duckie_state": 2.82446543375651e-06, "in-drivable-lane": 6.350000000000026, "agent_compute-ego": 0.029379854202270503, "deviation-heading": 2.1888588100202315, "complete-iteration": 0.37622251907984416, "set_robot_commands": 0.008872904777526856, "deviation-center-line": 0.7218872901512932, "driven_lanedir_consec": 0.8827930247537293, "sim_compute_sim_state": 0.040588742097218834, "sim_compute_performance-ego": 0.006622988382975261}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.7982480539099923, "get_ui_image": 0.05558511892954508, "step_physics": 0.14562852223714193, "survival_time": 14.950000000000076, "driven_lanedir": 1.775594404304636, "get_state_dump": 0.020289056301116944, "sim_render-ego": 0.009995110829671224, "get_robot_state": 0.02339208682378133, "get_duckie_state": 2.925395965576172e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026464730898539224, "deviation-heading": 1.96437539415228, "complete-iteration": 0.3407335416475932, "set_robot_commands": 0.0078801163037618, "deviation-center-line": 0.3782146417410072, "driven_lanedir_consec": 1.775594404304636, "sim_compute_sim_state": 0.04490385373433431, "sim_compute_performance-ego": 0.006413023471832275}}
set_robot_commands_max0.008872904777526856
set_robot_commands_mean0.008384260535240173
set_robot_commands_median0.008392010529836019
set_robot_commands_min0.0078801163037618
sim_compute_performance-ego_max0.006824232737223307
sim_compute_performance-ego_mean0.006592390735944112
sim_compute_performance-ego_median0.006566153367360434
sim_compute_performance-ego_min0.006413023471832275
sim_compute_sim_state_max0.04490385373433431
sim_compute_sim_state_mean0.04176323493321737
sim_compute_sim_state_median0.04102313677469889
sim_compute_sim_state_min0.04010281244913737
sim_render-ego_max0.010644276142120362
sim_render-ego_mean0.010302417476971944
sim_render-ego_median0.010285141468048094
sim_render-ego_min0.009995110829671224
simulation-passed1
step_physics_max0.17348483482996624
step_physics_mean0.15448735117912293
step_physics_median0.15213653246561687
step_physics_min0.14019150495529176
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4368011715Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:13:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7255251764902133
survival_time_median14.950000000000076
deviation-center-line_median0.8299632334620424
in-drivable-lane_median1.550000000000022


other stats
agent_compute-ego_max0.03039318084716797
agent_compute-ego_mean0.02840532620747884
agent_compute-ego_median0.0286431618531545
agent_compute-ego_min0.02594180027643839
complete-iteration_max0.37847564697265623
complete-iteration_mean0.3528475552797318
complete-iteration_median0.36846888025601704
complete-iteration_min0.29597681363423667
deviation-center-line_max1.010747130745184
deviation-center-line_mean0.8621230417473484
deviation-center-line_min0.7778185693201252
deviation-heading_max5.590042859289391
deviation-heading_mean4.38520259176895
deviation-heading_median4.152465100139599
deviation-heading_min3.645837307507207
driven_any_max3.685523806383762
driven_any_mean3.3944088187750636
driven_any_median3.389483730625459
driven_any_min3.1131440074655745
driven_lanedir_consec_max3.3529227872915603
driven_lanedir_consec_mean2.6772237563408594
driven_lanedir_consec_min1.9049218850914504
driven_lanedir_max3.3529227872915603
driven_lanedir_mean2.6772237563408594
driven_lanedir_median2.7255251764902133
driven_lanedir_min1.9049218850914504
get_duckie_state_max3.0954678853352863e-06
get_duckie_state_mean2.9907623926798504e-06
get_duckie_state_median2.9714902242024743e-06
get_duckie_state_min2.924601236979167e-06
get_robot_state_max0.024221111138661704
get_robot_state_mean0.023464636206626893
get_robot_state_median0.0234354301293691
get_robot_state_min0.022766573429107664
get_state_dump_max0.020002652804056803
get_state_dump_mean0.019939241806666057
get_state_dump_median0.019961893161137896
get_state_dump_min0.019830528100331625
get_ui_image_max0.06182791550954183
get_ui_image_mean0.05655201574166616
get_ui_image_median0.05849883596102397
get_ui_image_min0.04738247553507487
in-drivable-lane_max4.7500000000000675
in-drivable-lane_mean1.962500000000028
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.581642152678274, "get_ui_image": 0.04738247553507487, "step_physics": 0.1166749103864034, "survival_time": 14.950000000000076, "driven_lanedir": 3.3529227872915603, "get_state_dump": 0.019993663628896076, "sim_render-ego": 0.009679712454477948, "get_robot_state": 0.022766573429107664, "get_duckie_state": 2.9460589090983075e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02594180027643839, "deviation-heading": 4.387281542268498, "complete-iteration": 0.29597681363423667, "set_robot_commands": 0.007687854766845703, "deviation-center-line": 1.010747130745184, "driven_lanedir_consec": 3.3529227872915603, "sim_compute_sim_state": 0.03926208893458048, "sim_compute_performance-ego": 0.006404996713002523}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.1131440074655745, "get_ui_image": 0.05747765938440959, "step_physics": 0.1644100507100423, "survival_time": 14.950000000000076, "driven_lanedir": 2.729431000957269, "get_state_dump": 0.01993012269337972, "sim_render-ego": 0.010366992155710856, "get_robot_state": 0.024221111138661704, "get_duckie_state": 3.0954678853352863e-06, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.03039318084716797, "deviation-heading": 5.590042859289391, "complete-iteration": 0.3655500586827596, "set_robot_commands": 0.008800218105316162, "deviation-center-line": 0.8365044144688927, "driven_lanedir_consec": 2.729431000957269, "sim_compute_sim_state": 0.04286036888758341, "sim_compute_performance-ego": 0.006905363400777181}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.1973253085726445, "get_ui_image": 0.06182791550954183, "step_physics": 0.1676831062634786, "survival_time": 14.950000000000076, "driven_lanedir": 1.9049218850914504, "get_state_dump": 0.020002652804056803, "sim_render-ego": 0.010508557955423992, "get_robot_state": 0.023649967511494955, "get_duckie_state": 2.924601236979167e-06, "in-drivable-lane": 4.7500000000000675, "agent_compute-ego": 0.02877790927886963, "deviation-heading": 3.645837307507207, "complete-iteration": 0.3713877018292745, "set_robot_commands": 0.008515096505482992, "deviation-center-line": 0.7778185693201252, "driven_lanedir_consec": 1.9049218850914504, "sim_compute_sim_state": 0.04348381757736206, "sim_compute_performance-ego": 0.006752411524454753}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.685523806383762, "get_ui_image": 0.05952001253763835, "step_physics": 0.17015657504399617, "survival_time": 14.950000000000076, "driven_lanedir": 2.7216193520231577, "get_state_dump": 0.019830528100331625, "sim_render-ego": 0.01044960101445516, "get_robot_state": 0.023220892747243246, "get_duckie_state": 2.9969215393066407e-06, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.02850841442743937, "deviation-heading": 3.9176486580107, "complete-iteration": 0.37847564697265623, "set_robot_commands": 0.008535810311635335, "deviation-center-line": 0.8234220524551921, "driven_lanedir_consec": 2.7216193520231577, "sim_compute_sim_state": 0.05119838794072469, "sim_compute_performance-ego": 0.006866658528645833}}
set_robot_commands_max0.008800218105316162
set_robot_commands_mean0.008384744922320048
set_robot_commands_median0.008525453408559164
set_robot_commands_min0.007687854766845703
sim_compute_performance-ego_max0.006905363400777181
sim_compute_performance-ego_mean0.006732357541720073
sim_compute_performance-ego_median0.0068095350265502935
sim_compute_performance-ego_min0.006404996713002523
sim_compute_sim_state_max0.05119838794072469
sim_compute_sim_state_mean0.04420116583506266
sim_compute_sim_state_median0.04317209323247274
sim_compute_sim_state_min0.03926208893458048
sim_render-ego_max0.010508557955423992
sim_render-ego_mean0.010251215895016989
sim_render-ego_median0.010408296585083007
sim_render-ego_min0.009679712454477948
simulation-passed1
step_physics_max0.17015657504399617
step_physics_mean0.15473116060098013
step_physics_median0.1660465784867605
step_physics_min0.1166749103864034
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4366911711Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6918007112103934
survival_time_median14.950000000000076
deviation-center-line_median0.4756156415760951
in-drivable-lane_median4.575000000000044


other stats
agent_compute-ego_max0.025793259143829347
agent_compute-ego_mean0.02534579822650323
agent_compute-ego_median0.02527609565319159
agent_compute-ego_min0.025037742455800375
complete-iteration_max0.29196797529856366
complete-iteration_mean0.28661320211031494
complete-iteration_median0.28657061378161114
complete-iteration_min0.281343605579474
deviation-center-line_max0.9822077883108185
deviation-center-line_mean0.5383502844145258
deviation-center-line_min0.21996206619509423
deviation-heading_max3.1877164272742635
deviation-heading_mean1.9546275927046872
deviation-heading_median1.7258125621523537
deviation-heading_min1.1791688192397791
driven_any_max3.68319260206954
driven_any_mean2.5944035936686634
driven_any_median2.423238731747261
driven_any_min1.8479443091105912
driven_lanedir_consec_max3.615643311582078
driven_lanedir_consec_mean2.068718946068139
driven_lanedir_consec_min1.2756310502696904
driven_lanedir_max3.615643311582078
driven_lanedir_mean2.068718946068139
driven_lanedir_median1.6918007112103934
driven_lanedir_min1.2756310502696904
get_duckie_state_max2.889144114958934e-06
get_duckie_state_mean2.834078593131824e-06
get_duckie_state_median2.8236707051595053e-06
get_duckie_state_min2.799828847249349e-06
get_robot_state_max0.02439772410270495
get_robot_state_mean0.02281863660384447
get_robot_state_median0.0230257252852122
get_robot_state_min0.020825371742248536
get_state_dump_max0.020254781918647963
get_state_dump_mean0.01981345173640129
get_state_dump_median0.01975312113761902
get_state_dump_min0.019492782751719156
get_ui_image_max0.04458294947942098
get_ui_image_mean0.04430948605904213
get_ui_image_median0.044495213429133096
get_ui_image_min0.04366456789848132
in-drivable-lane_max7.0500000000000975
in-drivable-lane_mean4.050000000000047
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8479443091105912, "get_ui_image": 0.04366456789848132, "step_physics": 0.10772446241134252, "survival_time": 9.750000000000004, "driven_lanedir": 1.2756310502696904, "get_state_dump": 0.020254781918647963, "sim_render-ego": 0.00958570944957244, "get_robot_state": 0.02439772410270495, "get_duckie_state": 2.889144114958934e-06, "in-drivable-lane": 4.050000000000016, "agent_compute-ego": 0.025265994438758262, "deviation-heading": 1.320875496647251, "complete-iteration": 0.281343605579474, "set_robot_commands": 0.008142346602219802, "deviation-center-line": 0.21996206619509423, "driven_lanedir_consec": 1.2756310502696904, "sim_compute_sim_state": 0.036004809844188204, "sim_compute_performance-ego": 0.006109363604814578}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8047611416202933, "get_ui_image": 0.0444698969523112, "step_physics": 0.1110142175356547, "survival_time": 14.950000000000076, "driven_lanedir": 1.9914119020966168, "get_state_dump": 0.019492782751719156, "sim_render-ego": 0.00972223122914632, "get_robot_state": 0.023892388343811036, "get_duckie_state": 2.799828847249349e-06, "in-drivable-lane": 7.0500000000000975, "agent_compute-ego": 0.025037742455800375, "deviation-heading": 1.1791688192397791, "complete-iteration": 0.2840460522969564, "set_robot_commands": 0.00781958262125651, "deviation-center-line": 0.2960485683609206, "driven_lanedir_consec": 1.9914119020966168, "sim_compute_sim_state": 0.036225580374399824, "sim_compute_performance-ego": 0.006178085803985596}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.041716321874228, "get_ui_image": 0.044520529905954995, "step_physics": 0.11681254784266154, "survival_time": 14.950000000000076, "driven_lanedir": 1.39218952032417, "get_state_dump": 0.019910210768381755, "sim_render-ego": 0.009516974290211996, "get_robot_state": 0.022159062226613364, "get_duckie_state": 2.8133392333984377e-06, "in-drivable-lane": 5.1000000000000725, "agent_compute-ego": 0.025793259143829347, "deviation-heading": 3.1877164272742635, "complete-iteration": 0.2890951752662659, "set_robot_commands": 0.007490353584289551, "deviation-center-line": 0.6551827147912697, "driven_lanedir_consec": 1.39218952032417, "sim_compute_sim_state": 0.03641398350397746, "sim_compute_performance-ego": 0.006281471252441407}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.68319260206954, "get_ui_image": 0.04458294947942098, "step_physics": 0.1180143404006958, "survival_time": 14.950000000000076, "driven_lanedir": 3.615643311582078, "get_state_dump": 0.019596031506856283, "sim_render-ego": 0.008930160999298095, "get_robot_state": 0.020825371742248536, "get_duckie_state": 2.834002176920573e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02528619686762492, "deviation-heading": 2.130749627657456, "complete-iteration": 0.29196797529856366, "set_robot_commands": 0.007203261852264404, "deviation-center-line": 0.9822077883108185, "driven_lanedir_consec": 3.615643311582078, "sim_compute_sim_state": 0.04114707231521606, "sim_compute_performance-ego": 0.006187005043029785}}
set_robot_commands_max0.008142346602219802
set_robot_commands_mean0.007663886165007568
set_robot_commands_median0.00765496810277303
set_robot_commands_min0.007203261852264404
sim_compute_performance-ego_max0.006281471252441407
sim_compute_performance-ego_mean0.00618898142606784
sim_compute_performance-ego_median0.00618254542350769
sim_compute_performance-ego_min0.006109363604814578
sim_compute_sim_state_max0.04114707231521606
sim_compute_sim_state_mean0.03744786150944539
sim_compute_sim_state_median0.03631978193918864
sim_compute_sim_state_min0.036004809844188204
sim_render-ego_max0.00972223122914632
sim_render-ego_mean0.009438768992057214
sim_render-ego_median0.00955134186989222
sim_render-ego_min0.008930160999298095
simulation-passed1
step_physics_max0.1180143404006958
step_physics_mean0.11339139204758863
step_physics_median0.11391338268915813
step_physics_min0.10772446241134252
survival_time_max14.950000000000076
survival_time_mean13.65000000000006
survival_time_min9.750000000000004
No reset possible
4365511707Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1967268810090363
survival_time_median14.950000000000076
deviation-center-line_median0.5311393509273786
in-drivable-lane_median2.4000000000000195


other stats
agent_compute-ego_max0.025970063186044175
agent_compute-ego_mean0.025722379678575866
agent_compute-ego_median0.025749459266662597
agent_compute-ego_min0.025420536994934084
complete-iteration_max0.3211160413424174
complete-iteration_mean0.3085173472806151
complete-iteration_median0.3117793659369151
complete-iteration_min0.28939461590621274
deviation-center-line_max0.7446276789771187
deviation-center-line_mean0.5249076006324515
deviation-center-line_min0.2927240216979298
deviation-heading_max4.20710016248728
deviation-heading_mean2.858324733051548
deviation-heading_median2.875194348951588
deviation-heading_min1.4758100718157343
driven_any_max3.2141597057765297
driven_any_mean2.67331059771064
driven_any_median2.703130695372989
driven_any_min2.0728212943200517
driven_lanedir_consec_max3.144730954511744
driven_lanedir_consec_mean2.2222060542912416
driven_lanedir_consec_min1.35063950063515
driven_lanedir_max3.144730954511744
driven_lanedir_mean2.2439592873900502
driven_lanedir_median2.2402333472066536
driven_lanedir_min1.35063950063515
get_duckie_state_max2.991358439127604e-06
get_duckie_state_mean2.9386577543562466e-06
get_duckie_state_median2.941985435673756e-06
get_duckie_state_min2.8793017069498697e-06
get_robot_state_max0.02486336390177409
get_robot_state_mean0.0238725330265872
get_robot_state_median0.0235802916352972
get_robot_state_min0.023466184933980307
get_state_dump_max0.02002468188603719
get_state_dump_mean0.019919555032586033
get_state_dump_median0.01991395998862381
get_state_dump_min0.01982561826705933
get_ui_image_max0.049705123901367186
get_ui_image_mean0.048178736369793834
get_ui_image_median0.0487290887037913
get_ui_image_min0.045551644170225544
in-drivable-lane_max4.000000000000057
in-drivable-lane_mean2.200000000000024
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.0728212943200517, "get_ui_image": 0.045551644170225544, "step_physics": 0.11303038902470632, "survival_time": 10.15000000000001, "driven_lanedir": 1.35063950063515, "get_state_dump": 0.019917953190545144, "sim_render-ego": 0.009582553591047014, "get_robot_state": 0.023614755404993817, "get_duckie_state": 2.9538065341893087e-06, "in-drivable-lane": 3.750000000000024, "agent_compute-ego": 0.025970063186044175, "deviation-heading": 1.4758100718157343, "complete-iteration": 0.28939461590621274, "set_robot_commands": 0.008145450958477452, "deviation-center-line": 0.2927240216979298, "driven_lanedir_consec": 1.35063950063515, "sim_compute_sim_state": 0.03701534059834598, "sim_compute_performance-ego": 0.006377686420684965}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2141597057765297, "get_ui_image": 0.049705123901367186, "step_physics": 0.12679712851842245, "survival_time": 14.950000000000076, "driven_lanedir": 3.144730954511744, "get_state_dump": 0.019909966786702475, "sim_render-ego": 0.009879430929819744, "get_robot_state": 0.02486336390177409, "get_duckie_state": 2.991358439127604e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025420536994934084, "deviation-heading": 2.687213805793359, "complete-iteration": 0.30879008769989014, "set_robot_commands": 0.007867200374603272, "deviation-center-line": 0.6184760294733649, "driven_lanedir_consec": 3.144730954511744, "sim_compute_sim_state": 0.03775576194127401, "sim_compute_performance-ego": 0.006405522028605143}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5029424705097627, "get_ui_image": 0.048295950094858806, "step_physics": 0.13313955863316854, "survival_time": 14.950000000000076, "driven_lanedir": 1.8796115691624824, "get_state_dump": 0.02002468188603719, "sim_render-ego": 0.010062917868296306, "get_robot_state": 0.023545827865600583, "get_duckie_state": 2.8793017069498697e-06, "in-drivable-lane": 4.000000000000057, "agent_compute-ego": 0.02595908800760905, "deviation-heading": 3.063174892109817, "complete-iteration": 0.31476864417394, "set_robot_commands": 0.008124638398488362, "deviation-center-line": 0.4438026723813924, "driven_lanedir_consec": 1.8796115691624824, "sim_compute_sim_state": 0.03911263545354207, "sim_compute_performance-ego": 0.0063172523180643715}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.903318920236215, "get_ui_image": 0.049162227312723794, "step_physics": 0.13480296452840168, "survival_time": 14.950000000000076, "driven_lanedir": 2.6008551252508245, "get_state_dump": 0.01982561826705933, "sim_render-ego": 0.009838965733846027, "get_robot_state": 0.023466184933980307, "get_duckie_state": 2.930164337158203e-06, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.025539830525716147, "deviation-heading": 4.20710016248728, "complete-iteration": 0.3211160413424174, "set_robot_commands": 0.007914944489796957, "deviation-center-line": 0.7446276789771187, "driven_lanedir_consec": 2.5138421928555905, "sim_compute_sim_state": 0.04402841647466024, "sim_compute_performance-ego": 0.006352541446685791}}
set_robot_commands_max0.008145450958477452
set_robot_commands_mean0.008013058555341512
set_robot_commands_median0.008019791444142658
set_robot_commands_min0.007867200374603272
sim_compute_performance-ego_max0.006405522028605143
sim_compute_performance-ego_mean0.006363250553510068
sim_compute_performance-ego_median0.006365113933685378
sim_compute_performance-ego_min0.0063172523180643715
sim_compute_sim_state_max0.04402841647466024
sim_compute_sim_state_mean0.03947803861695558
sim_compute_sim_state_median0.03843419869740804
sim_compute_sim_state_min0.03701534059834598
sim_render-ego_max0.010062917868296306
sim_render-ego_mean0.009840967030752271
sim_render-ego_median0.009859198331832889
sim_render-ego_min0.009582553591047014
simulation-passed1
step_physics_max0.13480296452840168
step_physics_mean0.12694251017617475
step_physics_median0.1299683435757955
step_physics_min0.11303038902470632
survival_time_max14.950000000000076
survival_time_mean13.75000000000006
survival_time_min10.15000000000001
No reset possible
4365211705brian wongbaseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:02:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 236, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 23, in init
             ||     self.check_gpu_available(context)
             ||   File "solution.py", line 43, in check_gpu_available
             ||     raise Exception(msg)
             || Exception: I need a GPU; bailing.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 23, in init
             || |     self.check_gpu_available(context)
             || |   File "solution.py", line 43, in check_gpu_available
             || |     raise Exception(msg)
             || | Exception: I need a GPU; bailing.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4364411703Mo Kleit πŸ‡¨πŸ‡¦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7136553280581173
survival_time_median14.950000000000076
deviation-center-line_median0.4078823771784714
in-drivable-lane_median6.575000000000077


other stats
agent_compute-ego_max0.02563182751337687
agent_compute-ego_mean0.025504637757937113
agent_compute-ego_median0.02550766030947367
agent_compute-ego_min0.02537140289942423
complete-iteration_max0.31733216365178424
complete-iteration_mean0.31101774056752524
complete-iteration_median0.3107851560910543
complete-iteration_min0.3051684864362081
deviation-center-line_max0.6271646887362533
deviation-center-line_mean0.42496707288745167
deviation-center-line_min0.25693884845661047
deviation-heading_max2.878254091155856
deviation-heading_mean2.0548553179055986
deviation-heading_median1.9758711128579456
deviation-heading_min1.3894249547506492
driven_any_max3.8797063225465105
driven_any_mean3.872891559935863
driven_any_median3.879436397161072
driven_any_min3.852987122874799
driven_lanedir_consec_max3.548200688568337
driven_lanedir_consec_mean1.9395709364512344
driven_lanedir_consec_min0.7827724011203671
driven_lanedir_max3.548200688568337
driven_lanedir_mean2.0881412999649807
driven_lanedir_median2.0033081850795824
driven_lanedir_min0.797748141132422
get_duckie_state_max2.905527750651042e-06
get_duckie_state_mean2.8600295384724935e-06
get_duckie_state_median2.8940041859944662e-06
get_duckie_state_min2.74658203125e-06
get_robot_state_max0.02491271177927653
get_robot_state_mean0.023472179571787516
get_robot_state_median0.02317723035812378
get_robot_state_min0.022621545791625976
get_state_dump_max0.020002423922220867
get_state_dump_mean0.019956772526105247
get_state_dump_median0.01995813012123108
get_state_dump_min0.019908405939737955
get_ui_image_max0.0498423171043396
get_ui_image_mean0.04885280867417653
get_ui_image_median0.0487051506837209
get_ui_image_min0.048158616224924726
in-drivable-lane_max11.000000000000073
in-drivable-lane_mean6.237500000000058
in-drivable-lane_min0.8000000000000114
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.852987122874799, "get_ui_image": 0.048158616224924726, "step_physics": 0.13102371136347452, "survival_time": 14.950000000000076, "driven_lanedir": 1.4333115625145885, "get_state_dump": 0.020002423922220867, "sim_render-ego": 0.00954275369644165, "get_robot_state": 0.022621545791625976, "get_duckie_state": 2.891222635904948e-06, "in-drivable-lane": 8.800000000000091, "agent_compute-ego": 0.02537140289942423, "deviation-heading": 1.3894249547506492, "complete-iteration": 0.3088840730985006, "set_robot_commands": 0.007628845373789469, "deviation-center-line": 0.25693884845661047, "driven_lanedir_consec": 1.4333115625145885, "sim_compute_sim_state": 0.038049844106038413, "sim_compute_performance-ego": 0.0063041893641153975}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.8797063225465105, "get_ui_image": 0.04895848353703817, "step_physics": 0.12546005964279175, "survival_time": 14.950000000000076, "driven_lanedir": 3.548200688568337, "get_state_dump": 0.019966940879821777, "sim_render-ego": 0.00971951405207316, "get_robot_state": 0.02333202362060547, "get_duckie_state": 2.8967857360839845e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.025392659505208335, "deviation-heading": 2.878254091155856, "complete-iteration": 0.3051684864362081, "set_robot_commands": 0.007792940139770508, "deviation-center-line": 0.6271646887362533, "driven_lanedir_consec": 3.548200688568337, "sim_compute_sim_state": 0.038044823010762535, "sim_compute_performance-ego": 0.006319629351298014}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.8792279595029617, "get_ui_image": 0.0498423171043396, "step_physics": 0.13584272782007853, "survival_time": 14.950000000000076, "driven_lanedir": 0.797748141132422, "get_state_dump": 0.019908405939737955, "sim_render-ego": 0.009833015600840251, "get_robot_state": 0.02302243709564209, "get_duckie_state": 2.74658203125e-06, "in-drivable-lane": 11.000000000000073, "agent_compute-ego": 0.02563182751337687, "deviation-heading": 1.447010436208805, "complete-iteration": 0.31733216365178424, "set_robot_commands": 0.007743748823801676, "deviation-center-line": 0.2650718191275059, "driven_lanedir_consec": 0.7827724011203671, "sim_compute_sim_state": 0.03911173105239868, "sim_compute_performance-ego": 0.006209062735239665}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.879644834819183, "get_ui_image": 0.04845181783040364, "step_physics": 0.1270525336265564, "survival_time": 14.950000000000076, "driven_lanedir": 2.573304807644576, "get_state_dump": 0.01994931936264038, "sim_render-ego": 0.009779555002848307, "get_robot_state": 0.02491271177927653, "get_duckie_state": 2.905527750651042e-06, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.025622661113739013, "deviation-heading": 2.504731789507086, "complete-iteration": 0.312686239083608, "set_robot_commands": 0.0077080599466959636, "deviation-center-line": 0.550692935229437, "driven_lanedir_consec": 1.9939990936016465, "sim_compute_sim_state": 0.04287351051966349, "sim_compute_performance-ego": 0.006151121457417806}}
set_robot_commands_max0.007792940139770508
set_robot_commands_mean0.007718398571014405
set_robot_commands_median0.007725904385248819
set_robot_commands_min0.007628845373789469
sim_compute_performance-ego_max0.006319629351298014
sim_compute_performance-ego_mean0.00624600072701772
sim_compute_performance-ego_median0.006256626049677531
sim_compute_performance-ego_min0.006151121457417806
sim_compute_sim_state_max0.04287351051966349
sim_compute_sim_state_mean0.03951997717221578
sim_compute_sim_state_median0.038580787579218546
sim_compute_sim_state_min0.038044823010762535
sim_render-ego_max0.009833015600840251
sim_render-ego_mean0.009718709588050845
sim_render-ego_median0.009749534527460734
sim_render-ego_min0.00954275369644165
simulation-passed1
step_physics_max0.13584272782007853
step_physics_mean0.12984475811322532
step_physics_median0.12903812249501545
step_physics_min0.12546005964279175
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4362711698Dishank Bansal πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.560427544668145
survival_time_median14.950000000000076
deviation-center-line_median0.8388635210670683
in-drivable-lane_median3.77500000000002


other stats
agent_compute-ego_max0.026200245221455892
agent_compute-ego_mean0.02572533905506134
agent_compute-ego_median0.0256376838684082
agent_compute-ego_min0.025425743261973065
complete-iteration_max0.27992178201675416
complete-iteration_mean0.26832750856876375
complete-iteration_median0.26651493946711224
complete-iteration_min0.26035837332407635
deviation-center-line_max0.8646717236137037
deviation-center-line_mean0.6685248217343888
deviation-center-line_min0.13170052118971465
deviation-heading_max2.839504042516463
deviation-heading_mean1.9657636218966985
deviation-heading_median2.250809220940164
deviation-heading_min0.5219320031900025
driven_any_max5.707602745387382
driven_any_mean5.21938131715614
driven_any_median5.538475849089883
driven_any_min4.092970825057414
driven_lanedir_consec_max4.980077647601206
driven_lanedir_consec_mean3.694314717629314
driven_lanedir_consec_min0.6763261335797606
driven_lanedir_max4.980077647601206
driven_lanedir_mean3.694314717629314
driven_lanedir_median4.560427544668145
driven_lanedir_min0.6763261335797606
get_duckie_state_max3.77496083577474e-06
get_duckie_state_mean3.6784013112386062e-06
get_duckie_state_median3.671646118164062e-06
get_duckie_state_min3.5953521728515625e-06
get_robot_state_max0.01990007082621257
get_robot_state_mean0.019243669907251994
get_robot_state_median0.01906312982241313
get_robot_state_min0.01894834915796916
get_state_dump_max0.02027755578358968
get_state_dump_mean0.01950077970822652
get_state_dump_median0.01926715890566508
get_state_dump_min0.019191245237986248
get_ui_image_max0.044831019242604575
get_ui_image_mean0.04279147148132324
get_ui_image_median0.04225523670514425
get_ui_image_min0.0418243932723999
in-drivable-lane_max12.800000000000075
in-drivable-lane_mean5.575000000000031
in-drivable-lane_min1.950000000000008
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.597625739218286, "get_ui_image": 0.044831019242604575, "step_physics": 0.11033097743988036, "survival_time": 14.950000000000076, "driven_lanedir": 4.608338621259275, "get_state_dump": 0.02027755578358968, "sim_render-ego": 0.008764909108479818, "get_robot_state": 0.01990007082621257, "get_duckie_state": 3.70025634765625e-06, "in-drivable-lane": 3.6000000000000183, "agent_compute-ego": 0.025603831609090168, "deviation-heading": 2.4840594132311744, "complete-iteration": 0.27992178201675416, "set_robot_commands": 0.007051107088724772, "deviation-center-line": 0.8394119747331189, "driven_lanedir_consec": 4.608338621259275, "sim_compute_sim_state": 0.03681136290232341, "sim_compute_performance-ego": 0.0061644991238911945}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.479325958961479, "get_ui_image": 0.04243297974268596, "step_physics": 0.10061053991317748, "survival_time": 14.950000000000076, "driven_lanedir": 4.980077647601206, "get_state_dump": 0.019334819316864017, "sim_render-ego": 0.008238610426584879, "get_robot_state": 0.01909060080846151, "get_duckie_state": 3.77496083577474e-06, "in-drivable-lane": 1.950000000000008, "agent_compute-ego": 0.025425743261973065, "deviation-heading": 2.839504042516463, "complete-iteration": 0.26161970297495524, "set_robot_commands": 0.006503863334655762, "deviation-center-line": 0.8646717236137037, "driven_lanedir_consec": 4.980077647601206, "sim_compute_sim_state": 0.03387602249781291, "sim_compute_performance-ego": 0.005914166768391927}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.092970825057414, "get_ui_image": 0.0418243932723999, "step_physics": 0.10028244098027549, "survival_time": 14.950000000000076, "driven_lanedir": 0.6763261335797606, "get_state_dump": 0.019199498494466147, "sim_render-ego": 0.008385415871938069, "get_robot_state": 0.019035658836364745, "get_duckie_state": 3.5953521728515625e-06, "in-drivable-lane": 12.800000000000075, "agent_compute-ego": 0.02567153612772624, "deviation-heading": 0.5219320031900025, "complete-iteration": 0.26035837332407635, "set_robot_commands": 0.006891219615936279, "deviation-center-line": 0.13170052118971465, "driven_lanedir_consec": 0.6763261335797606, "sim_compute_sim_state": 0.032978227138519285, "sim_compute_performance-ego": 0.005895347595214844}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.707602745387382, "get_ui_image": 0.042077493667602536, "step_physics": 0.10464396953582764, "survival_time": 14.950000000000076, "driven_lanedir": 4.512516468077015, "get_state_dump": 0.019191245237986248, "sim_render-ego": 0.008196325302124023, "get_robot_state": 0.01894834915796916, "get_duckie_state": 3.643035888671875e-06, "in-drivable-lane": 3.9500000000000224, "agent_compute-ego": 0.026200245221455892, "deviation-heading": 2.0175590286491545, "complete-iteration": 0.2714101759592692, "set_robot_commands": 0.00652121384938558, "deviation-center-line": 0.8383150674010178, "driven_lanedir_consec": 4.512516468077015, "sim_compute_sim_state": 0.03950966914494832, "sim_compute_performance-ego": 0.005929962793986002}}
set_robot_commands_max0.007051107088724772
set_robot_commands_mean0.0067418509721755985
set_robot_commands_median0.006706216732660929
set_robot_commands_min0.006503863334655762
sim_compute_performance-ego_max0.0061644991238911945
sim_compute_performance-ego_mean0.005975994070370992
sim_compute_performance-ego_median0.0059220647811889645
sim_compute_performance-ego_min0.005895347595214844
sim_compute_sim_state_max0.03950966914494832
sim_compute_sim_state_mean0.03579382042090098
sim_compute_sim_state_median0.03534369270006815
sim_compute_sim_state_min0.032978227138519285
sim_render-ego_max0.008764909108479818
sim_render-ego_mean0.008396315177281698
sim_render-ego_median0.008312013149261475
sim_render-ego_min0.008196325302124023
simulation-passed1
step_physics_max0.11033097743988036
step_physics_mean0.10396698196729023
step_physics_median0.10262725472450256
step_physics_min0.10028244098027549
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4360811696Bhavya Patwa πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:12:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.513802963741092
survival_time_median14.950000000000076
deviation-center-line_median0.34700867175428834
in-drivable-lane_median1.40000000000002


other stats
agent_compute-ego_max0.028281520207722986
agent_compute-ego_mean0.02707328259944915
agent_compute-ego_median0.027158410946528114
agent_compute-ego_min0.025694788297017417
complete-iteration_max0.36503846406936646
complete-iteration_mean0.3380591843525569
complete-iteration_median0.3358954441547394
complete-iteration_min0.31540738503138227
deviation-center-line_max0.8117922424091002
deviation-center-line_mean0.4052056836660268
deviation-center-line_min0.1150131487464302
deviation-heading_max3.1722818548469753
deviation-heading_mean1.9721523104253584
deviation-heading_median1.7431422900321114
deviation-heading_min1.2300428067902351
driven_any_max1.7630433723084915
driven_any_mean1.7108621492622116
driven_any_median1.704108120058939
driven_any_min1.672188984622476
driven_lanedir_consec_max1.7533229405892057
driven_lanedir_consec_mean1.4376459430892163
driven_lanedir_consec_min0.9696549042854764
driven_lanedir_max1.7533229405892057
driven_lanedir_mean1.4376459430892163
driven_lanedir_median1.513802963741092
driven_lanedir_min0.9696549042854764
get_duckie_state_max4.047552744547526e-06
get_duckie_state_mean4.002650578816732e-06
get_duckie_state_median4.017750422159831e-06
get_duckie_state_min3.9275487263997394e-06
get_robot_state_max0.024698636531829833
get_robot_state_mean0.023884362578392028
get_robot_state_median0.02394511381785075
get_robot_state_min0.022948586146036783
get_state_dump_max0.021553417841593425
get_state_dump_mean0.020398337841033936
get_state_dump_median0.0201526673634847
get_state_dump_min0.019734598795572916
get_ui_image_max0.061991860071818033
get_ui_image_mean0.05510797758897146
get_ui_image_median0.05599411567052205
get_ui_image_min0.04645181894302368
in-drivable-lane_max5.300000000000023
in-drivable-lane_mean2.0250000000000155
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.688246863990441, "get_ui_image": 0.061991860071818033, "step_physics": 0.16627657413482666, "survival_time": 14.950000000000076, "driven_lanedir": 1.3158432358445549, "get_state_dump": 0.019734598795572916, "sim_render-ego": 0.010544688701629638, "get_robot_state": 0.022948586146036783, "get_duckie_state": 3.9275487263997394e-06, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.028281520207722986, "deviation-heading": 2.247940091917887, "complete-iteration": 0.36503846406936646, "set_robot_commands": 0.00858262300491333, "deviation-center-line": 0.2841092775557331, "driven_lanedir_consec": 1.3158432358445549, "sim_compute_sim_state": 0.04004915952682495, "sim_compute_performance-ego": 0.006450039545694987}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.7199693761274366, "get_ui_image": 0.05806954701741537, "step_physics": 0.14584787686665854, "survival_time": 14.950000000000076, "driven_lanedir": 1.7117626916376287, "get_state_dump": 0.01998939832051595, "sim_render-ego": 0.010269691944122314, "get_robot_state": 0.023821091651916503, "get_duckie_state": 3.997484842936198e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02710741996765137, "deviation-heading": 1.238344488146336, "complete-iteration": 0.338512282371521, "set_robot_commands": 0.008273399670918783, "deviation-center-line": 0.1150131487464302, "driven_lanedir_consec": 1.7117626916376287, "sim_compute_sim_state": 0.03852468729019165, "sim_compute_performance-ego": 0.006431813240051269}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.672188984622476, "get_ui_image": 0.05391868432362874, "step_physics": 0.14227423350016277, "survival_time": 14.950000000000076, "driven_lanedir": 0.9696549042854764, "get_state_dump": 0.021553417841593425, "sim_render-ego": 0.010534426371256511, "get_robot_state": 0.024069135983784993, "get_duckie_state": 4.047552744547526e-06, "in-drivable-lane": 5.300000000000023, "agent_compute-ego": 0.027209401925404865, "deviation-heading": 3.1722818548469753, "complete-iteration": 0.3332786059379578, "set_robot_commands": 0.007992485364278157, "deviation-center-line": 0.8117922424091002, "driven_lanedir_consec": 0.9696549042854764, "sim_compute_sim_state": 0.03916850248972575, "sim_compute_performance-ego": 0.006378842194875081}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.7630433723084915, "get_ui_image": 0.04645181894302368, "step_physics": 0.13092135906219482, "survival_time": 14.950000000000076, "driven_lanedir": 1.7533229405892057, "get_state_dump": 0.02031593640645345, "sim_render-ego": 0.009767119884490966, "get_robot_state": 0.024698636531829833, "get_duckie_state": 4.038016001383464e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025694788297017417, "deviation-heading": 1.2300428067902351, "complete-iteration": 0.31540738503138227, "set_robot_commands": 0.008119834264119467, "deviation-center-line": 0.4099080659528436, "driven_lanedir_consec": 1.7533229405892057, "sim_compute_sim_state": 0.04303764899571737, "sim_compute_performance-ego": 0.006221080621083577}}
set_robot_commands_max0.00858262300491333
set_robot_commands_mean0.008242085576057434
set_robot_commands_median0.008196616967519124
set_robot_commands_min0.007992485364278157
sim_compute_performance-ego_max0.006450039545694987
sim_compute_performance-ego_mean0.006370443900426228
sim_compute_performance-ego_median0.006405327717463175
sim_compute_performance-ego_min0.006221080621083577
sim_compute_sim_state_max0.04303764899571737
sim_compute_sim_state_mean0.040194999575614926
sim_compute_sim_state_median0.03960883100827535
sim_compute_sim_state_min0.03852468729019165
sim_render-ego_max0.010544688701629638
sim_render-ego_mean0.010278981725374855
sim_render-ego_median0.010402059157689412
sim_render-ego_min0.009767119884490966
simulation-passed1
step_physics_max0.16627657413482666
step_physics_mean0.1463300108909607
step_physics_median0.14406105518341067
step_physics_min0.13092135906219482
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4352511687Dishank Bansal πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.500132990877237
survival_time_median14.950000000000076
deviation-center-line_median0.8720107474705301
in-drivable-lane_median0.7500000000000107


other stats
agent_compute-ego_max0.02767898400624593
agent_compute-ego_mean0.02704850587728765
agent_compute-ego_median0.02732066419687164
agent_compute-ego_min0.02587371110916138
complete-iteration_max0.34758483961726844
complete-iteration_mean0.31141627767559293
complete-iteration_median0.3159265724817912
complete-iteration_min0.266227126121521
deviation-center-line_max0.9977896434101275
deviation-center-line_mean0.809424109000598
deviation-center-line_min0.4958852976512043
deviation-heading_max3.9259557309999233
deviation-heading_mean2.953278891685159
deviation-heading_median3.0728718331812734
deviation-heading_min1.7414161693781651
driven_any_max4.339519677964534
driven_any_mean3.724276482335521
driven_any_median3.893493212760806
driven_any_min2.770599825855937
driven_lanedir_consec_max4.193134983560277
driven_lanedir_consec_mean3.414033729146597
driven_lanedir_consec_min2.4627339512716384
driven_lanedir_max4.193134983560277
driven_lanedir_mean3.414033729146597
driven_lanedir_median3.500132990877237
driven_lanedir_min2.4627339512716384
get_duckie_state_max2.845128377278646e-06
get_duckie_state_mean2.7101807826467222e-06
get_duckie_state_median2.690866198879056e-06
get_duckie_state_min2.61386235555013e-06
get_robot_state_max0.023582883095473385
get_robot_state_mean0.02231155718756972
get_robot_state_median0.023183104594548545
get_robot_state_min0.019297136465708416
get_state_dump_max0.020257205105899425
get_state_dump_mean0.019846042975057824
get_state_dump_median0.019905935923258462
get_state_dump_min0.019315094947814943
get_ui_image_max0.05406400124231974
get_ui_image_mean0.04890109244134096
get_ui_image_median0.04925615992438927
get_ui_image_min0.043028048674265545
in-drivable-lane_max1.7000000000000242
in-drivable-lane_mean0.8000000000000114
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.339519677964534, "get_ui_image": 0.043028048674265545, "step_physics": 0.101666366259257, "survival_time": 14.950000000000076, "driven_lanedir": 4.193134983560277, "get_state_dump": 0.019315094947814943, "sim_render-ego": 0.00841242790222168, "get_robot_state": 0.019297136465708416, "get_duckie_state": 2.845128377278646e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027030858993530273, "deviation-heading": 3.1886993515527995, "complete-iteration": 0.266227126121521, "set_robot_commands": 0.006769124666849772, "deviation-center-line": 0.9977896434101275, "driven_lanedir_consec": 4.193134983560277, "sim_compute_sim_state": 0.03453254540761312, "sim_compute_performance-ego": 0.005978399117787679}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.274944159948511, "get_ui_image": 0.04632004976272583, "step_physics": 0.1199901310602824, "survival_time": 14.950000000000076, "driven_lanedir": 4.018718868498716, "get_state_dump": 0.019932469526926677, "sim_render-ego": 0.009328784147898356, "get_robot_state": 0.02297216574350993, "get_duckie_state": 2.61386235555013e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.02587371110916138, "deviation-heading": 2.957044314809747, "complete-iteration": 0.2959573173522949, "set_robot_commands": 0.007397544384002685, "deviation-center-line": 0.9612897243740932, "driven_lanedir_consec": 4.018718868498716, "sim_compute_sim_state": 0.03771251281102499, "sim_compute_performance-ego": 0.006242964267730713}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5120422655731014, "get_ui_image": 0.05406400124231974, "step_physics": 0.14279534896214804, "survival_time": 14.950000000000076, "driven_lanedir": 2.981547113255758, "get_state_dump": 0.01987940231959025, "sim_render-ego": 0.010246977011362712, "get_robot_state": 0.023394043445587157, "get_duckie_state": 2.702871958414714e-06, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.02767898400624593, "deviation-heading": 3.9259557309999233, "complete-iteration": 0.33589582761128745, "set_robot_commands": 0.008619004090627035, "deviation-center-line": 0.7827317705669667, "driven_lanedir_consec": 2.981547113255758, "sim_compute_sim_state": 0.04240707794825236, "sim_compute_performance-ego": 0.006617801189422607}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.770599825855937, "get_ui_image": 0.05219227008605271, "step_physics": 0.15142811818069288, "survival_time": 8.899999999999991, "driven_lanedir": 2.4627339512716384, "get_state_dump": 0.020257205105899425, "sim_render-ego": 0.009888302074389512, "get_robot_state": 0.023582883095473385, "get_duckie_state": 2.678860439343399e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.027610469400213007, "deviation-heading": 1.7414161693781651, "complete-iteration": 0.34758483961726844, "set_robot_commands": 0.008122184303369416, "deviation-center-line": 0.4958852976512043, "driven_lanedir_consec": 2.4627339512716384, "sim_compute_sim_state": 0.04768041144596057, "sim_compute_performance-ego": 0.006627891840559713}}
set_robot_commands_max0.008619004090627035
set_robot_commands_mean0.007726964361212228
set_robot_commands_median0.00775986434368605
set_robot_commands_min0.006769124666849772
sim_compute_performance-ego_max0.006627891840559713
sim_compute_performance-ego_mean0.006366764103875177
sim_compute_performance-ego_median0.00643038272857666
sim_compute_performance-ego_min0.005978399117787679
sim_compute_sim_state_max0.04768041144596057
sim_compute_sim_state_mean0.04058313690321276
sim_compute_sim_state_median0.04005979537963868
sim_compute_sim_state_min0.03453254540761312
sim_render-ego_max0.010246977011362712
sim_render-ego_mean0.009469122783968064
sim_render-ego_median0.009608543111143937
sim_render-ego_min0.00841242790222168
simulation-passed1
step_physics_max0.15142811818069288
step_physics_mean0.1289699911155951
step_physics_median0.1313927400112152
step_physics_min0.101666366259257
survival_time_max14.950000000000076
survival_time_mean13.437500000000057
survival_time_min8.899999999999991
No reset possible
4350411683Dishank Bansal πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simabortednoafdaniele15-b9b1aef9b8fb-10:12:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.419247766050049
survival_time_median14.950000000000076
deviation-center-line_median0.7992234584854309
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.026705822944641112
agent_compute-ego_mean0.02586804250876109
agent_compute-ego_median0.025838663578033445
agent_compute-ego_min0.025089019934336345
complete-iteration_max0.33318517764409383
complete-iteration_mean0.31472372849782304
complete-iteration_median0.31022918661435445
complete-iteration_min0.3052513631184896
deviation-center-line_max0.90534788876898
deviation-center-line_mean0.8166302810800647
deviation-center-line_min0.7627263185804174
deviation-heading_max3.640328129719423
deviation-heading_mean3.127670329992992
deviation-heading_median3.1396468301610394
deviation-heading_min2.591059529930466
driven_any_max3.6571686527481657
driven_any_mean3.382978949744007
driven_any_median3.614929520285687
driven_any_min2.6448881056564884
driven_lanedir_consec_max3.584414022157737
driven_lanedir_consec_mean3.2389860629010254
driven_lanedir_consec_min2.5330346973462667
driven_lanedir_max3.584414022157737
driven_lanedir_mean3.2389860629010254
driven_lanedir_median3.419247766050049
driven_lanedir_min2.5330346973462667
get_duckie_state_max3.2790501912434897e-06
get_duckie_state_mean3.2154719034830733e-06
get_duckie_state_median3.1952063242594403e-06
get_duckie_state_min3.192424774169922e-06
get_robot_state_max0.02359190066655477
get_robot_state_mean0.023076586524645486
get_robot_state_median0.02306157827377319
get_robot_state_min0.022591288884480795
get_state_dump_max0.02017791986465454
get_state_dump_mean0.01977058708667755
get_state_dump_median0.01981269637743632
get_state_dump_min0.019279035727183026
get_ui_image_max0.05558327356974284
get_ui_image_mean0.05087971568107605
get_ui_image_median0.05063624302546184
get_ui_image_min0.04666310310363769
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean0.31250000000000444
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5991738890121487, "get_ui_image": 0.05558327356974284, "step_physics": 0.14603349685668943, "survival_time": 14.950000000000076, "driven_lanedir": 3.506817608099456, "get_state_dump": 0.019279035727183026, "sim_render-ego": 0.009820748964945477, "get_robot_state": 0.022591288884480795, "get_duckie_state": 3.192424774169922e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025761948426564533, "deviation-heading": 2.898387394299219, "complete-iteration": 0.33318517764409383, "set_robot_commands": 0.007775660355885824, "deviation-center-line": 0.90534788876898, "driven_lanedir_consec": 3.506817608099456, "sim_compute_sim_state": 0.03984100977579753, "sim_compute_performance-ego": 0.006321265697479248}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.6306851515592258, "get_ui_image": 0.05037870009740194, "step_physics": 0.12631768703460694, "survival_time": 14.950000000000076, "driven_lanedir": 3.331677924000642, "get_state_dump": 0.019649441242218017, "sim_render-ego": 0.009616812864939372, "get_robot_state": 0.022824045022328696, "get_duckie_state": 3.195603688557943e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.025089019934336345, "deviation-heading": 3.3809062660228593, "complete-iteration": 0.3052513631184896, "set_robot_commands": 0.00783679962158203, "deviation-center-line": 0.7627263185804174, "driven_lanedir_consec": 3.331677924000642, "sim_compute_sim_state": 0.03719454447428385, "sim_compute_performance-ego": 0.006166940530141195}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.6448881056564884, "get_ui_image": 0.05089378595352173, "step_physics": 0.13142911195755003, "survival_time": 14.950000000000076, "driven_lanedir": 2.5330346973462667, "get_state_dump": 0.02017791986465454, "sim_render-ego": 0.009837679068247476, "get_robot_state": 0.023299111525217693, "get_duckie_state": 3.1948089599609376e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02591537872950236, "deviation-heading": 3.640328129719423, "complete-iteration": 0.31340874433517457, "set_robot_commands": 0.007823069095611573, "deviation-center-line": 0.7772522756201937, "driven_lanedir_consec": 2.5330346973462667, "sim_compute_sim_state": 0.03768620173136393, "sim_compute_performance-ego": 0.006169505914052327}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.6571686527481657, "get_ui_image": 0.04666310310363769, "step_physics": 0.1228037921587626, "survival_time": 14.950000000000076, "driven_lanedir": 3.584414022157737, "get_state_dump": 0.019975951512654622, "sim_render-ego": 0.009746637344360352, "get_robot_state": 0.02359190066655477, "get_duckie_state": 3.2790501912434897e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026705822944641112, "deviation-heading": 2.591059529930466, "complete-iteration": 0.3070496288935343, "set_robot_commands": 0.007732156117757161, "deviation-center-line": 0.821194641350668, "driven_lanedir_consec": 3.584414022157737, "sim_compute_sim_state": 0.04331318934758504, "sim_compute_performance-ego": 0.0063358950614929195}}
set_robot_commands_max0.00783679962158203
set_robot_commands_mean0.0077919212977091475
set_robot_commands_median0.007799364725748699
set_robot_commands_min0.007732156117757161
sim_compute_performance-ego_max0.0063358950614929195
sim_compute_performance-ego_mean0.0062484018007914225
sim_compute_performance-ego_median0.006245385805765788
sim_compute_performance-ego_min0.006166940530141195
sim_compute_sim_state_max0.04331318934758504
sim_compute_sim_state_mean0.039508736332257585
sim_compute_sim_state_median0.03876360575358073
sim_compute_sim_state_min0.03719454447428385
sim_render-ego_max0.009837679068247476
sim_render-ego_mean0.009755469560623169
sim_render-ego_median0.009783693154652912
sim_render-ego_min0.009616812864939372
simulation-passed1
step_physics_max0.14603349685668943
step_physics_mean0.13164602200190226
step_physics_median0.1288733994960785
step_physics_min0.1228037921587626
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4348211681Dishank Bansal πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4679416885833523
survival_time_median14.950000000000076
deviation-center-line_median0.602088107362283
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.026294458707173667
agent_compute-ego_mean0.02585239887237549
agent_compute-ego_median0.025826951662699386
agent_compute-ego_min0.025461233456929525
complete-iteration_max0.27219401200612386
complete-iteration_mean0.26419820507367453
complete-iteration_median0.2626492198308309
complete-iteration_min0.2593003686269124
deviation-center-line_max0.662785586237747
deviation-center-line_mean0.5489628068179969
deviation-center-line_min0.3288894263096747
deviation-heading_max4.0544293421046085
deviation-heading_mean2.841616851597416
deviation-heading_median2.7039492889316494
deviation-heading_min1.9041394864217556
driven_any_max3.2034778629914595
driven_any_mean2.8040804355025073
driven_any_median3.012699554289406
driven_any_min1.987444770439757
driven_lanedir_consec_max3.1431805454348996
driven_lanedir_consec_mean2.496071861545552
driven_lanedir_consec_min1.9052235235806032
driven_lanedir_max3.1431805454348996
driven_lanedir_mean2.496071861545552
driven_lanedir_median2.4679416885833523
driven_lanedir_min1.9052235235806032
get_duckie_state_max2.8920173645019533e-06
get_duckie_state_mean2.8622150421142576e-06
get_duckie_state_median2.863009770711263e-06
get_duckie_state_min2.830823262532552e-06
get_robot_state_max0.019264101187388104
get_robot_state_mean0.019085115989049273
get_robot_state_median0.019058476289113363
get_robot_state_min0.018959410190582275
get_state_dump_max0.019184507528940836
get_state_dump_mean0.019139654835065207
get_state_dump_median0.019138696988423663
get_state_dump_min0.019096717834472657
get_ui_image_max0.04206010421117147
get_ui_image_mean0.04184479633967082
get_ui_image_median0.041815222899119056
get_ui_image_min0.04168863534927368
in-drivable-lane_max5.250000000000075
in-drivable-lane_mean1.3125000000000189
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.2034778629914595, "get_ui_image": 0.04184322913487752, "step_physics": 0.10243496338526407, "survival_time": 14.950000000000076, "driven_lanedir": 3.1431805454348996, "get_state_dump": 0.019143274625142415, "sim_render-ego": 0.008332577546437582, "get_robot_state": 0.019083118438720705, "get_duckie_state": 2.8920173645019533e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026294458707173667, "deviation-heading": 2.677712504520022, "complete-iteration": 0.26324830532073973, "set_robot_commands": 0.006731539567311605, "deviation-center-line": 0.6566854486484158, "driven_lanedir_consec": 3.1431805454348996, "sim_compute_sim_state": 0.033331265449523924, "sim_compute_performance-ego": 0.005868339538574218}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9119001478722852, "get_ui_image": 0.04206010421117147, "step_physics": 0.10032038768132528, "survival_time": 14.950000000000076, "driven_lanedir": 2.8551074338920803, "get_state_dump": 0.019096717834472657, "sim_render-ego": 0.008255098660786947, "get_robot_state": 0.019264101187388104, "get_duckie_state": 2.864201863606771e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025461233456929525, "deviation-heading": 2.730186073343277, "complete-iteration": 0.2593003686269124, "set_robot_commands": 0.00657908280690511, "deviation-center-line": 0.5474907660761503, "driven_lanedir_consec": 2.8551074338920803, "sim_compute_sim_state": 0.03218199173609416, "sim_compute_performance-ego": 0.005894843737284342}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.987444770439757, "get_ui_image": 0.04168863534927368, "step_physics": 0.10292715231577557, "survival_time": 14.950000000000076, "driven_lanedir": 1.9052235235806032, "get_state_dump": 0.019184507528940836, "sim_render-ego": 0.00819675842920939, "get_robot_state": 0.01903383413950602, "get_duckie_state": 2.830823262532552e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025953787167867025, "deviation-heading": 4.0544293421046085, "complete-iteration": 0.26205013434092206, "set_robot_commands": 0.006526198387145996, "deviation-center-line": 0.662785586237747, "driven_lanedir_consec": 1.9052235235806032, "sim_compute_sim_state": 0.03204385757446289, "sim_compute_performance-ego": 0.006309828758239746}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.113498960706527, "get_ui_image": 0.0417872166633606, "step_physics": 0.10880468765894571, "survival_time": 14.950000000000076, "driven_lanedir": 2.080775943274624, "get_state_dump": 0.019134119351704917, "sim_render-ego": 0.00810833772023519, "get_robot_state": 0.018959410190582275, "get_duckie_state": 2.8618176778157553e-06, "in-drivable-lane": 5.250000000000075, "agent_compute-ego": 0.02570011615753174, "deviation-heading": 1.9041394864217556, "complete-iteration": 0.27219401200612386, "set_robot_commands": 0.006579971313476563, "deviation-center-line": 0.3288894263096747, "driven_lanedir_consec": 2.080775943274624, "sim_compute_sim_state": 0.03712864557902018, "sim_compute_performance-ego": 0.005804440975189209}}
set_robot_commands_max0.006731539567311605
set_robot_commands_mean0.006604198018709819
set_robot_commands_median0.006579527060190837
set_robot_commands_min0.006526198387145996
sim_compute_performance-ego_max0.006309828758239746
sim_compute_performance-ego_mean0.005969363252321879
sim_compute_performance-ego_median0.005881591637929281
sim_compute_performance-ego_min0.005804440975189209
sim_compute_sim_state_max0.03712864557902018
sim_compute_sim_state_mean0.03367144008477529
sim_compute_sim_state_median0.03275662859280904
sim_compute_sim_state_min0.03204385757446289
sim_render-ego_max0.008332577546437582
sim_render-ego_mean0.008223193089167278
sim_render-ego_median0.008225928544998169
sim_render-ego_min0.00810833772023519
simulation-passed1
step_physics_max0.10880468765894571
step_physics_mean0.10362179776032764
step_physics_median0.1026810578505198
step_physics_min0.10032038768132528
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4347311677Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.604721601800138
survival_time_median14.950000000000076
deviation-center-line_median0.9436252065291212
in-drivable-lane_median1.7750000000000012


other stats
agent_compute-ego_max0.026204405625661217
agent_compute-ego_mean0.025777186813140784
agent_compute-ego_median0.02577796737353007
agent_compute-ego_min0.02534840687984178
complete-iteration_max0.27006579875946046
complete-iteration_mean0.2644317695022631
complete-iteration_median0.2634282744965967
complete-iteration_min0.2608047302563985
deviation-center-line_max1.3102780268614769
deviation-center-line_mean0.9359954019540568
deviation-center-line_min0.5464531678965079
deviation-heading_max3.207175646810396
deviation-heading_mean2.4897576374980557
deviation-heading_median2.357499250655499
deviation-heading_min2.0368564018708293
driven_any_max4.628143376737875
driven_any_mean4.337758257589654
driven_any_median4.423562587741685
driven_any_min3.87576447813737
driven_lanedir_consec_max4.362731573862568
driven_lanedir_consec_mean3.4434163872845267
driven_lanedir_consec_min2.2014907716752643
driven_lanedir_max4.362731573862568
driven_lanedir_mean3.7111120059505422
driven_lanedir_median4.140112839132168
driven_lanedir_min2.2014907716752643
get_duckie_state_max3.185272216796875e-06
get_duckie_state_mean3.0674086231477455e-06
get_duckie_state_median3.051667654213785e-06
get_duckie_state_min2.981026967366537e-06
get_robot_state_max0.019168376127878823
get_robot_state_mean0.01904151927690212
get_robot_state_median0.019011397361755368
get_robot_state_min0.018974906256218917
get_state_dump_max0.019512933095296225
get_state_dump_mean0.019333724491402547
get_state_dump_median0.019351945941855592
get_state_dump_min0.019118072986602785
get_ui_image_max0.04268328782891025
get_ui_image_mean0.04204801449421741
get_ui_image_median0.04194226662317912
get_ui_image_min0.04162423690160116
in-drivable-lane_max4.350000000000001
in-drivable-lane_mean1.975000000000001
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.87576447813737, "get_ui_image": 0.04268328782891025, "step_physics": 0.10113098441051836, "survival_time": 11.900000000000034, "driven_lanedir": 2.2014907716752643, "get_state_dump": 0.01931119566204167, "sim_render-ego": 0.008212973089779125, "get_robot_state": 0.018974906256218917, "get_duckie_state": 3.0062779658982733e-06, "in-drivable-lane": 4.350000000000001, "agent_compute-ego": 0.02534840687984178, "deviation-heading": 2.0368564018708293, "complete-iteration": 0.2622926245216562, "set_robot_commands": 0.006431112770272904, "deviation-center-line": 0.5464531678965079, "driven_lanedir_consec": 2.2014907716752643, "sim_compute_sim_state": 0.03366994657436339, "sim_compute_performance-ego": 0.006345065701909426}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.4579591121849464, "get_ui_image": 0.041938188870747885, "step_physics": 0.100051855246226, "survival_time": 14.950000000000076, "driven_lanedir": 4.362731573862568, "get_state_dump": 0.019118072986602785, "sim_render-ego": 0.008382124106089274, "get_robot_state": 0.018998327255249026, "get_duckie_state": 3.185272216796875e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02591402848561605, "deviation-heading": 2.6276494998382094, "complete-iteration": 0.2608047302563985, "set_robot_commands": 0.006838313738505046, "deviation-center-line": 1.3102780268614769, "driven_lanedir_consec": 4.362731573862568, "sim_compute_sim_state": 0.03340842405954997, "sim_compute_performance-ego": 0.00596837600072225}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.389166063298425, "get_ui_image": 0.04162423690160116, "step_physics": 0.1058566403388977, "survival_time": 14.950000000000076, "driven_lanedir": 3.969846428842297, "get_state_dump": 0.019392696221669514, "sim_render-ego": 0.008221520582834879, "get_robot_state": 0.019024467468261717, "get_duckie_state": 3.097057342529297e-06, "in-drivable-lane": 1.9000000000000083, "agent_compute-ego": 0.026204405625661217, "deviation-heading": 3.207175646810396, "complete-iteration": 0.26456392447153726, "set_robot_commands": 0.006745652357737223, "deviation-center-line": 0.8575402772736334, "driven_lanedir_consec": 2.899063954178235, "sim_compute_sim_state": 0.03139404455820719, "sim_compute_performance-ego": 0.005913705031077067}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.628143376737875, "get_ui_image": 0.04194634437561035, "step_physics": 0.10419444719950358, "survival_time": 14.950000000000076, "driven_lanedir": 4.31037924942204, "get_state_dump": 0.019512933095296225, "sim_render-ego": 0.008206046422322592, "get_robot_state": 0.019168376127878823, "get_duckie_state": 2.981026967366537e-06, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.02564190626144409, "deviation-heading": 2.087349001472788, "complete-iteration": 0.27006579875946046, "set_robot_commands": 0.006444172064463297, "deviation-center-line": 1.0297101357846092, "driven_lanedir_consec": 4.31037924942204, "sim_compute_sim_state": 0.038784575462341306, "sim_compute_performance-ego": 0.00598239262898763}}
set_robot_commands_max0.006838313738505046
set_robot_commands_mean0.006614812732744617
set_robot_commands_median0.00659491221110026
set_robot_commands_min0.006431112770272904
sim_compute_performance-ego_max0.006345065701909426
sim_compute_performance-ego_mean0.006052384840674093
sim_compute_performance-ego_median0.005975384314854939
sim_compute_performance-ego_min0.005913705031077067
sim_compute_sim_state_max0.038784575462341306
sim_compute_sim_state_mean0.03431424766361546
sim_compute_sim_state_median0.03353918531695668
sim_compute_sim_state_min0.03139404455820719
sim_render-ego_max0.008382124106089274
sim_render-ego_mean0.008255666050256467
sim_render-ego_median0.008217246836307002
sim_render-ego_min0.008206046422322592
simulation-passed1
step_physics_max0.1058566403388977
step_physics_mean0.1028084817987864
step_physics_median0.10266271580501096
step_physics_min0.100051855246226
survival_time_max14.950000000000076
survival_time_mean14.187500000000068
survival_time_min11.900000000000034
No reset possible
4346211678Himanshu Arora πŸ‡¨πŸ‡¦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9622947770933602
survival_time_median12.075000000000037
deviation-center-line_median0.2500618405718361
in-drivable-lane_median2.8000000000000305


other stats
agent_compute-ego_max0.026691132265588512
agent_compute-ego_mean0.025746217687492787
agent_compute-ego_median0.026043483018875123
agent_compute-ego_min0.024206772446632385
complete-iteration_max0.34346144676208495
complete-iteration_mean0.30955196416340997
complete-iteration_median0.3053070087425457
complete-iteration_min0.2841323924064636
deviation-center-line_max0.46370528605096706
deviation-center-line_mean0.29479243127862637
deviation-center-line_min0.21534075791986615
deviation-heading_max1.6549715854003595
deviation-heading_mean1.2258264516680706
deviation-heading_median1.1519416368005704
deviation-heading_min0.9444509476707824
driven_any_max2.0420928474331568
driven_any_mean1.510998531079193
driven_any_median1.633295731702682
driven_any_min0.7353098134782498
driven_lanedir_consec_max1.9375853186902925
driven_lanedir_consec_mean1.050646430263107
driven_lanedir_consec_min0.340410848175414
driven_lanedir_max1.9375853186902925
driven_lanedir_mean1.050646430263107
driven_lanedir_median0.9622947770933602
driven_lanedir_min0.340410848175414
get_duckie_state_max2.9158592224121095e-06
get_duckie_state_mean2.844975663514858e-06
get_duckie_state_median2.837791329338437e-06
get_duckie_state_min2.7884607729704483e-06
get_robot_state_max0.023833674589792887
get_robot_state_mean0.02274437721379055
get_robot_state_median0.02355476372483848
get_robot_state_min0.020034306815692356
get_state_dump_max0.020052075386047363
get_state_dump_mean0.01985063374042511
get_state_dump_median0.019912574688593546
get_state_dump_min0.019525310198465984
get_ui_image_max0.056382159823956696
get_ui_image_mean0.05086517063079413
get_ui_image_median0.051540546346278415
get_ui_image_min0.04399743000666301
in-drivable-lane_max6.249999999999998
in-drivable-lane_mean3.0875000000000163
in-drivable-lane_min0.5000000000000071
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.0281228727887375, "get_ui_image": 0.04399743000666301, "step_physics": 0.11085410118103028, "survival_time": 14.950000000000076, "driven_lanedir": 1.36386588784719, "get_state_dump": 0.019525310198465984, "sim_render-ego": 0.009550893306732176, "get_robot_state": 0.023833674589792887, "get_duckie_state": 2.9158592224121095e-06, "in-drivable-lane": 4.550000000000065, "agent_compute-ego": 0.02550197919209798, "deviation-heading": 1.1152325190350338, "complete-iteration": 0.2841323924064636, "set_robot_commands": 0.007778332233428955, "deviation-center-line": 0.22899319446651767, "driven_lanedir_consec": 1.36386588784719, "sim_compute_sim_state": 0.03671045780181885, "sim_compute_performance-ego": 0.006204862594604493}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.7353098134782498, "get_ui_image": 0.0482514181307384, "step_physics": 0.11629979312419891, "survival_time": 5.599999999999988, "driven_lanedir": 0.5607236663395305, "get_state_dump": 0.019968688488006592, "sim_render-ego": 0.00891547543661935, "get_robot_state": 0.020034306815692356, "get_duckie_state": 2.837606838771275e-06, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.024206772446632385, "deviation-heading": 1.1886507545661071, "complete-iteration": 0.28512461696352276, "set_robot_commands": 0.007058066981179374, "deviation-center-line": 0.27113048667715456, "driven_lanedir_consec": 0.5607236663395305, "sim_compute_sim_state": 0.03296459785529545, "sim_compute_performance-ego": 0.007254455770765032}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.2384685906166266, "get_ui_image": 0.056382159823956696, "step_physics": 0.138584201750548, "survival_time": 9.199999999999996, "driven_lanedir": 0.340410848175414, "get_state_dump": 0.020052075386047363, "sim_render-ego": 0.00987682783085367, "get_robot_state": 0.02331938173459924, "get_duckie_state": 2.7884607729704483e-06, "in-drivable-lane": 6.249999999999998, "agent_compute-ego": 0.026691132265588512, "deviation-heading": 0.9444509476707824, "complete-iteration": 0.3254894005215686, "set_robot_commands": 0.00804495941037717, "deviation-center-line": 0.21534075791986615, "driven_lanedir_consec": 0.340410848175414, "sim_compute_sim_state": 0.03617765592492145, "sim_compute_performance-ego": 0.006188313598218171}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0420928474331568, "get_ui_image": 0.05482967456181844, "step_physics": 0.14652007261912028, "survival_time": 14.950000000000076, "driven_lanedir": 1.9375853186902925, "get_state_dump": 0.019856460889180503, "sim_render-ego": 0.009986727237701417, "get_robot_state": 0.02379014571507772, "get_duckie_state": 2.837975819905599e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.02658498684565226, "deviation-heading": 1.6549715854003595, "complete-iteration": 0.34346144676208495, "set_robot_commands": 0.008105138937632242, "deviation-center-line": 0.46370528605096706, "driven_lanedir_consec": 1.9375853186902925, "sim_compute_sim_state": 0.047127149899800616, "sim_compute_performance-ego": 0.006485701402028402}}
set_robot_commands_max0.008105138937632242
set_robot_commands_mean0.007746624390654435
set_robot_commands_median0.007911645821903063
set_robot_commands_min0.007058066981179374
sim_compute_performance-ego_max0.007254455770765032
sim_compute_performance-ego_mean0.006533333341404024
sim_compute_performance-ego_median0.006345281998316447
sim_compute_performance-ego_min0.006188313598218171
sim_compute_sim_state_max0.047127149899800616
sim_compute_sim_state_mean0.038244965370459086
sim_compute_sim_state_median0.03644405686337015
sim_compute_sim_state_min0.03296459785529545
sim_render-ego_max0.009986727237701417
sim_render-ego_mean0.009582480952976652
sim_render-ego_median0.009713860568792924
sim_render-ego_min0.00891547543661935
simulation-passed1
step_physics_max0.14652007261912028
step_physics_mean0.12806454216872437
step_physics_median0.12744199743737344
step_physics_min0.11085410118103028
survival_time_max14.950000000000076
survival_time_mean11.175000000000034
survival_time_min5.599999999999988
No reset possible
4344011671Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:12:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.461978562720896
survival_time_median14.950000000000076
deviation-center-line_median1.066827233445338
in-drivable-lane_median1.8000000000000025


other stats
agent_compute-ego_max0.029414634704589843
agent_compute-ego_mean0.02772723813851674
agent_compute-ego_median0.02787964463233948
agent_compute-ego_min0.02573502858479818
complete-iteration_max0.34157734711964927
complete-iteration_mean0.32896055638790134
complete-iteration_median0.32766912857691444
complete-iteration_min0.31892662127812704
deviation-center-line_max1.2983950417959926
deviation-center-line_mean1.089821220200757
deviation-center-line_min0.9272353721163576
deviation-heading_max3.6149610773039424
deviation-heading_mean3.215500888283223
deviation-heading_median3.255851410906509
deviation-heading_min2.7353396540159305
driven_any_max4.7829743142752426
driven_any_mean4.350822329099462
driven_any_median4.5012407468938935
driven_any_min3.617833508334819
driven_lanedir_consec_max4.183702935876692
driven_lanedir_consec_mean3.5461301359525517
driven_lanedir_consec_min3.076860482491722
driven_lanedir_max4.183702935876692
driven_lanedir_mean3.5461301359525517
driven_lanedir_median3.461978562720896
driven_lanedir_min3.076860482491722
get_duckie_state_max3.1248728434244793e-06
get_duckie_state_mean3.0541419982910153e-06
get_duckie_state_median3.052552541097005e-06
get_duckie_state_min2.986590067545573e-06
get_robot_state_max0.02383804718653361
get_robot_state_mean0.02333573838075002
get_robot_state_median0.023430554072062175
get_robot_state_min0.02264379819234212
get_state_dump_max0.01998198588689168
get_state_dump_mean0.019720844626426696
get_state_dump_median0.019660286903381348
get_state_dump_min0.019580818812052408
get_ui_image_max0.054777398109436035
get_ui_image_mean0.0520671280225118
get_ui_image_median0.05205928842226665
get_ui_image_min0.04937253713607788
in-drivable-lane_max3.9000000000000146
in-drivable-lane_mean1.9625000000000048
in-drivable-lane_min0.34999999999999876
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.7829743142752426, "get_ui_image": 0.05169845183690389, "step_physics": 0.12919018030166626, "survival_time": 14.950000000000076, "driven_lanedir": 3.184322325224476, "get_state_dump": 0.01998198588689168, "sim_render-ego": 0.010082087516784667, "get_robot_state": 0.02383804718653361, "get_duckie_state": 3.0740102132161457e-06, "in-drivable-lane": 3.9000000000000146, "agent_compute-ego": 0.029414634704589843, "deviation-heading": 3.339390332267474, "complete-iteration": 0.32097179810206095, "set_robot_commands": 0.008035722573598227, "deviation-center-line": 0.9272353721163576, "driven_lanedir_consec": 3.184322325224476, "sim_compute_sim_state": 0.04169382254282634, "sim_compute_performance-ego": 0.0068429350852966305}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.444001582488931, "get_ui_image": 0.054777398109436035, "step_physics": 0.15102991263071697, "survival_time": 14.950000000000076, "driven_lanedir": 4.183702935876692, "get_state_dump": 0.019580818812052408, "sim_render-ego": 0.009987529118855792, "get_robot_state": 0.02264379819234212, "get_duckie_state": 3.0310948689778645e-06, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.02865019957224528, "deviation-heading": 3.1723124895455443, "complete-iteration": 0.34157734711964927, "set_robot_commands": 0.008529841899871826, "deviation-center-line": 1.2983950417959926, "driven_lanedir_consec": 4.183702935876692, "sim_compute_sim_state": 0.03976653734842936, "sim_compute_performance-ego": 0.006419166723887126}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.617833508334819, "get_ui_image": 0.052420125007629395, "step_physics": 0.14485380013783772, "survival_time": 14.950000000000076, "driven_lanedir": 3.076860482491722, "get_state_dump": 0.01967456022898356, "sim_render-ego": 0.010066200892130532, "get_robot_state": 0.02320574363072713, "get_duckie_state": 3.1248728434244793e-06, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.027109089692433676, "deviation-heading": 3.6149610773039424, "complete-iteration": 0.334366459051768, "set_robot_commands": 0.008023515542348226, "deviation-center-line": 0.9988970739643784, "driven_lanedir_consec": 3.076860482491722, "sim_compute_sim_state": 0.04226616144180298, "sim_compute_performance-ego": 0.006547094186147054}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.558479911298856, "get_ui_image": 0.04937253713607788, "step_physics": 0.13081332365671794, "survival_time": 14.950000000000076, "driven_lanedir": 3.739634800217315, "get_state_dump": 0.019646013577779137, "sim_render-ego": 0.009818183581034342, "get_robot_state": 0.023655364513397215, "get_duckie_state": 2.986590067545573e-06, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.02573502858479818, "deviation-heading": 2.7353396540159305, "complete-iteration": 0.31892662127812704, "set_robot_commands": 0.007980480194091796, "deviation-center-line": 1.1347573929262975, "driven_lanedir_consec": 3.739634800217315, "sim_compute_sim_state": 0.045418333212534585, "sim_compute_performance-ego": 0.006294275919596354}}
set_robot_commands_max0.008529841899871826
set_robot_commands_mean0.008142390052477518
set_robot_commands_median0.008029619057973225
set_robot_commands_min0.007980480194091796
sim_compute_performance-ego_max0.0068429350852966305
sim_compute_performance-ego_mean0.006525867978731791
sim_compute_performance-ego_median0.00648313045501709
sim_compute_performance-ego_min0.006294275919596354
sim_compute_sim_state_max0.045418333212534585
sim_compute_sim_state_mean0.04228621363639831
sim_compute_sim_state_median0.041979991992314655
sim_compute_sim_state_min0.03976653734842936
sim_render-ego_max0.010082087516784667
sim_render-ego_mean0.009988500277201334
sim_render-ego_median0.010026865005493164
sim_render-ego_min0.009818183581034342
simulation-passed1
step_physics_max0.15102991263071697
step_physics_mean0.13897180418173471
step_physics_median0.13783356189727783
step_physics_min0.12919018030166626
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4340711670Mo Kleit πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7335098048042665
survival_time_median14.950000000000076
deviation-center-line_median0.44248945472341394
in-drivable-lane_median1.8500000000000216


other stats
agent_compute-ego_max0.028376320203145344
agent_compute-ego_mean0.027203188866607903
agent_compute-ego_median0.027359967490499335
agent_compute-ego_min0.0257165002822876
complete-iteration_max0.34793844444807187
complete-iteration_mean0.3198025981169339
complete-iteration_median0.334352023601532
complete-iteration_min0.26256790081659953
deviation-center-line_max0.7063906815526103
deviation-center-line_mean0.4539927701162585
deviation-center-line_min0.2246014894655959
deviation-heading_max2.9249333913860016
deviation-heading_mean1.9962098757755775
deviation-heading_median2.0827334030176266
deviation-heading_min0.8944393056810561
driven_any_max3.8797602019268274
driven_any_mean3.597616969443289
driven_any_median3.873118255831293
driven_any_min2.7644711641837447
driven_lanedir_consec_max3.755084125666425
driven_lanedir_consec_mean2.5033251570800186
driven_lanedir_consec_min0.7911968930451174
driven_lanedir_max3.755084125666425
driven_lanedir_mean2.5033251570800186
driven_lanedir_median2.7335098048042665
driven_lanedir_min0.7911968930451174
get_duckie_state_max2.9508272806803386e-06
get_duckie_state_mean2.890834512636643e-06
get_duckie_state_median2.8979963110398875e-06
get_duckie_state_min2.816518147786458e-06
get_robot_state_max0.02353739516679631
get_robot_state_mean0.02190367563750393
get_robot_state_median0.022514906326929728
get_robot_state_min0.019047494729359946
get_state_dump_max0.01982274293899536
get_state_dump_mean0.019480611857517743
get_state_dump_median0.019505415711292003
get_state_dump_min0.019088873068491614
get_ui_image_max0.05351188739140828
get_ui_image_mean0.050073113386021106
get_ui_image_median0.05236292510069618
get_ui_image_min0.04205471595128377
in-drivable-lane_max11.300000000000075
in-drivable-lane_mean3.75000000000003
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.867024885176981, "get_ui_image": 0.04205471595128377, "step_physics": 0.10179311196009318, "survival_time": 14.950000000000076, "driven_lanedir": 3.755084125666425, "get_state_dump": 0.019088873068491614, "sim_render-ego": 0.008376107215881348, "get_robot_state": 0.019047494729359946, "get_duckie_state": 2.9508272806803386e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0257165002822876, "deviation-heading": 2.8872631663939448, "complete-iteration": 0.26256790081659953, "set_robot_commands": 0.00654501756032308, "deviation-center-line": 0.7063906815526103, "driven_lanedir_consec": 3.755084125666425, "sim_compute_sim_state": 0.033845762411753334, "sim_compute_performance-ego": 0.005908340613047282}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.8797602019268274, "get_ui_image": 0.051557486852010094, "step_physics": 0.1391133975982666, "survival_time": 14.950000000000076, "driven_lanedir": 3.444714639058733, "get_state_dump": 0.019441025257110597, "sim_render-ego": 0.009779893557230633, "get_robot_state": 0.021837608814239504, "get_duckie_state": 2.816518147786458e-06, "in-drivable-lane": 1.1500000000000077, "agent_compute-ego": 0.027329943974812827, "deviation-heading": 2.9249333913860016, "complete-iteration": 0.32328936100006106, "set_robot_commands": 0.007993366718292236, "deviation-center-line": 0.6276174169338384, "driven_lanedir_consec": 3.444714639058733, "sim_compute_sim_state": 0.03965716361999512, "sim_compute_performance-ego": 0.006396740277608236}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.879211626485604, "get_ui_image": 0.05351188739140828, "step_physics": 0.1523537548383077, "survival_time": 14.950000000000076, "driven_lanedir": 0.7911968930451174, "get_state_dump": 0.01982274293899536, "sim_render-ego": 0.010203649202982584, "get_robot_state": 0.023192203839619955, "get_duckie_state": 2.9460589090983075e-06, "in-drivable-lane": 11.300000000000075, "agent_compute-ego": 0.028376320203145344, "deviation-heading": 0.8944393056810561, "complete-iteration": 0.3454146862030029, "set_robot_commands": 0.00825407107671102, "deviation-center-line": 0.2246014894655959, "driven_lanedir_consec": 0.7911968930451174, "sim_compute_sim_state": 0.04290968100229899, "sim_compute_performance-ego": 0.006602416038513184}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7644711641837447, "get_ui_image": 0.05316836334938227, "step_physics": 0.15312403967214186, "survival_time": 10.750000000000018, "driven_lanedir": 2.0223049705497997, "get_state_dump": 0.019569806165473404, "sim_render-ego": 0.010067313216453376, "get_robot_state": 0.02353739516679631, "get_duckie_state": 2.849933712981468e-06, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.02738999100618584, "deviation-heading": 1.278203639641308, "complete-iteration": 0.34793844444807187, "set_robot_commands": 0.008228154515111169, "deviation-center-line": 0.25736149251298945, "driven_lanedir_consec": 2.0223049705497997, "sim_compute_sim_state": 0.04632842817971872, "sim_compute_performance-ego": 0.006335605576980946}}
set_robot_commands_max0.00825407107671102
set_robot_commands_mean0.007755152467609376
set_robot_commands_median0.008110760616701702
set_robot_commands_min0.00654501756032308
sim_compute_performance-ego_max0.006602416038513184
sim_compute_performance-ego_mean0.0063107756265374125
sim_compute_performance-ego_median0.006366172927294591
sim_compute_performance-ego_min0.005908340613047282
sim_compute_sim_state_max0.04632842817971872
sim_compute_sim_state_mean0.040685258803441544
sim_compute_sim_state_median0.04128342231114705
sim_compute_sim_state_min0.033845762411753334
sim_render-ego_max0.010203649202982584
sim_render-ego_mean0.009606740798136984
sim_render-ego_median0.009923603386842002
sim_render-ego_min0.008376107215881348
simulation-passed1
step_physics_max0.15312403967214186
step_physics_mean0.13659607601720233
step_physics_median0.14573357621828714
step_physics_min0.10179311196009318
survival_time_max14.950000000000076
survival_time_mean13.900000000000064
survival_time_min10.750000000000018
No reset possible
4339311667Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:12:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1545782333009464
survival_time_median14.950000000000076
deviation-center-line_median0.9674233851133134
in-drivable-lane_median2.725000000000023


other stats
agent_compute-ego_max0.02534813086191813
agent_compute-ego_mean0.0251229198773702
agent_compute-ego_median0.02513108770052592
agent_compute-ego_min0.024881373246510824
complete-iteration_max0.3151478576660156
complete-iteration_mean0.3079244973262151
complete-iteration_median0.30628493626912434
complete-iteration_min0.3039802591005961
deviation-center-line_max1.3189042610044936
deviation-center-line_mean1.0072332448079424
deviation-center-line_min0.7751819480006492
deviation-heading_max3.365114717644468
deviation-heading_mean2.7861322182412356
deviation-heading_median2.7723836956162886
deviation-heading_min2.2346467640878966
driven_any_max4.874805733578859
driven_any_mean4.322634160497725
driven_any_median4.586544567117192
driven_any_min3.2426417741776605
driven_lanedir_consec_max4.224902194044191
driven_lanedir_consec_mean3.044626864300822
driven_lanedir_consec_min1.6444487965572054
driven_lanedir_max4.224902194044191
driven_lanedir_mean3.4180742812506812
driven_lanedir_median3.2120470582039276
driven_lanedir_min3.0233008145506792
get_duckie_state_max3.019173940022786e-06
get_duckie_state_mean2.9422839482625323e-06
get_duckie_state_median2.9420852661132812e-06
get_duckie_state_min2.865791320800781e-06
get_robot_state_max0.024343191782633465
get_robot_state_mean0.02411270121733348
get_robot_state_median0.02416366895039877
get_robot_state_min0.023780275185902915
get_state_dump_max0.020387880007425942
get_state_dump_mean0.020005113681157427
get_state_dump_median0.019989996751149493
get_state_dump_min0.019652581214904784
get_ui_image_max0.04874254624048869
get_ui_image_mean0.04797294278939565
get_ui_image_median0.04795644919077555
get_ui_image_min0.04723632653554281
in-drivable-lane_max5.000000000000012
in-drivable-lane_mean2.850000000000014
in-drivable-lane_min0.9499999999999966
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.874805733578859, "get_ui_image": 0.04723632653554281, "step_physics": 0.1243196431795756, "survival_time": 14.950000000000076, "driven_lanedir": 3.1211348378155335, "get_state_dump": 0.020387880007425942, "sim_render-ego": 0.01015567382176717, "get_robot_state": 0.024343191782633465, "get_duckie_state": 3.019173940022786e-06, "in-drivable-lane": 5.000000000000012, "agent_compute-ego": 0.02534813086191813, "deviation-heading": 2.9173687661395102, "complete-iteration": 0.30588465213775634, "set_robot_commands": 0.008036166032155356, "deviation-center-line": 0.7751819480006492, "driven_lanedir_consec": 1.6444487965572054, "sim_compute_sim_state": 0.03953713734944662, "sim_compute_performance-ego": 0.006340672969818115}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.722731315288327, "get_ui_image": 0.04874254624048869, "step_physics": 0.1257349157333374, "survival_time": 14.950000000000076, "driven_lanedir": 3.3029592785923216, "get_state_dump": 0.019652581214904784, "sim_render-ego": 0.010151318709055585, "get_robot_state": 0.024340022404988608, "get_duckie_state": 2.865791320800781e-06, "in-drivable-lane": 4.500000000000036, "agent_compute-ego": 0.0250058913230896, "deviation-heading": 3.365114717644468, "complete-iteration": 0.30668522040049234, "set_robot_commands": 0.007931857109069825, "deviation-center-line": 0.9249973123856804, "driven_lanedir_consec": 3.285855652051214, "sim_compute_sim_state": 0.03823152144749959, "sim_compute_performance-ego": 0.006714412371317546}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2426417741776605, "get_ui_image": 0.04779600461324056, "step_physics": 0.12422817548116048, "survival_time": 14.950000000000076, "driven_lanedir": 3.0233008145506792, "get_state_dump": 0.020171544551849364, "sim_render-ego": 0.010020872751871746, "get_robot_state": 0.02398731549580892, "get_duckie_state": 2.8705596923828123e-06, "in-drivable-lane": 0.95000000000001, "agent_compute-ego": 0.02525628407796224, "deviation-heading": 2.6273986250930665, "complete-iteration": 0.3039802591005961, "set_robot_commands": 0.007827121416727702, "deviation-center-line": 1.0098494578409465, "driven_lanedir_consec": 3.0233008145506792, "sim_compute_sim_state": 0.03832401355107625, "sim_compute_performance-ego": 0.006186618804931641}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.450357818946057, "get_ui_image": 0.04811689376831055, "step_physics": 0.13038994153340658, "survival_time": 14.950000000000076, "driven_lanedir": 4.224902194044191, "get_state_dump": 0.019808448950449625, "sim_render-ego": 0.009931314786275227, "get_robot_state": 0.023780275185902915, "get_duckie_state": 3.01361083984375e-06, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.024881373246510824, "deviation-heading": 2.2346467640878966, "complete-iteration": 0.3151478576660156, "set_robot_commands": 0.00798300822575887, "deviation-center-line": 1.3189042610044936, "driven_lanedir_consec": 4.224902194044191, "sim_compute_sim_state": 0.04382031917572021, "sim_compute_performance-ego": 0.006252951622009277}}
set_robot_commands_max0.008036166032155356
set_robot_commands_mean0.007944538195927938
set_robot_commands_median0.007957432667414346
set_robot_commands_min0.007827121416727702
sim_compute_performance-ego_max0.006714412371317546
sim_compute_performance-ego_mean0.006373663942019145
sim_compute_performance-ego_median0.006296812295913696
sim_compute_performance-ego_min0.006186618804931641
sim_compute_sim_state_max0.04382031917572021
sim_compute_sim_state_mean0.039978247880935666
sim_compute_sim_state_median0.038930575450261434
sim_compute_sim_state_min0.03823152144749959
sim_render-ego_max0.01015567382176717
sim_render-ego_mean0.010064795017242433
sim_render-ego_median0.010086095730463663
sim_render-ego_min0.009931314786275227
simulation-passed1
step_physics_max0.13038994153340658
step_physics_mean0.12616816898187003
step_physics_median0.1250272794564565
step_physics_min0.12422817548116048
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4335111663Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:13:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.683611456437253
survival_time_median14.950000000000076
deviation-center-line_median1.147235854587246
in-drivable-lane_median1.874999999999996


other stats
agent_compute-ego_max0.02828483978907267
agent_compute-ego_mean0.026845209399859113
agent_compute-ego_median0.0266042423248291
agent_compute-ego_min0.025887513160705568
complete-iteration_max0.379594243367513
complete-iteration_mean0.3312256894508998
complete-iteration_median0.3334101374944051
complete-iteration_min0.2784882394472758
deviation-center-line_max1.2170797719616042
deviation-center-line_mean1.156268854417938
deviation-center-line_min1.1135239365356562
deviation-heading_max4.686148457178746
deviation-heading_mean3.0608032953881033
deviation-heading_median2.5350755226605104
deviation-heading_min2.486913679052646
driven_any_max4.7192781136266495
driven_any_mean4.212832679017376
driven_any_median4.381172980672773
driven_any_min3.369706641097309
driven_lanedir_consec_max4.2551231339140685
driven_lanedir_consec_mean3.4132193423781203
driven_lanedir_consec_min2.030531322723907
driven_lanedir_max4.2551231339140685
driven_lanedir_mean3.6160827968237688
driven_lanedir_median3.683611456437253
driven_lanedir_min2.8419851405065018
get_duckie_state_max3.0271212259928387e-06
get_duckie_state_mean2.951423327128093e-06
get_duckie_state_median2.9420852661132812e-06
get_duckie_state_min2.894401550292969e-06
get_robot_state_max0.023657589753468832
get_robot_state_mean0.023096509973208112
get_robot_state_median0.02320387681325277
get_robot_state_min0.022320696512858073
get_state_dump_max0.020075713793436686
get_state_dump_mean0.01973127285639445
get_state_dump_median0.01971499522527059
get_state_dump_min0.019419387181599936
get_ui_image_max0.060209627946217856
get_ui_image_mean0.05290109694004059
get_ui_image_median0.05370430469512939
get_ui_image_min0.043986150423685706
in-drivable-lane_max3.1000000000000023
in-drivable-lane_mean2.0249999999999977
in-drivable-lane_min1.2499999999999956
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.7192781136266495, "get_ui_image": 0.043986150423685706, "step_physics": 0.10628342310587566, "survival_time": 14.950000000000076, "driven_lanedir": 3.6918486909775914, "get_state_dump": 0.019419387181599936, "sim_render-ego": 0.009386025269826253, "get_robot_state": 0.022320696512858073, "get_duckie_state": 2.9269854227701824e-06, "in-drivable-lane": 3.1000000000000023, "agent_compute-ego": 0.025887513160705568, "deviation-heading": 2.5221050047489415, "complete-iteration": 0.2784882394472758, "set_robot_commands": 0.007662821610768636, "deviation-center-line": 1.2170797719616042, "driven_lanedir_consec": 3.6918486909775914, "sim_compute_sim_state": 0.037240742842356366, "sim_compute_performance-ego": 0.006107542514801025}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.234472175243566, "get_ui_image": 0.05332641919453939, "step_physics": 0.14374749660491942, "survival_time": 14.950000000000076, "driven_lanedir": 3.675374221896913, "get_state_dump": 0.01984572331110637, "sim_render-ego": 0.010065003236134847, "get_robot_state": 0.02321349541346232, "get_duckie_state": 3.0271212259928387e-06, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.026883591016133628, "deviation-heading": 2.5480460405720797, "complete-iteration": 0.33248947699864706, "set_robot_commands": 0.00816775401433309, "deviation-center-line": 1.1135239365356562, "driven_lanedir_consec": 3.675374221896913, "sim_compute_sim_state": 0.04060618241628011, "sim_compute_performance-ego": 0.006443819999694824}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.369706641097309, "get_ui_image": 0.0540821901957194, "step_physics": 0.14660363912582397, "survival_time": 14.950000000000076, "driven_lanedir": 2.8419851405065018, "get_state_dump": 0.019584267139434813, "sim_render-ego": 0.01033182700475057, "get_robot_state": 0.023194258213043217, "get_duckie_state": 2.894401550292969e-06, "in-drivable-lane": 1.7499999999999991, "agent_compute-ego": 0.02632489363352458, "deviation-heading": 4.686148457178746, "complete-iteration": 0.3343307979901632, "set_robot_commands": 0.008109769821166991, "deviation-center-line": 1.177571763220714, "driven_lanedir_consec": 2.030531322723907, "sim_compute_sim_state": 0.03942066033681234, "sim_compute_performance-ego": 0.006487667560577393}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.5278737861019795, "get_ui_image": 0.060209627946217856, "step_physics": 0.16886555274327597, "survival_time": 14.950000000000076, "driven_lanedir": 4.2551231339140685, "get_state_dump": 0.020075713793436686, "sim_render-ego": 0.010342480341593425, "get_robot_state": 0.023657589753468832, "get_duckie_state": 2.9571851094563804e-06, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.02828483978907267, "deviation-heading": 2.486913679052646, "complete-iteration": 0.379594243367513, "set_robot_commands": 0.008819611072540283, "deviation-center-line": 1.116899945953778, "driven_lanedir_consec": 4.2551231339140685, "sim_compute_sim_state": 0.05250155131022136, "sim_compute_performance-ego": 0.006639850934346517}}
set_robot_commands_max0.008819611072540283
set_robot_commands_mean0.00818998912970225
set_robot_commands_median0.00813876191775004
set_robot_commands_min0.007662821610768636
sim_compute_performance-ego_max0.006639850934346517
sim_compute_performance-ego_mean0.006419720252354939
sim_compute_performance-ego_median0.006465743780136108
sim_compute_performance-ego_min0.006107542514801025
sim_compute_sim_state_max0.05250155131022136
sim_compute_sim_state_mean0.04244228422641755
sim_compute_sim_state_median0.040013421376546225
sim_compute_sim_state_min0.037240742842356366
sim_render-ego_max0.010342480341593425
sim_render-ego_mean0.010031333963076277
sim_render-ego_median0.010198415120442708
sim_render-ego_min0.009386025269826253
simulation-passed1
step_physics_max0.16886555274327597
step_physics_mean0.14137502789497375
step_physics_median0.1451755678653717
step_physics_min0.10628342310587566
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4334411660Melisande Tengsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.359617323416125
survival_time_median14.950000000000076
deviation-center-line_median0.7822971176088461
in-drivable-lane_median0.7250000000000103


other stats
agent_compute-ego_max0.026599845091501872
agent_compute-ego_mean0.02617919325828552
agent_compute-ego_median0.02614000121752421
agent_compute-ego_min0.025836925506591796
complete-iteration_max0.29215400536855063
complete-iteration_mean0.271645951072375
complete-iteration_median0.26753190358479817
complete-iteration_min0.25936599175135294
deviation-center-line_max1.008395534728366
deviation-center-line_mean0.742605590078738
deviation-center-line_min0.39743259036889383
deviation-heading_max4.05809610728665
deviation-heading_mean3.261618259719949
deviation-heading_median3.1991224327732146
deviation-heading_min2.590132066046716
driven_any_max3.2294462258340686
driven_any_mean2.995038688315004
driven_any_median3.026296915154086
driven_any_min2.6981146971177763
driven_lanedir_consec_max2.959552906415765
driven_lanedir_consec_mean2.4120985825120167
driven_lanedir_consec_min1.9696067768000511
driven_lanedir_max2.959552906415765
driven_lanedir_mean2.61263412240726
driven_lanedir_median2.7606884032066112
driven_lanedir_min1.9696067768000511
get_duckie_state_max3.0755996704101563e-06
get_duckie_state_mean2.9710928599039716e-06
get_duckie_state_median2.9702981313069663e-06
get_duckie_state_min2.8681755065917967e-06
get_robot_state_max0.02517713944117228
get_robot_state_mean0.020636387864748636
get_robot_state_median0.019147666692733763
get_robot_state_min0.019073078632354735
get_state_dump_max0.02027900457382202
get_state_dump_mean0.01951887547969818
get_state_dump_median0.01927880644798279
get_state_dump_min0.01923888444900513
get_ui_image_max0.04642516613006592
get_ui_image_mean0.04302726785341898
get_ui_image_median0.04196789503097534
get_ui_image_min0.04174811522165934
in-drivable-lane_max3.0
in-drivable-lane_mean1.2750000000000064
in-drivable-lane_min0.6500000000000048
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0164686743981526, "get_ui_image": 0.04642516613006592, "step_physics": 0.10910432895024616, "survival_time": 14.950000000000076, "driven_lanedir": 2.7365535175044675, "get_state_dump": 0.02027900457382202, "sim_render-ego": 0.010013265609741213, "get_robot_state": 0.02517713944117228, "get_duckie_state": 3.0755996704101563e-06, "in-drivable-lane": 0.6500000000000048, "agent_compute-ego": 0.026599845091501872, "deviation-heading": 3.269368690584609, "complete-iteration": 0.29215400536855063, "set_robot_commands": 0.00885315179824829, "deviation-center-line": 0.8155697232987443, "driven_lanedir_consec": 2.7365535175044675, "sim_compute_sim_state": 0.03906305154164632, "sim_compute_performance-ego": 0.006443342367808024}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2294462258340686, "get_ui_image": 0.04174811522165934, "step_physics": 0.10004720687866211, "survival_time": 14.950000000000076, "driven_lanedir": 2.959552906415765, "get_state_dump": 0.01923888444900513, "sim_render-ego": 0.00819472074508667, "get_robot_state": 0.019073078632354735, "get_duckie_state": 2.8967857360839845e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.026297759215037027, "deviation-heading": 2.590132066046716, "complete-iteration": 0.25936599175135294, "set_robot_commands": 0.006753843625386556, "deviation-center-line": 0.7490245119189479, "driven_lanedir_consec": 2.959552906415765, "sim_compute_sim_state": 0.031957857608795166, "sim_compute_performance-ego": 0.0058578904469807945}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.6981146971177763, "get_ui_image": 0.04198251406351725, "step_physics": 0.10296374162038167, "survival_time": 14.950000000000076, "driven_lanedir": 1.9696067768000511, "get_state_dump": 0.019273475805918375, "sim_render-ego": 0.008484735488891601, "get_robot_state": 0.01910411516825358, "get_duckie_state": 3.043810526529948e-06, "in-drivable-lane": 3.0, "agent_compute-ego": 0.025982243220011393, "deviation-heading": 4.05809610728665, "complete-iteration": 0.263547355333964, "set_robot_commands": 0.006703879833221436, "deviation-center-line": 1.008395534728366, "driven_lanedir_consec": 1.9696067768000511, "sim_compute_sim_state": 0.032918960253397626, "sim_compute_performance-ego": 0.005940837860107422}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.03612515591002, "get_ui_image": 0.04195327599843343, "step_physics": 0.10646243174870808, "survival_time": 14.950000000000076, "driven_lanedir": 2.784823288908755, "get_state_dump": 0.0192841370900472, "sim_render-ego": 0.008272428512573243, "get_robot_state": 0.019191218217213948, "get_duckie_state": 2.8681755065917967e-06, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.025836925506591796, "deviation-heading": 3.12887617496182, "complete-iteration": 0.27151645183563233, "set_robot_commands": 0.006678506533304851, "deviation-center-line": 0.39743259036889383, "driven_lanedir_consec": 1.9826811293277824, "sim_compute_sim_state": 0.03766872882843018, "sim_compute_performance-ego": 0.005973196824391683}}
set_robot_commands_max0.00885315179824829
set_robot_commands_mean0.007247345447540283
set_robot_commands_median0.006728861729303996
set_robot_commands_min0.006678506533304851
sim_compute_performance-ego_max0.006443342367808024
sim_compute_performance-ego_mean0.006053816874821981
sim_compute_performance-ego_median0.005957017342249552
sim_compute_performance-ego_min0.0058578904469807945
sim_compute_sim_state_max0.03906305154164632
sim_compute_sim_state_mean0.03540214955806732
sim_compute_sim_state_median0.0352938445409139
sim_compute_sim_state_min0.031957857608795166
sim_render-ego_max0.010013265609741213
sim_render-ego_mean0.008741287589073181
sim_render-ego_median0.008378582000732422
sim_render-ego_min0.00819472074508667
simulation-passed1
step_physics_max0.10910432895024616
step_physics_mean0.10464442729949952
step_physics_median0.10471308668454488
step_physics_min0.10004720687866211
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4332511655Mo Kleit πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.220023010046882
survival_time_median13.250000000000052
deviation-center-line_median0.6815210818584596
in-drivable-lane_median1.3750000000000195


other stats
agent_compute-ego_max0.02509731338137672
agent_compute-ego_mean0.02471794740492556
agent_compute-ego_median0.024757806857426963
agent_compute-ego_min0.02425886252347161
complete-iteration_max0.29204170493518605
complete-iteration_mean0.28746557334588324
complete-iteration_median0.2874068899949392
complete-iteration_min0.2830068084584686
deviation-center-line_max1.0356405065615688
deviation-center-line_mean0.6717288502912571
deviation-center-line_min0.28823273088654044
deviation-heading_max3.84710090626437
deviation-heading_mean2.3150381760266385
deviation-heading_median2.4059079890071304
deviation-heading_min0.6012358198279226
driven_any_max5.78578542973923
driven_any_mean4.3058122707107085
driven_any_median5.109081230760708
driven_any_min1.2193011915821863
driven_lanedir_consec_max4.633428756751177
driven_lanedir_consec_mean3.0247591550372275
driven_lanedir_consec_min1.025561843303968
driven_lanedir_max4.633428756751177
driven_lanedir_mean3.0247591550372275
driven_lanedir_median3.220023010046882
driven_lanedir_min1.025561843303968
get_duckie_state_max3.13143709521273e-06
get_duckie_state_mean3.0507108228395447e-06
get_duckie_state_median3.042010700001436e-06
get_duckie_state_min2.987384796142578e-06
get_robot_state_max0.023994270341220873
get_robot_state_mean0.02088870014341727
get_robot_state_median0.019893219891716454
get_robot_state_min0.0197740904490153
get_state_dump_max0.019899665514628097
get_state_dump_mean0.019745862458175396
get_state_dump_median0.019734484303049193
get_state_dump_min0.019614815711975098
get_ui_image_max0.046892951329549154
get_ui_image_mean0.04562954526564411
get_ui_image_median0.04584219572590846
get_ui_image_min0.04394083828121036
in-drivable-lane_max7.650000000000066
in-drivable-lane_mean2.700000000000026
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.78578542973923, "get_ui_image": 0.046892951329549154, "step_physics": 0.11463245471318564, "survival_time": 14.950000000000076, "driven_lanedir": 4.633428756751177, "get_state_dump": 0.019899665514628097, "sim_render-ego": 0.00882239818572998, "get_robot_state": 0.019889140129089357, "get_duckie_state": 2.987384796142578e-06, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.02441982905069987, "deviation-heading": 3.84710090626437, "complete-iteration": 0.2867972445487976, "set_robot_commands": 0.006917970975240072, "deviation-center-line": 1.0356405065615688, "driven_lanedir_consec": 4.633428756751177, "sim_compute_sim_state": 0.03888781468073527, "sim_compute_performance-ego": 0.006249142487843831}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.459285976581751, "get_ui_image": 0.04394083828121036, "step_physics": 0.10890420484336424, "survival_time": 11.55000000000003, "driven_lanedir": 4.009841290432034, "get_state_dump": 0.01978256692101945, "sim_render-ego": 0.00976803292443742, "get_robot_state": 0.023994270341220873, "get_duckie_state": 3.13143709521273e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.02509731338137672, "deviation-heading": 2.1577930477720293, "complete-iteration": 0.2830068084584686, "set_robot_commands": 0.008102442795064026, "deviation-center-line": 0.4949712027588188, "driven_lanedir_consec": 4.009841290432034, "sim_compute_sim_state": 0.03700765283592851, "sim_compute_performance-ego": 0.006222034429574942}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.758876484939665, "get_ui_image": 0.0452855904897054, "step_physics": 0.11931055068969726, "survival_time": 14.950000000000076, "driven_lanedir": 2.43020472966173, "get_state_dump": 0.019686401685078937, "sim_render-ego": 0.008822431564331054, "get_robot_state": 0.0197740904490153, "get_duckie_state": 3.082752227783203e-06, "in-drivable-lane": 7.650000000000066, "agent_compute-ego": 0.025095784664154058, "deviation-heading": 2.654022930242232, "complete-iteration": 0.28801653544108075, "set_robot_commands": 0.007028520901997884, "deviation-center-line": 0.8680709609581003, "driven_lanedir_consec": 2.43020472966173, "sim_compute_sim_state": 0.03665665864944458, "sim_compute_performance-ego": 0.006169434388478597}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.2193011915821863, "get_ui_image": 0.046398800962111526, "step_physics": 0.12287035058526433, "survival_time": 3.399999999999996, "driven_lanedir": 1.025561843303968, "get_state_dump": 0.019614815711975098, "sim_render-ego": 0.008552358430974624, "get_robot_state": 0.01989729965434355, "get_duckie_state": 3.001269172219669e-06, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.02425886252347161, "deviation-heading": 0.6012358198279226, "complete-iteration": 0.29204170493518605, "set_robot_commands": 0.00660473108291626, "deviation-center-line": 0.28823273088654044, "driven_lanedir_consec": 1.025561843303968, "sim_compute_sim_state": 0.037544282043681425, "sim_compute_performance-ego": 0.006119198658887078}}
set_robot_commands_max0.008102442795064026
set_robot_commands_mean0.007163416438804561
set_robot_commands_median0.006973245938618978
set_robot_commands_min0.00660473108291626
sim_compute_performance-ego_max0.006249142487843831
sim_compute_performance-ego_mean0.006189952491196112
sim_compute_performance-ego_median0.0061957344090267695
sim_compute_performance-ego_min0.006119198658887078
sim_compute_sim_state_max0.03888781468073527
sim_compute_sim_state_mean0.03752410205244745
sim_compute_sim_state_median0.03727596743980497
sim_compute_sim_state_min0.03665665864944458
sim_render-ego_max0.00976803292443742
sim_render-ego_mean0.00899130527636827
sim_render-ego_median0.008822414875030517
sim_render-ego_min0.008552358430974624
simulation-passed1
step_physics_max0.12287035058526433
step_physics_mean0.11642939020787783
step_physics_median0.11697150270144144
step_physics_min0.10890420484336424
survival_time_max14.950000000000076
survival_time_mean11.212500000000048
survival_time_min3.399999999999996
No reset possible
4329811657Melisande Tengsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:13:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.220267685554961
survival_time_median14.950000000000076
deviation-center-line_median0.7321005445322551
in-drivable-lane_median2.0750000000000197


other stats
agent_compute-ego_max0.02710381507873535
agent_compute-ego_mean0.026338069438934325
agent_compute-ego_median0.026296401818593343
agent_compute-ego_min0.025655659039815263
complete-iteration_max0.3304470411936442
complete-iteration_mean0.31819743871688844
complete-iteration_median0.31800699194272364
complete-iteration_min0.3063287297884623
deviation-center-line_max1.1402629142822749
deviation-center-line_mean0.8175034908459519
deviation-center-line_min0.6655499600370222
deviation-heading_max5.162079040440554
deviation-heading_mean4.054888057502583
deviation-heading_median3.9490072733729393
deviation-heading_min3.1594586428238993
driven_any_max3.1137559525815415
driven_any_mean3.0667874712856538
driven_any_median3.093499821881479
driven_any_min2.9663942887981154
driven_lanedir_consec_max2.677844247679373
driven_lanedir_consec_mean2.263714593063556
driven_lanedir_consec_min1.936478753464928
driven_lanedir_max2.677844247679373
driven_lanedir_mean2.4280217914701088
driven_lanedir_median2.436134909092234
driven_lanedir_min2.161973100016595
get_duckie_state_max3.143151601155599e-06
get_duckie_state_mean3.072023391723633e-06
get_duckie_state_median3.060499827067057e-06
get_duckie_state_min3.0239423116048178e-06
get_robot_state_max0.024698633352915444
get_robot_state_mean0.02371964355309804
get_robot_state_median0.023460054794947303
get_robot_state_min0.023259831269582112
get_state_dump_max0.020059801737467447
get_state_dump_mean0.019816951950391133
get_state_dump_median0.019826529026031492
get_state_dump_min0.0195549480120341
get_ui_image_max0.055439117749532064
get_ui_image_mean0.05146315375963847
get_ui_image_median0.051862192948659264
get_ui_image_min0.046689111391703286
in-drivable-lane_max3.850000000000035
in-drivable-lane_mean2.1375000000000206
in-drivable-lane_min0.5500000000000078
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.1137559525815415, "get_ui_image": 0.0544767689704895, "step_physics": 0.1404594643910726, "survival_time": 14.950000000000076, "driven_lanedir": 2.161973100016595, "get_state_dump": 0.01994674762090047, "sim_render-ego": 0.010002105236053467, "get_robot_state": 0.023580129146575927, "get_duckie_state": 3.081162770589193e-06, "in-drivable-lane": 3.850000000000035, "agent_compute-ego": 0.02710381507873535, "deviation-heading": 3.1594586428238993, "complete-iteration": 0.3304470411936442, "set_robot_commands": 0.008123158613840739, "deviation-center-line": 0.6845709773525189, "driven_lanedir_consec": 2.161973100016595, "sim_compute_sim_state": 0.04016509771347046, "sim_compute_performance-ego": 0.006403475602467855}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.076324362921465, "get_ui_image": 0.055439117749532064, "step_physics": 0.13867781241734822, "survival_time": 14.950000000000076, "driven_lanedir": 2.677844247679373, "get_state_dump": 0.0195549480120341, "sim_render-ego": 0.009715111255645751, "get_robot_state": 0.023259831269582112, "get_duckie_state": 3.0239423116048178e-06, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.026761097908020014, "deviation-heading": 3.6105027438580977, "complete-iteration": 0.3269867030779521, "set_robot_commands": 0.007815455595652263, "deviation-center-line": 0.7796301117119914, "driven_lanedir_consec": 2.677844247679373, "sim_compute_sim_state": 0.039233673413594565, "sim_compute_performance-ego": 0.006339977582295736}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.110675280841493, "get_ui_image": 0.04924761692682902, "step_physics": 0.12528071244557698, "survival_time": 14.950000000000076, "driven_lanedir": 2.278562271093327, "get_state_dump": 0.019706310431162517, "sim_render-ego": 0.00978088855743408, "get_robot_state": 0.023339980443318684, "get_duckie_state": 3.143151601155599e-06, "in-drivable-lane": 3.000000000000023, "agent_compute-ego": 0.025831705729166668, "deviation-heading": 4.287511802887781, "complete-iteration": 0.3063287297884623, "set_robot_commands": 0.007867670853932699, "deviation-center-line": 1.1402629142822749, "driven_lanedir_consec": 2.278562271093327, "sim_compute_sim_state": 0.0387932292620341, "sim_compute_performance-ego": 0.006294151147206624}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9663942887981154, "get_ui_image": 0.046689111391703286, "step_physics": 0.12304264863332112, "survival_time": 14.950000000000076, "driven_lanedir": 2.593707547091141, "get_state_dump": 0.020059801737467447, "sim_render-ego": 0.009963720639546711, "get_robot_state": 0.024698633352915444, "get_duckie_state": 3.039836883544922e-06, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.025655659039815263, "deviation-heading": 5.162079040440554, "complete-iteration": 0.30902728080749514, "set_robot_commands": 0.007945875326792399, "deviation-center-line": 0.6655499600370222, "driven_lanedir_consec": 1.936478753464928, "sim_compute_sim_state": 0.04440096139907837, "sim_compute_performance-ego": 0.006380983193715413}}
set_robot_commands_max0.008123158613840739
set_robot_commands_mean0.007938040097554526
set_robot_commands_median0.00790677309036255
set_robot_commands_min0.007815455595652263
sim_compute_performance-ego_max0.006403475602467855
sim_compute_performance-ego_mean0.006354646881421407
sim_compute_performance-ego_median0.006360480388005575
sim_compute_performance-ego_min0.006294151147206624
sim_compute_sim_state_max0.04440096139907837
sim_compute_sim_state_mean0.040648240447044376
sim_compute_sim_state_median0.03969938556353251
sim_compute_sim_state_min0.0387932292620341
sim_render-ego_max0.010002105236053467
sim_render-ego_mean0.009865456422170002
sim_render-ego_median0.009872304598490398
sim_render-ego_min0.009715111255645751
simulation-passed1
step_physics_max0.1404594643910726
step_physics_mean0.13186515947182972
step_physics_median0.1319792624314626
step_physics_min0.12304264863332112
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4328611654Dishank Bansal πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3506266945283665
survival_time_median14.950000000000076
deviation-center-line_median0.6693409168080235
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.025513206322987873
agent_compute-ego_mean0.02512059926986694
agent_compute-ego_median0.025159136454264323
agent_compute-ego_min0.024650917847951252
complete-iteration_max0.2740584357579549
complete-iteration_mean0.26642524600028994
complete-iteration_median0.26651008168856305
complete-iteration_min0.2586223848660787
deviation-center-line_max0.7438451165322406
deviation-center-line_mean0.643813256475594
deviation-center-line_min0.49272607575408833
deviation-heading_max2.5656650022320577
deviation-heading_mean1.9061016370189516
deviation-heading_median1.8130310415631248
deviation-heading_min1.4326794627174988
driven_any_max2.4285328020992125
driven_any_mean2.3230445026904167
driven_any_median2.37700694686224
driven_any_min2.1096313149379755
driven_lanedir_consec_max2.3916368917885533
driven_lanedir_consec_mean2.2892880008532375
driven_lanedir_consec_min2.0642617225676645
driven_lanedir_max2.3916368917885533
driven_lanedir_mean2.2892880008532375
driven_lanedir_median2.3506266945283665
driven_lanedir_min2.0642617225676645
get_duckie_state_max3.329912821451823e-06
get_duckie_state_mean3.2146771748860675e-06
get_duckie_state_median3.217458724975586e-06
get_duckie_state_min3.093878428141276e-06
get_robot_state_max0.019781661828358967
get_robot_state_mean0.019137357274691263
get_robot_state_median0.018945532242457073
get_robot_state_min0.018876702785491944
get_state_dump_max0.020433574517567953
get_state_dump_mean0.019317982991536455
get_state_dump_median0.018987519343694057
get_state_dump_min0.01886331876118978
get_ui_image_max0.043851239681243895
get_ui_image_mean0.04225951810677846
get_ui_image_median0.04181088844935099
get_ui_image_min0.04156505584716797
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.367598746908433, "get_ui_image": 0.043851239681243895, "step_physics": 0.10711620410283408, "survival_time": 14.950000000000076, "driven_lanedir": 2.348570521350855, "get_state_dump": 0.020433574517567953, "sim_render-ego": 0.008620291550954184, "get_robot_state": 0.019781661828358967, "get_duckie_state": 3.1749407450358072e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024650917847951252, "deviation-heading": 1.4326794627174988, "complete-iteration": 0.2717915002504985, "set_robot_commands": 0.006806635061899821, "deviation-center-line": 0.7438451165322406, "driven_lanedir_consec": 2.348570521350855, "sim_compute_sim_state": 0.03432638009389242, "sim_compute_performance-ego": 0.006022711594899495}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.386415146816047, "get_ui_image": 0.04165664831797282, "step_physics": 0.10077164888381958, "survival_time": 14.950000000000076, "driven_lanedir": 2.352682867705878, "get_state_dump": 0.01886331876118978, "sim_render-ego": 0.008193835417429607, "get_robot_state": 0.018876702785491944, "get_duckie_state": 3.093878428141276e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025513206322987873, "deviation-heading": 1.8879199031650524, "complete-iteration": 0.2586223848660787, "set_robot_commands": 0.006428939501444499, "deviation-center-line": 0.6130170430986148, "driven_lanedir_consec": 2.352682867705878, "sim_compute_sim_state": 0.032210351626078285, "sim_compute_performance-ego": 0.00592167059580485}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.1096313149379755, "get_ui_image": 0.04156505584716797, "step_physics": 0.1035969853401184, "survival_time": 14.950000000000076, "driven_lanedir": 2.0642617225676645, "get_state_dump": 0.018899636268615724, "sim_render-ego": 0.008167777061462402, "get_robot_state": 0.01898706118265788, "get_duckie_state": 3.329912821451823e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025100111961364743, "deviation-heading": 2.5656650022320577, "complete-iteration": 0.2612286631266276, "set_robot_commands": 0.006256246566772461, "deviation-center-line": 0.49272607575408833, "driven_lanedir_consec": 2.0642617225676645, "sim_compute_sim_state": 0.03263404448827108, "sim_compute_performance-ego": 0.005836044152577718}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4285328020992125, "get_ui_image": 0.04196512858072917, "step_physics": 0.11076740980148315, "survival_time": 14.950000000000076, "driven_lanedir": 2.3916368917885533, "get_state_dump": 0.01907540241877238, "sim_render-ego": 0.00829034964243571, "get_robot_state": 0.018904003302256268, "get_duckie_state": 3.2599767049153647e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0252181609471639, "deviation-heading": 1.738142179961197, "complete-iteration": 0.2740584357579549, "set_robot_commands": 0.006334609190622966, "deviation-center-line": 0.7256647905174322, "driven_lanedir_consec": 2.3916368917885533, "sim_compute_sim_state": 0.03744364261627197, "sim_compute_performance-ego": 0.0058713308970133465}}
set_robot_commands_max0.006806635061899821
set_robot_commands_mean0.006456607580184936
set_robot_commands_median0.006381774346033733
set_robot_commands_min0.006256246566772461
sim_compute_performance-ego_max0.006022711594899495
sim_compute_performance-ego_mean0.005912939310073853
sim_compute_performance-ego_median0.005896500746409098
sim_compute_performance-ego_min0.005836044152577718
sim_compute_sim_state_max0.03744364261627197
sim_compute_sim_state_mean0.03415360470612844
sim_compute_sim_state_median0.03348021229108175
sim_compute_sim_state_min0.032210351626078285
sim_render-ego_max0.008620291550954184
sim_render-ego_mean0.008318063418070475
sim_render-ego_median0.008242092529932658
sim_render-ego_min0.008167777061462402
simulation-passed1
step_physics_max0.11076740980148315
step_physics_mean0.1055630620320638
step_physics_median0.10535659472147624
step_physics_min0.10077164888381958
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4326611652Philippe Reddy πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:12:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.73115686537124
survival_time_median14.950000000000076
deviation-center-line_median0.7580541335105959
in-drivable-lane_median1.700000000000017


other stats
agent_compute-ego_max0.02644846836725871
agent_compute-ego_mean0.02575447718302409
agent_compute-ego_median0.025813952287038165
agent_compute-ego_min0.02494153579076131
complete-iteration_max0.3365890375773112
complete-iteration_mean0.299591309428215
complete-iteration_median0.2995528018474579
complete-iteration_min0.2626705964406331
deviation-center-line_max0.8871108217327383
deviation-center-line_mean0.78379808760409
deviation-center-line_min0.7319732616624299
deviation-heading_max4.156629601256175
deviation-heading_mean3.2874835448437896
deviation-heading_median3.148258567062606
deviation-heading_min2.6967874439937725
driven_any_max3.879726976434282
driven_any_mean3.876420329784109
driven_any_median3.8794756816380342
driven_any_min3.867002979426085
driven_lanedir_consec_max3.438212444410812
driven_lanedir_consec_mean2.760612638826326
driven_lanedir_consec_min2.1419243801520125
driven_lanedir_max3.438212444410812
driven_lanedir_mean3.02920377287091
driven_lanedir_median3.2683391334604073
driven_lanedir_min2.1419243801520125
get_duckie_state_max2.9738744099934894e-06
get_duckie_state_mean2.865791320800781e-06
get_duckie_state_median2.844333648681641e-06
get_duckie_state_min2.800623575846354e-06
get_robot_state_max0.02387890497843425
get_robot_state_mean0.02242310404777527
get_robot_state_median0.023407108386357622
get_robot_state_min0.01899929443995158
get_state_dump_max0.020107749303181967
get_state_dump_mean0.019767823417981462
get_state_dump_median0.019851368268330893
get_state_dump_min0.019260807832082113
get_ui_image_max0.05323646783828735
get_ui_image_mean0.04749572455883026
get_ui_image_median0.047267615000406896
get_ui_image_min0.04221120039621989
in-drivable-lane_max5.900000000000041
in-drivable-lane_mean2.5125000000000193
in-drivable-lane_min0.7500000000000018
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.867002979426085, "get_ui_image": 0.04221120039621989, "step_physics": 0.10205511252085368, "survival_time": 14.950000000000076, "driven_lanedir": 3.1007771537609288, "get_state_dump": 0.019260807832082113, "sim_render-ego": 0.008299230734507243, "get_robot_state": 0.01899929443995158, "get_duckie_state": 2.9738744099934894e-06, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.025535173416137695, "deviation-heading": 2.6967874439937725, "complete-iteration": 0.2626705964406331, "set_robot_commands": 0.00661531130472819, "deviation-center-line": 0.7326494997497424, "driven_lanedir_consec": 3.1007771537609288, "sim_compute_sim_state": 0.033607394695281984, "sim_compute_performance-ego": 0.00589165449142456}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879726976434282, "get_ui_image": 0.04510957797368367, "step_physics": 0.10956296920776368, "survival_time": 14.950000000000076, "driven_lanedir": 3.438212444410812, "get_state_dump": 0.020042797724405925, "sim_render-ego": 0.00967579444249471, "get_robot_state": 0.02380354086558024, "get_duckie_state": 2.8522809346516926e-06, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.02494153579076131, "deviation-heading": 3.505720691734349, "complete-iteration": 0.2840432167053223, "set_robot_commands": 0.007768179575602213, "deviation-center-line": 0.7834587672714496, "driven_lanedir_consec": 3.438212444410812, "sim_compute_sim_state": 0.03662753264109293, "sim_compute_performance-ego": 0.006325365702311198}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.879484224230257, "get_ui_image": 0.049425652027130125, "step_physics": 0.1305103826522827, "survival_time": 14.950000000000076, "driven_lanedir": 2.1419243801520125, "get_state_dump": 0.020107749303181967, "sim_render-ego": 0.009913024107615152, "get_robot_state": 0.02387890497843425, "get_duckie_state": 2.8363863627115885e-06, "in-drivable-lane": 5.900000000000041, "agent_compute-ego": 0.02609273115793864, "deviation-heading": 2.7907964423908624, "complete-iteration": 0.3150623869895935, "set_robot_commands": 0.007880885601043702, "deviation-center-line": 0.7319732616624299, "driven_lanedir_consec": 2.1419243801520125, "sim_compute_sim_state": 0.04069997866948446, "sim_compute_performance-ego": 0.006366492907206218}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.879467139045811, "get_ui_image": 0.05323646783828735, "step_physics": 0.14350894927978516, "survival_time": 14.950000000000076, "driven_lanedir": 3.4359011131598862, "get_state_dump": 0.019659938812255855, "sim_render-ego": 0.010040465990702312, "get_robot_state": 0.02301067590713501, "get_duckie_state": 2.800623575846354e-06, "in-drivable-lane": 0.7500000000000018, "agent_compute-ego": 0.02644846836725871, "deviation-heading": 4.156629601256175, "complete-iteration": 0.3365890375773112, "set_robot_commands": 0.007948280970255534, "deviation-center-line": 0.8871108217327383, "driven_lanedir_consec": 2.3615365769815515, "sim_compute_sim_state": 0.04624176263809204, "sim_compute_performance-ego": 0.006305288473765055}}
set_robot_commands_max0.007948280970255534
set_robot_commands_mean0.00755316436290741
set_robot_commands_median0.007824532588322958
set_robot_commands_min0.00661531130472819
sim_compute_performance-ego_max0.006366492907206218
sim_compute_performance-ego_mean0.006222200393676758
sim_compute_performance-ego_median0.006315327088038126
sim_compute_performance-ego_min0.00589165449142456
sim_compute_sim_state_max0.04624176263809204
sim_compute_sim_state_mean0.03929416716098785
sim_compute_sim_state_median0.03866375565528869
sim_compute_sim_state_min0.033607394695281984
sim_render-ego_max0.010040465990702312
sim_render-ego_mean0.009482128818829854
sim_render-ego_median0.00979440927505493
sim_render-ego_min0.008299230734507243
simulation-passed1
step_physics_max0.14350894927978516
step_physics_mean0.12140935341517133
step_physics_median0.1200366759300232
step_physics_min0.10205511252085368
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4325511648Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:09:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.515830029362942
survival_time_median14.950000000000076
deviation-center-line_median0.678185022948341
in-drivable-lane_median2.8000000000000287


other stats
agent_compute-ego_max0.0256179404258728
agent_compute-ego_mean0.025458617128577887
agent_compute-ego_median0.025466274654164033
agent_compute-ego_min0.025283978780110676
complete-iteration_max0.26950982738943663
complete-iteration_mean0.2653629603222305
complete-iteration_median0.2657717438538869
complete-iteration_min0.26039852619171144
deviation-center-line_max0.7670273232590175
deviation-center-line_mean0.6087951550734492
deviation-center-line_min0.311783251138097
deviation-heading_max2.7183223859842833
deviation-heading_mean2.1626113171672916
deviation-heading_median2.506343647381078
deviation-heading_min0.9194355879227276
driven_any_max3.7728455677441457
driven_any_mean3.1374969805680184
driven_any_median3.1324421703419305
driven_any_min2.512258013844067
driven_lanedir_consec_max3.486357574049637
driven_lanedir_consec_mean2.5854480436224705
driven_lanedir_consec_min1.8237745417143607
driven_lanedir_max3.486357574049637
driven_lanedir_mean2.5854480436224705
driven_lanedir_median2.515830029362942
driven_lanedir_min1.8237745417143607
get_duckie_state_max4.164377848307291e-06
get_duckie_state_mean4.087090492248535e-06
get_duckie_state_median4.066626230875651e-06
get_duckie_state_min4.0507316589355465e-06
get_robot_state_max0.01918233492795159
get_robot_state_mean0.01909477516716602
get_robot_state_median0.019098620414733886
get_robot_state_min0.018999524911244712
get_state_dump_max0.019414082368214926
get_state_dump_mean0.019265755169531877
get_state_dump_median0.019316475695254756
get_state_dump_min0.019015986919403077
get_ui_image_max0.04224283456802368
get_ui_image_mean0.04204285267521353
get_ui_image_median0.04202670971552531
get_ui_image_min0.04187515670177983
in-drivable-lane_max5.400000000000077
in-drivable-lane_mean3.062500000000033
in-drivable-lane_min1.2499999999999956
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.722698421436145, "get_ui_image": 0.04224283456802368, "step_physics": 0.10269975662231444, "survival_time": 14.950000000000076, "driven_lanedir": 3.1684491351664343, "get_state_dump": 0.019414082368214926, "sim_render-ego": 0.008319794336954752, "get_robot_state": 0.018999524911244712, "get_duckie_state": 4.164377848307291e-06, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.025513158639272053, "deviation-heading": 2.355375291365347, "complete-iteration": 0.2638122876485189, "set_robot_commands": 0.006637665430704752, "deviation-center-line": 0.7670273232590175, "driven_lanedir_consec": 3.1684491351664343, "sim_compute_sim_state": 0.033878681659698484, "sim_compute_performance-ego": 0.005908145109812419}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.7728455677441457, "get_ui_image": 0.04202961683273315, "step_physics": 0.10128990729649862, "survival_time": 14.950000000000076, "driven_lanedir": 3.486357574049637, "get_state_dump": 0.019015986919403077, "sim_render-ego": 0.008221516609191895, "get_robot_state": 0.019046053886413575, "get_duckie_state": 4.0507316589355465e-06, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.025283978780110676, "deviation-heading": 2.6573120033968087, "complete-iteration": 0.26039852619171144, "set_robot_commands": 0.006523381074269613, "deviation-center-line": 0.6588526557625549, "driven_lanedir_consec": 3.486357574049637, "sim_compute_sim_state": 0.032931556701660154, "sim_compute_performance-ego": 0.005861140886942545}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.512258013844067, "get_ui_image": 0.042023802598317464, "step_physics": 0.10683378219604492, "survival_time": 14.950000000000076, "driven_lanedir": 1.8237745417143607, "get_state_dump": 0.01941104014714559, "sim_render-ego": 0.00838127613067627, "get_robot_state": 0.0191511869430542, "get_duckie_state": 4.0801366170247396e-06, "in-drivable-lane": 5.400000000000077, "agent_compute-ego": 0.0256179404258728, "deviation-heading": 2.7183223859842833, "complete-iteration": 0.26773120005925494, "set_robot_commands": 0.006795790195465088, "deviation-center-line": 0.6975173901341271, "driven_lanedir_consec": 1.8237745417143607, "sim_compute_sim_state": 0.03339788834253947, "sim_compute_performance-ego": 0.005920665264129639}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.5421859192477165, "get_ui_image": 0.04187515670177983, "step_physics": 0.1043368753264932, "survival_time": 10.20000000000001, "driven_lanedir": 1.8632109235594496, "get_state_dump": 0.019221911243363924, "sim_render-ego": 0.008349300599565693, "get_robot_state": 0.01918233492795159, "get_duckie_state": 4.0531158447265625e-06, "in-drivable-lane": 3.400000000000026, "agent_compute-ego": 0.025419390669056012, "deviation-heading": 0.9194355879227276, "complete-iteration": 0.26950982738943663, "set_robot_commands": 0.006572383291581098, "deviation-center-line": 0.311783251138097, "driven_lanedir_consec": 1.8632109235594496, "sim_compute_sim_state": 0.0383381025463927, "sim_compute_performance-ego": 0.006017467554877786}}
set_robot_commands_max0.006795790195465088
set_robot_commands_mean0.006632304998005138
set_robot_commands_median0.006605024361142926
set_robot_commands_min0.006523381074269613
sim_compute_performance-ego_max0.006017467554877786
sim_compute_performance-ego_mean0.005926854703940597
sim_compute_performance-ego_median0.005914405186971028
sim_compute_performance-ego_min0.005861140886942545
sim_compute_sim_state_max0.0383381025463927
sim_compute_sim_state_mean0.0346365573125727
sim_compute_sim_state_median0.03363828500111898
sim_compute_sim_state_min0.032931556701660154
sim_render-ego_max0.00838127613067627
sim_render-ego_mean0.008317971919097153
sim_render-ego_median0.008334547468260223
sim_render-ego_min0.008221516609191895
simulation-passed1
step_physics_max0.10683378219604492
step_physics_mean0.1037900803603378
step_physics_median0.10351831597440384
step_physics_min0.10128990729649862
survival_time_max14.950000000000076
survival_time_mean13.76250000000006
survival_time_min10.20000000000001
No reset possible
4325111647Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9560133779338345
survival_time_median14.950000000000076
deviation-center-line_median0.4599831758736694
in-drivable-lane_median1.0250000000000117


other stats
agent_compute-ego_max0.025650797684987382
agent_compute-ego_mean0.025586806243320683
agent_compute-ego_median0.025585967909614996
agent_compute-ego_min0.02552449146906535
complete-iteration_max0.31727017771522953
complete-iteration_mean0.31115024480054965
complete-iteration_median0.31325137813886006
complete-iteration_min0.3008280452092489
deviation-center-line_max0.933610612276092
deviation-center-line_mean0.5017375548568404
deviation-center-line_min0.15337325540393087
deviation-heading_max3.2685204839727815
deviation-heading_mean2.4137527619855654
deviation-heading_median2.7570186758114144
deviation-heading_min0.872453212346652
driven_any_max3.354623005280148
driven_any_mean2.652319762948193
driven_any_median2.980192170490356
driven_any_min1.2942717055319122
driven_lanedir_consec_max3.235238499244021
driven_lanedir_consec_mean2.0062625854750684
driven_lanedir_consec_min0.8777850867885839
driven_lanedir_max3.235238499244021
driven_lanedir_mean2.0062625854750684
driven_lanedir_median1.9560133779338345
driven_lanedir_min0.8777850867885839
get_duckie_state_max3.2146771748860675e-06
get_duckie_state_mean3.077811415090501e-06
get_duckie_state_median3.1054019927978516e-06
get_duckie_state_min2.885764499880233e-06
get_robot_state_max0.02302491439963287
get_robot_state_mean0.022551930779181183
get_robot_state_median0.022458770275115968
get_robot_state_min0.022265268166859944
get_state_dump_max0.020391027882414044
get_state_dump_mean0.020008830019513014
get_state_dump_median0.019983672698338825
get_state_dump_min0.019676946798960367
get_ui_image_max0.049937410354614256
get_ui_image_mean0.04916283308709943
get_ui_image_median0.04921153543880151
get_ui_image_min0.04829085111618042
in-drivable-lane_max9.60000000000008
in-drivable-lane_mean2.9125000000000254
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.2942717055319122, "get_ui_image": 0.04907396154583625, "step_physics": 0.13653207050179536, "survival_time": 5.299999999999989, "driven_lanedir": 1.154527929873658, "get_state_dump": 0.020391027882414044, "sim_render-ego": 0.010161053459599332, "get_robot_state": 0.02302491439963287, "get_duckie_state": 2.885764499880233e-06, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.025577048085770517, "deviation-heading": 0.872453212346652, "complete-iteration": 0.31727017771522953, "set_robot_commands": 0.007929129420586352, "deviation-center-line": 0.15337325540393087, "driven_lanedir_consec": 1.154527929873658, "sim_compute_sim_state": 0.03787449395881509, "sim_compute_performance-ego": 0.00652131494486107}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0607772295249465, "get_ui_image": 0.04829085111618042, "step_physics": 0.12322465340296428, "survival_time": 14.950000000000076, "driven_lanedir": 2.7574988259940105, "get_state_dump": 0.019676946798960367, "sim_render-ego": 0.009570852915445963, "get_robot_state": 0.022562288443247477, "get_duckie_state": 3.2146771748860675e-06, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.02559488773345947, "deviation-heading": 3.2685204839727815, "complete-iteration": 0.3008280452092489, "set_robot_commands": 0.007761174837748209, "deviation-center-line": 0.5387766988066399, "driven_lanedir_consec": 2.7574988259940105, "sim_compute_sim_state": 0.03768190463383993, "sim_compute_performance-ego": 0.006275366942087809}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8996071114557656, "get_ui_image": 0.04934910933176676, "step_physics": 0.13157848676045736, "survival_time": 14.950000000000076, "driven_lanedir": 0.8777850867885839, "get_state_dump": 0.02005894104639689, "sim_render-ego": 0.009500349362691243, "get_robot_state": 0.022265268166859944, "get_duckie_state": 3.1057993570963543e-06, "in-drivable-lane": 9.60000000000008, "agent_compute-ego": 0.025650797684987382, "deviation-heading": 2.371530583953358, "complete-iteration": 0.30949483315149945, "set_robot_commands": 0.007529608408610026, "deviation-center-line": 0.3811896529406989, "driven_lanedir_consec": 0.8777850867885839, "sim_compute_sim_state": 0.03714304208755493, "sim_compute_performance-ego": 0.006230467955271403}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.354623005280148, "get_ui_image": 0.049937410354614256, "step_physics": 0.1324966597557068, "survival_time": 14.950000000000076, "driven_lanedir": 3.235238499244021, "get_state_dump": 0.01990840435028076, "sim_render-ego": 0.009419324398040772, "get_robot_state": 0.022355252106984455, "get_duckie_state": 3.105004628499349e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02552449146906535, "deviation-heading": 3.1425067676694707, "complete-iteration": 0.3170079231262207, "set_robot_commands": 0.007475122610727946, "deviation-center-line": 0.933610612276092, "driven_lanedir_consec": 3.235238499244021, "sim_compute_sim_state": 0.04342045942942301, "sim_compute_performance-ego": 0.006280664602915446}}
set_robot_commands_max0.007929129420586352
set_robot_commands_mean0.007673758819418133
set_robot_commands_median0.007645391623179117
set_robot_commands_min0.007475122610727946
sim_compute_performance-ego_max0.00652131494486107
sim_compute_performance-ego_mean0.006326953611283932
sim_compute_performance-ego_median0.006278015772501627
sim_compute_performance-ego_min0.006230467955271403
sim_compute_sim_state_max0.04342045942942301
sim_compute_sim_state_mean0.03902997502740824
sim_compute_sim_state_median0.03777819929632751
sim_compute_sim_state_min0.03714304208755493
sim_render-ego_max0.010161053459599332
sim_render-ego_mean0.009662895033944328
sim_render-ego_median0.009535601139068603
sim_render-ego_min0.009419324398040772
simulation-passed1
step_physics_max0.13653207050179536
step_physics_mean0.13095796760523093
step_physics_median0.13203757325808207
step_physics_min0.12322465340296428
survival_time_max14.950000000000076
survival_time_mean12.537500000000056
survival_time_min5.299999999999989
No reset possible
4324211645Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9792642168578825
survival_time_median14.950000000000076
deviation-center-line_median0.8545486395353977
in-drivable-lane_median1.5250000000000097


other stats
agent_compute-ego_max0.025695764775178872
agent_compute-ego_mean0.025361389456963056
agent_compute-ego_median0.02534962852795919
agent_compute-ego_min0.02505053599675497
complete-iteration_max0.3354694298335484
complete-iteration_mean0.31389987119606566
complete-iteration_median0.31039196650187173
complete-iteration_min0.29934612194697063
deviation-center-line_max1.019064128604379
deviation-center-line_mean0.8402580922189475
deviation-center-line_min0.6328709612006156
deviation-heading_max3.470761865283511
deviation-heading_mean2.6762669123062963
deviation-heading_median2.6907767575855464
deviation-heading_min1.8527522687705809
driven_any_max3.8581874667135665
driven_any_mean3.425635169707597
driven_any_median3.4526570412386013
driven_any_min2.93903912963962
driven_lanedir_consec_max3.801126540290154
driven_lanedir_consec_mean2.8117652260310195
driven_lanedir_consec_min1.4874059301181592
driven_lanedir_max3.801126540290154
driven_lanedir_mean2.8117652260310195
driven_lanedir_median2.9792642168578825
driven_lanedir_min1.4874059301181592
get_duckie_state_max3.253618876139323e-06
get_duckie_state_mean3.179019811202069e-06
get_duckie_state_median3.2001855422039424e-06
get_duckie_state_min3.062089284261068e-06
get_robot_state_max0.02393460988998413
get_robot_state_mean0.023278832281527877
get_robot_state_median0.023154263188238856
get_robot_state_min0.022872192859649657
get_state_dump_max0.019908768790108815
get_state_dump_mean0.01968523255416325
get_state_dump_median0.019640745321909587
get_state_dump_min0.019550670782725016
get_ui_image_max0.05352507513396594
get_ui_image_mean0.050969183449031535
get_ui_image_median0.05059203743934632
get_ui_image_min0.04916758378346761
in-drivable-lane_max6.400000000000049
in-drivable-lane_mean2.362500000000017
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.697389573512269, "get_ui_image": 0.04916758378346761, "step_physics": 0.12147284269332886, "survival_time": 14.950000000000076, "driven_lanedir": 3.424775822763768, "get_state_dump": 0.019550670782725016, "sim_render-ego": 0.009595406850179036, "get_robot_state": 0.022872192859649657, "get_duckie_state": 3.062089284261068e-06, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.02505053599675497, "deviation-heading": 3.470761865283511, "complete-iteration": 0.29934612194697063, "set_robot_commands": 0.00763657808303833, "deviation-center-line": 0.8053831142867449, "driven_lanedir_consec": 3.424775822763768, "sim_compute_sim_state": 0.03757663329442342, "sim_compute_performance-ego": 0.0062481196721394855}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.8581874667135665, "get_ui_image": 0.05009651263554891, "step_physics": 0.1281608255704244, "survival_time": 14.950000000000076, "driven_lanedir": 3.801126540290154, "get_state_dump": 0.019700074195861814, "sim_render-ego": 0.009719011783599851, "get_robot_state": 0.02393460988998413, "get_duckie_state": 3.216266632080078e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02519429365793864, "deviation-heading": 2.1419222998145084, "complete-iteration": 0.30887108405431113, "set_robot_commands": 0.00785210688908895, "deviation-center-line": 1.019064128604379, "driven_lanedir_consec": 3.801126540290154, "sim_compute_sim_state": 0.03785145044326782, "sim_compute_performance-ego": 0.006185017426808675}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.207924508964934, "get_ui_image": 0.05108756224314372, "step_physics": 0.13080003341039023, "survival_time": 14.950000000000076, "driven_lanedir": 1.4874059301181592, "get_state_dump": 0.019581416447957356, "sim_render-ego": 0.009743908246358237, "get_robot_state": 0.023077877362569173, "get_duckie_state": 3.253618876139323e-06, "in-drivable-lane": 6.400000000000049, "agent_compute-ego": 0.025504963397979735, "deviation-heading": 3.2396312153565843, "complete-iteration": 0.3119128489494324, "set_robot_commands": 0.007456759611765544, "deviation-center-line": 0.9037141647840504, "driven_lanedir_consec": 1.4874059301181592, "sim_compute_sim_state": 0.03828804572423299, "sim_compute_performance-ego": 0.006194228331247965}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.93903912963962, "get_ui_image": 0.05352507513396594, "step_physics": 0.14269679127907267, "survival_time": 12.25000000000004, "driven_lanedir": 2.5337526109519968, "get_state_dump": 0.019908768790108815, "sim_render-ego": 0.010210745675223214, "get_robot_state": 0.023230649013908544, "get_duckie_state": 3.184104452327806e-06, "in-drivable-lane": 2.600000000000013, "agent_compute-ego": 0.025695764775178872, "deviation-heading": 1.8527522687705809, "complete-iteration": 0.3354694298335484, "set_robot_commands": 0.007720041275024414, "deviation-center-line": 0.6328709612006156, "driven_lanedir_consec": 2.5337526109519968, "sim_compute_sim_state": 0.04590129268412688, "sim_compute_performance-ego": 0.006400309776773258}}
set_robot_commands_max0.00785210688908895
set_robot_commands_mean0.00766637146472931
set_robot_commands_median0.007678309679031372
set_robot_commands_min0.007456759611765544
sim_compute_performance-ego_max0.006400309776773258
sim_compute_performance-ego_mean0.006256918801742346
sim_compute_performance-ego_median0.006221174001693725
sim_compute_performance-ego_min0.006185017426808675
sim_compute_sim_state_max0.04590129268412688
sim_compute_sim_state_mean0.03990435553651278
sim_compute_sim_state_median0.03806974808375041
sim_compute_sim_state_min0.03757663329442342
sim_render-ego_max0.010210745675223214
sim_render-ego_mean0.009817268138840086
sim_render-ego_median0.009731460014979045
sim_render-ego_min0.009595406850179036
simulation-passed1
step_physics_max0.14269679127907267
step_physics_mean0.13078262323830403
step_physics_median0.12948042949040733
step_physics_min0.12147284269332886
survival_time_max14.950000000000076
survival_time_mean14.27500000000007
survival_time_min12.25000000000004
No reset possible
4320011630Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:08:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.196865855621956
survival_time_median12.25000000000004
deviation-center-line_median0.25964390743951676
in-drivable-lane_median0.5750000000000046


other stats
agent_compute-ego_max0.02597287654876709
agent_compute-ego_mean0.02557949756480202
agent_compute-ego_median0.025468647555459904
agent_compute-ego_min0.025407818599521174
complete-iteration_max0.27905194838841757
complete-iteration_mean0.2670009751990841
complete-iteration_median0.264588523595537
complete-iteration_min0.25977490521684476
deviation-center-line_max0.7563691815811185
deviation-center-line_mean0.35413271703804444
deviation-center-line_min0.14087387169202567
deviation-heading_max3.571484770321215
deviation-heading_mean1.9972546398184543
deviation-heading_median1.8541626688205588
deviation-heading_min0.709208451311486
driven_any_max2.974396186534774
driven_any_mean2.1094147077581127
driven_any_median2.355310294222678
driven_any_min0.7526420560523207
driven_lanedir_consec_max2.4865945528556113
driven_lanedir_consec_mean1.3817325274776484
driven_lanedir_consec_min0.6466038458110706
driven_lanedir_max2.683869694438462
driven_lanedir_mean1.431051312873361
driven_lanedir_median1.196865855621956
driven_lanedir_min0.6466038458110706
get_duckie_state_max3.2593932332871835e-06
get_duckie_state_mean3.1623361540838256e-06
get_duckie_state_median3.1663152351845413e-06
get_duckie_state_min3.0573209126790367e-06
get_robot_state_max0.01930913442297827
get_robot_state_mean0.019149307854610036
get_robot_state_median0.01913501593038882
get_robot_state_min0.019018065134684244
get_state_dump_max0.019605989697613294
get_state_dump_mean0.019410855996905528
get_state_dump_median0.019371522203165823
get_state_dump_min0.019294389883677165
get_ui_image_max0.04202965656916301
get_ui_image_mean0.04189708896953885
get_ui_image_median0.041897634954352656
get_ui_image_min0.0417634294002871
in-drivable-lane_max11.400000000000082
in-drivable-lane_mean3.1875000000000235
in-drivable-lane_min0.20000000000000284
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.7526420560523207, "get_ui_image": 0.0417634294002871, "step_physics": 0.10020767284345024, "survival_time": 3.949999999999994, "driven_lanedir": 0.6466038458110706, "get_state_dump": 0.019605989697613294, "sim_render-ego": 0.008485024488424952, "get_robot_state": 0.01930913442297827, "get_duckie_state": 3.2593932332871835e-06, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.025441181810596323, "deviation-heading": 0.7374302922307345, "complete-iteration": 0.25977490521684476, "set_robot_commands": 0.0069039411182645, "deviation-center-line": 0.14177770150134314, "driven_lanedir_consec": 0.6466038458110706, "sim_compute_sim_state": 0.03180750412277029, "sim_compute_performance-ego": 0.006056541129003597}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9166966695746124, "get_ui_image": 0.041959024848738265, "step_physics": 0.10158236114142452, "survival_time": 9.55, "driven_lanedir": 1.6743872756072158, "get_state_dump": 0.01932195094243394, "sim_render-ego": 0.008296272517498876, "get_robot_state": 0.01917095209291468, "get_duckie_state": 3.086958880199812e-06, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.025407818599521174, "deviation-heading": 2.970895045410383, "complete-iteration": 0.2600371700306838, "set_robot_commands": 0.006598966908080416, "deviation-center-line": 0.3775101133776904, "driven_lanedir_consec": 1.6743872756072158, "sim_compute_sim_state": 0.031558836941943745, "sim_compute_performance-ego": 0.005954526481828141}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.793923918870743, "get_ui_image": 0.04183624505996704, "step_physics": 0.1094815969467163, "survival_time": 14.950000000000076, "driven_lanedir": 0.7193444356366963, "get_state_dump": 0.019294389883677165, "sim_render-ego": 0.008444930712381999, "get_robot_state": 0.019018065134684244, "get_duckie_state": 3.0573209126790367e-06, "in-drivable-lane": 11.400000000000082, "agent_compute-ego": 0.02597287654876709, "deviation-heading": 0.709208451311486, "complete-iteration": 0.26913987716039023, "set_robot_commands": 0.006873559951782226, "deviation-center-line": 0.14087387169202567, "driven_lanedir_consec": 0.7193444356366963, "sim_compute_sim_state": 0.03209206660588582, "sim_compute_performance-ego": 0.005939772923787435}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.974396186534774, "get_ui_image": 0.04202965656916301, "step_physics": 0.1128585648536682, "survival_time": 14.950000000000076, "driven_lanedir": 2.683869694438462, "get_state_dump": 0.019421093463897705, "sim_render-ego": 0.008424390157063802, "get_robot_state": 0.019099079767862955, "get_duckie_state": 3.245671590169271e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.02549611330032349, "deviation-heading": 3.571484770321215, "complete-iteration": 0.27905194838841757, "set_robot_commands": 0.006652180353800456, "deviation-center-line": 0.7563691815811185, "driven_lanedir_consec": 2.4865945528556113, "sim_compute_sim_state": 0.03889590501785278, "sim_compute_performance-ego": 0.005990284283955892}}
set_robot_commands_max0.0069039411182645
set_robot_commands_mean0.0067571620829819
set_robot_commands_median0.006762870152791341
set_robot_commands_min0.006598966908080416
sim_compute_performance-ego_max0.006056541129003597
sim_compute_performance-ego_mean0.005985281204643766
sim_compute_performance-ego_median0.005972405382892017
sim_compute_performance-ego_min0.005939772923787435
sim_compute_sim_state_max0.03889590501785278
sim_compute_sim_state_mean0.03358857817211316
sim_compute_sim_state_median0.031949785364328055
sim_compute_sim_state_min0.031558836941943745
sim_render-ego_max0.008485024488424952
sim_render-ego_mean0.008412654468842408
sim_render-ego_median0.0084346604347229
sim_render-ego_min0.008296272517498876
simulation-passed1
step_physics_max0.1128585648536682
step_physics_mean0.1060325489463148
step_physics_median0.1055319790440704
step_physics_min0.10020767284345024
survival_time_max14.950000000000076
survival_time_mean10.850000000000035
survival_time_min3.949999999999994
No reset possible
4318811629Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6096628907827673
survival_time_median14.950000000000076
deviation-center-line_median0.5783642609708709
in-drivable-lane_median1.4250000000000205


other stats
agent_compute-ego_max0.02596172332763672
agent_compute-ego_mean0.025225533843040465
agent_compute-ego_median0.02510514815648397
agent_compute-ego_min0.02473011573155721
complete-iteration_max0.29995969851811727
complete-iteration_mean0.2907533474763234
complete-iteration_median0.29014995296796164
complete-iteration_min0.28275378545125324
deviation-center-line_max0.864506490398022
deviation-center-line_mean0.6239303131639095
deviation-center-line_min0.4744862403158742
deviation-heading_max4.387204817778578
deviation-heading_mean3.319833086095627
deviation-heading_median3.0280218312026452
deviation-heading_min2.836083864198641
driven_any_max3.2346439330219545
driven_any_mean3.124376539148295
driven_any_median3.1144781002884097
driven_any_min3.033906022994406
driven_lanedir_consec_max3.0128214200411265
driven_lanedir_consec_mean2.6915925259680304
driven_lanedir_consec_min2.53422290226546
driven_lanedir_max3.0128214200411265
driven_lanedir_mean2.78250396775659
driven_lanedir_median2.7882942279162273
driven_lanedir_min2.540605995152779
get_duckie_state_max2.9691060384114583e-06
get_duckie_state_mean2.9192368189493815e-06
get_duckie_state_median2.9257933298746744e-06
get_duckie_state_min2.856254577636719e-06
get_robot_state_max0.023818864822387695
get_robot_state_mean0.0219776584704717
get_robot_state_median0.022187782923380535
get_robot_state_min0.019716203212738037
get_state_dump_max0.019919567902882893
get_state_dump_mean0.01976765036582947
get_state_dump_median0.019781972964604697
get_state_dump_min0.019587087631225585
get_ui_image_max0.04604995091756185
get_ui_image_mean0.04560152530670166
get_ui_image_median0.04565345962842306
get_ui_image_min0.045049231052398685
in-drivable-lane_max1.9999999999999964
in-drivable-lane_mean1.2125000000000092
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.033906022994406, "get_ui_image": 0.04604995091756185, "step_physics": 0.1135835560162862, "survival_time": 14.950000000000076, "driven_lanedir": 2.678719786412755, "get_state_dump": 0.019919567902882893, "sim_render-ego": 0.008926117420196533, "get_robot_state": 0.019716203212738037, "get_duckie_state": 2.9691060384114583e-06, "in-drivable-lane": 1.9999999999999964, "agent_compute-ego": 0.02473011573155721, "deviation-heading": 2.836083864198641, "complete-iteration": 0.28275378545125324, "set_robot_commands": 0.007023959954579671, "deviation-center-line": 0.4744862403158742, "driven_lanedir_consec": 2.678719786412755, "sim_compute_sim_state": 0.03655096054077149, "sim_compute_performance-ego": 0.006083977222442627}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.1091195970279153, "get_ui_image": 0.0460452405611674, "step_physics": 0.11427062273025512, "survival_time": 14.950000000000076, "driven_lanedir": 3.0128214200411265, "get_state_dump": 0.019587087631225585, "sim_render-ego": 0.009593513011932371, "get_robot_state": 0.022060492833455403, "get_duckie_state": 2.856254577636719e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02596172332763672, "deviation-heading": 3.093425022876622, "complete-iteration": 0.28783352772394816, "set_robot_commands": 0.007761503060658773, "deviation-center-line": 0.6155332234892322, "driven_lanedir_consec": 3.0128214200411265, "sim_compute_sim_state": 0.03613528966903687, "sim_compute_performance-ego": 0.006247460842132568}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2346439330219545, "get_ui_image": 0.04526167869567871, "step_physics": 0.11752691745758057, "survival_time": 14.950000000000076, "driven_lanedir": 2.540605995152779, "get_state_dump": 0.019753071467081707, "sim_render-ego": 0.00963729699452718, "get_robot_state": 0.023818864822387695, "get_duckie_state": 2.9420852661132812e-06, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.02540388345718384, "deviation-heading": 4.387204817778578, "complete-iteration": 0.2924663782119751, "set_robot_commands": 0.007744270165761312, "deviation-center-line": 0.864506490398022, "driven_lanedir_consec": 2.540605995152779, "sim_compute_sim_state": 0.03705670674641927, "sim_compute_performance-ego": 0.006091872056325277}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.119836603548904, "get_ui_image": 0.045049231052398685, "step_physics": 0.1223849606513977, "survival_time": 14.950000000000076, "driven_lanedir": 2.897868669419699, "get_state_dump": 0.01981087446212769, "sim_render-ego": 0.00935116449991862, "get_robot_state": 0.022315073013305663, "get_duckie_state": 2.9095013936360677e-06, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.0248064128557841, "deviation-heading": 2.9626186395286687, "complete-iteration": 0.29995969851811727, "set_robot_commands": 0.007592824300130209, "deviation-center-line": 0.5411952984525096, "driven_lanedir_consec": 2.53422290226546, "sim_compute_sim_state": 0.04244694073994954, "sim_compute_performance-ego": 0.006031847000122071}}
set_robot_commands_max0.007761503060658773
set_robot_commands_mean0.007530639370282491
set_robot_commands_median0.00766854723294576
set_robot_commands_min0.007023959954579671
sim_compute_performance-ego_max0.006247460842132568
sim_compute_performance-ego_mean0.006113789280255636
sim_compute_performance-ego_median0.006087924639383952
sim_compute_performance-ego_min0.006031847000122071
sim_compute_sim_state_max0.04244694073994954
sim_compute_sim_state_mean0.03804747442404429
sim_compute_sim_state_median0.03680383364359538
sim_compute_sim_state_min0.03613528966903687
sim_render-ego_max0.00963729699452718
sim_render-ego_mean0.009377022981643677
sim_render-ego_median0.009472338755925496
sim_render-ego_min0.008926117420196533
simulation-passed1
step_physics_max0.1223849606513977
step_physics_mean0.11694151421387992
step_physics_median0.11589877009391784
step_physics_min0.1135835560162862
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4317611626Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:12:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.35090941863785
survival_time_median14.950000000000076
deviation-center-line_median0.6756266678387084
in-drivable-lane_median1.9500000000000148


other stats
agent_compute-ego_max0.026787439187367756
agent_compute-ego_mean0.026143273711204527
agent_compute-ego_median0.02617435296376546
agent_compute-ego_min0.02543694972991943
complete-iteration_max0.34088639974594115
complete-iteration_mean0.3146988215049108
complete-iteration_median0.3167790118853251
complete-iteration_min0.28435086250305175
deviation-center-line_max0.8869232113643496
deviation-center-line_mean0.6422539472717315
deviation-center-line_min0.3308392420451597
deviation-heading_max2.6956148304284446
deviation-heading_mean2.242741232789013
deviation-heading_median2.1429530444490603
deviation-heading_min1.989444011829487
driven_any_max3.889055062571556
driven_any_mean3.5708234258938565
driven_any_median3.836328905533225
driven_any_min2.721580829937419
driven_lanedir_consec_max3.7631655936184742
driven_lanedir_consec_mean2.8027220464701403
driven_lanedir_consec_min0.7459037549863863
driven_lanedir_max3.7631655936184742
driven_lanedir_mean2.8049573432577084
driven_lanedir_median3.3553800122129864
driven_lanedir_min0.7459037549863863
get_duckie_state_max3.8178761800130205e-06
get_duckie_state_mean3.723502159118652e-06
get_duckie_state_median3.7086009979248046e-06
get_duckie_state_min3.658930460611979e-06
get_robot_state_max0.02378381888071696
get_robot_state_mean0.023496031761169434
get_robot_state_median0.02345616340637207
get_robot_state_min0.023287981351216635
get_state_dump_max0.020164005756378178
get_state_dump_mean0.020060875217119856
get_state_dump_median0.020061368147532142
get_state_dump_min0.019956758817036947
get_ui_image_max0.05349431753158569
get_ui_image_mean0.04963727494080861
get_ui_image_median0.050398037036259974
get_ui_image_min0.04425870815912882
in-drivable-lane_max10.500000000000068
in-drivable-lane_mean3.6000000000000245
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.889055062571556, "get_ui_image": 0.04425870815912882, "step_physics": 0.1103295389811198, "survival_time": 14.950000000000076, "driven_lanedir": 3.1322429179581173, "get_state_dump": 0.019956758817036947, "sim_render-ego": 0.009464263121287028, "get_robot_state": 0.023362326622009277, "get_duckie_state": 3.8178761800130205e-06, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.02543694972991943, "deviation-heading": 2.6956148304284446, "complete-iteration": 0.28435086250305175, "set_robot_commands": 0.007820665836334229, "deviation-center-line": 0.6501082112478159, "driven_lanedir_consec": 3.1233017308078437, "sim_compute_sim_state": 0.03736966451009115, "sim_compute_performance-ego": 0.006172042687733968}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.8021663152025975, "get_ui_image": 0.04953513781229655, "step_physics": 0.12772709449132283, "survival_time": 14.950000000000076, "driven_lanedir": 3.7631655936184742, "get_state_dump": 0.020164005756378178, "sim_render-ego": 0.009894092082977295, "get_robot_state": 0.023550000190734863, "get_duckie_state": 3.7089983622233073e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025726525783538817, "deviation-heading": 2.0021514043622552, "complete-iteration": 0.3098725875218709, "set_robot_commands": 0.00792025327682495, "deviation-center-line": 0.8869232113643496, "driven_lanedir_consec": 3.7631655936184742, "sim_compute_sim_state": 0.03875697215398153, "sim_compute_performance-ego": 0.006416635513305664}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.721580829937419, "get_ui_image": 0.05126093626022339, "step_physics": 0.1391546297073364, "survival_time": 14.950000000000076, "driven_lanedir": 0.7459037549863863, "get_state_dump": 0.02014446973800659, "sim_render-ego": 0.00991499662399292, "get_robot_state": 0.023287981351216635, "get_duckie_state": 3.708203633626302e-06, "in-drivable-lane": 10.500000000000068, "agent_compute-ego": 0.026622180143992105, "deviation-heading": 2.2837546845358654, "complete-iteration": 0.3236854362487793, "set_robot_commands": 0.0076614777247111, "deviation-center-line": 0.3308392420451597, "driven_lanedir_consec": 0.7459037549863863, "sim_compute_sim_state": 0.03914822975794474, "sim_compute_performance-ego": 0.006309141318003336}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.870491495863852, "get_ui_image": 0.05349431753158569, "step_physics": 0.14472259998321532, "survival_time": 14.950000000000076, "driven_lanedir": 3.578517106467856, "get_state_dump": 0.0199782665570577, "sim_render-ego": 0.010241398811340332, "get_robot_state": 0.02378381888071696, "get_duckie_state": 3.658930460611979e-06, "in-drivable-lane": 1.7499999999999991, "agent_compute-ego": 0.026787439187367756, "deviation-heading": 1.989444011829487, "complete-iteration": 0.34088639974594115, "set_robot_commands": 0.007854437828063965, "deviation-center-line": 0.701145124429601, "driven_lanedir_consec": 3.578517106467856, "sim_compute_sim_state": 0.04743884325027466, "sim_compute_performance-ego": 0.006402514775594076}}
set_robot_commands_max0.00792025327682495
set_robot_commands_mean0.00781420866648356
set_robot_commands_median0.007837551832199096
set_robot_commands_min0.0076614777247111
sim_compute_performance-ego_max0.006416635513305664
sim_compute_performance-ego_mean0.006325083573659261
sim_compute_performance-ego_median0.006355828046798706
sim_compute_performance-ego_min0.006172042687733968
sim_compute_sim_state_max0.04743884325027466
sim_compute_sim_state_mean0.040678427418073024
sim_compute_sim_state_median0.03895260095596313
sim_compute_sim_state_min0.03736966451009115
sim_render-ego_max0.010241398811340332
sim_render-ego_mean0.009878687659899394
sim_render-ego_median0.009904544353485109
sim_render-ego_min0.009464263121287028
simulation-passed1
step_physics_max0.14472259998321532
step_physics_mean0.1304834657907486
step_physics_median0.13344086209932962
step_physics_min0.1103295389811198
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4316911624Anthony Courchesne πŸ‡¨πŸ‡¦TNetR1aido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:01:00
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4316611624Anthony Courchesne πŸ‡¨πŸ‡¦TNetR1aido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:01:23
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4315111620Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:09:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4314311618Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.245186339143577
survival_time_median14.950000000000076
deviation-center-line_median0.5822771527603405
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.026277003288269044
agent_compute-ego_mean0.026098693211873372
agent_compute-ego_median0.02614285429318746
agent_compute-ego_min0.025832060972849527
complete-iteration_max0.2754908855756124
complete-iteration_mean0.26637365241845445
complete-iteration_median0.2641549229621887
complete-iteration_min0.2616938781738281
deviation-center-line_max0.7784320287315161
deviation-center-line_mean0.6084501032292944
deviation-center-line_min0.4908140786649806
deviation-heading_max1.9931919370594944
deviation-heading_mean1.5402050545133197
deviation-heading_median1.4456337012998255
deviation-heading_min1.276360878394133
driven_any_max3.6018761515447015
driven_any_mean3.3798813612176715
driven_any_median3.4666872331340315
driven_any_min2.984274827057922
driven_lanedir_consec_max3.580563391120178
driven_lanedir_consec_mean3.253760827543675
driven_lanedir_consec_min2.944107240767368
driven_lanedir_max3.580563391120178
driven_lanedir_mean3.253760827543675
driven_lanedir_median3.245186339143577
driven_lanedir_min2.944107240767368
get_duckie_state_max3.372828165690104e-06
get_duckie_state_mean3.2667318979899087e-06
get_duckie_state_median3.246068954467773e-06
get_duckie_state_min3.2019615173339843e-06
get_robot_state_max0.019214632511138915
get_robot_state_mean0.01920274078845978
get_robot_state_median0.019207093318303427
get_robot_state_min0.019182144006093343
get_state_dump_max0.019555781682332355
get_state_dump_mean0.01948515713214874
get_state_dump_median0.019486772616704305
get_state_dump_min0.019411301612854003
get_ui_image_max0.04231920957565308
get_ui_image_mean0.04215439240137736
get_ui_image_median0.04214638868967692
get_ui_image_min0.04200558265050252
in-drivable-lane_max1.6500000000000234
in-drivable-lane_mean0.41250000000000586
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.409453692109892, "get_ui_image": 0.042208504676818845, "step_physics": 0.10143499771753949, "survival_time": 14.950000000000076, "driven_lanedir": 3.3742002041996844, "get_state_dump": 0.019498827457427977, "sim_render-ego": 0.008356573581695557, "get_robot_state": 0.019182144006093343, "get_duckie_state": 3.239313761393229e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026197063128153484, "deviation-heading": 1.6025567995497858, "complete-iteration": 0.2630706969896952, "set_robot_commands": 0.006677430470784505, "deviation-center-line": 0.4908140786649806, "driven_lanedir_consec": 3.3742002041996844, "sim_compute_sim_state": 0.03343729654947917, "sim_compute_performance-ego": 0.005892054239908854}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.6018761515447015, "get_ui_image": 0.042084272702534994, "step_physics": 0.10071531295776368, "survival_time": 14.950000000000076, "driven_lanedir": 3.580563391120178, "get_state_dump": 0.019474717775980633, "sim_render-ego": 0.008221125602722168, "get_robot_state": 0.019214632511138915, "get_duckie_state": 3.2528241475423175e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026277003288269044, "deviation-heading": 1.2887106030498656, "complete-iteration": 0.2616938781738281, "set_robot_commands": 0.0066183900833129885, "deviation-center-line": 0.6273812507266487, "driven_lanedir_consec": 3.580563391120178, "sim_compute_sim_state": 0.032992067337036135, "sim_compute_performance-ego": 0.005911641915639241}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.984274827057922, "get_ui_image": 0.04200558265050252, "step_physics": 0.10398830970128375, "survival_time": 14.950000000000076, "driven_lanedir": 2.944107240767368, "get_state_dump": 0.019555781682332355, "sim_render-ego": 0.008266300360361734, "get_robot_state": 0.019208498001098633, "get_duckie_state": 3.2019615173339843e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026088645458221437, "deviation-heading": 1.9931919370594944, "complete-iteration": 0.2652391489346822, "set_robot_commands": 0.006715508302052816, "deviation-center-line": 0.5371730547940322, "driven_lanedir_consec": 2.944107240767368, "sim_compute_sim_state": 0.033283100922902424, "sim_compute_performance-ego": 0.005943977832794189}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.523920774158171, "get_ui_image": 0.04231920957565308, "step_physics": 0.1095148245493571, "survival_time": 14.950000000000076, "driven_lanedir": 3.11617247408747, "get_state_dump": 0.019411301612854003, "sim_render-ego": 0.008286067644755046, "get_robot_state": 0.01920568863550822, "get_duckie_state": 3.372828165690104e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.025832060972849527, "deviation-heading": 1.276360878394133, "complete-iteration": 0.2754908855756124, "set_robot_commands": 0.006571165720621745, "deviation-center-line": 0.7784320287315161, "driven_lanedir_consec": 3.11617247408747, "sim_compute_sim_state": 0.03822387218475342, "sim_compute_performance-ego": 0.005941068331400554}}
set_robot_commands_max0.006715508302052816
set_robot_commands_mean0.006645623644193013
set_robot_commands_median0.006647910277048747
set_robot_commands_min0.006571165720621745
sim_compute_performance-ego_max0.005943977832794189
sim_compute_performance-ego_mean0.005922185579935709
sim_compute_performance-ego_median0.005926355123519897
sim_compute_performance-ego_min0.005892054239908854
sim_compute_sim_state_max0.03822387218475342
sim_compute_sim_state_mean0.03448408424854279
sim_compute_sim_state_median0.033360198736190796
sim_compute_sim_state_min0.032992067337036135
sim_render-ego_max0.008356573581695557
sim_render-ego_mean0.008282516797383626
sim_render-ego_median0.00827618400255839
sim_render-ego_min0.008221125602722168
simulation-passed1
step_physics_max0.1095148245493571
step_physics_mean0.103913361231486
step_physics_median0.10271165370941164
step_physics_min0.10071531295776368
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4314111617Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6318511053648872
survival_time_median14.950000000000076
deviation-center-line_median0.33941554242964767
in-drivable-lane_median1.824999999999997


other stats
agent_compute-ego_max0.025761191844940187
agent_compute-ego_mean0.02563526391983032
agent_compute-ego_median0.02568578044573466
agent_compute-ego_min0.025408302942911784
complete-iteration_max0.27391471147537233
complete-iteration_mean0.26347486197948455
complete-iteration_median0.2611716071764628
complete-iteration_min0.2576415220896403
deviation-center-line_max0.7912663684535854
deviation-center-line_mean0.4311610857939916
deviation-center-line_min0.2545468898630857
deviation-heading_max2.85831831191642
deviation-heading_mean2.1343321676689855
deviation-heading_median2.066383383796619
deviation-heading_min1.546243591166284
driven_any_max1.939949566738258
driven_any_mean1.9383589394261107
driven_any_median1.939915339954392
driven_any_min1.933655511057401
driven_lanedir_consec_max1.913085184004592
driven_lanedir_consec_mean1.6327468913240195
driven_lanedir_consec_min1.354200170561712
driven_lanedir_max1.913085184004592
driven_lanedir_mean1.6327468913240195
driven_lanedir_median1.6318511053648872
driven_lanedir_min1.354200170561712
get_duckie_state_max3.028710683186849e-06
get_duckie_state_mean2.9869874318440753e-06
get_duckie_state_median3.0032793680826825e-06
get_duckie_state_min2.912680308024089e-06
get_robot_state_max0.019139865239461262
get_robot_state_mean0.019051127433776856
get_robot_state_median0.01902835051218669
get_robot_state_min0.019007943471272788
get_state_dump_max0.019408992131551107
get_state_dump_mean0.019251466592152912
get_state_dump_median0.01921210686365763
get_state_dump_min0.01917266050974528
get_ui_image_max0.04221730947494507
get_ui_image_mean0.042135578791300456
get_ui_image_median0.04217398484547933
get_ui_image_min0.0419770359992981
in-drivable-lane_max4.100000000000058
in-drivable-lane_mean1.937500000000013
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933655511057401, "get_ui_image": 0.042160800298055016, "step_physics": 0.10056169907251994, "survival_time": 14.950000000000076, "driven_lanedir": 1.354200170561712, "get_state_dump": 0.019408992131551107, "sim_render-ego": 0.008290471235911052, "get_robot_state": 0.019139865239461262, "get_duckie_state": 3.021558125813802e-06, "in-drivable-lane": 4.100000000000058, "agent_compute-ego": 0.025749168395996093, "deviation-heading": 1.546243591166284, "complete-iteration": 0.2608509612083435, "set_robot_commands": 0.0066791971524556475, "deviation-center-line": 0.2545468898630857, "driven_lanedir_consec": 1.354200170561712, "sim_compute_sim_state": 0.03272388219833374, "sim_compute_performance-ego": 0.00594322125116984}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399373370100303, "get_ui_image": 0.04218716939290365, "step_physics": 0.09928269386291504, "survival_time": 14.950000000000076, "driven_lanedir": 1.913085184004592, "get_state_dump": 0.019192143281300863, "sim_render-ego": 0.008206906318664551, "get_robot_state": 0.019024187723795577, "get_duckie_state": 2.912680308024089e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025622392495473226, "deviation-heading": 1.8305661339478068, "complete-iteration": 0.2576415220896403, "set_robot_commands": 0.006577606201171875, "deviation-center-line": 0.34694483131695625, "driven_lanedir_consec": 1.913085184004592, "sim_compute_sim_state": 0.03144273440043131, "sim_compute_performance-ego": 0.005912535985310872}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939893342898753, "get_ui_image": 0.0419770359992981, "step_physics": 0.10274011532465616, "survival_time": 14.950000000000076, "driven_lanedir": 1.3625802410340486, "get_state_dump": 0.01917266050974528, "sim_render-ego": 0.008156203428904215, "get_robot_state": 0.019007943471272788, "get_duckie_state": 3.028710683186849e-06, "in-drivable-lane": 3.649999999999994, "agent_compute-ego": 0.025408302942911784, "deviation-heading": 2.85831831191642, "complete-iteration": 0.26149225314458213, "set_robot_commands": 0.006567761898040771, "deviation-center-line": 0.7912663684535854, "driven_lanedir_consec": 1.3625802410340486, "sim_compute_sim_state": 0.032344695727030436, "sim_compute_performance-ego": 0.005920984745025635}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939949566738258, "get_ui_image": 0.04221730947494507, "step_physics": 0.10941389719645182, "survival_time": 14.950000000000076, "driven_lanedir": 1.901121969695726, "get_state_dump": 0.019232070446014403, "sim_render-ego": 0.008384111722310385, "get_robot_state": 0.0190325133005778, "get_duckie_state": 2.9850006103515624e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025761191844940187, "deviation-heading": 2.3022006336454313, "complete-iteration": 0.27391471147537233, "set_robot_commands": 0.006586213906606038, "deviation-center-line": 0.3318862535423391, "driven_lanedir_consec": 1.901121969695726, "sim_compute_sim_state": 0.03713548978169759, "sim_compute_performance-ego": 0.0059560942649841304}}
set_robot_commands_max0.0066791971524556475
set_robot_commands_mean0.0066026947895685825
set_robot_commands_median0.0065819100538889565
set_robot_commands_min0.006567761898040771
sim_compute_performance-ego_max0.0059560942649841304
sim_compute_performance-ego_mean0.005933209061622619
sim_compute_performance-ego_median0.005932102998097738
sim_compute_performance-ego_min0.005912535985310872
sim_compute_sim_state_max0.03713548978169759
sim_compute_sim_state_mean0.03341170052687327
sim_compute_sim_state_median0.03253428896268209
sim_compute_sim_state_min0.03144273440043131
sim_render-ego_max0.008384111722310385
sim_render-ego_mean0.00825942317644755
sim_render-ego_median0.0082486887772878
sim_render-ego_min0.008156203428904215
simulation-passed1
step_physics_max0.10941389719645182
step_physics_mean0.10299960136413576
step_physics_median0.10165090719858803
step_physics_min0.09928269386291504
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4312811613Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7576391628891037
survival_time_median14.950000000000076
deviation-center-line_median0.7581003779237471
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02608277479807536
agent_compute-ego_mean0.02550609131654104
agent_compute-ego_median0.025386118888854985
agent_compute-ego_min0.025169352690378823
complete-iteration_max0.32466039816538494
complete-iteration_mean0.2916360253095627
complete-iteration_median0.2903750745455424
complete-iteration_min0.261133553981781
deviation-center-line_max0.8156754376432319
deviation-center-line_mean0.7483008453411162
deviation-center-line_min0.6613271878737388
deviation-heading_max2.515980208273744
deviation-heading_mean1.8534002695253624
deviation-heading_median1.8203051553911025
deviation-heading_min1.257010559045501
driven_any_max3.2965472124476447
driven_any_mean2.890366791439122
driven_any_median2.840604161986147
driven_any_min2.5837116293365474
driven_lanedir_consec_max3.278517682933468
driven_lanedir_consec_mean2.7488091587736925
driven_lanedir_consec_min2.2014406263830937
driven_lanedir_max3.278517682933468
driven_lanedir_mean2.7488091587736925
driven_lanedir_median2.7576391628891037
driven_lanedir_min2.2014406263830937
get_duckie_state_max3.0771891276041666e-06
get_duckie_state_mean2.927780151367188e-06
get_duckie_state_median2.9015541076660156e-06
get_duckie_state_min2.830823262532552e-06
get_robot_state_max0.024011386235555012
get_robot_state_mean0.02165839890638987
get_robot_state_median0.021787779331207277
get_robot_state_min0.019046650727589924
get_state_dump_max0.01982569297154745
get_state_dump_mean0.01949048618475596
get_state_dump_median0.01953604539235433
get_state_dump_min0.019064160982767742
get_ui_image_max0.04987736701965332
get_ui_image_mean0.04587705910205841
get_ui_image_median0.04580842773119609
get_ui_image_min0.04201401392618815
in-drivable-lane_max2.6500000000000377
in-drivable-lane_mean0.6625000000000094
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0115369566684262, "get_ui_image": 0.04201401392618815, "step_physics": 0.10125765482584637, "survival_time": 14.950000000000076, "driven_lanedir": 2.9828077282675247, "get_state_dump": 0.019064160982767742, "sim_render-ego": 0.008258036772410075, "get_robot_state": 0.019046650727589924, "get_duckie_state": 3.0771891276041666e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025523845354715986, "deviation-heading": 1.441313334976603, "complete-iteration": 0.261133553981781, "set_robot_commands": 0.006576167742411296, "deviation-center-line": 0.8156754376432319, "driven_lanedir_consec": 2.9828077282675247, "sim_compute_sim_state": 0.0332794189453125, "sim_compute_performance-ego": 0.00591936985651652}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2965472124476447, "get_ui_image": 0.042883883317311605, "step_physics": 0.10505735476811728, "survival_time": 14.950000000000076, "driven_lanedir": 3.278517682933468, "get_state_dump": 0.019369478225708007, "sim_render-ego": 0.008622902234395345, "get_robot_state": 0.01966724157333374, "get_duckie_state": 2.907117207845052e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02608277479807536, "deviation-heading": 1.257010559045501, "complete-iteration": 0.268800581296285, "set_robot_commands": 0.006977243423461914, "deviation-center-line": 0.7173969591080853, "driven_lanedir_consec": 3.278517682933468, "sim_compute_sim_state": 0.03379103422164917, "sim_compute_performance-ego": 0.006155895392100016}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5837116293365474, "get_ui_image": 0.04987736701965332, "step_physics": 0.13068358103434244, "survival_time": 14.950000000000076, "driven_lanedir": 2.5324705975106827, "get_state_dump": 0.01982569297154745, "sim_render-ego": 0.009714530309041342, "get_robot_state": 0.02390831708908081, "get_duckie_state": 2.895991007486979e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025248392422993975, "deviation-heading": 2.199296975805602, "complete-iteration": 0.3119495677947998, "set_robot_commands": 0.007709098656972249, "deviation-center-line": 0.7988037967394088, "driven_lanedir_consec": 2.5324705975106827, "sim_compute_sim_state": 0.038548394838968915, "sim_compute_performance-ego": 0.006246929963429769}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.669671367303868, "get_ui_image": 0.048732972145080565, "step_physics": 0.13834989070892334, "survival_time": 14.950000000000076, "driven_lanedir": 2.2014406263830937, "get_state_dump": 0.019702612559000653, "sim_render-ego": 0.009844215710957845, "get_robot_state": 0.024011386235555012, "get_duckie_state": 2.830823262532552e-06, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.025169352690378823, "deviation-heading": 2.515980208273744, "complete-iteration": 0.32466039816538494, "set_robot_commands": 0.007874358495076497, "deviation-center-line": 0.6613271878737388, "driven_lanedir_consec": 2.2014406263830937, "sim_compute_sim_state": 0.044514289697011315, "sim_compute_performance-ego": 0.006272008419036865}}
set_robot_commands_max0.007874358495076497
set_robot_commands_mean0.007284217079480489
set_robot_commands_median0.007343171040217082
set_robot_commands_min0.006576167742411296
sim_compute_performance-ego_max0.006272008419036865
sim_compute_performance-ego_mean0.006148550907770792
sim_compute_performance-ego_median0.006201412677764893
sim_compute_performance-ego_min0.00591936985651652
sim_compute_sim_state_max0.044514289697011315
sim_compute_sim_state_mean0.037533284425735475
sim_compute_sim_state_median0.03616971453030904
sim_compute_sim_state_min0.0332794189453125
sim_render-ego_max0.009844215710957845
sim_render-ego_mean0.009109921256701152
sim_render-ego_median0.009168716271718344
sim_render-ego_min0.008258036772410075
simulation-passed1
step_physics_max0.13834989070892334
step_physics_mean0.11883712033430736
step_physics_median0.11787046790122983
step_physics_min0.10125765482584637
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4310511605Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8968822111584838
survival_time_median9.700000000000014
deviation-center-line_median0.2602371935762679
in-drivable-lane_median6.250000000000039


other stats
agent_compute-ego_max0.07046834627787273
agent_compute-ego_mean0.05306307738587476
agent_compute-ego_median0.05732358784606491
agent_compute-ego_min0.0271367875734965
complete-iteration_max0.3149332183378714
complete-iteration_mean0.30268579696668324
complete-iteration_median0.2993808990837871
complete-iteration_min0.2970481713612874
deviation-center-line_max0.32644233732637334
deviation-center-line_mean0.25916775565024375
deviation-center-line_min0.1897542981220659
deviation-heading_max1.9004591234944483
deviation-heading_mean1.5364046125533628
deviation-heading_median1.523585596210734
deviation-heading_min1.1979881342975356
driven_any_max4.562527829738378
driven_any_mean3.010385669784111
driven_any_median2.9437194793839714
driven_any_min1.591575890630125
driven_lanedir_consec_max1.699405270266805
driven_lanedir_consec_mean1.0506520240951838
driven_lanedir_consec_min0.7094384037969628
driven_lanedir_max1.699405270266805
driven_lanedir_mean1.0506520240951838
driven_lanedir_median0.8968822111584838
driven_lanedir_min0.7094384037969628
get_duckie_state_max3.101649107756438e-06
get_duckie_state_mean3.051221274715307e-06
get_duckie_state_median3.057528233182603e-06
get_duckie_state_min2.9881795247395833e-06
get_robot_state_max0.02430842081705729
get_robot_state_mean0.021547572214438336
get_robot_state_median0.021554254379825315
get_robot_state_min0.01877335928104542
get_state_dump_max0.020758339564005537
get_state_dump_mean0.019731510225509487
get_state_dump_median0.019572222032408784
get_state_dump_min0.01902325727321483
get_ui_image_max0.04678715864817302
get_ui_image_mean0.043507212221142566
get_ui_image_median0.04277070769019749
get_ui_image_min0.04170027485600224
in-drivable-lane_max9.100000000000032
in-drivable-lane_mean5.762500000000027
in-drivable-lane_min1.4499999999999948
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.562527829738378, "get_ui_image": 0.04678715864817302, "step_physics": 0.11808159510294595, "survival_time": 14.950000000000076, "driven_lanedir": 1.699405270266805, "get_state_dump": 0.020758339564005537, "sim_render-ego": 0.009828837712605794, "get_robot_state": 0.02430842081705729, "get_duckie_state": 2.9881795247395833e-06, "in-drivable-lane": 8.650000000000091, "agent_compute-ego": 0.0271367875734965, "deviation-heading": 1.9004591234944483, "complete-iteration": 0.2970481713612874, "set_robot_commands": 0.0079561448097229, "deviation-center-line": 0.32644233732637334, "driven_lanedir_consec": 1.699405270266805, "sim_compute_sim_state": 0.03581987778345744, "sim_compute_performance-ego": 0.006197575728098551}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.063253082337856, "get_ui_image": 0.04380169122115425, "step_physics": 0.10335478229799132, "survival_time": 6.8999999999999835, "driven_lanedir": 0.7094384037969628, "get_state_dump": 0.01990970666857733, "sim_render-ego": 0.00969209705573925, "get_robot_state": 0.02397586124530737, "get_duckie_state": 3.025151681208956e-06, "in-drivable-lane": 3.8499999999999863, "agent_compute-ego": 0.04852278509001801, "deviation-heading": 1.4324300794738256, "complete-iteration": 0.2978275530580161, "set_robot_commands": 0.008162216863770416, "deviation-center-line": 0.1897542981220659, "driven_lanedir_consec": 0.7094384037969628, "sim_compute_sim_state": 0.034076759780662644, "sim_compute_performance-ego": 0.006152134010757225}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.8241858764300862, "get_ui_image": 0.04173972415924072, "step_physics": 0.10087430286407471, "survival_time": 12.500000000000044, "driven_lanedir": 0.7437514630510532, "get_state_dump": 0.019234737396240233, "sim_render-ego": 0.008154414176940917, "get_robot_state": 0.01913264751434326, "get_duckie_state": 3.08990478515625e-06, "in-drivable-lane": 9.100000000000032, "agent_compute-ego": 0.06612439060211181, "deviation-heading": 1.6147411129476423, "complete-iteration": 0.30093424510955813, "set_robot_commands": 0.007150532722473145, "deviation-center-line": 0.22428655947731316, "driven_lanedir_consec": 0.7437514630510532, "sim_compute_sim_state": 0.032474523544311525, "sim_compute_performance-ego": 0.005865631103515625}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.591575890630125, "get_ui_image": 0.04170027485600224, "step_physics": 0.10841879138240108, "survival_time": 5.399999999999989, "driven_lanedir": 1.0500129592659142, "get_state_dump": 0.01902325727321483, "sim_render-ego": 0.008305902834291811, "get_robot_state": 0.01877335928104542, "get_duckie_state": 3.101649107756438e-06, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.07046834627787273, "deviation-heading": 1.1979881342975356, "complete-iteration": 0.3149332183378714, "set_robot_commands": 0.007209113350620976, "deviation-center-line": 0.2961878276752226, "driven_lanedir_consec": 1.0500129592659142, "sim_compute_sim_state": 0.035183851365689876, "sim_compute_performance-ego": 0.005669761587072302}}
set_robot_commands_max0.008162216863770416
set_robot_commands_mean0.007619501936646859
set_robot_commands_median0.007582629080171938
set_robot_commands_min0.007150532722473145
sim_compute_performance-ego_max0.006197575728098551
sim_compute_performance-ego_mean0.005971275607360926
sim_compute_performance-ego_median0.006008882557136426
sim_compute_performance-ego_min0.005669761587072302
sim_compute_sim_state_max0.03581987778345744
sim_compute_sim_state_mean0.034388753118530374
sim_compute_sim_state_median0.03463030557317626
sim_compute_sim_state_min0.032474523544311525
sim_render-ego_max0.009828837712605794
sim_render-ego_mean0.008995312944894444
sim_render-ego_median0.008998999945015532
sim_render-ego_min0.008154414176940917
simulation-passed1
step_physics_max0.11808159510294595
step_physics_mean0.10768236791185327
step_physics_median0.1058867868401962
step_physics_min0.10087430286407471
survival_time_max14.950000000000076
survival_time_mean9.937500000000025
survival_time_min5.399999999999989
No reset possible
4307711601Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6367211459826525
survival_time_median9.650000000000034
deviation-center-line_median0.27583187226627504
in-drivable-lane_median3.3500000000000263


other stats
agent_compute-ego_max0.030092581113179525
agent_compute-ego_mean0.026808947521151257
agent_compute-ego_median0.02627713984456555
agent_compute-ego_min0.024588929282294374
complete-iteration_max0.3842432419459025
complete-iteration_mean0.3278029791377057
complete-iteration_median0.3178604149544376
complete-iteration_min0.2912478446960449
deviation-center-line_max0.4657733976050933
deviation-center-line_mean0.283671098879321
deviation-center-line_min0.11724725337964084
deviation-heading_max4.050493932560276
deviation-heading_mean1.601601029895052
deviation-heading_median0.9091497840802364
deviation-heading_min0.5376106188594604
driven_any_max3.0631255443512986
driven_any_mean1.839404973268088
driven_any_median1.946910396996493
driven_any_min0.40067355472806887
driven_lanedir_consec_max2.1239235286925804
driven_lanedir_consec_mean0.9252317737658268
driven_lanedir_consec_min0.30356127440542213
driven_lanedir_max2.1239235286925804
driven_lanedir_mean0.9402988018282232
driven_lanedir_median0.666855202107445
driven_lanedir_min0.30356127440542213
get_duckie_state_max3.078248765733507e-06
get_duckie_state_mean3.006339529921725e-06
get_duckie_state_median2.992180572158989e-06
get_duckie_state_min2.9627482096354165e-06
get_robot_state_max0.02393600584446699
get_robot_state_mean0.023584440651981307
get_robot_state_median0.02357125322024027
get_robot_state_min0.023259250322977702
get_state_dump_max0.020327368001828248
get_state_dump_mean0.01995105464111343
get_state_dump_median0.019937058157391017
get_state_dump_min0.019602734247843423
get_ui_image_max0.06119143565495809
get_ui_image_mean0.05366334874739592
get_ui_image_median0.0531379989645947
get_ui_image_min0.0471859614054362
in-drivable-lane_max7.900000000000046
in-drivable-lane_mean3.737500000000024
in-drivable-lane_min0.349999999999999
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.8309319661257625, "get_ui_image": 0.05075460192800938, "step_physics": 0.12434526969646584, "survival_time": 4.3499999999999925, "driven_lanedir": 0.305108648548446, "get_state_dump": 0.020327368001828248, "sim_render-ego": 0.009527236565776255, "get_robot_state": 0.02393600584446699, "get_duckie_state": 2.9898237908023527e-06, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.02552238278005315, "deviation-heading": 0.5376106188594604, "complete-iteration": 0.30419138108176746, "set_robot_commands": 0.007946899567527333, "deviation-center-line": 0.11724725337964084, "driven_lanedir_consec": 0.305108648548446, "sim_compute_sim_state": 0.03536451273951037, "sim_compute_performance-ego": 0.006280101578811119}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.40067355472806887, "get_ui_image": 0.0471859614054362, "step_physics": 0.11748553911844888, "survival_time": 2.25, "driven_lanedir": 0.30356127440542213, "get_state_dump": 0.019967529508802623, "sim_render-ego": 0.009746387269761828, "get_robot_state": 0.02356727917989095, "get_duckie_state": 3.078248765733507e-06, "in-drivable-lane": 0.349999999999999, "agent_compute-ego": 0.024588929282294374, "deviation-heading": 0.6208873895670087, "complete-iteration": 0.2912478446960449, "set_robot_commands": 0.007833867602878146, "deviation-center-line": 0.13311691593365715, "driven_lanedir_consec": 0.30356127440542213, "sim_compute_sim_state": 0.03434293005201552, "sim_compute_performance-ego": 0.006340514289008246}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0628888278672233, "get_ui_image": 0.055521396001180015, "step_physics": 0.1418014144897461, "survival_time": 14.950000000000076, "driven_lanedir": 1.028601755666444, "get_state_dump": 0.019602734247843423, "sim_render-ego": 0.010019450187683106, "get_robot_state": 0.0235752272605896, "get_duckie_state": 2.9627482096354165e-06, "in-drivable-lane": 7.900000000000046, "agent_compute-ego": 0.02703189690907796, "deviation-heading": 4.050493932560276, "complete-iteration": 0.3315294488271077, "set_robot_commands": 0.008165250619252523, "deviation-center-line": 0.4657733976050933, "driven_lanedir_consec": 0.968333643416859, "sim_compute_sim_state": 0.03920450369517008, "sim_compute_performance-ego": 0.006422431468963623}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0631255443512986, "get_ui_image": 0.06119143565495809, "step_physics": 0.17248383522033692, "survival_time": 14.950000000000076, "driven_lanedir": 2.1239235286925804, "get_state_dump": 0.019906586805979412, "sim_render-ego": 0.010955410798390706, "get_robot_state": 0.023259250322977702, "get_duckie_state": 2.994537353515625e-06, "in-drivable-lane": 4.300000000000061, "agent_compute-ego": 0.030092581113179525, "deviation-heading": 1.1974121785934635, "complete-iteration": 0.3842432419459025, "set_robot_commands": 0.008849295775095621, "deviation-center-line": 0.41854682859889286, "driven_lanedir_consec": 2.1239235286925804, "sim_compute_sim_state": 0.050397082964579266, "sim_compute_performance-ego": 0.006915753682454427}}
set_robot_commands_max0.008849295775095621
set_robot_commands_mean0.008198828391188406
set_robot_commands_median0.008056075093389927
set_robot_commands_min0.007833867602878146
sim_compute_performance-ego_max0.006915753682454427
sim_compute_performance-ego_mean0.006489700254809354
sim_compute_performance-ego_median0.006381472878985935
sim_compute_performance-ego_min0.006280101578811119
sim_compute_sim_state_max0.050397082964579266
sim_compute_sim_state_mean0.03982725736281881
sim_compute_sim_state_median0.03728450821734022
sim_compute_sim_state_min0.03434293005201552
sim_render-ego_max0.010955410798390706
sim_render-ego_mean0.010062121205402974
sim_render-ego_median0.009882918728722469
sim_render-ego_min0.009527236565776255
simulation-passed1
step_physics_max0.17248383522033692
step_physics_mean0.13902901463124945
step_physics_median0.13307334209310598
step_physics_min0.11748553911844888
survival_time_max14.950000000000076
survival_time_mean9.125000000000036
survival_time_min2.25
No reset possible
4306711598Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7931716622688805
survival_time_median14.950000000000076
deviation-center-line_median0.5804827655613493
in-drivable-lane_median0.7250000000000103


other stats
agent_compute-ego_max0.026183865865071616
agent_compute-ego_mean0.02499522686004639
agent_compute-ego_median0.024829808870951337
agent_compute-ego_min0.024137423833211265
complete-iteration_max0.29753750721613564
complete-iteration_mean0.2845939159393311
complete-iteration_median0.2821674740314484
complete-iteration_min0.27650320847829185
deviation-center-line_max0.8786956896871934
deviation-center-line_mean0.5837060649737027
deviation-center-line_min0.2951630390849189
deviation-heading_max2.548575378140328
deviation-heading_mean1.7062324031250131
deviation-heading_median1.4794577106387965
deviation-heading_min1.3174388130821322
driven_any_max1.939993567850693
driven_any_mean1.938412215134848
driven_any_median1.9399886240306337
driven_any_min1.9336780446274329
driven_lanedir_consec_max1.916679124590869
driven_lanedir_consec_mean1.7234337990065367
driven_lanedir_consec_min1.3907127468975171
driven_lanedir_max1.916679124590869
driven_lanedir_mean1.7234337990065367
driven_lanedir_median1.7931716622688805
driven_lanedir_min1.3907127468975171
get_duckie_state_max3.085931142171224e-06
get_duckie_state_mean3.0495723088582357e-06
get_duckie_state_median3.058910369873047e-06
get_duckie_state_min2.994537353515625e-06
get_robot_state_max0.02377884070078532
get_robot_state_mean0.022504844268163043
get_robot_state_median0.0228637691338857
get_robot_state_min0.02051299810409546
get_state_dump_max0.019890514214833576
get_state_dump_mean0.019760454297065733
get_state_dump_median0.01975283106168111
get_state_dump_min0.019645640850067137
get_ui_image_max0.046282668908437095
get_ui_image_mean0.04504742562770843
get_ui_image_median0.04508843104044597
get_ui_image_min0.04373017152150472
in-drivable-lane_max3.8500000000000543
in-drivable-lane_mean1.3250000000000188
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336780446274329, "get_ui_image": 0.04373017152150472, "step_physics": 0.10727890491485596, "survival_time": 14.950000000000076, "driven_lanedir": 1.3907127468975171, "get_state_dump": 0.019890514214833576, "sim_render-ego": 0.009550565083821617, "get_robot_state": 0.023558316230773927, "get_duckie_state": 3.040631612141927e-06, "in-drivable-lane": 3.8500000000000543, "agent_compute-ego": 0.026183865865071616, "deviation-heading": 1.3174388130821322, "complete-iteration": 0.2798468867937724, "set_robot_commands": 0.007921201388041178, "deviation-center-line": 0.3349651942693932, "driven_lanedir_consec": 1.3907127468975171, "sim_compute_sim_state": 0.03546708583831787, "sim_compute_performance-ego": 0.006087635358174642}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399927990946315, "get_ui_image": 0.046282668908437095, "step_physics": 0.10931081851323446, "survival_time": 14.950000000000076, "driven_lanedir": 1.916679124590869, "get_state_dump": 0.019645640850067137, "sim_render-ego": 0.008945042292277019, "get_robot_state": 0.02051299810409546, "get_duckie_state": 3.085931142171224e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02478643178939819, "deviation-heading": 1.3213516925837243, "complete-iteration": 0.27650320847829185, "set_robot_commands": 0.007163786093393962, "deviation-center-line": 0.2951630390849189, "driven_lanedir_consec": 1.916679124590869, "sim_compute_sim_state": 0.03349236965179443, "sim_compute_performance-ego": 0.006185775597890218}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9399844489666351, "get_ui_image": 0.045153919061024984, "step_physics": 0.1143038813273112, "survival_time": 14.950000000000076, "driven_lanedir": 1.6774398662785928, "get_state_dump": 0.01970507780710856, "sim_render-ego": 0.009445614020029703, "get_robot_state": 0.022169222036997477, "get_duckie_state": 2.994537353515625e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.024873185952504477, "deviation-heading": 2.548575378140328, "complete-iteration": 0.28448806126912435, "set_robot_commands": 0.00766231377919515, "deviation-center-line": 0.8786956896871934, "driven_lanedir_consec": 1.6774398662785928, "sim_compute_sim_state": 0.03490769465764364, "sim_compute_performance-ego": 0.006092659632364909}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939993567850693, "get_ui_image": 0.045022943019866944, "step_physics": 0.1194392244021098, "survival_time": 14.950000000000076, "driven_lanedir": 1.908903458259168, "get_state_dump": 0.01980058431625366, "sim_render-ego": 0.009731500148773194, "get_robot_state": 0.02377884070078532, "get_duckie_state": 3.0771891276041666e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024137423833211265, "deviation-heading": 1.6375637286938685, "complete-iteration": 0.29753750721613564, "set_robot_commands": 0.007995628515879313, "deviation-center-line": 0.8260003368533053, "driven_lanedir_consec": 1.908903458259168, "sim_compute_sim_state": 0.04118847846984863, "sim_compute_performance-ego": 0.006266450881958008}}
set_robot_commands_max0.007995628515879313
set_robot_commands_mean0.0076857324441274
set_robot_commands_median0.007791757583618164
set_robot_commands_min0.007163786093393962
sim_compute_performance-ego_max0.006266450881958008
sim_compute_performance-ego_mean0.006158130367596944
sim_compute_performance-ego_median0.006139217615127564
sim_compute_performance-ego_min0.006087635358174642
sim_compute_sim_state_max0.04118847846984863
sim_compute_sim_state_mean0.03626390715440114
sim_compute_sim_state_median0.03518739024798075
sim_compute_sim_state_min0.03349236965179443
sim_render-ego_max0.009731500148773194
sim_render-ego_mean0.009418180386225383
sim_render-ego_median0.00949808955192566
sim_render-ego_min0.008945042292277019
simulation-passed1
step_physics_max0.1194392244021098
step_physics_mean0.11258320728937786
step_physics_median0.11180734992027284
step_physics_min0.10727890491485596
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4303911590Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02549487829208374
agent_compute-ego_mean0.02511159320672353
agent_compute-ego_median0.02500836531321208
agent_compute-ego_min0.02493476390838623
complete-iteration_max0.31866743564605715
complete-iteration_mean0.28532372415065765
complete-iteration_median0.2838371988137563
complete-iteration_min0.25495306332906087
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max3.208319346110026e-06
get_duckie_state_mean3.016193707784017e-06
get_duckie_state_median2.9850006103515624e-06
get_duckie_state_min2.886454264322917e-06
get_robot_state_max0.022730520566304525
get_robot_state_mean0.02073918720086415
get_robot_state_median0.02070812225341797
get_robot_state_min0.01880998373031616
get_state_dump_max0.02045792023340861
get_state_dump_mean0.019621689716974897
get_state_dump_median0.019533672332763673
get_state_dump_min0.018961493968963624
get_ui_image_max0.051731866200764975
get_ui_image_mean0.04634215613206227
get_ui_image_median0.045827910105387365
get_ui_image_min0.041980938116709395
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.041980938116709395, "step_physics": 0.09903200785319012, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.018961493968963624, "sim_render-ego": 0.008160136540730794, "get_robot_state": 0.01880998373031616, "get_duckie_state": 3.208319346110026e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02493476390838623, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.25495306332906087, "set_robot_commands": 0.006295504570007324, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.030821562608083088, "sim_compute_performance-ego": 0.0057636117935180664}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04266221443812052, "step_physics": 0.10064393043518066, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01938091516494751, "sim_render-ego": 0.008359022935231527, "get_robot_state": 0.019085171222686766, "get_duckie_state": 2.9857953389485677e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02499538818995158, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.25853004058202106, "set_robot_commands": 0.006654717127482096, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.030668032964070637, "sim_compute_performance-ego": 0.005888158480326334}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.051731866200764975, "step_physics": 0.1295653486251831, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.019686429500579833, "sim_render-ego": 0.009784600734710693, "get_robot_state": 0.022730520566304525, "get_duckie_state": 2.886454264322917e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02549487829208374, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.30914435704549154, "set_robot_commands": 0.007841389179229736, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.03588889996210734, "sim_compute_performance-ego": 0.006233087380727132}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.048993605772654214, "step_physics": 0.13796130736668905, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02045792023340861, "sim_render-ego": 0.009608300526936848, "get_robot_state": 0.02233107328414917, "get_duckie_state": 2.9842058817545575e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025021342436472575, "deviation-heading": 0.486072248607516, "complete-iteration": 0.31866743564605715, "set_robot_commands": 0.00762457529703776, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0401960555712382, "sim_compute_performance-ego": 0.006283671061197917}}
set_robot_commands_max0.007841389179229736
set_robot_commands_mean0.0071040465434392295
set_robot_commands_median0.007139646212259928
set_robot_commands_min0.006295504570007324
sim_compute_performance-ego_max0.006283671061197917
sim_compute_performance-ego_mean0.006042132178942362
sim_compute_performance-ego_median0.006060622930526734
sim_compute_performance-ego_min0.0057636117935180664
sim_compute_sim_state_max0.0401960555712382
sim_compute_sim_state_mean0.034393637776374816
sim_compute_sim_state_median0.03335523128509521
sim_compute_sim_state_min0.030668032964070637
sim_render-ego_max0.009784600734710693
sim_render-ego_mean0.008978015184402464
sim_render-ego_median0.008983661731084187
sim_render-ego_min0.008160136540730794
simulation-passed1
step_physics_max0.13796130736668905
step_physics_mean0.11680064857006071
step_physics_median0.11510463953018188
step_physics_min0.09903200785319012
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4302711587Yishu Malhotra πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:04:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 170 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4302011585Yishu Malhotra πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:03:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 98 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4301111584Yishu Malhotra πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:04:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 116 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4300211583Yishu Malhotra πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:04:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 118 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4300111582Yishu Malhotra πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:03:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 114 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4299311579Olga (Ge Ya) Xu πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6540463408320971
survival_time_median14.950000000000076
deviation-center-line_median0.6162052764995296
in-drivable-lane_median6.72500000000003


other stats
agent_compute-ego_max0.026494584083557128
agent_compute-ego_mean0.026118932565053307
agent_compute-ego_median0.02619551499684652
agent_compute-ego_min0.025590116182963057
complete-iteration_max0.27249715487162274
complete-iteration_mean0.26571392118930814
complete-iteration_median0.26474358002344767
complete-iteration_min0.2608713698387146
deviation-center-line_max0.9290702507739566
deviation-center-line_mean0.650986226822651
deviation-center-line_min0.4424641035175879
deviation-heading_max3.518340672136796
deviation-heading_mean3.0550828034507886
deviation-heading_median3.0405280274497257
deviation-heading_min2.620934486766907
driven_any_max3.4422765989583164
driven_any_mean3.1237179475109604
driven_any_median3.105356826247175
driven_any_min2.8418815385911764
driven_lanedir_consec_max2.018548335601673
driven_lanedir_consec_mean1.5233496225522205
driven_lanedir_consec_min0.7667574729430148
driven_lanedir_max2.018548335601673
driven_lanedir_mean1.5233496225522205
driven_lanedir_median1.6540463408320971
driven_lanedir_min0.7667574729430148
get_duckie_state_max3.1248728434244793e-06
get_duckie_state_mean3.0521551767985024e-06
get_duckie_state_median3.0740102132161457e-06
get_duckie_state_min2.9357274373372394e-06
get_robot_state_max0.01924596945444743
get_robot_state_mean0.019057357311248777
get_robot_state_median0.019026783704757688
get_robot_state_min0.018929892381032307
get_state_dump_max0.019240771929423015
get_state_dump_mean0.019142750898996988
get_state_dump_median0.01914456605911255
get_state_dump_min0.019041099548339845
get_ui_image_max0.04245719273885091
get_ui_image_mean0.04235194504261017
get_ui_image_median0.042345042626063034
get_ui_image_min0.042260502179463706
in-drivable-lane_max9.20000000000007
in-drivable-lane_mean6.512500000000045
in-drivable-lane_min3.4000000000000483
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.8580689494225613, "get_ui_image": 0.042260502179463706, "step_physics": 0.10389562447865804, "survival_time": 14.950000000000076, "driven_lanedir": 2.018548335601673, "get_state_dump": 0.019159913063049316, "sim_render-ego": 0.00824619213740031, "get_robot_state": 0.018929892381032307, "get_duckie_state": 3.1248728434244793e-06, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.02621613264083862, "deviation-heading": 3.4376787782388676, "complete-iteration": 0.264787122408549, "set_robot_commands": 0.006657287279764812, "deviation-center-line": 0.9290702507739566, "driven_lanedir_consec": 2.018548335601673, "sim_compute_sim_state": 0.033333962758382164, "sim_compute_performance-ego": 0.005887410640716553}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.3526447030717894, "get_ui_image": 0.04232865571975708, "step_physics": 0.10088160196940105, "survival_time": 14.950000000000076, "driven_lanedir": 1.6034051275856016, "get_state_dump": 0.01912921905517578, "sim_render-ego": 0.008096105257670084, "get_robot_state": 0.01924596945444743, "get_duckie_state": 2.9357274373372394e-06, "in-drivable-lane": 7.350000000000039, "agent_compute-ego": 0.02617489735285441, "deviation-heading": 2.620934486766907, "complete-iteration": 0.2608713698387146, "set_robot_commands": 0.006669596831003825, "deviation-center-line": 0.5725314258434547, "driven_lanedir_consec": 1.6034051275856016, "sim_compute_sim_state": 0.03234827677408854, "sim_compute_performance-ego": 0.0058019081751505535}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8418815385911764, "get_ui_image": 0.04236142953236898, "step_physics": 0.10336173295974732, "survival_time": 14.950000000000076, "driven_lanedir": 0.7667574729430148, "get_state_dump": 0.019041099548339845, "sim_render-ego": 0.008208653926849364, "get_robot_state": 0.01900234858194987, "get_duckie_state": 3.0628840128580727e-06, "in-drivable-lane": 9.20000000000007, "agent_compute-ego": 0.026494584083557128, "deviation-heading": 3.518340672136796, "complete-iteration": 0.2647000376383464, "set_robot_commands": 0.006625991662343343, "deviation-center-line": 0.4424641035175879, "driven_lanedir_consec": 0.7667574729430148, "sim_compute_sim_state": 0.03348560253779093, "sim_compute_performance-ego": 0.005919013023376465}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.4422765989583164, "get_ui_image": 0.04245719273885091, "step_physics": 0.10742998917897542, "survival_time": 14.950000000000076, "driven_lanedir": 1.7046875540785926, "get_state_dump": 0.019240771929423015, "sim_render-ego": 0.008279512723286947, "get_robot_state": 0.01905121882756551, "get_duckie_state": 3.085136413574218e-06, "in-drivable-lane": 6.10000000000002, "agent_compute-ego": 0.025590116182963057, "deviation-heading": 2.643377276660584, "complete-iteration": 0.27249715487162274, "set_robot_commands": 0.006727879047393799, "deviation-center-line": 0.6598791271556045, "driven_lanedir_consec": 1.7046875540785926, "sim_compute_sim_state": 0.037655592759450275, "sim_compute_performance-ego": 0.005866698424021403}}
set_robot_commands_max0.006727879047393799
set_robot_commands_mean0.006670188705126445
set_robot_commands_median0.006663442055384318
set_robot_commands_min0.006625991662343343
sim_compute_performance-ego_max0.005919013023376465
sim_compute_performance-ego_mean0.005868757565816243
sim_compute_performance-ego_median0.005877054532368978
sim_compute_performance-ego_min0.0058019081751505535
sim_compute_sim_state_max0.037655592759450275
sim_compute_sim_state_mean0.034205858707427976
sim_compute_sim_state_median0.03340978264808655
sim_compute_sim_state_min0.03234827677408854
sim_render-ego_max0.008279512723286947
sim_render-ego_mean0.008207616011301676
sim_render-ego_median0.008227423032124837
sim_render-ego_min0.008096105257670084
simulation-passed1
step_physics_max0.10742998917897542
step_physics_mean0.10389223714669546
step_physics_median0.10362867871920269
step_physics_min0.10088160196940105
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4298811578Anastasiya Nikolskaya πŸ‡·πŸ‡ΊJetBrains Researchaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.952390783470051
survival_time_median14.950000000000076
deviation-center-line_median0.6946931243222538
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.027974825700124103
agent_compute-ego_mean0.02781159281730652
agent_compute-ego_median0.02786014238993327
agent_compute-ego_min0.02755126078923543
complete-iteration_max0.26882814486821494
complete-iteration_mean0.26337987462679546
complete-iteration_median0.2622345809141795
complete-iteration_min0.2602221918106079
deviation-center-line_max0.7512373269203972
deviation-center-line_mean0.6880759262655605
deviation-center-line_min0.6116801294973372
deviation-heading_max3.993980001424541
deviation-heading_mean3.402745423929969
deviation-heading_median3.2825351593058887
deviation-heading_min3.0519313756835555
driven_any_max6.525738386392676
driven_any_mean6.10571364561895
driven_any_median6.279355936052159
driven_any_min5.338404323978806
driven_lanedir_consec_max6.323432906653505
driven_lanedir_consec_mean5.780319896884747
driven_lanedir_consec_min4.893065113945383
driven_lanedir_max6.323432906653505
driven_lanedir_mean5.780319896884747
driven_lanedir_median5.952390783470051
driven_lanedir_min4.893065113945383
get_duckie_state_max3.791650136311849e-06
get_duckie_state_mean3.746549288431803e-06
get_duckie_state_median3.7535031636555983e-06
get_duckie_state_min3.6875406901041663e-06
get_robot_state_max0.0186121662457784
get_robot_state_mean0.018516698280970256
get_robot_state_median0.01851416071256002
get_robot_state_min0.018426305452982582
get_state_dump_max0.01856242020924886
get_state_dump_mean0.018467663129170735
get_state_dump_median0.01848399043083191
get_state_dump_min0.018340251445770263
get_ui_image_max0.04205512444178263
get_ui_image_mean0.04180386821428935
get_ui_image_median0.04177917877833048
get_ui_image_min0.041601990858713786
in-drivable-lane_max0.8500000000000121
in-drivable-lane_mean0.3625000000000025
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 6.525738386392676, "get_ui_image": 0.04205512444178263, "step_physics": 0.1021130386988322, "survival_time": 14.950000000000076, "driven_lanedir": 6.323432906653505, "get_state_dump": 0.01847244421641032, "sim_render-ego": 0.008122660319010417, "get_robot_state": 0.018426305452982582, "get_duckie_state": 3.791650136311849e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027866368293762208, "deviation-heading": 3.0519313756835555, "complete-iteration": 0.26346361796061196, "set_robot_commands": 0.006364490191141764, "deviation-center-line": 0.6116801294973372, "driven_lanedir_consec": 6.323432906653505, "sim_compute_sim_state": 0.03410311698913574, "sim_compute_performance-ego": 0.005760730902353923}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 6.421966293119426, "get_ui_image": 0.041733582019805905, "step_physics": 0.09924939235051472, "survival_time": 14.950000000000076, "driven_lanedir": 5.960313732373617, "get_state_dump": 0.018340251445770263, "sim_render-ego": 0.008192667961120606, "get_robot_state": 0.018458338578542073, "get_duckie_state": 3.6875406901041663e-06, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.02785391648610433, "deviation-heading": 3.410850462838277, "complete-iteration": 0.2602221918106079, "set_robot_commands": 0.00653739849726359, "deviation-center-line": 0.6519171553905976, "driven_lanedir_consec": 5.960313732373617, "sim_compute_sim_state": 0.033968024253845215, "sim_compute_performance-ego": 0.005707454681396484}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.338404323978806, "get_ui_image": 0.041601990858713786, "step_physics": 0.09979260683059692, "survival_time": 14.950000000000076, "driven_lanedir": 4.893065113945383, "get_state_dump": 0.01856242020924886, "sim_render-ego": 0.008076672554016113, "get_robot_state": 0.018569982846577963, "get_duckie_state": 3.741582234700521e-06, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02755126078923543, "deviation-heading": 3.993980001424541, "complete-iteration": 0.261005543867747, "set_robot_commands": 0.00636138916015625, "deviation-center-line": 0.7512373269203972, "driven_lanedir_consec": 4.893065113945383, "sim_compute_sim_state": 0.03452862819035848, "sim_compute_performance-ego": 0.005777568022410075}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 6.136745578984893, "get_ui_image": 0.04182477553685506, "step_physics": 0.10217607736587524, "survival_time": 14.950000000000076, "driven_lanedir": 5.944467834566486, "get_state_dump": 0.0184955366452535, "sim_render-ego": 0.0082192063331604, "get_robot_state": 0.0186121662457784, "get_duckie_state": 3.765424092610677e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027974825700124103, "deviation-heading": 3.154219855773501, "complete-iteration": 0.26882814486821494, "set_robot_commands": 0.006423562367757161, "deviation-center-line": 0.73746909325391, "driven_lanedir_consec": 5.944467834566486, "sim_compute_sim_state": 0.03917033116022746, "sim_compute_performance-ego": 0.00575119415918986}}
set_robot_commands_max0.00653739849726359
set_robot_commands_mean0.006421710054079692
set_robot_commands_median0.006394026279449462
set_robot_commands_min0.00636138916015625
sim_compute_performance-ego_max0.005777568022410075
sim_compute_performance-ego_mean0.005749236941337586
sim_compute_performance-ego_median0.005755962530771892
sim_compute_performance-ego_min0.005707454681396484
sim_compute_sim_state_max0.03917033116022746
sim_compute_sim_state_mean0.03544252514839172
sim_compute_sim_state_median0.03431587258974711
sim_compute_sim_state_min0.033968024253845215
sim_render-ego_max0.0082192063331604
sim_render-ego_mean0.008152801791826885
sim_render-ego_median0.008157664140065512
sim_render-ego_min0.008076672554016113
simulation-passed1
step_physics_max0.10217607736587524
step_physics_mean0.10083277881145478
step_physics_median0.10095282276471455
step_physics_min0.09924939235051472
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4298411576Anastasiya Nikolskaya πŸ‡·πŸ‡ΊJetBrains Researchaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:13:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.431039191012565
survival_time_median14.950000000000076
deviation-center-line_median1.2372273482269596
in-drivable-lane_median2.0500000000000163


other stats
agent_compute-ego_max0.04472412904103597
agent_compute-ego_mean0.04245027363300324
agent_compute-ego_median0.0421914025147756
agent_compute-ego_min0.04069416046142578
complete-iteration_max0.34998611132303875
complete-iteration_mean0.3422627105315526
complete-iteration_median0.3401757570107778
complete-iteration_min0.3387132167816162
deviation-center-line_max1.350624752778255
deviation-center-line_mean1.1894768010358698
deviation-center-line_min0.9328277549113048
deviation-heading_max4.142418729049147
deviation-heading_mean3.5874184038420887
deviation-heading_median3.6324629085544538
deviation-heading_min2.942329069210301
driven_any_max4.575504757773163
driven_any_mean4.052247480454052
driven_any_median4.08735084715015
driven_any_min3.4587834697427455
driven_lanedir_consec_max4.028398695150118
driven_lanedir_consec_mean3.4171473958064777
driven_lanedir_consec_min2.7781125060506633
driven_lanedir_max4.028398695150118
driven_lanedir_mean3.5397962375193397
driven_lanedir_median3.5978150968007085
driven_lanedir_min2.935156061325823
get_duckie_state_max2.8284390767415364e-06
get_duckie_state_mean2.755125363667806e-06
get_duckie_state_median2.767244974772135e-06
get_duckie_state_min2.6575724283854166e-06
get_robot_state_max0.023169713815053304
get_robot_state_mean0.02268303314844767
get_robot_state_median0.022534820636113485
get_robot_state_min0.022492777506510415
get_state_dump_max0.01958633104960124
get_state_dump_mean0.019295622905095417
get_state_dump_median0.019329574505488077
get_state_dump_min0.01893701155980428
get_ui_image_max0.056809022426605224
get_ui_image_mean0.055276519060134886
get_ui_image_median0.055037177006403606
get_ui_image_min0.054222699801127115
in-drivable-lane_max2.300000000000013
in-drivable-lane_mean1.9375000000000135
in-drivable-lane_min1.3500000000000094
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.919296206415132, "get_ui_image": 0.054929848512013754, "step_physics": 0.13525380690892538, "survival_time": 14.950000000000076, "driven_lanedir": 3.428187274488163, "get_state_dump": 0.01958633104960124, "sim_render-ego": 0.010162546634674072, "get_robot_state": 0.022559229532877603, "get_duckie_state": 2.8284390767415364e-06, "in-drivable-lane": 2.250000000000006, "agent_compute-ego": 0.042032002607981366, "deviation-heading": 2.942329069210301, "complete-iteration": 0.33958856026331585, "set_robot_commands": 0.007031515439351399, "deviation-center-line": 1.2156202945391166, "driven_lanedir_consec": 3.428187274488163, "sim_compute_sim_state": 0.041532658735911054, "sim_compute_performance-ego": 0.006332239309946696}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.2554054878851675, "get_ui_image": 0.05514450550079346, "step_physics": 0.136488721370697, "survival_time": 14.950000000000076, "driven_lanedir": 3.767442919113254, "get_state_dump": 0.01893701155980428, "sim_render-ego": 0.009672359625498454, "get_robot_state": 0.022492777506510415, "get_duckie_state": 2.7839342753092446e-06, "in-drivable-lane": 1.3500000000000094, "agent_compute-ego": 0.04472412904103597, "deviation-heading": 4.142418729049147, "complete-iteration": 0.34076295375823973, "set_robot_commands": 0.007323177655537924, "deviation-center-line": 1.350624752778255, "driven_lanedir_consec": 3.433891107536967, "sim_compute_sim_state": 0.039443732102711994, "sim_compute_performance-ego": 0.006365547974904379}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.4587834697427455, "get_ui_image": 0.056809022426605224, "step_physics": 0.1355747683842977, "survival_time": 14.950000000000076, "driven_lanedir": 2.935156061325823, "get_state_dump": 0.01932383934656779, "sim_render-ego": 0.009839329719543455, "get_robot_state": 0.022510411739349364, "get_duckie_state": 2.750555674235026e-06, "in-drivable-lane": 2.300000000000013, "agent_compute-ego": 0.04069416046142578, "deviation-heading": 4.086697331479138, "complete-iteration": 0.3387132167816162, "set_robot_commands": 0.007019539674123128, "deviation-center-line": 0.9328277549113048, "driven_lanedir_consec": 2.7781125060506633, "sim_compute_sim_state": 0.04047562996546428, "sim_compute_performance-ego": 0.006297034422556559}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.575504757773163, "get_ui_image": 0.054222699801127115, "step_physics": 0.1380985363324483, "survival_time": 14.950000000000076, "driven_lanedir": 4.028398695150118, "get_state_dump": 0.019335309664408367, "sim_render-ego": 0.00991477648417155, "get_robot_state": 0.023169713815053304, "get_duckie_state": 2.6575724283854166e-06, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.04235080242156983, "deviation-heading": 3.178228485629768, "complete-iteration": 0.34998611132303875, "set_robot_commands": 0.007776594956715901, "deviation-center-line": 1.2588344019148028, "driven_lanedir_consec": 4.028398695150118, "sim_compute_sim_state": 0.048582566579182945, "sim_compute_performance-ego": 0.006364177068074545}}
set_robot_commands_max0.007776594956715901
set_robot_commands_mean0.007287706931432088
set_robot_commands_median0.007177346547444662
set_robot_commands_min0.007019539674123128
sim_compute_performance-ego_max0.006365547974904379
sim_compute_performance-ego_mean0.006339749693870545
sim_compute_performance-ego_median0.006348208189010621
sim_compute_performance-ego_min0.006297034422556559
sim_compute_sim_state_max0.048582566579182945
sim_compute_sim_state_mean0.042508646845817566
sim_compute_sim_state_median0.041004144350687666
sim_compute_sim_state_min0.039443732102711994
sim_render-ego_max0.010162546634674072
sim_render-ego_mean0.009897253115971885
sim_render-ego_median0.009877053101857504
sim_render-ego_min0.009672359625498454
simulation-passed1
step_physics_max0.1380985363324483
step_physics_mean0.1363539582490921
step_physics_median0.13603174487749736
step_physics_min0.13525380690892538
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4297311574Anastasiya Nikolskaya πŸ‡·πŸ‡ΊJetBrains Researchaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0254827667576
survival_time_median14.950000000000076
deviation-center-line_median0.8090187430594024
in-drivable-lane_median6.025000000000054


other stats
agent_compute-ego_max0.02885104258855184
agent_compute-ego_mean0.028143725991249084
agent_compute-ego_median0.028144601980845133
agent_compute-ego_min0.027434657414754232
complete-iteration_max0.30806989113489786
complete-iteration_mean0.28636844754219054
complete-iteration_median0.2810854609807332
complete-iteration_min0.27523297707239786
deviation-center-line_max1.231777884192775
deviation-center-line_mean0.7375502477168966
deviation-center-line_min0.10038562055600687
deviation-heading_max4.187566694967403
deviation-heading_mean2.3447919707416083
deviation-heading_median2.408009569836579
deviation-heading_min0.3755820483258718
driven_any_max5.136548088136837
driven_any_mean3.315055190432229
driven_any_median3.774758602442085
driven_any_min0.5741554687079089
driven_lanedir_consec_max4.7849517170726665
driven_lanedir_consec_mean2.335347907368891
driven_lanedir_consec_min0.5054743788876983
driven_lanedir_max4.7849517170726665
driven_lanedir_mean2.6171423664294258
driven_lanedir_median2.589071684878669
driven_lanedir_min0.5054743788876983
get_duckie_state_max3.07003657023112e-06
get_duckie_state_mean2.981424331665039e-06
get_duckie_state_median3.0350685119628907e-06
get_duckie_state_min2.7855237325032553e-06
get_robot_state_max0.022508530616760253
get_robot_state_mean0.02145987272262573
get_robot_state_median0.021768865585327143
get_robot_state_min0.01979322910308838
get_state_dump_max0.019103213946024575
get_state_dump_mean0.018894251386324563
get_state_dump_median0.018899534543355308
get_state_dump_min0.01867472251256307
get_ui_image_max0.0477487587928772
get_ui_image_mean0.04529335637887319
get_ui_image_median0.044839007457097374
get_ui_image_min0.043746651808420814
in-drivable-lane_max13.100000000000076
in-drivable-lane_mean6.525000000000049
in-drivable-lane_min0.9500000000000136
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.5741554687079089, "get_ui_image": 0.043746651808420814, "step_physics": 0.1057893427213033, "survival_time": 14.950000000000076, "driven_lanedir": 0.5054743788876983, "get_state_dump": 0.018766605854034425, "sim_render-ego": 0.009393876393636069, "get_robot_state": 0.022508530616760253, "get_duckie_state": 3.07003657023112e-06, "in-drivable-lane": 13.100000000000076, "agent_compute-ego": 0.027434657414754232, "deviation-heading": 0.3755820483258718, "complete-iteration": 0.27523297707239786, "set_robot_commands": 0.006999066670735677, "deviation-center-line": 0.10038562055600687, "driven_lanedir_consec": 0.5054743788876983, "sim_compute_sim_state": 0.034490400155385334, "sim_compute_performance-ego": 0.005935804843902588}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.277281505648219, "get_ui_image": 0.04517740408579509, "step_physics": 0.10840218385060628, "survival_time": 14.950000000000076, "driven_lanedir": 1.8983695737614723, "get_state_dump": 0.019032463232676187, "sim_render-ego": 0.009113061428070068, "get_robot_state": 0.021267209847768143, "get_duckie_state": 3.0469894409179686e-06, "in-drivable-lane": 9.25000000000008, "agent_compute-ego": 0.02828365961710612, "deviation-heading": 1.8389131351900816, "complete-iteration": 0.2797076956431071, "set_robot_commands": 0.006859729290008545, "deviation-center-line": 0.4629257038012348, "driven_lanedir_consec": 1.8983695737614723, "sim_compute_sim_state": 0.03538994232813517, "sim_compute_performance-ego": 0.006012204488118489}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.27223569923595, "get_ui_image": 0.04450061082839966, "step_physics": 0.1129834779103597, "survival_time": 14.950000000000076, "driven_lanedir": 3.279773795995866, "get_state_dump": 0.019103213946024575, "sim_render-ego": 0.008694605032602946, "get_robot_state": 0.01979322910308838, "get_duckie_state": 3.0231475830078124e-06, "in-drivable-lane": 2.8000000000000274, "agent_compute-ego": 0.028005544344584143, "deviation-heading": 4.187566694967403, "complete-iteration": 0.28246322631835935, "set_robot_commands": 0.006540067195892334, "deviation-center-line": 1.1551117823175698, "driven_lanedir_consec": 2.152595959753728, "sim_compute_sim_state": 0.036105229059855144, "sim_compute_performance-ego": 0.006569922765096029}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.136548088136837, "get_ui_image": 0.0477487587928772, "step_physics": 0.1217800760269165, "survival_time": 14.950000000000076, "driven_lanedir": 4.7849517170726665, "get_state_dump": 0.01867472251256307, "sim_render-ego": 0.009632002512613933, "get_robot_state": 0.02227052132288615, "get_duckie_state": 2.7855237325032553e-06, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.02885104258855184, "deviation-heading": 2.9771060044830766, "complete-iteration": 0.30806989113489786, "set_robot_commands": 0.007079602877298991, "deviation-center-line": 1.231777884192775, "driven_lanedir_consec": 4.7849517170726665, "sim_compute_sim_state": 0.045759449005126955, "sim_compute_performance-ego": 0.006106557846069336}}
set_robot_commands_max0.007079602877298991
set_robot_commands_mean0.006869616508483886
set_robot_commands_median0.006929397980372111
set_robot_commands_min0.006540067195892334
sim_compute_performance-ego_max0.006569922765096029
sim_compute_performance-ego_mean0.00615612248579661
sim_compute_performance-ego_median0.0060593811670939125
sim_compute_performance-ego_min0.005935804843902588
sim_compute_sim_state_max0.045759449005126955
sim_compute_sim_state_mean0.03793625513712565
sim_compute_sim_state_median0.03574758569399516
sim_compute_sim_state_min0.034490400155385334
sim_render-ego_max0.009632002512613933
sim_render-ego_mean0.009208386341730754
sim_render-ego_median0.009253468910853067
sim_render-ego_min0.008694605032602946
simulation-passed1
step_physics_max0.1217800760269165
step_physics_mean0.11223877012729644
step_physics_median0.11069283088048298
step_physics_min0.1057893427213033
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4296411574Anastasiya Nikolskaya πŸ‡·πŸ‡ΊJetBrains Researchaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:14:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6910979136679576
survival_time_median14.950000000000076
deviation-center-line_median0.47371256112554183
in-drivable-lane_median9.35000000000009


other stats
agent_compute-ego_max0.028421385288238524
agent_compute-ego_mean0.027936466534932453
agent_compute-ego_median0.027949994802474978
agent_compute-ego_min0.02742449124654134
complete-iteration_max0.2871227995554606
complete-iteration_mean0.2809172924359639
complete-iteration_median0.28065013329188027
complete-iteration_min0.2752461036046346
deviation-center-line_max1.119296396682168
deviation-center-line_mean0.5591465822435048
deviation-center-line_min0.16986481004076737
deviation-heading_max3.0805847652581027
deviation-heading_mean1.6522497840018555
deviation-heading_median1.437421526033616
deviation-heading_min0.6535713186820874
driven_any_max4.95936646338928
driven_any_mean2.8033106262107292
driven_any_median2.231968107297826
driven_any_min1.7899398268579854
driven_lanedir_consec_max4.105277487040106
driven_lanedir_consec_mean2.200167115500803
driven_lanedir_consec_min1.3131951476271904
driven_lanedir_max4.105277487040106
driven_lanedir_mean2.200167115500803
driven_lanedir_median1.6910979136679576
driven_lanedir_min1.3131951476271904
get_duckie_state_max2.7720133463541667e-06
get_duckie_state_mean2.7221441268920895e-06
get_duckie_state_median2.7326742808024087e-06
get_duckie_state_min2.651214599609375e-06
get_robot_state_max0.0229583207766215
get_robot_state_mean0.02069364507993062
get_robot_state_median0.020389397541681925
get_robot_state_min0.01903746445973714
get_state_dump_max0.018854521115620932
get_state_dump_mean0.0187516188621521
get_state_dump_median0.018755512634913128
get_state_dump_min0.018640929063161213
get_ui_image_max0.04438059012095134
get_ui_image_mean0.044217044909795125
get_ui_image_median0.044208130439122514
get_ui_image_min0.04407132863998413
in-drivable-lane_max10.950000000000085
in-drivable-lane_mean8.187500000000076
in-drivable-lane_min3.100000000000044
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.7899398268579854, "get_ui_image": 0.04438059012095134, "step_physics": 0.11209198156992596, "survival_time": 14.950000000000076, "driven_lanedir": 1.3131951476271904, "get_state_dump": 0.01881142218907674, "sim_render-ego": 0.008695788383483886, "get_robot_state": 0.01903746445973714, "get_duckie_state": 2.7720133463541667e-06, "in-drivable-lane": 10.950000000000085, "agent_compute-ego": 0.028322575092315675, "deviation-heading": 0.6535713186820874, "complete-iteration": 0.2786789274215698, "set_robot_commands": 0.006518433094024658, "deviation-center-line": 0.16986481004076737, "driven_lanedir_consec": 1.3131951476271904, "sim_compute_sim_state": 0.03480420112609863, "sim_compute_performance-ego": 0.005851720174153646}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.4585655011345917, "get_ui_image": 0.044332488377888994, "step_physics": 0.1081851037343343, "survival_time": 14.950000000000076, "driven_lanedir": 1.4750038646215082, "get_state_dump": 0.018699603080749513, "sim_render-ego": 0.009237939516703288, "get_robot_state": 0.019242456754048665, "get_duckie_state": 2.7108192443847654e-06, "in-drivable-lane": 10.100000000000088, "agent_compute-ego": 0.027577414512634277, "deviation-heading": 1.7112820444064143, "complete-iteration": 0.2752461036046346, "set_robot_commands": 0.006537024180094401, "deviation-center-line": 0.5000640754124691, "driven_lanedir_consec": 1.4750038646215082, "sim_compute_sim_state": 0.03535749912261963, "sim_compute_performance-ego": 0.005908633867899577}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.0053707134610597, "get_ui_image": 0.04407132863998413, "step_physics": 0.1096700922648112, "survival_time": 14.950000000000076, "driven_lanedir": 1.907191962714407, "get_state_dump": 0.018640929063161213, "sim_render-ego": 0.009502875804901122, "get_robot_state": 0.0229583207766215, "get_duckie_state": 2.754529317220052e-06, "in-drivable-lane": 8.600000000000092, "agent_compute-ego": 0.028421385288238524, "deviation-heading": 1.1635610076608178, "complete-iteration": 0.28262133916219073, "set_robot_commands": 0.006729027430216471, "deviation-center-line": 0.44736104683861455, "driven_lanedir_consec": 1.907191962714407, "sim_compute_sim_state": 0.03656205574671428, "sim_compute_performance-ego": 0.005894544124603271}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.95936646338928, "get_ui_image": 0.04408377250035604, "step_physics": 0.10971165259679158, "survival_time": 14.950000000000076, "driven_lanedir": 4.105277487040106, "get_state_dump": 0.018854521115620932, "sim_render-ego": 0.009182490507761638, "get_robot_state": 0.021536338329315185, "get_duckie_state": 2.651214599609375e-06, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.02742449124654134, "deviation-heading": 3.0805847652581027, "complete-iteration": 0.2871227995554606, "set_robot_commands": 0.006682856877644857, "deviation-center-line": 1.119296396682168, "driven_lanedir_consec": 4.105277487040106, "sim_compute_sim_state": 0.04356249809265136, "sim_compute_performance-ego": 0.0059153588612874345}}
set_robot_commands_max0.006729027430216471
set_robot_commands_mean0.006616835395495097
set_robot_commands_median0.0066099405288696286
set_robot_commands_min0.006518433094024658
sim_compute_performance-ego_max0.0059153588612874345
sim_compute_performance-ego_mean0.005892564256985982
sim_compute_performance-ego_median0.005901588996251424
sim_compute_performance-ego_min0.005851720174153646
sim_compute_sim_state_max0.04356249809265136
sim_compute_sim_state_mean0.03757156352202098
sim_compute_sim_state_median0.035959777434666954
sim_compute_sim_state_min0.03480420112609863
sim_render-ego_max0.009502875804901122
sim_render-ego_mean0.009154773553212484
sim_render-ego_median0.009210215012232462
sim_render-ego_min0.008695788383483886
simulation-passed1
step_physics_max0.11209198156992596
step_physics_mean0.10991470754146576
step_physics_median0.1096908724308014
step_physics_min0.1081851037343343
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4296111573Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:06:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2272023264998968
survival_time_median7.849999999999987
deviation-center-line_median0.240218231574166
in-drivable-lane_median2.0499999999999994


other stats
agent_compute-ego_max0.02634909715545311
agent_compute-ego_mean0.02572191170427237
agent_compute-ego_median0.025560566186904908
agent_compute-ego_min0.025417417287826535
complete-iteration_max0.27349013522051385
complete-iteration_mean0.2648452637226947
complete-iteration_median0.26377686099572617
complete-iteration_min0.2583371976788124
deviation-center-line_max0.3957739529428256
deviation-center-line_mean0.26337487481253685
deviation-center-line_min0.17728908315898995
deviation-heading_max1.9356894419811703
deviation-heading_mean1.1380510885029045
deviation-heading_median0.972449677782645
deviation-heading_min0.6716155564651569
driven_any_max3.536011279426908
driven_any_mean2.3273609903129806
driven_any_median2.295958655222177
driven_any_min1.1815153713806594
driven_lanedir_consec_max1.846093681982738
driven_lanedir_consec_mean1.265056862437823
driven_lanedir_consec_min0.7597291147687603
driven_lanedir_max1.846093681982738
driven_lanedir_mean1.265056862437823
driven_lanedir_median1.2272023264998968
driven_lanedir_min0.7597291147687603
get_duckie_state_max3.0234240103459018e-06
get_duckie_state_mean2.9465087388255723e-06
get_duckie_state_median2.949454567649148e-06
get_duckie_state_min2.8637018096580932e-06
get_robot_state_max0.01925707381704579
get_robot_state_mean0.019126051925547928
get_robot_state_median0.01910119088208712
get_robot_state_min0.01904475212097168
get_state_dump_max0.01930210728576218
get_state_dump_mean0.019146779764733328
get_state_dump_median0.019117379532324688
get_state_dump_min0.019050252708521755
get_ui_image_max0.04196782594316461
get_ui_image_mean0.041843428396625935
get_ui_image_median0.04182636551235033
get_ui_image_min0.04175315661863847
in-drivable-lane_max11.100000000000064
in-drivable-lane_mean3.9500000000000153
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.4328995770409154, "get_ui_image": 0.04175315661863847, "step_physics": 0.10058378225023096, "survival_time": 8.79999999999999, "driven_lanedir": 1.5258719086825228, "get_state_dump": 0.019050252708521755, "sim_render-ego": 0.008436830206350847, "get_robot_state": 0.01905401592904871, "get_duckie_state": 2.9043717817826704e-06, "in-drivable-lane": 3.3500000000000014, "agent_compute-ego": 0.025417417287826535, "deviation-heading": 0.6716155564651569, "complete-iteration": 0.2606900063428012, "set_robot_commands": 0.006553022698922591, "deviation-center-line": 0.17728908315898995, "driven_lanedir_consec": 1.5258719086825228, "sim_compute_sim_state": 0.033742733977057716, "sim_compute_performance-ego": 0.0059152042323892765}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.1815153713806594, "get_ui_image": 0.04196782594316461, "step_physics": 0.0998991419760029, "survival_time": 4.449999999999992, "driven_lanedir": 0.9285327443172708, "get_state_dump": 0.019100036513939333, "sim_render-ego": 0.008275948213727286, "get_robot_state": 0.01914836583512553, "get_duckie_state": 2.8637018096580932e-06, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02634909715545311, "deviation-heading": 0.946674244663766, "complete-iteration": 0.2583371976788124, "set_robot_commands": 0.006672773468360472, "deviation-center-line": 0.2097419171512693, "driven_lanedir_consec": 0.9285327443172708, "sim_compute_sim_state": 0.030750759531942645, "sim_compute_performance-ego": 0.005987424529000615}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.536011279426908, "get_ui_image": 0.04188144524892171, "step_physics": 0.10710737387339274, "survival_time": 14.950000000000076, "driven_lanedir": 0.7597291147687603, "get_state_dump": 0.019134722550710043, "sim_render-ego": 0.008310718536376953, "get_robot_state": 0.01904475212097168, "get_duckie_state": 2.994537353515625e-06, "in-drivable-lane": 11.100000000000064, "agent_compute-ego": 0.025422271887461344, "deviation-heading": 1.9356894419811703, "complete-iteration": 0.26686371564865113, "set_robot_commands": 0.006555790106455485, "deviation-center-line": 0.27069454599706266, "driven_lanedir_consec": 0.7597291147687603, "sim_compute_sim_state": 0.03332666794459025, "sim_compute_performance-ego": 0.005896193186442057}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.159017733403439, "get_ui_image": 0.04177128577577895, "step_physics": 0.1093375337296638, "survival_time": 6.8999999999999835, "driven_lanedir": 1.846093681982738, "get_state_dump": 0.01930210728576218, "sim_render-ego": 0.008328973383143328, "get_robot_state": 0.01925707381704579, "get_duckie_state": 3.0234240103459018e-06, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.02569886048634847, "deviation-heading": 0.998225110901524, "complete-iteration": 0.27349013522051385, "set_robot_commands": 0.00660366770150005, "deviation-center-line": 0.3957739529428256, "driven_lanedir_consec": 1.846093681982738, "sim_compute_sim_state": 0.03703287718952566, "sim_compute_performance-ego": 0.005975583325261655}}
set_robot_commands_max0.006672773468360472
set_robot_commands_mean0.00659631349380965
set_robot_commands_median0.006579728903977768
set_robot_commands_min0.006553022698922591
sim_compute_performance-ego_max0.005987424529000615
sim_compute_performance-ego_mean0.0059436013182734
sim_compute_performance-ego_median0.005945393778825466
sim_compute_performance-ego_min0.005896193186442057
sim_compute_sim_state_max0.03703287718952566
sim_compute_sim_state_mean0.033713259660779066
sim_compute_sim_state_median0.033534700960823983
sim_compute_sim_state_min0.030750759531942645
sim_render-ego_max0.008436830206350847
sim_render-ego_mean0.008338117584899604
sim_render-ego_median0.00831984595976014
sim_render-ego_min0.008275948213727286
simulation-passed1
step_physics_max0.1093375337296638
step_physics_mean0.1042319579573226
step_physics_median0.10384557806181186
step_physics_min0.0998991419760029
survival_time_max14.950000000000076
survival_time_mean8.775000000000011
survival_time_min4.449999999999992
No reset possible
4295811572Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:03:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 96 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4294311568Dishank Bansal πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:08:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 712 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4292611565Bhavya Patwa πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2655407381912922
survival_time_median14.950000000000076
deviation-center-line_median0.5647812598788058
in-drivable-lane_median4.375000000000062


other stats
agent_compute-ego_max0.06164298057556152
agent_compute-ego_mean0.050190533121055536
agent_compute-ego_median0.056858729759109355
agent_compute-ego_min0.025401692390441898
complete-iteration_max0.3086792246500651
complete-iteration_mean0.28758581329728955
complete-iteration_median0.2892330914605815
complete-iteration_min0.2631978456179301
deviation-center-line_max0.7727440241037439
deviation-center-line_mean0.5352551493040342
deviation-center-line_min0.23871405335478144
deviation-heading_max2.4584787913300454
deviation-heading_mean1.4323586219134263
deviation-heading_median1.1405131831281414
deviation-heading_min0.9899293300673772
driven_any_max1.9399742479483355
driven_any_mean1.7973220739540927
driven_any_median1.9368028772144472
driven_any_min1.37570829343914
driven_lanedir_consec_max1.8402801331340752
driven_lanedir_consec_mean1.2388025409103558
driven_lanedir_consec_min0.583848554124763
driven_lanedir_max1.8402801331340752
driven_lanedir_mean1.2558130341121445
driven_lanedir_median1.29956172459487
driven_lanedir_min0.583848554124763
get_duckie_state_max4.180123872846086e-06
get_duckie_state_mean4.069768008413345e-06
get_duckie_state_median4.085302352905273e-06
get_duckie_state_min3.928343454996745e-06
get_robot_state_max0.01932129347435782
get_robot_state_mean0.019053721537471188
get_robot_state_median0.01899095336596171
get_robot_state_min0.018911685943603516
get_state_dump_max0.019388984044392904
get_state_dump_mean0.01923898170113192
get_state_dump_median0.019253614141933644
get_state_dump_min0.019059714476267496
get_ui_image_max0.041983311176300046
get_ui_image_mean0.04181112156850155
get_ui_image_median0.041838423013687134
get_ui_image_min0.041584329070331896
in-drivable-lane_max5.8000000000000265
in-drivable-lane_mean3.78750000000004
in-drivable-lane_min0.6000000000000085
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933651525796548, "get_ui_image": 0.041983311176300046, "step_physics": 0.10385311444600424, "survival_time": 14.950000000000076, "driven_lanedir": 1.218910997659965, "get_state_dump": 0.019059714476267496, "sim_render-ego": 0.008307926654815674, "get_robot_state": 0.019021294911702475, "get_duckie_state": 4.067420959472656e-06, "in-drivable-lane": 5.300000000000075, "agent_compute-ego": 0.025401692390441898, "deviation-heading": 1.0143703103216553, "complete-iteration": 0.2631978456179301, "set_robot_commands": 0.006380257606506348, "deviation-center-line": 0.5714363618668612, "driven_lanedir_consec": 1.218910997659965, "sim_compute_sim_state": 0.033075141906738284, "sim_compute_performance-ego": 0.005932537714640299}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399542286323463, "get_ui_image": 0.04177611509958903, "step_physics": 0.10103638807932536, "survival_time": 14.950000000000076, "driven_lanedir": 1.3802124515297751, "get_state_dump": 0.01919515291849772, "sim_render-ego": 0.00820935567220052, "get_robot_state": 0.01896061182022095, "get_duckie_state": 3.928343454996745e-06, "in-drivable-lane": 3.450000000000049, "agent_compute-ego": 0.05408885478973389, "deviation-heading": 2.4584787913300454, "complete-iteration": 0.28774222294489543, "set_robot_commands": 0.007256555557250977, "deviation-center-line": 0.7727440241037439, "driven_lanedir_consec": 1.3121704787226194, "sim_compute_sim_state": 0.0312080184618632, "sim_compute_performance-ego": 0.005830208460489909}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.37570829343914, "get_ui_image": 0.041584329070331896, "step_physics": 0.09809656789369672, "survival_time": 10.700000000000015, "driven_lanedir": 0.583848554124763, "get_state_dump": 0.01931207536536957, "sim_render-ego": 0.00823651853008805, "get_robot_state": 0.01932129347435782, "get_duckie_state": 4.180123872846086e-06, "in-drivable-lane": 5.8000000000000265, "agent_compute-ego": 0.05962860472848482, "deviation-heading": 0.9899293300673772, "complete-iteration": 0.2907239599762676, "set_robot_commands": 0.007152731173506407, "deviation-center-line": 0.23871405335478144, "driven_lanedir_consec": 0.583848554124763, "sim_compute_sim_state": 0.03142223402718517, "sim_compute_performance-ego": 0.005784159508821006}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399742479483355, "get_ui_image": 0.041900730927785235, "step_physics": 0.10782985051472982, "survival_time": 14.950000000000076, "driven_lanedir": 1.8402801331340752, "get_state_dump": 0.019388984044392904, "sim_render-ego": 0.008267096678415934, "get_robot_state": 0.018911685943603516, "get_duckie_state": 4.103183746337891e-06, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.06164298057556152, "deviation-heading": 1.2666560559346274, "complete-iteration": 0.3086792246500651, "set_robot_commands": 0.007446676890055339, "deviation-center-line": 0.5581261578907503, "driven_lanedir_consec": 1.8402801331340752, "sim_compute_sim_state": 0.037332428296407066, "sim_compute_performance-ego": 0.005774017969767253}}
set_robot_commands_max0.007446676890055339
set_robot_commands_mean0.007059055306829767
set_robot_commands_median0.007204643365378692
set_robot_commands_min0.006380257606506348
sim_compute_performance-ego_max0.005932537714640299
sim_compute_performance-ego_mean0.005830230913429616
sim_compute_performance-ego_median0.0058071839846554575
sim_compute_performance-ego_min0.005774017969767253
sim_compute_sim_state_max0.037332428296407066
sim_compute_sim_state_mean0.03325945567304843
sim_compute_sim_state_median0.03224868796696173
sim_compute_sim_state_min0.0312080184618632
sim_render-ego_max0.008307926654815674
sim_render-ego_mean0.008255224383880044
sim_render-ego_median0.008251807604251992
sim_render-ego_min0.00820935567220052
simulation-passed1
step_physics_max0.10782985051472982
step_physics_mean0.10270398023343905
step_physics_median0.1024447512626648
step_physics_min0.09809656789369672
survival_time_max14.950000000000076
survival_time_mean13.887500000000063
survival_time_min10.700000000000015
No reset possible
4290911560Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:09:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 854 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4290011557Olga (Ge Ya) Xu πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0390793987872824
survival_time_median14.950000000000076
deviation-center-line_median0.6351449999017097
in-drivable-lane_median3.225000000000013


other stats
agent_compute-ego_max0.02556385040283203
agent_compute-ego_mean0.02507499350855748
agent_compute-ego_median0.025080025990804035
agent_compute-ego_min0.02457607164978981
complete-iteration_max0.28790976126988727
complete-iteration_mean0.2806773331513007
complete-iteration_median0.27952601313591
complete-iteration_min0.27574754506349564
deviation-center-line_max0.832515532708892
deviation-center-line_mean0.5648972952662807
deviation-center-line_min0.15678364855281185
deviation-heading_max4.08506517236941
deviation-heading_mean2.1297459792202544
deviation-heading_median2.001198315192953
deviation-heading_min0.431522114125702
driven_any_max3.730618568012284
driven_any_mean2.6396366011932013
driven_any_median3.1544620856018017
driven_any_min0.5190036655569173
driven_lanedir_consec_max3.1748768456204974
driven_lanedir_consec_mean1.8799756284664064
driven_lanedir_consec_min0.26686687067056347
driven_lanedir_max3.1748768456204974
driven_lanedir_mean1.8799756284664064
driven_lanedir_median2.0390793987872824
driven_lanedir_min0.26686687067056347
get_duckie_state_max2.9746691385904948e-06
get_duckie_state_mean2.930996318658193e-06
get_duckie_state_median2.941762407620748e-06
get_duckie_state_min2.865791320800781e-06
get_robot_state_max0.021587047576904297
get_robot_state_mean0.0203297666584452
get_robot_state_median0.02006238855421543
get_robot_state_min0.01960724194844564
get_state_dump_max0.0209618337949117
get_state_dump_mean0.020275999009609223
get_state_dump_median0.02023627460002899
get_state_dump_min0.019669613043467205
get_ui_image_max0.045463813940684
get_ui_image_mean0.04461145461847385
get_ui_image_median0.04452319820721944
get_ui_image_min0.04393560811877251
in-drivable-lane_max7.550000000000065
in-drivable-lane_mean3.7250000000000254
in-drivable-lane_min0.9000000000000128
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.4223081009535905, "get_ui_image": 0.04437158028284709, "step_physics": 0.11062922557195028, "survival_time": 14.950000000000076, "driven_lanedir": 3.1748768456204974, "get_state_dump": 0.020001184940338135, "sim_render-ego": 0.008751969337463378, "get_robot_state": 0.020332708358764648, "get_duckie_state": 2.9746691385904948e-06, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.02460964520772298, "deviation-heading": 1.873258302765317, "complete-iteration": 0.2778457721074422, "set_robot_commands": 0.007018832365671793, "deviation-center-line": 0.832515532708892, "driven_lanedir_consec": 3.1748768456204974, "sim_compute_sim_state": 0.03587785402933757, "sim_compute_performance-ego": 0.006075499057769776}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.730618568012284, "get_ui_image": 0.0446748161315918, "step_physics": 0.11234610875447593, "survival_time": 14.950000000000076, "driven_lanedir": 2.7688998483617686, "get_state_dump": 0.0209618337949117, "sim_render-ego": 0.009109175205230712, "get_robot_state": 0.01960724194844564, "get_duckie_state": 2.865791320800781e-06, "in-drivable-lane": 5.05000000000003, "agent_compute-ego": 0.02556385040283203, "deviation-heading": 2.129138327620589, "complete-iteration": 0.28120625416437783, "set_robot_commands": 0.0071349358558654786, "deviation-center-line": 0.6085002033636356, "driven_lanedir_consec": 2.7688998483617686, "sim_compute_sim_state": 0.03544981161753336, "sim_compute_performance-ego": 0.006181561946868896}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.886616070250013, "get_ui_image": 0.045463813940684, "step_physics": 0.1160531504948934, "survival_time": 14.950000000000076, "driven_lanedir": 1.3092589492127964, "get_state_dump": 0.019669613043467205, "sim_render-ego": 0.009489332834879556, "get_robot_state": 0.021587047576904297, "get_duckie_state": 2.929369608561198e-06, "in-drivable-lane": 7.550000000000065, "agent_compute-ego": 0.025550406773885093, "deviation-heading": 4.08506517236941, "complete-iteration": 0.28790976126988727, "set_robot_commands": 0.007544381618499756, "deviation-center-line": 0.6617897964397838, "driven_lanedir_consec": 1.3092589492127964, "sim_compute_sim_state": 0.03595758120218913, "sim_compute_performance-ego": 0.006416423320770264}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.5190036655569173, "get_ui_image": 0.04393560811877251, "step_physics": 0.10914213582873344, "survival_time": 3.1999999999999966, "driven_lanedir": 0.26686687067056347, "get_state_dump": 0.02047136425971985, "sim_render-ego": 0.008451361209154129, "get_robot_state": 0.019792068749666217, "get_duckie_state": 2.954155206680298e-06, "in-drivable-lane": 1.3999999999999957, "agent_compute-ego": 0.02457607164978981, "deviation-heading": 0.431522114125702, "complete-iteration": 0.27574754506349564, "set_robot_commands": 0.00689643993973732, "deviation-center-line": 0.15678364855281185, "driven_lanedir_consec": 0.26686687067056347, "sim_compute_sim_state": 0.03612752631306648, "sim_compute_performance-ego": 0.006167203187942505}}
set_robot_commands_max0.007544381618499756
set_robot_commands_mean0.0071486474449435865
set_robot_commands_median0.007076884110768636
set_robot_commands_min0.00689643993973732
sim_compute_performance-ego_max0.006416423320770264
sim_compute_performance-ego_mean0.0062101718783378595
sim_compute_performance-ego_median0.0061743825674057005
sim_compute_performance-ego_min0.006075499057769776
sim_compute_sim_state_max0.03612752631306648
sim_compute_sim_state_mean0.03585319329053163
sim_compute_sim_state_median0.035917717615763345
sim_compute_sim_state_min0.03544981161753336
sim_render-ego_max0.009489332834879556
sim_render-ego_mean0.008950459646681945
sim_render-ego_median0.008930572271347047
sim_render-ego_min0.008451361209154129
simulation-passed1
step_physics_max0.1160531504948934
step_physics_mean0.11204265516251326
step_physics_median0.1114876671632131
step_physics_min0.10914213582873344
survival_time_max14.950000000000076
survival_time_mean12.012500000000058
survival_time_min3.1999999999999966
No reset possible
4289311556Yishu Malhotra πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.024918408393859864
agent_compute-ego_mean0.02465687135855357
agent_compute-ego_median0.02465769688288371
agent_compute-ego_min0.024393683274586995
complete-iteration_max0.2999844249089559
complete-iteration_mean0.27685504833857216
complete-iteration_median0.27524017055829364
complete-iteration_min0.25695542732874554
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.8332074483235676e-06
get_duckie_state_mean2.783338228861491e-06
get_duckie_state_median2.8073787689208985e-06
get_duckie_state_min2.685387929280599e-06
get_robot_state_max0.022886307239532472
get_robot_state_mean0.02151547213395437
get_robot_state_median0.021890371640523272
get_robot_state_min0.019394838015238444
get_state_dump_max0.01973556836446126
get_state_dump_mean0.01947355508804321
get_state_dump_median0.019529861609141032
get_state_dump_min0.019098928769429525
get_ui_image_max0.04596389532089233
get_ui_image_mean0.04443506836891174
get_ui_image_median0.04469326774279277
get_ui_image_min0.042389842669169106
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.042389842669169106, "step_physics": 0.09903660217920938, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019098928769429525, "sim_render-ego": 0.008274644215901693, "get_robot_state": 0.019394838015238444, "get_duckie_state": 2.826054890950521e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024918408393859864, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.25695542732874554, "set_robot_commands": 0.0066227595011393225, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.031139090855916342, "sim_compute_performance-ego": 0.005890462398529053}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.044796872138977054, "step_physics": 0.1103402042388916, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019394640922546388, "sim_render-ego": 0.009167098999023435, "get_robot_state": 0.021636831760406493, "get_duckie_state": 2.685387929280599e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024393683274586995, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2755333566665649, "set_robot_commands": 0.007435896396636963, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03208826780319214, "sim_compute_performance-ego": 0.006097359657287598}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04458966334660848, "step_physics": 0.10720094521840412, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.01973556836446126, "sim_render-ego": 0.009274223645528157, "get_robot_state": 0.022143911520640058, "get_duckie_state": 2.8332074483235676e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024629788398742677, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.27494698445002236, "set_robot_commands": 0.007411916255950928, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.033684564431508385, "sim_compute_performance-ego": 0.006090203921000163}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04596389532089233, "step_physics": 0.12403365929921469, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019665082295735676, "sim_render-ego": 0.009585092067718506, "get_robot_state": 0.022886307239532472, "get_duckie_state": 2.788702646891276e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02468560536702474, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2999844249089559, "set_robot_commands": 0.007753214041392008, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03881914138793945, "sim_compute_performance-ego": 0.006407701969146728}}
set_robot_commands_max0.007753214041392008
set_robot_commands_mean0.007305946548779805
set_robot_commands_median0.007423906326293946
set_robot_commands_min0.0066227595011393225
sim_compute_performance-ego_max0.006407701969146728
sim_compute_performance-ego_mean0.006121431986490886
sim_compute_performance-ego_median0.00609378178914388
sim_compute_performance-ego_min0.005890462398529053
sim_compute_sim_state_max0.03881914138793945
sim_compute_sim_state_mean0.03393276611963908
sim_compute_sim_state_median0.03288641611735026
sim_compute_sim_state_min0.031139090855916342
sim_render-ego_max0.009585092067718506
sim_render-ego_mean0.009075264732042948
sim_render-ego_median0.009220661322275798
sim_render-ego_min0.008274644215901693
simulation-passed1
step_physics_max0.12403365929921469
step_physics_mean0.11015285273392994
step_physics_median0.10877057472864789
step_physics_min0.09903660217920938
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4287511551Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:09:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 872 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4286611551Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simabortednoafdaniele15-b9b1aef9b8fb-10:09:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 856 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4284411544Yishu Malhotra πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoafdaniele15-b9b1aef9b8fb-10:07:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 566 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4283111538Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:09:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4113565474936607
survival_time_median14.950000000000076
deviation-center-line_median0.39834506707038775
in-drivable-lane_median4.575000000000058


other stats
agent_compute-ego_max0.02644371112187703
agent_compute-ego_mean0.02554912628549518
agent_compute-ego_median0.025908098618189497
agent_compute-ego_min0.023936596783724697
complete-iteration_max0.30914281686147055
complete-iteration_mean0.3026048091505513
complete-iteration_median0.30530331521323234
complete-iteration_min0.29066978931427
deviation-center-line_max0.5371788851744281
deviation-center-line_mean0.34711288379494537
deviation-center-line_min0.05458251586457802
deviation-heading_max3.051350696683687
deviation-heading_mean1.7138324148012145
deviation-heading_median1.6495446664485445
deviation-heading_min0.5048896296240827
driven_any_max4.594454879973228
driven_any_mean3.5019262584530617
driven_any_median4.586714825553319
driven_any_min0.23982050273238348
driven_lanedir_consec_max3.3794311192600937
driven_lanedir_consec_mean2.082907127007429
driven_lanedir_consec_min0.12948429378230175
driven_lanedir_max3.3794311192600937
driven_lanedir_mean2.083390216049923
driven_lanedir_median2.412322725578648
driven_lanedir_min0.12948429378230175
get_duckie_state_max3.039836883544922e-06
get_duckie_state_mean2.904100851579146e-06
get_duckie_state_median2.9444694519042972e-06
get_duckie_state_min2.6876276189630683e-06
get_robot_state_max0.02387002229690552
get_robot_state_mean0.022927709474708093
get_robot_state_median0.022986608852039684
get_robot_state_min0.021867597897847493
get_state_dump_max0.02007560173670451
get_state_dump_mean0.019910075827078384
get_state_dump_median0.01991121642517321
get_state_dump_min0.019742268721262612
get_ui_image_max0.04920809189478556
get_ui_image_mean0.047388345544988456
get_ui_image_median0.04741420019756664
get_ui_image_min0.045516889890034995
in-drivable-lane_max7.000000000000096
in-drivable-lane_mean4.087500000000054
in-drivable-lane_min0.20000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.5793240348035145, "get_ui_image": 0.04877036333084107, "step_physics": 0.12565042018890382, "survival_time": 14.950000000000076, "driven_lanedir": 3.3794311192600937, "get_state_dump": 0.02007560173670451, "sim_render-ego": 0.009922875563303629, "get_robot_state": 0.02387002229690552, "get_duckie_state": 3.039836883544922e-06, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.02644371112187703, "deviation-heading": 1.916909963993595, "complete-iteration": 0.30853949149449666, "set_robot_commands": 0.007812486489613851, "deviation-center-line": 0.4587593150496051, "driven_lanedir_consec": 3.3794311192600937, "sim_compute_sim_state": 0.039590463638305665, "sim_compute_performance-ego": 0.00621906836827596}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.23982050273238348, "get_ui_image": 0.046058037064292214, "step_physics": 0.12897750464352695, "survival_time": 1.1000000000000003, "driven_lanedir": 0.12948429378230175, "get_state_dump": 0.019955223256891422, "sim_render-ego": 0.00961314548145641, "get_robot_state": 0.022297642447731712, "get_duckie_state": 2.6876276189630683e-06, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.023936596783724697, "deviation-heading": 0.5048896296240827, "complete-iteration": 0.302067138931968, "set_robot_commands": 0.00786888599395752, "deviation-center-line": 0.05458251586457802, "driven_lanedir_consec": 0.12948429378230175, "sim_compute_sim_state": 0.03652545538815585, "sim_compute_performance-ego": 0.006658445705067028}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.594105616303122, "get_ui_image": 0.04920809189478556, "step_physics": 0.12606603781382242, "survival_time": 14.950000000000076, "driven_lanedir": 2.5212992345995677, "get_state_dump": 0.019867209593454997, "sim_render-ego": 0.009889875253041584, "get_robot_state": 0.023675575256347656, "get_duckie_state": 2.89758046468099e-06, "in-drivable-lane": 5.650000000000067, "agent_compute-ego": 0.02589718500773112, "deviation-heading": 3.051350696683687, "complete-iteration": 0.30914281686147055, "set_robot_commands": 0.007862772941589356, "deviation-center-line": 0.5371788851744281, "driven_lanedir_consec": 2.5212992345995677, "sim_compute_sim_state": 0.04014679829279582, "sim_compute_performance-ego": 0.006346729596455892}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.594454879973228, "get_ui_image": 0.045516889890034995, "step_physics": 0.1135213073094686, "survival_time": 14.950000000000076, "driven_lanedir": 2.303346216557728, "get_state_dump": 0.019742268721262612, "sim_render-ego": 0.009567757447560629, "get_robot_state": 0.021867597897847493, "get_duckie_state": 2.991358439127604e-06, "in-drivable-lane": 7.000000000000096, "agent_compute-ego": 0.025919012228647863, "deviation-heading": 1.3821793689034936, "complete-iteration": 0.29066978931427, "set_robot_commands": 0.007650564511617025, "deviation-center-line": 0.3379308190911703, "driven_lanedir_consec": 2.301413860387754, "sim_compute_sim_state": 0.04039757013320923, "sim_compute_performance-ego": 0.006299485365549723}}
set_robot_commands_max0.00786888599395752
set_robot_commands_mean0.007798677484194437
set_robot_commands_median0.007837629715601603
set_robot_commands_min0.007650564511617025
sim_compute_performance-ego_max0.006658445705067028
sim_compute_performance-ego_mean0.00638093225883715
sim_compute_performance-ego_median0.006323107481002808
sim_compute_performance-ego_min0.00621906836827596
sim_compute_sim_state_max0.04039757013320923
sim_compute_sim_state_mean0.03916507186311664
sim_compute_sim_state_median0.03986863096555074
sim_compute_sim_state_min0.03652545538815585
sim_render-ego_max0.009922875563303629
sim_render-ego_mean0.009748413436340564
sim_render-ego_median0.009751510367248997
sim_render-ego_min0.009567757447560629
simulation-passed1
step_physics_max0.12897750464352695
step_physics_mean0.12355381748893043
step_physics_median0.12585822900136312
step_physics_min0.1135213073094686
survival_time_max14.950000000000076
survival_time_mean11.487500000000058
survival_time_min1.1000000000000003
No reset possible
4279911539Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.616526604852763
survival_time_median14.950000000000076
deviation-center-line_median1.1132799761767869
in-drivable-lane_median1.750000000000005


other stats
agent_compute-ego_max0.027467395464579263
agent_compute-ego_mean0.026088311870892843
agent_compute-ego_median0.025704497893651326
agent_compute-ego_min0.02547685623168945
complete-iteration_max0.3456874370574951
complete-iteration_mean0.3333705482880275
complete-iteration_median0.3353796645005544
complete-iteration_min0.31703542709350585
deviation-center-line_max1.2117154147750333
deviation-center-line_mean0.8797007814071228
deviation-center-line_min0.08052775849988487
deviation-heading_max3.9026570872216704
deviation-heading_mean2.6319692696163397
deviation-heading_median3.0879905309234124
deviation-heading_min0.4492389293968636
driven_any_max3.5734378405972818
driven_any_mean2.7328892645641107
driven_any_median3.567562652613274
driven_any_min0.22299391243261404
driven_lanedir_consec_max3.167652099526366
driven_lanedir_consec_mean2.129956672598868
driven_lanedir_consec_min0.11912138116358006
driven_lanedir_max3.167652099526366
driven_lanedir_mean2.129956672598868
driven_lanedir_median2.616526604852763
driven_lanedir_min0.11912138116358006
get_duckie_state_max3.0740102132161457e-06
get_duckie_state_mean2.9601653416951498e-06
get_duckie_state_median2.9957294464111327e-06
get_duckie_state_min2.7751922607421876e-06
get_robot_state_max0.02351179361343384
get_robot_state_mean0.02305009484291077
get_robot_state_median0.023108950853347777
get_robot_state_min0.022470684051513673
get_state_dump_max0.02067994435628255
get_state_dump_mean0.01994322955608368
get_state_dump_median0.01986420631408691
get_state_dump_min0.01936456123987834
get_ui_image_max0.06011981010437012
get_ui_image_mean0.05558643360932668
get_ui_image_median0.05525403221448262
get_ui_image_min0.051717859903971354
in-drivable-lane_max3.950000000000014
in-drivable-lane_mean1.925000000000006
in-drivable-lane_min0.2500000000000002
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5618026571233155, "get_ui_image": 0.0545317808787028, "step_physics": 0.13834329605102538, "survival_time": 14.950000000000076, "driven_lanedir": 3.167652099526366, "get_state_dump": 0.01936456123987834, "sim_render-ego": 0.010017832120259603, "get_robot_state": 0.023033918539683024, "get_duckie_state": 2.9436747233072915e-06, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.025642937024434407, "deviation-heading": 3.2063810884635044, "complete-iteration": 0.3259706632296244, "set_robot_commands": 0.007807916005452474, "deviation-center-line": 1.1173240098740371, "driven_lanedir_consec": 3.167652099526366, "sim_compute_sim_state": 0.040548409620920815, "sim_compute_performance-ego": 0.006495972474416097}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5734378405972818, "get_ui_image": 0.051717859903971354, "step_physics": 0.13183748006820678, "survival_time": 14.950000000000076, "driven_lanedir": 2.4586433812143307, "get_state_dump": 0.02067994435628255, "sim_render-ego": 0.0099057141939799, "get_robot_state": 0.02351179361343384, "get_duckie_state": 3.0740102132161457e-06, "in-drivable-lane": 3.950000000000014, "agent_compute-ego": 0.02576605876286825, "deviation-heading": 2.96959997338332, "complete-iteration": 0.31703542709350585, "set_robot_commands": 0.007865891456604004, "deviation-center-line": 1.2117154147750333, "driven_lanedir_consec": 2.4586433812143307, "sim_compute_sim_state": 0.03913869222005208, "sim_compute_performance-ego": 0.006424427032470703}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.573322648103233, "get_ui_image": 0.05597628355026245, "step_physics": 0.15166158676147462, "survival_time": 14.950000000000076, "driven_lanedir": 2.7744098284911956, "get_state_dump": 0.01973865509033203, "sim_render-ego": 0.010073954264322916, "get_robot_state": 0.023183983167012538, "get_duckie_state": 3.047784169514974e-06, "in-drivable-lane": 2.400000000000014, "agent_compute-ego": 0.027467395464579263, "deviation-heading": 3.9026570872216704, "complete-iteration": 0.3456874370574951, "set_robot_commands": 0.00856376091639201, "deviation-center-line": 1.1092359424795364, "driven_lanedir_consec": 2.7744098284911956, "sim_compute_sim_state": 0.0423300035794576, "sim_compute_performance-ego": 0.00650166908899943}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.22299391243261404, "get_ui_image": 0.06011981010437012, "step_physics": 0.14805705070495606, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11912138116358006, "get_state_dump": 0.019989757537841796, "sim_render-ego": 0.009840049743652345, "get_robot_state": 0.022470684051513673, "get_duckie_state": 2.7751922607421876e-06, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.02547685623168945, "deviation-heading": 0.4492389293968636, "complete-iteration": 0.34478866577148437, "set_robot_commands": 0.008762054443359375, "deviation-center-line": 0.08052775849988487, "driven_lanedir_consec": 0.11912138116358006, "sim_compute_sim_state": 0.043892412185668944, "sim_compute_performance-ego": 0.005986967086791992}}
set_robot_commands_max0.008762054443359375
set_robot_commands_mean0.008249905705451966
set_robot_commands_median0.008214826186498006
set_robot_commands_min0.007807916005452474
sim_compute_performance-ego_max0.00650166908899943
sim_compute_performance-ego_mean0.006352258920669556
sim_compute_performance-ego_median0.0064601997534433995
sim_compute_performance-ego_min0.005986967086791992
sim_compute_sim_state_max0.043892412185668944
sim_compute_sim_state_mean0.041477379401524864
sim_compute_sim_state_median0.04143920660018921
sim_compute_sim_state_min0.03913869222005208
sim_render-ego_max0.010073954264322916
sim_render-ego_mean0.009959387580553692
sim_render-ego_median0.009961773157119751
sim_render-ego_min0.009840049743652345
simulation-passed1
step_physics_max0.15166158676147462
step_physics_mean0.14247485339641572
step_physics_median0.14320017337799074
step_physics_min0.13183748006820678
survival_time_max14.950000000000076
survival_time_mean11.52500000000006
survival_time_min1.2500000000000004
No reset possible
4278011536Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.771734833674533
survival_time_median9.675000000000034
deviation-center-line_median0.39547345165591075
in-drivable-lane_median0.37499999999999906


other stats
agent_compute-ego_max0.026346751054128013
agent_compute-ego_mean0.025721639810186443
agent_compute-ego_median0.025564231222326105
agent_compute-ego_min0.025411345741965553
complete-iteration_max0.3185207952152599
complete-iteration_mean0.29734416497476174
complete-iteration_median0.3015058918793996
complete-iteration_min0.2678440809249878
deviation-center-line_max0.7482442702702755
deviation-center-line_mean0.4020997819744528
deviation-center-line_min0.0692079543157143
deviation-heading_max3.278594434404395
deviation-heading_mean1.6610621195091004
deviation-heading_median1.482632892664307
deviation-heading_min0.4003882583033926
driven_any_max4.0839223383907095
driven_any_mean2.3756666165614644
driven_any_median2.602814138652108
driven_any_min0.2131158505509333
driven_lanedir_consec_max3.9356961713446657
driven_lanedir_consec_mean1.896922393857595
driven_lanedir_consec_min0.10852373673664896
driven_lanedir_max3.9356961713446657
driven_lanedir_mean1.896922393857595
driven_lanedir_median1.771734833674533
driven_lanedir_min0.10852373673664896
get_duckie_state_max2.944469451904297e-06
get_duckie_state_mean2.864463762803511e-06
get_duckie_state_median2.848831090060147e-06
get_duckie_state_min2.8157234191894532e-06
get_robot_state_max0.023039135065945713
get_robot_state_mean0.02190123101978591
get_robot_state_median0.022111520369847617
get_robot_state_min0.020342748273502697
get_state_dump_max0.020678812807256527
get_state_dump_mean0.02019290631467646
get_state_dump_median0.020124278104666507
get_state_dump_min0.019844256242116293
get_ui_image_max0.053517915985801
get_ui_image_mean0.048162637054920195
get_ui_image_median0.047593485116958614
get_ui_image_min0.04394566199996255
in-drivable-lane_max4.90000000000007
in-drivable-lane_mean1.412500000000017
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.1219175741505367, "get_ui_image": 0.04394566199996255, "step_physics": 0.10379903424869884, "survival_time": 4.399999999999992, "driven_lanedir": 0.9585647808266506, "get_state_dump": 0.019953814419833096, "sim_render-ego": 0.00868787548758767, "get_robot_state": 0.020342748273502697, "get_duckie_state": 2.869150855324485e-06, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.025411345741965553, "deviation-heading": 0.4003882583033926, "complete-iteration": 0.2678440809249878, "set_robot_commands": 0.0070489834655414925, "deviation-center-line": 0.22762615113456067, "driven_lanedir_consec": 0.9585647808266506, "sim_compute_sim_state": 0.03247873891483654, "sim_compute_performance-ego": 0.005984880707480691}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.0839223383907095, "get_ui_image": 0.04600172758102417, "step_physics": 0.11516252517700196, "survival_time": 14.950000000000076, "driven_lanedir": 3.9356961713446657, "get_state_dump": 0.019844256242116293, "sim_render-ego": 0.009278391202290851, "get_robot_state": 0.021217438379923504, "get_duckie_state": 2.944469451904297e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02560934066772461, "deviation-heading": 3.278594434404395, "complete-iteration": 0.28696938435236613, "set_robot_commands": 0.00752463181813558, "deviation-center-line": 0.7482442702702755, "driven_lanedir_consec": 3.9356961713446657, "sim_compute_sim_state": 0.03581761678059896, "sim_compute_performance-ego": 0.006326785087585449}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.083710703153679, "get_ui_image": 0.04918524265289306, "step_physics": 0.13330923239390055, "survival_time": 14.950000000000076, "driven_lanedir": 2.584904886522416, "get_state_dump": 0.02029474178949992, "sim_render-ego": 0.009750482241312662, "get_robot_state": 0.02300560235977173, "get_duckie_state": 2.8157234191894532e-06, "in-drivable-lane": 4.90000000000007, "agent_compute-ego": 0.026346751054128013, "deviation-heading": 2.56073932481924, "complete-iteration": 0.3160423994064331, "set_robot_commands": 0.007817486921946207, "deviation-center-line": 0.5633207521772609, "driven_lanedir_consec": 2.584904886522416, "sim_compute_sim_state": 0.03981413841247559, "sim_compute_performance-ego": 0.006331945260365804}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.2131158505509333, "get_ui_image": 0.053517915985801, "step_physics": 0.1301100254058838, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10852373673664896, "get_state_dump": 0.020678812807256527, "sim_render-ego": 0.009314797141335228, "get_robot_state": 0.023039135065945713, "get_duckie_state": 2.8285113247958096e-06, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.0255191217769276, "deviation-heading": 0.40452646050937474, "complete-iteration": 0.3185207952152599, "set_robot_commands": 0.00751317631114613, "deviation-center-line": 0.0692079543157143, "driven_lanedir_consec": 0.10852373673664896, "sim_compute_sim_state": 0.04271965677087957, "sim_compute_performance-ego": 0.005918134342540394}}
set_robot_commands_max0.007817486921946207
set_robot_commands_mean0.007476069629192352
set_robot_commands_median0.007518904064640855
set_robot_commands_min0.0070489834655414925
sim_compute_performance-ego_max0.006331945260365804
sim_compute_performance-ego_mean0.006140436349493085
sim_compute_performance-ego_median0.00615583289753307
sim_compute_performance-ego_min0.005918134342540394
sim_compute_sim_state_max0.04271965677087957
sim_compute_sim_state_mean0.03770753771969766
sim_compute_sim_state_median0.03781587759653728
sim_compute_sim_state_min0.03247873891483654
sim_render-ego_max0.009750482241312662
sim_render-ego_mean0.009257886518131603
sim_render-ego_median0.00929659417181304
sim_render-ego_min0.00868787548758767
simulation-passed1
step_physics_max0.13330923239390055
step_physics_mean0.12059520430637127
step_physics_median0.12263627529144289
step_physics_min0.10379903424869884
survival_time_max14.950000000000076
survival_time_mean8.850000000000037
survival_time_min1.1000000000000003
No reset possible
4277311534Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0967572150854634
survival_time_median14.950000000000076
deviation-center-line_median0.7948250326397125
in-drivable-lane_median2.4750000000000005


other stats
agent_compute-ego_max0.02612470626831055
agent_compute-ego_mean0.025475917458534243
agent_compute-ego_median0.02544567545255025
agent_compute-ego_min0.02488761266072591
complete-iteration_max0.31508788506189983
complete-iteration_mean0.2899022478262584
complete-iteration_median0.2820706832408905
complete-iteration_min0.28037973976135255
deviation-center-line_max1.042900517501286
deviation-center-line_mean0.6841956692948965
deviation-center-line_min0.1042320943988752
deviation-heading_max4.78914824467356
deviation-heading_mean3.0603135537627506
deviation-heading_median3.5542290311979072
deviation-heading_min0.3436479079816273
driven_any_max4.774623620419774
driven_any_mean3.860437931890522
driven_any_median4.166234809363659
driven_any_min2.334658488414997
driven_lanedir_consec_max3.4401976651447512
driven_lanedir_consec_mean2.7447374211999582
driven_lanedir_consec_min1.3452375894841533
driven_lanedir_max3.4437320157689957
driven_lanedir_mean2.886401010556406
driven_lanedir_median3.3783172184862384
driven_lanedir_min1.3452375894841533
get_duckie_state_max3.0651092529296875e-06
get_duckie_state_mean2.9780069986979165e-06
get_duckie_state_median2.9762585957845054e-06
get_duckie_state_min2.894401550292969e-06
get_robot_state_max0.02488360595703125
get_robot_state_mean0.022584746956825257
get_robot_state_median0.022065864006678263
get_robot_state_min0.02132365385691325
get_state_dump_max0.02000665855407715
get_state_dump_mean0.019852986812591553
get_state_dump_median0.0199048638343811
get_state_dump_min0.019595561027526857
get_ui_image_max0.04876221736272176
get_ui_image_mean0.045090559800465904
get_ui_image_median0.04443415760993957
get_ui_image_min0.0427317066192627
in-drivable-lane_max3.7500000000000258
in-drivable-lane_mean2.4875000000000056
in-drivable-lane_min1.2499999999999956
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.334658488414997, "get_ui_image": 0.0427317066192627, "step_physics": 0.10614126014709473, "survival_time": 6.249999999999986, "driven_lanedir": 1.3452375894841533, "get_state_dump": 0.02000665855407715, "sim_render-ego": 0.0097927303314209, "get_robot_state": 0.02488360595703125, "get_duckie_state": 3.0651092529296875e-06, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.02612470626831055, "deviation-heading": 0.3436479079816273, "complete-iteration": 0.28037973976135255, "set_robot_commands": 0.008407756805419922, "deviation-center-line": 0.1042320943988752, "driven_lanedir_consec": 1.3452375894841533, "sim_compute_sim_state": 0.03596980094909668, "sim_compute_performance-ego": 0.006128957748413086}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.618903926298311, "get_ui_image": 0.04394583384195964, "step_physics": 0.11280887842178344, "survival_time": 14.950000000000076, "driven_lanedir": 3.4437320157689957, "get_state_dump": 0.019895622730255125, "sim_render-ego": 0.009096300601959229, "get_robot_state": 0.021650647322336833, "get_duckie_state": 2.9770533243815103e-06, "in-drivable-lane": 2.40000000000001, "agent_compute-ego": 0.02488761266072591, "deviation-heading": 4.78914824467356, "complete-iteration": 0.2816033260027568, "set_robot_commands": 0.007383561929066976, "deviation-center-line": 1.042900517501286, "driven_lanedir_consec": 2.8770776583432016, "sim_compute_sim_state": 0.035601452191670734, "sim_compute_performance-ego": 0.0061492125193278}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.713565692429007, "get_ui_image": 0.044922481377919515, "step_physics": 0.11180214325586955, "survival_time": 14.950000000000076, "driven_lanedir": 3.3164367718277257, "get_state_dump": 0.01991410493850708, "sim_render-ego": 0.009115962187449138, "get_robot_state": 0.02132365385691325, "get_duckie_state": 2.9754638671875e-06, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.024972685972849528, "deviation-heading": 3.955070399355854, "complete-iteration": 0.28253804047902426, "set_robot_commands": 0.007438408533732096, "deviation-center-line": 0.9542943118979436, "driven_lanedir_consec": 3.3164367718277257, "sim_compute_sim_state": 0.03673735777537028, "sim_compute_performance-ego": 0.006125328540802002}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.774623620419774, "get_ui_image": 0.04876221736272176, "step_physics": 0.12951863765716554, "survival_time": 14.950000000000076, "driven_lanedir": 3.4401976651447512, "get_state_dump": 0.019595561027526857, "sim_render-ego": 0.009684173266092937, "get_robot_state": 0.022481080691019693, "get_duckie_state": 2.894401550292969e-06, "in-drivable-lane": 3.7500000000000258, "agent_compute-ego": 0.025918664932250975, "deviation-heading": 3.1533876630399607, "complete-iteration": 0.31508788506189983, "set_robot_commands": 0.007688268820444743, "deviation-center-line": 0.6353557533814814, "driven_lanedir_consec": 3.4401976651447512, "sim_compute_sim_state": 0.04503172715504964, "sim_compute_performance-ego": 0.0062264784177144365}}
set_robot_commands_max0.008407756805419922
set_robot_commands_mean0.007729499022165935
set_robot_commands_median0.007563338677088419
set_robot_commands_min0.007383561929066976
sim_compute_performance-ego_max0.0062264784177144365
sim_compute_performance-ego_mean0.0061574943065643315
sim_compute_performance-ego_median0.006139085133870443
sim_compute_performance-ego_min0.006125328540802002
sim_compute_sim_state_max0.04503172715504964
sim_compute_sim_state_mean0.03833508451779683
sim_compute_sim_state_median0.03635357936223347
sim_compute_sim_state_min0.035601452191670734
sim_render-ego_max0.0097927303314209
sim_render-ego_mean0.00942229159673055
sim_render-ego_median0.009400067726771036
sim_render-ego_min0.009096300601959229
simulation-passed1
step_physics_max0.12951863765716554
step_physics_mean0.11506772987047832
step_physics_median0.1123055108388265
step_physics_min0.10614126014709473
survival_time_max14.950000000000076
survival_time_mean12.775000000000055
survival_time_min6.249999999999986
No reset possible
4276911533Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:08:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4275711529Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2279893313305386
survival_time_median14.950000000000076
deviation-center-line_median0.7990141864194783
in-drivable-lane_median1.2500000000000178


other stats
agent_compute-ego_max0.025809104442596435
agent_compute-ego_mean0.025758423407872516
agent_compute-ego_median0.025755637486775715
agent_compute-ego_min0.025713314215342203
complete-iteration_max0.2742292849222819
complete-iteration_mean0.26617856820424396
complete-iteration_median0.26472256938616434
complete-iteration_min0.26103984912236533
deviation-center-line_max1.220350167091351
deviation-center-line_mean0.8708783523192567
deviation-center-line_min0.6651348693467194
deviation-heading_max3.862850362868875
deviation-heading_mean2.2590801021877915
deviation-heading_median1.848005953994189
deviation-heading_min1.477458137893914
driven_any_max2.5526011521348155
driven_any_mean2.550489380877679
driven_any_median2.552546502648264
driven_any_min2.544263366079372
driven_lanedir_consec_max2.402300294123563
driven_lanedir_consec_mean2.2115439506018197
driven_lanedir_consec_min1.987896845622638
driven_lanedir_max2.402300294123563
driven_lanedir_mean2.2846777124684547
driven_lanedir_median2.2649832290482035
driven_lanedir_min2.206444097653849
get_duckie_state_max2.944469451904297e-06
get_duckie_state_mean2.8725465138753256e-06
get_duckie_state_median2.8598308563232424e-06
get_duckie_state_min2.826054890950521e-06
get_robot_state_max0.0195165475209554
get_robot_state_mean0.01911945541699727
get_robot_state_median0.019023375511169435
get_robot_state_min0.018914523124694823
get_state_dump_max0.01918633222579956
get_state_dump_mean0.01912427763144175
get_state_dump_median0.019125736554463705
get_state_dump_min0.01905930519104004
get_ui_image_max0.04265148401260376
get_ui_image_mean0.04226542413234711
get_ui_image_median0.04220864176750183
get_ui_image_min0.041992928981781
in-drivable-lane_max1.8500000000000263
in-drivable-lane_mean1.0875000000000157
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.544263366079372, "get_ui_image": 0.04265148401260376, "step_physics": 0.1023412577311198, "survival_time": 14.950000000000076, "driven_lanedir": 2.2495345650072283, "get_state_dump": 0.019087281227111817, "sim_render-ego": 0.008821029663085938, "get_robot_state": 0.018976697921752928, "get_duckie_state": 2.827644348144531e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.025809104442596435, "deviation-heading": 1.7935319590241927, "complete-iteration": 0.2638754534721375, "set_robot_commands": 0.006571491559346517, "deviation-center-line": 0.8933283853843244, "driven_lanedir_consec": 2.2495345650072283, "sim_compute_sim_state": 0.03352349042892456, "sim_compute_performance-ego": 0.0058987029393514}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.5526011521348155, "get_ui_image": 0.042172207832336425, "step_physics": 0.10166036049524944, "survival_time": 14.950000000000076, "driven_lanedir": 2.206444097653849, "get_state_dump": 0.01905930519104004, "sim_render-ego": 0.008583529790242513, "get_robot_state": 0.01907005310058594, "get_duckie_state": 2.826054890950521e-06, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.02572680791219075, "deviation-heading": 1.477458137893914, "complete-iteration": 0.26103984912236533, "set_robot_commands": 0.006546906630198161, "deviation-center-line": 0.6651348693467194, "driven_lanedir_consec": 2.206444097653849, "sim_compute_sim_state": 0.032151482105255126, "sim_compute_performance-ego": 0.00587831179300944}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5525362828193723, "get_ui_image": 0.04224507570266724, "step_physics": 0.10517644325892132, "survival_time": 14.950000000000076, "driven_lanedir": 2.402300294123563, "get_state_dump": 0.01918633222579956, "sim_render-ego": 0.008165674209594726, "get_robot_state": 0.0195165475209554, "get_duckie_state": 2.944469451904297e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025713314215342203, "deviation-heading": 3.862850362868875, "complete-iteration": 0.26556968530019126, "set_robot_commands": 0.006464525858561198, "deviation-center-line": 1.220350167091351, "driven_lanedir_consec": 2.402300294123563, "sim_compute_sim_state": 0.0330349063873291, "sim_compute_performance-ego": 0.005870495637257894}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.552556722477155, "get_ui_image": 0.041992928981781, "step_physics": 0.11017469167709353, "survival_time": 14.950000000000076, "driven_lanedir": 2.2804318930891787, "get_state_dump": 0.019164191881815593, "sim_render-ego": 0.008191884358723958, "get_robot_state": 0.018914523124694823, "get_duckie_state": 2.8920173645019533e-06, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.025784467061360675, "deviation-heading": 1.9024799489641853, "complete-iteration": 0.2742292849222819, "set_robot_commands": 0.006633832454681397, "deviation-center-line": 0.7046999874546322, "driven_lanedir_consec": 1.987896845622638, "sim_compute_sim_state": 0.037304444313049315, "sim_compute_performance-ego": 0.005872744719187419}}
set_robot_commands_max0.006633832454681397
set_robot_commands_mean0.006554189125696818
set_robot_commands_median0.006559199094772339
set_robot_commands_min0.006464525858561198
sim_compute_performance-ego_max0.0058987029393514
sim_compute_performance-ego_mean0.005880063772201538
sim_compute_performance-ego_median0.0058755282560984294
sim_compute_performance-ego_min0.005870495637257894
sim_compute_sim_state_max0.037304444313049315
sim_compute_sim_state_mean0.03400358080863952
sim_compute_sim_state_median0.033279198408126834
sim_compute_sim_state_min0.032151482105255126
sim_render-ego_max0.008821029663085938
sim_render-ego_mean0.008440529505411784
sim_render-ego_median0.008387707074483237
sim_render-ego_min0.008165674209594726
simulation-passed1
step_physics_max0.11017469167709353
step_physics_mean0.10483818829059602
step_physics_median0.10375885049502057
step_physics_min0.10166036049524944
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4275011528Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.654783501026913
survival_time_median14.950000000000076
deviation-center-line_median0.7247000777416159
in-drivable-lane_median0.12500000000000178


other stats
agent_compute-ego_max0.02681584240269745
agent_compute-ego_mean0.02557459841487826
agent_compute-ego_median0.025378400484720863
agent_compute-ego_min0.024725750287373865
complete-iteration_max0.2958468194563903
complete-iteration_mean0.2845816728413035
complete-iteration_median0.2819957788785299
complete-iteration_min0.2784883141517639
deviation-center-line_max0.7544510028643059
deviation-center-line_mean0.7152638458111463
deviation-center-line_min0.6572042248970472
deviation-heading_max2.188778205679049
deviation-heading_mean1.567639388834147
deviation-heading_median1.4061157110072662
deviation-heading_min1.2695479276430084
driven_any_max2.9944305928481865
driven_any_mean2.7633455005529615
driven_any_median2.766906079308759
driven_any_min2.52513925074614
driven_lanedir_consec_max2.977246097985347
driven_lanedir_consec_mean2.6426000368567055
driven_lanedir_consec_min2.2835870473876505
driven_lanedir_max2.977246097985347
driven_lanedir_mean2.6429953101400456
driven_lanedir_median2.654783501026913
driven_lanedir_min2.2851681405210105
get_duckie_state_max3.138383229573568e-06
get_duckie_state_mean3.0212148199092658e-06
get_duckie_state_median3.035573993049325e-06
get_duckie_state_min2.875328063964844e-06
get_robot_state_max0.02331976095835368
get_robot_state_mean0.021573101938543105
get_robot_state_median0.021524456739425657
get_robot_state_min0.019923733316967427
get_state_dump_max0.019789979651622977
get_state_dump_mean0.01966392919298336
get_state_dump_median0.01975875695546468
get_state_dump_min0.019348223209381104
get_ui_image_max0.04500979820887248
get_ui_image_mean0.04438082238178793
get_ui_image_median0.04428623279216573
get_ui_image_min0.04394102573394775
in-drivable-lane_max2.550000000000036
in-drivable-lane_mean0.70000000000001
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.912596483718633, "get_ui_image": 0.04394102573394775, "step_physics": 0.10712884585062664, "survival_time": 14.950000000000076, "driven_lanedir": 2.8271590836927034, "get_state_dump": 0.019348223209381104, "sim_render-ego": 0.009443965752919515, "get_robot_state": 0.023115691343943277, "get_duckie_state": 3.0660629272460936e-06, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.02533603588740031, "deviation-heading": 1.5246330274353843, "complete-iteration": 0.2784883141517639, "set_robot_commands": 0.007902255058288574, "deviation-center-line": 0.7176283914167181, "driven_lanedir_consec": 2.8271590836927034, "sim_compute_sim_state": 0.036070852279663085, "sim_compute_performance-ego": 0.006017138957977295}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9944305928481865, "get_ui_image": 0.04456388791402181, "step_physics": 0.11193345308303831, "survival_time": 14.950000000000076, "driven_lanedir": 2.977246097985347, "get_state_dump": 0.019730857213338216, "sim_render-ego": 0.009495899677276612, "get_robot_state": 0.02331976095835368, "get_duckie_state": 3.138383229573568e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025420765082041424, "deviation-heading": 1.2875983945791478, "complete-iteration": 0.2836478082338969, "set_robot_commands": 0.007782484690348307, "deviation-center-line": 0.7317717640665138, "driven_lanedir_consec": 2.977246097985347, "sim_compute_sim_state": 0.03512393474578857, "sim_compute_performance-ego": 0.006095716158548991}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.52513925074614, "get_ui_image": 0.04500979820887248, "step_physics": 0.11370647668838502, "survival_time": 14.950000000000076, "driven_lanedir": 2.4824079183611225, "get_state_dump": 0.019786656697591144, "sim_render-ego": 0.008817537625630697, "get_robot_state": 0.01993322213490804, "get_duckie_state": 2.875328063964844e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024725750287373865, "deviation-heading": 2.188778205679049, "complete-iteration": 0.2803437495231628, "set_robot_commands": 0.007129956086476644, "deviation-center-line": 0.7544510028643059, "driven_lanedir_consec": 2.4824079183611225, "sim_compute_sim_state": 0.0350047492980957, "sim_compute_performance-ego": 0.006049280961354574}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.621215674898886, "get_ui_image": 0.044008577670309655, "step_physics": 0.1246517757644923, "survival_time": 14.150000000000066, "driven_lanedir": 2.2851681405210105, "get_state_dump": 0.019789979651622977, "sim_render-ego": 0.008556129233154729, "get_robot_state": 0.019923733316967427, "get_duckie_state": 3.0050850588525565e-06, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.02681584240269745, "deviation-heading": 1.2695479276430084, "complete-iteration": 0.2958468194563903, "set_robot_commands": 0.006746992205562524, "deviation-center-line": 0.6572042248970472, "driven_lanedir_consec": 2.2835870473876505, "sim_compute_sim_state": 0.03901565285537774, "sim_compute_performance-ego": 0.006157951725666599}}
set_robot_commands_max0.007902255058288574
set_robot_commands_mean0.007390422010169012
set_robot_commands_median0.007456220388412475
set_robot_commands_min0.006746992205562524
sim_compute_performance-ego_max0.006157951725666599
sim_compute_performance-ego_mean0.006080021950886865
sim_compute_performance-ego_median0.006072498559951782
sim_compute_performance-ego_min0.006017138957977295
sim_compute_sim_state_max0.03901565285537774
sim_compute_sim_state_mean0.03630379729473127
sim_compute_sim_state_median0.035597393512725825
sim_compute_sim_state_min0.0350047492980957
sim_render-ego_max0.009495899677276612
sim_render-ego_mean0.009078383072245387
sim_render-ego_median0.009130751689275103
sim_render-ego_min0.008556129233154729
simulation-passed1
step_physics_max0.1246517757644923
step_physics_mean0.11435513784663556
step_physics_median0.11281996488571168
step_physics_min0.10712884585062664
survival_time_max14.950000000000076
survival_time_mean14.750000000000076
survival_time_min14.150000000000066
No reset possible
4274811527Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:08:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4274711526Francois Hebertexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0174379064536434
survival_time_median14.950000000000076
deviation-center-line_median0.6961826749439182
in-drivable-lane_median4.900000000000066


other stats
agent_compute-ego_max0.026103599866231283
agent_compute-ego_mean0.025868284900983175
agent_compute-ego_median0.025851999918619792
agent_compute-ego_min0.02566553990046183
complete-iteration_max0.3250425720214844
complete-iteration_mean0.30693051099777224
complete-iteration_median0.3072676769892375
complete-iteration_min0.28814411799112954
deviation-center-line_max0.8355440183031072
deviation-center-line_mean0.5903774732076267
deviation-center-line_min0.133600524639563
deviation-heading_max4.340907840768959
deviation-heading_mean2.275819824167903
deviation-heading_median1.809975122883562
deviation-heading_min1.1424212101355298
driven_any_max1.9399507984560471
driven_any_mean1.934952705178808
driven_any_median1.939878508334329
driven_any_min1.920103005590527
driven_lanedir_consec_max1.7154734514329733
driven_lanedir_consec_mean0.9765900621491956
driven_lanedir_consec_min0.15601098425652216
driven_lanedir_max1.7154734514329733
driven_lanedir_mean1.0506338868754346
driven_lanedir_median1.1655255559061213
driven_lanedir_min0.15601098425652216
get_duckie_state_max2.998510996500651e-06
get_duckie_state_mean2.907315889994303e-06
get_duckie_state_median2.9210249582926433e-06
get_duckie_state_min2.788702646891276e-06
get_robot_state_max0.024065550168355307
get_robot_state_mean0.0225035148859024
get_robot_state_median0.023128301699956257
get_robot_state_min0.019691905975341796
get_state_dump_max0.020064117113749187
get_state_dump_mean0.01988529125849406
get_state_dump_median0.019864222208658855
get_state_dump_min0.019748603502909343
get_ui_image_max0.051073363622029626
get_ui_image_mean0.048296630183855695
get_ui_image_median0.04935672720273336
get_ui_image_min0.04339970270792643
in-drivable-lane_max12.40000000000008
in-drivable-lane_mean5.925000000000058
in-drivable-lane_min1.500000000000021
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.920103005590527, "get_ui_image": 0.048170525232950845, "step_physics": 0.1287256383895874, "survival_time": 14.950000000000076, "driven_lanedir": 1.383696120470867, "get_state_dump": 0.01997895081837972, "sim_render-ego": 0.009925182660420737, "get_robot_state": 0.022916464805603023, "get_duckie_state": 2.9730796813964845e-06, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.025914900302886963, "deviation-heading": 4.340907840768959, "complete-iteration": 0.30793566942214967, "set_robot_commands": 0.007749167283376058, "deviation-center-line": 0.7865595536524356, "driven_lanedir_consec": 1.0875208215659111, "sim_compute_sim_state": 0.03823524792989095, "sim_compute_performance-ego": 0.00614742914835612}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399507984560471, "get_ui_image": 0.051073363622029626, "step_physics": 0.12657009919484458, "survival_time": 14.950000000000076, "driven_lanedir": 0.9473549913413756, "get_state_dump": 0.01974949359893799, "sim_render-ego": 0.00967177947362264, "get_robot_state": 0.024065550168355307, "get_duckie_state": 2.998510996500651e-06, "in-drivable-lane": 7.350000000000096, "agent_compute-ego": 0.02578909953435262, "deviation-heading": 1.1424212101355298, "complete-iteration": 0.3065996845563253, "set_robot_commands": 0.0076131852467854816, "deviation-center-line": 0.8355440183031072, "driven_lanedir_consec": 0.9473549913413756, "sim_compute_sim_state": 0.035607017676035566, "sim_compute_performance-ego": 0.006289676030476888}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939811415958713, "get_ui_image": 0.05054292917251587, "step_physics": 0.14285666545232137, "survival_time": 14.950000000000076, "driven_lanedir": 0.15601098425652216, "get_state_dump": 0.019748603502909343, "sim_render-ego": 0.010037400722503665, "get_robot_state": 0.02334013859430949, "get_duckie_state": 2.788702646891276e-06, "in-drivable-lane": 12.40000000000008, "agent_compute-ego": 0.026103599866231283, "deviation-heading": 2.11672024634744, "complete-iteration": 0.3250425720214844, "set_robot_commands": 0.0077753448486328125, "deviation-center-line": 0.133600524639563, "driven_lanedir_consec": 0.15601098425652216, "sim_compute_sim_state": 0.03818316380182902, "sim_compute_performance-ego": 0.006281861464182536}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399456007099452, "get_ui_image": 0.04339970270792643, "step_physics": 0.1180756982167562, "survival_time": 14.950000000000076, "driven_lanedir": 1.7154734514329733, "get_state_dump": 0.020064117113749187, "sim_render-ego": 0.00948470910390218, "get_robot_state": 0.019691905975341796, "get_duckie_state": 2.868970235188802e-06, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.02566553990046183, "deviation-heading": 1.503229999419684, "complete-iteration": 0.28814411799112954, "set_robot_commands": 0.007113651434580485, "deviation-center-line": 0.6058057962354009, "driven_lanedir_consec": 1.7154734514329733, "sim_compute_sim_state": 0.03829874515533447, "sim_compute_performance-ego": 0.006170219580332439}}
set_robot_commands_max0.0077753448486328125
set_robot_commands_mean0.007562837203343709
set_robot_commands_median0.0076811762650807695
set_robot_commands_min0.007113651434580485
sim_compute_performance-ego_max0.006289676030476888
sim_compute_performance-ego_mean0.006222296555836996
sim_compute_performance-ego_median0.006226040522257488
sim_compute_performance-ego_min0.00614742914835612
sim_compute_sim_state_max0.03829874515533447
sim_compute_sim_state_mean0.0375810436407725
sim_compute_sim_state_median0.038209205865859984
sim_compute_sim_state_min0.035607017676035566
sim_render-ego_max0.010037400722503665
sim_render-ego_mean0.009779767990112305
sim_render-ego_median0.009798481067021688
sim_render-ego_min0.00948470910390218
simulation-passed1
step_physics_max0.14285666545232137
step_physics_mean0.1290570253133774
step_physics_median0.12764786879221598
step_physics_min0.1180756982167562
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4273511522Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:09:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4272111519Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:08:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4271511516Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.214189790672028
survival_time_median14.950000000000076
deviation-center-line_median0.5911693324672288
in-drivable-lane_median1.0249999999999964


other stats
agent_compute-ego_max0.02625035762786865
agent_compute-ego_mean0.02565199022491773
agent_compute-ego_median0.025623477399349212
agent_compute-ego_min0.02511064847310384
complete-iteration_max0.2950260368982951
complete-iteration_mean0.2722551867365837
complete-iteration_median0.2666653356949489
complete-iteration_min0.2606640386581421
deviation-center-line_max0.878630777259845
deviation-center-line_mean0.5892276858441496
deviation-center-line_min0.2959413011822962
deviation-heading_max2.327150062205486
deviation-heading_mean1.4272369009326578
deviation-heading_median1.2399532778379485
deviation-heading_min0.901890985849248
driven_any_max2.48606821226231
driven_any_mean2.3061229588853664
driven_any_median2.382647865607674
driven_any_min1.9731278920638076
driven_lanedir_consec_max2.4756967077042216
driven_lanedir_consec_mean2.0899527953637045
driven_lanedir_consec_min1.45573489240654
driven_lanedir_max2.4756967077042216
driven_lanedir_mean2.0899527953637045
driven_lanedir_median2.214189790672028
driven_lanedir_min1.45573489240654
get_duckie_state_max3.2170613606770835e-06
get_duckie_state_mean3.0529499053955077e-06
get_duckie_state_median3.0120213826497395e-06
get_duckie_state_min2.970695495605469e-06
get_robot_state_max0.022921962738037108
get_robot_state_mean0.02052194595336914
get_robot_state_median0.02008568326632182
get_robot_state_min0.018994454542795816
get_state_dump_max0.01963986078898112
get_state_dump_mean0.019333270192146305
get_state_dump_median0.019321401516596476
get_state_dump_min0.019050416946411138
get_ui_image_max0.044170812765757246
get_ui_image_mean0.042581302523612974
get_ui_image_median0.04210912664731344
get_ui_image_min0.04193614403406779
in-drivable-lane_max2.80000000000004
in-drivable-lane_mean1.212500000000008
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9731278920638076, "get_ui_image": 0.04212087790171305, "step_physics": 0.10152715345223744, "survival_time": 12.000000000000036, "driven_lanedir": 1.45573489240654, "get_state_dump": 0.019209794203440347, "sim_render-ego": 0.008606556057929992, "get_robot_state": 0.018994454542795816, "get_duckie_state": 3.0358632405598956e-06, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.025295771161715188, "deviation-heading": 1.302233318397743, "complete-iteration": 0.26219370563824973, "set_robot_commands": 0.006528709332148234, "deviation-center-line": 0.2959413011822962, "driven_lanedir_consec": 1.45573489240654, "sim_compute_sim_state": 0.03385516305764516, "sim_compute_performance-ego": 0.0058778166770935055}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.47999006483781, "get_ui_image": 0.04193614403406779, "step_physics": 0.10118799924850463, "survival_time": 14.950000000000076, "driven_lanedir": 2.4666258039492046, "get_state_dump": 0.019050416946411138, "sim_render-ego": 0.008202544848124186, "get_robot_state": 0.01905073960622152, "get_duckie_state": 3.2170613606770835e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025951183636983236, "deviation-heading": 1.1776732372781542, "complete-iteration": 0.2606640386581421, "set_robot_commands": 0.006837102572123209, "deviation-center-line": 0.5820073778555074, "driven_lanedir_consec": 2.4666258039492046, "sim_compute_sim_state": 0.032343955834706624, "sim_compute_performance-ego": 0.0059203131993611656}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.285305666377538, "get_ui_image": 0.04209737539291382, "step_physics": 0.10633960247039796, "survival_time": 14.950000000000076, "driven_lanedir": 1.9617537773948517, "get_state_dump": 0.01963986078898112, "sim_render-ego": 0.008870582580566406, "get_robot_state": 0.02112062692642212, "get_duckie_state": 2.9881795247395833e-06, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.02625035762786865, "deviation-heading": 2.327150062205486, "complete-iteration": 0.271136965751648, "set_robot_commands": 0.00739161729812622, "deviation-center-line": 0.878630777259845, "driven_lanedir_consec": 1.9617537773948517, "sim_compute_sim_state": 0.03311436494191488, "sim_compute_performance-ego": 0.0061345529556274415}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.48606821226231, "get_ui_image": 0.044170812765757246, "step_physics": 0.11903015931447349, "survival_time": 14.950000000000076, "driven_lanedir": 2.4756967077042216, "get_state_dump": 0.019433008829752605, "sim_render-ego": 0.00953599214553833, "get_robot_state": 0.022921962738037108, "get_duckie_state": 2.970695495605469e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02511064847310384, "deviation-heading": 0.901890985849248, "complete-iteration": 0.2950260368982951, "set_robot_commands": 0.00772431214650472, "deviation-center-line": 0.6003312870789502, "driven_lanedir_consec": 2.4756967077042216, "sim_compute_sim_state": 0.04090172052383423, "sim_compute_performance-ego": 0.006024595101674398}}
set_robot_commands_max0.00772431214650472
set_robot_commands_mean0.007120435337225596
set_robot_commands_median0.007114359935124714
set_robot_commands_min0.006528709332148234
sim_compute_performance-ego_max0.0061345529556274415
sim_compute_performance-ego_mean0.005989319483439127
sim_compute_performance-ego_median0.005972454150517782
sim_compute_performance-ego_min0.0058778166770935055
sim_compute_sim_state_max0.04090172052383423
sim_compute_sim_state_mean0.03505380108952522
sim_compute_sim_state_median0.03348476399978002
sim_compute_sim_state_min0.032343955834706624
sim_render-ego_max0.00953599214553833
sim_render-ego_mean0.008803918908039728
sim_render-ego_median0.008738569319248199
sim_render-ego_min0.008202544848124186
simulation-passed1
step_physics_max0.11903015931447349
step_physics_mean0.10702122862140336
step_physics_median0.1039333779613177
step_physics_min0.10118799924850463
survival_time_max14.950000000000076
survival_time_mean14.212500000000066
survival_time_min12.000000000000036
No reset possible
4270111511Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1927801237932494
survival_time_median14.950000000000076
deviation-center-line_median0.4036219743783399
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego_max0.025598615010579428
agent_compute-ego_mean0.02538859268029531
agent_compute-ego_median0.02547615687052409
agent_compute-ego_min0.02500344196955363
complete-iteration_max0.29158494154612224
complete-iteration_mean0.283632953564326
complete-iteration_median0.283431849082311
complete-iteration_min0.2760831745465597
deviation-center-line_max0.6320802632394154
deviation-center-line_mean0.4533283209072642
deviation-center-line_min0.3739890716329616
deviation-heading_max3.523853203511646
deviation-heading_mean1.8007377764204688
deviation-heading_median1.2848132345229986
deviation-heading_min1.1094714331242317
driven_any_max3.449327668390653
driven_any_mean3.3150420515692978
driven_any_median3.315742800065242
driven_any_min3.179354937756055
driven_lanedir_consec_max3.4343703798887857
driven_lanedir_consec_mean2.7549832655398285
driven_lanedir_consec_min1.2000024346840308
driven_lanedir_max3.4343703798887857
driven_lanedir_mean2.761017393004529
driven_lanedir_median3.1927801237932494
driven_lanedir_min1.224138944542833
get_duckie_state_max3.0914942423502604e-06
get_duckie_state_mean2.9742717742919925e-06
get_duckie_state_median2.9611587524414062e-06
get_duckie_state_min2.883275349934896e-06
get_robot_state_max0.02326325575510661
get_robot_state_mean0.021635914246241252
get_robot_state_median0.021934320131937662
get_robot_state_min0.01941176096598307
get_state_dump_max0.019948835372924804
get_state_dump_mean0.019772087732950847
get_state_dump_median0.019755535920461018
get_state_dump_min0.019628443717956544
get_ui_image_max0.045333619912465414
get_ui_image_mean0.04423726677894592
get_ui_image_median0.044453168312708534
get_ui_image_min0.04270911057790121
in-drivable-lane_max8.100000000000037
in-drivable-lane_mean2.275000000000013
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.3133068341076974, "get_ui_image": 0.045333619912465414, "step_physics": 0.11557078043619792, "survival_time": 14.950000000000076, "driven_lanedir": 3.081169202958157, "get_state_dump": 0.019948835372924804, "sim_render-ego": 0.009738867282867433, "get_robot_state": 0.02326325575510661, "get_duckie_state": 2.972284952799479e-06, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.025492901802062987, "deviation-heading": 1.414004919263269, "complete-iteration": 0.29158494154612224, "set_robot_commands": 0.007602740923563639, "deviation-center-line": 0.4243169333151493, "driven_lanedir_consec": 3.081169202958157, "sim_compute_sim_state": 0.038097182114919026, "sim_compute_performance-ego": 0.006357430617014567}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.3181787660227866, "get_ui_image": 0.044151566823323565, "step_physics": 0.10831990957260132, "survival_time": 14.950000000000076, "driven_lanedir": 3.3043910446283418, "get_state_dump": 0.01983149131139119, "sim_render-ego": 0.008830632368723551, "get_robot_state": 0.021400306224823, "get_duckie_state": 2.9500325520833333e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02500344196955363, "deviation-heading": 1.1556215497827278, "complete-iteration": 0.2760831745465597, "set_robot_commands": 0.007194440364837646, "deviation-center-line": 0.3739890716329616, "driven_lanedir_consec": 3.3043910446283418, "sim_compute_sim_state": 0.035044747988382974, "sim_compute_performance-ego": 0.006125289599100749}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.179354937756055, "get_ui_image": 0.0447547698020935, "step_physics": 0.11126966873804728, "survival_time": 14.950000000000076, "driven_lanedir": 1.224138944542833, "get_state_dump": 0.01967958052953084, "sim_render-ego": 0.009337000846862792, "get_robot_state": 0.022468334039052327, "get_duckie_state": 2.883275349934896e-06, "in-drivable-lane": 8.100000000000037, "agent_compute-ego": 0.02545941193898519, "deviation-heading": 3.523853203511646, "complete-iteration": 0.2841241526603699, "set_robot_commands": 0.007936858336130777, "deviation-center-line": 0.38292701544153057, "driven_lanedir_consec": 1.2000024346840308, "sim_compute_sim_state": 0.03685282866160075, "sim_compute_performance-ego": 0.006187969048817952}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.449327668390653, "get_ui_image": 0.04270911057790121, "step_physics": 0.11367794434229532, "survival_time": 14.950000000000076, "driven_lanedir": 3.4343703798887857, "get_state_dump": 0.019628443717956544, "sim_render-ego": 0.008341642220815022, "get_robot_state": 0.01941176096598307, "get_duckie_state": 3.0914942423502604e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025598615010579428, "deviation-heading": 1.1094714331242317, "complete-iteration": 0.2827395455042521, "set_robot_commands": 0.007158215840657552, "deviation-center-line": 0.6320802632394154, "driven_lanedir_consec": 3.4343703798887857, "sim_compute_sim_state": 0.03994635899861654, "sim_compute_performance-ego": 0.006081582705179851}}
set_robot_commands_max0.007936858336130777
set_robot_commands_mean0.007473063866297404
set_robot_commands_median0.007398590644200643
set_robot_commands_min0.007158215840657552
sim_compute_performance-ego_max0.006357430617014567
sim_compute_performance-ego_mean0.006188067992528279
sim_compute_performance-ego_median0.006156629323959351
sim_compute_performance-ego_min0.006081582705179851
sim_compute_sim_state_max0.03994635899861654
sim_compute_sim_state_mean0.03748527944087982
sim_compute_sim_state_median0.03747500538825989
sim_compute_sim_state_min0.035044747988382974
sim_render-ego_max0.009738867282867433
sim_render-ego_mean0.0090620356798172
sim_render-ego_median0.009083816607793171
sim_render-ego_min0.008341642220815022
simulation-passed1
step_physics_max0.11557078043619792
step_physics_mean0.11220957577228546
step_physics_median0.1124738065401713
step_physics_min0.10831990957260132
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4269311509Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3073684333724613
survival_time_median14.950000000000076
deviation-center-line_median0.4272254614788604
in-drivable-lane_median0.8500000000000121


other stats
agent_compute-ego_max0.02602513551712036
agent_compute-ego_mean0.02572677512963613
agent_compute-ego_median0.02568287134170532
agent_compute-ego_min0.02551622231801351
complete-iteration_max0.27688777367273965
complete-iteration_mean0.2645745118459066
complete-iteration_median0.2608355224132538
complete-iteration_min0.25973922888437906
deviation-center-line_max0.6227393718067155
deviation-center-line_mean0.44075803335479335
deviation-center-line_min0.285841838654737
deviation-heading_max1.4338033444015563
deviation-heading_mean1.3349552875263897
deviation-heading_median1.348827135744323
deviation-heading_min1.2083635342153562
driven_any_max3.7516725245634768
driven_any_mean3.4707613729188793
driven_any_median3.468872279476579
driven_any_min3.193628408158883
driven_lanedir_consec_max3.670942389588887
driven_lanedir_consec_mean2.791460704936846
driven_lanedir_consec_min0.8801635634135745
driven_lanedir_max3.670942389588887
driven_lanedir_mean3.000656454678043
driven_lanedir_median3.3073684333724613
driven_lanedir_min1.7169465623783613
get_duckie_state_max4.15960947672526e-06
get_duckie_state_mean4.1270256042480466e-06
get_duckie_state_median4.137357076009114e-06
get_duckie_state_min4.073778788248698e-06
get_robot_state_max0.019307726224263508
get_robot_state_mean0.01907626748085022
get_robot_state_median0.019076557556788127
get_robot_state_min0.01884422858556112
get_state_dump_max0.019147396087646484
get_state_dump_mean0.019082780679066977
get_state_dump_median0.01909482081731161
get_state_dump_min0.018994084993998208
get_ui_image_max0.04246474345525106
get_ui_image_mean0.042196651498476664
get_ui_image_median0.042181022961934406
get_ui_image_min0.04195981661478678
in-drivable-lane_max7.800000000000024
in-drivable-lane_mean2.375000000000012
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.392448135059713, "get_ui_image": 0.04221767902374267, "step_physics": 0.10127065181732178, "survival_time": 14.950000000000076, "driven_lanedir": 3.091168556928965, "get_state_dump": 0.019139047463734946, "sim_render-ego": 0.008233942985534669, "get_robot_state": 0.019096293449401856, "get_duckie_state": 4.073778788248698e-06, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.02551622231801351, "deviation-heading": 1.33920400407657, "complete-iteration": 0.261423180103302, "set_robot_commands": 0.0066765260696411135, "deviation-center-line": 0.38244505978687, "driven_lanedir_consec": 3.091168556928965, "sim_compute_sim_state": 0.03318917989730835, "sim_compute_performance-ego": 0.005899167060852051}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5452964238934443, "get_ui_image": 0.042144366900126136, "step_physics": 0.10130999644597372, "survival_time": 14.950000000000076, "driven_lanedir": 3.523568309815958, "get_state_dump": 0.019050594170888262, "sim_render-ego": 0.008193792502085368, "get_robot_state": 0.01884422858556112, "get_duckie_state": 4.122257232666015e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025774365266164143, "deviation-heading": 1.4338033444015563, "complete-iteration": 0.26024786472320555, "set_robot_commands": 0.006548612117767334, "deviation-center-line": 0.4720058631708508, "driven_lanedir_consec": 3.523568309815958, "sim_compute_sim_state": 0.03235246896743774, "sim_compute_performance-ego": 0.00584686279296875}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.193628408158883, "get_ui_image": 0.04195981661478678, "step_physics": 0.10125953594843548, "survival_time": 14.950000000000076, "driven_lanedir": 1.7169465623783613, "get_state_dump": 0.019147396087646484, "sim_render-ego": 0.008136738141377766, "get_robot_state": 0.0190568216641744, "get_duckie_state": 4.15960947672526e-06, "in-drivable-lane": 7.800000000000024, "agent_compute-ego": 0.02602513551712036, "deviation-heading": 1.2083635342153562, "complete-iteration": 0.25973922888437906, "set_robot_commands": 0.0068367099761962894, "deviation-center-line": 0.285841838654737, "driven_lanedir_consec": 0.8801635634135745, "sim_compute_sim_state": 0.031214263439178467, "sim_compute_performance-ego": 0.005918123722076416}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.7516725245634768, "get_ui_image": 0.04246474345525106, "step_physics": 0.11021512905756632, "survival_time": 14.950000000000076, "driven_lanedir": 3.670942389588887, "get_state_dump": 0.018994084993998208, "sim_render-ego": 0.008532273769378661, "get_robot_state": 0.019307726224263508, "get_duckie_state": 4.152456919352214e-06, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.0255913774172465, "deviation-heading": 1.3584502674120753, "complete-iteration": 0.27688777367273965, "set_robot_commands": 0.007034443219502767, "deviation-center-line": 0.6227393718067155, "driven_lanedir_consec": 3.670942389588887, "sim_compute_sim_state": 0.03863433122634888, "sim_compute_performance-ego": 0.005930783748626709}}
set_robot_commands_max0.007034443219502767
set_robot_commands_mean0.006774072845776876
set_robot_commands_median0.0067566180229187015
set_robot_commands_min0.006548612117767334
sim_compute_performance-ego_max0.005930783748626709
sim_compute_performance-ego_mean0.005898734331130981
sim_compute_performance-ego_median0.005908645391464233
sim_compute_performance-ego_min0.00584686279296875
sim_compute_sim_state_max0.03863433122634888
sim_compute_sim_state_mean0.03384756088256836
sim_compute_sim_state_median0.032770824432373044
sim_compute_sim_state_min0.031214263439178467
sim_render-ego_max0.008532273769378661
sim_render-ego_mean0.008274186849594117
sim_render-ego_median0.008213867743810018
sim_render-ego_min0.008136738141377766
simulation-passed1
step_physics_max0.11021512905756632
step_physics_mean0.10351382831732432
step_physics_median0.10129032413164776
step_physics_min0.10125953594843548
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4267411503Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:08:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4267211502Jean-SΓ©bastien Grondin πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:07:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6352128492010662
survival_time_median8.925000000000038
deviation-center-line_median0.34539814998534946
in-drivable-lane_median0.5749999999999992


other stats
agent_compute-ego_max0.024958579540252684
agent_compute-ego_mean0.024273889403918697
agent_compute-ego_median0.0247300136911458
agent_compute-ego_min0.022676950693130492
complete-iteration_max0.2904686347643534
complete-iteration_mean0.2807358010883989
complete-iteration_median0.28142715300636734
complete-iteration_min0.2696202635765076
deviation-center-line_max0.7372867653691678
deviation-center-line_mean0.3805767834498936
deviation-center-line_min0.09422406845970746
deviation-heading_max3.2480645175521135
deviation-heading_mean1.9230258267938884
deviation-heading_median1.9336685656324837
deviation-heading_min0.5767016583584738
driven_any_max2.6396356082691077
driven_any_mean1.29122516437737
driven_any_median1.161194303556229
driven_any_min0.20287644212791353
driven_lanedir_consec_max2.553916538895157
driven_lanedir_consec_mean0.978719313807864
driven_lanedir_consec_min0.09053501793416709
driven_lanedir_max2.553916538895157
driven_lanedir_mean0.978719313807864
driven_lanedir_median0.6352128492010662
driven_lanedir_min0.09053501793416709
get_duckie_state_max4.229874446474273e-06
get_duckie_state_mean4.038892943283607e-06
get_duckie_state_median3.9978822072347e-06
get_duckie_state_min3.9299329121907554e-06
get_robot_state_max0.022352070013682047
get_robot_state_mean0.021024724310156943
get_robot_state_median0.020918010404740256
get_robot_state_min0.01991080641746521
get_state_dump_max0.020004618167877197
get_state_dump_mean0.01983532615091609
get_state_dump_median0.019797581584974265
get_state_dump_min0.019741523265838622
get_ui_image_max0.04609494209289551
get_ui_image_mean0.04467181988146113
get_ui_image_median0.04474275509516398
get_ui_image_min0.04310682724262106
in-drivable-lane_max6.35000000000009
in-drivable-lane_mean1.8750000000000224
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.6396356082691077, "get_ui_image": 0.04495078404744466, "step_physics": 0.11241848945617676, "survival_time": 14.950000000000076, "driven_lanedir": 2.553916538895157, "get_state_dump": 0.019741523265838622, "sim_render-ego": 0.00968075672785441, "get_robot_state": 0.021713020006815593, "get_duckie_state": 3.9545694986979165e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02460057020187378, "deviation-heading": 3.2480645175521135, "complete-iteration": 0.2835370667775472, "set_robot_commands": 0.007454141775767009, "deviation-center-line": 0.7372867653691678, "driven_lanedir_consec": 2.553916538895157, "sim_compute_sim_state": 0.03660895983378092, "sim_compute_performance-ego": 0.006187740961710612}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.20287644212791353, "get_ui_image": 0.04609494209289551, "step_physics": 0.1076100707054138, "survival_time": 2.000000000000001, "driven_lanedir": 0.09053501793416709, "get_state_dump": 0.020004618167877197, "sim_render-ego": 0.008527624607086181, "get_robot_state": 0.01991080641746521, "get_duckie_state": 4.041194915771484e-06, "in-drivable-lane": 0.6000000000000003, "agent_compute-ego": 0.022676950693130492, "deviation-heading": 1.0250778840057704, "complete-iteration": 0.2696202635765076, "set_robot_commands": 0.006971710920333862, "deviation-center-line": 0.09422406845970746, "driven_lanedir_consec": 0.09053501793416709, "sim_compute_sim_state": 0.0315565824508667, "sim_compute_performance-ego": 0.006086689233779907}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9479786830962889, "get_ui_image": 0.0445347261428833, "step_physics": 0.12000125328699748, "survival_time": 14.950000000000076, "driven_lanedir": 1.0045408549471628, "get_state_dump": 0.019849303563435873, "sim_render-ego": 0.009381518363952636, "get_robot_state": 0.022352070013682047, "get_duckie_state": 3.9299329121907554e-06, "in-drivable-lane": 6.35000000000009, "agent_compute-ego": 0.024958579540252684, "deviation-heading": 2.842259247259197, "complete-iteration": 0.2904686347643534, "set_robot_commands": 0.0075741767883300785, "deviation-center-line": 0.4914154155940827, "driven_lanedir_consec": 1.0045408549471628, "sim_compute_sim_state": 0.03549839973449707, "sim_compute_performance-ego": 0.006135771274566651}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.37440992401617, "get_ui_image": 0.04310682724262106, "step_physics": 0.1117957460469213, "survival_time": 2.8999999999999977, "driven_lanedir": 0.26588484345496965, "get_state_dump": 0.01974585960651266, "sim_render-ego": 0.008458482808080214, "get_robot_state": 0.020123000802664923, "get_duckie_state": 4.229874446474273e-06, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.024859457180417818, "deviation-heading": 0.5767016583584738, "complete-iteration": 0.2793172392351874, "set_robot_commands": 0.006951237546986547, "deviation-center-line": 0.1993808843766162, "driven_lanedir_consec": 0.26588484345496965, "sim_compute_sim_state": 0.037840649999421216, "sim_compute_performance-ego": 0.006248243923844962}}
set_robot_commands_max0.0075741767883300785
set_robot_commands_mean0.007237816757854374
set_robot_commands_median0.007212926348050435
set_robot_commands_min0.006951237546986547
sim_compute_performance-ego_max0.006248243923844962
sim_compute_performance-ego_mean0.006164611348475533
sim_compute_performance-ego_median0.006161756118138632
sim_compute_performance-ego_min0.006086689233779907
sim_compute_sim_state_max0.037840649999421216
sim_compute_sim_state_mean0.03537614800464148
sim_compute_sim_state_median0.036053679784138995
sim_compute_sim_state_min0.0315565824508667
sim_render-ego_max0.00968075672785441
sim_render-ego_mean0.00901209562674336
sim_render-ego_median0.008954571485519409
sim_render-ego_min0.008458482808080214
simulation-passed1
step_physics_max0.12000125328699748
step_physics_mean0.11295638987387736
step_physics_median0.11210711775154902
step_physics_min0.1076100707054138
survival_time_max14.950000000000076
survival_time_mean8.700000000000038
survival_time_min2.000000000000001
No reset possible
4266611500Olga (Ge Ya) Xu πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.70740350667967
survival_time_median14.950000000000076
deviation-center-line_median0.6611087673403531
in-drivable-lane_median3.300000000000032


other stats
agent_compute-ego_max0.026318926811218266
agent_compute-ego_mean0.025878419677416484
agent_compute-ego_median0.02579896648724874
agent_compute-ego_min0.02559681892395019
complete-iteration_max0.2782083829243978
complete-iteration_mean0.2667609280347824
complete-iteration_median0.26357248147328693
complete-iteration_min0.26169036626815795
deviation-center-line_max0.9191323501395904
deviation-center-line_mean0.5926918849486615
deviation-center-line_min0.12941765497434968
deviation-heading_max2.256490732121259
deviation-heading_mean1.579908564859755
deviation-heading_median1.6472911538193469
deviation-heading_min0.7685612196790679
driven_any_max3.3909647763869835
driven_any_mean3.1482936316796213
driven_any_median3.217920305759706
driven_any_min2.76636913881209
driven_lanedir_consec_max3.1967502576050677
driven_lanedir_consec_mean2.3241304556061873
driven_lanedir_consec_min0.6849645514603415
driven_lanedir_max3.1967502576050677
driven_lanedir_mean2.3241304556061873
driven_lanedir_median2.70740350667967
driven_lanedir_min0.6849645514603415
get_duckie_state_max4.727840423583984e-06
get_duckie_state_mean4.586974779764811e-06
get_duckie_state_median4.598697026570638e-06
get_duckie_state_min4.4226646423339845e-06
get_robot_state_max0.019142433007558187
get_robot_state_mean0.019068021376927695
get_robot_state_median0.019066701730092367
get_robot_state_min0.018996249039967855
get_state_dump_max0.019317351977030436
get_state_dump_mean0.019238540331522624
get_state_dump_median0.01924406846364339
get_state_dump_min0.019148672421773275
get_ui_image_max0.04229565064112346
get_ui_image_mean0.04208354870478312
get_ui_image_median0.04206175645192464
get_ui_image_min0.04191503127415975
in-drivable-lane_max11.80000000000008
in-drivable-lane_mean4.600000000000036
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.3909647763869835, "get_ui_image": 0.04229565064112346, "step_physics": 0.10276492436726888, "survival_time": 14.950000000000076, "driven_lanedir": 2.808531567734043, "get_state_dump": 0.019317351977030436, "sim_render-ego": 0.008282506465911865, "get_robot_state": 0.019090142250061035, "get_duckie_state": 4.727840423583984e-06, "in-drivable-lane": 2.850000000000021, "agent_compute-ego": 0.02559681892395019, "deviation-heading": 2.256490732121259, "complete-iteration": 0.2638961378733317, "set_robot_commands": 0.006531031131744385, "deviation-center-line": 0.9191323501395904, "driven_lanedir_consec": 2.808531567734043, "sim_compute_sim_state": 0.033895124594370524, "sim_compute_performance-ego": 0.005937102635701497}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2202424279321575, "get_ui_image": 0.042172848383585614, "step_physics": 0.1013616172472636, "survival_time": 14.950000000000076, "driven_lanedir": 2.6062754456252963, "get_state_dump": 0.019148672421773275, "sim_render-ego": 0.008295764923095703, "get_robot_state": 0.0190432612101237, "get_duckie_state": 4.57763671875e-06, "in-drivable-lane": 3.750000000000042, "agent_compute-ego": 0.02577782471974691, "deviation-heading": 1.923587854358563, "complete-iteration": 0.26169036626815795, "set_robot_commands": 0.006647450129191081, "deviation-center-line": 0.6448211012701076, "driven_lanedir_consec": 2.6062754456252963, "sim_compute_sim_state": 0.03312346696853638, "sim_compute_performance-ego": 0.005933477878570557}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.76636913881209, "get_ui_image": 0.04195066452026367, "step_physics": 0.10183812300364176, "survival_time": 14.950000000000076, "driven_lanedir": 0.6849645514603415, "get_state_dump": 0.01929916779200236, "sim_render-ego": 0.008288658459981283, "get_robot_state": 0.019142433007558187, "get_duckie_state": 4.619757334391276e-06, "in-drivable-lane": 11.80000000000008, "agent_compute-ego": 0.026318926811218266, "deviation-heading": 0.7685612196790679, "complete-iteration": 0.2632488250732422, "set_robot_commands": 0.006929011344909668, "deviation-center-line": 0.12941765497434968, "driven_lanedir_consec": 0.6849645514603415, "sim_compute_sim_state": 0.033336164951324465, "sim_compute_performance-ego": 0.005959005355834961}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.2155981835872542, "get_ui_image": 0.04191503127415975, "step_physics": 0.1127051305770874, "survival_time": 14.950000000000076, "driven_lanedir": 3.1967502576050677, "get_state_dump": 0.019188969135284423, "sim_render-ego": 0.008320029576619465, "get_robot_state": 0.018996249039967855, "get_duckie_state": 4.4226646423339845e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02582010825475057, "deviation-heading": 1.3709944532801306, "complete-iteration": 0.2782083829243978, "set_robot_commands": 0.006676965554555257, "deviation-center-line": 0.6773964334105984, "driven_lanedir_consec": 3.1967502576050677, "sim_compute_sim_state": 0.038406236966451006, "sim_compute_performance-ego": 0.005997222264607747}}
set_robot_commands_max0.006929011344909668
set_robot_commands_mean0.006696114540100098
set_robot_commands_median0.006662207841873168
set_robot_commands_min0.006531031131744385
sim_compute_performance-ego_max0.005997222264607747
sim_compute_performance-ego_mean0.005956702033678691
sim_compute_performance-ego_median0.005948053995768229
sim_compute_performance-ego_min0.005933477878570557
sim_compute_sim_state_max0.038406236966451006
sim_compute_sim_state_mean0.034690248370170595
sim_compute_sim_state_median0.033615644772847494
sim_compute_sim_state_min0.03312346696853638
sim_render-ego_max0.008320029576619465
sim_render-ego_mean0.008296739856402079
sim_render-ego_median0.008292211691538494
sim_render-ego_min0.008282506465911865
simulation-passed1
step_physics_max0.1127051305770874
step_physics_mean0.1046674487988154
step_physics_median0.10230152368545532
step_physics_min0.1013616172472636
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4265511498Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:09:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4262511499Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:09:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4260411496Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:09:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4259011492Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:04:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4258511490Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7731983998587415
survival_time_median14.950000000000076
deviation-center-line_median0.614466531577539
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.025698564052581783
agent_compute-ego_mean0.025132947365442908
agent_compute-ego_median0.025180613199869792
agent_compute-ego_min0.024471999009450275
complete-iteration_max0.3131165242195129
complete-iteration_mean0.2944584554433823
complete-iteration_median0.29483391920725505
complete-iteration_min0.275049459139506
deviation-center-line_max0.6937813269693023
deviation-center-line_mean0.6113480450991673
deviation-center-line_min0.5226777902722888
deviation-heading_max3.428804594640338
deviation-heading_mean2.8097606410900644
deviation-heading_median2.748316926403964
deviation-heading_min2.3136041169119923
driven_any_max2.858821568517725
driven_any_mean2.856494373494985
driven_any_median2.8587914937879164
driven_any_min2.849572937886383
driven_lanedir_consec_max2.8008268291043357
driven_lanedir_consec_mean2.6514125479161272
driven_lanedir_consec_min2.258426562842689
driven_lanedir_max2.8008268291043357
driven_lanedir_mean2.6514125479161272
driven_lanedir_median2.7731983998587415
driven_lanedir_min2.258426562842689
get_duckie_state_max3.139972686767578e-06
get_duckie_state_mean3.054539362589518e-06
get_duckie_state_median3.048976262410482e-06
get_duckie_state_min2.9802322387695312e-06
get_robot_state_max0.025025412241617837
get_robot_state_mean0.022688434918721516
get_robot_state_median0.02331349929173787
get_robot_state_min0.01910132884979248
get_state_dump_max0.020035691261291504
get_state_dump_mean0.019774009982744853
get_state_dump_median0.019810809294382732
get_state_dump_min0.019438730080922444
get_ui_image_max0.0513683025042216
get_ui_image_mean0.046493469278017674
get_ui_image_median0.046214716831843056
get_ui_image_min0.042176140944163006
in-drivable-lane_max2.6500000000000377
in-drivable-lane_mean0.6625000000000094
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.849572937886383, "get_ui_image": 0.04934938271840413, "step_physics": 0.13173004865646362, "survival_time": 14.950000000000076, "driven_lanedir": 2.8008268291043357, "get_state_dump": 0.020035691261291504, "sim_render-ego": 0.00992352565129598, "get_robot_state": 0.02380032459894816, "get_duckie_state": 3.055731455485026e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025117697715759276, "deviation-heading": 2.3136041169119923, "complete-iteration": 0.3131165242195129, "set_robot_commands": 0.007843494415283203, "deviation-center-line": 0.5226777902722888, "driven_lanedir_consec": 2.8008268291043357, "sim_compute_sim_state": 0.03887255191802978, "sim_compute_performance-ego": 0.006268223921457926}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.858821568517725, "get_ui_image": 0.0513683025042216, "step_physics": 0.12755592584609984, "survival_time": 14.950000000000076, "driven_lanedir": 2.7620974968719096, "get_state_dump": 0.01981453021367391, "sim_render-ego": 0.009630414644877116, "get_robot_state": 0.022826673984527587, "get_duckie_state": 2.9802322387695312e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024471999009450275, "deviation-heading": 3.428804594640338, "complete-iteration": 0.3063810936609904, "set_robot_commands": 0.007622184753417968, "deviation-center-line": 0.6937813269693023, "driven_lanedir_consec": 2.7620974968719096, "sim_compute_sim_state": 0.03669126749038696, "sim_compute_performance-ego": 0.006223358313242594}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8587671006129853, "get_ui_image": 0.04308005094528198, "step_physics": 0.1083563454945882, "survival_time": 14.950000000000076, "driven_lanedir": 2.784299302845573, "get_state_dump": 0.019807088375091552, "sim_render-ego": 0.01005573829015096, "get_robot_state": 0.025025412241617837, "get_duckie_state": 3.139972686767578e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025698564052581783, "deviation-heading": 2.748833079897085, "complete-iteration": 0.28328674475351967, "set_robot_commands": 0.008555860519409179, "deviation-center-line": 0.6339967173221511, "driven_lanedir_consec": 2.784299302845573, "sim_compute_sim_state": 0.03634439945220947, "sim_compute_performance-ego": 0.0061777822176615396}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.858815886962847, "get_ui_image": 0.042176140944163006, "step_physics": 0.1104281481107076, "survival_time": 14.950000000000076, "driven_lanedir": 2.258426562842689, "get_state_dump": 0.019438730080922444, "sim_render-ego": 0.008265759150187174, "get_robot_state": 0.01910132884979248, "get_duckie_state": 3.0422210693359374e-06, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.025243528683980308, "deviation-heading": 2.747800772910843, "complete-iteration": 0.275049459139506, "set_robot_commands": 0.006479955514272054, "deviation-center-line": 0.5949363458329271, "driven_lanedir_consec": 2.258426562842689, "sim_compute_sim_state": 0.03781343777974447, "sim_compute_performance-ego": 0.00591808795928955}}
set_robot_commands_max0.008555860519409179
set_robot_commands_mean0.007625373800595601
set_robot_commands_median0.007732839584350585
set_robot_commands_min0.006479955514272054
sim_compute_performance-ego_max0.006268223921457926
sim_compute_performance-ego_mean0.006146863102912902
sim_compute_performance-ego_median0.006200570265452067
sim_compute_performance-ego_min0.00591808795928955
sim_compute_sim_state_max0.03887255191802978
sim_compute_sim_state_mean0.03743041416009267
sim_compute_sim_state_median0.03725235263506571
sim_compute_sim_state_min0.03634439945220947
sim_render-ego_max0.01005573829015096
sim_render-ego_mean0.009468859434127808
sim_render-ego_median0.009776970148086548
sim_render-ego_min0.008265759150187174
simulation-passed1
step_physics_max0.13173004865646362
step_physics_mean0.11951761702696484
step_physics_median0.11899203697840371
step_physics_min0.1083563454945882
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4255511486Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7504071022928525
survival_time_median14.950000000000076
deviation-center-line_median0.6711655711522616
in-drivable-lane_median1.5000000000000155


other stats
agent_compute-ego_max0.02531605323155721
agent_compute-ego_mean0.024587170481681825
agent_compute-ego_median0.024553401867548626
agent_compute-ego_min0.023925824960072836
complete-iteration_max0.31058147112528484
complete-iteration_mean0.2914674117167791
complete-iteration_median0.29000283598899845
complete-iteration_min0.2752825037638346
deviation-center-line_max1.123455279168851
deviation-center-line_mean0.7087653249940605
deviation-center-line_min0.3692748785028682
deviation-heading_max3.33491721033506
deviation-heading_mean2.406630464712166
deviation-heading_median2.734747667812637
deviation-heading_min0.8221093128883299
driven_any_max3.972191560630415
driven_any_mean3.7991438635271257
driven_any_median3.813175090841366
driven_any_min3.598033711795352
driven_lanedir_consec_max3.6774355426420406
driven_lanedir_consec_mean2.805024336616508
driven_lanedir_consec_min2.041847599238286
driven_lanedir_max3.6774355426420406
driven_lanedir_mean3.0905447704307387
driven_lanedir_median3.321447969921314
driven_lanedir_min2.041847599238286
get_duckie_state_max3.0390421549479165e-06
get_duckie_state_mean2.8876463572184244e-06
get_duckie_state_median2.860625584920248e-06
get_duckie_state_min2.7902921040852864e-06
get_robot_state_max0.023910713195800785
get_robot_state_mean0.021455296476682022
get_robot_state_median0.02137152870496114
get_robot_state_min0.019167415301005044
get_state_dump_max0.01988261302312215
get_state_dump_mean0.01969122568766276
get_state_dump_median0.019760428269704183
get_state_dump_min0.019361433188120523
get_ui_image_max0.04921887159347534
get_ui_image_mean0.04658228913942973
get_ui_image_median0.04721267859141032
get_ui_image_min0.04268492778142293
in-drivable-lane_max7.450000000000096
in-drivable-lane_mean2.93750000000003
in-drivable-lane_min1.2999999999999954
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.972191560630415, "get_ui_image": 0.04921887159347534, "step_physics": 0.1298843232790629, "survival_time": 14.950000000000076, "driven_lanedir": 3.3188101785201543, "get_state_dump": 0.01988261302312215, "sim_render-ego": 0.010063360532124838, "get_robot_state": 0.023910713195800785, "get_duckie_state": 3.0390421549479165e-06, "in-drivable-lane": 1.3500000000000076, "agent_compute-ego": 0.02486358880996704, "deviation-heading": 3.1916715761455303, "complete-iteration": 0.31058147112528484, "set_robot_commands": 0.007812419732411703, "deviation-center-line": 0.8101263776039495, "driven_lanedir_consec": 3.3188101785201543, "sim_compute_sim_state": 0.03846042156219483, "sim_compute_performance-ego": 0.006311096350351969}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.968176371259085, "get_ui_image": 0.04890412966410319, "step_physics": 0.12191974878311156, "survival_time": 14.950000000000076, "driven_lanedir": 3.6774355426420406, "get_state_dump": 0.019878944555918376, "sim_render-ego": 0.009635396003723144, "get_robot_state": 0.02286200205485026, "get_duckie_state": 2.826849619547526e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.024243214925130208, "deviation-heading": 2.277823759479743, "complete-iteration": 0.2992814302444458, "set_robot_commands": 0.007685391108194987, "deviation-center-line": 0.5322047647005738, "driven_lanedir_consec": 3.6774355426420406, "sim_compute_sim_state": 0.03774757544199626, "sim_compute_performance-ego": 0.006229486465454102}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.598033711795352, "get_ui_image": 0.04552122751871745, "step_physics": 0.11599738200505574, "survival_time": 14.950000000000076, "driven_lanedir": 3.324085761322474, "get_state_dump": 0.01964191198348999, "sim_render-ego": 0.008953988552093506, "get_robot_state": 0.019881055355072026, "get_duckie_state": 2.7902921040852864e-06, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.023925824960072836, "deviation-heading": 3.33491721033506, "complete-iteration": 0.28072424173355104, "set_robot_commands": 0.007022951443990072, "deviation-center-line": 1.123455279168851, "driven_lanedir_consec": 2.1820040260655507, "sim_compute_sim_state": 0.033484925429026285, "sim_compute_performance-ego": 0.00612104336420695}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.6581738104236488, "get_ui_image": 0.04268492778142293, "step_physics": 0.10873369296391804, "survival_time": 14.950000000000076, "driven_lanedir": 2.041847599238286, "get_state_dump": 0.019361433188120523, "sim_render-ego": 0.00849565029144287, "get_robot_state": 0.019167415301005044, "get_duckie_state": 2.894401550292969e-06, "in-drivable-lane": 7.450000000000096, "agent_compute-ego": 0.02531605323155721, "deviation-heading": 0.8221093128883299, "complete-iteration": 0.2752825037638346, "set_robot_commands": 0.006980319817860921, "deviation-center-line": 0.3692748785028682, "driven_lanedir_consec": 2.041847599238286, "sim_compute_sim_state": 0.03838541030883789, "sim_compute_performance-ego": 0.0059754784901936845}}
set_robot_commands_max0.007812419732411703
set_robot_commands_mean0.007375270525614421
set_robot_commands_median0.007354171276092529
set_robot_commands_min0.006980319817860921
sim_compute_performance-ego_max0.006311096350351969
sim_compute_performance-ego_mean0.006159276167551676
sim_compute_performance-ego_median0.006175264914830525
sim_compute_performance-ego_min0.0059754784901936845
sim_compute_sim_state_max0.03846042156219483
sim_compute_sim_state_mean0.037019583185513814
sim_compute_sim_state_median0.03806649287541707
sim_compute_sim_state_min0.033484925429026285
sim_render-ego_max0.010063360532124838
sim_render-ego_mean0.00928709884484609
sim_render-ego_median0.009294692277908323
sim_render-ego_min0.00849565029144287
simulation-passed1
step_physics_max0.1298843232790629
step_physics_mean0.11913378675778706
step_physics_median0.11895856539408366
step_physics_min0.10873369296391804
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4254611484Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:08:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4253711483Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:09:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4252211478Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:08:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4251311475Francois Hebertexercise_state_estimationaido5-LF-sim-validationLFv-simerrornoafdaniele15-b9b1aef9b8fb-10:08:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4249011468Raphael Jeanexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele15-b9b1aef9b8fb-10:10:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02502352794011434
agent_compute-ego_mean0.02478399157524109
agent_compute-ego_median0.0248883851369222
agent_compute-ego_min0.024335668087005616
complete-iteration_max0.29268343687057496
complete-iteration_mean0.28028346637884777
complete-iteration_median0.27751559535662335
complete-iteration_min0.2734192379315694
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.971490224202474e-06
get_duckie_state_mean2.91446844736735e-06
get_duckie_state_median2.9377142588297523e-06
get_duckie_state_min2.8109550476074217e-06
get_robot_state_max0.023519502480824787
get_robot_state_mean0.02269802471001943
get_robot_state_median0.023160427411397295
get_robot_state_min0.020951741536458332
get_state_dump_max0.019653955300649006
get_state_dump_mean0.019595842560132345
get_state_dump_median0.01959825118382772
get_state_dump_min0.019532912572224937
get_ui_image_max0.04533857266108195
get_ui_image_mean0.044747785925865174
get_ui_image_median0.044743176301320395
get_ui_image_min0.044166218439737955
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.044166218439737955, "step_physics": 0.1090083924929301, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01956538518269857, "sim_render-ego": 0.009542427857716878, "get_robot_state": 0.023519502480824787, "get_duckie_state": 2.9206275939941406e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024764199256896973, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2790937892595927, "set_robot_commands": 0.007942142486572266, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03426070213317871, "sim_compute_performance-ego": 0.006146139303843181}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.044839855829874674, "step_physics": 0.10549659252166747, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01963111718495687, "sim_render-ego": 0.00940000851949056, "get_robot_state": 0.023337291081746415, "get_duckie_state": 2.9548009236653644e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024335668087005616, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2734192379315694, "set_robot_commands": 0.008064780235290527, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03210989236831665, "sim_compute_performance-ego": 0.006028946240743001}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04464649677276611, "step_physics": 0.10628809372584024, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.019653955300649006, "sim_render-ego": 0.00948378086090088, "get_robot_state": 0.022983563741048176, "get_duckie_state": 2.971490224202474e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025012571016947427, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.275937401453654, "set_robot_commands": 0.00775109608968099, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.033812296390533444, "sim_compute_performance-ego": 0.006129430135091146}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04533857266108195, "step_physics": 0.12133539199829102, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019532912572224937, "sim_render-ego": 0.008879644870758057, "get_robot_state": 0.020951741536458332, "get_duckie_state": 2.8109550476074217e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02502352794011434, "deviation-heading": 0.486072248607516, "complete-iteration": 0.29268343687057496, "set_robot_commands": 0.007316384315490723, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0380708916982015, "sim_compute_performance-ego": 0.006057276725769043}}
set_robot_commands_max0.008064780235290527
set_robot_commands_mean0.007768600781758626
set_robot_commands_median0.007846619288126628
set_robot_commands_min0.007316384315490723
sim_compute_performance-ego_max0.006146139303843181
sim_compute_performance-ego_mean0.006090448101361593
sim_compute_performance-ego_median0.0060933534304300945
sim_compute_performance-ego_min0.006028946240743001
sim_compute_sim_state_max0.0380708916982015
sim_compute_sim_state_mean0.034563445647557575
sim_compute_sim_state_median0.034036499261856076
sim_compute_sim_state_min0.03210989236831665
sim_render-ego_max0.009542427857716878
sim_render-ego_mean0.009326465527216594
sim_render-ego_median0.00944189469019572
sim_render-ego_min0.008879644870758057
simulation-passed1
step_physics_max0.12133539199829102
step_physics_mean0.1105321176846822
step_physics_median0.10764824310938516
step_physics_min0.10549659252166747
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible