Duckietown Challenges Home Challenges Submissions

Evaluator 2323

ID2323
evaluatormont04-85f844e025a2-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont04-85f844e025a2-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success50 42469
# timeout1 42626
# failed10 42846
# error5 42645
# aborted1 43941
# host-error6 43401
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4407411779Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-errornomont04-85f844e025a2-10:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4404811778Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-errornomont04-85f844e025a2-10:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4399911777Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-errornomont04-85f844e025a2-10:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4394111772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednomont04-85f844e025a2-10:00:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4384811759Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:06:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.791020582369579
survival_time_median13.100000000000051
deviation-center-line_median0.35627925469433896
in-drivable-lane_median2.700000000000019


other stats
agent_compute-ego_max0.01752656618754069
agent_compute-ego_mean0.01661593522780981
agent_compute-ego_median0.016555587053298952
agent_compute-ego_min0.01582600061710064
complete-iteration_max0.18665053129196169
complete-iteration_mean0.17415008606564283
complete-iteration_median0.1706464315785302
complete-iteration_min0.16865694981354934
deviation-center-line_max0.7218735605016909
deviation-center-line_mean0.4028192427954176
deviation-center-line_min0.1768449012913015
deviation-heading_max1.136478463411485
deviation-heading_mean0.9711851315794848
deviation-heading_median0.9678173164117032
deviation-heading_min0.8126274300830487
driven_any_max1.93999963482613
driven_any_mean1.491966730469452
driven_any_median1.6912084491045956
driven_any_min0.6454503888424866
driven_lanedir_consec_max1.9186854903883064
driven_lanedir_consec_mean0.9784849099722944
driven_lanedir_consec_min0.4132129847617136
driven_lanedir_max1.9186854903883064
driven_lanedir_mean0.9784849099722944
driven_lanedir_median0.791020582369579
driven_lanedir_min0.4132129847617136
get_duckie_state_max2.1732770479642427e-06
get_duckie_state_mean2.008268975803995e-06
get_duckie_state_median1.956621805826823e-06
get_duckie_state_min1.9465552435980905e-06
get_robot_state_max0.011651522838152371
get_robot_state_mean0.011449237330856486
get_robot_state_median0.011387264198727078
get_robot_state_min0.011370898087819416
get_state_dump_max0.011859402126736113
get_state_dump_mean0.01178095714149312
get_state_dump_median0.011763527974104269
get_state_dump_min0.011737370491027832
get_ui_image_max0.033111006418863935
get_ui_image_mean0.03200422057738671
get_ui_image_median0.03206496098102667
get_ui_image_min0.030775953928629557
in-drivable-lane_max9.500000000000089
in-drivable-lane_mean3.725000000000032
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.442417263383062, "get_ui_image": 0.030775953928629557, "step_physics": 0.06540393087599013, "survival_time": 11.250000000000025, "driven_lanedir": 0.9389696215327928, "get_state_dump": 0.011859402126736113, "sim_render-ego": 0.004888584348890517, "get_robot_state": 0.01137120140923394, "get_duckie_state": 1.9465552435980905e-06, "in-drivable-lane": 3.750000000000043, "agent_compute-ego": 0.01652832349141439, "deviation-heading": 0.8126274300830487, "complete-iteration": 0.16916954782274035, "set_robot_commands": 0.004426981608072917, "deviation-center-line": 0.7218735605016909, "driven_lanedir_consec": 0.9389696215327928, "sim_compute_sim_state": 0.02045628441704644, "sim_compute_performance-ego": 0.0033314842647976343}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6454503888424866, "get_ui_image": 0.03153007305585421, "step_physics": 0.06590624726735629, "survival_time": 5.1999999999999895, "driven_lanedir": 0.4132129847617136, "get_state_dump": 0.011749437222113976, "sim_render-ego": 0.004898046071712787, "get_robot_state": 0.011651522838152371, "get_duckie_state": 2.1732770479642427e-06, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.01582600061710064, "deviation-heading": 0.8842443267371751, "complete-iteration": 0.16865694981354934, "set_robot_commands": 0.004304023889394907, "deviation-center-line": 0.3181776078572893, "driven_lanedir_consec": 0.4132129847617136, "sim_compute_sim_state": 0.01929721923974844, "sim_compute_performance-ego": 0.0033654203781714807}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.93999963482613, "get_ui_image": 0.03259984890619914, "step_physics": 0.06681485970815022, "survival_time": 14.950000000000076, "driven_lanedir": 0.6430715432063652, "get_state_dump": 0.011777618726094565, "sim_render-ego": 0.0050861652692159014, "get_robot_state": 0.011403326988220214, "get_duckie_state": 1.964569091796875e-06, "in-drivable-lane": 9.500000000000089, "agent_compute-ego": 0.01658285061518351, "deviation-heading": 1.051390306086231, "complete-iteration": 0.17212331533432007, "set_robot_commands": 0.004320013523101807, "deviation-center-line": 0.1768449012913015, "driven_lanedir_consec": 0.6430715432063652, "sim_compute_sim_state": 0.020039645036061603, "sim_compute_performance-ego": 0.0033743619918823243}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939999634826129, "get_ui_image": 0.033111006418863935, "step_physics": 0.07685265938440959, "survival_time": 14.950000000000076, "driven_lanedir": 1.9186854903883064, "get_state_dump": 0.011737370491027832, "sim_render-ego": 0.004923969109853109, "get_robot_state": 0.011370898087819416, "get_duckie_state": 1.948674519856771e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01752656618754069, "deviation-heading": 1.136478463411485, "complete-iteration": 0.18665053129196169, "set_robot_commands": 0.004571344057718913, "deviation-center-line": 0.3943809015313886, "driven_lanedir_consec": 1.9186854903883064, "sim_compute_sim_state": 0.023120898405710855, "sim_compute_performance-ego": 0.0033059080441792807}}
set_robot_commands_max0.004571344057718913
set_robot_commands_mean0.004405590769572136
set_robot_commands_median0.004373497565587362
set_robot_commands_min0.004304023889394907
sim_compute_performance-ego_max0.0033743619918823243
sim_compute_performance-ego_mean0.00334429366975768
sim_compute_performance-ego_median0.0033484523214845578
sim_compute_performance-ego_min0.0033059080441792807
sim_compute_sim_state_max0.023120898405710855
sim_compute_sim_state_mean0.020728511774641835
sim_compute_sim_state_median0.020247964726554026
sim_compute_sim_state_min0.01929721923974844
sim_render-ego_max0.0050861652692159014
sim_render-ego_mean0.004949191199918078
sim_render-ego_median0.004911007590782948
sim_render-ego_min0.004888584348890517
simulation-passed1
step_physics_max0.07685265938440959
step_physics_mean0.06874442430897656
step_physics_median0.06636055348775326
step_physics_min0.06540393087599013
survival_time_max14.950000000000076
survival_time_mean11.58750000000004
survival_time_min5.1999999999999895
No reset possible
4383111754Étienne Boucher 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-errornomont04-85f844e025a2-10:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4382811753Étienne Boucher 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4291951586132292
survival_time_median14.950000000000076
deviation-center-line_median0.6661421346620838
in-drivable-lane_median2.900000000000033


other stats
agent_compute-ego_max0.017620209058125814
agent_compute-ego_mean0.017043816248575847
agent_compute-ego_median0.016873377164204915
agent_compute-ego_min0.01680830160776774
complete-iteration_max0.20286492029825845
complete-iteration_mean0.19305687606334687
complete-iteration_median0.19125355203946431
complete-iteration_min0.18685547987620035
deviation-center-line_max1.4054117358733265
deviation-center-line_mean0.7546193517852531
deviation-center-line_min0.2807814019435182
deviation-heading_max4.83869556913992
deviation-heading_mean3.091740942778018
deviation-heading_median3.2487396198641227
deviation-heading_min1.0307889622439077
driven_any_max1.9399100308991444
driven_any_mean1.9382973671847483
driven_any_median1.939824697889139
driven_any_min1.9336300420615715
driven_lanedir_consec_max1.872081185121051
driven_lanedir_consec_mean1.311579160438293
driven_lanedir_consec_min0.5158451394056621
driven_lanedir_max1.872081185121051
driven_lanedir_mean1.311579160438293
driven_lanedir_median1.4291951586132292
driven_lanedir_min0.5158451394056621
get_duckie_state_max2.7720133463541667e-06
get_duckie_state_mean2.6468435923258463e-06
get_duckie_state_median2.6543935139973957e-06
get_duckie_state_min2.506573994954427e-06
get_robot_state_max0.01499122142791748
get_robot_state_mean0.014351431131362917
get_robot_state_median0.014223042329152426
get_robot_state_min0.01396841843922933
get_state_dump_max0.01321565628051758
get_state_dump_mean0.012993034919102989
get_state_dump_median0.012940067450205484
get_state_dump_min0.012876348495483398
get_ui_image_max0.034979751904805505
get_ui_image_mean0.0341339518626531
get_ui_image_median0.034184205134709676
get_ui_image_min0.03318764527638753
in-drivable-lane_max10.450000000000085
in-drivable-lane_mean4.062500000000037
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336300420615715, "get_ui_image": 0.03318764527638753, "step_physics": 0.07308502435684204, "survival_time": 14.950000000000076, "driven_lanedir": 1.872081185121051, "get_state_dump": 0.01295777161916097, "sim_render-ego": 0.00552700678507487, "get_robot_state": 0.01396841843922933, "get_duckie_state": 2.7720133463541667e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016901515324910483, "deviation-heading": 3.0083102101118793, "complete-iteration": 0.18685547987620035, "set_robot_commands": 0.0045369116465250655, "deviation-center-line": 0.48682855309376666, "driven_lanedir_consec": 1.872081185121051, "sim_compute_sim_state": 0.02281758467356364, "sim_compute_performance-ego": 0.0037228957811991374}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9398472671420115, "get_ui_image": 0.03396739403406779, "step_physics": 0.0731730341911316, "survival_time": 14.950000000000076, "driven_lanedir": 1.3626269934324184, "get_state_dump": 0.012876348495483398, "sim_render-ego": 0.005590352217356364, "get_robot_state": 0.014460668563842774, "get_duckie_state": 2.506573994954427e-06, "in-drivable-lane": 3.1500000000000288, "agent_compute-ego": 0.016845239003499348, "deviation-heading": 4.83869556913992, "complete-iteration": 0.18727064847946168, "set_robot_commands": 0.004622022310892741, "deviation-center-line": 1.4054117358733265, "driven_lanedir_consec": 1.3626269934324184, "sim_compute_sim_state": 0.021888374487559, "sim_compute_performance-ego": 0.003702946503957113}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939802128636266, "get_ui_image": 0.034401016235351564, "step_physics": 0.07942161480585734, "survival_time": 14.950000000000076, "driven_lanedir": 0.5158451394056621, "get_state_dump": 0.01321565628051758, "sim_render-ego": 0.005720415115356445, "get_robot_state": 0.013985416094462078, "get_duckie_state": 2.7060508728027343e-06, "in-drivable-lane": 10.450000000000085, "agent_compute-ego": 0.017620209058125814, "deviation-heading": 1.0307889622439077, "complete-iteration": 0.19523645559946695, "set_robot_commands": 0.004806493918100993, "deviation-center-line": 0.2807814019435182, "driven_lanedir_consec": 0.5158451394056621, "sim_compute_sim_state": 0.022144264380137127, "sim_compute_performance-ego": 0.0037712971369425457}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399100308991444, "get_ui_image": 0.034979751904805505, "step_physics": 0.08318516731262207, "survival_time": 14.950000000000076, "driven_lanedir": 1.4957633237940398, "get_state_dump": 0.01292236328125, "sim_render-ego": 0.0056389530499776205, "get_robot_state": 0.01499122142791748, "get_duckie_state": 2.602736155192057e-06, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.01680830160776774, "deviation-heading": 3.489169029616366, "complete-iteration": 0.20286492029825845, "set_robot_commands": 0.00480679988861084, "deviation-center-line": 0.8454557162304009, "driven_lanedir_consec": 1.4957633237940398, "sim_compute_sim_state": 0.02562985340754191, "sim_compute_performance-ego": 0.003753395080566406}}
set_robot_commands_max0.00480679988861084
set_robot_commands_mean0.004693056941032409
set_robot_commands_median0.0047142581144968675
set_robot_commands_min0.0045369116465250655
sim_compute_performance-ego_max0.0037712971369425457
sim_compute_performance-ego_mean0.0037376336256663
sim_compute_performance-ego_median0.003738145430882772
sim_compute_performance-ego_min0.003702946503957113
sim_compute_sim_state_max0.02562985340754191
sim_compute_sim_state_mean0.02312001923720042
sim_compute_sim_state_median0.022480924526850386
sim_compute_sim_state_min0.021888374487559
sim_render-ego_max0.005720415115356445
sim_render-ego_mean0.005619181791941325
sim_render-ego_median0.005614652633666992
sim_render-ego_min0.00552700678507487
simulation-passed1
step_physics_max0.08318516731262207
step_physics_mean0.07721621016661326
step_physics_median0.07629732449849447
step_physics_min0.07308502435684204
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4381311751Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.459429721935343
survival_time_median14.950000000000076
deviation-center-line_median0.381011799695086
in-drivable-lane_median7.050000000000049


other stats
agent_compute-ego_max0.017390390237172444
agent_compute-ego_mean0.017063912131379474
agent_compute-ego_median0.01708382765452067
agent_compute-ego_min0.016697602979304116
complete-iteration_max0.1977744181950887
complete-iteration_mean0.1893111396415762
complete-iteration_median0.18992006103197737
complete-iteration_min0.1796300183072615
deviation-center-line_max1.0779326773516975
deviation-center-line_mean0.4964243009687588
deviation-center-line_min0.14574092713316544
deviation-heading_max2.159892838696137
deviation-heading_mean1.10138270668752
deviation-heading_median0.8975530289754268
deviation-heading_min0.4505319301030899
driven_any_max3.963972318721026
driven_any_mean3.331441733087191
driven_any_median3.5053656077597553
driven_any_min2.3510633981082254
driven_lanedir_consec_max2.622731035406125
driven_lanedir_consec_mean1.5567017227371456
driven_lanedir_consec_min0.685216411671772
driven_lanedir_max2.622731035406125
driven_lanedir_mean1.5567017227371456
driven_lanedir_median1.459429721935343
driven_lanedir_min0.685216411671772
get_duckie_state_max3.667672475179036e-06
get_duckie_state_mean3.47566851778654e-06
get_duckie_state_median3.445148468017578e-06
get_duckie_state_min3.344704659931968e-06
get_robot_state_max0.01481727917989095
get_robot_state_mean0.01384223431681522
get_robot_state_median0.013904693126678466
get_robot_state_min0.012742271834012994
get_state_dump_max0.013413936297098797
get_state_dump_mean0.013162250971299798
get_state_dump_median0.01318240245183309
get_state_dump_min0.012870262684434223
get_ui_image_max0.03458429495493571
get_ui_image_mean0.033615920014168466
get_ui_image_median0.03397813677787781
get_ui_image_min0.03192311154598254
in-drivable-lane_max11.400000000000082
in-drivable-lane_mean7.537500000000056
in-drivable-lane_min4.65000000000005
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3510633981082254, "get_ui_image": 0.03192311154598254, "step_physics": 0.06953438731471888, "survival_time": 10.450000000000014, "driven_lanedir": 0.7216365048162974, "get_state_dump": 0.012870262684434223, "sim_render-ego": 0.005399872811787437, "get_robot_state": 0.012742271834012994, "get_duckie_state": 3.344704659931968e-06, "in-drivable-lane": 7.250000000000017, "agent_compute-ego": 0.016697602979304116, "deviation-heading": 0.4505319301030899, "complete-iteration": 0.1796300183072615, "set_robot_commands": 0.004506617641905278, "deviation-center-line": 0.26367361239597753, "driven_lanedir_consec": 0.7216365048162974, "sim_compute_sim_state": 0.022173438916366067, "sim_compute_performance-ego": 0.0036426788311825983}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.6986760803151535, "get_ui_image": 0.03361814975738525, "step_physics": 0.0736300269762675, "survival_time": 14.950000000000076, "driven_lanedir": 2.622731035406125, "get_state_dump": 0.013036778767903646, "sim_render-ego": 0.005689217249552409, "get_robot_state": 0.01481727917989095, "get_duckie_state": 3.667672475179036e-06, "in-drivable-lane": 4.65000000000005, "agent_compute-ego": 0.016818554401397706, "deviation-heading": 1.0357821812698451, "complete-iteration": 0.18932906150817871, "set_robot_commands": 0.004653512636820475, "deviation-center-line": 1.0779326773516975, "driven_lanedir_consec": 2.622731035406125, "sim_compute_sim_state": 0.02311970790227254, "sim_compute_performance-ego": 0.003803916772206624}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.312055135204357, "get_ui_image": 0.03433812379837036, "step_physics": 0.07439666589101156, "survival_time": 14.950000000000076, "driven_lanedir": 0.685216411671772, "get_state_dump": 0.013328026135762531, "sim_render-ego": 0.005639256636301677, "get_robot_state": 0.013882309595743814, "get_duckie_state": 3.4880638122558596e-06, "in-drivable-lane": 11.400000000000082, "agent_compute-ego": 0.017390390237172444, "deviation-heading": 0.7593238766810084, "complete-iteration": 0.19051106055577596, "set_robot_commands": 0.004438100655873616, "deviation-center-line": 0.14574092713316544, "driven_lanedir_consec": 0.685216411671772, "sim_compute_sim_state": 0.023133836587270105, "sim_compute_performance-ego": 0.0038167762756347655}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.963972318721026, "get_ui_image": 0.03458429495493571, "step_physics": 0.0777386204401652, "survival_time": 14.950000000000076, "driven_lanedir": 2.1972229390543885, "get_state_dump": 0.013413936297098797, "sim_render-ego": 0.005586124261220296, "get_robot_state": 0.01392707665761312, "get_duckie_state": 3.4022331237792968e-06, "in-drivable-lane": 6.8500000000000805, "agent_compute-ego": 0.017349100907643637, "deviation-heading": 2.159892838696137, "complete-iteration": 0.1977744181950887, "set_robot_commands": 0.00452767292658488, "deviation-center-line": 0.4983499869941946, "driven_lanedir_consec": 2.1972229390543885, "sim_compute_sim_state": 0.026720136801401773, "sim_compute_performance-ego": 0.0037778846422831217}}
set_robot_commands_max0.004653512636820475
set_robot_commands_mean0.004531475965296062
set_robot_commands_median0.004517145284245079
set_robot_commands_min0.004438100655873616
sim_compute_performance-ego_max0.0038167762756347655
sim_compute_performance-ego_mean0.0037603141303267774
sim_compute_performance-ego_median0.0037909007072448727
sim_compute_performance-ego_min0.0036426788311825983
sim_compute_sim_state_max0.026720136801401773
sim_compute_sim_state_mean0.02378678005182762
sim_compute_sim_state_median0.02312677224477132
sim_compute_sim_state_min0.022173438916366067
sim_render-ego_max0.005689217249552409
sim_render-ego_mean0.005578617739715455
sim_render-ego_median0.005612690448760987
sim_render-ego_min0.005399872811787437
simulation-passed1
step_physics_max0.0777386204401652
step_physics_mean0.07382492515554079
step_physics_median0.07401334643363952
step_physics_min0.06953438731471888
survival_time_max14.950000000000076
survival_time_mean13.82500000000006
survival_time_min10.450000000000014
No reset possible
4380911750Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6925981286381246
survival_time_median14.950000000000076
deviation-center-line_median0.7267411955373388
in-drivable-lane_median5.925000000000024


other stats
agent_compute-ego_max0.01765889803568522
agent_compute-ego_mean0.01713388959566752
agent_compute-ego_median0.01712990760803223
agent_compute-ego_min0.01661684513092041
complete-iteration_max0.1815060623486837
complete-iteration_mean0.1751760246356329
complete-iteration_median0.17404203295707704
complete-iteration_min0.1711139702796936
deviation-center-line_max1.1552356658073093
deviation-center-line_mean0.6906234123262097
deviation-center-line_min0.15377559242285185
deviation-heading_max2.9978606332464035
deviation-heading_mean2.2178243367424297
deviation-heading_median2.545368133501148
deviation-heading_min0.7827004467210206
driven_any_max4.049911006979518
driven_any_mean3.2662970557074757
driven_any_median3.067333919880863
driven_any_min2.88060937608866
driven_lanedir_consec_max3.1741048500549356
driven_lanedir_consec_mean1.796669701308898
driven_lanedir_consec_min0.6273776979044068
driven_lanedir_max3.1783453066767624
driven_lanedir_mean1.7977298154643546
driven_lanedir_median1.6925981286381246
driven_lanedir_min0.6273776979044068
get_duckie_state_max2.2951761881510417e-06
get_duckie_state_mean2.2280216217041013e-06
get_duckie_state_median2.220471700032552e-06
get_duckie_state_min2.1759668986002605e-06
get_robot_state_max0.011538291772206624
get_robot_state_mean0.011467881798744202
get_robot_state_median0.011472113132476806
get_robot_state_min0.011389009157816567
get_state_dump_max0.012124324639638265
get_state_dump_mean0.011929524540901184
get_state_dump_median0.011908361117045085
get_state_dump_min0.011777051289876302
get_ui_image_max0.03250498374303182
get_ui_image_mean0.0315260523557663
get_ui_image_median0.03134328643480937
get_ui_image_min0.030912652810414634
in-drivable-lane_max11.45000000000008
in-drivable-lane_mean6.38750000000004
in-drivable-lane_min2.250000000000032
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.88060937608866, "get_ui_image": 0.03110653559366862, "step_physics": 0.0669540294011434, "survival_time": 14.950000000000076, "driven_lanedir": 0.6273776979044068, "get_state_dump": 0.012124324639638265, "sim_render-ego": 0.005080223878224691, "get_robot_state": 0.011529937585194903, "get_duckie_state": 2.2951761881510417e-06, "in-drivable-lane": 11.45000000000008, "agent_compute-ego": 0.016982796192169188, "deviation-heading": 0.7827004467210206, "complete-iteration": 0.17323333819707237, "set_robot_commands": 0.0047149348258972166, "deviation-center-line": 0.15377559242285185, "driven_lanedir_consec": 0.6273776979044068, "sim_compute_sim_state": 0.021194085280100503, "sim_compute_performance-ego": 0.003421030044555664}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.1804465254749017, "get_ui_image": 0.030912652810414634, "step_physics": 0.06621306419372558, "survival_time": 14.950000000000076, "driven_lanedir": 2.2353165808727127, "get_state_dump": 0.011883784929911295, "sim_render-ego": 0.0049277130762736005, "get_robot_state": 0.011538291772206624, "get_duckie_state": 2.179145812988282e-06, "in-drivable-lane": 3.450000000000009, "agent_compute-ego": 0.017277019023895265, "deviation-heading": 2.2782487786979653, "complete-iteration": 0.1711139702796936, "set_robot_commands": 0.004561036427815755, "deviation-center-line": 1.1552356658073093, "driven_lanedir_consec": 2.2353165808727127, "sim_compute_sim_state": 0.020351943969726564, "sim_compute_performance-ego": 0.0033265240987141926}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.954221314286825, "get_ui_image": 0.031580037275950115, "step_physics": 0.06796007871627807, "survival_time": 14.950000000000076, "driven_lanedir": 1.1498796764035366, "get_state_dump": 0.011777051289876302, "sim_render-ego": 0.005051730473836263, "get_robot_state": 0.011389009157816567, "get_duckie_state": 2.1759668986002605e-06, "in-drivable-lane": 8.400000000000038, "agent_compute-ego": 0.01765889803568522, "deviation-heading": 2.9978606332464035, "complete-iteration": 0.1748507277170817, "set_robot_commands": 0.004502393404642741, "deviation-center-line": 0.5800244119187619, "driven_lanedir_consec": 1.1498796764035366, "sim_compute_sim_state": 0.02142207543055217, "sim_compute_performance-ego": 0.003382153511047363}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.049911006979518, "get_ui_image": 0.03250498374303182, "step_physics": 0.07160864273707072, "survival_time": 14.950000000000076, "driven_lanedir": 3.1783453066767624, "get_state_dump": 0.011932937304178874, "sim_render-ego": 0.004923702081044515, "get_robot_state": 0.011414288679758708, "get_duckie_state": 2.261797587076823e-06, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.01661684513092041, "deviation-heading": 2.8124874883043303, "complete-iteration": 0.1815060623486837, "set_robot_commands": 0.004446347554524739, "deviation-center-line": 0.8734579791559158, "driven_lanedir_consec": 3.1741048500549356, "sim_compute_sim_state": 0.02461447556813558, "sim_compute_performance-ego": 0.00332001527150472}}
set_robot_commands_max0.0047149348258972166
set_robot_commands_mean0.0045561780532201125
set_robot_commands_median0.004531714916229248
set_robot_commands_min0.004446347554524739
sim_compute_performance-ego_max0.003421030044555664
sim_compute_performance-ego_mean0.003362430731455485
sim_compute_performance-ego_median0.003354338804880778
sim_compute_performance-ego_min0.00332001527150472
sim_compute_sim_state_max0.02461447556813558
sim_compute_sim_state_mean0.021895645062128703
sim_compute_sim_state_median0.021308080355326334
sim_compute_sim_state_min0.020351943969726564
sim_render-ego_max0.005080223878224691
sim_render-ego_mean0.004995842377344767
sim_render-ego_median0.004989721775054932
sim_render-ego_min0.004923702081044515
simulation-passed1
step_physics_max0.07160864273707072
step_physics_mean0.06818395376205444
step_physics_median0.06745705405871073
step_physics_min0.06621306419372558
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4380511749Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.570628638377958
survival_time_median14.950000000000076
deviation-center-line_median0.7548125612452813
in-drivable-lane_median3.90000000000003


other stats
agent_compute-ego_max0.017176923751831056
agent_compute-ego_mean0.016942083636919656
agent_compute-ego_median0.01693321069081624
agent_compute-ego_min0.01672498941421509
complete-iteration_max0.189266250928243
complete-iteration_mean0.1842146984736125
complete-iteration_median0.1830405120054881
complete-iteration_min0.1815115189552307
deviation-center-line_max1.1244230637188228
deviation-center-line_mean0.8127055752474477
deviation-center-line_min0.6167741147804052
deviation-heading_max3.1919466330497417
deviation-heading_mean2.368451957966216
deviation-heading_median2.173151562757866
deviation-heading_min1.935558073299391
driven_any_max4.250723490815805
driven_any_mean3.4535640900265356
driven_any_median3.2381346633267833
driven_any_min3.0872635426367703
driven_lanedir_consec_max2.960316098837719
driven_lanedir_consec_mean2.34807444040922
driven_lanedir_consec_min1.290724386043245
driven_lanedir_max2.960316098837719
driven_lanedir_mean2.34807444040922
driven_lanedir_median2.570628638377958
driven_lanedir_min1.290724386043245
get_duckie_state_max2.502600351969401e-06
get_duckie_state_mean2.381006876627604e-06
get_duckie_state_median2.3833910624186197e-06
get_duckie_state_min2.254645029703776e-06
get_robot_state_max0.01352649688720703
get_robot_state_mean0.013221540252367657
get_robot_state_median0.013232670227686564
get_robot_state_min0.012894323666890462
get_state_dump_max0.013131518363952635
get_state_dump_mean0.013061294555664064
get_state_dump_median0.013054957787195842
get_state_dump_min0.013003744284311933
get_ui_image_max0.03325274546941121
get_ui_image_mean0.03281542360782623
get_ui_image_median0.032845141490300496
get_ui_image_min0.032318665981292724
in-drivable-lane_max7.500000000000032
in-drivable-lane_mean4.087500000000027
in-drivable-lane_min1.050000000000015
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.288776695846268, "get_ui_image": 0.032465147177378334, "step_physics": 0.0702522333463033, "survival_time": 14.950000000000076, "driven_lanedir": 2.960316098837719, "get_state_dump": 0.013044044971466063, "sim_render-ego": 0.005402375062306722, "get_robot_state": 0.01352649688720703, "get_duckie_state": 2.5002161661783853e-06, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.01672498941421509, "deviation-heading": 2.2123637572927377, "complete-iteration": 0.18231874624888103, "set_robot_commands": 0.004478152592976888, "deviation-center-line": 1.1244230637188228, "driven_lanedir_consec": 2.960316098837719, "sim_compute_sim_state": 0.022611281077067055, "sim_compute_performance-ego": 0.003668695290883382}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.187492630807298, "get_ui_image": 0.032318665981292724, "step_physics": 0.06968003908793131, "survival_time": 14.950000000000076, "driven_lanedir": 2.237157492003083, "get_state_dump": 0.013003744284311933, "sim_render-ego": 0.005482319196065267, "get_robot_state": 0.013380861282348631, "get_duckie_state": 2.502600351969401e-06, "in-drivable-lane": 3.9500000000000055, "agent_compute-ego": 0.016970245838165282, "deviation-heading": 2.1339393682229946, "complete-iteration": 0.1815115189552307, "set_robot_commands": 0.004498220284779866, "deviation-center-line": 0.6907697884569062, "driven_lanedir_consec": 2.237157492003083, "sim_compute_sim_state": 0.022321082750956216, "sim_compute_performance-ego": 0.0037044588724772136}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0872635426367703, "get_ui_image": 0.03325274546941121, "step_physics": 0.07109617948532104, "survival_time": 14.950000000000076, "driven_lanedir": 1.290724386043245, "get_state_dump": 0.013131518363952635, "sim_render-ego": 0.0053752875328063965, "get_robot_state": 0.012894323666890462, "get_duckie_state": 2.254645029703776e-06, "in-drivable-lane": 7.500000000000032, "agent_compute-ego": 0.017176923751831056, "deviation-heading": 3.1919466330497417, "complete-iteration": 0.1837622777620951, "set_robot_commands": 0.0044593373934427895, "deviation-center-line": 0.6167741147804052, "driven_lanedir_consec": 1.290724386043245, "sim_compute_sim_state": 0.02262515385945638, "sim_compute_performance-ego": 0.003603737354278565}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.250723490815805, "get_ui_image": 0.03322513580322266, "step_physics": 0.07328503688176473, "survival_time": 14.950000000000076, "driven_lanedir": 2.904099784752833, "get_state_dump": 0.013065870602925618, "sim_render-ego": 0.005360334714253743, "get_robot_state": 0.013084479173024495, "get_duckie_state": 2.266565958658854e-06, "in-drivable-lane": 3.8500000000000543, "agent_compute-ego": 0.016896175543467205, "deviation-heading": 1.935558073299391, "complete-iteration": 0.189266250928243, "set_robot_commands": 0.004459969202677409, "deviation-center-line": 0.8188553340336564, "driven_lanedir_consec": 2.904099784752833, "sim_compute_sim_state": 0.026088148752848307, "sim_compute_performance-ego": 0.003651155630747478}}
set_robot_commands_max0.004498220284779866
set_robot_commands_mean0.004473919868469238
set_robot_commands_median0.004469060897827148
set_robot_commands_min0.0044593373934427895
sim_compute_performance-ego_max0.0037044588724772136
sim_compute_performance-ego_mean0.003657011787096659
sim_compute_performance-ego_median0.0036599254608154297
sim_compute_performance-ego_min0.003603737354278565
sim_compute_sim_state_max0.026088148752848307
sim_compute_sim_state_mean0.02341141661008199
sim_compute_sim_state_median0.022618217468261717
sim_compute_sim_state_min0.022321082750956216
sim_render-ego_max0.005482319196065267
sim_render-ego_mean0.005405079126358033
sim_render-ego_median0.005388831297556559
sim_render-ego_min0.005360334714253743
simulation-passed1
step_physics_max0.07328503688176473
step_physics_mean0.0710783722003301
step_physics_median0.07067420641581218
step_physics_min0.06968003908793131
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4379411745Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5546653381425037
survival_time_median14.950000000000076
deviation-center-line_median0.7810750874376128
in-drivable-lane_median1.8750000000000124


other stats
agent_compute-ego_max0.01769012212753296
agent_compute-ego_mean0.017284107208251954
agent_compute-ego_median0.017276197274525958
agent_compute-ego_min0.016893912156422934
complete-iteration_max0.1944689655303955
complete-iteration_mean0.184844977580091
complete-iteration_median0.18443328936894737
complete-iteration_min0.17604436605207385
deviation-center-line_max1.2181645014942
deviation-center-line_mean0.7694683571965821
deviation-center-line_min0.29755875241690327
deviation-heading_max4.193448071048566
deviation-heading_mean2.710888906668486
deviation-heading_median2.6095224327222573
deviation-heading_min1.4310626901808632
driven_any_max3.4357340330202737
driven_any_mean2.7149391771367117
driven_any_median2.97402657688683
driven_any_min1.4759695217529136
driven_lanedir_consec_max3.264616531140897
driven_lanedir_consec_mean2.341720459775929
driven_lanedir_consec_min0.9929346316778104
driven_lanedir_max3.264616531140897
driven_lanedir_mean2.341720459775929
driven_lanedir_median2.5546653381425037
driven_lanedir_min0.9929346316778104
get_duckie_state_max2.5121370951334636e-06
get_duckie_state_mean2.3262154671453663e-06
get_duckie_state_median2.332131067911784e-06
get_duckie_state_min2.128462637624433e-06
get_robot_state_max0.01378868579864502
get_robot_state_mean0.01291145900885264
get_robot_state_median0.013043063481648765
get_robot_state_min0.011771023273468018
get_state_dump_max0.014762226740519208
get_state_dump_mean0.013071327574791446
get_state_dump_median0.01260157863299052
get_state_dump_min0.012319926292665545
get_ui_image_max0.03381760756174723
get_ui_image_mean0.03281050428908358
get_ui_image_median0.032723315556844074
get_ui_image_min0.03197777848089895
in-drivable-lane_max2.7500000000000115
in-drivable-lane_mean1.625000000000009
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4759695217529136, "get_ui_image": 0.03197777848089895, "step_physics": 0.06827747629534814, "survival_time": 6.199999999999986, "driven_lanedir": 0.9929346316778104, "get_state_dump": 0.012319926292665545, "sim_render-ego": 0.00502230082788775, "get_robot_state": 0.011771023273468018, "get_duckie_state": 2.128462637624433e-06, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.01769012212753296, "deviation-heading": 1.4310626901808632, "complete-iteration": 0.17604436605207385, "set_robot_commands": 0.004583627946915165, "deviation-center-line": 0.29755875241690327, "driven_lanedir_consec": 0.9929346316778104, "sim_compute_sim_state": 0.020861891008192492, "sim_compute_performance-ego": 0.0034149500631516978}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.4357340330202737, "get_ui_image": 0.03202942927678426, "step_physics": 0.0692756462097168, "survival_time": 14.950000000000076, "driven_lanedir": 3.036371901016788, "get_state_dump": 0.012330853939056396, "sim_render-ego": 0.005499719778696696, "get_robot_state": 0.01378868579864502, "get_duckie_state": 2.27053960164388e-06, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.016893912156422934, "deviation-heading": 2.4264725556856153, "complete-iteration": 0.1799663313229879, "set_robot_commands": 0.0046545998255411785, "deviation-center-line": 0.6254362133892839, "driven_lanedir_consec": 3.036371901016788, "sim_compute_sim_state": 0.02176450570424398, "sim_compute_performance-ego": 0.003601850668589274}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.6051035549907797, "get_ui_image": 0.03341720183690389, "step_physics": 0.0747575298945109, "survival_time": 14.950000000000076, "driven_lanedir": 2.0729587752682193, "get_state_dump": 0.014762226740519208, "sim_render-ego": 0.005349009831746419, "get_robot_state": 0.013007562160491945, "get_duckie_state": 2.3937225341796873e-06, "in-drivable-lane": 2.7500000000000115, "agent_compute-ego": 0.017289386590321858, "deviation-heading": 4.193448071048566, "complete-iteration": 0.1889002474149068, "set_robot_commands": 0.0044603896141052245, "deviation-center-line": 1.2181645014942, "driven_lanedir_consec": 2.0729587752682193, "sim_compute_sim_state": 0.02219843546549479, "sim_compute_performance-ego": 0.0035241786638895672}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.34294959878288, "get_ui_image": 0.03381760756174723, "step_physics": 0.0782360283533732, "survival_time": 14.950000000000076, "driven_lanedir": 3.264616531140897, "get_state_dump": 0.012872303326924642, "sim_render-ego": 0.005305389563242595, "get_robot_state": 0.013078564802805583, "get_duckie_state": 2.5121370951334636e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01726300795873006, "deviation-heading": 2.7925723097588997, "complete-iteration": 0.1944689655303955, "set_robot_commands": 0.00440825621287028, "deviation-center-line": 0.9367139614859415, "driven_lanedir_consec": 3.264616531140897, "sim_compute_sim_state": 0.025744698842366538, "sim_compute_performance-ego": 0.0036105163892110183}}
set_robot_commands_max0.0046545998255411785
set_robot_commands_mean0.004526718399857962
set_robot_commands_median0.004522008780510195
set_robot_commands_min0.00440825621287028
sim_compute_performance-ego_max0.0036105163892110183
sim_compute_performance-ego_mean0.0035378739462103895
sim_compute_performance-ego_median0.0035630146662394206
sim_compute_performance-ego_min0.0034149500631516978
sim_compute_sim_state_max0.025744698842366538
sim_compute_sim_state_mean0.022642382755074447
sim_compute_sim_state_median0.021981470584869385
sim_compute_sim_state_min0.020861891008192492
sim_render-ego_max0.005499719778696696
sim_render-ego_mean0.005294105000393365
sim_render-ego_median0.005327199697494507
sim_render-ego_min0.00502230082788775
simulation-passed1
step_physics_max0.0782360283533732
step_physics_mean0.07263667018823726
step_physics_median0.07201658805211385
step_physics_min0.06827747629534814
survival_time_max14.950000000000076
survival_time_mean12.762500000000053
survival_time_min6.199999999999986
No reset possible
4377311738Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4489289496399702
survival_time_median11.075000000000022
deviation-center-line_median0.22217992139202303
in-drivable-lane_median4.825000000000003


other stats
agent_compute-ego_max0.018299063841501872
agent_compute-ego_mean0.017643934824084783
agent_compute-ego_median0.017490057696226254
agent_compute-ego_min0.017296560062384753
complete-iteration_max0.207389545736846
complete-iteration_mean0.20329959024812855
complete-iteration_median0.20317233879156787
complete-iteration_min0.19946413767253257
deviation-center-line_max0.6230109598186133
deviation-center-line_mean0.2918394292026692
deviation-center-line_min0.0999869142080175
deviation-heading_max3.558759843335537
deviation-heading_mean1.3545122312561586
deviation-heading_median0.7517551996700744
deviation-heading_min0.3557786823489486
driven_any_max5.301998640185992
driven_any_mean3.6714861042158105
driven_any_median3.5970031147632335
driven_any_min2.1899395471507814
driven_lanedir_consec_max2.6280216003508996
driven_lanedir_consec_mean1.541420251030345
driven_lanedir_consec_min0.6398015044905392
driven_lanedir_max2.6280216003508996
driven_lanedir_mean1.541420251030345
driven_lanedir_median1.4489289496399702
driven_lanedir_min0.6398015044905392
get_duckie_state_max2.6226043701171875e-06
get_duckie_state_mean2.5746445165747915e-06
get_duckie_state_median2.594063826691533e-06
get_duckie_state_min2.487846042798913e-06
get_robot_state_max0.01586803436279297
get_robot_state_mean0.0152555231897829
get_robot_state_median0.01558162372854738
get_robot_state_min0.01399081093924386
get_state_dump_max0.013613799413045248
get_state_dump_mean0.013420631282540084
get_state_dump_median0.013386098108471849
get_state_dump_min0.013296529500171392
get_ui_image_max0.03588790416717529
get_ui_image_mean0.03521406364728338
get_ui_image_median0.03511974433916962
get_ui_image_min0.034728861743618986
in-drivable-lane_max13.250000000000076
in-drivable-lane_mean6.3000000000000185
in-drivable-lane_min2.299999999999992
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.301998640185992, "get_ui_image": 0.03480574594321826, "step_physics": 0.07868168878217116, "survival_time": 14.100000000000064, "driven_lanedir": 2.6280216003508996, "get_state_dump": 0.01338378165630584, "sim_render-ego": 0.005990596527748919, "get_robot_state": 0.015438010506596126, "get_duckie_state": 2.620913458208666e-06, "in-drivable-lane": 6.150000000000019, "agent_compute-ego": 0.017407380097301292, "deviation-heading": 3.558759843335537, "complete-iteration": 0.19946413767253257, "set_robot_commands": 0.004806761200546373, "deviation-center-line": 0.6230109598186133, "driven_lanedir_consec": 2.6280216003508996, "sim_compute_sim_state": 0.02478731524014304, "sim_compute_performance-ego": 0.004012286240327443}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.1899395471507814, "get_ui_image": 0.03543374273512098, "step_physics": 0.07966027115330551, "survival_time": 4.94999999999999, "driven_lanedir": 0.9745210726578856, "get_state_dump": 0.013296529500171392, "sim_render-ego": 0.006159808900621202, "get_robot_state": 0.015725236950498638, "get_duckie_state": 2.5672141951744004e-06, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.01757273529515122, "deviation-heading": 0.9171426799303516, "complete-iteration": 0.20007784920509417, "set_robot_commands": 0.004789971341990462, "deviation-center-line": 0.15313167908164552, "driven_lanedir_consec": 0.9745210726578856, "sim_compute_sim_state": 0.023191492966931276, "sim_compute_performance-ego": 0.004092840233234444}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.119699128466883, "get_ui_image": 0.03588790416717529, "step_physics": 0.08342425584793091, "survival_time": 14.950000000000076, "driven_lanedir": 0.6398015044905392, "get_state_dump": 0.013613799413045248, "sim_render-ego": 0.006192698478698731, "get_robot_state": 0.01586803436279297, "get_duckie_state": 2.6226043701171875e-06, "in-drivable-lane": 13.250000000000076, "agent_compute-ego": 0.018299063841501872, "deviation-heading": 0.3557786823489486, "complete-iteration": 0.2062668283780416, "set_robot_commands": 0.00494230588277181, "deviation-center-line": 0.0999869142080175, "driven_lanedir_consec": 0.6398015044905392, "sim_compute_sim_state": 0.023710168997446695, "sim_compute_performance-ego": 0.004168248176574707}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0743071010595844, "get_ui_image": 0.034728861743618986, "step_physics": 0.08576725136419261, "survival_time": 8.04999999999998, "driven_lanedir": 1.9233368266220547, "get_state_dump": 0.01338841456063786, "sim_render-ego": 0.005810970104999424, "get_robot_state": 0.01399081093924386, "get_duckie_state": 2.487846042798913e-06, "in-drivable-lane": 3.4999999999999876, "agent_compute-ego": 0.017296560062384753, "deviation-heading": 0.586367719409797, "complete-iteration": 0.207389545736846, "set_robot_commands": 0.004601724399542957, "deviation-center-line": 0.2912281637024005, "driven_lanedir_consec": 1.9233368266220547, "sim_compute_sim_state": 0.027703991587858023, "sim_compute_performance-ego": 0.003938947405133929}}
set_robot_commands_max0.00494230588277181
set_robot_commands_mean0.004785190706212901
set_robot_commands_median0.0047983662712684175
set_robot_commands_min0.004601724399542957
sim_compute_performance-ego_max0.004168248176574707
sim_compute_performance-ego_mean0.004053080513817631
sim_compute_performance-ego_median0.004052563236780944
sim_compute_performance-ego_min0.003938947405133929
sim_compute_sim_state_max0.027703991587858023
sim_compute_sim_state_mean0.02484824219809476
sim_compute_sim_state_median0.024248742118794867
sim_compute_sim_state_min0.023191492966931276
sim_render-ego_max0.006192698478698731
sim_render-ego_mean0.006038518503017069
sim_render-ego_median0.00607520271418506
sim_render-ego_min0.005810970104999424
simulation-passed1
step_physics_max0.08576725136419261
step_physics_mean0.08188336678690004
step_physics_median0.08154226350061822
step_physics_min0.07868168878217116
survival_time_max14.950000000000076
survival_time_mean10.512500000000028
survival_time_min4.94999999999999
No reset possible
4376111734Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3692970040379864
survival_time_median14.950000000000076
deviation-center-line_median0.5441671884987591
in-drivable-lane_median3.050000000000032


other stats
agent_compute-ego_max0.017619316577911378
agent_compute-ego_mean0.017533335856944554
agent_compute-ego_median0.017549974068701724
agent_compute-ego_min0.01741407871246338
complete-iteration_max0.20621379693349204
complete-iteration_mean0.198292681516224
complete-iteration_median0.1993623761336009
complete-iteration_min0.18823217686420213
deviation-center-line_max0.9780682419452956
deviation-center-line_mean0.5814255996895052
deviation-center-line_min0.25929977981520735
deviation-heading_max3.3430168851788133
deviation-heading_mean1.892604195983279
deviation-heading_median1.7282584772856813
deviation-heading_min0.7708829441829406
driven_any_max3.264442031696942
driven_any_mean2.796907393503588
driven_any_median2.7749751679142225
driven_any_min2.3732372064889646
driven_lanedir_consec_max3.038447755129817
driven_lanedir_consec_mean2.3391233626331447
driven_lanedir_consec_min1.5794516873267903
driven_lanedir_max3.038447755129817
driven_lanedir_mean2.3391233626331447
driven_lanedir_median2.3692970040379864
driven_lanedir_min1.5794516873267903
get_duckie_state_max3.081162770589193e-06
get_duckie_state_mean2.692721772670013e-06
get_duckie_state_median2.769231796264648e-06
get_duckie_state_min2.151260727561564e-06
get_robot_state_max0.015784361362457276
get_robot_state_mean0.014526428589439975
get_robot_state_median0.015081531206766764
get_robot_state_min0.012158290581769107
get_state_dump_max0.013447140057881671
get_state_dump_mean0.01305752037490751
get_state_dump_median0.013270610968271892
get_state_dump_min0.012241719505204585
get_ui_image_max0.03636293331782023
get_ui_image_mean0.03479079355292605
get_ui_image_median0.0347582487265269
get_ui_image_min0.03328374344083021
in-drivable-lane_max6.700000000000095
in-drivable-lane_mean3.475000000000043
in-drivable-lane_min1.100000000000014
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.988302780513282, "get_ui_image": 0.035567517280578616, "step_physics": 0.08327116966247558, "survival_time": 14.950000000000076, "driven_lanedir": 2.728383153668296, "get_state_dump": 0.01331392526626587, "sim_render-ego": 0.006251177787780762, "get_robot_state": 0.015784361362457276, "get_duckie_state": 3.081162770589193e-06, "in-drivable-lane": 2.500000000000026, "agent_compute-ego": 0.017619316577911378, "deviation-heading": 1.8451606866993304, "complete-iteration": 0.20621379693349204, "set_robot_commands": 0.004891979694366455, "deviation-center-line": 0.9780682419452956, "driven_lanedir_consec": 2.728383153668296, "sim_compute_sim_state": 0.025189801851908365, "sim_compute_performance-ego": 0.004171295166015625}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.264442031696942, "get_ui_image": 0.03636293331782023, "step_physics": 0.08232842763264973, "survival_time": 14.950000000000076, "driven_lanedir": 3.038447755129817, "get_state_dump": 0.013447140057881671, "sim_render-ego": 0.006147809028625488, "get_robot_state": 0.015698961416880288, "get_duckie_state": 2.9357274373372394e-06, "in-drivable-lane": 1.100000000000014, "agent_compute-ego": 0.01741407871246338, "deviation-heading": 3.3430168851788133, "complete-iteration": 0.20476512749989828, "set_robot_commands": 0.004941908518473307, "deviation-center-line": 0.6644283382989771, "driven_lanedir_consec": 3.038447755129817, "sim_compute_sim_state": 0.02414004643758138, "sim_compute_performance-ego": 0.004125423431396484}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.3732372064889646, "get_ui_image": 0.03394898017247518, "step_physics": 0.07764254570007324, "survival_time": 14.950000000000076, "driven_lanedir": 1.5794516873267903, "get_state_dump": 0.013227296670277914, "sim_render-ego": 0.005611859162648519, "get_robot_state": 0.01446410099665324, "get_duckie_state": 2.602736155192057e-06, "in-drivable-lane": 6.700000000000095, "agent_compute-ego": 0.017516506512959797, "deviation-heading": 1.6113562678720323, "complete-iteration": 0.19395962476730347, "set_robot_commands": 0.004700866540273031, "deviation-center-line": 0.4239060386985411, "driven_lanedir_consec": 1.5794516873267903, "sim_compute_sim_state": 0.02292409658432007, "sim_compute_performance-ego": 0.003780002593994141}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.5616475553151634, "get_ui_image": 0.03328374344083021, "step_physics": 0.07571511224667597, "survival_time": 10.85000000000002, "driven_lanedir": 2.0102108544076764, "get_state_dump": 0.012241719505204585, "sim_render-ego": 0.004989948140860703, "get_robot_state": 0.012158290581769107, "get_duckie_state": 2.151260727561564e-06, "in-drivable-lane": 3.600000000000037, "agent_compute-ego": 0.01758344162444365, "deviation-heading": 0.7708829441829406, "complete-iteration": 0.18823217686420213, "set_robot_commands": 0.004372192417971, "deviation-center-line": 0.25929977981520735, "driven_lanedir_consec": 2.0102108544076764, "sim_compute_sim_state": 0.02440958308734103, "sim_compute_performance-ego": 0.0033538154742684782}}
set_robot_commands_max0.004941908518473307
set_robot_commands_mean0.004726736792770948
set_robot_commands_median0.0047964231173197435
set_robot_commands_min0.004372192417971
sim_compute_performance-ego_max0.004171295166015625
sim_compute_performance-ego_mean0.003857634166418682
sim_compute_performance-ego_median0.003952713012695312
sim_compute_performance-ego_min0.0033538154742684782
sim_compute_sim_state_max0.025189801851908365
sim_compute_sim_state_mean0.024165881990287713
sim_compute_sim_state_median0.024274814762461204
sim_compute_sim_state_min0.02292409658432007
sim_render-ego_max0.006251177787780762
sim_render-ego_mean0.005750198529978868
sim_render-ego_median0.005879834095637004
sim_render-ego_min0.004989948140860703
simulation-passed1
step_physics_max0.08327116966247558
step_physics_mean0.07973931381046863
step_physics_median0.07998548666636149
step_physics_min0.07571511224667597
survival_time_max14.950000000000076
survival_time_mean13.925000000000065
survival_time_min10.85000000000002
No reset possible
4372811724Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.758076647429756
survival_time_median14.950000000000076
deviation-center-line_median0.8121590212103087
in-drivable-lane_median2.0750000000000264


other stats
agent_compute-ego_max0.017231300671895346
agent_compute-ego_mean0.017028073668479922
agent_compute-ego_median0.017039931615193685
agent_compute-ego_min0.016801130771636964
complete-iteration_max0.1942127792040507
complete-iteration_mean0.18451373934745788
complete-iteration_median0.18235267599423727
complete-iteration_min0.1791368261973063
deviation-center-line_max0.8394128785391222
deviation-center-line_mean0.7778334807611984
deviation-center-line_min0.6476030020850538
deviation-heading_max4.137452676320934
deviation-heading_mean3.0937687869876074
deviation-heading_median3.0095084575390567
deviation-heading_min2.218605556551383
driven_any_max3.773632559735389
driven_any_mean3.222658910727411
driven_any_median3.2313078927696286
driven_any_min2.6543872976349983
driven_lanedir_consec_max3.5815251675129223
driven_lanedir_consec_mean2.8308836273967497
driven_lanedir_consec_min2.225856047214564
driven_lanedir_max3.5815251675129223
driven_lanedir_mean2.8308836273967497
driven_lanedir_median2.758076647429756
driven_lanedir_min2.225856047214564
get_duckie_state_max2.315839131673177e-06
get_duckie_state_mean2.20795472462972e-06
get_duckie_state_median2.223650614420573e-06
get_duckie_state_min2.068678538004557e-06
get_robot_state_max0.012907435894012453
get_robot_state_mean0.012643311818440755
get_robot_state_median0.012574115594228108
get_robot_state_min0.012517580191294352
get_state_dump_max0.01362582842508952
get_state_dump_mean0.01284792681535085
get_state_dump_median0.012622288862864177
get_state_dump_min0.01252130111058553
get_ui_image_max0.03385833024978638
get_ui_image_mean0.03264274020989736
get_ui_image_median0.032536103328069055
get_ui_image_min0.03164042393366496
in-drivable-lane_max3.4000000000000012
in-drivable-lane_mean2.0750000000000135
in-drivable-lane_min0.75
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.129148890399876, "get_ui_image": 0.03217410643895467, "step_physics": 0.07024844805399577, "survival_time": 14.950000000000076, "driven_lanedir": 2.630851603117213, "get_state_dump": 0.01252130111058553, "sim_render-ego": 0.0053282229105631514, "get_robot_state": 0.012517580191294352, "get_duckie_state": 2.315839131673177e-06, "in-drivable-lane": 3.4000000000000012, "agent_compute-ego": 0.017231300671895346, "deviation-heading": 2.8811670303087253, "complete-iteration": 0.1803396185239156, "set_robot_commands": 0.004454967180887858, "deviation-center-line": 0.6476030020850538, "driven_lanedir_consec": 2.630851603117213, "sim_compute_sim_state": 0.022143141428629557, "sim_compute_performance-ego": 0.0035921152432759605}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.773632559735389, "get_ui_image": 0.03164042393366496, "step_physics": 0.06916410684585571, "survival_time": 14.950000000000076, "driven_lanedir": 3.5815251675129223, "get_state_dump": 0.01263236920038859, "sim_render-ego": 0.005312582651774088, "get_robot_state": 0.012907435894012453, "get_duckie_state": 2.2610028584798175e-06, "in-drivable-lane": 0.75, "agent_compute-ego": 0.016801130771636964, "deviation-heading": 2.218605556551383, "complete-iteration": 0.1791368261973063, "set_robot_commands": 0.0044210163752237954, "deviation-center-line": 0.8106101380463027, "driven_lanedir_consec": 3.5815251675129223, "sim_compute_sim_state": 0.022556310494740803, "sim_compute_performance-ego": 0.003571300506591797}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.6543872976349983, "get_ui_image": 0.03289810021718343, "step_physics": 0.07420313517252604, "survival_time": 14.950000000000076, "driven_lanedir": 2.225856047214564, "get_state_dump": 0.012612208525339764, "sim_render-ego": 0.005288034280141195, "get_robot_state": 0.0125912872950236, "get_duckie_state": 2.186298370361328e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.016909879048665366, "deviation-heading": 4.137452676320934, "complete-iteration": 0.18436573346455892, "set_robot_commands": 0.0044119421641031905, "deviation-center-line": 0.8394128785391222, "driven_lanedir_consec": 2.225856047214564, "sim_compute_sim_state": 0.02177928368250529, "sim_compute_performance-ego": 0.0035431631406148273}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.3334668951393813, "get_ui_image": 0.03385833024978638, "step_physics": 0.07867321014404297, "survival_time": 14.950000000000076, "driven_lanedir": 2.8853016917422996, "get_state_dump": 0.01362582842508952, "sim_render-ego": 0.005203192234039307, "get_robot_state": 0.012556943893432615, "get_duckie_state": 2.068678538004557e-06, "in-drivable-lane": 2.5000000000000293, "agent_compute-ego": 0.017169984181722005, "deviation-heading": 3.137849884769388, "complete-iteration": 0.1942127792040507, "set_robot_commands": 0.004348603089650472, "deviation-center-line": 0.8137079043743147, "driven_lanedir_consec": 2.8853016917422996, "sim_compute_sim_state": 0.02508308490117391, "sim_compute_performance-ego": 0.00356733242670695}}
set_robot_commands_max0.004454967180887858
set_robot_commands_mean0.00440913220246633
set_robot_commands_median0.004416479269663493
set_robot_commands_min0.004348603089650472
sim_compute_performance-ego_max0.0035921152432759605
sim_compute_performance-ego_mean0.003568477829297384
sim_compute_performance-ego_median0.0035693164666493736
sim_compute_performance-ego_min0.0035431631406148273
sim_compute_sim_state_max0.02508308490117391
sim_compute_sim_state_mean0.02289045512676239
sim_compute_sim_state_median0.02234972596168518
sim_compute_sim_state_min0.02177928368250529
sim_render-ego_max0.0053282229105631514
sim_render-ego_mean0.0052830080191294355
sim_render-ego_median0.0053003084659576415
sim_render-ego_min0.005203192234039307
simulation-passed1
step_physics_max0.07867321014404297
step_physics_mean0.07307222505410513
step_physics_median0.0722257916132609
step_physics_min0.06916410684585571
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4371211720Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8532785934582483
survival_time_median14.950000000000076
deviation-center-line_median0.47710230723229374
in-drivable-lane_median3.3500000000000174


other stats
agent_compute-ego_max0.017610241572062174
agent_compute-ego_mean0.01708062611244343
agent_compute-ego_median0.017001941248222633
agent_compute-ego_min0.016708380381266277
complete-iteration_max0.205970462958018
complete-iteration_mean0.19979009992546504
complete-iteration_median0.19977290789286295
complete-iteration_min0.1936441209581163
deviation-center-line_max0.7486020010759898
deviation-center-line_mean0.4653367886041917
deviation-center-line_min0.15854053887618932
deviation-heading_max3.431871929676689
deviation-heading_mean2.130089041914549
deviation-heading_median2.321362549020102
deviation-heading_min0.44575913994130345
driven_any_max3.3210565349547863
driven_any_mean2.7071034872561253
driven_any_median2.617600072264809
driven_any_min2.2721572695400973
driven_lanedir_consec_max3.19986165481932
driven_lanedir_consec_mean1.971105204291005
driven_lanedir_consec_min0.978001975428203
driven_lanedir_max3.19986165481932
driven_lanedir_mean1.971105204291005
driven_lanedir_median1.8532785934582483
driven_lanedir_min0.978001975428203
get_duckie_state_max3.625551859537761e-06
get_duckie_state_mean3.5311778386433923e-06
get_duckie_state_median3.552834192911784e-06
get_duckie_state_min3.3934911092122394e-06
get_robot_state_max0.015899755336620188
get_robot_state_mean0.015404217287346167
get_robot_state_median0.015453271865844729
get_robot_state_min0.014810570081075032
get_state_dump_max0.01376798152923584
get_state_dump_mean0.013536720386257878
get_state_dump_median0.013508351864638153
get_state_dump_min0.013362196286519369
get_ui_image_max0.036152620315551755
get_ui_image_mean0.0347407097728164
get_ui_image_median0.034586786429087316
get_ui_image_min0.033636645917539246
in-drivable-lane_max7.300000000000097
in-drivable-lane_mean3.500000000000033
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2721572695400973, "get_ui_image": 0.033636645917539246, "step_physics": 0.0742467791945846, "survival_time": 6.749999999999984, "driven_lanedir": 0.978001975428203, "get_state_dump": 0.013536560976946796, "sim_render-ego": 0.0060012358206289786, "get_robot_state": 0.015899755336620188, "get_duckie_state": 3.5603841145833334e-06, "in-drivable-lane": 3.399999999999988, "agent_compute-ego": 0.01716117152461299, "deviation-heading": 0.44575913994130345, "complete-iteration": 0.1936441209581163, "set_robot_commands": 0.0048806190490722655, "deviation-center-line": 0.15854053887618932, "driven_lanedir_consec": 0.978001975428203, "sim_compute_sim_state": 0.023922837222063984, "sim_compute_performance-ego": 0.004204366825245045}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.3210565349547863, "get_ui_image": 0.03451934019724528, "step_physics": 0.07782507260640462, "survival_time": 14.950000000000076, "driven_lanedir": 3.19986165481932, "get_state_dump": 0.013480142752329508, "sim_render-ego": 0.005986445744832356, "get_robot_state": 0.015451010862986246, "get_duckie_state": 3.545284271240234e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016708380381266277, "deviation-heading": 3.431871929676689, "complete-iteration": 0.196757648785909, "set_robot_commands": 0.004823590914408366, "deviation-center-line": 0.6605428785576116, "driven_lanedir_consec": 3.19986165481932, "sim_compute_sim_state": 0.02374724547068278, "sim_compute_performance-ego": 0.004060006141662598}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4623386308321544, "get_ui_image": 0.036152620315551755, "step_physics": 0.08460601488749186, "survival_time": 14.950000000000076, "driven_lanedir": 1.8999457403045177, "get_state_dump": 0.013362196286519369, "sim_render-ego": 0.006077428658803304, "get_robot_state": 0.015455532868703206, "get_duckie_state": 3.625551859537761e-06, "in-drivable-lane": 3.300000000000047, "agent_compute-ego": 0.017610241572062174, "deviation-heading": 3.1132280636210496, "complete-iteration": 0.205970462958018, "set_robot_commands": 0.005027272701263428, "deviation-center-line": 0.7486020010759898, "driven_lanedir_consec": 1.8999457403045177, "sim_compute_sim_state": 0.02342479149500529, "sim_compute_performance-ego": 0.0040962497393290205}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.772861513697464, "get_ui_image": 0.03465423266092936, "step_physics": 0.08078758001327514, "survival_time": 14.950000000000076, "driven_lanedir": 1.8066114466119791, "get_state_dump": 0.01376798152923584, "sim_render-ego": 0.005841891765594482, "get_robot_state": 0.014810570081075032, "get_duckie_state": 3.3934911092122394e-06, "in-drivable-lane": 7.300000000000097, "agent_compute-ego": 0.016842710971832275, "deviation-heading": 1.529497034419154, "complete-iteration": 0.2027881669998169, "set_robot_commands": 0.004600545565287272, "deviation-center-line": 0.2936617359069758, "driven_lanedir_consec": 1.8066114466119791, "sim_compute_sim_state": 0.027418282826741535, "sim_compute_performance-ego": 0.003911013603210449}}
set_robot_commands_max0.005027272701263428
set_robot_commands_mean0.004833007057507833
set_robot_commands_median0.004852104981740315
set_robot_commands_min0.004600545565287272
sim_compute_performance-ego_max0.004204366825245045
sim_compute_performance-ego_mean0.004067909077361778
sim_compute_performance-ego_median0.004078127940495809
sim_compute_performance-ego_min0.003911013603210449
sim_compute_sim_state_max0.027418282826741535
sim_compute_sim_state_mean0.0246282892536234
sim_compute_sim_state_median0.023835041346373383
sim_compute_sim_state_min0.02342479149500529
sim_render-ego_max0.006077428658803304
sim_render-ego_mean0.00597675049746478
sim_render-ego_median0.005993840782730667
sim_render-ego_min0.005841891765594482
simulation-passed1
step_physics_max0.08460601488749186
step_physics_mean0.07936636167543905
step_physics_median0.07930632630983989
step_physics_min0.0742467791945846
survival_time_max14.950000000000076
survival_time_mean12.900000000000052
survival_time_min6.749999999999984
No reset possible
4369711718Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9727748484505954
survival_time_median14.950000000000076
deviation-center-line_median1.0755197435981103
in-drivable-lane_median0.6000000000000041


other stats
agent_compute-ego_max0.017617129484812418
agent_compute-ego_mean0.017387785930787363
agent_compute-ego_median0.017413388093312582
agent_compute-ego_min0.01710723805171187
complete-iteration_max0.20201816161473593
complete-iteration_mean0.1990942750054021
complete-iteration_median0.19920233521410213
complete-iteration_min0.19595426797866825
deviation-center-line_max1.1257810264975845
deviation-center-line_mean0.9582424424130882
deviation-center-line_min0.5561492559585475
deviation-heading_max5.949478543787538
deviation-heading_mean4.674097098040662
deviation-heading_median5.340888605763484
deviation-heading_min2.0651326368481433
driven_any_max3.877011090686616
driven_any_mean3.5748662110154497
driven_any_median3.803706548126506
driven_any_min2.8150406571221716
driven_lanedir_consec_max3.288720329498327
driven_lanedir_consec_mean2.950298418368498
driven_lanedir_consec_min2.566923647074474
driven_lanedir_max3.288720329498327
driven_lanedir_mean2.950298418368498
driven_lanedir_median2.9727748484505954
driven_lanedir_min2.566923647074474
get_duckie_state_max4.067420959472656e-06
get_duckie_state_mean3.5832517890519993e-06
get_duckie_state_median3.4888585408528645e-06
get_duckie_state_min3.287869115029612e-06
get_robot_state_max0.015061067740122476
get_robot_state_mean0.014232172504548104
get_robot_state_median0.014270564317703249
get_robot_state_min0.013326493642663443
get_state_dump_max0.01358906348546346
get_state_dump_mean0.013382071795002106
get_state_dump_median0.013351990779240926
get_state_dump_min0.013235242136063117
get_ui_image_max0.034961958726247154
get_ui_image_mean0.03453179760645794
get_ui_image_median0.03446220517158508
get_ui_image_min0.034240821356414465
in-drivable-lane_max3.4000000000000066
in-drivable-lane_mean1.2250000000000048
in-drivable-lane_min0.30000000000000426
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.877011090686616, "get_ui_image": 0.034961958726247154, "step_physics": 0.08056236426035564, "survival_time": 14.950000000000076, "driven_lanedir": 3.288720329498327, "get_state_dump": 0.01358906348546346, "sim_render-ego": 0.006061256726582845, "get_robot_state": 0.015061067740122476, "get_duckie_state": 4.067420959472656e-06, "in-drivable-lane": 0.8500000000000032, "agent_compute-ego": 0.017617129484812418, "deviation-heading": 5.474293224292685, "complete-iteration": 0.20201816161473593, "set_robot_commands": 0.004916386604309082, "deviation-center-line": 1.1257810264975845, "driven_lanedir_consec": 3.288720329498327, "sim_compute_sim_state": 0.024968540668487547, "sim_compute_performance-ego": 0.004125601450602214}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.7380023446983457, "get_ui_image": 0.034395848910013835, "step_physics": 0.07872365315755209, "survival_time": 14.950000000000076, "driven_lanedir": 3.250557728606654, "get_state_dump": 0.013464364210764568, "sim_render-ego": 0.005868948300679524, "get_robot_state": 0.01485410213470459, "get_duckie_state": 3.631114959716797e-06, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.017475324471791585, "deviation-heading": 5.949478543787538, "complete-iteration": 0.19714092095692953, "set_robot_commands": 0.004669717947642009, "deviation-center-line": 1.1093053244333262, "driven_lanedir_consec": 3.250557728606654, "sim_compute_sim_state": 0.023625886440277095, "sim_compute_performance-ego": 0.0039105677604675294}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.869410751554666, "get_ui_image": 0.03452856143315633, "step_physics": 0.07936834653218587, "survival_time": 14.950000000000076, "driven_lanedir": 2.6949919682945365, "get_state_dump": 0.013239617347717286, "sim_render-ego": 0.005642463366190592, "get_robot_state": 0.013687026500701903, "get_duckie_state": 3.3466021219889324e-06, "in-drivable-lane": 3.4000000000000066, "agent_compute-ego": 0.017351451714833578, "deviation-heading": 5.2074839872342835, "complete-iteration": 0.19595426797866825, "set_robot_commands": 0.004509560267130534, "deviation-center-line": 1.0417341627628949, "driven_lanedir_consec": 2.6949919682945365, "sim_compute_sim_state": 0.023708780606587727, "sim_compute_performance-ego": 0.0037717286745707194}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8150406571221716, "get_ui_image": 0.034240821356414465, "step_physics": 0.08364359281396352, "survival_time": 9.299999999999995, "driven_lanedir": 2.566923647074474, "get_state_dump": 0.013235242136063117, "sim_render-ego": 0.005389305853074597, "get_robot_state": 0.013326493642663443, "get_duckie_state": 3.287869115029612e-06, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.01710723805171187, "deviation-heading": 2.0651326368481433, "complete-iteration": 0.20126374947127476, "set_robot_commands": 0.004509026004422096, "deviation-center-line": 0.5561492559585475, "driven_lanedir_consec": 2.566923647074474, "sim_compute_sim_state": 0.026045103226938555, "sim_compute_performance-ego": 0.003626147905985514}}
set_robot_commands_max0.004916386604309082
set_robot_commands_mean0.00465117270587593
set_robot_commands_median0.004589639107386271
set_robot_commands_min0.004509026004422096
sim_compute_performance-ego_max0.004125601450602214
sim_compute_performance-ego_mean0.0038585114479064942
sim_compute_performance-ego_median0.003841148217519124
sim_compute_performance-ego_min0.003626147905985514
sim_compute_sim_state_max0.026045103226938555
sim_compute_sim_state_mean0.02458707773557273
sim_compute_sim_state_median0.02433866063753764
sim_compute_sim_state_min0.023625886440277095
sim_render-ego_max0.006061256726582845
sim_render-ego_mean0.00574049356163189
sim_render-ego_median0.005755705833435059
sim_render-ego_min0.005389305853074597
simulation-passed1
step_physics_max0.08364359281396352
step_physics_mean0.08057448919101429
step_physics_median0.07996535539627075
step_physics_min0.07872365315755209
survival_time_max14.950000000000076
survival_time_mean13.537500000000058
survival_time_min9.299999999999995
No reset possible
4367611713Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.168296637308832
survival_time_median12.825000000000047
deviation-center-line_median0.7556510124522178
in-drivable-lane_median0.15000000000000213


other stats
agent_compute-ego_max0.017633453830257877
agent_compute-ego_mean0.017112960981586486
agent_compute-ego_median0.017090468826323653
agent_compute-ego_min0.016637452443440757
complete-iteration_max0.2082516976765224
complete-iteration_mean0.19503629312177845
complete-iteration_median0.1934305262565613
complete-iteration_min0.1850324222974688
deviation-center-line_max0.9541364622758374
deviation-center-line_mean0.6640814180769667
deviation-center-line_min0.19088718512759417
deviation-heading_max5.750891454979855
deviation-heading_mean3.6782078605432393
deviation-heading_median3.9842513678446094
deviation-heading_min0.993437251503884
driven_any_max3.190394448481184
driven_any_mean2.770156285418646
driven_any_median2.944565581333759
driven_any_min2.0010995305258836
driven_lanedir_consec_max2.9360794360429145
driven_lanedir_consec_mean2.1509575759786816
driven_lanedir_consec_min1.331157593254149
driven_lanedir_max2.9360794360429145
driven_lanedir_mean2.1509575759786816
driven_lanedir_median2.168296637308832
driven_lanedir_min1.331157593254149
get_duckie_state_max2.8073132693112553e-06
get_duckie_state_mean2.4968714010653864e-06
get_duckie_state_median2.4135907491048176e-06
get_duckie_state_min2.352990836740654e-06
get_robot_state_max0.015465131172767052
get_robot_state_mean0.014771912163634566
get_robot_state_median0.015046766599019368
get_robot_state_min0.013528984283732476
get_state_dump_max0.013329469240628757
get_state_dump_mean0.013159590221525469
get_state_dump_median0.013176064888636272
get_state_dump_min0.01295676186820057
get_ui_image_max0.034701556364695234
get_ui_image_mean0.033727673826440964
get_ui_image_median0.034010836872862375
get_ui_image_min0.03218746519534387
in-drivable-lane_max5.550000000000027
in-drivable-lane_mean1.462500000000008
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9595836451840443, "get_ui_image": 0.03218746519534387, "step_physics": 0.07127646419489495, "survival_time": 10.700000000000015, "driven_lanedir": 1.331157593254149, "get_state_dump": 0.01295676186820057, "sim_render-ego": 0.00555656112243082, "get_robot_state": 0.013528984283732476, "get_duckie_state": 2.352990836740654e-06, "in-drivable-lane": 5.550000000000027, "agent_compute-ego": 0.017111215635994884, "deviation-heading": 0.993437251503884, "complete-iteration": 0.1850324222974688, "set_robot_commands": 0.0045889259498810096, "deviation-center-line": 0.19088718512759417, "driven_lanedir_consec": 1.331157593254149, "sim_compute_sim_state": 0.023882461485461658, "sim_compute_performance-ego": 0.0037977027001782}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9295475174834738, "get_ui_image": 0.033501034577687584, "step_physics": 0.07345635096232096, "survival_time": 14.950000000000076, "driven_lanedir": 2.627516405718388, "get_state_dump": 0.013072245915730796, "sim_render-ego": 0.005725982983907064, "get_robot_state": 0.01475404183069865, "get_duckie_state": 2.353986104329427e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016637452443440757, "deviation-heading": 5.750891454979855, "complete-iteration": 0.18854576349258423, "set_robot_commands": 0.004609178702036539, "deviation-center-line": 0.9541364622758374, "driven_lanedir_consec": 2.627516405718388, "sim_compute_sim_state": 0.022846270402272544, "sim_compute_performance-ego": 0.003802258968353271}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.190394448481184, "get_ui_image": 0.034701556364695234, "step_physics": 0.07943313757578532, "survival_time": 14.950000000000076, "driven_lanedir": 2.9360794360429145, "get_state_dump": 0.013279883861541749, "sim_render-ego": 0.0058624672889709475, "get_robot_state": 0.015339491367340087, "get_duckie_state": 2.4731953938802083e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017069722016652425, "deviation-heading": 4.726660589654091, "complete-iteration": 0.19831528902053833, "set_robot_commands": 0.004659892717997233, "deviation-center-line": 0.9232284064032964, "driven_lanedir_consec": 2.9360794360429145, "sim_compute_sim_state": 0.02383745352427165, "sim_compute_performance-ego": 0.003986376126607259}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0010995305258836, "get_ui_image": 0.034520639168037166, "step_physics": 0.08561721476879748, "survival_time": 9.099999999999994, "driven_lanedir": 1.7090768688992757, "get_state_dump": 0.013329469240628757, "sim_render-ego": 0.0060233113529917955, "get_robot_state": 0.015465131172767052, "get_duckie_state": 2.8073132693112553e-06, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.017633453830257877, "deviation-heading": 3.2418421460351277, "complete-iteration": 0.2082516976765224, "set_robot_commands": 0.004889089982588212, "deviation-center-line": 0.588073618501139, "driven_lanedir_consec": 1.7090768688992757, "sim_compute_sim_state": 0.0266069579910446, "sim_compute_performance-ego": 0.004013691629682269}}
set_robot_commands_max0.004889089982588212
set_robot_commands_mean0.004686771838125749
set_robot_commands_median0.004634535710016886
set_robot_commands_min0.0045889259498810096
sim_compute_performance-ego_max0.004013691629682269
sim_compute_performance-ego_mean0.00390000735620525
sim_compute_performance-ego_median0.0038943175474802656
sim_compute_performance-ego_min0.0037977027001782
sim_compute_sim_state_max0.0266069579910446
sim_compute_sim_state_mean0.02429328585076261
sim_compute_sim_state_median0.02385995750486665
sim_compute_sim_state_min0.022846270402272544
sim_render-ego_max0.0060233113529917955
sim_render-ego_mean0.005792080687075156
sim_render-ego_median0.005794225136439006
sim_render-ego_min0.00555656112243082
simulation-passed1
step_physics_max0.08561721476879748
step_physics_mean0.07744579187544968
step_physics_median0.07644474426905315
step_physics_min0.07127646419489495
survival_time_max14.950000000000076
survival_time_mean12.425000000000042
survival_time_min9.099999999999994
No reset possible
4367111711Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.173929386419143
survival_time_median14.950000000000076
deviation-center-line_median0.7481987051236045
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.017988081773122153
agent_compute-ego_mean0.017567905584971108
agent_compute-ego_median0.017477500438690185
agent_compute-ego_min0.017328539689381917
complete-iteration_max0.18414929787317913
complete-iteration_mean0.1781516075134277
complete-iteration_median0.1781616262594859
complete-iteration_min0.17213387966156005
deviation-center-line_max0.9488157550291396
deviation-center-line_mean0.7735044287326643
deviation-center-line_min0.6488045496543086
deviation-heading_max3.292582906004158
deviation-heading_mean2.7172387595101655
deviation-heading_median2.8065441171576557
deviation-heading_min1.9632838977211915
driven_any_max3.618917964526742
driven_any_mean3.121033617565079
driven_any_median3.2633184960872748
driven_any_min2.3385795135590235
driven_lanedir_consec_max3.5663086011569503
driven_lanedir_consec_mean2.9488960687856887
driven_lanedir_consec_min1.8814169011475184
driven_lanedir_max3.5663086011569503
driven_lanedir_mean2.9488960687856887
driven_lanedir_median3.173929386419143
driven_lanedir_min1.8814169011475184
get_duckie_state_max2.9174486796061197e-06
get_duckie_state_mean2.793272336324056e-06
get_duckie_state_median2.760092417399089e-06
get_duckie_state_min2.735455830891927e-06
get_robot_state_max0.011597771644592286
get_robot_state_mean0.01148250182469686
get_robot_state_median0.011500202814737955
get_robot_state_min0.011331830024719238
get_state_dump_max0.0120644211769104
get_state_dump_mean0.011939756274223327
get_state_dump_median0.0120308248202006
get_state_dump_min0.011632954279581706
get_ui_image_max0.03320561091105143
get_ui_image_mean0.03233259797096252
get_ui_image_median0.03247799078623454
get_ui_image_min0.03116879940032959
in-drivable-lane_max3.3500000000000476
in-drivable-lane_mean0.8375000000000119
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.1917845440189665, "get_ui_image": 0.03116879940032959, "step_physics": 0.06641958634058634, "survival_time": 14.950000000000076, "driven_lanedir": 3.100724163095234, "get_state_dump": 0.011632954279581706, "sim_render-ego": 0.005067226886749268, "get_robot_state": 0.011331830024719238, "get_duckie_state": 2.9174486796061197e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01736211856206258, "deviation-heading": 2.7551023544516524, "complete-iteration": 0.17213387966156005, "set_robot_commands": 0.004476469357808431, "deviation-center-line": 0.6488045496543086, "driven_lanedir_consec": 3.100724163095234, "sim_compute_sim_state": 0.02112126111984253, "sim_compute_performance-ego": 0.0034261210759480793}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.334852448155583, "get_ui_image": 0.03201565504074097, "step_physics": 0.0665159797668457, "survival_time": 14.950000000000076, "driven_lanedir": 3.2471346097430533, "get_state_dump": 0.0120644211769104, "sim_render-ego": 0.004997849464416504, "get_robot_state": 0.01144974152247111, "get_duckie_state": 2.735455830891927e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01759288231531779, "deviation-heading": 2.8579858798636595, "complete-iteration": 0.17338990767796833, "set_robot_commands": 0.00449711799621582, "deviation-center-line": 0.6594351009625814, "driven_lanedir_consec": 3.2471346097430533, "sim_compute_sim_state": 0.020760534604390465, "sim_compute_performance-ego": 0.003370611667633057}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.3385795135590235, "get_ui_image": 0.03320561091105143, "step_physics": 0.0738224204381307, "survival_time": 14.950000000000076, "driven_lanedir": 1.8814169011475184, "get_state_dump": 0.012051505247751872, "sim_render-ego": 0.0051527969042460126, "get_robot_state": 0.011597771644592286, "get_duckie_state": 2.7449925740559897e-06, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.017988081773122153, "deviation-heading": 3.292582906004158, "complete-iteration": 0.18293334484100343, "set_robot_commands": 0.004485332171122233, "deviation-center-line": 0.9488157550291396, "driven_lanedir_consec": 1.8814169011475184, "sim_compute_sim_state": 0.02102864424387614, "sim_compute_performance-ego": 0.0034706219037373863}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.618917964526742, "get_ui_image": 0.03294032653172811, "step_physics": 0.07279560009638468, "survival_time": 14.950000000000076, "driven_lanedir": 3.5663086011569503, "get_state_dump": 0.012010144392649332, "sim_render-ego": 0.005024934609731038, "get_robot_state": 0.0115506641070048, "get_duckie_state": 2.7751922607421876e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017328539689381917, "deviation-heading": 1.9632838977211915, "complete-iteration": 0.18414929787317913, "set_robot_commands": 0.004520549774169922, "deviation-center-line": 0.8369623092846278, "driven_lanedir_consec": 3.5663086011569503, "sim_compute_sim_state": 0.024432419141133623, "sim_compute_performance-ego": 0.0034182055791219077}}
set_robot_commands_max0.004520549774169922
set_robot_commands_mean0.004494867324829102
set_robot_commands_median0.004491225083669026
set_robot_commands_min0.004476469357808431
sim_compute_performance-ego_max0.0034706219037373863
sim_compute_performance-ego_mean0.003421390056610107
sim_compute_performance-ego_median0.0034221633275349937
sim_compute_performance-ego_min0.003370611667633057
sim_compute_sim_state_max0.024432419141133623
sim_compute_sim_state_mean0.02183571477731069
sim_compute_sim_state_median0.021074952681859337
sim_compute_sim_state_min0.020760534604390465
sim_render-ego_max0.0051527969042460126
sim_render-ego_mean0.005060701966285706
sim_render-ego_median0.0050460807482401535
sim_render-ego_min0.004997849464416504
simulation-passed1
step_physics_max0.0738224204381307
step_physics_mean0.06988839666048685
step_physics_median0.0696557899316152
step_physics_min0.06641958634058634
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4365911708Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0253273579839908
survival_time_median14.950000000000076
deviation-center-line_median0.6484968280219672
in-drivable-lane_median5.150000000000055


other stats
agent_compute-ego_max0.017626276016235353
agent_compute-ego_mean0.017233703335126242
agent_compute-ego_median0.017211461464564006
agent_compute-ego_min0.0168856143951416
complete-iteration_max0.19136158466339112
complete-iteration_mean0.18443828145662944
complete-iteration_median0.18441954851150513
complete-iteration_min0.17755244414011637
deviation-center-line_max0.9756315801024033
deviation-center-line_mean0.6277606634738719
deviation-center-line_min0.23841741774915007
deviation-heading_max4.033426607555657
deviation-heading_mean2.372804010671432
deviation-heading_median2.0623149314482077
deviation-heading_min1.3331595722336569
driven_any_max3.879690839081782
driven_any_mean3.876378810121331
driven_any_median3.8794267039229258
driven_any_min3.866970993557691
driven_lanedir_consec_max3.1233797315915317
driven_lanedir_consec_mean2.0191904378182537
driven_lanedir_consec_min0.9027273037135016
driven_lanedir_max3.1233797315915317
driven_lanedir_mean2.17110049860754
driven_lanedir_median2.3291474795625633
driven_lanedir_min0.9027273037135016
get_duckie_state_max2.175172170003255e-06
get_duckie_state_mean2.15450922648112e-06
get_duckie_state_median2.158482869466146e-06
get_duckie_state_min2.125898996988932e-06
get_robot_state_max0.013120867411295574
get_robot_state_mean0.012652162710825605
get_robot_state_median0.012854874928792318
get_robot_state_min0.0117780335744222
get_state_dump_max0.01301688273747762
get_state_dump_mean0.012614961663881938
get_state_dump_median0.012618468205134074
get_state_dump_min0.012206027507781984
get_ui_image_max0.03336353222529093
get_ui_image_mean0.03259122947851816
get_ui_image_median0.03250833352406819
get_ui_image_min0.031984718640645345
in-drivable-lane_max10.800000000000068
in-drivable-lane_mean5.825000000000053
in-drivable-lane_min2.2000000000000313
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.866970993557691, "get_ui_image": 0.031984718640645345, "step_physics": 0.06912282546361287, "survival_time": 14.950000000000076, "driven_lanedir": 1.692667675451189, "get_state_dump": 0.012206027507781984, "sim_render-ego": 0.005050630569458008, "get_robot_state": 0.0117780335744222, "get_duckie_state": 2.125898996988932e-06, "in-drivable-lane": 8.000000000000078, "agent_compute-ego": 0.017626276016235353, "deviation-heading": 1.3331595722336569, "complete-iteration": 0.17755244414011637, "set_robot_commands": 0.004485575358072916, "deviation-center-line": 0.5343333700353724, "driven_lanedir_consec": 1.692667675451189, "sim_compute_sim_state": 0.02179592132568359, "sim_compute_performance-ego": 0.0033702452977498374}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879631042940015, "get_ui_image": 0.03216048955917358, "step_physics": 0.06846304257710775, "survival_time": 14.950000000000076, "driven_lanedir": 3.1233797315915317, "get_state_dump": 0.012584490776062012, "sim_render-ego": 0.005203309853871663, "get_robot_state": 0.013012761274973552, "get_duckie_state": 2.15450922648112e-06, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.0168856143951416, "deviation-heading": 2.775894875518176, "complete-iteration": 0.17855176448822022, "set_robot_commands": 0.00432331641515096, "deviation-center-line": 0.762660286008562, "driven_lanedir_consec": 3.1233797315915317, "sim_compute_sim_state": 0.02226035992304484, "sim_compute_performance-ego": 0.003518783251444498}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.879222364905836, "get_ui_image": 0.03336353222529093, "step_physics": 0.077763778368632, "survival_time": 14.950000000000076, "driven_lanedir": 0.9027273037135016, "get_state_dump": 0.01301688273747762, "sim_render-ego": 0.005367582639058431, "get_robot_state": 0.013120867411295574, "get_duckie_state": 2.175172170003255e-06, "in-drivable-lane": 10.800000000000068, "agent_compute-ego": 0.017532236576080322, "deviation-heading": 1.3487349873782395, "complete-iteration": 0.19136158466339112, "set_robot_commands": 0.004426605701446533, "deviation-center-line": 0.23841741774915007, "driven_lanedir_consec": 0.9027273037135016, "sim_compute_sim_state": 0.023043301900227863, "sim_compute_performance-ego": 0.003589482307434082}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.879690839081782, "get_ui_image": 0.03285617748896281, "step_physics": 0.07679939270019531, "survival_time": 14.950000000000076, "driven_lanedir": 2.965627283673938, "get_state_dump": 0.012652445634206136, "sim_render-ego": 0.005181935628255209, "get_robot_state": 0.012696988582611084, "get_duckie_state": 2.162456512451172e-06, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.01689068635304769, "deviation-heading": 4.033426607555657, "complete-iteration": 0.19028733253479005, "set_robot_commands": 0.004373168150583903, "deviation-center-line": 0.9756315801024033, "driven_lanedir_consec": 2.357987040516793, "sim_compute_sim_state": 0.025142268339792887, "sim_compute_performance-ego": 0.003557279904683431}}
set_robot_commands_max0.004485575358072916
set_robot_commands_mean0.004402166406313578
set_robot_commands_median0.004399886926015218
set_robot_commands_min0.00432331641515096
sim_compute_performance-ego_max0.003589482307434082
sim_compute_performance-ego_mean0.003508947690327962
sim_compute_performance-ego_median0.003538031578063965
sim_compute_performance-ego_min0.0033702452977498374
sim_compute_sim_state_max0.025142268339792887
sim_compute_sim_state_mean0.023060462872187295
sim_compute_sim_state_median0.02265183091163635
sim_compute_sim_state_min0.02179592132568359
sim_render-ego_max0.005367582639058431
sim_render-ego_mean0.005200864672660828
sim_render-ego_median0.0051926227410634355
sim_render-ego_min0.005050630569458008
simulation-passed1
step_physics_max0.077763778368632
step_physics_mean0.07303725977738698
step_physics_median0.07296110908190409
step_physics_min0.06846304257710775
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4364711704brian wongtemplate-randomaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6440373265804349
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.017348116841809504
agent_compute-ego_mean0.016243976533453868
agent_compute-ego_median0.01602076705865567
agent_compute-ego_min0.01558625517469464
complete-iteration_max0.186699906984965
complete-iteration_mean0.17410428121479224
complete-iteration_median0.17102424973576769
complete-iteration_min0.1676687184026686
deviation-center-line_max0.15583868303837567
deviation-center-line_mean0.10879855071843549
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876925
driven_any_mean1.8510551780477624
driven_any_median1.998666635086524
driven_any_min0.5174263274303096
driven_lanedir_consec_max0.8904446665936326
driven_lanedir_consec_mean0.6302364342579737
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936326
driven_lanedir_mean0.6302364342579737
driven_lanedir_median0.6440373265804349
driven_lanedir_min0.3424264172773923
get_duckie_state_max1.988168490135064e-06
get_duckie_state_mean1.8892970759524904e-06
get_duckie_state_median1.894955738598664e-06
get_duckie_state_min1.7791083364775686e-06
get_robot_state_max0.011140626488309918
get_robot_state_mean0.011014400614819937
get_robot_state_median0.011037108468620268
get_robot_state_min0.01084275903372929
get_state_dump_max0.011977820560849946
get_state_dump_mean0.011876581918003514
get_state_dump_median0.011870002766650936
get_state_dump_min0.01178850157786224
get_ui_image_max0.03331288063164913
get_ui_image_mean0.031643376503984494
get_ui_image_median0.03129066684600773
get_ui_image_min0.03067929169227337
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.1619321797959306, "get_ui_image": 0.031170040874157923, "step_physics": 0.0650716474500753, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.01178850157786224, "sim_render-ego": 0.00504043142674333, "get_robot_state": 0.011069225052655752, "get_duckie_state": 1.988168490135064e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.01568610789412159, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.1676687184026686, "set_robot_commands": 0.004379878609867419, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.019934149111731577, "sim_compute_performance-ego": 0.003399436756715936}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303096, "get_ui_image": 0.03067929169227337, "step_physics": 0.06706246014299064, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.011977820560849946, "sim_render-ego": 0.005216228550878064, "get_robot_state": 0.01084275903372929, "get_duckie_state": 1.932012623754041e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.017348116841809504, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.17248755487902412, "set_robot_commands": 0.004933669649321458, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.02060996252914955, "sim_compute_performance-ego": 0.003679431717971276}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8354010903771174, "get_ui_image": 0.03141129281785753, "step_physics": 0.0658039304945204, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921884, "get_state_dump": 0.011861831170541268, "sim_render-ego": 0.004953666969581887, "get_robot_state": 0.01100499188458478, "get_duckie_state": 1.857898853443287e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.016355426223189744, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.16956094459251125, "set_robot_commands": 0.004576750154848452, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921884, "sim_compute_sim_state": 0.02009311252170139, "sim_compute_performance-ego": 0.003371425911232277}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876925, "get_ui_image": 0.03331288063164913, "step_physics": 0.0779861392396869, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936326, "get_state_dump": 0.0118781743627606, "sim_render-ego": 0.004981646032044382, "get_robot_state": 0.011140626488309918, "get_duckie_state": 1.7791083364775686e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.01558625517469464, "deviation-heading": 0.976837469261332, "complete-iteration": 0.186699906984965, "set_robot_commands": 0.0045611316507512874, "deviation-center-line": 0.15583868303837567, "driven_lanedir_consec": 0.8904446665936326, "sim_compute_sim_state": 0.02373261162728974, "sim_compute_performance-ego": 0.003389459667783795}}
set_robot_commands_max0.004933669649321458
set_robot_commands_mean0.004612857516197154
set_robot_commands_median0.00456894090279987
set_robot_commands_min0.004379878609867419
sim_compute_performance-ego_max0.003679431717971276
sim_compute_performance-ego_mean0.003459938513425821
sim_compute_performance-ego_median0.0033944482122498657
sim_compute_performance-ego_min0.003371425911232277
sim_compute_sim_state_max0.02373261162728974
sim_compute_sim_state_mean0.021092458947468064
sim_compute_sim_state_median0.02035153752542547
sim_compute_sim_state_min0.019934149111731577
sim_render-ego_max0.005216228550878064
sim_render-ego_mean0.005047993244811916
sim_render-ego_median0.005011038729393856
sim_render-ego_min0.004953666969581887
simulation-passed1
step_physics_max0.0779861392396869
step_physics_mean0.0689810443318183
step_physics_median0.06643319531875552
step_physics_min0.0650716474500753
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible
4362611696Bhavya Patwa 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5298247379021468
survival_time_median14.950000000000076
deviation-center-line_median0.4062301657240397
in-drivable-lane_median0.1750000000000025


other stats
agent_compute-ego_max0.01777752161026001
agent_compute-ego_mean0.017446378668149312
agent_compute-ego_median0.017424538930257163
agent_compute-ego_min0.017158915201822916
complete-iteration_max0.2000421404838562
complete-iteration_mean0.19502263883749643
complete-iteration_median0.19567461133003233
complete-iteration_min0.18869919220606485
deviation-center-line_max0.6052878903259662
deviation-center-line_mean0.4070703957291509
deviation-center-line_min0.21053336114255777
deviation-heading_max3.100615319074989
deviation-heading_mean1.987769139054009
deviation-heading_median1.816242049432144
deviation-heading_min1.2179771382767608
driven_any_max1.809525398649799
driven_any_mean1.7105797239025082
driven_any_median1.7092349869165773
driven_any_min1.614323523127079
driven_lanedir_consec_max1.8005039083123884
driven_lanedir_consec_mean1.3884542054856044
driven_lanedir_consec_min0.6936634378257358
driven_lanedir_max1.8005039083123884
driven_lanedir_mean1.4428645246681224
driven_lanedir_median1.6386453762671829
driven_lanedir_min0.6936634378257358
get_duckie_state_max2.712408701578776e-06
get_duckie_state_mean2.569953600565593e-06
get_duckie_state_median2.532402674357096e-06
get_duckie_state_min2.502600351969401e-06
get_robot_state_max0.015193368593851724
get_robot_state_mean0.014406869014104208
get_robot_state_median0.014288185437520345
get_robot_state_min0.013857736587524414
get_state_dump_max0.01386914332707723
get_state_dump_mean0.01367862025896708
get_state_dump_median0.01365695039431254
get_state_dump_min0.013531436920166015
get_ui_image_max0.03436237891515096
get_ui_image_mean0.0340301235516866
get_ui_image_median0.03407313426335652
get_ui_image_min0.03361184676488241
in-drivable-lane_max7.900000000000057
in-drivable-lane_mean2.0625000000000155
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.66629821527389, "get_ui_image": 0.03401659250259399, "step_physics": 0.07742810010910034, "survival_time": 14.950000000000076, "driven_lanedir": 1.5387691516873585, "get_state_dump": 0.01386914332707723, "sim_render-ego": 0.005881640911102295, "get_robot_state": 0.014348142941792806, "get_duckie_state": 2.5343894958496096e-06, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.01750446875890096, "deviation-heading": 3.100615319074989, "complete-iteration": 0.1953183023134867, "set_robot_commands": 0.004636986255645752, "deviation-center-line": 0.5019917742640613, "driven_lanedir_consec": 1.3211278749572868, "sim_compute_sim_state": 0.023428482214609785, "sim_compute_performance-ego": 0.00405164082845052}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.809525398649799, "get_ui_image": 0.03361184676488241, "step_physics": 0.07238755702972412, "survival_time": 14.950000000000076, "driven_lanedir": 1.8005039083123884, "get_state_dump": 0.013713236649831135, "sim_render-ego": 0.005811429023742676, "get_robot_state": 0.014228227933247885, "get_duckie_state": 2.712408701578776e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01777752161026001, "deviation-heading": 1.2179771382767608, "complete-iteration": 0.18869919220606485, "set_robot_commands": 0.00462926705678304, "deviation-center-line": 0.21053336114255777, "driven_lanedir_consec": 1.8005039083123884, "sim_compute_sim_state": 0.02245175282160441, "sim_compute_performance-ego": 0.0039351129531860355}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.614323523127079, "get_ui_image": 0.03412967602411906, "step_physics": 0.0785535470644633, "survival_time": 14.950000000000076, "driven_lanedir": 0.6936634378257358, "get_state_dump": 0.013600664138793944, "sim_render-ego": 0.005851794878641764, "get_robot_state": 0.015193368593851724, "get_duckie_state": 2.5304158528645833e-06, "in-drivable-lane": 7.900000000000057, "agent_compute-ego": 0.017344609101613364, "deviation-heading": 2.0964100352348285, "complete-iteration": 0.19603092034657796, "set_robot_commands": 0.004670636653900146, "deviation-center-line": 0.6052878903259662, "driven_lanedir_consec": 0.6936634378257358, "sim_compute_sim_state": 0.022640225887298585, "sim_compute_performance-ego": 0.003899475733439127}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.7521717585592644, "get_ui_image": 0.03436237891515096, "step_physics": 0.08133869330088297, "survival_time": 14.950000000000076, "driven_lanedir": 1.7385216008470068, "get_state_dump": 0.013531436920166015, "sim_render-ego": 0.005668683052062988, "get_robot_state": 0.013857736587524414, "get_duckie_state": 2.502600351969401e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017158915201822916, "deviation-heading": 1.5360740636294596, "complete-iteration": 0.2000421404838562, "set_robot_commands": 0.004506678581237793, "deviation-center-line": 0.31046855718401817, "driven_lanedir_consec": 1.7385216008470068, "sim_compute_sim_state": 0.025641501744588215, "sim_compute_performance-ego": 0.003823826313018799}}
set_robot_commands_max0.004670636653900146
set_robot_commands_mean0.004610892136891683
set_robot_commands_median0.004633126656214397
set_robot_commands_min0.004506678581237793
sim_compute_performance-ego_max0.00405164082845052
sim_compute_performance-ego_mean0.003927513957023621
sim_compute_performance-ego_median0.0039172943433125815
sim_compute_performance-ego_min0.003823826313018799
sim_compute_sim_state_max0.025641501744588215
sim_compute_sim_state_mean0.023540490667025245
sim_compute_sim_state_median0.023034354050954185
sim_compute_sim_state_min0.02245175282160441
sim_render-ego_max0.005881640911102295
sim_render-ego_mean0.005803386966387431
sim_render-ego_median0.00583161195119222
sim_render-ego_min0.005668683052062988
simulation-passed1
step_physics_max0.08133869330088297
step_physics_mean0.07742697437604268
step_physics_median0.07799082358678182
step_physics_min0.07238755702972412
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4359811695Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.6026178743303063
survival_time_median14.950000000000076
deviation-center-line_median0.731635327399543
in-drivable-lane_median2.7000000000000313


other stats
agent_compute-ego_max0.01796379566192627
agent_compute-ego_mean0.017751580476760863
agent_compute-ego_median0.01774916688601176
agent_compute-ego_min0.01754419247309367
complete-iteration_max0.21230069637298585
complete-iteration_mean0.20520023941993715
complete-iteration_median0.2039284837245941
complete-iteration_min0.20064329385757448
deviation-center-line_max1.0931545500009334
deviation-center-line_mean0.792871920684993
deviation-center-line_min0.6150624779399523
deviation-heading_max3.9630256261729264
deviation-heading_mean3.1526182029407495
deviation-heading_median3.249508966507214
deviation-heading_min2.148429252575644
driven_any_max4.716978599572853
driven_any_mean4.28139282610019
driven_any_median4.307067219933242
driven_any_min3.794458264961425
driven_lanedir_consec_max4.319758138934372
driven_lanedir_consec_mean3.471198750467691
driven_lanedir_consec_min2.359801114275778
driven_lanedir_max4.319758138934372
driven_lanedir_mean3.5193731165352915
driven_lanedir_median3.6026178743303063
driven_lanedir_min2.5524985785461816
get_duckie_state_max2.570947011311849e-06
get_duckie_state_mean2.447168032328288e-06
get_duckie_state_median2.419153849283854e-06
get_duckie_state_min2.379417419433594e-06
get_robot_state_max0.015755763053894044
get_robot_state_mean0.015427499413490297
get_robot_state_median0.015535823901494343
get_robot_state_min0.01488258679707845
get_state_dump_max0.014071939786275228
get_state_dump_mean0.013792052070299784
get_state_dump_median0.013771969477335612
get_state_dump_min0.013552329540252685
get_ui_image_max0.03655035734176636
get_ui_image_mean0.03568999310334524
get_ui_image_median0.035569490989049275
get_ui_image_min0.03507063309351603
in-drivable-lane_max6.000000000000041
in-drivable-lane_mean2.9250000000000256
in-drivable-lane_min0.29999999999999893
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.622940486696056, "get_ui_image": 0.03550774176915487, "step_physics": 0.07989347616831462, "survival_time": 14.950000000000076, "driven_lanedir": 4.304062474569406, "get_state_dump": 0.013763524691263835, "sim_render-ego": 0.00607857624689738, "get_robot_state": 0.015652984778086344, "get_duckie_state": 2.570947011311849e-06, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01796379566192627, "deviation-heading": 3.4411982015034024, "complete-iteration": 0.2034112763404846, "set_robot_commands": 0.004894367059071859, "deviation-center-line": 1.0931545500009334, "driven_lanedir_consec": 4.304062474569406, "sim_compute_sim_state": 0.025386850039164223, "sim_compute_performance-ego": 0.004117721716562907}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.716978599572853, "get_ui_image": 0.03507063309351603, "step_physics": 0.07882803440093994, "survival_time": 14.950000000000076, "driven_lanedir": 4.319758138934372, "get_state_dump": 0.014071939786275228, "sim_render-ego": 0.006053754488627116, "get_robot_state": 0.01488258679707845, "get_duckie_state": 2.444585164388021e-06, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.017827865282694498, "deviation-heading": 3.057819731511026, "complete-iteration": 0.20064329385757448, "set_robot_commands": 0.004819486141204834, "deviation-center-line": 0.7786205134381592, "driven_lanedir_consec": 4.319758138934372, "sim_compute_sim_state": 0.02481961965560913, "sim_compute_performance-ego": 0.004112735589345296}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.991193953170429, "get_ui_image": 0.03563124020894368, "step_physics": 0.08116992473602296, "survival_time": 14.950000000000076, "driven_lanedir": 2.901173274091206, "get_state_dump": 0.01378041426340739, "sim_render-ego": 0.006154167652130127, "get_robot_state": 0.015418663024902343, "get_duckie_state": 2.379417419433594e-06, "in-drivable-lane": 4.100000000000044, "agent_compute-ego": 0.01767046848932902, "deviation-heading": 2.148429252575644, "complete-iteration": 0.2044456911087036, "set_robot_commands": 0.004872213999430338, "deviation-center-line": 0.6846501413609267, "driven_lanedir_consec": 2.901173274091206, "sim_compute_sim_state": 0.02544518868128459, "sim_compute_performance-ego": 0.00414636770884196}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.794458264961425, "get_ui_image": 0.03655035734176636, "step_physics": 0.0858389965693156, "survival_time": 14.950000000000076, "driven_lanedir": 2.5524985785461816, "get_state_dump": 0.013552329540252685, "sim_render-ego": 0.0060997406641642255, "get_robot_state": 0.015755763053894044, "get_duckie_state": 2.3937225341796873e-06, "in-drivable-lane": 6.000000000000041, "agent_compute-ego": 0.01754419247309367, "deviation-heading": 3.9630256261729264, "complete-iteration": 0.21230069637298585, "set_robot_commands": 0.004957836469014485, "deviation-center-line": 0.6150624779399523, "driven_lanedir_consec": 2.359801114275778, "sim_compute_sim_state": 0.027792296409606933, "sim_compute_performance-ego": 0.004056983788808186}}
set_robot_commands_max0.004957836469014485
set_robot_commands_mean0.004885975917180379
set_robot_commands_median0.004883290529251098
set_robot_commands_min0.004819486141204834
sim_compute_performance-ego_max0.00414636770884196
sim_compute_performance-ego_mean0.0041084522008895865
sim_compute_performance-ego_median0.004115228652954101
sim_compute_performance-ego_min0.004056983788808186
sim_compute_sim_state_max0.027792296409606933
sim_compute_sim_state_mean0.025860988696416214
sim_compute_sim_state_median0.025416019360224407
sim_compute_sim_state_min0.02481961965560913
sim_render-ego_max0.006154167652130127
sim_render-ego_mean0.006096559762954712
sim_render-ego_median0.006089158455530803
sim_render-ego_min0.006053754488627116
simulation-passed1
step_physics_max0.0858389965693156
step_physics_mean0.08143260796864828
step_physics_median0.08053170045216879
step_physics_min0.07882803440093994
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4358411694Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8737807505955624
survival_time_median14.950000000000076
deviation-center-line_median0.3241091481512245
in-drivable-lane_median4.950000000000053


other stats
agent_compute-ego_max0.017537429332733154
agent_compute-ego_mean0.017032901303282062
agent_compute-ego_median0.016917046023032425
agent_compute-ego_min0.016760083834330242
complete-iteration_max0.20827105901773693
complete-iteration_mean0.1964793792916733
complete-iteration_median0.19684709866841635
complete-iteration_min0.1839522608121236
deviation-center-line_max0.6206081616706144
deviation-center-line_mean0.3670071185922031
deviation-center-line_min0.19920201639574903
deviation-heading_max2.6329819036121207
deviation-heading_mean1.492783519353279
deviation-heading_median1.2988083977057523
deviation-heading_min0.740535378389491
driven_any_max3.879717550739172
driven_any_mean3.5677579156385546
driven_any_median3.8731122132492386
driven_any_min2.6450896853165684
driven_lanedir_consec_max3.569695565526248
driven_lanedir_consec_mean2.0805645526658827
driven_lanedir_consec_min1.0050011439461586
driven_lanedir_max3.569695565526248
driven_lanedir_mean2.0805645526658827
driven_lanedir_median1.8737807505955624
driven_lanedir_min1.0050011439461586
get_duckie_state_max2.693204046453087e-06
get_duckie_state_mean2.587404837500316e-06
get_duckie_state_median2.592007319132487e-06
get_duckie_state_min2.472400665283203e-06
get_robot_state_max0.015593644777933756
get_robot_state_mean0.014712751910910251
get_robot_state_median0.014819394361625595
get_robot_state_min0.013618574142456055
get_state_dump_max0.013752742878441672
get_state_dump_mean0.013549694685102668
get_state_dump_median0.013538742462793988
get_state_dump_min0.013368550936381025
get_ui_image_max0.03504406132744354
get_ui_image_mean0.03395978966962944
get_ui_image_median0.03387145598729452
get_ui_image_min0.03305218537648519
in-drivable-lane_max10.70000000000007
in-drivable-lane_mean5.350000000000043
in-drivable-lane_min0.7999999999999972
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.866964368580368, "get_ui_image": 0.033276167710622154, "step_physics": 0.07255375226338705, "survival_time": 14.950000000000076, "driven_lanedir": 1.5830295076707432, "get_state_dump": 0.013479294776916504, "sim_render-ego": 0.005797996520996094, "get_robot_state": 0.015464963912963868, "get_duckie_state": 2.472400665283203e-06, "in-drivable-lane": 8.250000000000082, "agent_compute-ego": 0.016760083834330242, "deviation-heading": 1.493918382200944, "complete-iteration": 0.18915858666102092, "set_robot_commands": 0.004788841406504313, "deviation-center-line": 0.2987003281328179, "driven_lanedir_consec": 1.5830295076707432, "sim_compute_sim_state": 0.02300367514292399, "sim_compute_performance-ego": 0.0038918439547220864}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879717550739172, "get_ui_image": 0.03305218537648519, "step_physics": 0.07052158276240031, "survival_time": 14.950000000000076, "driven_lanedir": 3.569695565526248, "get_state_dump": 0.013368550936381025, "sim_render-ego": 0.005569007396697998, "get_robot_state": 0.013618574142456055, "get_duckie_state": 2.525647481282552e-06, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.016777978738149006, "deviation-heading": 2.6329819036121207, "complete-iteration": 0.1839522608121236, "set_robot_commands": 0.004481518268585205, "deviation-center-line": 0.6206081616706144, "driven_lanedir_consec": 3.569695565526248, "sim_compute_sim_state": 0.022638119061787924, "sim_compute_performance-ego": 0.003780292669932047}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.87926005791811, "get_ui_image": 0.03446674426396688, "step_physics": 0.08406266848246256, "survival_time": 14.950000000000076, "driven_lanedir": 1.0050011439461586, "get_state_dump": 0.013598190148671469, "sim_render-ego": 0.006024197737375895, "get_robot_state": 0.015593644777933756, "get_duckie_state": 2.658367156982422e-06, "in-drivable-lane": 10.70000000000007, "agent_compute-ego": 0.017537429332733154, "deviation-heading": 0.740535378389491, "complete-iteration": 0.20453561067581175, "set_robot_commands": 0.004843566417694092, "deviation-center-line": 0.34951796816963104, "driven_lanedir_consec": 1.0050011439461586, "sim_compute_sim_state": 0.02423377911249797, "sim_compute_performance-ego": 0.004021688302357992}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6450896853165684, "get_ui_image": 0.03504406132744354, "step_physics": 0.08689839863082738, "survival_time": 10.300000000000011, "driven_lanedir": 2.164531993520381, "get_state_dump": 0.013752742878441672, "sim_render-ego": 0.005883393935786868, "get_robot_state": 0.014173824810287328, "get_duckie_state": 2.693204046453087e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.017056113307915843, "deviation-heading": 1.1036984132105605, "complete-iteration": 0.20827105901773693, "set_robot_commands": 0.004571594080878693, "deviation-center-line": 0.19920201639574903, "driven_lanedir_consec": 2.164531993520381, "sim_compute_sim_state": 0.026772764122601853, "sim_compute_performance-ego": 0.003965565301839588}}
set_robot_commands_max0.004843566417694092
set_robot_commands_mean0.004671380043415576
set_robot_commands_median0.004680217743691503
set_robot_commands_min0.004481518268585205
sim_compute_performance-ego_max0.004021688302357992
sim_compute_performance-ego_mean0.0039148475572129285
sim_compute_performance-ego_median0.003928704628280837
sim_compute_performance-ego_min0.003780292669932047
sim_compute_sim_state_max0.026772764122601853
sim_compute_sim_state_mean0.024162084359952932
sim_compute_sim_state_median0.02361872712771098
sim_compute_sim_state_min0.022638119061787924
sim_render-ego_max0.006024197737375895
sim_render-ego_mean0.005818648897714214
sim_render-ego_median0.005840695228391481
sim_render-ego_min0.005569007396697998
simulation-passed1
step_physics_max0.08689839863082738
step_physics_mean0.07850910053476932
step_physics_median0.0783082103729248
step_physics_min0.07052158276240031
survival_time_max14.950000000000076
survival_time_mean13.787500000000062
survival_time_min10.300000000000011
No reset possible
4357311691Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.62463323803069
survival_time_median13.600000000000058
deviation-center-line_median0.4366545284067841
in-drivable-lane_median3.900000000000018


other stats
agent_compute-ego_max0.017897291978200277
agent_compute-ego_mean0.017599039630380304
agent_compute-ego_median0.017621118730428265
agent_compute-ego_min0.017256629082464402
complete-iteration_max0.2105550718307495
complete-iteration_mean0.200622400703832
complete-iteration_median0.2018631764090791
complete-iteration_min0.18820817816642024
deviation-center-line_max0.5732879037020242
deviation-center-line_mean0.39153204790406226
deviation-center-line_min0.11953123110065668
deviation-heading_max2.609067550498674
deviation-heading_mean1.9383195476372732
deviation-heading_median2.2875429113109433
deviation-heading_min0.569124817428533
driven_any_max5.8096223649775975
driven_any_mean4.651160706860493
driven_any_median5.242330985913933
driven_any_min2.31035849063651
driven_lanedir_consec_max3.6720311907708942
driven_lanedir_consec_mean2.535722273843883
driven_lanedir_consec_min1.221591428543257
driven_lanedir_max3.6720311907708942
driven_lanedir_mean2.535722273843883
driven_lanedir_median2.62463323803069
driven_lanedir_min1.221591428543257
get_duckie_state_max2.4805263597138076e-06
get_duckie_state_mean2.438387301555715e-06
get_duckie_state_median2.4372659703736664e-06
get_duckie_state_min2.398490905761719e-06
get_robot_state_max0.015978785355885823
get_robot_state_mean0.015503797629095626
get_robot_state_median0.01556387362026033
get_robot_state_min0.01490865791997602
get_state_dump_max0.013847729365030923
get_state_dump_mean0.013711786869719597
get_state_dump_median0.01378141382113606
get_state_dump_min0.013436590471575338
get_ui_image_max0.03512751658757528
get_ui_image_mean0.034371560552885635
get_ui_image_median0.03471712424641564
get_ui_image_min0.032924477131136005
in-drivable-lane_max9.600000000000035
in-drivable-lane_mean4.90000000000002
in-drivable-lane_min2.2000000000000055
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.31035849063651, "get_ui_image": 0.032924477131136005, "step_physics": 0.07217208608504265, "survival_time": 6.199999999999986, "driven_lanedir": 1.221591428543257, "get_state_dump": 0.013436590471575338, "sim_render-ego": 0.005770604456624677, "get_robot_state": 0.01490865791997602, "get_duckie_state": 2.44186770531439e-06, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.017256629082464402, "deviation-heading": 0.569124817428533, "complete-iteration": 0.18820817816642024, "set_robot_commands": 0.004816885917417465, "deviation-center-line": 0.11953123110065668, "driven_lanedir_consec": 1.221591428543257, "sim_compute_sim_state": 0.022957394199986613, "sim_compute_performance-ego": 0.003817598665914228}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.723441184925485, "get_ui_image": 0.03463309832981654, "step_physics": 0.07682049906983668, "survival_time": 12.25000000000004, "driven_lanedir": 3.6720311907708942, "get_state_dump": 0.013787995552530094, "sim_render-ego": 0.0061378002166748045, "get_robot_state": 0.015615694863455636, "get_duckie_state": 2.4805263597138076e-06, "in-drivable-lane": 2.2000000000000055, "agent_compute-ego": 0.017622584712748624, "deviation-heading": 2.555923646212105, "complete-iteration": 0.19827354586854273, "set_robot_commands": 0.004803121333219567, "deviation-center-line": 0.49078946315659094, "driven_lanedir_consec": 3.6720311907708942, "sim_compute_sim_state": 0.02467495665258291, "sim_compute_performance-ego": 0.00402514496628119}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.761220786902381, "get_ui_image": 0.03480115016301473, "step_physics": 0.08336204687754313, "survival_time": 14.950000000000076, "driven_lanedir": 1.718822729580839, "get_state_dump": 0.013774832089742024, "sim_render-ego": 0.006073996225992839, "get_robot_state": 0.015512052377065023, "get_duckie_state": 2.4326642354329427e-06, "in-drivable-lane": 9.600000000000035, "agent_compute-ego": 0.017897291978200277, "deviation-heading": 2.019162176409781, "complete-iteration": 0.20545280694961549, "set_robot_commands": 0.004731613000233968, "deviation-center-line": 0.3825195936569772, "driven_lanedir_consec": 1.718822729580839, "sim_compute_sim_state": 0.025036659240722656, "sim_compute_performance-ego": 0.004108347098032633}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.8096223649775975, "get_ui_image": 0.03512751658757528, "step_physics": 0.08412769158681234, "survival_time": 14.950000000000076, "driven_lanedir": 3.5304437464805414, "get_state_dump": 0.013847729365030923, "sim_render-ego": 0.006086289087931315, "get_robot_state": 0.015978785355885823, "get_duckie_state": 2.398490905761719e-06, "in-drivable-lane": 5.2000000000000455, "agent_compute-ego": 0.01761965274810791, "deviation-heading": 2.609067550498674, "complete-iteration": 0.2105550718307495, "set_robot_commands": 0.004838844935099284, "deviation-center-line": 0.5732879037020242, "driven_lanedir_consec": 3.5304437464805414, "sim_compute_sim_state": 0.028666234016418456, "sim_compute_performance-ego": 0.0041093643506368}}
set_robot_commands_max0.004838844935099284
set_robot_commands_mean0.004797616296492571
set_robot_commands_median0.004810003625318516
set_robot_commands_min0.004731613000233968
sim_compute_performance-ego_max0.0041093643506368
sim_compute_performance-ego_mean0.004015113770216213
sim_compute_performance-ego_median0.004066746032156912
sim_compute_performance-ego_min0.003817598665914228
sim_compute_sim_state_max0.028666234016418456
sim_compute_sim_state_mean0.025333811027427655
sim_compute_sim_state_median0.024855807946652785
sim_compute_sim_state_min0.022957394199986613
sim_render-ego_max0.0061378002166748045
sim_render-ego_mean0.006017172496805908
sim_render-ego_median0.006080142656962077
sim_render-ego_min0.005770604456624677
simulation-passed1
step_physics_max0.08412769158681234
step_physics_mean0.0791205809048087
step_physics_median0.0800912729736899
step_physics_min0.07217208608504265
survival_time_max14.950000000000076
survival_time_mean12.087500000000045
survival_time_min6.199999999999986
No reset possible
4355011690Bhavya Patwa 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0027312896276945
survival_time_median14.950000000000076
deviation-center-line_median0.5297180673248933
in-drivable-lane_median4.225000000000037


other stats
agent_compute-ego_max0.017565743923187258
agent_compute-ego_mean0.01732180138429006
agent_compute-ego_median0.017466216882069903
agent_compute-ego_min0.01678902784983317
complete-iteration_max0.21360992829004924
complete-iteration_mean0.20018518110116323
complete-iteration_median0.19683287421862283
complete-iteration_min0.193465047677358
deviation-center-line_max0.663063142290931
deviation-center-line_mean0.48530761490139773
deviation-center-line_min0.21873118266487335
deviation-heading_max4.496772144935024
deviation-heading_mean3.1458830150541113
deviation-heading_median3.2474555689113433
deviation-heading_min1.5918487774587344
driven_any_max3.062968257188301
driven_any_mean3.060395961426821
driven_any_median3.062790968495172
driven_any_min3.0530336515286387
driven_lanedir_consec_max2.034792834432573
driven_lanedir_consec_mean1.8550415302247352
driven_lanedir_consec_min1.3799107072109793
driven_lanedir_max2.700226059619778
driven_lanedir_mean2.021399836521536
driven_lanedir_median2.0027312896276945
driven_lanedir_min1.3799107072109793
get_duckie_state_max2.6488304138183592e-06
get_duckie_state_mean2.544323603312174e-06
get_duckie_state_median2.5308132171630856e-06
get_duckie_state_min2.4668375651041665e-06
get_robot_state_max0.016190419991811117
get_robot_state_mean0.015213889280954997
get_robot_state_median0.014974471728006998
get_robot_state_min0.014716193675994874
get_state_dump_max0.01385491689046224
get_state_dump_mean0.01364624043305715
get_state_dump_median0.013646195729573568
get_state_dump_min0.013437653382619222
get_ui_image_max0.035496529738108316
get_ui_image_mean0.03461256682872772
get_ui_image_median0.03461465994517009
get_ui_image_min0.0337244176864624
in-drivable-lane_max7.650000000000095
in-drivable-lane_mean4.187500000000044
in-drivable-lane_min0.6500000000000092
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0530336515286387, "get_ui_image": 0.0337244176864624, "step_physics": 0.07597207228342692, "survival_time": 14.950000000000076, "driven_lanedir": 1.3799107072109793, "get_state_dump": 0.01354591449101766, "sim_render-ego": 0.005815981229146321, "get_robot_state": 0.01493750015894572, "get_duckie_state": 2.591609954833984e-06, "in-drivable-lane": 7.650000000000095, "agent_compute-ego": 0.017389992078145344, "deviation-heading": 1.5918487774587344, "complete-iteration": 0.193465047677358, "set_robot_commands": 0.004593946933746338, "deviation-center-line": 0.21873118266487335, "driven_lanedir_consec": 1.3799107072109793, "sim_compute_sim_state": 0.02346718708674113, "sim_compute_performance-ego": 0.003873424530029297}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.062822019485201, "get_ui_image": 0.03424122095108032, "step_physics": 0.07721859852472941, "survival_time": 14.950000000000076, "driven_lanedir": 2.700226059619778, "get_state_dump": 0.013437653382619222, "sim_render-ego": 0.005844157536824544, "get_robot_state": 0.015011443297068276, "get_duckie_state": 2.4700164794921874e-06, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.01678902784983317, "deviation-heading": 4.496772144935024, "complete-iteration": 0.19385984579722088, "set_robot_commands": 0.004661648273468017, "deviation-center-line": 0.5203163581779569, "driven_lanedir_consec": 2.034792834432573, "sim_compute_sim_state": 0.022653899987538657, "sim_compute_performance-ego": 0.003857425053914388}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.062759917505143, "get_ui_image": 0.034988098939259846, "step_physics": 0.08006540934244792, "survival_time": 14.950000000000076, "driven_lanedir": 1.9709091378050303, "get_state_dump": 0.01385491689046224, "sim_render-ego": 0.005905183951059977, "get_robot_state": 0.014716193675994874, "get_duckie_state": 2.4668375651041665e-06, "in-drivable-lane": 4.100000000000011, "agent_compute-ego": 0.017565743923187258, "deviation-heading": 3.912718776679585, "complete-iteration": 0.1998059026400248, "set_robot_commands": 0.004670781294504801, "deviation-center-line": 0.663063142290931, "driven_lanedir_consec": 1.9709091378050303, "sim_compute_sim_state": 0.02395794153213501, "sim_compute_performance-ego": 0.003927876154581705}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.062968257188301, "get_ui_image": 0.035496529738108316, "step_physics": 0.08763046105702718, "survival_time": 14.950000000000076, "driven_lanedir": 2.0345534414503588, "get_state_dump": 0.013746476968129476, "sim_render-ego": 0.006218225161234538, "get_robot_state": 0.016190419991811117, "get_duckie_state": 2.6488304138183592e-06, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.017542441685994465, "deviation-heading": 2.5821923611431017, "complete-iteration": 0.21360992829004924, "set_robot_commands": 0.00503972053527832, "deviation-center-line": 0.5391197764718297, "driven_lanedir_consec": 2.0345534414503588, "sim_compute_sim_state": 0.027357618014017746, "sim_compute_performance-ego": 0.004228585561116536}}
set_robot_commands_max0.00503972053527832
set_robot_commands_mean0.004741524259249369
set_robot_commands_median0.004666214783986409
set_robot_commands_min0.004593946933746338
sim_compute_performance-ego_max0.004228585561116536
sim_compute_performance-ego_mean0.003971827824910482
sim_compute_performance-ego_median0.003900650342305501
sim_compute_performance-ego_min0.003857425053914388
sim_compute_sim_state_max0.027357618014017746
sim_compute_sim_state_mean0.024359161655108135
sim_compute_sim_state_median0.02371256430943807
sim_compute_sim_state_min0.022653899987538657
sim_render-ego_max0.006218225161234538
sim_render-ego_mean0.005945886969566345
sim_render-ego_median0.0058746707439422605
sim_render-ego_min0.005815981229146321
simulation-passed1
step_physics_max0.08763046105702718
step_physics_mean0.08022163530190787
step_physics_median0.07864200393358867
step_physics_min0.07597207228342692
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4352711688Bhavya Patwa 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7683903938188776
survival_time_median14.950000000000076
deviation-center-line_median0.33749707048124494
in-drivable-lane_median0.6250000000000089


other stats
agent_compute-ego_max0.01765714168548584
agent_compute-ego_mean0.017288692196210223
agent_compute-ego_median0.01733621835708618
agent_compute-ego_min0.0168251903851827
complete-iteration_max0.21479018529256183
complete-iteration_mean0.20067502220471703
complete-iteration_median0.2014071583747864
complete-iteration_min0.1850955867767334
deviation-center-line_max0.5872014548147845
deviation-center-line_mean0.36570833335443126
deviation-center-line_min0.2006377376404506
deviation-heading_max4.126255777101052
deviation-heading_mean2.710271817620085
deviation-heading_median2.8644849868882085
deviation-heading_min0.9858615196028698
driven_any_max1.939914969233345
driven_any_mean1.938212558730937
driven_any_median1.939681454173052
driven_any_min1.933572357344298
driven_lanedir_consec_max1.8717961590361705
driven_lanedir_consec_mean1.460368163095245
driven_lanedir_consec_min0.4328957057070546
driven_lanedir_max1.8717961590361705
driven_lanedir_mean1.460368163095245
driven_lanedir_median1.7683903938188776
driven_lanedir_min0.4328957057070546
get_duckie_state_max3.841718037923177e-06
get_duckie_state_mean3.610054651896158e-06
get_duckie_state_median3.639459609985352e-06
get_duckie_state_min3.3195813496907553e-06
get_robot_state_max0.016191030343373616
get_robot_state_mean0.015663814942042033
get_robot_state_median0.015548127094904584
get_robot_state_min0.015367975234985351
get_state_dump_max0.013794885476430258
get_state_dump_mean0.013571001489957171
get_state_dump_median0.013687525192896524
get_state_dump_min0.013114070097605388
get_ui_image_max0.03634608586629232
get_ui_image_mean0.03501110096772512
get_ui_image_median0.03555512348810832
get_ui_image_min0.03258807102839152
in-drivable-lane_max11.050000000000082
in-drivable-lane_mean3.075000000000025
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933572357344298, "get_ui_image": 0.03258807102839152, "step_physics": 0.07024594783782959, "survival_time": 14.950000000000076, "driven_lanedir": 1.6922035868837817, "get_state_dump": 0.013114070097605388, "sim_render-ego": 0.0057574033737182615, "get_robot_state": 0.015367975234985351, "get_duckie_state": 3.3195813496907553e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.0168251903851827, "deviation-heading": 2.76654250442104, "complete-iteration": 0.1850955867767334, "set_robot_commands": 0.004820294380187988, "deviation-center-line": 0.5872014548147845, "driven_lanedir_consec": 1.6922035868837817, "sim_compute_sim_state": 0.02245958169301351, "sim_compute_performance-ego": 0.003776900768280029}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.939914969233345, "get_ui_image": 0.035443610350290936, "step_physics": 0.07876705249150594, "survival_time": 14.950000000000076, "driven_lanedir": 1.8717961590361705, "get_state_dump": 0.013794885476430258, "sim_render-ego": 0.006132171948750814, "get_robot_state": 0.015716315905253093, "get_duckie_state": 3.659725189208984e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01720246156056722, "deviation-heading": 2.9624274693553776, "complete-iteration": 0.19974722464879355, "set_robot_commands": 0.004998428026835124, "deviation-center-line": 0.24055717070136615, "driven_lanedir_consec": 1.8717961590361705, "sim_compute_sim_state": 0.023356165091196698, "sim_compute_performance-ego": 0.004178187052408854}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9395222159739665, "get_ui_image": 0.0356666366259257, "step_physics": 0.08179431041081746, "survival_time": 14.950000000000076, "driven_lanedir": 0.4328957057070546, "get_state_dump": 0.013742429415384928, "sim_render-ego": 0.006053748925526937, "get_robot_state": 0.01537993828455607, "get_duckie_state": 3.6191940307617183e-06, "in-drivable-lane": 11.050000000000082, "agent_compute-ego": 0.01765714168548584, "deviation-heading": 0.9858615196028698, "complete-iteration": 0.2030670921007792, "set_robot_commands": 0.004768636226654053, "deviation-center-line": 0.2006377376404506, "driven_lanedir_consec": 0.4328957057070546, "sim_compute_sim_state": 0.023836028575897217, "sim_compute_performance-ego": 0.0040143394470214845}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939840692372137, "get_ui_image": 0.03634608586629232, "step_physics": 0.08774159669876098, "survival_time": 14.950000000000076, "driven_lanedir": 1.8445772007539736, "get_state_dump": 0.013632620970408122, "sim_render-ego": 0.006190768082936605, "get_robot_state": 0.016191030343373616, "get_duckie_state": 3.841718037923177e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017469975153605145, "deviation-heading": 4.126255777101052, "complete-iteration": 0.21479018529256183, "set_robot_commands": 0.004962348937988281, "deviation-center-line": 0.43443697026112377, "driven_lanedir_consec": 1.8445772007539736, "sim_compute_sim_state": 0.02791544993718465, "sim_compute_performance-ego": 0.0041777626673380535}}
set_robot_commands_max0.004998428026835124
set_robot_commands_mean0.004887426892916361
set_robot_commands_median0.0048913216590881345
set_robot_commands_min0.004768636226654053
sim_compute_performance-ego_max0.004178187052408854
sim_compute_performance-ego_mean0.004036797483762105
sim_compute_performance-ego_median0.0040960510571797695
sim_compute_performance-ego_min0.003776900768280029
sim_compute_sim_state_max0.02791544993718465
sim_compute_sim_state_mean0.024391806324323025
sim_compute_sim_state_median0.02359609683354696
sim_compute_sim_state_min0.02245958169301351
sim_render-ego_max0.006190768082936605
sim_render-ego_mean0.006033523082733154
sim_render-ego_median0.006092960437138875
sim_render-ego_min0.0057574033737182615
simulation-passed1
step_physics_max0.08774159669876098
step_physics_mean0.07963722685972849
step_physics_median0.0802806814511617
step_physics_min0.07024594783782959
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4348711681Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.519885539013841
survival_time_median14.950000000000076
deviation-center-line_median0.6488923300887333
in-drivable-lane_median0.20000000000000284


other stats
agent_compute-ego_max0.017556350231170654
agent_compute-ego_mean0.017045394579569495
agent_compute-ego_median0.017010362545649207
agent_compute-ego_min0.016604502995808918
complete-iteration_max0.20235961357752483
complete-iteration_mean0.1914600376288096
complete-iteration_median0.18824410120646157
complete-iteration_min0.18699233452479044
deviation-center-line_max0.7433503221331875
deviation-center-line_mean0.5955891950233606
deviation-center-line_min0.3412217977827884
deviation-heading_max4.799909108392621
deviation-heading_mean2.944365943099721
deviation-heading_median2.5173540566774877
deviation-heading_min1.9428465506512873
driven_any_max3.2529694928089308
driven_any_mean2.712417500647185
driven_any_median2.823443278341574
driven_any_min1.94981395309666
driven_lanedir_consec_max3.200596452345866
driven_lanedir_consec_mean2.5079524051806685
driven_lanedir_consec_min1.7914420903491255
driven_lanedir_max3.200596452345866
driven_lanedir_mean2.5079524051806685
driven_lanedir_median2.519885539013841
driven_lanedir_min1.7914420903491255
get_duckie_state_max3.482500712076823e-06
get_duckie_state_mean3.3797820409138997e-06
get_duckie_state_median3.364880879720052e-06
get_duckie_state_min3.3068656921386717e-06
get_robot_state_max0.01537324825922648
get_robot_state_mean0.014630635182062784
get_robot_state_median0.014835673967997232
get_robot_state_min0.013477944533030192
get_state_dump_max0.013840858141581218
get_state_dump_mean0.013473148544629415
get_state_dump_median0.013404039144515992
get_state_dump_min0.01324365774790446
get_ui_image_max0.03397308349609375
get_ui_image_mean0.03333544810612997
get_ui_image_median0.033371359904607135
get_ui_image_min0.032625989119211836
in-drivable-lane_max4.700000000000067
in-drivable-lane_mean1.275000000000018
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.907402768984634, "get_ui_image": 0.032625989119211836, "step_physics": 0.07135725657145182, "survival_time": 14.950000000000076, "driven_lanedir": 2.854556861954702, "get_state_dump": 0.013413433233896892, "sim_render-ego": 0.005719304879506429, "get_robot_state": 0.01537324825922648, "get_duckie_state": 3.482500712076823e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016604502995808918, "deviation-heading": 2.592267541793124, "complete-iteration": 0.18699233452479044, "set_robot_commands": 0.004811155001322428, "deviation-center-line": 0.691162337484587, "driven_lanedir_consec": 2.854556861954702, "sim_compute_sim_state": 0.02304342985153198, "sim_compute_performance-ego": 0.003898468812306722}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2529694928089308, "get_ui_image": 0.03298062483469645, "step_physics": 0.07145966132481893, "survival_time": 14.950000000000076, "driven_lanedir": 3.200596452345866, "get_state_dump": 0.013394645055135093, "sim_render-ego": 0.005775839487711589, "get_robot_state": 0.015345555146535236, "get_duckie_state": 3.3068656921386717e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0169354510307312, "deviation-heading": 2.4424405715618516, "complete-iteration": 0.1870599365234375, "set_robot_commands": 0.0048727329572041825, "deviation-center-line": 0.6066223226928796, "driven_lanedir_consec": 3.200596452345866, "sim_compute_sim_state": 0.02226893663406372, "sim_compute_performance-ego": 0.003875653743743897}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.94981395309666, "get_ui_image": 0.03376209497451782, "step_physics": 0.07425705750783285, "survival_time": 14.950000000000076, "driven_lanedir": 1.7914420903491255, "get_state_dump": 0.01324365774790446, "sim_render-ego": 0.005753177801767985, "get_robot_state": 0.01432579278945923, "get_duckie_state": 3.422101338704427e-06, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.01708527406056722, "deviation-heading": 4.799909108392621, "complete-iteration": 0.1894282658894857, "set_robot_commands": 0.004570028781890869, "deviation-center-line": 0.7433503221331875, "driven_lanedir_consec": 1.7914420903491255, "sim_compute_sim_state": 0.022428656419118245, "sim_compute_performance-ego": 0.00385271946589152}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7394837876985143, "get_ui_image": 0.03397308349609375, "step_physics": 0.08344149589538574, "survival_time": 14.950000000000076, "driven_lanedir": 2.18521421607298, "get_state_dump": 0.013840858141581218, "sim_render-ego": 0.005657468636830648, "get_robot_state": 0.013477944533030192, "get_duckie_state": 3.307660420735677e-06, "in-drivable-lane": 4.700000000000067, "agent_compute-ego": 0.017556350231170654, "deviation-heading": 1.9428465506512873, "complete-iteration": 0.20235961357752483, "set_robot_commands": 0.004538493951161703, "deviation-center-line": 0.3412217977827884, "driven_lanedir_consec": 2.18521421607298, "sim_compute_sim_state": 0.02588731129964193, "sim_compute_performance-ego": 0.003832398255666097}}
set_robot_commands_max0.0048727329572041825
set_robot_commands_mean0.0046981026728947954
set_robot_commands_median0.004690591891606649
set_robot_commands_min0.004538493951161703
sim_compute_performance-ego_max0.003898468812306722
sim_compute_performance-ego_mean0.003864810069402059
sim_compute_performance-ego_median0.003864186604817709
sim_compute_performance-ego_min0.003832398255666097
sim_compute_sim_state_max0.02588731129964193
sim_compute_sim_state_mean0.023407083551088968
sim_compute_sim_state_median0.022736043135325113
sim_compute_sim_state_min0.02226893663406372
sim_render-ego_max0.005775839487711589
sim_render-ego_mean0.005726447701454163
sim_render-ego_median0.005736241340637207
sim_render-ego_min0.005657468636830648
simulation-passed1
step_physics_max0.08344149589538574
step_physics_mean0.07512886782487234
step_physics_median0.07285835941632589
step_physics_min0.07135725657145182
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4346411677Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simhost-errornomont04-85f844e025a2-10:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4344911673Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.733382531506982
survival_time_median13.375000000000057
deviation-center-line_median0.4368391395065956
in-drivable-lane_median6.475000000000058


other stats
agent_compute-ego_max0.017821029081182965
agent_compute-ego_mean0.01769354479980903
agent_compute-ego_median0.017682455700963832
agent_compute-ego_min0.017588238716125488
complete-iteration_max0.20510595632811723
complete-iteration_mean0.1996158198713701
complete-iteration_median0.1994384996829295
complete-iteration_min0.1944803237915039
deviation-center-line_max0.7742040419718731
deviation-center-line_mean0.45846381946629866
deviation-center-line_min0.18597295688013035
deviation-heading_max2.312635278139677
deviation-heading_mean1.867852834588881
deviation-heading_median2.02080435119871
deviation-heading_min1.1171673578184276
driven_any_max5.805658907516371
driven_any_mean5.017485307819887
driven_any_median5.165034226620079
driven_any_min3.9342138705230183
driven_lanedir_consec_max3.423066999918042
driven_lanedir_consec_mean2.4760848874457553
driven_lanedir_consec_min1.0145074868510149
driven_lanedir_max3.423066999918042
driven_lanedir_mean2.4765129018713816
driven_lanedir_median2.7342385603582353
driven_lanedir_min1.0145074868510149
get_duckie_state_max2.7313973139790656e-06
get_duckie_state_mean2.657083128229798e-06
get_duckie_state_median2.659417815127615e-06
get_duckie_state_min2.5780995686848957e-06
get_robot_state_max0.015410068681684591
get_robot_state_mean0.014867876111875865
get_robot_state_median0.015055750959513642
get_robot_state_min0.013949933846791586
get_state_dump_max0.013627622922261556
get_state_dump_mean0.013509673048645516
get_state_dump_median0.013496935226149476
get_state_dump_min0.013417198820021544
get_ui_image_max0.03464644339125035
get_ui_image_mean0.03426554787803694
get_ui_image_median0.0342873392907547
get_ui_image_min0.03384106953938802
in-drivable-lane_max8.50000000000003
in-drivable-lane_mean5.9625000000000385
in-drivable-lane_min2.4000000000000092
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.9342138705230183, "get_ui_image": 0.03434542544837137, "step_physics": 0.0780009853029714, "survival_time": 10.300000000000011, "driven_lanedir": 2.824694392834763, "get_state_dump": 0.013417198820021544, "sim_render-ego": 0.005960357999338687, "get_robot_state": 0.014820022490418071, "get_duckie_state": 2.7313973139790656e-06, "in-drivable-lane": 2.4000000000000092, "agent_compute-ego": 0.017754546646932955, "deviation-heading": 1.946193078198466, "complete-iteration": 0.19775420600928148, "set_robot_commands": 0.004712736722335075, "deviation-center-line": 0.4211689308449649, "driven_lanedir_consec": 2.824694392834763, "sim_compute_sim_state": 0.02455166821340913, "sim_compute_performance-ego": 0.0040292635704707175}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.805658907516371, "get_ui_image": 0.03384106953938802, "step_physics": 0.0749049703280131, "survival_time": 14.950000000000076, "driven_lanedir": 3.423066999918042, "get_state_dump": 0.013463025093078613, "sim_render-ego": 0.006016386349995931, "get_robot_state": 0.015291479428609213, "get_duckie_state": 2.701282501220703e-06, "in-drivable-lane": 5.550000000000043, "agent_compute-ego": 0.01761036475499471, "deviation-heading": 2.312635278139677, "complete-iteration": 0.1944803237915039, "set_robot_commands": 0.004907940228780111, "deviation-center-line": 0.7742040419718731, "driven_lanedir_consec": 3.423066999918042, "sim_compute_sim_state": 0.024221802552541097, "sim_compute_performance-ego": 0.004062404632568359}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.527526403705099, "get_ui_image": 0.03464644339125035, "step_physics": 0.08439710988836774, "survival_time": 11.800000000000033, "driven_lanedir": 1.0145074868510149, "get_state_dump": 0.013530845359220342, "sim_render-ego": 0.005941990068403341, "get_robot_state": 0.015410068681684591, "get_duckie_state": 2.617553129034527e-06, "in-drivable-lane": 8.50000000000003, "agent_compute-ego": 0.017821029081182965, "deviation-heading": 1.1171673578184276, "complete-iteration": 0.20510595632811723, "set_robot_commands": 0.004718786579067424, "deviation-center-line": 0.18597295688013035, "driven_lanedir_consec": 1.0145074868510149, "sim_compute_sim_state": 0.02443551916187093, "sim_compute_performance-ego": 0.004045171252751755}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.802542049535059, "get_ui_image": 0.03422925313313802, "step_physics": 0.08119365056355794, "survival_time": 14.950000000000076, "driven_lanedir": 2.6437827278817077, "get_state_dump": 0.013627622922261556, "sim_render-ego": 0.005754663944244385, "get_robot_state": 0.013949933846791586, "get_duckie_state": 2.5780995686848957e-06, "in-drivable-lane": 7.400000000000072, "agent_compute-ego": 0.017588238716125488, "deviation-heading": 2.095415624198954, "complete-iteration": 0.20112279335657757, "set_robot_commands": 0.004572062492370605, "deviation-center-line": 0.4525093481682264, "driven_lanedir_consec": 2.6420706701792014, "sim_compute_sim_state": 0.026037824153900147, "sim_compute_performance-ego": 0.004007372061411539}}
set_robot_commands_max0.004907940228780111
set_robot_commands_mean0.0047278815056383035
set_robot_commands_median0.0047157616507012496
set_robot_commands_min0.004572062492370605
sim_compute_performance-ego_max0.004062404632568359
sim_compute_performance-ego_mean0.004036052879300592
sim_compute_performance-ego_median0.004037217411611236
sim_compute_performance-ego_min0.004007372061411539
sim_compute_sim_state_max0.026037824153900147
sim_compute_sim_state_mean0.02481170352043032
sim_compute_sim_state_median0.024493593687640022
sim_compute_sim_state_min0.024221802552541097
sim_render-ego_max0.006016386349995931
sim_render-ego_mean0.005918349590495585
sim_render-ego_median0.005951174033871014
sim_render-ego_min0.005754663944244385
simulation-passed1
step_physics_max0.08439710988836774
step_physics_mean0.07962417902072755
step_physics_median0.07959731793326467
step_physics_min0.0749049703280131
survival_time_max14.950000000000076
survival_time_mean13.00000000000005
survival_time_min10.300000000000011
No reset possible
4341611670Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.036962978266436
survival_time_median14.950000000000076
deviation-center-line_median0.6456216024485082
in-drivable-lane_median2.625000000000018


other stats
agent_compute-ego_max0.018125575383504233
agent_compute-ego_mean0.017591753602027894
agent_compute-ego_median0.017635330359141034
agent_compute-ego_min0.016970778306325277
complete-iteration_max0.21878171841303504
complete-iteration_mean0.20467670381069183
complete-iteration_median0.20415807127952576
complete-iteration_min0.19160895427068075
deviation-center-line_max0.7776665815928987
deviation-center-line_mean0.5826805601546645
deviation-center-line_min0.26181245412874316
deviation-heading_max3.398948475029796
deviation-heading_mean2.5231763055677483
deviation-heading_median2.611599770750467
deviation-heading_min1.4705572057402645
driven_any_max3.879759454989306
driven_any_mean3.8764315389608184
driven_any_median3.879545744192183
driven_any_min3.8668752124696018
driven_lanedir_consec_max3.3920029774210465
driven_lanedir_consec_mean2.615353863308409
driven_lanedir_consec_min0.9954865192797168
driven_lanedir_max3.3920029774210465
driven_lanedir_mean2.615353863308409
driven_lanedir_median3.036962978266436
driven_lanedir_min0.9954865192797168
get_duckie_state_max2.6416778564453125e-06
get_duckie_state_mean2.5155146916707357e-06
get_duckie_state_median2.545515696207682e-06
get_duckie_state_min2.3293495178222655e-06
get_robot_state_max0.016031898657480875
get_robot_state_mean0.01552535672982534
get_robot_state_median0.01555875301361084
get_robot_state_min0.014952022234598796
get_state_dump_max0.014013156096140544
get_state_dump_mean0.013745614886283874
get_state_dump_median0.013680170774459838
get_state_dump_min0.013608961900075276
get_ui_image_max0.03746381282806397
get_ui_image_mean0.03533238311608632
get_ui_image_median0.03491053144137064
get_ui_image_min0.03404465675354004
in-drivable-lane_max10.350000000000067
in-drivable-lane_mean4.212500000000027
in-drivable-lane_min1.2500000000000018
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.8668752124696018, "get_ui_image": 0.03407228390375773, "step_physics": 0.07728356917699178, "survival_time": 14.950000000000076, "driven_lanedir": 2.7003604468255444, "get_state_dump": 0.013743515809377034, "sim_render-ego": 0.005869734287261963, "get_robot_state": 0.01539738655090332, "get_duckie_state": 2.6416778564453125e-06, "in-drivable-lane": 3.700000000000034, "agent_compute-ego": 0.017548357645670573, "deviation-heading": 2.74771937315362, "complete-iteration": 0.1973578532536825, "set_robot_commands": 0.005021663506825765, "deviation-center-line": 0.5586631582811271, "driven_lanedir_consec": 2.7003604468255444, "sim_compute_sim_state": 0.0241922918955485, "sim_compute_performance-ego": 0.004076127211252848}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879759454989306, "get_ui_image": 0.03404465675354004, "step_physics": 0.07421225547790528, "survival_time": 14.950000000000076, "driven_lanedir": 3.3920029774210465, "get_state_dump": 0.013608961900075276, "sim_render-ego": 0.005765633583068848, "get_robot_state": 0.014952022234598796, "get_duckie_state": 2.3293495178222655e-06, "in-drivable-lane": 1.5500000000000025, "agent_compute-ego": 0.016970778306325277, "deviation-heading": 2.4754801683473144, "complete-iteration": 0.19160895427068075, "set_robot_commands": 0.004664986928304036, "deviation-center-line": 0.7325800466158892, "driven_lanedir_consec": 3.3920029774210465, "sim_compute_sim_state": 0.02327851057052612, "sim_compute_performance-ego": 0.003961632251739502}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.879335046889513, "get_ui_image": 0.03746381282806397, "step_physics": 0.09199079990386964, "survival_time": 14.950000000000076, "driven_lanedir": 0.9954865192797168, "get_state_dump": 0.014013156096140544, "sim_render-ego": 0.006406733194986979, "get_robot_state": 0.016031898657480875, "get_duckie_state": 2.5494893391927083e-06, "in-drivable-lane": 10.350000000000067, "agent_compute-ego": 0.018125575383504233, "deviation-heading": 1.4705572057402645, "complete-iteration": 0.21878171841303504, "set_robot_commands": 0.004857833385467529, "deviation-center-line": 0.26181245412874316, "driven_lanedir_consec": 0.9954865192797168, "sim_compute_sim_state": 0.025482138792673747, "sim_compute_performance-ego": 0.004244789282480876}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.879756441494852, "get_ui_image": 0.03574877897898356, "step_physics": 0.08462537924448649, "survival_time": 14.950000000000076, "driven_lanedir": 3.373565509707327, "get_state_dump": 0.013616825739542643, "sim_render-ego": 0.006105631192525228, "get_robot_state": 0.01572011947631836, "get_duckie_state": 2.5415420532226563e-06, "in-drivable-lane": 1.2500000000000018, "agent_compute-ego": 0.01772230307261149, "deviation-heading": 3.398948475029796, "complete-iteration": 0.21095828930536903, "set_robot_commands": 0.004890077114105225, "deviation-center-line": 0.7776665815928987, "driven_lanedir_consec": 3.373565509707327, "sim_compute_sim_state": 0.028300468921661374, "sim_compute_performance-ego": 0.004067552089691162}}
set_robot_commands_max0.005021663506825765
set_robot_commands_mean0.004858640233675639
set_robot_commands_median0.004873955249786377
set_robot_commands_min0.004664986928304036
sim_compute_performance-ego_max0.004244789282480876
sim_compute_performance-ego_mean0.004087525208791097
sim_compute_performance-ego_median0.004071839650472005
sim_compute_performance-ego_min0.003961632251739502
sim_compute_sim_state_max0.028300468921661374
sim_compute_sim_state_mean0.02531335254510244
sim_compute_sim_state_median0.024837215344111124
sim_compute_sim_state_min0.02327851057052612
sim_render-ego_max0.006406733194986979
sim_render-ego_mean0.006036933064460755
sim_render-ego_median0.005987682739893595
sim_render-ego_min0.005765633583068848
simulation-passed1
step_physics_max0.09199079990386964
step_physics_mean0.08202800095081329
step_physics_median0.08095447421073913
step_physics_min0.07421225547790528
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4340111669Bhavya Patwa 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-errornomont04-85f844e025a2-10:00:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4337811663Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9378083549153926
survival_time_median14.950000000000076
deviation-center-line_median0.8863407189748761
in-drivable-lane_median1.9250000000000032


other stats
agent_compute-ego_max0.01783921241760254
agent_compute-ego_mean0.01773655613263448
agent_compute-ego_median0.017744114796320598
agent_compute-ego_min0.01761878252029419
complete-iteration_max0.20323984464009603
complete-iteration_mean0.2005930838982264
complete-iteration_median0.2006060294310252
complete-iteration_min0.19792043209075927
deviation-center-line_max1.1206949972698257
deviation-center-line_mean0.9215743900355464
deviation-center-line_min0.7929211249226078
deviation-heading_max4.981254150580185
deviation-heading_mean3.616400007891156
deviation-heading_median3.45142970782338
deviation-heading_min2.58148646533768
driven_any_max4.742613849359859
driven_any_mean4.129622514081489
driven_any_median4.248015747454527
driven_any_min3.2798447120570406
driven_lanedir_consec_max4.551156391057265
driven_lanedir_consec_mean3.0905392028708825
driven_lanedir_consec_min1.935383710595478
driven_lanedir_max4.551156391057265
driven_lanedir_mean3.201221902685474
driven_lanedir_median3.143998352328783
driven_lanedir_min1.9657345150270624
get_duckie_state_max2.6941299438476564e-06
get_duckie_state_mean2.4952491124471027e-06
get_duckie_state_median2.4497509002685548e-06
get_duckie_state_min2.387364705403646e-06
get_robot_state_max0.016100979646046957
get_robot_state_mean0.01511689841747284
get_robot_state_median0.015387072960535684
get_robot_state_min0.013592468102773031
get_state_dump_max0.013717758655548097
get_state_dump_mean0.013599750200907389
get_state_dump_median0.013663428227106733
get_state_dump_min0.013354385693868
get_ui_image_max0.03529212713241577
get_ui_image_mean0.034626041849454246
get_ui_image_median0.03462424874305725
get_ui_image_min0.033963542779286704
in-drivable-lane_max6.250000000000015
in-drivable-lane_mean2.662500000000007
in-drivable-lane_min0.5500000000000078
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.9970264123775254, "get_ui_image": 0.03483713150024414, "step_physics": 0.07939418792724609, "survival_time": 14.950000000000076, "driven_lanedir": 1.9657345150270624, "get_state_dump": 0.013710222244262694, "sim_render-ego": 0.00645020325978597, "get_robot_state": 0.016100979646046957, "get_duckie_state": 2.6941299438476564e-06, "in-drivable-lane": 6.250000000000015, "agent_compute-ego": 0.01783921241760254, "deviation-heading": 3.652226323331712, "complete-iteration": 0.20240339199701943, "set_robot_commands": 0.004861294428507487, "deviation-center-line": 0.8506752626784291, "driven_lanedir_consec": 1.935383710595478, "sim_compute_sim_state": 0.024832789103190103, "sim_compute_performance-ego": 0.004215428034464518}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.499005082531529, "get_ui_image": 0.034411365985870364, "step_physics": 0.07927084048589071, "survival_time": 14.950000000000076, "driven_lanedir": 3.31721325451063, "get_state_dump": 0.013616634209950766, "sim_render-ego": 0.005983747641245524, "get_robot_state": 0.014915115038553872, "get_duckie_state": 2.454916636149089e-06, "in-drivable-lane": 2.7000000000000064, "agent_compute-ego": 0.01767692486445109, "deviation-heading": 4.981254150580185, "complete-iteration": 0.19880866686503093, "set_robot_commands": 0.0046600087483723955, "deviation-center-line": 0.9220061752713232, "driven_lanedir_consec": 2.9048332596838504, "sim_compute_sim_state": 0.024100600083669023, "sim_compute_performance-ego": 0.004013845920562744}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2798447120570406, "get_ui_image": 0.03529212713241577, "step_physics": 0.08095462878545125, "survival_time": 14.950000000000076, "driven_lanedir": 2.9707834501469352, "get_state_dump": 0.013717758655548097, "sim_render-ego": 0.006217492421468099, "get_robot_state": 0.015859030882517496, "get_duckie_state": 2.387364705403646e-06, "in-drivable-lane": 1.1500000000000004, "agent_compute-ego": 0.01761878252029419, "deviation-heading": 3.250633092315048, "complete-iteration": 0.20323984464009603, "set_robot_commands": 0.004776434103647868, "deviation-center-line": 0.7929211249226078, "driven_lanedir_consec": 2.9707834501469352, "sim_compute_sim_state": 0.024516011079152425, "sim_compute_performance-ego": 0.004127500057220459}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.742613849359859, "get_ui_image": 0.033963542779286704, "step_physics": 0.07874169747034708, "survival_time": 14.950000000000076, "driven_lanedir": 4.551156391057265, "get_state_dump": 0.013354385693868, "sim_render-ego": 0.005482694307963053, "get_robot_state": 0.013592468102773031, "get_duckie_state": 2.444585164388021e-06, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.017811304728190105, "deviation-heading": 2.58148646533768, "complete-iteration": 0.19792043209075927, "set_robot_commands": 0.0045884323120117185, "deviation-center-line": 1.1206949972698257, "driven_lanedir_consec": 4.551156391057265, "sim_compute_sim_state": 0.026497082710266115, "sim_compute_performance-ego": 0.003737356662750244}}
set_robot_commands_max0.004861294428507487
set_robot_commands_mean0.0047215423981348675
set_robot_commands_median0.0047182214260101316
set_robot_commands_min0.0045884323120117185
sim_compute_performance-ego_max0.004215428034464518
sim_compute_performance-ego_mean0.004023532668749491
sim_compute_performance-ego_median0.004070672988891601
sim_compute_performance-ego_min0.003737356662750244
sim_compute_sim_state_max0.026497082710266115
sim_compute_sim_state_mean0.024986620744069415
sim_compute_sim_state_median0.024674400091171264
sim_compute_sim_state_min0.024100600083669023
sim_render-ego_max0.00645020325978597
sim_render-ego_mean0.006033534407615662
sim_render-ego_median0.006100620031356811
sim_render-ego_min0.005482694307963053
simulation-passed1
step_physics_max0.08095462878545125
step_physics_mean0.07959033866723378
step_physics_median0.0793325142065684
step_physics_min0.07874169747034708
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4335411665Bhavya Patwa 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:06:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6488941806132331
survival_time_median9.099999999999994
deviation-center-line_median0.24292031428172217
in-drivable-lane_median3.300000000000021


other stats
agent_compute-ego_max0.01758260863167899
agent_compute-ego_mean0.017394407230037108
agent_compute-ego_median0.017370149626906285
agent_compute-ego_min0.017254721034656872
complete-iteration_max0.19652410789772315
complete-iteration_mean0.18789445267791371
complete-iteration_median0.1854308033243417
complete-iteration_min0.18419209616524831
deviation-center-line_max0.35243356728487546
deviation-center-line_mean0.23724186373998052
deviation-center-line_min0.11069325911160235
deviation-heading_max0.9301398432306816
deviation-heading_mean0.7983521757350547
deviation-heading_median0.8396970139071537
deviation-heading_min0.5838748318952295
driven_any_max2.654683466319443
driven_any_mean2.2184158231116924
driven_any_median2.5406142450701843
driven_any_min1.1377513359869589
driven_lanedir_consec_max2.020685356215507
driven_lanedir_consec_mean1.4773809223743313
driven_lanedir_consec_min0.5910499720553517
driven_lanedir_max2.020685356215507
driven_lanedir_mean1.4773809223743313
driven_lanedir_median1.6488941806132331
driven_lanedir_min0.5910499720553517
get_duckie_state_max2.657925641095197e-06
get_duckie_state_mean2.5705334485408606e-06
get_duckie_state_median2.5995753028176045e-06
get_duckie_state_min2.4250575474330356e-06
get_robot_state_max0.013728236610239202
get_robot_state_mean0.013472269968469506
get_robot_state_median0.013495290940291092
get_robot_state_min0.01317026138305664
get_state_dump_max0.013391844885689872
get_state_dump_mean0.013275115498710258
get_state_dump_median0.0133240941148367
get_state_dump_min0.01306042887947776
get_ui_image_max0.03394356480351201
get_ui_image_mean0.03313592835540621
get_ui_image_median0.03320955454020527
get_ui_image_min0.03218103953770229
in-drivable-lane_max3.5999999999999996
in-drivable-lane_mean3.000000000000009
in-drivable-lane_min1.7999999999999936
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.5090295214573355, "get_ui_image": 0.03218103953770229, "step_physics": 0.07120802061898368, "survival_time": 8.74999999999999, "driven_lanedir": 1.341582723486979, "get_state_dump": 0.013391844885689872, "sim_render-ego": 0.005435444968087333, "get_robot_state": 0.01317026138305664, "get_duckie_state": 2.4250575474330356e-06, "in-drivable-lane": 3.5999999999999996, "agent_compute-ego": 0.01758260863167899, "deviation-heading": 0.832832649641857, "complete-iteration": 0.18419209616524831, "set_robot_commands": 0.004573565891810826, "deviation-center-line": 0.27539148934103214, "driven_lanedir_consec": 1.341582723486979, "sim_compute_sim_state": 0.022765214102608816, "sim_compute_performance-ego": 0.00373969486781529}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.654683466319443, "get_ui_image": 0.03297873050118414, "step_physics": 0.07164565031079279, "survival_time": 10.350000000000012, "driven_lanedir": 2.020685356215507, "get_state_dump": 0.013291267957088453, "sim_render-ego": 0.0057265067446059074, "get_robot_state": 0.013425425054946384, "get_duckie_state": 2.6226043701171875e-06, "in-drivable-lane": 3.4500000000000286, "agent_compute-ego": 0.01730796910714412, "deviation-heading": 0.9301398432306816, "complete-iteration": 0.185969865264524, "set_robot_commands": 0.004549930637009478, "deviation-center-line": 0.35243356728487546, "driven_lanedir_consec": 2.020685356215507, "sim_compute_sim_state": 0.02303966231968092, "sim_compute_performance-ego": 0.0038574375392158257}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.1377513359869589, "get_ui_image": 0.03344037857922641, "step_physics": 0.07148169658400795, "survival_time": 4.399999999999992, "driven_lanedir": 0.5910499720553517, "get_state_dump": 0.01306042887947776, "sim_render-ego": 0.0055904063311490145, "get_robot_state": 0.013728236610239202, "get_duckie_state": 2.576546235518022e-06, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.017254721034656872, "deviation-heading": 0.5838748318952295, "complete-iteration": 0.18489174138415945, "set_robot_commands": 0.004522318189794367, "deviation-center-line": 0.11069325911160235, "driven_lanedir_consec": 0.5910499720553517, "sim_compute_sim_state": 0.021921919150785965, "sim_compute_performance-ego": 0.0037453418428247624}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.5721989686830327, "get_ui_image": 0.03394356480351201, "step_physics": 0.07734934993521878, "survival_time": 9.45, "driven_lanedir": 1.9562056377394876, "get_state_dump": 0.013356920272584944, "sim_render-ego": 0.005581957953316825, "get_robot_state": 0.0135651568256358, "get_duckie_state": 2.657925641095197e-06, "in-drivable-lane": 3.1500000000000137, "agent_compute-ego": 0.017432330146668448, "deviation-heading": 0.8465613781724504, "complete-iteration": 0.19652410789772315, "set_robot_commands": 0.004616988399041393, "deviation-center-line": 0.2104491392224122, "driven_lanedir_consec": 1.9562056377394876, "sim_compute_sim_state": 0.02668248030243727, "sim_compute_performance-ego": 0.003841241200764974}}
set_robot_commands_max0.004616988399041393
set_robot_commands_mean0.004565700779414016
set_robot_commands_median0.004561748264410152
set_robot_commands_min0.004522318189794367
sim_compute_performance-ego_max0.0038574375392158257
sim_compute_performance-ego_mean0.003795928862655213
sim_compute_performance-ego_median0.003793291521794869
sim_compute_performance-ego_min0.00373969486781529
sim_compute_sim_state_max0.02668248030243727
sim_compute_sim_state_mean0.02360231896887825
sim_compute_sim_state_median0.02290243821114487
sim_compute_sim_state_min0.021921919150785965
sim_render-ego_max0.0057265067446059074
sim_render-ego_mean0.0055835789992897695
sim_render-ego_median0.00558618214223292
sim_render-ego_min0.005435444968087333
simulation-passed1
step_physics_max0.07734934993521878
step_physics_mean0.07292117936225079
step_physics_median0.07156367344740036
step_physics_min0.07120802061898368
survival_time_max10.350000000000012
survival_time_mean8.237499999999997
survival_time_min4.399999999999992
No reset possible
4332311655Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1980450737967594
survival_time_median12.450000000000042
deviation-center-line_median0.5000470999336714
in-drivable-lane_median2.600000000000035


other stats
agent_compute-ego_max0.017735071922546107
agent_compute-ego_mean0.01713705396244647
agent_compute-ego_median0.017048554634107912
agent_compute-ego_min0.016716034659023944
complete-iteration_max0.19438932846332416
complete-iteration_mean0.19081447883278263
complete-iteration_median0.1917906581865598
complete-iteration_min0.18528727049468663
deviation-center-line_max0.8802254237888613
deviation-center-line_mean0.538024156578393
deviation-center-line_min0.2717770026573679
deviation-heading_max3.1069820913682653
deviation-heading_mean1.9238953682764552
deviation-heading_median1.7928405935614564
deviation-heading_min1.0029181946146428
driven_any_max5.790787143016877
driven_any_mean4.53459646070908
driven_any_median4.799293624523319
driven_any_min2.7490114507728074
driven_lanedir_consec_max4.992250118086243
driven_lanedir_consec_mean3.1487731046985523
driven_lanedir_consec_min1.206752153114447
driven_lanedir_max4.992250118086243
driven_lanedir_mean3.1487731046985523
driven_lanedir_median3.1980450737967594
driven_lanedir_min1.206752153114447
get_duckie_state_max3.570715586344401e-06
get_duckie_state_mean3.4016484726354545e-06
get_duckie_state_median3.399159213302237e-06
get_duckie_state_min3.237559877592942e-06
get_robot_state_max0.01533444466129426
get_robot_state_mean0.013592419349248885
get_robot_state_median0.013288515811641468
get_robot_state_min0.01245820111241834
get_state_dump_max0.0135870623588562
get_state_dump_mean0.013172871240615789
get_state_dump_median0.013157000887631162
get_state_dump_min0.012790420828344615
get_ui_image_max0.03356035550435384
get_ui_image_mean0.033129812926449335
get_ui_image_median0.033376943541406516
get_ui_image_min0.032205009118630466
in-drivable-lane_max7.300000000000008
in-drivable-lane_mean3.162500000000019
in-drivable-lane_min0.14999999999999947
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.790787143016877, "get_ui_image": 0.03356035550435384, "step_physics": 0.07459830363591512, "survival_time": 14.950000000000076, "driven_lanedir": 4.992250118086243, "get_state_dump": 0.0135870623588562, "sim_render-ego": 0.005654976367950439, "get_robot_state": 0.014051423072814942, "get_duckie_state": 3.570715586344401e-06, "in-drivable-lane": 1.450000000000017, "agent_compute-ego": 0.01700666904449463, "deviation-heading": 3.1069820913682653, "complete-iteration": 0.19145795663197832, "set_robot_commands": 0.004626002311706543, "deviation-center-line": 0.8802254237888613, "driven_lanedir_consec": 4.992250118086243, "sim_compute_sim_state": 0.02438501516977946, "sim_compute_performance-ego": 0.003837658564249674}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.410281832625938, "get_ui_image": 0.032205009118630466, "step_physics": 0.06963809758531578, "survival_time": 13.950000000000063, "driven_lanedir": 3.7545807228032384, "get_state_dump": 0.013414440189211172, "sim_render-ego": 0.005776557443817029, "get_robot_state": 0.01533444466129426, "get_duckie_state": 3.5301331550844254e-06, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.017090440223721193, "deviation-heading": 2.41776588515728, "complete-iteration": 0.18528727049468663, "set_robot_commands": 0.004866729073199748, "deviation-center-line": 0.6936363039336088, "driven_lanedir_consec": 3.7545807228032384, "sim_compute_sim_state": 0.022972077024453003, "sim_compute_performance-ego": 0.003842270075206688}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.1883054164206985, "get_ui_image": 0.03321865486772093, "step_physics": 0.08032624580000089, "survival_time": 10.95000000000002, "driven_lanedir": 1.206752153114447, "get_state_dump": 0.012790420828344615, "sim_render-ego": 0.005212106661165142, "get_robot_state": 0.012525608550467991, "get_duckie_state": 3.2681852715200485e-06, "in-drivable-lane": 7.300000000000008, "agent_compute-ego": 0.017735071922546107, "deviation-heading": 1.167915301965633, "complete-iteration": 0.19212335974114125, "set_robot_commands": 0.0044685868912091534, "deviation-center-line": 0.2717770026573679, "driven_lanedir_consec": 1.206752153114447, "sim_compute_sim_state": 0.02221770917988259, "sim_compute_performance-ego": 0.0034932480555146797}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7490114507728074, "get_ui_image": 0.0335352322150921, "step_physics": 0.08128897403848583, "survival_time": 7.249999999999982, "driven_lanedir": 2.6415094247902804, "get_state_dump": 0.012899561586051152, "sim_render-ego": 0.005185298261971309, "get_robot_state": 0.01245820111241834, "get_duckie_state": 3.237559877592942e-06, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.016716034659023944, "deviation-heading": 1.0029181946146428, "complete-iteration": 0.19438932846332416, "set_robot_commands": 0.004310367847311086, "deviation-center-line": 0.30645789593373396, "driven_lanedir_consec": 2.6415094247902804, "sim_compute_sim_state": 0.02432897501978381, "sim_compute_performance-ego": 0.0035335524328823746}}
set_robot_commands_max0.004866729073199748
set_robot_commands_mean0.004567921530856633
set_robot_commands_median0.004547294601457848
set_robot_commands_min0.004310367847311086
sim_compute_performance-ego_max0.003842270075206688
sim_compute_performance-ego_mean0.0036766822819633543
sim_compute_performance-ego_median0.0036856054985660246
sim_compute_performance-ego_min0.0034932480555146797
sim_compute_sim_state_max0.02438501516977946
sim_compute_sim_state_mean0.02347594409847472
sim_compute_sim_state_median0.02365052602211841
sim_compute_sim_state_min0.02221770917988259
sim_render-ego_max0.005776557443817029
sim_render-ego_mean0.00545723468372598
sim_render-ego_median0.0054335415145577905
sim_render-ego_min0.005185298261971309
simulation-passed1
step_physics_max0.08128897403848583
step_physics_mean0.0764629052649294
step_physics_median0.077462274717958
step_physics_min0.06963809758531578
survival_time_max14.950000000000076
survival_time_mean11.775000000000038
survival_time_min7.249999999999982
No reset possible
4330511657Melisande Tengsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1854827317111556
survival_time_median14.950000000000076
deviation-center-line_median0.7159154169292633
in-drivable-lane_median2.750000000000032


other stats
agent_compute-ego_max0.01789392868677775
agent_compute-ego_mean0.01758021067653477
agent_compute-ego_median0.017633574626334116
agent_compute-ego_min0.017159764766693116
complete-iteration_max0.22250158826181712
complete-iteration_mean0.20091057548838212
complete-iteration_median0.19654509862263997
complete-iteration_min0.18805051644643148
deviation-center-line_max0.7655573251750741
deviation-center-line_mean0.6340886028054571
deviation-center-line_min0.3389662521882275
deviation-heading_max4.333037227512081
deviation-heading_mean3.306170130745307
deviation-heading_median3.454683888534487
deviation-heading_min1.9822755184001724
driven_any_max3.161922412054045
driven_any_mean2.9894896579739005
driven_any_median3.0584074429120705
driven_any_min2.6792213340174187
driven_lanedir_consec_max2.497067447916706
driven_lanedir_consec_mean2.1823824424966407
driven_lanedir_consec_min1.861496858647545
driven_lanedir_max2.497067447916706
driven_lanedir_mean2.1823824424966407
driven_lanedir_median2.1854827317111556
driven_lanedir_min1.861496858647545
get_duckie_state_max2.793044098152602e-06
get_duckie_state_mean2.567065320395898e-06
get_duckie_state_median2.531607945760091e-06
get_duckie_state_min2.4120012919108074e-06
get_robot_state_max0.015732244026562398
get_robot_state_mean0.015163711749489314
get_robot_state_median0.015364016294479373
get_robot_state_min0.014194570382436116
get_state_dump_max0.014016000692509422
get_state_dump_mean0.013645372655109268
get_state_dump_median0.013596799373626707
get_state_dump_min0.013371891180674236
get_ui_image_max0.03675955780281509
get_ui_image_mean0.034712176342641024
get_ui_image_median0.03436082681020101
get_ui_image_min0.033367493947347004
in-drivable-lane_max3.8500000000000494
in-drivable-lane_mean2.8500000000000356
in-drivable-lane_min2.050000000000029
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.161922412054045, "get_ui_image": 0.034032304286956784, "step_physics": 0.07388333082199097, "survival_time": 14.950000000000076, "driven_lanedir": 2.223294491832343, "get_state_dump": 0.013371891180674236, "sim_render-ego": 0.005803451538085937, "get_robot_state": 0.015415672461191814, "get_duckie_state": 2.536773681640625e-06, "in-drivable-lane": 3.250000000000032, "agent_compute-ego": 0.01738144556681315, "deviation-heading": 3.4389054525183655, "complete-iteration": 0.19216736475626628, "set_robot_commands": 0.004753336906433105, "deviation-center-line": 0.6786007555076868, "driven_lanedir_consec": 2.223294491832343, "sim_compute_sim_state": 0.02342072566350301, "sim_compute_performance-ego": 0.003967969417572021}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.057086958005574, "get_ui_image": 0.033367493947347004, "step_physics": 0.07256725549697876, "survival_time": 14.950000000000076, "driven_lanedir": 2.497067447916706, "get_state_dump": 0.013621957302093504, "sim_render-ego": 0.005626453558603923, "get_robot_state": 0.014194570382436116, "get_duckie_state": 2.4120012919108074e-06, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.017159764766693116, "deviation-heading": 3.4704623245506085, "complete-iteration": 0.18805051644643148, "set_robot_commands": 0.004546348253885905, "deviation-center-line": 0.7655573251750741, "driven_lanedir_consec": 2.497067447916706, "sim_compute_sim_state": 0.022989211082458497, "sim_compute_performance-ego": 0.003840530713399251}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0597279278185665, "get_ui_image": 0.03468934933344523, "step_physics": 0.08045981248219808, "survival_time": 14.950000000000076, "driven_lanedir": 1.861496858647545, "get_state_dump": 0.013571641445159911, "sim_render-ego": 0.006096946398417155, "get_robot_state": 0.015312360127766928, "get_duckie_state": 2.526442209879557e-06, "in-drivable-lane": 3.8500000000000494, "agent_compute-ego": 0.01789392868677775, "deviation-heading": 4.333037227512081, "complete-iteration": 0.2009228324890137, "set_robot_commands": 0.004772270520528157, "deviation-center-line": 0.7532300783508398, "driven_lanedir_consec": 1.861496858647545, "sim_compute_sim_state": 0.02397941827774048, "sim_compute_performance-ego": 0.004002656936645508}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6792213340174187, "get_ui_image": 0.03675955780281509, "step_physics": 0.09365651725737516, "survival_time": 12.100000000000035, "driven_lanedir": 2.147670971589968, "get_state_dump": 0.014016000692509422, "sim_render-ego": 0.006513021209023215, "get_robot_state": 0.015732244026562398, "get_duckie_state": 2.793044098152602e-06, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.017885703685855077, "deviation-heading": 1.9822755184001724, "complete-iteration": 0.22250158826181712, "set_robot_commands": 0.004830421495043541, "deviation-center-line": 0.3389662521882275, "driven_lanedir_consec": 2.147670971589968, "sim_compute_sim_state": 0.02870302850549871, "sim_compute_performance-ego": 0.00425001313863707}}
set_robot_commands_max0.004830421495043541
set_robot_commands_mean0.004725594293972677
set_robot_commands_median0.004762803713480632
set_robot_commands_min0.004546348253885905
sim_compute_performance-ego_max0.00425001313863707
sim_compute_performance-ego_mean0.004015292551563463
sim_compute_performance-ego_median0.003985313177108764
sim_compute_performance-ego_min0.003840530713399251
sim_compute_sim_state_max0.02870302850549871
sim_compute_sim_state_mean0.024773095882300176
sim_compute_sim_state_median0.023700071970621742
sim_compute_sim_state_min0.022989211082458497
sim_render-ego_max0.006513021209023215
sim_render-ego_mean0.0060099681760325575
sim_render-ego_median0.005950198968251546
sim_render-ego_min0.005626453558603923
simulation-passed1
step_physics_max0.09365651725737516
step_physics_mean0.08014172901463575
step_physics_median0.07717157165209453
step_physics_min0.07256725549697876
survival_time_max14.950000000000076
survival_time_mean14.237500000000068
survival_time_min12.100000000000035
No reset possible
4327711653Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2470036903221526
survival_time_median14.950000000000076
deviation-center-line_median0.7127054946217892
in-drivable-lane_median1.6500000000000146


other stats
agent_compute-ego_max0.017373252709706626
agent_compute-ego_mean0.016966887513796488
agent_compute-ego_median0.016872531970342
agent_compute-ego_min0.016749233404795328
complete-iteration_max0.20491913557052613
complete-iteration_mean0.19783537983894348
complete-iteration_median0.19751058459281923
complete-iteration_min0.19140121459960935
deviation-center-line_max1.0368189901428433
deviation-center-line_mean0.7801385192817324
deviation-center-line_min0.658324097740508
deviation-heading_max5.010060204893619
deviation-heading_mean3.500365615451775
deviation-heading_median3.028850353066495
deviation-heading_min2.9337015507804907
driven_any_max3.134208226928052
driven_any_mean2.996872101564014
driven_any_median3.0431679904282176
driven_any_min2.7669441984715677
driven_lanedir_consec_max2.8140292553424917
driven_lanedir_consec_mean2.352870654769556
driven_lanedir_consec_min2.1034459830914285
driven_lanedir_max2.8140292553424917
driven_lanedir_mean2.507231784959883
driven_lanedir_median2.5557259507028056
driven_lanedir_min2.1034459830914285
get_duckie_state_max2.742608388264974e-06
get_duckie_state_mean2.4950504302978515e-06
get_duckie_state_median2.469619115193685e-06
get_duckie_state_min2.2983551025390622e-06
get_robot_state_max0.015406359831492106
get_robot_state_mean0.015359416405359904
get_robot_state_median0.015359935363133749
get_robot_state_min0.015311435063680013
get_state_dump_max0.013685656388600668
get_state_dump_mean0.013478661179542542
get_state_dump_median0.013506823778152464
get_state_dump_min0.013215340773264568
get_ui_image_max0.03580612738927205
get_ui_image_mean0.034740907351175944
get_ui_image_median0.03467211643854777
get_ui_image_min0.03381326913833618
in-drivable-lane_max2.8500000000000147
in-drivable-lane_mean1.7000000000000133
in-drivable-lane_min0.6500000000000092
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.134208226928052, "get_ui_image": 0.03381326913833618, "step_physics": 0.07485130786895752, "survival_time": 14.950000000000076, "driven_lanedir": 2.383229568330129, "get_state_dump": 0.013685656388600668, "sim_render-ego": 0.005776195526123047, "get_robot_state": 0.015406359831492106, "get_duckie_state": 2.742608388264974e-06, "in-drivable-lane": 2.8500000000000147, "agent_compute-ego": 0.01687550703684489, "deviation-heading": 2.986529016496004, "complete-iteration": 0.1927274966239929, "set_robot_commands": 0.004760337670644124, "deviation-center-line": 0.6661450758447541, "driven_lanedir_consec": 2.383229568330129, "sim_compute_sim_state": 0.023529105186462403, "sim_compute_performance-ego": 0.0038855759302775066}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.053321592775488, "get_ui_image": 0.03402533849080404, "step_physics": 0.07424846808115641, "survival_time": 14.950000000000076, "driven_lanedir": 2.8140292553424917, "get_state_dump": 0.013215340773264568, "sim_render-ego": 0.0058664679527282715, "get_robot_state": 0.015370758374532063, "get_duckie_state": 2.457300821940104e-06, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.016749233404795328, "deviation-heading": 3.071171689636986, "complete-iteration": 0.19140121459960935, "set_robot_commands": 0.0048440758387247726, "deviation-center-line": 0.7592659133988243, "driven_lanedir_consec": 2.8140292553424917, "sim_compute_sim_state": 0.022996184825897215, "sim_compute_performance-ego": 0.003938941160837809}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7669441984715677, "get_ui_image": 0.03580612738927205, "step_physics": 0.08084978501001994, "survival_time": 14.950000000000076, "driven_lanedir": 2.1034459830914285, "get_state_dump": 0.013639186223347982, "sim_render-ego": 0.006016279856363932, "get_robot_state": 0.015349112351735432, "get_duckie_state": 2.4819374084472657e-06, "in-drivable-lane": 2.150000000000013, "agent_compute-ego": 0.017373252709706626, "deviation-heading": 5.010060204893619, "complete-iteration": 0.20229367256164552, "set_robot_commands": 0.004733659426371256, "deviation-center-line": 1.0368189901428433, "driven_lanedir_consec": 2.1034459830914285, "sim_compute_sim_state": 0.02432344913482666, "sim_compute_performance-ego": 0.0040497279167175295}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0330143880809475, "get_ui_image": 0.0353188943862915, "step_physics": 0.0829911192258199, "survival_time": 14.950000000000076, "driven_lanedir": 2.7282223330754825, "get_state_dump": 0.01337446133295695, "sim_render-ego": 0.005814620653788249, "get_robot_state": 0.015311435063680013, "get_duckie_state": 2.2983551025390622e-06, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.016869556903839112, "deviation-heading": 2.9337015507804907, "complete-iteration": 0.20491913557052613, "set_robot_commands": 0.004784544308980306, "deviation-center-line": 0.658324097740508, "driven_lanedir_consec": 2.110777812314176, "sim_compute_sim_state": 0.026439685821533204, "sim_compute_performance-ego": 0.0038681125640869143}}
set_robot_commands_max0.0048440758387247726
set_robot_commands_mean0.004780654311180114
set_robot_commands_median0.004772440989812215
set_robot_commands_min0.004733659426371256
sim_compute_performance-ego_max0.0040497279167175295
sim_compute_performance-ego_mean0.00393558939297994
sim_compute_performance-ego_median0.003912258545557658
sim_compute_performance-ego_min0.0038681125640869143
sim_compute_sim_state_max0.026439685821533204
sim_compute_sim_state_mean0.024322106242179873
sim_compute_sim_state_median0.02392627716064453
sim_compute_sim_state_min0.022996184825897215
sim_render-ego_max0.006016279856363932
sim_render-ego_mean0.005868390997250874
sim_render-ego_median0.00584054430325826
sim_render-ego_min0.005776195526123047
simulation-passed1
step_physics_max0.0829911192258199
step_physics_mean0.07823517004648844
step_physics_median0.07785054643948873
step_physics_min0.07424846808115641
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4324811646Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3567154304756253
survival_time_median14.950000000000076
deviation-center-line_median0.682021594933414
in-drivable-lane_median0.8000000000000065


other stats
agent_compute-ego_max0.017582937081654867
agent_compute-ego_mean0.017303585410118102
agent_compute-ego_median0.017297533750534055
agent_compute-ego_min0.01703633705774943
complete-iteration_max0.1884641432762146
complete-iteration_mean0.1849357875188192
complete-iteration_median0.18536264300346375
complete-iteration_min0.1805537207921346
deviation-center-line_max1.0710465945778098
deviation-center-line_mean0.7402423383668837
deviation-center-line_min0.5258795690228968
deviation-heading_max4.965497064177535
deviation-heading_mean3.4310873723102926
deviation-heading_median3.02395822887902
deviation-heading_min2.710935967305595
driven_any_max3.15109497455063
driven_any_mean2.9684225824456196
driven_any_median2.9877498117863386
driven_any_min2.747095731659172
driven_lanedir_consec_max2.9159501824901772
driven_lanedir_consec_mean2.4036007935078176
driven_lanedir_consec_min1.9850221305898428
driven_lanedir_max2.9159501824901772
driven_lanedir_mean2.63586714637473
driven_lanedir_median2.7554229178194127
driven_lanedir_min2.1166725673699167
get_duckie_state_max2.3833910624186197e-06
get_duckie_state_mean2.2367636362711587e-06
get_duckie_state_median2.2125244140625003e-06
get_duckie_state_min2.138614654541016e-06
get_robot_state_max0.01325889269510905
get_robot_state_mean0.013039911786715187
get_robot_state_median0.013150611718495686
get_robot_state_min0.012599531014760336
get_state_dump_max0.013168102900187174
get_state_dump_mean0.0130756280819575
get_state_dump_median0.013108699321746823
get_state_dump_min0.01291701078414917
get_ui_image_max0.03335595448811849
get_ui_image_mean0.03285850246747335
get_ui_image_median0.03296576380729675
get_ui_image_min0.032146527767181396
in-drivable-lane_max1.8000000000000256
in-drivable-lane_mean0.9000000000000103
in-drivable-lane_min0.20000000000000284
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.913640294833008, "get_ui_image": 0.03272739092508952, "step_physics": 0.07111034393310547, "survival_time": 14.950000000000076, "driven_lanedir": 2.596758293581334, "get_state_dump": 0.013168102900187174, "sim_render-ego": 0.00544205109278361, "get_robot_state": 0.01314700444539388, "get_duckie_state": 2.3833910624186197e-06, "in-drivable-lane": 1.0000000000000044, "agent_compute-ego": 0.017301596800486246, "deviation-heading": 3.256206353166404, "complete-iteration": 0.18376280387242636, "set_robot_commands": 0.004444941679636638, "deviation-center-line": 0.6078225056491466, "driven_lanedir_consec": 2.596758293581334, "sim_compute_sim_state": 0.02262843688329061, "sim_compute_performance-ego": 0.003643734455108642}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.15109497455063, "get_ui_image": 0.032146527767181396, "step_physics": 0.0694537854194641, "survival_time": 14.950000000000076, "driven_lanedir": 2.9159501824901772, "get_state_dump": 0.013135748704274496, "sim_render-ego": 0.005421505769093831, "get_robot_state": 0.013154218991597494, "get_duckie_state": 2.1568934122721355e-06, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.01729347070058187, "deviation-heading": 2.791710104591636, "complete-iteration": 0.1805537207921346, "set_robot_commands": 0.0044548106193542485, "deviation-center-line": 0.7562206842176813, "driven_lanedir_consec": 2.9159501824901772, "sim_compute_sim_state": 0.02169064362843831, "sim_compute_performance-ego": 0.0036533514658610025}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.747095731659172, "get_ui_image": 0.03335595448811849, "step_physics": 0.07369763135910035, "survival_time": 14.950000000000076, "driven_lanedir": 2.1166725673699167, "get_state_dump": 0.013081649939219156, "sim_render-ego": 0.005533357461293538, "get_robot_state": 0.01325889269510905, "get_duckie_state": 2.2681554158528647e-06, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.017582937081654867, "deviation-heading": 4.965497064177535, "complete-iteration": 0.18696248213450117, "set_robot_commands": 0.004414401849110921, "deviation-center-line": 1.0710465945778098, "driven_lanedir_consec": 2.1166725673699167, "sim_compute_sim_state": 0.022248430252075194, "sim_compute_performance-ego": 0.00363858699798584}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.061859328739669, "get_ui_image": 0.03320413668950399, "step_physics": 0.07479286988576253, "survival_time": 14.950000000000076, "driven_lanedir": 2.9140875420574917, "get_state_dump": 0.01291701078414917, "sim_render-ego": 0.005326786835988363, "get_robot_state": 0.012599531014760336, "get_duckie_state": 2.138614654541016e-06, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.01703633705774943, "deviation-heading": 2.710935967305595, "complete-iteration": 0.1884641432762146, "set_robot_commands": 0.004380056063334147, "deviation-center-line": 0.5258795690228968, "driven_lanedir_consec": 1.9850221305898428, "sim_compute_sim_state": 0.024449152946472166, "sim_compute_performance-ego": 0.003615682125091553}}
set_robot_commands_max0.0044548106193542485
set_robot_commands_mean0.0044235525528589885
set_robot_commands_median0.004429671764373779
set_robot_commands_min0.004380056063334147
sim_compute_performance-ego_max0.0036533514658610025
sim_compute_performance-ego_mean0.00363783876101176
sim_compute_performance-ego_median0.0036411607265472417
sim_compute_performance-ego_min0.003615682125091553
sim_compute_sim_state_max0.024449152946472166
sim_compute_sim_state_mean0.02275416592756907
sim_compute_sim_state_median0.0224384335676829
sim_compute_sim_state_min0.02169064362843831
sim_render-ego_max0.005533357461293538
sim_render-ego_mean0.005430925289789835
sim_render-ego_median0.00543177843093872
sim_render-ego_min0.005326786835988363
simulation-passed1
step_physics_max0.07479286988576253
step_physics_mean0.0722636576493581
step_physics_median0.07240398764610291
step_physics_min0.0694537854194641
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4324011644Dishank Bansal 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:03:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 162 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4320211632Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6061490290207725
survival_time_median14.950000000000076
deviation-center-line_median0.3780847296578249
in-drivable-lane_median2.0750000000000295


other stats
agent_compute-ego_max0.01761380910873413
agent_compute-ego_mean0.017375922401746114
agent_compute-ego_median0.017389704783757527
agent_compute-ego_min0.01711047093073527
complete-iteration_max0.19700989882151285
complete-iteration_mean0.19032265424728395
complete-iteration_median0.1892096797625224
complete-iteration_min0.1858613586425781
deviation-center-line_max0.775603475235392
deviation-center-line_mean0.4288290525790666
deviation-center-line_min0.1835432757652249
deviation-heading_max2.468297243975007
deviation-heading_mean1.89469461170602
deviation-heading_median2.0343458817749456
deviation-heading_min1.0417894392991824
driven_any_max1.9399370944144037
driven_any_mean1.9365342758632496
driven_any_median1.9397896607682223
driven_any_min1.9266206875021508
driven_lanedir_consec_max1.9013072293688844
driven_lanedir_consec_mean1.3901963434779565
driven_lanedir_consec_min0.4471800865013955
driven_lanedir_max1.9013072293688844
driven_lanedir_mean1.3901963434779565
driven_lanedir_median1.6061490290207725
driven_lanedir_min0.4471800865013955
get_duckie_state_max2.455711364746094e-06
get_duckie_state_mean2.307891845703125e-06
get_duckie_state_median2.2693475087483727e-06
get_duckie_state_min2.2371610005696613e-06
get_robot_state_max0.014231353600819906
get_robot_state_mean0.013468177914619447
get_robot_state_median0.013497440020243327
get_robot_state_min0.012646478017171224
get_state_dump_max0.013361316521962483
get_state_dump_mean0.013174793720245362
get_state_dump_median0.013260358969370525
get_state_dump_min0.012817140420277913
get_ui_image_max0.034406562646230064
get_ui_image_mean0.03345811843872071
get_ui_image_median0.03314746777216593
get_ui_image_min0.03313097556432088
in-drivable-lane_max10.850000000000083
in-drivable-lane_mean3.750000000000035
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9266206875021508, "get_ui_image": 0.03313097556432088, "step_physics": 0.0735508386294047, "survival_time": 14.950000000000076, "driven_lanedir": 1.328838678191102, "get_state_dump": 0.013202909628550212, "sim_render-ego": 0.0055340758959452315, "get_robot_state": 0.013370747566223144, "get_duckie_state": 2.238750457763672e-06, "in-drivable-lane": 4.150000000000059, "agent_compute-ego": 0.017168752352396646, "deviation-heading": 1.816401334760404, "complete-iteration": 0.18660860220591227, "set_robot_commands": 0.004453732172648112, "deviation-center-line": 0.2211297851617225, "driven_lanedir_consec": 1.328838678191102, "sim_compute_sim_state": 0.022369937896728517, "sim_compute_performance-ego": 0.003683958053588867}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399370944144037, "get_ui_image": 0.033142430782318114, "step_physics": 0.07200928131739298, "survival_time": 14.950000000000076, "driven_lanedir": 1.9013072293688844, "get_state_dump": 0.013361316521962483, "sim_render-ego": 0.005673684279123942, "get_robot_state": 0.01362413247426351, "get_duckie_state": 2.455711364746094e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01761380910873413, "deviation-heading": 2.252290428789487, "complete-iteration": 0.1858613586425781, "set_robot_commands": 0.004628461201985677, "deviation-center-line": 0.5350396741539274, "driven_lanedir_consec": 1.9013072293688844, "sim_compute_sim_state": 0.021826641559600832, "sim_compute_performance-ego": 0.003832603295644124}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939644399533116, "get_ui_image": 0.034406562646230064, "step_physics": 0.08082690080006917, "survival_time": 14.950000000000076, "driven_lanedir": 0.4471800865013955, "get_state_dump": 0.013317808310190835, "sim_render-ego": 0.005688297748565674, "get_robot_state": 0.014231353600819906, "get_duckie_state": 2.299944559733073e-06, "in-drivable-lane": 10.850000000000083, "agent_compute-ego": 0.017610657215118408, "deviation-heading": 1.0417894392991824, "complete-iteration": 0.19700989882151285, "set_robot_commands": 0.0046236840883890785, "deviation-center-line": 0.1835432757652249, "driven_lanedir_consec": 0.4471800865013955, "sim_compute_sim_state": 0.022291714350382488, "sim_compute_performance-ego": 0.0038643908500671383}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399349220033288, "get_ui_image": 0.03315250476201375, "step_physics": 0.07850810766220093, "survival_time": 14.950000000000076, "driven_lanedir": 1.8834593798504424, "get_state_dump": 0.012817140420277913, "sim_render-ego": 0.005208440621693929, "get_robot_state": 0.012646478017171224, "get_duckie_state": 2.2371610005696613e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01711047093073527, "deviation-heading": 2.468297243975007, "complete-iteration": 0.1918107573191325, "set_robot_commands": 0.004428462187449137, "deviation-center-line": 0.775603475235392, "driven_lanedir_consec": 1.8834593798504424, "sim_compute_sim_state": 0.02427584648132324, "sim_compute_performance-ego": 0.0035250099500020345}}
set_robot_commands_max0.004628461201985677
set_robot_commands_mean0.0045335849126180005
set_robot_commands_median0.004538708130518595
set_robot_commands_min0.004428462187449137
sim_compute_performance-ego_max0.0038643908500671383
sim_compute_performance-ego_mean0.003726490537325541
sim_compute_performance-ego_median0.003758280674616496
sim_compute_performance-ego_min0.0035250099500020345
sim_compute_sim_state_max0.02427584648132324
sim_compute_sim_state_mean0.022691035072008772
sim_compute_sim_state_median0.022330826123555504
sim_compute_sim_state_min0.021826641559600832
sim_render-ego_max0.005688297748565674
sim_render-ego_mean0.005526124636332194
sim_render-ego_median0.005603880087534587
sim_render-ego_min0.005208440621693929
simulation-passed1
step_physics_max0.08082690080006917
step_physics_mean0.07622378210226693
step_physics_median0.07602947314580281
step_physics_min0.07200928131739298
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4316311623Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9652860821298763
survival_time_median14.950000000000076
deviation-center-line_median0.5302016791032738
in-drivable-lane_median1.0000000000000142


other stats
agent_compute-ego_max0.017379804452260336
agent_compute-ego_mean0.016849086446066697
agent_compute-ego_median0.016881223917007446
agent_compute-ego_min0.016254093497991562
complete-iteration_max0.1988816472391287
complete-iteration_mean0.19021064709872007
complete-iteration_median0.18997400522232055
complete-iteration_min0.18201293071111044
deviation-center-line_max0.7389669737523321
deviation-center-line_mean0.4863893829627247
deviation-center-line_min0.14618719989201923
deviation-heading_max4.927145661006822
deviation-heading_mean3.134511495080909
deviation-heading_median3.4495486771551143
deviation-heading_min0.7118029650065856
driven_any_max3.0518367008576344
driven_any_mean2.6562799678034823
driven_any_median2.7371091758131825
driven_any_min2.0990648187299294
driven_lanedir_consec_max2.646643611154611
driven_lanedir_consec_mean1.8105032670078829
driven_lanedir_consec_min0.664797292617167
driven_lanedir_max2.646643611154611
driven_lanedir_mean1.8105032670078829
driven_lanedir_median1.9652860821298763
driven_lanedir_min0.664797292617167
get_duckie_state_max2.474784851074219e-06
get_duckie_state_mean2.32599675655365e-06
get_duckie_state_median2.2940337657928465e-06
get_duckie_state_min2.2411346435546876e-06
get_robot_state_max0.013476692140102386
get_robot_state_mean0.013102075879772504
get_robot_state_median0.013044295310974122
get_robot_state_min0.012843020757039388
get_state_dump_max0.012777529656887054
get_state_dump_mean0.012709274912873905
get_state_dump_median0.012695628801981608
get_state_dump_min0.012668312390645343
get_ui_image_max0.03437216361363729
get_ui_image_mean0.03356317333877087
get_ui_image_median0.033627288589874904
get_ui_image_min0.03262595256169637
in-drivable-lane_max11.95000000000008
in-drivable-lane_mean3.4875000000000274
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.84549994068042, "get_ui_image": 0.03262595256169637, "step_physics": 0.07136538902918498, "survival_time": 14.950000000000076, "driven_lanedir": 2.646643611154611, "get_state_dump": 0.012668312390645343, "sim_render-ego": 0.005338709354400634, "get_robot_state": 0.012916541894276936, "get_duckie_state": 2.300739288330078e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01668497403462728, "deviation-heading": 4.504184006896913, "complete-iteration": 0.18217363993326824, "set_robot_commands": 0.004429605007171631, "deviation-center-line": 0.7389669737523321, "driven_lanedir_consec": 2.646643611154611, "sim_compute_sim_state": 0.02241083065668742, "sim_compute_performance-ego": 0.003590836524963379}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.628718410945945, "get_ui_image": 0.032937687238057456, "step_physics": 0.07104611476262411, "survival_time": 14.950000000000076, "driven_lanedir": 2.127912959320819, "get_state_dump": 0.012694338162740073, "sim_render-ego": 0.005464666684468587, "get_robot_state": 0.012843020757039388, "get_duckie_state": 2.2411346435546876e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.017077473799387614, "deviation-heading": 4.927145661006822, "complete-iteration": 0.18201293071111044, "set_robot_commands": 0.004373847643534342, "deviation-center-line": 0.7118539753189359, "driven_lanedir_consec": 2.127912959320819, "sim_compute_sim_state": 0.021783401171366373, "sim_compute_performance-ego": 0.003648966153462728}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0518367008576344, "get_ui_image": 0.03437216361363729, "step_physics": 0.08353458086649578, "survival_time": 14.950000000000076, "driven_lanedir": 0.664797292617167, "get_state_dump": 0.012696919441223144, "sim_render-ego": 0.00548800786336263, "get_robot_state": 0.013172048727671306, "get_duckie_state": 2.474784851074219e-06, "in-drivable-lane": 11.95000000000008, "agent_compute-ego": 0.017379804452260336, "deviation-heading": 0.7118029650065856, "complete-iteration": 0.1977743705113729, "set_robot_commands": 0.004351967175801595, "deviation-center-line": 0.14618719989201923, "driven_lanedir_consec": 0.664797292617167, "sim_compute_sim_state": 0.022973371346791584, "sim_compute_performance-ego": 0.003660931587219238}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0990648187299294, "get_ui_image": 0.03431688994169235, "step_physics": 0.08279922604560852, "survival_time": 9.6, "driven_lanedir": 1.8026592049389336, "get_state_dump": 0.012777529656887054, "sim_render-ego": 0.005327047159274419, "get_robot_state": 0.013476692140102386, "get_duckie_state": 2.2873282432556152e-06, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.016254093497991562, "deviation-heading": 2.3949133474133153, "complete-iteration": 0.1988816472391287, "set_robot_commands": 0.004383313159147899, "deviation-center-line": 0.34854938288761156, "driven_lanedir_consec": 1.8026592049389336, "sim_compute_sim_state": 0.025769148021936417, "sim_compute_performance-ego": 0.003635863463083903}}
set_robot_commands_max0.004429605007171631
set_robot_commands_mean0.004384683246413867
set_robot_commands_median0.00437858040134112
set_robot_commands_min0.004351967175801595
sim_compute_performance-ego_max0.003660931587219238
sim_compute_performance-ego_mean0.003634149432182312
sim_compute_performance-ego_median0.003642414808273315
sim_compute_performance-ego_min0.003590836524963379
sim_compute_sim_state_max0.025769148021936417
sim_compute_sim_state_mean0.02323418779919545
sim_compute_sim_state_median0.022692101001739504
sim_compute_sim_state_min0.021783401171366373
sim_render-ego_max0.00548800786336263
sim_render-ego_mean0.005404607765376567
sim_render-ego_median0.00540168801943461
sim_render-ego_min0.005327047159274419
simulation-passed1
step_physics_max0.08353458086649578
step_physics_mean0.07718632767597834
step_physics_median0.07708230753739675
step_physics_min0.07104611476262411
survival_time_max14.950000000000076
survival_time_mean13.61250000000006
survival_time_min9.6
No reset possible
4311411607Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7753170996748056
survival_time_median14.950000000000076
deviation-center-line_median0.5344293011161214
in-drivable-lane_median1.5250000000000217


other stats
agent_compute-ego_max0.017715009848276776
agent_compute-ego_mean0.01723127583662669
agent_compute-ego_median0.01712366223335266
agent_compute-ego_min0.016962769031524657
complete-iteration_max0.206037073135376
complete-iteration_mean0.1998643477757772
complete-iteration_median0.2012794923782349
complete-iteration_min0.19086133321126303
deviation-center-line_max0.87285685043526
deviation-center-line_mean0.568330540981093
deviation-center-line_min0.3316067112568695
deviation-heading_max3.400059553451573
deviation-heading_mean2.7686446666047977
deviation-heading_median2.8767131454246133
deviation-heading_min1.9210928221183905
driven_any_max3.583300061561779
driven_any_mean3.207373550781204
driven_any_median3.1912509058752496
driven_any_min2.8636923298125376
driven_lanedir_consec_max3.540142561848756
driven_lanedir_consec_mean2.4297922428009096
driven_lanedir_consec_min0.6283922100052713
driven_lanedir_max3.540142561848756
driven_lanedir_mean2.5050583444978294
driven_lanedir_median2.898150887510875
driven_lanedir_min0.6837890411208136
get_duckie_state_max3.4817059834798177e-06
get_duckie_state_mean3.3454100290934244e-06
get_duckie_state_median3.335475921630859e-06
get_duckie_state_min3.228982289632162e-06
get_robot_state_max0.015593706766764324
get_robot_state_mean0.015151355266571048
get_robot_state_median0.015379878679911295
get_robot_state_min0.014251956939697266
get_state_dump_max0.013578240076700847
get_state_dump_mean0.01342832366625468
get_state_dump_median0.013444064458211264
get_state_dump_min0.013246925671895345
get_ui_image_max0.03524009625116984
get_ui_image_mean0.03454891443252563
get_ui_image_median0.034812577565511066
get_ui_image_min0.03333040634791056
in-drivable-lane_max10.50000000000006
in-drivable-lane_mean3.387500000000026
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.3021969901183414, "get_ui_image": 0.03333040634791056, "step_physics": 0.07396528482437134, "survival_time": 14.950000000000076, "driven_lanedir": 3.0151171806770662, "get_state_dump": 0.013246925671895345, "sim_render-ego": 0.0058272401491800945, "get_robot_state": 0.015189061959584554, "get_duckie_state": 3.3752123514811197e-06, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.017070531050364178, "deviation-heading": 3.0426733979497667, "complete-iteration": 0.19086133321126303, "set_robot_commands": 0.004699644247690837, "deviation-center-line": 0.6245916599857749, "driven_lanedir_consec": 3.0151171806770662, "sim_compute_sim_state": 0.023537766933441163, "sim_compute_performance-ego": 0.0038526415824890136}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.583300061561779, "get_ui_image": 0.03459847688674927, "step_physics": 0.07769282738367717, "survival_time": 14.950000000000076, "driven_lanedir": 3.540142561848756, "get_state_dump": 0.013547082742055258, "sim_render-ego": 0.006057094732920328, "get_robot_state": 0.015570695400238038, "get_duckie_state": 3.4817059834798177e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017176793416341145, "deviation-heading": 1.9210928221183905, "complete-iteration": 0.1973681934674581, "set_robot_commands": 0.0048734084765116375, "deviation-center-line": 0.444266942246468, "driven_lanedir_consec": 3.540142561848756, "sim_compute_sim_state": 0.023650529384613036, "sim_compute_performance-ego": 0.00405177116394043}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8636923298125376, "get_ui_image": 0.035026678244272864, "step_physics": 0.0843188238143921, "survival_time": 14.950000000000076, "driven_lanedir": 0.6837890411208136, "get_state_dump": 0.013578240076700847, "sim_render-ego": 0.006061788400014242, "get_robot_state": 0.015593706766764324, "get_duckie_state": 3.228982289632162e-06, "in-drivable-lane": 10.50000000000006, "agent_compute-ego": 0.017715009848276776, "deviation-heading": 2.7107528928994604, "complete-iteration": 0.20519079128901163, "set_robot_commands": 0.004864517052968343, "deviation-center-line": 0.3316067112568695, "driven_lanedir_consec": 0.6283922100052713, "sim_compute_sim_state": 0.023870178858439128, "sim_compute_performance-ego": 0.0040101019541422525}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.080304821632158, "get_ui_image": 0.03524009625116984, "step_physics": 0.08473421494166056, "survival_time": 14.950000000000076, "driven_lanedir": 2.7811845943446833, "get_state_dump": 0.01334104617436727, "sim_render-ego": 0.0058220752080281575, "get_robot_state": 0.014251956939697266, "get_duckie_state": 3.295739491780599e-06, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.016962769031524657, "deviation-heading": 3.400059553451573, "complete-iteration": 0.206037073135376, "set_robot_commands": 0.004503590265909831, "deviation-center-line": 0.87285685043526, "driven_lanedir_consec": 2.5355170186725444, "sim_compute_sim_state": 0.027223649024963378, "sim_compute_performance-ego": 0.0038116351763407383}}
set_robot_commands_max0.0048734084765116375
set_robot_commands_mean0.004735290010770162
set_robot_commands_median0.00478208065032959
set_robot_commands_min0.004503590265909831
sim_compute_performance-ego_max0.00405177116394043
sim_compute_performance-ego_mean0.003931537469228108
sim_compute_performance-ego_median0.003931371768315633
sim_compute_performance-ego_min0.0038116351763407383
sim_compute_sim_state_max0.027223649024963378
sim_compute_sim_state_mean0.024570531050364178
sim_compute_sim_state_median0.02376035412152608
sim_compute_sim_state_min0.023537766933441163
sim_render-ego_max0.006061788400014242
sim_render-ego_mean0.005942049622535706
sim_render-ego_median0.005942167441050212
sim_render-ego_min0.0058220752080281575
simulation-passed1
step_physics_max0.08473421494166056
step_physics_mean0.0801777877410253
step_physics_median0.08100582559903463
step_physics_min0.07396528482437134
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4310611606Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8519413926186762
survival_time_median5.374999999999989
deviation-center-line_median0.17694023231856648
in-drivable-lane_median1.4749999999999948


other stats
agent_compute-ego_max0.017544647057851154
agent_compute-ego_mean0.01724476545606285
agent_compute-ego_median0.017246445039566377
agent_compute-ego_min0.016941524687267485
complete-iteration_max0.19482653027489072
complete-iteration_mean0.1915311236803164
complete-iteration_median0.19189359654079785
complete-iteration_min0.1875107713647791
deviation-center-line_max0.3583814460450858
deviation-center-line_mean0.22058222182832385
deviation-center-line_min0.1700669766310764
deviation-heading_max1.358279121949328
deviation-heading_mean1.0752859175132448
deviation-heading_median1.0830700698385138
deviation-heading_min0.7767244084266232
driven_any_max3.1135025938964014
driven_any_mean1.9389251137004615
driven_any_median1.7596741146461348
driven_any_min1.1228496316131746
driven_lanedir_consec_max1.566362066895522
driven_lanedir_consec_mean0.9746528268897584
driven_lanedir_consec_min0.6283664554261585
driven_lanedir_max1.566362066895522
driven_lanedir_mean0.992986246047728
driven_lanedir_median0.8519413926186762
driven_lanedir_min0.7017001320580384
get_duckie_state_max2.631274136629972e-06
get_duckie_state_mean2.420851562330101e-06
get_duckie_state_median2.416852000239375e-06
get_duckie_state_min2.2184281122116817e-06
get_robot_state_max0.0147989576513117
get_robot_state_mean0.014014210316990823
get_robot_state_median0.014325374830234517
get_robot_state_min0.01260713395618257
get_state_dump_max0.013712985648049248
get_state_dump_mean0.013257325281788995
get_state_dump_median0.013180356734507792
get_state_dump_min0.012955602010091143
get_ui_image_max0.034621208906173706
get_ui_image_mean0.034117947808236175
get_ui_image_median0.03412952319884197
get_ui_image_min0.03359153592908705
in-drivable-lane_max6.299999999999987
in-drivable-lane_mean2.387499999999994
in-drivable-lane_min0.29999999999999893
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.1228496316131746, "get_ui_image": 0.034621208906173706, "step_physics": 0.07551671399010552, "survival_time": 3.599999999999995, "driven_lanedir": 0.951601933581194, "get_state_dump": 0.013712985648049248, "sim_render-ego": 0.005738841162787544, "get_robot_state": 0.013979362116919624, "get_duckie_state": 2.4172994825575088e-06, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.017544647057851154, "deviation-heading": 0.7767244084266232, "complete-iteration": 0.19243496656417847, "set_robot_commands": 0.00453981426027086, "deviation-center-line": 0.1700669766310764, "driven_lanedir_consec": 0.951601933581194, "sim_compute_sim_state": 0.022658911016252305, "sim_compute_performance-ego": 0.003980278968811035}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.803331703899277, "get_ui_image": 0.03461546464399858, "step_physics": 0.07529185251756147, "survival_time": 5.4999999999999885, "driven_lanedir": 0.7522808516561583, "get_state_dump": 0.013264966011047364, "sim_render-ego": 0.00566992542960427, "get_robot_state": 0.0147989576513117, "get_duckie_state": 2.631274136629972e-06, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.017336372895674274, "deviation-heading": 1.285127777080729, "complete-iteration": 0.1913522265174172, "set_robot_commands": 0.004621234807101163, "deviation-center-line": 0.1809875017108302, "driven_lanedir_consec": 0.7522808516561583, "sim_compute_sim_state": 0.02179700244556774, "sim_compute_performance-ego": 0.003814242102883079}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.1135025938964014, "get_ui_image": 0.03359153592908705, "step_physics": 0.07356468922383076, "survival_time": 9.249999999999996, "driven_lanedir": 0.7017001320580384, "get_state_dump": 0.013095747457968222, "sim_render-ego": 0.005608278996235615, "get_robot_state": 0.01467138754354941, "get_duckie_state": 2.4164045179212415e-06, "in-drivable-lane": 6.299999999999987, "agent_compute-ego": 0.017156517183458484, "deviation-heading": 1.358279121949328, "complete-iteration": 0.1875107713647791, "set_robot_commands": 0.0045567576949660845, "deviation-center-line": 0.1728929629263028, "driven_lanedir_consec": 0.6283664554261585, "sim_compute_sim_state": 0.021412930617461332, "sim_compute_performance-ego": 0.003719265396530564}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.7160165253929924, "get_ui_image": 0.03364358175368536, "step_physics": 0.0814325559706915, "survival_time": 5.249999999999989, "driven_lanedir": 1.566362066895522, "get_state_dump": 0.012955602010091143, "sim_render-ego": 0.005147109712873186, "get_robot_state": 0.01260713395618257, "get_duckie_state": 2.2184281122116817e-06, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.016941524687267485, "deviation-heading": 0.8810123625962987, "complete-iteration": 0.19482653027489072, "set_robot_commands": 0.004385984511602493, "deviation-center-line": 0.3583814460450858, "driven_lanedir_consec": 1.566362066895522, "sim_compute_sim_state": 0.02402495202564058, "sim_compute_performance-ego": 0.003550463631039574}}
set_robot_commands_max0.004621234807101163
set_robot_commands_mean0.00452594781848515
set_robot_commands_median0.004548285977618472
set_robot_commands_min0.004385984511602493
sim_compute_performance-ego_max0.003980278968811035
sim_compute_performance-ego_mean0.003766062524816064
sim_compute_performance-ego_median0.003766753749706821
sim_compute_performance-ego_min0.003550463631039574
sim_compute_sim_state_max0.02402495202564058
sim_compute_sim_state_mean0.02247344902623049
sim_compute_sim_state_median0.02222795673091002
sim_compute_sim_state_min0.021412930617461332
sim_render-ego_max0.005738841162787544
sim_render-ego_mean0.0055410388253751535
sim_render-ego_median0.005639102212919942
sim_render-ego_min0.005147109712873186
simulation-passed1
step_physics_max0.0814325559706915
step_physics_mean0.07645145292554731
step_physics_median0.0754042832538335
step_physics_min0.07356468922383076
survival_time_max9.249999999999996
survival_time_mean5.899999999999992
survival_time_min3.599999999999995
No reset possible
4308011602Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:06:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2475952518687876
survival_time_median9.800000000000004
deviation-center-line_median0.44658730610448993
in-drivable-lane_median3.1000000000000125


other stats
agent_compute-ego_max0.017991739406920317
agent_compute-ego_mean0.01751375665208741
agent_compute-ego_median0.017529633429974635
agent_compute-ego_min0.01700402034148005
complete-iteration_max0.21613837264434635
complete-iteration_mean0.19795780383812012
complete-iteration_median0.19640773568937325
complete-iteration_min0.18287737132938764
deviation-center-line_max0.750834969314129
deviation-center-line_mean0.4721135189467731
deviation-center-line_min0.24444449426398365
deviation-heading_max3.441645356761891
deviation-heading_mean2.5314043047154597
deviation-heading_median2.665381419019064
deviation-heading_min1.3532090240618204
driven_any_max3.052948391207642
driven_any_mean2.080491927009658
driven_any_median1.9834507595557267
driven_any_min1.3021177977195355
driven_lanedir_consec_max2.1688598544587574
driven_lanedir_consec_mean1.3050451862296637
driven_lanedir_consec_min0.5561303867223215
driven_lanedir_max2.1688598544587574
driven_lanedir_mean1.320273162852773
driven_lanedir_median1.2780512051150068
driven_lanedir_min0.5561303867223215
get_duckie_state_max2.694885115817662e-06
get_duckie_state_mean2.5285383993993223e-06
get_duckie_state_median2.564861063371625e-06
get_duckie_state_min2.2895463550363788e-06
get_robot_state_max0.015860871491928445
get_robot_state_mean0.01509112252914217
get_robot_state_median0.015648423656385545
get_robot_state_min0.013206771311869148
get_state_dump_max0.013378276005050175
get_state_dump_mean0.013195513842917214
get_state_dump_median0.013270351043221546
get_state_dump_min0.012863077280175597
get_ui_image_max0.036627010992395945
get_ui_image_mean0.034812557159026314
get_ui_image_median0.03471205103990719
get_ui_image_min0.03319911556389495
in-drivable-lane_max4.10000000000002
in-drivable-lane_mean2.837500000000013
in-drivable-lane_min1.0500000000000052
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.052948391207642, "get_ui_image": 0.0340270471572876, "step_physics": 0.07435860474904378, "survival_time": 14.950000000000076, "driven_lanedir": 2.1688598544587574, "get_state_dump": 0.01320853312810262, "sim_render-ego": 0.005819992224375407, "get_robot_state": 0.0157885734240214, "get_duckie_state": 2.5280316670735677e-06, "in-drivable-lane": 3.450000000000035, "agent_compute-ego": 0.017616669336954754, "deviation-heading": 3.441645356761891, "complete-iteration": 0.1932839075724284, "set_robot_commands": 0.004775564670562744, "deviation-center-line": 0.750834969314129, "driven_lanedir_consec": 2.1688598544587574, "sim_compute_sim_state": 0.023591012159983316, "sim_compute_performance-ego": 0.003953673044840495}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3021177977195355, "get_ui_image": 0.03319911556389495, "step_physics": 0.07204290382734692, "survival_time": 6.549999999999985, "driven_lanedir": 0.5561303867223215, "get_state_dump": 0.012863077280175597, "sim_render-ego": 0.00548861772959469, "get_robot_state": 0.013206771311869148, "get_duckie_state": 2.2895463550363788e-06, "in-drivable-lane": 2.7499999999999902, "agent_compute-ego": 0.01700402034148005, "deviation-heading": 2.157449403040926, "complete-iteration": 0.18287737132938764, "set_robot_commands": 0.004257755425140148, "deviation-center-line": 0.24444449426398365, "driven_lanedir_consec": 0.5561303867223215, "sim_compute_sim_state": 0.02099687088536852, "sim_compute_performance-ego": 0.00368190357703289}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.245467481713254, "get_ui_image": 0.03539705492252678, "step_physics": 0.07930166365334351, "survival_time": 11.050000000000022, "driven_lanedir": 1.0929178786666611, "get_state_dump": 0.013378276005050175, "sim_render-ego": 0.005992745921622574, "get_robot_state": 0.015860871491928445, "get_duckie_state": 2.694885115817662e-06, "in-drivable-lane": 4.10000000000002, "agent_compute-ego": 0.017442597522994513, "deviation-heading": 3.173313434997201, "complete-iteration": 0.1995315638063181, "set_robot_commands": 0.005010876720307639, "deviation-center-line": 0.4104342021810655, "driven_lanedir_consec": 1.0320059721742227, "sim_compute_sim_state": 0.02292027840247521, "sim_compute_performance-ego": 0.0040758702549999115}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.7214340373981996, "get_ui_image": 0.036627010992395945, "step_physics": 0.09101270932203148, "survival_time": 8.549999999999986, "driven_lanedir": 1.4631845315633525, "get_state_dump": 0.013332168958340471, "sim_render-ego": 0.005990814744380482, "get_robot_state": 0.015508273888749686, "get_duckie_state": 2.601690459669682e-06, "in-drivable-lane": 1.0500000000000052, "agent_compute-ego": 0.017991739406920317, "deviation-heading": 1.3532090240618204, "complete-iteration": 0.21613837264434635, "set_robot_commands": 0.004856013415152566, "deviation-center-line": 0.4827404100279144, "driven_lanedir_consec": 1.4631845315633525, "sim_compute_sim_state": 0.026527481469494556, "sim_compute_performance-ego": 0.004134804184673823}}
set_robot_commands_max0.005010876720307639
set_robot_commands_mean0.004725052557790774
set_robot_commands_median0.004815789042857655
set_robot_commands_min0.004257755425140148
sim_compute_performance-ego_max0.004134804184673823
sim_compute_performance-ego_mean0.00396156276538678
sim_compute_performance-ego_median0.004014771649920203
sim_compute_performance-ego_min0.00368190357703289
sim_compute_sim_state_max0.026527481469494556
sim_compute_sim_state_mean0.023508910729330403
sim_compute_sim_state_median0.023255645281229264
sim_compute_sim_state_min0.02099687088536852
sim_render-ego_max0.005992745921622574
sim_render-ego_mean0.005823042654993288
sim_render-ego_median0.005905403484377944
sim_render-ego_min0.00548861772959469
simulation-passed1
step_physics_max0.09101270932203148
step_physics_mean0.07917897038794142
step_physics_median0.07683013420119364
step_physics_min0.07204290382734692
survival_time_max14.950000000000076
survival_time_mean10.275000000000016
survival_time_min6.549999999999985
No reset possible
4305011591Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:06:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 593 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4303511589Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:05:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 440 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4300611584Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:03:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 208 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4300311583Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:03:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 156 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4299411580Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:03:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 140 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4297411575Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.272419019491887
survival_time_median14.950000000000076
deviation-center-line_median0.6877422111809708
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.020463165442148844
agent_compute-ego_mean0.019681639472643536
agent_compute-ego_median0.01964674433072408
agent_compute-ego_min0.018969903786977133
complete-iteration_max0.1826171906789144
complete-iteration_mean0.17713365256786345
complete-iteration_median0.1768843420346578
complete-iteration_min0.17214873552322388
deviation-center-line_max0.7928013344265519
deviation-center-line_mean0.6890401746397148
deviation-center-line_min0.5878749417703659
deviation-heading_max3.713177205475293
deviation-heading_mean2.4238114162780553
deviation-heading_median2.223539813944118
deviation-heading_min1.5349888317486913
driven_any_max5.951984405568851
driven_any_mean5.238608328061652
driven_any_median5.383412765525547
driven_any_min4.2356233756266635
driven_lanedir_consec_max5.900747905893505
driven_lanedir_consec_mean5.123304356394073
driven_lanedir_consec_min4.0476314806990095
driven_lanedir_max5.900747905893505
driven_lanedir_mean5.123304356394073
driven_lanedir_median5.272419019491887
driven_lanedir_min4.0476314806990095
get_duckie_state_max2.3253758748372397e-06
get_duckie_state_mean2.1541118621826172e-06
get_duckie_state_median2.121130625406901e-06
get_duckie_state_min2.048810323079427e-06
get_robot_state_max0.01124158223470052
get_robot_state_mean0.01118385910987854
get_robot_state_median0.01117822011311849
get_robot_state_min0.01113741397857666
get_state_dump_max0.011906564235687256
get_state_dump_mean0.011823354363441467
get_state_dump_median0.011852344274520874
get_state_dump_min0.011682164669036866
get_ui_image_max0.033221440315246584
get_ui_image_mean0.032059280673662816
get_ui_image_median0.03178301572799683
get_ui_image_min0.03144965092341105
in-drivable-lane_max0.15000000000000213
in-drivable-lane_mean0.03750000000000053
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.951984405568851, "get_ui_image": 0.03175861358642578, "step_physics": 0.06730661153793335, "survival_time": 14.950000000000076, "driven_lanedir": 5.900747905893505, "get_state_dump": 0.011896395683288574, "sim_render-ego": 0.005124903519948323, "get_robot_state": 0.011153559684753418, "get_duckie_state": 2.048810323079427e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.020060130755106608, "deviation-heading": 1.5349888317486913, "complete-iteration": 0.17765652815500896, "set_robot_commands": 0.00452423095703125, "deviation-center-line": 0.6018542962653206, "driven_lanedir_consec": 5.900747905893505, "sim_compute_sim_state": 0.022219463984171548, "sim_compute_performance-ego": 0.0034804717699686684}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.802933229310911, "get_ui_image": 0.03144965092341105, "step_physics": 0.06430948098500569, "survival_time": 14.950000000000076, "driven_lanedir": 5.686348674264744, "get_state_dump": 0.011906564235687256, "sim_render-ego": 0.004845422108968099, "get_robot_state": 0.01124158223470052, "get_duckie_state": 2.3253758748372397e-06, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.018969903786977133, "deviation-heading": 1.8643484657049856, "complete-iteration": 0.17214873552322388, "set_robot_commands": 0.004462367693583171, "deviation-center-line": 0.7928013344265519, "driven_lanedir_consec": 5.686348674264744, "sim_compute_sim_state": 0.02151421308517456, "sim_compute_performance-ego": 0.0033206931749979653}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.2356233756266635, "get_ui_image": 0.031807417869567874, "step_physics": 0.0662430191040039, "survival_time": 14.950000000000076, "driven_lanedir": 4.0476314806990095, "get_state_dump": 0.011682164669036866, "sim_render-ego": 0.005058221817016602, "get_robot_state": 0.01120288054148356, "get_duckie_state": 2.0917256673177084e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.020463165442148844, "deviation-heading": 3.713177205475293, "complete-iteration": 0.17611215591430665, "set_robot_commands": 0.004447542031606039, "deviation-center-line": 0.7736301260966209, "driven_lanedir_consec": 4.0476314806990095, "sim_compute_sim_state": 0.021664084593454997, "sim_compute_performance-ego": 0.003409458001454671}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.963892301740183, "get_ui_image": 0.033221440315246584, "step_physics": 0.0698578151067098, "survival_time": 14.950000000000076, "driven_lanedir": 4.858489364719031, "get_state_dump": 0.011808292865753174, "sim_render-ego": 0.004928245544433594, "get_robot_state": 0.01113741397857666, "get_duckie_state": 2.1505355834960936e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.019233357906341553, "deviation-heading": 2.5827311621832503, "complete-iteration": 0.1826171906789144, "set_robot_commands": 0.00456378698348999, "deviation-center-line": 0.5878749417703659, "driven_lanedir_consec": 4.858489364719031, "sim_compute_sim_state": 0.024406882921854656, "sim_compute_performance-ego": 0.003331275780995687}}
set_robot_commands_max0.00456378698348999
set_robot_commands_mean0.004499481916427613
set_robot_commands_median0.004493299325307211
set_robot_commands_min0.004447542031606039
sim_compute_performance-ego_max0.0034804717699686684
sim_compute_performance-ego_mean0.003385474681854248
sim_compute_performance-ego_median0.0033703668912251792
sim_compute_performance-ego_min0.0033206931749979653
sim_compute_sim_state_max0.024406882921854656
sim_compute_sim_state_mean0.02245116114616394
sim_compute_sim_state_median0.021941774288813273
sim_compute_sim_state_min0.02151421308517456
sim_render-ego_max0.005124903519948323
sim_render-ego_mean0.004989198247591654
sim_render-ego_median0.0049932336807250975
sim_render-ego_min0.004845422108968099
simulation-passed1
step_physics_max0.0698578151067098
step_physics_mean0.06692923168341319
step_physics_median0.06677481532096863
step_physics_min0.06430948098500569
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4297011574Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6028715316417057
survival_time_median14.950000000000076
deviation-center-line_median0.6978439192759769
in-drivable-lane_median5.725000000000064


other stats
agent_compute-ego_max0.01987186352411906
agent_compute-ego_mean0.019754810955925906
agent_compute-ego_median0.019818090200424195
agent_compute-ego_min0.019511199898736172
complete-iteration_max0.1813640332221985
complete-iteration_mean0.1766033496008706
complete-iteration_median0.17667169173558553
complete-iteration_min0.17170598171011278
deviation-center-line_max1.4157903005434296
deviation-center-line_mean0.7453359225998835
deviation-center-line_min0.16986555130415046
deviation-heading_max4.808278241903188
deviation-heading_mean2.2432719216552615
deviation-heading_median1.7556181821225856
deviation-heading_min0.6535730804726871
driven_any_max5.032107998690584
driven_any_mean3.23852559698294
driven_any_median3.066027356986025
driven_any_min1.789939675269126
driven_lanedir_consec_max4.305490229804849
driven_lanedir_consec_mean2.7061070402692065
driven_lanedir_consec_min1.3131948679885657
driven_lanedir_max4.305490229804849
driven_lanedir_mean2.7087530459618865
driven_lanedir_median2.6081635430270658
driven_lanedir_min1.3131948679885657
get_duckie_state_max2.1457672119140625e-06
get_duckie_state_mean2.0815211882705954e-06
get_duckie_state_median2.075036366780599e-06
get_duckie_state_min2.03024480760712e-06
get_robot_state_max0.011597020626068115
get_robot_state_mean0.011343455869717288
get_robot_state_median0.011323680398390466
get_robot_state_min0.011129442056020102
get_state_dump_max0.012170581817626954
get_state_dump_mean0.011886108206309814
get_state_dump_median0.011797942095196124
get_state_dump_min0.011777966817220051
get_ui_image_max0.032099411487579346
get_ui_image_mean0.03173484583695729
get_ui_image_median0.031754017670949305
get_ui_image_min0.031331936518351235
in-drivable-lane_max10.950000000000085
in-drivable-lane_mean6.012500000000057
in-drivable-lane_min1.6500000000000172
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.789939675269126, "get_ui_image": 0.031458726723988854, "step_physics": 0.06573891401290893, "survival_time": 14.950000000000076, "driven_lanedir": 1.3131948679885657, "get_state_dump": 0.012170581817626954, "sim_render-ego": 0.005168445905049642, "get_robot_state": 0.011597020626068115, "get_duckie_state": 2.1457672119140625e-06, "in-drivable-lane": 10.950000000000085, "agent_compute-ego": 0.01982380469640096, "deviation-heading": 0.6535730804726871, "complete-iteration": 0.1755532177289327, "set_robot_commands": 0.0044830083847045895, "deviation-center-line": 0.16986555130415046, "driven_lanedir_consec": 1.3131948679885657, "sim_compute_sim_state": 0.021530797481536867, "sim_compute_performance-ego": 0.003453060785929362}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.032107998690584, "get_ui_image": 0.031331936518351235, "step_physics": 0.06358301680522277, "survival_time": 14.550000000000072, "driven_lanedir": 4.305490229804849, "get_state_dump": 0.011810075786105548, "sim_render-ego": 0.004981459620891977, "get_robot_state": 0.011342175637733484, "get_duckie_state": 2.03024480760712e-06, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.019511199898736172, "deviation-heading": 2.142160504275571, "complete-iteration": 0.17170598171011278, "set_robot_commands": 0.004405786900995523, "deviation-center-line": 0.9210301657560168, "driven_lanedir_consec": 4.305490229804849, "sim_compute_sim_state": 0.021210024856619818, "sim_compute_performance-ego": 0.003404564873869066}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.109554868463818, "get_ui_image": 0.032099411487579346, "step_physics": 0.06913179238637289, "survival_time": 14.950000000000076, "driven_lanedir": 1.6575846404509875, "get_state_dump": 0.011777966817220051, "sim_render-ego": 0.0049588974316914875, "get_robot_state": 0.011129442056020102, "get_duckie_state": 2.063115437825521e-06, "in-drivable-lane": 8.950000000000092, "agent_compute-ego": 0.01987186352411906, "deviation-heading": 1.3690758599696002, "complete-iteration": 0.17779016574223835, "set_robot_commands": 0.004476009209950765, "deviation-center-line": 0.4746576727959369, "driven_lanedir_consec": 1.6575846404509875, "sim_compute_sim_state": 0.020905661582946777, "sim_compute_performance-ego": 0.0033139459292093913}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.022499845508232, "get_ui_image": 0.03204930861790975, "step_physics": 0.06928629398345948, "survival_time": 14.950000000000076, "driven_lanedir": 3.558742445603144, "get_state_dump": 0.011785808404286705, "sim_render-ego": 0.004968756834665934, "get_robot_state": 0.011305185159047444, "get_duckie_state": 2.086957295735677e-06, "in-drivable-lane": 1.6500000000000172, "agent_compute-ego": 0.019812375704447428, "deviation-heading": 4.808278241903188, "complete-iteration": 0.1813640332221985, "set_robot_commands": 0.004393761952718099, "deviation-center-line": 1.4157903005434296, "driven_lanedir_consec": 3.548158422832424, "sim_compute_sim_state": 0.0242751415570577, "sim_compute_performance-ego": 0.0033601760864257813}}
set_robot_commands_max0.0044830083847045895
set_robot_commands_mean0.004439641612092244
set_robot_commands_median0.004440898055473144
set_robot_commands_min0.004393761952718099
sim_compute_performance-ego_max0.003453060785929362
sim_compute_performance-ego_mean0.0033829369188584
sim_compute_performance-ego_median0.003382370480147424
sim_compute_performance-ego_min0.0033139459292093913
sim_compute_sim_state_max0.0242751415570577
sim_compute_sim_state_mean0.021980406369540288
sim_compute_sim_state_median0.02137041116907834
sim_compute_sim_state_min0.020905661582946777
sim_render-ego_max0.005168445905049642
sim_render-ego_mean0.00501938994807476
sim_render-ego_median0.004975108227778956
sim_render-ego_min0.0049588974316914875
simulation-passed1
step_physics_max0.06928629398345948
step_physics_mean0.06693500429699102
step_physics_median0.06743535319964092
step_physics_min0.06358301680522277
survival_time_max14.950000000000076
survival_time_mean14.850000000000076
survival_time_min14.550000000000072
No reset possible
4294811570Bhavya Patwa 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:06:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30163709225190094
survival_time_median10.87500000000003
deviation-center-line_median0.174984554746127
in-drivable-lane_median6.925000000000036


other stats
agent_compute-ego_max0.01708279053370158
agent_compute-ego_mean0.016756708896627615
agent_compute-ego_median0.016841269661398494
agent_compute-ego_min0.016261505730011883
complete-iteration_max0.1931641205151876
complete-iteration_mean0.17836265674993104
complete-iteration_median0.1752548037557041
complete-iteration_min0.16977689897312837
deviation-center-line_max0.26857996047138716
deviation-center-line_mean0.19625158960378117
deviation-center-line_min0.16645728845148342
deviation-heading_max1.462948735630048
deviation-heading_mean1.1123108323419282
deviation-heading_median1.070634948762851
deviation-heading_min0.8450246962119621
driven_any_max1.9399929047664837
driven_any_mean1.2845009347121197
driven_any_median1.398939222660296
driven_any_min0.4001323887614028
driven_lanedir_consec_max0.5910777965649623
driven_lanedir_consec_mean0.3666334738244075
driven_lanedir_consec_min0.27218191422886573
driven_lanedir_max0.5910777965649623
driven_lanedir_mean0.3666334738244075
driven_lanedir_median0.30163709225190094
driven_lanedir_min0.27218191422886573
get_duckie_state_max2.4215380350748697e-06
get_duckie_state_mean2.259997760548311e-06
get_duckie_state_median2.239849053177179e-06
get_duckie_state_min2.138754900764017e-06
get_robot_state_max0.0136735995610555
get_robot_state_mean0.011998572565761268
get_robot_state_median0.011442311371074003
get_robot_state_min0.01143606795984156
get_state_dump_max0.01247564156850179
get_state_dump_mean0.012180544038613636
get_state_dump_median0.012135858886382158
get_state_dump_min0.01197481681318844
get_ui_image_max0.03367537419001261
get_ui_image_mean0.03246844967790678
get_ui_image_median0.03220862798831042
get_ui_image_min0.03178116854499368
in-drivable-lane_max12.250000000000078
in-drivable-lane_mean6.650000000000038
in-drivable-lane_min0.4999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.4001323887614028, "get_ui_image": 0.03178116854499368, "step_physics": 0.06716213857426363, "survival_time": 3.399999999999996, "driven_lanedir": 0.3074850069699444, "get_state_dump": 0.012194658026975743, "sim_render-ego": 0.004907758796916288, "get_robot_state": 0.01144349925658282, "get_duckie_state": 2.138754900764017e-06, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.016828186371747184, "deviation-heading": 0.8450246962119621, "complete-iteration": 0.17217887850368724, "set_robot_commands": 0.004591489539426916, "deviation-center-line": 0.17431858477573592, "driven_lanedir_consec": 0.3074850069699444, "sim_compute_sim_state": 0.01976240031859454, "sim_compute_performance-ego": 0.0033796114080092486}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.93999112984439, "get_ui_image": 0.032246387004852294, "step_physics": 0.0724509064356486, "survival_time": 14.950000000000076, "driven_lanedir": 0.5910777965649623, "get_state_dump": 0.012077059745788574, "sim_render-ego": 0.005078738530476888, "get_robot_state": 0.011441123485565186, "get_duckie_state": 2.284844716389974e-06, "in-drivable-lane": 9.850000000000088, "agent_compute-ego": 0.016854352951049804, "deviation-heading": 1.462948735630048, "complete-iteration": 0.17833072900772096, "set_robot_commands": 0.0045015438397725425, "deviation-center-line": 0.26857996047138716, "driven_lanedir_consec": 0.5910777965649623, "sim_compute_sim_state": 0.0201514466603597, "sim_compute_performance-ego": 0.003402552604675293}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.8578873154762016, "get_ui_image": 0.032170868971768546, "step_physics": 0.06538416883524727, "survival_time": 6.799999999999984, "driven_lanedir": 0.2957891775338575, "get_state_dump": 0.01197481681318844, "sim_render-ego": 0.0049647040226880245, "get_robot_state": 0.01143606795984156, "get_duckie_state": 2.194853389964384e-06, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.016261505730011883, "deviation-heading": 1.0249959393027368, "complete-iteration": 0.16977689897312837, "set_robot_commands": 0.004446346970165477, "deviation-center-line": 0.17565052471651812, "driven_lanedir_consec": 0.2957891775338575, "sim_compute_sim_state": 0.01961987158831428, "sim_compute_performance-ego": 0.0033876685535206516}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399929047664837, "get_ui_image": 0.03367537419001261, "step_physics": 0.0786898406346639, "survival_time": 14.950000000000076, "driven_lanedir": 0.27218191422886573, "get_state_dump": 0.01247564156850179, "sim_render-ego": 0.005424760977427165, "get_robot_state": 0.0136735995610555, "get_duckie_state": 2.4215380350748697e-06, "in-drivable-lane": 12.250000000000078, "agent_compute-ego": 0.01708279053370158, "deviation-heading": 1.116273958222965, "complete-iteration": 0.1931641205151876, "set_robot_commands": 0.004579719702402751, "deviation-center-line": 0.16645728845148342, "driven_lanedir_consec": 0.27218191422886573, "sim_compute_sim_state": 0.02382351636886597, "sim_compute_performance-ego": 0.003602128028869629}}
set_robot_commands_max0.004591489539426916
set_robot_commands_mean0.004529775012941922
set_robot_commands_median0.004540631771087647
set_robot_commands_min0.004446346970165477
sim_compute_performance-ego_max0.003602128028869629
sim_compute_performance-ego_mean0.003442990148768705
sim_compute_performance-ego_median0.0033951105790979725
sim_compute_performance-ego_min0.0033796114080092486
sim_compute_sim_state_max0.02382351636886597
sim_compute_sim_state_mean0.020839308734033623
sim_compute_sim_state_median0.01995692348947712
sim_compute_sim_state_min0.01961987158831428
sim_render-ego_max0.005424760977427165
sim_render-ego_mean0.005093990581877091
sim_render-ego_median0.005021721276582456
sim_render-ego_min0.004907758796916288
simulation-passed1
step_physics_max0.0786898406346639
step_physics_mean0.07092176361995585
step_physics_median0.06980652250495611
step_physics_min0.06538416883524727
survival_time_max14.950000000000076
survival_time_mean10.025000000000034
survival_time_min3.399999999999996
No reset possible
4294411568Dishank Bansal 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:03:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 146 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4293311566Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5648871943822542
survival_time_median14.950000000000076
deviation-center-line_median0.5588191816691852
in-drivable-lane_median6.67500000000004


other stats
agent_compute-ego_max0.017596471309661865
agent_compute-ego_mean0.016972653552105553
agent_compute-ego_median0.016812494993209838
agent_compute-ego_min0.016669152912340664
complete-iteration_max0.1839536174138387
complete-iteration_mean0.1825052379725272
complete-iteration_median0.18273958467600637
complete-iteration_min0.1805881651242574
deviation-center-line_max0.8833488874058629
deviation-center-line_mean0.5612431600673724
deviation-center-line_min0.24398538952525609
deviation-heading_max2.1533441060273963
deviation-heading_mean1.3940151305820516
deviation-heading_median1.542386747272157
deviation-heading_min0.33794292175649576
driven_any_max3.838401314302475
driven_any_mean2.842084639854768
driven_any_median3.144675718140645
driven_any_min1.240585808835307
driven_lanedir_consec_max2.721116891559764
driven_lanedir_consec_mean1.684027328971464
driven_lanedir_consec_min0.8852180355615835
driven_lanedir_max2.721116891559764
driven_lanedir_mean1.684027328971464
driven_lanedir_median1.5648871943822542
driven_lanedir_min0.8852180355615835
get_duckie_state_max4.179477691650391e-06
get_duckie_state_mean3.6294000190601017e-06
get_duckie_state_median3.49854168139006e-06
get_duckie_state_min3.341039021809896e-06
get_robot_state_max0.015070629119873048
get_robot_state_mean0.013129286964734395
get_robot_state_median0.01265716274579366
get_robot_state_min0.012132193247477214
get_state_dump_max0.013231375342921207
get_state_dump_mean0.012769811780829178
get_state_dump_median0.012654863595962525
get_state_dump_min0.01253814458847046
get_ui_image_max0.032999562422434486
get_ui_image_mean0.032423817891823616
get_ui_image_median0.03253410736719767
get_ui_image_min0.03162749441046464
in-drivable-lane_max8.250000000000092
in-drivable-lane_mean5.862500000000041
in-drivable-lane_min1.8499999999999936
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.240585808835307, "get_ui_image": 0.03162749441046464, "step_physics": 0.06959833847848992, "survival_time": 4.749999999999991, "driven_lanedir": 0.8852180355615835, "get_state_dump": 0.013231375342921207, "sim_render-ego": 0.005732787282843339, "get_robot_state": 0.015070629119873048, "get_duckie_state": 3.5185562936883225e-06, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.016669152912340664, "deviation-heading": 0.33794292175649576, "complete-iteration": 0.18286464339808417, "set_robot_commands": 0.004707517121967516, "deviation-center-line": 0.24398538952525609, "driven_lanedir_consec": 0.8852180355615835, "sim_compute_sim_state": 0.022317941565262643, "sim_compute_performance-ego": 0.003769279781140779}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.393447726961783, "get_ui_image": 0.03222212076187134, "step_physics": 0.07103472153345744, "survival_time": 14.950000000000076, "driven_lanedir": 1.7702612474036412, "get_state_dump": 0.01253814458847046, "sim_render-ego": 0.005237405300140381, "get_robot_state": 0.01270219087600708, "get_duckie_state": 4.179477691650391e-06, "in-drivable-lane": 7.300000000000042, "agent_compute-ego": 0.01688553730646769, "deviation-heading": 2.1533441060273963, "complete-iteration": 0.1805881651242574, "set_robot_commands": 0.0044565335909525555, "deviation-center-line": 0.8833488874058629, "driven_lanedir_consec": 1.7702612474036412, "sim_compute_sim_state": 0.021836926937103273, "sim_compute_performance-ego": 0.003541407585144043}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8959037093195077, "get_ui_image": 0.032999562422434486, "step_physics": 0.0711360518137614, "survival_time": 14.950000000000076, "driven_lanedir": 1.3595131413608672, "get_state_dump": 0.012666001319885252, "sim_render-ego": 0.005325867335001628, "get_robot_state": 0.01261213461558024, "get_duckie_state": 3.341039021809896e-06, "in-drivable-lane": 8.250000000000092, "agent_compute-ego": 0.017596471309661865, "deviation-heading": 1.9568381666565084, "complete-iteration": 0.18261452595392863, "set_robot_commands": 0.004452510674794515, "deviation-center-line": 0.4610677013035668, "driven_lanedir_consec": 1.3595131413608672, "sim_compute_sim_state": 0.02216220458348592, "sim_compute_performance-ego": 0.0035314393043518067}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.838401314302475, "get_ui_image": 0.032846093972524006, "step_physics": 0.07154338200887045, "survival_time": 14.950000000000076, "driven_lanedir": 2.721116891559764, "get_state_dump": 0.012643725872039794, "sim_render-ego": 0.005142780145009359, "get_robot_state": 0.012132193247477214, "get_duckie_state": 3.478527069091797e-06, "in-drivable-lane": 6.050000000000037, "agent_compute-ego": 0.016739452679951985, "deviation-heading": 1.1279353278878057, "complete-iteration": 0.1839536174138387, "set_robot_commands": 0.004458854993184408, "deviation-center-line": 0.6565706620348036, "driven_lanedir_consec": 2.721116891559764, "sim_compute_sim_state": 0.02483314752578735, "sim_compute_performance-ego": 0.003482067584991455}}
set_robot_commands_max0.004707517121967516
set_robot_commands_mean0.004518854095224749
set_robot_commands_median0.004457694292068482
set_robot_commands_min0.004452510674794515
sim_compute_performance-ego_max0.003769279781140779
sim_compute_performance-ego_mean0.0035810485639070208
sim_compute_performance-ego_median0.0035364234447479246
sim_compute_performance-ego_min0.003482067584991455
sim_compute_sim_state_max0.02483314752578735
sim_compute_sim_state_mean0.022787555152909797
sim_compute_sim_state_median0.022240073074374284
sim_compute_sim_state_min0.021836926937103273
sim_render-ego_max0.005732787282843339
sim_render-ego_mean0.005359710015748677
sim_render-ego_median0.005281636317571004
sim_render-ego_min0.005142780145009359
simulation-passed1
step_physics_max0.07154338200887045
step_physics_mean0.07082812345864481
step_physics_median0.07108538667360942
step_physics_min0.06959833847848992
survival_time_max14.950000000000076
survival_time_mean12.400000000000055
survival_time_min4.749999999999991
No reset possible
4292011563Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:03:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 116 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4291411561Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.974058803937767
survival_time_median14.950000000000076
deviation-center-line_median0.7024653502447495
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.017653390566507974
agent_compute-ego_mean0.01727960765361786
agent_compute-ego_median0.01726425051689148
agent_compute-ego_min0.0169365390141805
complete-iteration_max0.1936476683616638
complete-iteration_mean0.17841785550117492
complete-iteration_median0.1742467967669169
complete-iteration_min0.17153016010920208
deviation-center-line_max0.831181629631743
deviation-center-line_mean0.6712931522706075
deviation-center-line_min0.449060278961188
deviation-heading_max1.4945446194037912
deviation-heading_mean1.1346575749111996
deviation-heading_median1.1090456187815614
deviation-heading_min0.8259944426778839
driven_any_max0.9802099155418648
driven_any_mean0.9794110554326788
driven_any_median0.9802082712538128
driven_any_min0.9770177636812252
driven_lanedir_consec_max0.9758032753111548
driven_lanedir_consec_mean0.9743745672206524
driven_lanedir_consec_min0.9735773856959212
driven_lanedir_max0.9758032753111548
driven_lanedir_mean0.9743745672206524
driven_lanedir_median0.974058803937767
driven_lanedir_min0.9735773856959212
get_duckie_state_max3.269513448079427e-06
get_duckie_state_mean3.196597099304199e-06
get_duckie_state_median3.188451131184896e-06
get_duckie_state_min3.139972686767578e-06
get_robot_state_max0.011977870464324952
get_robot_state_mean0.01166434665520986
get_robot_state_median0.0115895410378774
get_robot_state_min0.011500434080759684
get_state_dump_max0.012206141153971357
get_state_dump_mean0.011986970702807107
get_state_dump_median0.011942689816157023
get_state_dump_min0.011856362024943034
get_ui_image_max0.03328448931376139
get_ui_image_mean0.03216929356257121
get_ui_image_median0.031993711789449056
get_ui_image_min0.03140526135762533
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.9770177636812252, "get_ui_image": 0.03140526135762533, "step_physics": 0.06602217435836792, "survival_time": 14.950000000000076, "driven_lanedir": 0.9741161373891114, "get_state_dump": 0.011939167181650796, "sim_render-ego": 0.005045911471048991, "get_robot_state": 0.011574896176656089, "get_duckie_state": 3.196398417154948e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0169365390141805, "deviation-heading": 0.8259944426778839, "complete-iteration": 0.17153016010920208, "set_robot_commands": 0.004509019056955973, "deviation-center-line": 0.6735007855891344, "driven_lanedir_consec": 0.9741161373891114, "sim_compute_sim_state": 0.02057477633158366, "sim_compute_performance-ego": 0.003394635518391927}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.9802093947594632, "get_ui_image": 0.031743080615997316, "step_physics": 0.0669133488337199, "survival_time": 14.950000000000076, "driven_lanedir": 0.9758032753111548, "get_state_dump": 0.012206141153971357, "sim_render-ego": 0.005126091639200846, "get_robot_state": 0.011977870464324952, "get_duckie_state": 3.269513448079427e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017653390566507974, "deviation-heading": 1.0812724054424836, "complete-iteration": 0.17340831995010375, "set_robot_commands": 0.004504961172739665, "deviation-center-line": 0.7314299149003648, "driven_lanedir_consec": 0.9758032753111548, "sim_compute_sim_state": 0.01963425636291504, "sim_compute_performance-ego": 0.0035147356986999514}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.9802071477481624, "get_ui_image": 0.032244342962900796, "step_physics": 0.06925274531046549, "survival_time": 14.950000000000076, "driven_lanedir": 0.9735773856959212, "get_state_dump": 0.011856362024943034, "sim_render-ego": 0.004983596801757813, "get_robot_state": 0.011500434080759684, "get_duckie_state": 3.1805038452148437e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017442235151926676, "deviation-heading": 1.4945446194037912, "complete-iteration": 0.17508527358373005, "set_robot_commands": 0.00443593422571818, "deviation-center-line": 0.449060278961188, "driven_lanedir_consec": 0.9735773856959212, "sim_compute_sim_state": 0.019868263403574626, "sim_compute_performance-ego": 0.003370371659596761}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.9802099155418648, "get_ui_image": 0.03328448931376139, "step_physics": 0.08410388231277466, "survival_time": 14.950000000000076, "driven_lanedir": 0.9740014704864226, "get_state_dump": 0.01194621245066325, "sim_render-ego": 0.004975708325703939, "get_robot_state": 0.011604185899098712, "get_duckie_state": 3.139972686767578e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017086265881856282, "deviation-heading": 1.1368188321206392, "complete-iteration": 0.1936476683616638, "set_robot_commands": 0.004517640272776286, "deviation-center-line": 0.831181629631743, "driven_lanedir_consec": 0.9740014704864226, "sim_compute_sim_state": 0.022624900341033937, "sim_compute_performance-ego": 0.00337467908859253}}
set_robot_commands_max0.004517640272776286
set_robot_commands_mean0.0044918886820475255
set_robot_commands_median0.004506990114847819
set_robot_commands_min0.00443593422571818
sim_compute_performance-ego_max0.0035147356986999514
sim_compute_performance-ego_mean0.0034136054913202923
sim_compute_performance-ego_median0.003384657303492228
sim_compute_performance-ego_min0.003370371659596761
sim_compute_sim_state_max0.022624900341033937
sim_compute_sim_state_mean0.020675549109776818
sim_compute_sim_state_median0.02022151986757914
sim_compute_sim_state_min0.01963425636291504
sim_render-ego_max0.005126091639200846
sim_render-ego_mean0.005032827059427897
sim_render-ego_median0.005014754136403402
sim_render-ego_min0.004975708325703939
simulation-passed1
step_physics_max0.08410388231277466
step_physics_mean0.071573037703832
step_physics_median0.0680830470720927
step_physics_min0.06602217435836792
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4290811560Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:03:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 162 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4285711548Himanshu Arora 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.566916130427665
survival_time_median14.950000000000076
deviation-center-line_median0.6427227184000531
in-drivable-lane_median1.9500000000000008


other stats
agent_compute-ego_max0.017521042823791504
agent_compute-ego_mean0.017129871453214814
agent_compute-ego_median0.017133429855841653
agent_compute-ego_min0.01673158327738444
complete-iteration_max0.21642978429794313
complete-iteration_mean0.20070726183303517
complete-iteration_median0.198892187277476
complete-iteration_min0.1886148884792456
deviation-center-line_max0.7382596256916238
deviation-center-line_mean0.5340679582893818
deviation-center-line_min0.11256677066579704
deviation-heading_max2.599945431234454
deviation-heading_mean1.8900746727141424
deviation-heading_median2.1907865028809383
deviation-heading_min0.5787802538602398
driven_any_max3.950768382080861
driven_any_mean2.99476239772185
driven_any_median2.993104794640937
driven_any_min2.042071619524664
driven_lanedir_consec_max3.769084898288573
driven_lanedir_consec_mean2.4050098533806823
driven_lanedir_consec_min0.7171222543788254
driven_lanedir_max3.769084898288573
driven_lanedir_mean2.4050098533806823
driven_lanedir_median2.566916130427665
driven_lanedir_min0.7171222543788254
get_duckie_state_max2.5320053100585936e-06
get_duckie_state_mean2.459987697985348e-06
get_duckie_state_median2.4511510093740167e-06
get_duckie_state_min2.4056434631347656e-06
get_robot_state_max0.015806612173716227
get_robot_state_mean0.015248546716350836
get_robot_state_median0.01548858086268107
get_robot_state_min0.01421041296632498
get_state_dump_max0.013674028714497884
get_state_dump_mean0.013465679262575154
get_state_dump_median0.013436803767078408
get_state_dump_min0.013315080801645916
get_ui_image_max0.036648221015930176
get_ui_image_mean0.03500245510731767
get_ui_image_median0.03517114996910095
get_ui_image_min0.03301929947513862
in-drivable-lane_max9.00000000000009
in-drivable-lane_mean3.3500000000000245
in-drivable-lane_min0.5000000000000071
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.088327815022617, "get_ui_image": 0.03301929947513862, "step_physics": 0.07264494415897652, "survival_time": 7.449999999999981, "driven_lanedir": 1.378522246342612, "get_state_dump": 0.01351366907158154, "sim_render-ego": 0.0057050349728373076, "get_robot_state": 0.01421041296632498, "get_duckie_state": 2.44659065400194e-06, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.016984465938286494, "deviation-heading": 0.5787802538602398, "complete-iteration": 0.1886148884792456, "set_robot_commands": 0.00458874958473564, "deviation-center-line": 0.11256677066579704, "driven_lanedir_consec": 1.378522246342612, "sim_compute_sim_state": 0.023930431212354827, "sim_compute_performance-ego": 0.003875478002048979}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.897881774259257, "get_ui_image": 0.03372238636016846, "step_physics": 0.07552314201990763, "survival_time": 14.950000000000076, "driven_lanedir": 3.755310014512718, "get_state_dump": 0.013359938462575277, "sim_render-ego": 0.005805439949035644, "get_robot_state": 0.015416843096415202, "get_duckie_state": 2.4056434631347656e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.01673158327738444, "deviation-heading": 2.599945431234454, "complete-iteration": 0.19293636163075764, "set_robot_commands": 0.004660975138346354, "deviation-center-line": 0.7382596256916238, "driven_lanedir_consec": 3.755310014512718, "sim_compute_sim_state": 0.02367104768753052, "sim_compute_performance-ego": 0.003900307019551595}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.042071619524664, "get_ui_image": 0.03661991357803344, "step_physics": 0.08312195380528768, "survival_time": 14.950000000000076, "driven_lanedir": 0.7171222543788254, "get_state_dump": 0.013315080801645916, "sim_render-ego": 0.006047367254892985, "get_robot_state": 0.015806612173716227, "get_duckie_state": 2.5320053100585936e-06, "in-drivable-lane": 9.00000000000009, "agent_compute-ego": 0.017521042823791504, "deviation-heading": 2.109410724361386, "complete-iteration": 0.20484801292419433, "set_robot_commands": 0.004882089296976725, "deviation-center-line": 0.5606770522096902, "driven_lanedir_consec": 0.7171222543788254, "sim_compute_sim_state": 0.02331220865249634, "sim_compute_performance-ego": 0.0040655787785847984}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.950768382080861, "get_ui_image": 0.036648221015930176, "step_physics": 0.08931941032409668, "survival_time": 14.950000000000076, "driven_lanedir": 3.769084898288573, "get_state_dump": 0.013674028714497884, "sim_render-ego": 0.006262563864390056, "get_robot_state": 0.01556031862894694, "get_duckie_state": 2.455711364746094e-06, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.01728239377339681, "deviation-heading": 2.2721622814004907, "complete-iteration": 0.21642978429794313, "set_robot_commands": 0.004821859995524089, "deviation-center-line": 0.724768384590416, "driven_lanedir_consec": 3.769084898288573, "sim_compute_sim_state": 0.028565003871917724, "sim_compute_performance-ego": 0.004140145778656006}}
set_robot_commands_max0.004882089296976725
set_robot_commands_mean0.004738418503895702
set_robot_commands_median0.004741417566935221
set_robot_commands_min0.00458874958473564
sim_compute_performance-ego_max0.004140145778656006
sim_compute_performance-ego_mean0.003995377394710345
sim_compute_performance-ego_median0.003982942899068196
sim_compute_performance-ego_min0.003875478002048979
sim_compute_sim_state_max0.028565003871917724
sim_compute_sim_state_mean0.024869672856074852
sim_compute_sim_state_median0.023800739449942675
sim_compute_sim_state_min0.02331220865249634
sim_render-ego_max0.006262563864390056
sim_render-ego_mean0.0059551015102889985
sim_render-ego_median0.0059264036019643146
sim_render-ego_min0.0057050349728373076
simulation-passed1
step_physics_max0.08931941032409668
step_physics_mean0.08015236257706713
step_physics_median0.07932254791259766
step_physics_min0.07264494415897652
survival_time_max14.950000000000076
survival_time_mean13.075000000000053
survival_time_min7.449999999999981
No reset possible
4284611544Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simfailednomont04-85f844e025a2-10:04:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 270 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4283711538Jean-Sébastien Grondin 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.658896885839632
survival_time_median14.950000000000076
deviation-center-line_median0.7598147574504179
in-drivable-lane_median3.2750000000000172


other stats
agent_compute-ego_max0.01797435124715169
agent_compute-ego_mean0.017128518566191655
agent_compute-ego_median0.01695512164572966
agent_compute-ego_min0.0166294797261556
complete-iteration_max0.18613510527369065
complete-iteration_mean0.17877671420116395
complete-iteration_median0.17830751736958822
complete-iteration_min0.17235671679178874
deviation-center-line_max0.914894387390362
deviation-center-line_mean0.7730044423357894
deviation-center-line_min0.6574938670519596
deviation-heading_max4.549466214936408
deviation-heading_mean3.61458150404322
deviation-heading_median3.61553646495294
deviation-heading_min2.6777868713305932
driven_any_max4.594414530962288
driven_any_mean4.268194010680211
driven_any_median4.586637485143077
driven_any_min3.3050865414723996
driven_lanedir_consec_max3.937452403093531
driven_lanedir_consec_mean2.8569752787676697
driven_lanedir_consec_min2.172654940297881
driven_lanedir_max3.937452403093531
driven_lanedir_mean2.898140167133673
driven_lanedir_median2.6984756529706733
driven_lanedir_min2.258156959499815
get_duckie_state_max2.377827962239583e-06
get_duckie_state_mean2.197425486305342e-06
get_duckie_state_median2.1684188081005935e-06
get_duckie_state_min2.075036366780599e-06
get_robot_state_max0.011898303826649984
get_robot_state_mean0.011585703692677932
get_robot_state_median0.011596731742223103
get_robot_state_min0.01125104745961554
get_state_dump_max0.012228152751922608
get_state_dump_mean0.01196916410633679
get_state_dump_median0.011900358782385902
get_state_dump_min0.01184778610865275
get_ui_image_max0.033565955227970526
get_ui_image_mean0.032207418497989436
get_ui_image_median0.03211317340532939
get_ui_image_min0.031037371953328452
in-drivable-lane_max5.850000000000063
in-drivable-lane_mean3.387500000000025
in-drivable-lane_min1.150000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.579271364049816, "get_ui_image": 0.031037371953328452, "step_physics": 0.06659993966420491, "survival_time": 14.950000000000076, "driven_lanedir": 3.937452403093531, "get_state_dump": 0.01184778610865275, "sim_render-ego": 0.004937248229980469, "get_robot_state": 0.01159077803293864, "get_duckie_state": 2.377827962239583e-06, "in-drivable-lane": 1.150000000000003, "agent_compute-ego": 0.0166294797261556, "deviation-heading": 4.248682234929211, "complete-iteration": 0.17235671679178874, "set_robot_commands": 0.004396363099416097, "deviation-center-line": 0.914894387390362, "driven_lanedir_consec": 3.937452403093531, "sim_compute_sim_state": 0.021836717923482254, "sim_compute_performance-ego": 0.0033570424715677898}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.594414530962288, "get_ui_image": 0.03131316184997559, "step_physics": 0.06603842496871948, "survival_time": 14.950000000000076, "driven_lanedir": 2.8638439232446964, "get_state_dump": 0.011920361518859864, "sim_render-ego": 0.005036561489105224, "get_robot_state": 0.011602685451507567, "get_duckie_state": 2.075036366780599e-06, "in-drivable-lane": 4.950000000000038, "agent_compute-ego": 0.01722604513168335, "deviation-heading": 2.6777868713305932, "complete-iteration": 0.17245548168818156, "set_robot_commands": 0.0044560440381368, "deviation-center-line": 0.801328363153499, "driven_lanedir_consec": 2.8638439232446964, "sim_compute_sim_state": 0.02134268045425415, "sim_compute_performance-ego": 0.0033949597676595053}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.3050865414723996, "get_ui_image": 0.033565955227970526, "step_physics": 0.07854182049975417, "survival_time": 10.85000000000002, "driven_lanedir": 2.5331073826966497, "get_state_dump": 0.01188035604591194, "sim_render-ego": 0.0050434527858611074, "get_robot_state": 0.01125104745961554, "get_duckie_state": 2.1831231183170725e-06, "in-drivable-lane": 1.599999999999996, "agent_compute-ego": 0.016684198159775974, "deviation-heading": 2.982390694976669, "complete-iteration": 0.18613510527369065, "set_robot_commands": 0.004465848070135864, "deviation-center-line": 0.6574938670519596, "driven_lanedir_consec": 2.4539498484345685, "sim_compute_sim_state": 0.02113630255246492, "sim_compute_performance-ego": 0.0034384090230212233}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.594003606236339, "get_ui_image": 0.032913184960683184, "step_physics": 0.07341181755065918, "survival_time": 14.950000000000076, "driven_lanedir": 2.258156959499815, "get_state_dump": 0.012228152751922608, "sim_render-ego": 0.005115194320678711, "get_robot_state": 0.011898303826649984, "get_duckie_state": 2.1537144978841146e-06, "in-drivable-lane": 5.850000000000063, "agent_compute-ego": 0.01797435124715169, "deviation-heading": 4.549466214936408, "complete-iteration": 0.18415955305099488, "set_robot_commands": 0.004637016455332438, "deviation-center-line": 0.718301151747337, "driven_lanedir_consec": 2.172654940297881, "sim_compute_sim_state": 0.022404266993204754, "sim_compute_performance-ego": 0.003448324998219808}}
set_robot_commands_max0.004637016455332438
set_robot_commands_mean0.0044888179157553
set_robot_commands_median0.004460946054136332
set_robot_commands_min0.004396363099416097
sim_compute_performance-ego_max0.003448324998219808
sim_compute_performance-ego_mean0.0034096840651170815
sim_compute_performance-ego_median0.0034166843953403643
sim_compute_performance-ego_min0.0033570424715677898
sim_compute_sim_state_max0.022404266993204754
sim_compute_sim_state_mean0.02167999198085152
sim_compute_sim_state_median0.021589699188868203
sim_compute_sim_state_min0.02113630255246492
sim_render-ego_max0.005115194320678711
sim_render-ego_mean0.005033114206406378
sim_render-ego_median0.005040007137483166
sim_render-ego_min0.004937248229980469
simulation-passed1
step_physics_max0.07854182049975417
step_physics_mean0.07114800067083443
step_physics_median0.07000587860743204
step_physics_min0.06603842496871948
survival_time_max14.950000000000076
survival_time_mean13.92500000000006
survival_time_min10.85000000000002
No reset possible
4282811541Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.667616361829576
survival_time_median14.950000000000076
deviation-center-line_median1.013870033360288
in-drivable-lane_median2.450000000000002


other stats
agent_compute-ego_max0.01759307066599528
agent_compute-ego_mean0.017244556148846943
agent_compute-ego_median0.017186463673909504
agent_compute-ego_min0.017012226581573486
complete-iteration_max0.19913890997568767
complete-iteration_mean0.193686763048172
complete-iteration_median0.1941381049156189
complete-iteration_min0.18733193238576257
deviation-center-line_max1.101108297374605
deviation-center-line_mean0.9992599854525414
deviation-center-line_min0.8681915777149843
deviation-heading_max4.162279693854063
deviation-heading_mean3.273997794594347
deviation-heading_median3.398870779537506
deviation-heading_min2.1359699254483115
driven_any_max4.8477756943636665
driven_any_mean4.515691512658205
driven_any_median4.651677195145526
driven_any_min3.911635965978103
driven_lanedir_consec_max4.124285713407664
driven_lanedir_consec_mean3.629065685126695
driven_lanedir_consec_min3.056744303439965
driven_lanedir_max4.124285713407664
driven_lanedir_mean3.629065685126695
driven_lanedir_median3.667616361829576
driven_lanedir_min3.056744303439965
get_duckie_state_max3.764629364013672e-06
get_duckie_state_mean3.65138053894043e-06
get_duckie_state_median3.656148910522461e-06
get_duckie_state_min3.528594970703125e-06
get_robot_state_max0.015591378211975098
get_robot_state_mean0.014425634344418844
get_robot_state_median0.014269745747248331
get_robot_state_min0.013571667671203613
get_state_dump_max0.013517736593882244
get_state_dump_mean0.01328236679236094
get_state_dump_median0.013244057496388751
get_state_dump_min0.013123615582784015
get_ui_image_max0.03470318555831909
get_ui_image_mean0.033789512316385904
get_ui_image_median0.033782589435577395
get_ui_image_min0.032889684836069744
in-drivable-lane_max4.100000000000048
in-drivable-lane_mean2.5875000000000177
in-drivable-lane_min1.3500000000000192
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.8477756943636665, "get_ui_image": 0.03470318555831909, "step_physics": 0.07738561550776164, "survival_time": 14.950000000000076, "driven_lanedir": 4.124285713407664, "get_state_dump": 0.013517736593882244, "sim_render-ego": 0.006033938725789388, "get_robot_state": 0.015591378211975098, "get_duckie_state": 3.7391980489095057e-06, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.01759307066599528, "deviation-heading": 4.162279693854063, "complete-iteration": 0.19913890997568767, "set_robot_commands": 0.004921451409657796, "deviation-center-line": 0.9958795630133837, "driven_lanedir_consec": 4.124285713407664, "sim_compute_sim_state": 0.025189003944396972, "sim_compute_performance-ego": 0.004060200055440267}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.83111746234827, "get_ui_image": 0.032889684836069744, "step_physics": 0.07228827635447184, "survival_time": 14.950000000000076, "driven_lanedir": 4.08488057908524, "get_state_dump": 0.013123615582784015, "sim_render-ego": 0.0056000065803527834, "get_robot_state": 0.01446169376373291, "get_duckie_state": 3.5730997721354166e-06, "in-drivable-lane": 2.4500000000000126, "agent_compute-ego": 0.017012226581573486, "deviation-heading": 3.4293225619592698, "complete-iteration": 0.18733193238576257, "set_robot_commands": 0.004554875691731771, "deviation-center-line": 1.101108297374605, "driven_lanedir_consec": 4.08488057908524, "sim_compute_sim_state": 0.02351605733235677, "sim_compute_performance-ego": 0.003746711413065592}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.911635965978103, "get_ui_image": 0.033623201847076414, "step_physics": 0.07564491192499796, "survival_time": 14.950000000000076, "driven_lanedir": 3.056744303439965, "get_state_dump": 0.013208946386973064, "sim_render-ego": 0.005632873376210531, "get_robot_state": 0.014077797730763753, "get_duckie_state": 3.764629364013672e-06, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.01727771043777466, "deviation-heading": 3.368418997115743, "complete-iteration": 0.1920907719930013, "set_robot_commands": 0.004567526976267497, "deviation-center-line": 1.0318605037071922, "driven_lanedir_consec": 3.056744303439965, "sim_compute_sim_state": 0.024134046236673992, "sim_compute_performance-ego": 0.003787132898966471}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.472236927942782, "get_ui_image": 0.03394197702407837, "step_physics": 0.0771639609336853, "survival_time": 14.950000000000076, "driven_lanedir": 3.2503521445739114, "get_state_dump": 0.013279168605804444, "sim_render-ego": 0.005480890274047852, "get_robot_state": 0.013571667671203613, "get_duckie_state": 3.528594970703125e-06, "in-drivable-lane": 4.100000000000048, "agent_compute-ego": 0.017095216910044352, "deviation-heading": 2.1359699254483115, "complete-iteration": 0.1961854378382365, "set_robot_commands": 0.004505376815795898, "deviation-center-line": 0.8681915777149843, "driven_lanedir_consec": 3.2503521445739114, "sim_compute_sim_state": 0.02733325322469075, "sim_compute_performance-ego": 0.00367859681447347}}
set_robot_commands_max0.004921451409657796
set_robot_commands_mean0.00463730772336324
set_robot_commands_median0.004561201333999634
set_robot_commands_min0.004505376815795898
sim_compute_performance-ego_max0.004060200055440267
sim_compute_performance-ego_mean0.00381816029548645
sim_compute_performance-ego_median0.003766922156016032
sim_compute_performance-ego_min0.00367859681447347
sim_compute_sim_state_max0.02733325322469075
sim_compute_sim_state_mean0.02504309018452962
sim_compute_sim_state_median0.02466152509053548
sim_compute_sim_state_min0.02351605733235677
sim_render-ego_max0.006033938725789388
sim_render-ego_mean0.005686927239100139
sim_render-ego_median0.005616439978281657
sim_render-ego_min0.005480890274047852
simulation-passed1
step_physics_max0.07738561550776164
step_physics_mean0.07562069118022918
step_physics_median0.07640443642934164
step_physics_min0.07228827635447184
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4280211539Jean-Sébastien Grondin 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4080945112663903
survival_time_median14.950000000000076
deviation-center-line_median0.6479880623752808
in-drivable-lane_median1.049999999999998


other stats
agent_compute-ego_max0.01769910494486491
agent_compute-ego_mean0.016984285798625667
agent_compute-ego_median0.01714160084724426
agent_compute-ego_min0.015954836555149243
complete-iteration_max0.2115639292675516
complete-iteration_mean0.2003980943431025
complete-iteration_median0.19964167753855389
complete-iteration_min0.19074509302775064
deviation-center-line_max0.9394625226645702
deviation-center-line_mean0.5773378090560773
deviation-center-line_min0.07391258880917731
deviation-heading_max3.761429790510283
deviation-heading_mean2.4895533457134653
deviation-heading_median2.865262361692007
deviation-heading_min0.4662588689595642
driven_any_max3.573368594935366
driven_any_mean2.726787885094035
driven_any_median3.567580507471717
driven_any_min0.19862193049733937
driven_lanedir_consec_max3.208098694228366
driven_lanedir_consec_mean2.030459347107083
driven_lanedir_consec_min0.09754967166718398
driven_lanedir_max3.208098694228366
driven_lanedir_mean2.030459347107083
driven_lanedir_median2.4080945112663903
driven_lanedir_min0.09754967166718398
get_duckie_state_max2.591506294582201e-06
get_duckie_state_mean2.5450924168462338e-06
get_duckie_state_median2.541939417521159e-06
get_duckie_state_min2.5049845377604165e-06
get_robot_state_max0.016078458627065022
get_robot_state_mean0.01494773425053859
get_robot_state_median0.015095895926157636
get_robot_state_min0.013520686522774076
get_state_dump_max0.013417783578236898
get_state_dump_mean0.01327670573324397
get_state_dump_median0.013246119402456976
get_state_dump_min0.013196800549825033
get_ui_image_max0.036752752635789955
get_ui_image_mean0.03497636779494907
get_ui_image_median0.03478281855583191
get_ui_image_min0.03358708143234253
in-drivable-lane_max6.850000000000037
in-drivable-lane_mean2.287500000000008
in-drivable-lane_min0.20000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.561809608279423, "get_ui_image": 0.03374232530593872, "step_physics": 0.07462867180506388, "survival_time": 14.950000000000076, "driven_lanedir": 3.1201591821926424, "get_state_dump": 0.013293396631876628, "sim_render-ego": 0.005804240703582764, "get_robot_state": 0.015048872629801433, "get_duckie_state": 2.5177001953125e-06, "in-drivable-lane": 1.349999999999996, "agent_compute-ego": 0.017011157671610513, "deviation-heading": 2.753285058553395, "complete-iteration": 0.1917190440495809, "set_robot_commands": 0.004862998326619466, "deviation-center-line": 0.9394625226645702, "driven_lanedir_consec": 3.1201591821926424, "sim_compute_sim_state": 0.023300349712371823, "sim_compute_performance-ego": 0.0038801105817159016}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.573368594935366, "get_ui_image": 0.03358708143234253, "step_physics": 0.07362783034642538, "survival_time": 14.950000000000076, "driven_lanedir": 3.208098694228366, "get_state_dump": 0.013196800549825033, "sim_render-ego": 0.005902223587036133, "get_robot_state": 0.015142919222513837, "get_duckie_state": 2.5049845377604165e-06, "in-drivable-lane": 0.7500000000000002, "agent_compute-ego": 0.017272044022878012, "deviation-heading": 3.761429790510283, "complete-iteration": 0.19074509302775064, "set_robot_commands": 0.004772034486134847, "deviation-center-line": 0.7975290550611988, "driven_lanedir_consec": 3.208098694228366, "sim_compute_sim_state": 0.02307098627090454, "sim_compute_performance-ego": 0.004021319548288981}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.573351406664011, "get_ui_image": 0.035823311805725094, "step_physics": 0.0846828548113505, "survival_time": 14.950000000000076, "driven_lanedir": 1.6960298403401382, "get_state_dump": 0.013417783578236898, "sim_render-ego": 0.006477798620859782, "get_robot_state": 0.016078458627065022, "get_duckie_state": 2.5661786397298178e-06, "in-drivable-lane": 6.850000000000037, "agent_compute-ego": 0.01769910494486491, "deviation-heading": 2.9772396648306194, "complete-iteration": 0.20756431102752684, "set_robot_commands": 0.004770310719807943, "deviation-center-line": 0.49844706968936286, "driven_lanedir_consec": 1.6960298403401382, "sim_compute_sim_state": 0.02434687296549479, "sim_compute_performance-ego": 0.0041116905212402344}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.19862193049733937, "get_ui_image": 0.036752752635789955, "step_physics": 0.0919001931729524, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09754967166718398, "get_state_dump": 0.01319884217303732, "sim_render-ego": 0.0055920974068019704, "get_robot_state": 0.013520686522774076, "get_duckie_state": 2.591506294582201e-06, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.015954836555149243, "deviation-heading": 0.4662588689595642, "complete-iteration": 0.2115639292675516, "set_robot_commands": 0.004558998605479364, "deviation-center-line": 0.07391258880917731, "driven_lanedir_consec": 0.09754967166718398, "sim_compute_sim_state": 0.026219191758529, "sim_compute_performance-ego": 0.0037161370982294497}}
set_robot_commands_max0.004862998326619466
set_robot_commands_mean0.0047410855345104055
set_robot_commands_median0.004771172602971396
set_robot_commands_min0.004558998605479364
sim_compute_performance-ego_max0.0041116905212402344
sim_compute_performance-ego_mean0.003932314437368641
sim_compute_performance-ego_median0.003950715065002441
sim_compute_performance-ego_min0.0037161370982294497
sim_compute_sim_state_max0.026219191758529
sim_compute_sim_state_mean0.024234350176825036
sim_compute_sim_state_median0.023823611338933307
sim_compute_sim_state_min0.02307098627090454
sim_render-ego_max0.006477798620859782
sim_render-ego_mean0.005944090079570162
sim_render-ego_median0.005853232145309448
sim_render-ego_min0.0055920974068019704
simulation-passed1
step_physics_max0.0919001931729524
step_physics_mean0.08120988753394805
step_physics_median0.0796557633082072
step_physics_min0.07362783034642538
survival_time_max14.950000000000076
survival_time_mean11.50000000000006
survival_time_min1.1500000000000004
No reset possible
4279211538Jean-Sébastien Grondin 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8148714867733022
survival_time_median4.174999999999992
deviation-center-line_median0.1171685140314152
in-drivable-lane_median1.124999999999997


other stats
agent_compute-ego_max0.01780407428741455
agent_compute-ego_mean0.01738557168504977
agent_compute-ego_median0.017380055190919938
agent_compute-ego_min0.01697810207094465
complete-iteration_max0.2096345392862956
complete-iteration_mean0.20374390263535136
complete-iteration_median0.2037491812996719
complete-iteration_min0.1978427086557661
deviation-center-line_max0.4177946937360658
deviation-center-line_mean0.1781109261666234
deviation-center-line_min0.06031198286759741
deviation-heading_max2.05928016439628
deviation-heading_mean0.8999034561597041
deviation-heading_median0.6128727693645851
deviation-heading_min0.31458812151336624
driven_any_max4.5942210745730545
driven_any_mean1.8314477087467465
driven_any_median1.1988797405335905
driven_any_min0.3338102793467506
driven_lanedir_consec_max2.5189816583131783
driven_lanedir_consec_mean1.0816482551039843
driven_lanedir_consec_min0.17786838855615494
driven_lanedir_max2.5189816583131783
driven_lanedir_mean1.0816482551039843
driven_lanedir_median0.8148714867733022
driven_lanedir_min0.17786838855615494
get_duckie_state_max2.9612278592759283e-06
get_duckie_state_mean2.59295634661002e-06
get_duckie_state_median2.504984537760417e-06
get_duckie_state_min2.400628451643319e-06
get_robot_state_max0.015672448752582935
get_robot_state_mean0.015181387666419513
get_robot_state_median0.015180180566064242
get_robot_state_min0.014692740780966622
get_state_dump_max0.01399454863175102
get_state_dump_mean0.013588740546161888
get_state_dump_median0.013489819708324614
get_state_dump_min0.013380774136247308
get_ui_image_max0.03613104820251465
get_ui_image_mean0.035317441684927224
get_ui_image_median0.03530021092574585
get_ui_image_min0.03453829668570256
in-drivable-lane_max6.250000000000089
in-drivable-lane_mean2.2250000000000205
in-drivable-lane_min0.4000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.048254299989976, "get_ui_image": 0.03453829668570256, "step_physics": 0.0788610413454581, "survival_time": 6.8999999999999835, "driven_lanedir": 1.4283119078457172, "get_state_dump": 0.01399454863175102, "sim_render-ego": 0.006020069122314453, "get_robot_state": 0.015672448752582935, "get_duckie_state": 2.9612278592759283e-06, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.01766825240591298, "deviation-heading": 0.7824414819411667, "complete-iteration": 0.19961077061252316, "set_robot_commands": 0.004862341327943664, "deviation-center-line": 0.14623887155358212, "driven_lanedir_consec": 1.4283119078457172, "sim_compute_sim_state": 0.02388500476229018, "sim_compute_performance-ego": 0.003956152045208475}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.3338102793467506, "get_ui_image": 0.03498228107179914, "step_physics": 0.08183468239648002, "survival_time": 1.4000000000000006, "driven_lanedir": 0.17786838855615494, "get_state_dump": 0.01346531936100551, "sim_render-ego": 0.005570445741925921, "get_robot_state": 0.014692740780966622, "get_duckie_state": 2.562999725341797e-06, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.01697810207094465, "deviation-heading": 0.4433040567880035, "complete-iteration": 0.1978427086557661, "set_robot_commands": 0.004996316773550851, "deviation-center-line": 0.06031198286759741, "driven_lanedir_consec": 0.17786838855615494, "sim_compute_sim_state": 0.02135012831006731, "sim_compute_performance-ego": 0.003825919968741281}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.5942210745730545, "get_ui_image": 0.03613104820251465, "step_physics": 0.08571307102839153, "survival_time": 14.950000000000076, "driven_lanedir": 2.5189816583131783, "get_state_dump": 0.013514320055643715, "sim_render-ego": 0.0062142268816630045, "get_robot_state": 0.015510048866271973, "get_duckie_state": 2.4469693501790365e-06, "in-drivable-lane": 6.250000000000089, "agent_compute-ego": 0.01780407428741455, "deviation-heading": 2.05928016439628, "complete-iteration": 0.2096345392862956, "set_robot_commands": 0.0048677587509155275, "deviation-center-line": 0.4177946937360658, "driven_lanedir_consec": 2.5189816583131783, "sim_compute_sim_state": 0.025563247203826904, "sim_compute_performance-ego": 0.004164785544077555}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.3495051810772043, "get_ui_image": 0.03561814077969255, "step_physics": 0.08737262364091544, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2014310657008873, "get_state_dump": 0.013380774136247308, "sim_render-ego": 0.005969450391572097, "get_robot_state": 0.014850312265856511, "get_duckie_state": 2.400628451643319e-06, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.017091857975926893, "deviation-heading": 0.31458812151336624, "complete-iteration": 0.2078875919868206, "set_robot_commands": 0.004565641797822097, "deviation-center-line": 0.08809815650924831, "driven_lanedir_consec": 0.2014310657008873, "sim_compute_sim_state": 0.024891664241922313, "sim_compute_performance-ego": 0.004002349130038558}}
set_robot_commands_max0.004996316773550851
set_robot_commands_mean0.004823014662558035
set_robot_commands_median0.004865050039429596
set_robot_commands_min0.004565641797822097
sim_compute_performance-ego_max0.004164785544077555
sim_compute_performance-ego_mean0.003987301672016467
sim_compute_performance-ego_median0.003979250587623516
sim_compute_performance-ego_min0.003825919968741281
sim_compute_sim_state_max0.025563247203826904
sim_compute_sim_state_mean0.02392251112952668
sim_compute_sim_state_median0.024388334502106247
sim_compute_sim_state_min0.02135012831006731
sim_render-ego_max0.0062142268816630045
sim_render-ego_mean0.005943548034368869
sim_render-ego_median0.005994759756943275
sim_render-ego_min0.005570445741925921
simulation-passed1
step_physics_max0.08737262364091544
step_physics_mean0.08344535460281127
step_physics_median0.08377387671243577
step_physics_min0.0788610413454581
survival_time_max14.950000000000076
survival_time_mean6.175000000000016
survival_time_min1.4000000000000006
No reset possible
4276411531Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornomont04-85f844e025a2-10:06:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4276111530Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornomont04-85f844e025a2-10:06:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4273411521Jean-Sébastien Grondin 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:07:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6207634866287353
survival_time_median14.950000000000076
deviation-center-line_median0.8853828930564693
in-drivable-lane_median2.275000000000004


other stats
agent_compute-ego_max0.01785219113032023
agent_compute-ego_mean0.017564353346824643
agent_compute-ego_median0.017579358816146848
agent_compute-ego_min0.01724650462468465
complete-iteration_max0.2090454339981079
complete-iteration_mean0.20329074054956436
complete-iteration_median0.20404031852881113
complete-iteration_min0.1960368911425273
deviation-center-line_max1.1192754869076895
deviation-center-line_mean0.7412157517653528
deviation-center-line_min0.0748217340407829
deviation-heading_max3.4225966165528936
deviation-heading_mean2.330203519776391
deviation-heading_median2.7326592066636453
deviation-heading_min0.4328990492253809
driven_any_max3.573427667352675
driven_any_mean2.729851018386489
driven_any_median3.567581614901613
driven_any_min0.21081317639005495
driven_lanedir_consec_max2.918505468663686
driven_lanedir_consec_mean2.067025955361657
driven_lanedir_consec_min0.10807137952547086
driven_lanedir_max2.918505468663686
driven_lanedir_mean2.067025955361657
driven_lanedir_median2.6207634866287353
driven_lanedir_min0.10807137952547086
get_duckie_state_max2.7839342753092446e-06
get_duckie_state_mean2.735952536265055e-06
get_duckie_state_median2.745985984802246e-06
get_duckie_state_min2.6679039001464843e-06
get_robot_state_max0.015828979015350342
get_robot_state_mean0.01519385317961375
get_robot_state_median0.015600314537684123
get_robot_state_min0.01374580462773641
get_state_dump_max0.013681153456370035
get_state_dump_mean0.013434774875640869
get_state_dump_median0.013436113198598226
get_state_dump_min0.013185719648996988
get_ui_image_max0.03641201337178549
get_ui_image_mean0.03527893235286077
get_ui_image_median0.03520093441009521
get_ui_image_min0.03430184721946716
in-drivable-lane_max4.050000000000014
in-drivable-lane_mean2.2125000000000057
in-drivable-lane_min0.2500000000000001
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.561816961039283, "get_ui_image": 0.034913517634073896, "step_physics": 0.07634693543116251, "survival_time": 14.950000000000076, "driven_lanedir": 2.918505468663686, "get_state_dump": 0.01344731569290161, "sim_render-ego": 0.005879073937733968, "get_robot_state": 0.015400579770406087, "get_duckie_state": 2.7839342753092446e-06, "in-drivable-lane": 2.150000000000013, "agent_compute-ego": 0.017342453797658284, "deviation-heading": 2.829616713517563, "complete-iteration": 0.1960368911425273, "set_robot_commands": 0.004753415584564209, "deviation-center-line": 0.9955043335219546, "driven_lanedir_consec": 2.918505468663686, "sim_compute_sim_state": 0.02384161631266276, "sim_compute_performance-ego": 0.003964195251464844}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.573427667352675, "get_ui_image": 0.03548835118611653, "step_physics": 0.08199597517649333, "survival_time": 14.950000000000076, "driven_lanedir": 2.444423259922279, "get_state_dump": 0.013681153456370035, "sim_render-ego": 0.006289984385172526, "get_robot_state": 0.01580004930496216, "get_duckie_state": 2.7799606323242188e-06, "in-drivable-lane": 4.050000000000014, "agent_compute-ego": 0.01785219113032023, "deviation-heading": 2.6357016998097276, "complete-iteration": 0.20428382317225136, "set_robot_commands": 0.004805161952972412, "deviation-center-line": 1.1192754869076895, "driven_lanedir_consec": 2.444423259922279, "sim_compute_sim_state": 0.024057981173197428, "sim_compute_performance-ego": 0.004154540697733561}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5733462687639426, "get_ui_image": 0.03641201337178549, "step_physics": 0.08513189315795898, "survival_time": 14.950000000000076, "driven_lanedir": 2.7971037133351917, "get_state_dump": 0.01342491070429484, "sim_render-ego": 0.006277074813842773, "get_robot_state": 0.015828979015350342, "get_duckie_state": 2.6679039001464843e-06, "in-drivable-lane": 2.399999999999995, "agent_compute-ego": 0.017816263834635415, "deviation-heading": 3.4225966165528936, "complete-iteration": 0.2090454339981079, "set_robot_commands": 0.0048323535919189455, "deviation-center-line": 0.775261452590984, "driven_lanedir_consec": 2.7971037133351917, "sim_compute_sim_state": 0.024943721294403077, "sim_compute_performance-ego": 0.00422000249226888}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.21081317639005495, "get_ui_image": 0.03430184721946716, "step_physics": 0.08524030447006226, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10807137952547086, "get_state_dump": 0.013185719648996988, "sim_render-ego": 0.005562305450439453, "get_robot_state": 0.01374580462773641, "get_duckie_state": 2.7120113372802734e-06, "in-drivable-lane": 0.2500000000000001, "agent_compute-ego": 0.01724650462468465, "deviation-heading": 0.4328990492253809, "complete-iteration": 0.20379681388537088, "set_robot_commands": 0.004653215408325195, "deviation-center-line": 0.0748217340407829, "driven_lanedir_consec": 0.10807137952547086, "sim_compute_sim_state": 0.026035010814666748, "sim_compute_performance-ego": 0.003675212462743123}}
set_robot_commands_max0.0048323535919189455
set_robot_commands_mean0.004761036634445191
set_robot_commands_median0.004779288768768311
set_robot_commands_min0.004653215408325195
sim_compute_performance-ego_max0.00422000249226888
sim_compute_performance-ego_mean0.004003487726052602
sim_compute_performance-ego_median0.004059367974599203
sim_compute_performance-ego_min0.003675212462743123
sim_compute_sim_state_max0.026035010814666748
sim_compute_sim_state_mean0.024719582398732506
sim_compute_sim_state_median0.024500851233800258
sim_compute_sim_state_min0.02384161631266276
sim_render-ego_max0.006289984385172526
sim_render-ego_mean0.00600210964679718
sim_render-ego_median0.00607807437578837
sim_render-ego_min0.005562305450439453
simulation-passed1
step_physics_max0.08524030447006226
step_physics_mean0.08217877705891927
step_physics_median0.08356393416722616
step_physics_min0.07634693543116251
survival_time_max14.950000000000076
survival_time_mean11.51250000000006
survival_time_min1.2000000000000004
No reset possible
4272211519Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:08:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2242198196468417
survival_time_median14.950000000000076
deviation-center-line_median0.4754198245432241
in-drivable-lane_median0.8250000000000117


other stats
agent_compute-ego_max0.017675678730010986
agent_compute-ego_mean0.017355875614260836
agent_compute-ego_median0.017325294500540107
agent_compute-ego_min0.01709723472595215
complete-iteration_max0.2021425771713257
complete-iteration_mean0.19683486009432263
complete-iteration_median0.19711888313293455
complete-iteration_min0.19095909694009577
deviation-center-line_max0.7369787799751408
deviation-center-line_mean0.4610534189116608
deviation-center-line_min0.15639524658505416
deviation-heading_max2.3934567233429305
deviation-heading_mean1.8211329660196305
deviation-heading_median1.81567601220766
deviation-heading_min1.259723116320271
driven_any_max3.594896089219053
driven_any_mean2.9816443830669934
driven_any_median3.4679441371365014
driven_any_min1.395793168775917
driven_lanedir_consec_max3.5109983612125273
driven_lanedir_consec_mean2.65968332734442
driven_lanedir_consec_min0.6792953088714697
driven_lanedir_max3.5109983612125273
driven_lanedir_mean2.6648546721192936
driven_lanedir_median3.2242198196468417
driven_lanedir_min0.6999806879709654
get_duckie_state_max2.487500508626302e-06
get_duckie_state_mean2.2910728270685705e-06
get_duckie_state_median2.277432722822037e-06
get_duckie_state_min2.1219253540039063e-06
get_robot_state_max0.01577003320058187
get_robot_state_mean0.014936827299680265
get_robot_state_median0.015145662382614514
get_robot_state_min0.013685951232910156
get_state_dump_max0.013513753414154051
get_state_dump_mean0.013381211644361828
get_state_dump_median0.01336925960769338
get_state_dump_min0.013272573947906494
get_ui_image_max0.03509886582692464
get_ui_image_mean0.03428909945422296
get_ui_image_median0.034222277800242104
get_ui_image_min0.03361297638948299
in-drivable-lane_max2.249999999999992
in-drivable-lane_mean0.975000000000004
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.594896089219053, "get_ui_image": 0.034104320208231606, "step_physics": 0.07895750443140666, "survival_time": 14.950000000000076, "driven_lanedir": 3.1092935780329296, "get_state_dump": 0.013513753414154051, "sim_render-ego": 0.0060555791854858395, "get_robot_state": 0.01577003320058187, "get_duckie_state": 2.487500508626302e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.017675678730010986, "deviation-heading": 2.114009716790943, "complete-iteration": 0.1993094023068746, "set_robot_commands": 0.004841631253560384, "deviation-center-line": 0.4927815795932598, "driven_lanedir_consec": 3.1092935780329296, "sim_compute_sim_state": 0.02416680892308553, "sim_compute_performance-ego": 0.0040720359484354655}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.567648723762758, "get_ui_image": 0.0343402353922526, "step_physics": 0.07693998177846273, "survival_time": 14.950000000000076, "driven_lanedir": 3.5109983612125273, "get_state_dump": 0.013272573947906494, "sim_render-ego": 0.005881907939910888, "get_robot_state": 0.015145392417907714, "get_duckie_state": 2.2514661153157552e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0172597861289978, "deviation-heading": 2.3934567233429305, "complete-iteration": 0.19492836395899457, "set_robot_commands": 0.004657567342122396, "deviation-center-line": 0.4580580694931885, "driven_lanedir_consec": 3.5109983612125273, "sim_compute_sim_state": 0.02332541942596435, "sim_compute_performance-ego": 0.0039522027969360355}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.395793168775917, "get_ui_image": 0.03361297638948299, "step_physics": 0.07414349642666904, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6999806879709654, "get_state_dump": 0.01342430784682597, "sim_render-ego": 0.0059196121436505275, "get_robot_state": 0.015145932347321311, "get_duckie_state": 2.3033993303283186e-06, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.017390802872082417, "deviation-heading": 1.259723116320271, "complete-iteration": 0.19095909694009577, "set_robot_commands": 0.004730094562877308, "deviation-center-line": 0.15639524658505416, "driven_lanedir_consec": 0.6792953088714697, "sim_compute_sim_state": 0.022514731430810345, "sim_compute_performance-ego": 0.003924844678768442}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.368239550510246, "get_ui_image": 0.03509886582692464, "step_physics": 0.08289574305216471, "survival_time": 14.950000000000076, "driven_lanedir": 3.3391460612607533, "get_state_dump": 0.01331421136856079, "sim_render-ego": 0.005547431310017904, "get_robot_state": 0.013685951232910156, "get_duckie_state": 2.1219253540039063e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01709723472595215, "deviation-heading": 1.517342307624377, "complete-iteration": 0.2021425771713257, "set_robot_commands": 0.004449152151743571, "deviation-center-line": 0.7369787799751408, "driven_lanedir_consec": 3.3391460612607533, "sim_compute_sim_state": 0.026145564715067543, "sim_compute_performance-ego": 0.003760528564453125}}
set_robot_commands_max0.004841631253560384
set_robot_commands_mean0.004669611327575915
set_robot_commands_median0.004693830952499852
set_robot_commands_min0.004449152151743571
sim_compute_performance-ego_max0.0040720359484354655
sim_compute_performance-ego_mean0.003927402997148267
sim_compute_performance-ego_median0.003938523737852239
sim_compute_performance-ego_min0.003760528564453125
sim_compute_sim_state_max0.026145564715067543
sim_compute_sim_state_mean0.024038131123731946
sim_compute_sim_state_median0.023746114174524945
sim_compute_sim_state_min0.022514731430810345
sim_render-ego_max0.0060555791854858395
sim_render-ego_mean0.005851132644766289
sim_render-ego_median0.005900760041780708
sim_render-ego_min0.005547431310017904
simulation-passed1
step_physics_max0.08289574305216471
step_physics_mean0.07823418142217578
step_physics_median0.07794874310493469
step_physics_min0.07414349642666904
survival_time_max14.950000000000076
survival_time_mean12.725000000000056
survival_time_min6.0499999999999865
No reset possible
4269011506Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0091088510440749
survival_time_median9.05
deviation-center-line_median0.34570287258631277
in-drivable-lane_median1.8250000000000208


other stats
agent_compute-ego_max0.016837157070908916
agent_compute-ego_mean0.01650224171277046
agent_compute-ego_median0.016463576612018402
agent_compute-ego_min0.016244656556136123
complete-iteration_max0.18905772030625712
complete-iteration_mean0.18491566161516665
complete-iteration_median0.18524396605702825
complete-iteration_min0.18011699404035297
deviation-center-line_max0.7649608677917684
deviation-center-line_mean0.3882324790050769
deviation-center-line_min0.09656330305591372
deviation-heading_max4.2674203016122245
deviation-heading_mean2.002210939320112
deviation-heading_median1.502347600620062
deviation-heading_min0.7367282544281009
driven_any_max2.1925346062951787
driven_any_mean1.4243683275749968
driven_any_median1.6200174064115402
driven_any_min0.26490389118172825
driven_lanedir_consec_max1.41463804860556
driven_lanedir_consec_mean0.8977712333182124
driven_lanedir_consec_min0.15822918257914065
driven_lanedir_max1.41463804860556
driven_lanedir_mean0.9454295130391214
driven_lanedir_median1.1044254104858924
driven_lanedir_min0.15822918257914065
get_duckie_state_max2.606274330452697e-06
get_duckie_state_mean2.3413765376560766e-06
get_duckie_state_median2.2920298250841768e-06
get_duckie_state_min2.175172170003255e-06
get_robot_state_max0.01395623760136295
get_robot_state_mean0.012986279549152309
get_robot_state_median0.012938605887549264
get_robot_state_min0.012111668820147747
get_state_dump_max0.013348320303442272
get_state_dump_mean0.012858226982779344
get_state_dump_median0.012855960244224186
get_state_dump_min0.01237266713922674
get_ui_image_max0.033534157766054756
get_ui_image_mean0.032878077989265835
get_ui_image_median0.03286272823671639
get_ui_image_min0.0322526977175758
in-drivable-lane_max6.200000000000059
in-drivable-lane_mean2.575000000000025
in-drivable-lane_min0.4499999999999984
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.941443346938638, "get_ui_image": 0.033534157766054756, "step_physics": 0.07395904466986111, "survival_time": 10.95000000000002, "driven_lanedir": 1.41463804860556, "get_state_dump": 0.013348320303442272, "sim_render-ego": 0.005664250622056935, "get_robot_state": 0.01395623760136295, "get_duckie_state": 2.606274330452697e-06, "in-drivable-lane": 2.950000000000041, "agent_compute-ego": 0.016837157070908916, "deviation-heading": 1.6696610475206046, "complete-iteration": 0.18905772030625712, "set_robot_commands": 0.004478910742285045, "deviation-center-line": 0.312314239289796, "driven_lanedir_consec": 1.41463804860556, "sim_compute_sim_state": 0.023327303803674707, "sim_compute_performance-ego": 0.003808673658327425}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.26490389118172825, "get_ui_image": 0.0322526977175758, "step_physics": 0.07086336045038133, "survival_time": 2.1000000000000005, "driven_lanedir": 0.15822918257914065, "get_state_dump": 0.013024977275303431, "sim_render-ego": 0.005322195234752837, "get_robot_state": 0.012847576822553362, "get_duckie_state": 2.208210173107329e-06, "in-drivable-lane": 0.7, "agent_compute-ego": 0.01639291218348912, "deviation-heading": 0.7367282544281009, "complete-iteration": 0.18011699404035297, "set_robot_commands": 0.004533069474356515, "deviation-center-line": 0.09656330305591372, "driven_lanedir_consec": 0.15822918257914065, "sim_compute_sim_state": 0.021086704163324265, "sim_compute_performance-ego": 0.0036636818022955033}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.1925346062951787, "get_ui_image": 0.033022133509318034, "step_physics": 0.07282082001368205, "survival_time": 14.950000000000076, "driven_lanedir": 1.0216169941942823, "get_state_dump": 0.012686943213144938, "sim_render-ego": 0.005353101094563802, "get_robot_state": 0.013029634952545166, "get_duckie_state": 2.175172170003255e-06, "in-drivable-lane": 6.200000000000059, "agent_compute-ego": 0.01653424104054769, "deviation-heading": 4.2674203016122245, "complete-iteration": 0.18274735609690348, "set_robot_commands": 0.004359352588653565, "deviation-center-line": 0.7649608677917684, "driven_lanedir_consec": 0.8309838753106467, "sim_compute_sim_state": 0.02117095152537028, "sim_compute_performance-ego": 0.0036374696095784506}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.2985914658844426, "get_ui_image": 0.03270332296411474, "step_physics": 0.07771484334985693, "survival_time": 7.149999999999983, "driven_lanedir": 1.1872338267775024, "get_state_dump": 0.01237266713922674, "sim_render-ego": 0.00519679643057443, "get_robot_state": 0.012111668820147747, "get_duckie_state": 2.375849477061025e-06, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.016244656556136123, "deviation-heading": 1.3350341537195192, "complete-iteration": 0.18774057601715305, "set_robot_commands": 0.00431506617085917, "deviation-center-line": 0.3790915058828295, "driven_lanedir_consec": 1.1872338267775024, "sim_compute_sim_state": 0.023398150930871497, "sim_compute_performance-ego": 0.0035529953616482393}}
set_robot_commands_max0.004533069474356515
set_robot_commands_mean0.004421599744038574
set_robot_commands_median0.004419131665469304
set_robot_commands_min0.00431506617085917
sim_compute_performance-ego_max0.003808673658327425
sim_compute_performance-ego_mean0.0036657051079624046
sim_compute_performance-ego_median0.003650575705936977
sim_compute_performance-ego_min0.0035529953616482393
sim_compute_sim_state_max0.023398150930871497
sim_compute_sim_state_mean0.022245777605810188
sim_compute_sim_state_median0.022249127664522493
sim_compute_sim_state_min0.021086704163324265
sim_render-ego_max0.005664250622056935
sim_render-ego_mean0.005384085845487001
sim_render-ego_median0.0053376481646583195
sim_render-ego_min0.00519679643057443
simulation-passed1
step_physics_max0.07771484334985693
step_physics_mean0.07383951712094536
step_physics_median0.07338993234177157
step_physics_min0.07086336045038133
survival_time_max14.950000000000076
survival_time_mean8.787500000000021
survival_time_min2.1000000000000005
No reset possible
4267611504Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornomont04-85f844e025a2-10:04:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4265711498Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornomont04-85f844e025a2-10:06:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4264511497Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornomont04-85f844e025a2-10:05:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4262611498Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simtimeoutnomont04-85f844e025a2-1----No reset possible
4248711467Thomas Wiggers 🇳🇱ppo_v1aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1910693742269753
survival_time_median14.950000000000076
deviation-center-line_median1.5211680648003392
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02149347941080729
agent_compute-ego_mean0.021358089248339335
agent_compute-ego_median0.021377674738566083
agent_compute-ego_min0.021183528105417886
complete-iteration_max0.19448924620946248
complete-iteration_mean0.1863217224677404
complete-iteration_median0.184980784257253
complete-iteration_min0.180836075146993
deviation-center-line_max1.5959967261302574
deviation-center-line_mean1.5164321132462997
deviation-center-line_min1.4273955972542614
deviation-heading_max2.979285585359533
deviation-heading_mean1.8834106327762512
deviation-heading_median1.5705762021499088
deviation-heading_min1.413204541445655
driven_any_max3.5020583374016767
driven_any_mean2.977569547461178
driven_any_median3.210075361240885
driven_any_min1.9880691299612652
driven_lanedir_consec_max3.482503217887285
driven_lanedir_consec_mean2.934211023542576
driven_lanedir_consec_min1.8722021278290704
driven_lanedir_max3.482503217887285
driven_lanedir_mean2.934211023542576
driven_lanedir_median3.1910693742269753
driven_lanedir_min1.8722021278290704
get_duckie_state_max2.1497408548990887e-06
get_duckie_state_mean2.0559628804524743e-06
get_duckie_state_median2.047618230183919e-06
get_duckie_state_min1.978874206542969e-06
get_robot_state_max0.013778645992279051
get_robot_state_mean0.012834057013193763
get_robot_state_median0.012603472471237182
get_robot_state_min0.012350637118021647
get_state_dump_max0.01251104990641276
get_state_dump_mean0.012488120595614115
get_state_dump_median0.012492951154708862
get_state_dump_min0.012455530166625976
get_ui_image_max0.033526612917582195
get_ui_image_mean0.03286708374818166
get_ui_image_median0.03292099833488464
get_ui_image_min0.03209972540537516
in-drivable-lane_max0.9000000000000012
in-drivable-lane_mean0.2250000000000003
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0285383398074135, "get_ui_image": 0.03260090589523315, "step_physics": 0.06844564358393351, "survival_time": 14.950000000000076, "driven_lanedir": 3.0078498001383096, "get_state_dump": 0.012455530166625976, "sim_render-ego": 0.005307168165842692, "get_robot_state": 0.013778645992279051, "get_duckie_state": 2.087752024332682e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021450564861297608, "deviation-heading": 1.710532079572419, "complete-iteration": 0.18410576343536375, "set_robot_commands": 0.004140532016754151, "deviation-center-line": 1.5253245752690785, "driven_lanedir_consec": 3.0078498001383096, "sim_compute_sim_state": 0.02223816474278768, "sim_compute_performance-ego": 0.003554279804229736}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.391612382674357, "get_ui_image": 0.03209972540537516, "step_physics": 0.06802244265874227, "survival_time": 14.950000000000076, "driven_lanedir": 3.374288948315641, "get_state_dump": 0.012494507630666098, "sim_render-ego": 0.0051421848932902015, "get_robot_state": 0.012628579139709472, "get_duckie_state": 2.1497408548990887e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021183528105417886, "deviation-heading": 1.4306203247273988, "complete-iteration": 0.180836075146993, "set_robot_commands": 0.00383624792098999, "deviation-center-line": 1.4273955972542614, "driven_lanedir_consec": 3.374288948315641, "sim_compute_sim_state": 0.02182518720626831, "sim_compute_performance-ego": 0.0034641766548156737}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9880691299612652, "get_ui_image": 0.03324109077453613, "step_physics": 0.0720839254061381, "survival_time": 14.950000000000076, "driven_lanedir": 1.8722021278290704, "get_state_dump": 0.012491394678751627, "sim_render-ego": 0.00524781862894694, "get_robot_state": 0.012350637118021647, "get_duckie_state": 2.007484436035156e-06, "in-drivable-lane": 0.9000000000000012, "agent_compute-ego": 0.021304784615834554, "deviation-heading": 2.979285585359533, "complete-iteration": 0.18585580507914223, "set_robot_commands": 0.0038069470723470058, "deviation-center-line": 1.5959967261302574, "driven_lanedir_consec": 1.8722021278290704, "sim_compute_sim_state": 0.02171104431152344, "sim_compute_performance-ego": 0.003480024337768555}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5020583374016767, "get_ui_image": 0.033526612917582195, "step_physics": 0.07655810991923015, "survival_time": 14.950000000000076, "driven_lanedir": 3.482503217887285, "get_state_dump": 0.01251104990641276, "sim_render-ego": 0.00520655632019043, "get_robot_state": 0.012578365802764892, "get_duckie_state": 1.978874206542969e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02149347941080729, "deviation-heading": 1.413204541445655, "complete-iteration": 0.19448924620946248, "set_robot_commands": 0.0038842240969340007, "deviation-center-line": 1.5170115543315998, "driven_lanedir_consec": 3.482503217887285, "sim_compute_sim_state": 0.025089683532714843, "sim_compute_performance-ego": 0.0034994109471639}}
set_robot_commands_max0.004140532016754151
set_robot_commands_mean0.003916987776756286
set_robot_commands_median0.003860236008961995
set_robot_commands_min0.0038069470723470058
sim_compute_performance-ego_max0.003554279804229736
sim_compute_performance-ego_mean0.003499472935994466
sim_compute_performance-ego_median0.0034897176424662276
sim_compute_performance-ego_min0.0034641766548156737
sim_compute_sim_state_max0.025089683532714843
sim_compute_sim_state_mean0.02271601994832357
sim_compute_sim_state_median0.022031675974527994
sim_compute_sim_state_min0.02171104431152344
sim_render-ego_max0.005307168165842692
sim_render-ego_mean0.005225932002067567
sim_render-ego_median0.005227187474568685
sim_render-ego_min0.0051421848932902015
simulation-passed1
step_physics_max0.07655810991923015
step_physics_mean0.07127753039201101
step_physics_median0.07026478449503581
step_physics_min0.06802244265874227
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4246911462Jerome Labonte 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnomont04-85f844e025a2-10:09:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.632162675406713
survival_time_median14.950000000000076
deviation-center-line_median0.9565857004791408
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01731675068537394
agent_compute-ego_mean0.01711998720963796
agent_compute-ego_median0.017180082003275553
agent_compute-ego_min0.016803034146626792
complete-iteration_max0.1903740072250366
complete-iteration_mean0.18435632646083833
complete-iteration_median0.18327594836552935
complete-iteration_min0.18049940188725788
deviation-center-line_max1.0884129893975805
deviation-center-line_mean0.9687447491325776
deviation-center-line_min0.8733946061744474
deviation-heading_max3.898948341562476
deviation-heading_mean3.0256838654884626
deviation-heading_median2.9268487345138547
deviation-heading_min2.3500896513636635
driven_any_max4.060556014641398
driven_any_mean3.5871425631028813
driven_any_median3.731954826238189
driven_any_min2.8241045852937496
driven_lanedir_consec_max3.9929086697676617
driven_lanedir_consec_mean3.4840567124706965
driven_lanedir_consec_min2.6789928293017
driven_lanedir_max3.9929086697676617
driven_lanedir_mean3.4840567124706965
driven_lanedir_median3.632162675406713
driven_lanedir_min2.6789928293017
get_duckie_state_max3.235340118408203e-06
get_duckie_state_mean3.167390823364258e-06
get_duckie_state_median3.162225087483724e-06
get_duckie_state_min3.10977300008138e-06
get_robot_state_max0.013650256792704265
get_robot_state_mean0.0131141330798467
get_robot_state_median0.01310407797495524
get_robot_state_min0.012598119576772052
get_state_dump_max0.01288929303487142
get_state_dump_mean0.012614752650260923
get_state_dump_median0.012588260571161906
get_state_dump_min0.01239319642384847
get_ui_image_max0.033266041278839115
get_ui_image_mean0.03270504335562388
get_ui_image_median0.03263323148091634
get_ui_image_min0.03228766918182373
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.7263586692203368, "get_ui_image": 0.03240386168162028, "step_physics": 0.06985244035720825, "survival_time": 14.950000000000076, "driven_lanedir": 3.643874378538757, "get_state_dump": 0.01288929303487142, "sim_render-ego": 0.005271589756011963, "get_robot_state": 0.012897958755493164, "get_duckie_state": 3.235340118408203e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01713473876317342, "deviation-heading": 2.636641205213248, "complete-iteration": 0.1814075231552124, "set_robot_commands": 0.004449315071105957, "deviation-center-line": 1.0201970626813543, "driven_lanedir_consec": 3.643874378538757, "sim_compute_sim_state": 0.022778518994649253, "sim_compute_performance-ego": 0.003595783710479736}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.060556014641398, "get_ui_image": 0.03228766918182373, "step_physics": 0.069368683497111, "survival_time": 14.950000000000076, "driven_lanedir": 3.9929086697676617, "get_state_dump": 0.012701875368754069, "sim_render-ego": 0.005322590668996175, "get_robot_state": 0.013650256792704265, "get_duckie_state": 3.151098887125651e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016803034146626792, "deviation-heading": 2.3500896513636635, "complete-iteration": 0.18049940188725788, "set_robot_commands": 0.004448855717976888, "deviation-center-line": 0.8733946061744474, "driven_lanedir_consec": 3.9929086697676617, "sim_compute_sim_state": 0.022204841772715252, "sim_compute_performance-ego": 0.003578785260518392}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8241045852937496, "get_ui_image": 0.033266041278839115, "step_physics": 0.07385561466217042, "survival_time": 14.950000000000076, "driven_lanedir": 2.6789928293017, "get_state_dump": 0.01239319642384847, "sim_render-ego": 0.005289884408315023, "get_robot_state": 0.012598119576772052, "get_duckie_state": 3.173351287841797e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01731675068537394, "deviation-heading": 3.898948341562476, "complete-iteration": 0.18514437357584632, "set_robot_commands": 0.00451220989227295, "deviation-center-line": 1.0884129893975805, "driven_lanedir_consec": 2.6789928293017, "sim_compute_sim_state": 0.02223994811375936, "sim_compute_performance-ego": 0.0035377661387125652}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.73755098325604, "get_ui_image": 0.0328626012802124, "step_physics": 0.0758470090230306, "survival_time": 14.950000000000076, "driven_lanedir": 3.6204509722746687, "get_state_dump": 0.012474645773569742, "sim_render-ego": 0.005317169030507406, "get_robot_state": 0.013310197194417318, "get_duckie_state": 3.10977300008138e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017225425243377685, "deviation-heading": 3.2170562638144617, "complete-iteration": 0.1903740072250366, "set_robot_commands": 0.004514682292938233, "deviation-center-line": 0.8929743382769275, "driven_lanedir_consec": 3.6204509722746687, "sim_compute_sim_state": 0.025066443284352626, "sim_compute_performance-ego": 0.00362336794535319}}
set_robot_commands_max0.004514682292938233
set_robot_commands_mean0.0044812657435735065
set_robot_commands_median0.004480762481689453
set_robot_commands_min0.004448855717976888
sim_compute_performance-ego_max0.00362336794535319
sim_compute_performance-ego_mean0.003583925763765971
sim_compute_performance-ego_median0.003587284485499064
sim_compute_performance-ego_min0.0035377661387125652
sim_compute_sim_state_max0.025066443284352626
sim_compute_sim_state_mean0.02307243804136912
sim_compute_sim_state_median0.022509233554204304
sim_compute_sim_state_min0.022204841772715252
sim_render-ego_max0.005322590668996175
sim_render-ego_mean0.0053003084659576415
sim_render-ego_median0.005303526719411214
sim_render-ego_min0.005271589756011963
simulation-passed1
step_physics_max0.0758470090230306
step_physics_mean0.07223093688488007
step_physics_median0.07185402750968933
step_physics_min0.069368683497111
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible