Duckietown Challenges Home Challenges Submissions

Evaluator 780

ID780
evaluatoridsc-rudolf-34217
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-34217
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success32 19255
# timeout
# failed2 19387
# error30 19416
# aborted
# host-error1 20629
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
206292410jiang pengBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationhost-errornoidsc-rudolf-342170:23:31
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 691, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/589290b593980351bfba82f013e532025d5e8537bf4fd3d9e825c9e6038d75a2/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
206122377Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:07:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6706320447655254
survival_time_median3.649999999999995
deviation-center-line_median0.1443022347216951
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.05244414508342743
agent_compute-ego_mean0.05143808285698996
agent_compute-ego_median0.05161657503673008
agent_compute-ego_min0.049946056829916465
deviation-center-line_max0.20852123149077373
deviation-center-line_mean0.15888685918382944
deviation-center-line_min0.10671885526515967
deviation-heading_max0.6191860504142408
deviation-heading_mean0.5235971531668774
deviation-heading_median0.5153031432686003
deviation-heading_min0.42218734391092383
driven_any_max1.579642148338819
driven_any_mean0.99765012054497
driven_any_median0.9946421491379502
driven_any_min0.37967340513566655
driven_lanedir_consec_max1.2016447108169914
driven_lanedir_consec_mean0.7739098759832518
driven_lanedir_consec_min0.36653389634861655
driven_lanedir_max1.2016447108169914
driven_lanedir_mean0.7739098759832518
driven_lanedir_median0.6706320447655254
driven_lanedir_min0.36653389634861655
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9946421491379502, "sim_physics": 0.08504161769396638, "survival_time": 3.649999999999995, "driven_lanedir": 0.6706320447655254, "sim_render-ego": 0.056509413131295816, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05141494698720435, "deviation-heading": 0.5584700619682197, "set_robot_commands": 0.07417061557508495, "deviation-center-line": 0.1443022347216951, "driven_lanedir_consec": 0.6706320447655254, "sim_compute_sim_state": 0.03300116160144544, "sim_compute_performance-ego": 0.06019288546418491, "sim_compute_robot_state-ego": 0.05886808160233171, "sim_compute_robot_state-npc0": 0.06601657606151005, "sim_compute_robot_state-npc1": 0.06332751169596633, "sim_compute_robot_state-npc2": 0.06169461224177112, "sim_compute_robot_state-npc3": 0.06074440642578961}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4546507517736249, "sim_physics": 0.09313154864955592, "survival_time": 1.850000000000001, "driven_lanedir": 0.42942258152873247, "sim_render-ego": 0.05536842346191406, "in-drivable-lane": 0, "agent_compute-ego": 0.049946056829916465, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.07333932696162043, "deviation-center-line": 0.13176207049783456, "driven_lanedir_consec": 0.42942258152873247, "sim_compute_sim_state": 0.0319538180892532, "sim_compute_performance-ego": 0.060947579306525154, "sim_compute_robot_state-ego": 0.06027041899191367, "sim_compute_robot_state-npc0": 0.06855988502502441, "sim_compute_robot_state-npc1": 0.06056858397818901, "sim_compute_robot_state-npc2": 0.060290278615178286, "sim_compute_robot_state-npc3": 0.05859280921317435}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5796421483387897, "sim_physics": 0.09256887435913086, "survival_time": 5.599999999999988, "driven_lanedir": 1.201316146456393, "sim_render-ego": 0.055850950734955926, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.05176869034767151, "deviation-heading": 0.5153031432686003, "set_robot_commands": 0.10835618419306618, "deviation-center-line": 0.20852123149077373, "driven_lanedir_consec": 1.201316146456393, "sim_compute_sim_state": 0.0341703827892031, "sim_compute_performance-ego": 0.06312122941017151, "sim_compute_robot_state-ego": 0.060443720647266934, "sim_compute_robot_state-npc0": 0.06735682274614062, "sim_compute_robot_state-npc1": 0.06677813189370292, "sim_compute_robot_state-npc2": 0.0673480076449258, "sim_compute_robot_state-npc3": 0.06238724078450884}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.579642148338819, "sim_physics": 0.08503648638725281, "survival_time": 5.599999999999988, "driven_lanedir": 1.2016447108169914, "sim_render-ego": 0.0548650643655232, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.05161657503673008, "deviation-heading": 0.5028391662724023, "set_robot_commands": 0.07345304318836757, "deviation-center-line": 0.20312990394368424, "driven_lanedir_consec": 1.2016447108169914, "sim_compute_sim_state": 0.03300348988601139, "sim_compute_performance-ego": 0.058888256549835205, "sim_compute_robot_state-ego": 0.05693347113473075, "sim_compute_robot_state-npc0": 0.06607064817632947, "sim_compute_robot_state-npc1": 0.05967983177730015, "sim_compute_robot_state-npc2": 0.05941186845302582, "sim_compute_robot_state-npc3": 0.06018478104046413}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.37967340513566655, "sim_physics": 0.07826030254364014, "survival_time": 1.6000000000000008, "driven_lanedir": 0.36653389634861655, "sim_render-ego": 0.05607503652572632, "in-drivable-lane": 0, "agent_compute-ego": 0.05244414508342743, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.07365939021110535, "deviation-center-line": 0.10671885526515967, "driven_lanedir_consec": 0.36653389634861655, "sim_compute_sim_state": 0.0314159095287323, "sim_compute_performance-ego": 0.06443382799625397, "sim_compute_robot_state-ego": 0.060568057000637054, "sim_compute_robot_state-npc0": 0.06208465993404389, "sim_compute_robot_state-npc1": 0.058276355266571045, "sim_compute_robot_state-npc2": 0.05728187412023544, "sim_compute_robot_state-npc3": 0.0571461021900177}}
set_robot_commands_max0.10835618419306618
set_robot_commands_mean0.08059571202584889
set_robot_commands_median0.07365939021110535
set_robot_commands_min0.07333932696162043
sim_compute_performance-ego_max0.06443382799625397
sim_compute_performance-ego_mean0.06151675574539415
sim_compute_performance-ego_median0.060947579306525154
sim_compute_performance-ego_min0.058888256549835205
sim_compute_robot_state-ego_max0.060568057000637054
sim_compute_robot_state-ego_mean0.05941674987537602
sim_compute_robot_state-ego_median0.06027041899191367
sim_compute_robot_state-ego_min0.05693347113473075
sim_compute_robot_state-npc0_max0.06855988502502441
sim_compute_robot_state-npc0_mean0.06601771838860969
sim_compute_robot_state-npc0_median0.06607064817632947
sim_compute_robot_state-npc0_min0.06208465993404389
sim_compute_robot_state-npc1_max0.06677813189370292
sim_compute_robot_state-npc1_mean0.06172608292234588
sim_compute_robot_state-npc1_median0.06056858397818901
sim_compute_robot_state-npc1_min0.058276355266571045
sim_compute_robot_state-npc2_max0.0673480076449258
sim_compute_robot_state-npc2_mean0.06120532821502729
sim_compute_robot_state-npc2_median0.060290278615178286
sim_compute_robot_state-npc2_min0.05728187412023544
sim_compute_robot_state-npc3_max0.06238724078450884
sim_compute_robot_state-npc3_mean0.05981106793079092
sim_compute_robot_state-npc3_median0.06018478104046413
sim_compute_robot_state-npc3_min0.0571461021900177
sim_compute_sim_state_max0.0341703827892031
sim_compute_sim_state_mean0.03270895237892908
sim_compute_sim_state_median0.03300116160144544
sim_compute_sim_state_min0.0314159095287323
sim_physics_max0.09313154864955592
sim_physics_mean0.08680776592670922
sim_physics_median0.08504161769396638
sim_physics_min0.07826030254364014
sim_render-ego_max0.056509413131295816
sim_render-ego_mean0.05573377764388306
sim_render-ego_median0.055850950734955926
sim_render-ego_min0.0548650643655232
simulation-passed1
survival_time_max5.599999999999988
survival_time_mean3.6599999999999944
survival_time_min1.6000000000000008
No reset possible
206022399Liam Paull 🇨🇦random_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:07:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7060476436119825
survival_time_median2.9499999999999975
deviation-center-line_median0.11000911211661404
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12385066889100156
agent_compute-ego_mean0.121047300393235
agent_compute-ego_median0.1219197046958794
agent_compute-ego_min0.11746964139758416
deviation-center-line_max0.2756124593780862
deviation-center-line_mean0.14761657707365936
deviation-center-line_min0.05521015531316102
deviation-heading_max1.16360603086641
deviation-heading_mean0.4999185982159845
deviation-heading_median0.3379975413110555
deviation-heading_min0.23494529737543027
driven_any_max2.1872512115945857
driven_any_mean1.055944540531118
driven_any_median1.167808122478256
driven_any_min0.3209290725136122
driven_lanedir_consec_max0.9419039350715476
driven_lanedir_consec_mean0.6173219551829218
driven_lanedir_consec_min0.30305117192114617
driven_lanedir_max1.1635498459086595
driven_lanedir_mean0.6971981394313693
driven_lanedir_median0.7060476436119825
driven_lanedir_min0.30305117192114617
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.10888102144565222, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05760919597913634, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.11746964139758416, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.07862243337451287, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03621950914274971, "sim_compute_performance-ego": 0.06406571505204686, "sim_compute_robot_state-ego": 0.060844704789935415, "sim_compute_robot_state-npc0": 0.07128294009082722, "sim_compute_robot_state-npc1": 0.06341121331700739, "sim_compute_robot_state-npc2": 0.062433355259445475, "sim_compute_robot_state-npc3": 0.06101332745462094}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.09627854824066162, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.0584682822227478, "in-drivable-lane": 0, "agent_compute-ego": 0.12220295270284016, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.07342735926310222, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03350717822710673, "sim_compute_performance-ego": 0.06280506650606792, "sim_compute_robot_state-ego": 0.06330339113871257, "sim_compute_robot_state-npc0": 0.06612665454546611, "sim_compute_robot_state-npc1": 0.060298522313435875, "sim_compute_robot_state-npc2": 0.05950380365053813, "sim_compute_robot_state-npc3": 0.05651184916496277}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.10467116711503369, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06072317947775631, "in-drivable-lane": 0, "agent_compute-ego": 0.1219197046958794, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.07542906373234118, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.034839787725674906, "sim_compute_performance-ego": 0.06029464026628915, "sim_compute_robot_state-ego": 0.06044150611101571, "sim_compute_robot_state-npc0": 0.07211887634406655, "sim_compute_robot_state-npc1": 0.06626403533806235, "sim_compute_robot_state-npc2": 0.060879953836990616, "sim_compute_robot_state-npc3": 0.05981610589108224}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.10632740441015212, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.0594525013939809, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12385066889100156, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.07769370483139813, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03535045607615325, "sim_compute_performance-ego": 0.06235679125381728, "sim_compute_robot_state-ego": 0.06242560128034171, "sim_compute_robot_state-npc0": 0.06630405329041562, "sim_compute_robot_state-npc1": 0.0652693570670435, "sim_compute_robot_state-npc2": 0.06283178167828059, "sim_compute_robot_state-npc3": 0.061541989698248395}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.08837465047836304, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.060382735729217527, "in-drivable-lane": 0, "agent_compute-ego": 0.11979353427886964, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.07608112096786498, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.0447939395904541, "sim_compute_performance-ego": 0.05951004028320313, "sim_compute_robot_state-ego": 0.0626949667930603, "sim_compute_robot_state-npc0": 0.06587731838226318, "sim_compute_robot_state-npc1": 0.06078864336013794, "sim_compute_robot_state-npc2": 0.06116000413894653, "sim_compute_robot_state-npc3": 0.06305689811706543}}
set_robot_commands_max0.07862243337451287
set_robot_commands_mean0.07625073643384388
set_robot_commands_median0.07608112096786498
set_robot_commands_min0.07342735926310222
sim_compute_performance-ego_max0.06406571505204686
sim_compute_performance-ego_mean0.061806450672284866
sim_compute_performance-ego_median0.06235679125381728
sim_compute_performance-ego_min0.05951004028320313
sim_compute_robot_state-ego_max0.06330339113871257
sim_compute_robot_state-ego_mean0.061942034022613134
sim_compute_robot_state-ego_median0.06242560128034171
sim_compute_robot_state-ego_min0.06044150611101571
sim_compute_robot_state-npc0_max0.07211887634406655
sim_compute_robot_state-npc0_mean0.06834196853060773
sim_compute_robot_state-npc0_median0.06630405329041562
sim_compute_robot_state-npc0_min0.06587731838226318
sim_compute_robot_state-npc1_max0.06626403533806235
sim_compute_robot_state-npc1_mean0.06320635427913741
sim_compute_robot_state-npc1_median0.06341121331700739
sim_compute_robot_state-npc1_min0.060298522313435875
sim_compute_robot_state-npc2_max0.06283178167828059
sim_compute_robot_state-npc2_mean0.06136177971284026
sim_compute_robot_state-npc2_median0.06116000413894653
sim_compute_robot_state-npc2_min0.05950380365053813
sim_compute_robot_state-npc3_max0.06305689811706543
sim_compute_robot_state-npc3_mean0.06038803406519595
sim_compute_robot_state-npc3_median0.06101332745462094
sim_compute_robot_state-npc3_min0.05651184916496277
sim_compute_sim_state_max0.0447939395904541
sim_compute_sim_state_mean0.03694217415242774
sim_compute_sim_state_median0.03535045607615325
sim_compute_sim_state_min0.03350717822710673
sim_physics_max0.10888102144565222
sim_physics_mean0.10090655833797252
sim_physics_median0.10467116711503369
sim_physics_min0.08837465047836304
sim_render-ego_max0.06072317947775631
sim_render-ego_mean0.05932717896056777
sim_render-ego_median0.0594525013939809
sim_render-ego_min0.05760919597913634
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean2.679999999999997
survival_time_min1.0000000000000002
No reset possible
205922404Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12575227301446867
survival_time_median1.2500000000000004
deviation-center-line_median0.07983843130682763
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2352805534998576
agent_compute-ego_mean0.2145874379295874
agent_compute-ego_median0.21445388143712824
agent_compute-ego_min0.19332947269562753
deviation-center-line_max0.10876226320733676
deviation-center-line_mean0.07922258121163858
deviation-center-line_min0.055127321578047055
deviation-heading_max0.8418550107263465
deviation-heading_mean0.6764806788015136
deviation-heading_median0.8114486770531056
deviation-heading_min0.429932095379765
driven_any_max0.22083820096404377
driven_any_mean0.18077346137965497
driven_any_median0.17751226986785562
driven_any_min0.13682786199392313
driven_lanedir_consec_max0.14467071276565502
driven_lanedir_consec_mean0.1086104404885688
driven_lanedir_consec_min0.0537785946064635
driven_lanedir_max0.14467071276565502
driven_lanedir_mean0.1086104404885688
driven_lanedir_median0.12575227301446867
driven_lanedir_min0.0537785946064635
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.14000000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22083820096404377, "sim_physics": 0.09803860418258174, "survival_time": 1.5500000000000007, "driven_lanedir": 0.12575227301446867, "sim_render-ego": 0.050281701549406976, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.19332947269562753, "deviation-heading": 0.8418550107263465, "set_robot_commands": 0.07867956930591215, "deviation-center-line": 0.07983843130682763, "driven_lanedir_consec": 0.12575227301446867, "sim_compute_sim_state": 0.0315612131549466, "sim_compute_performance-ego": 0.05475755660764633, "sim_compute_robot_state-ego": 0.0582498965724822, "sim_compute_robot_state-npc0": 0.06490018290858116, "sim_compute_robot_state-npc1": 0.05828119093371976, "sim_compute_robot_state-npc2": 0.05770516395568848, "sim_compute_robot_state-npc3": 0.05572328259868006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.196139401428116, "sim_physics": 0.08240439742803574, "survival_time": 1.6000000000000008, "driven_lanedir": 0.0537785946064635, "sim_render-ego": 0.05285724252462387, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.21781418472528455, "deviation-heading": 0.8286936497668178, "set_robot_commands": 0.07115970551967621, "deviation-center-line": 0.05524765665309959, "driven_lanedir_consec": 0.0537785946064635, "sim_compute_sim_state": 0.03178541362285614, "sim_compute_performance-ego": 0.05689180642366409, "sim_compute_robot_state-ego": 0.05705834925174713, "sim_compute_robot_state-npc0": 0.06597065180540085, "sim_compute_robot_state-npc1": 0.058847129344940186, "sim_compute_robot_state-npc2": 0.05798310786485672, "sim_compute_robot_state-npc3": 0.05734642595052719}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17751226986785562, "sim_physics": 0.08474980354309082, "survival_time": 1.2500000000000004, "driven_lanedir": 0.144446070321266, "sim_render-ego": 0.05437496185302734, "in-drivable-lane": 0, "agent_compute-ego": 0.21205909729003905, "deviation-heading": 0.4704739610815334, "set_robot_commands": 0.07289416313171387, "deviation-center-line": 0.10876226320733676, "driven_lanedir_consec": 0.144446070321266, "sim_compute_sim_state": 0.031049814224243164, "sim_compute_performance-ego": 0.05575689315795898, "sim_compute_robot_state-ego": 0.056070623397827146, "sim_compute_robot_state-npc0": 0.05905048370361328, "sim_compute_robot_state-npc1": 0.06290489196777344, "sim_compute_robot_state-npc2": 0.06130355834960938, "sim_compute_robot_state-npc3": 0.05634234428405762}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17254957264433635, "sim_physics": 0.08971557021141052, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14467071276565502, "sim_render-ego": 0.051661938428878784, "in-drivable-lane": 0, "agent_compute-ego": 0.2352805534998576, "deviation-heading": 0.429932095379765, "set_robot_commands": 0.08013522624969482, "deviation-center-line": 0.09713723331288192, "driven_lanedir_consec": 0.14467071276565502, "sim_compute_sim_state": 0.030102849006652832, "sim_compute_performance-ego": 0.05553057789802551, "sim_compute_robot_state-ego": 0.05886609355608622, "sim_compute_robot_state-npc0": 0.05803353587786357, "sim_compute_robot_state-npc1": 0.05642022689183553, "sim_compute_robot_state-npc2": 0.053635736306508384, "sim_compute_robot_state-npc3": 0.0533204178015391}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13682786199392313, "sim_physics": 0.07687117836692116, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07440455173499083, "sim_render-ego": 0.05800366401672363, "in-drivable-lane": 0, "agent_compute-ego": 0.21445388143712824, "deviation-heading": 0.8114486770531056, "set_robot_commands": 0.07627399401231245, "deviation-center-line": 0.055127321578047055, "driven_lanedir_consec": 0.07440455173499083, "sim_compute_sim_state": 0.03458314592188055, "sim_compute_performance-ego": 0.05778415636582808, "sim_compute_robot_state-ego": 0.060205481269142845, "sim_compute_robot_state-npc0": 0.06725816293196245, "sim_compute_robot_state-npc1": 0.06252110004425049, "sim_compute_robot_state-npc2": 0.0612428296696056, "sim_compute_robot_state-npc3": 0.0616758411580866}}
set_robot_commands_max0.08013522624969482
set_robot_commands_mean0.0758285316438619
set_robot_commands_median0.07627399401231245
set_robot_commands_min0.07115970551967621
sim_compute_performance-ego_max0.05778415636582808
sim_compute_performance-ego_mean0.0561441980906246
sim_compute_performance-ego_median0.05575689315795898
sim_compute_performance-ego_min0.05475755660764633
sim_compute_robot_state-ego_max0.060205481269142845
sim_compute_robot_state-ego_mean0.05809008880945711
sim_compute_robot_state-ego_median0.0582498965724822
sim_compute_robot_state-ego_min0.056070623397827146
sim_compute_robot_state-npc0_max0.06725816293196245
sim_compute_robot_state-npc0_mean0.06304260344548426
sim_compute_robot_state-npc0_median0.06490018290858116
sim_compute_robot_state-npc0_min0.05803353587786357
sim_compute_robot_state-npc1_max0.06290489196777344
sim_compute_robot_state-npc1_mean0.059794907836503874
sim_compute_robot_state-npc1_median0.058847129344940186
sim_compute_robot_state-npc1_min0.05642022689183553
sim_compute_robot_state-npc2_max0.06130355834960938
sim_compute_robot_state-npc2_mean0.05837407922925371
sim_compute_robot_state-npc2_median0.05798310786485672
sim_compute_robot_state-npc2_min0.053635736306508384
sim_compute_robot_state-npc3_max0.0616758411580866
sim_compute_robot_state-npc3_mean0.05688166235857811
sim_compute_robot_state-npc3_median0.05634234428405762
sim_compute_robot_state-npc3_min0.0533204178015391
sim_compute_sim_state_max0.03458314592188055
sim_compute_sim_state_mean0.031816487186115856
sim_compute_sim_state_median0.0315612131549466
sim_compute_sim_state_min0.030102849006652832
sim_physics_max0.09803860418258174
sim_physics_mean0.086355910746408
sim_physics_median0.08474980354309082
sim_physics_min0.07687117836692116
sim_render-ego_max0.05800366401672363
sim_render-ego_mean0.05343590167453212
sim_render-ego_median0.05285724252462387
sim_render-ego_min0.050281701549406976
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3400000000000003
survival_time_min1.1000000000000003
No reset possible
202222978Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:21:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0677192086065117
survival_time_median11.050000000000022
deviation-center-line_median0.6625553328518204
in-drivable-lane_median0


other stats
agent_compute-ego_max0.18747536407029333
agent_compute-ego_mean0.1846889475425117
agent_compute-ego_median0.18674658326541677
agent_compute-ego_min0.1802676458494358
deviation-center-line_max0.9142610817874374
deviation-center-line_mean0.630689968416167
deviation-center-line_min0.3314193529537079
deviation-heading_max1.7613351923273304
deviation-heading_mean1.26132139593324
deviation-heading_median1.1835599804004386
deviation-heading_min0.8760974466586153
driven_any_max1.3894279741935052
driven_any_mean1.0349692312089578
driven_any_median1.0764085554742084
driven_any_min0.5402579700227935
driven_lanedir_consec_max1.3801682111753335
driven_lanedir_consec_mean1.0120530704919617
driven_lanedir_consec_min0.48397171734056377
driven_lanedir_max1.3801682111753335
driven_lanedir_mean1.0120530704919617
driven_lanedir_median1.0677192086065117
driven_lanedir_min0.48397171734056377
in-drivable-lane_max0.2499999999999991
in-drivable-lane_mean0.0700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5402579700227935, "sim_physics": 0.09750149269734532, "survival_time": 6.0499999999999865, "driven_lanedir": 0.48397171734056377, "sim_render-ego": 0.05974394033763034, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.18747536407029333, "deviation-heading": 1.7613351923273304, "set_robot_commands": 0.07561811336801072, "deviation-center-line": 0.3314193529537079, "driven_lanedir_consec": 0.48397171734056377, "sim_compute_sim_state": 0.035217982678373984, "sim_compute_performance-ego": 0.06306413185497946, "sim_compute_robot_state-ego": 0.060834762478662915, "sim_compute_robot_state-npc0": 0.06738303121456429, "sim_compute_robot_state-npc1": 0.06434225641991481, "sim_compute_robot_state-npc2": 0.06342993097857011, "sim_compute_robot_state-npc3": 0.06286244944107434}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3894279741935052, "sim_physics": 0.10582036256790162, "survival_time": 14.950000000000076, "driven_lanedir": 1.3801682111753335, "sim_render-ego": 0.057316935062408446, "in-drivable-lane": 0, "agent_compute-ego": 0.18192693551381428, "deviation-heading": 1.0895746259024286, "set_robot_commands": 0.07656848986943562, "deviation-center-line": 0.7399350665792067, "driven_lanedir_consec": 1.3801682111753335, "sim_compute_sim_state": 0.034437518119812015, "sim_compute_performance-ego": 0.061372927029927575, "sim_compute_robot_state-ego": 0.06052125612894694, "sim_compute_robot_state-npc0": 0.0670761744181315, "sim_compute_robot_state-npc1": 0.06225748062133789, "sim_compute_robot_state-npc2": 0.061668973763783774, "sim_compute_robot_state-npc3": 0.06116418679555257}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0762232804701697, "sim_physics": 0.09814909736127084, "survival_time": 10.550000000000017, "driven_lanedir": 1.0677192086065117, "sim_render-ego": 0.05835637775077639, "in-drivable-lane": 0, "agent_compute-ego": 0.1802676458494358, "deviation-heading": 0.8760974466586153, "set_robot_commands": 0.07804918967152094, "deviation-center-line": 0.9142610817874374, "driven_lanedir_consec": 1.0677192086065117, "sim_compute_sim_state": 0.036998685502328016, "sim_compute_performance-ego": 0.06237058390938275, "sim_compute_robot_state-ego": 0.06072040191758865, "sim_compute_robot_state-npc0": 0.06880995673590927, "sim_compute_robot_state-npc1": 0.06284103122367678, "sim_compute_robot_state-npc2": 0.06210621047358942, "sim_compute_robot_state-npc3": 0.06211110313921743}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.092528375884112, "sim_physics": 0.09825741818972995, "survival_time": 11.200000000000024, "driven_lanedir": 1.0786212808981706, "sim_render-ego": 0.05835655544485365, "in-drivable-lane": 0, "agent_compute-ego": 0.18702820901359832, "deviation-heading": 1.1835599804004386, "set_robot_commands": 0.07608767279556819, "deviation-center-line": 0.6625553328518204, "driven_lanedir_consec": 1.0786212808981706, "sim_compute_sim_state": 0.03585906007460186, "sim_compute_performance-ego": 0.06160723205123629, "sim_compute_robot_state-ego": 0.06131310441664287, "sim_compute_robot_state-npc0": 0.07007317138569695, "sim_compute_robot_state-npc1": 0.06546950127397265, "sim_compute_robot_state-npc2": 0.06397405479635511, "sim_compute_robot_state-npc3": 0.06388107048613685}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0764085554742084, "sim_physics": 0.09614353482000428, "survival_time": 11.050000000000022, "driven_lanedir": 1.0497849344392278, "sim_render-ego": 0.057707802742315094, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.18674658326541677, "deviation-heading": 1.3960397343773852, "set_robot_commands": 0.07777831241555883, "deviation-center-line": 0.5052790079086625, "driven_lanedir_consec": 1.0497849344392278, "sim_compute_sim_state": 0.03593715391547432, "sim_compute_performance-ego": 0.06258493419146646, "sim_compute_robot_state-ego": 0.06267696592063386, "sim_compute_robot_state-npc0": 0.06821895292981178, "sim_compute_robot_state-npc1": 0.06463004237386435, "sim_compute_robot_state-npc2": 0.06353550906634439, "sim_compute_robot_state-npc3": 0.06384068376877729}}
set_robot_commands_max0.07804918967152094
set_robot_commands_mean0.07682035562401887
set_robot_commands_median0.07656848986943562
set_robot_commands_min0.07561811336801072
sim_compute_performance-ego_max0.06306413185497946
sim_compute_performance-ego_mean0.06219996180739851
sim_compute_performance-ego_median0.06237058390938275
sim_compute_performance-ego_min0.061372927029927575
sim_compute_robot_state-ego_max0.06267696592063386
sim_compute_robot_state-ego_mean0.061213298172495045
sim_compute_robot_state-ego_median0.060834762478662915
sim_compute_robot_state-ego_min0.06052125612894694
sim_compute_robot_state-npc0_max0.07007317138569695
sim_compute_robot_state-npc0_mean0.06831225733682277
sim_compute_robot_state-npc0_median0.06821895292981178
sim_compute_robot_state-npc0_min0.0670761744181315
sim_compute_robot_state-npc1_max0.06546950127397265
sim_compute_robot_state-npc1_mean0.06390806238255331
sim_compute_robot_state-npc1_median0.06434225641991481
sim_compute_robot_state-npc1_min0.06225748062133789
sim_compute_robot_state-npc2_max0.06397405479635511
sim_compute_robot_state-npc2_mean0.06294293581572856
sim_compute_robot_state-npc2_median0.06342993097857011
sim_compute_robot_state-npc2_min0.061668973763783774
sim_compute_robot_state-npc3_max0.06388107048613685
sim_compute_robot_state-npc3_mean0.06277189872615169
sim_compute_robot_state-npc3_median0.06286244944107434
sim_compute_robot_state-npc3_min0.06116418679555257
sim_compute_sim_state_max0.036998685502328016
sim_compute_sim_state_mean0.03569008005811804
sim_compute_sim_state_median0.03585906007460186
sim_compute_sim_state_min0.034437518119812015
sim_physics_max0.10582036256790162
sim_physics_mean0.0991743811272504
sim_physics_median0.09814909736127084
sim_physics_min0.09614353482000428
sim_render-ego_max0.05974394033763034
sim_render-ego_mean0.058296322267596776
sim_render-ego_median0.05835637775077639
sim_render-ego_min0.057316935062408446
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.760000000000025
survival_time_min6.0499999999999865
No reset possible
202132991Artem Ioselevskiichallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:04:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.45184217027453455
survival_time_median1.7500000000000009
deviation-center-line_median0.094924391504323
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1400266715458461
agent_compute-ego_mean0.13157538507381933
agent_compute-ego_median0.12947558067940376
agent_compute-ego_min0.12542751739765037
deviation-center-line_max0.16631343996338216
deviation-center-line_mean0.11421351738832364
deviation-center-line_min0.0754692084971031
deviation-heading_max1.072159954459151
deviation-heading_mean0.576426850427586
deviation-heading_median0.44521246971815515
deviation-heading_min0.3946956646203656
driven_any_max1.1427967168569593
driven_any_mean0.588596798101203
driven_any_median0.49890250041207895
driven_any_min0.31782929302466106
driven_lanedir_consec_max0.745639047805466
driven_lanedir_consec_mean0.47949544781269465
driven_lanedir_consec_min0.2933101152400397
driven_lanedir_max0.745639047805466
driven_lanedir_mean0.47949544781269465
driven_lanedir_median0.45184217027453455
driven_lanedir_min0.2933101152400397
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.14999999999999952
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4554240134167317, "sim_physics": 0.05287585587337099, "survival_time": 1.4500000000000006, "driven_lanedir": 0.39556147978925127, "sim_render-ego": 0.05353543676179031, "in-drivable-lane": 0, "agent_compute-ego": 0.12542751739765037, "deviation-heading": 0.44521246971815515, "set_robot_commands": 0.07479430067128148, "deviation-center-line": 0.09227686451743008, "driven_lanedir_consec": 0.39556147978925127, "sim_compute_sim_state": 0.0350556702449404, "sim_compute_performance-ego": 0.05899191724842992, "sim_compute_robot_state-ego": 0.06173159336221629}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.31782929302466106, "sim_physics": 0.05409352595989521, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2933101152400397, "sim_render-ego": 0.0580291564647968, "in-drivable-lane": 0, "agent_compute-ego": 0.12771711899684027, "deviation-heading": 0.4146018617717943, "set_robot_commands": 0.07606768608093262, "deviation-center-line": 0.0754692084971031, "driven_lanedir_consec": 0.2933101152400397, "sim_compute_sim_state": 0.04073772063622108, "sim_compute_performance-ego": 0.06289351903475247, "sim_compute_robot_state-ego": 0.06403804742372952}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5280314667955844, "sim_physics": 0.05366514824532174, "survival_time": 1.850000000000001, "driven_lanedir": 0.5111244259541818, "sim_render-ego": 0.05421667485623746, "in-drivable-lane": 0, "agent_compute-ego": 0.12947558067940376, "deviation-heading": 0.3946956646203656, "set_robot_commands": 0.07767478839771168, "deviation-center-line": 0.1420836824593798, "driven_lanedir_consec": 0.5111244259541818, "sim_compute_sim_state": 0.03471827507019043, "sim_compute_performance-ego": 0.059237873232042465, "sim_compute_robot_state-ego": 0.05797912623431232}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.49890250041207895, "sim_physics": 0.05750490597316197, "survival_time": 1.7500000000000009, "driven_lanedir": 0.45184217027453455, "sim_render-ego": 0.06315766062055315, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1400266715458461, "deviation-heading": 0.5554643015684639, "set_robot_commands": 0.07901770727975028, "deviation-center-line": 0.094924391504323, "driven_lanedir_consec": 0.45184217027453455, "sim_compute_sim_state": 0.0405963557107108, "sim_compute_performance-ego": 0.06485828672136579, "sim_compute_robot_state-ego": 0.06339710780552456}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1427967168569593, "sim_physics": 0.05590108857638594, "survival_time": 3.4499999999999957, "driven_lanedir": 0.745639047805466, "sim_render-ego": 0.05923245609670445, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.13523003674935605, "deviation-heading": 1.072159954459151, "set_robot_commands": 0.07939156587573065, "deviation-center-line": 0.16631343996338216, "driven_lanedir_consec": 0.745639047805466, "sim_compute_sim_state": 0.03918112879214079, "sim_compute_performance-ego": 0.06494645104892012, "sim_compute_robot_state-ego": 0.0635929418646771}}
set_robot_commands_max0.07939156587573065
set_robot_commands_mean0.07738920966108134
set_robot_commands_median0.07767478839771168
set_robot_commands_min0.07479430067128148
sim_compute_performance-ego_max0.06494645104892012
sim_compute_performance-ego_mean0.06218560945710215
sim_compute_performance-ego_median0.06289351903475247
sim_compute_performance-ego_min0.05899191724842992
sim_compute_robot_state-ego_max0.06403804742372952
sim_compute_robot_state-ego_mean0.06214776333809195
sim_compute_robot_state-ego_median0.06339710780552456
sim_compute_robot_state-ego_min0.05797912623431232
sim_compute_sim_state_max0.04073772063622108
sim_compute_sim_state_mean0.038057830090840704
sim_compute_sim_state_median0.03918112879214079
sim_compute_sim_state_min0.03471827507019043
sim_physics_max0.05750490597316197
sim_physics_mean0.05480810492562717
sim_physics_median0.05409352595989521
sim_physics_min0.05287585587337099
sim_render-ego_max0.06315766062055315
sim_render-ego_mean0.05763427696001644
sim_render-ego_median0.0580291564647968
sim_render-ego_min0.05353543676179031
simulation-passed1
survival_time_max3.4499999999999957
survival_time_mean1.9599999999999995
survival_time_min1.3000000000000005
No reset possible
201842711Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.20634987115105471
survival_time_median2.000000000000001
deviation-center-line_median0.1523986725414952
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06253329912821452
agent_compute-ego_mean0.060173251187094
agent_compute-ego_median0.06029429700639513
agent_compute-ego_min0.058296551423914295
deviation-center-line_max0.50620172739154
deviation-center-line_mean0.23574951273678552
deviation-center-line_min0.12400568266662276
deviation-heading_max4.480112757195974
deviation-heading_mean1.5358439118198275
deviation-heading_median1.079687993544907
deviation-heading_min0.4006765143176738
driven_any_max1.3122512429058175
driven_any_mean0.5908535446220309
driven_any_median0.26766677090601043
driven_any_min0.18733816800450537
driven_lanedir_consec_max0.8248605276485121
driven_lanedir_consec_mean0.3061454716167337
driven_lanedir_consec_min0.116584957256459
driven_lanedir_max1.0276516752198268
driven_lanedir_mean0.36233939797378817
driven_lanedir_median0.20634987115105471
driven_lanedir_min0.17531370591599815
in-drivable-lane_max4.199999999999986
in-drivable-lane_mean0.879999999999997
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.95148051829978, "sim_physics": 0.10226493557607096, "survival_time": 6.349999999999985, "driven_lanedir": 0.1947634414704165, "sim_render-ego": 0.0496853280255175, "in-drivable-lane": 4.199999999999986, "agent_compute-ego": 0.05876086452814538, "deviation-heading": 1.079687993544907, "set_robot_commands": 0.07178751126987727, "deviation-center-line": 0.2596017153716278, "driven_lanedir_consec": 0.116584957256459, "sim_compute_sim_state": 0.03083073998999408, "sim_compute_performance-ego": 0.05198220005185585, "sim_compute_robot_state-ego": 0.053281461160014, "sim_compute_robot_state-npc0": 0.056953884485199696, "sim_compute_robot_state-npc1": 0.053657092447355975, "sim_compute_robot_state-npc2": 0.05373571238179845, "sim_compute_robot_state-npc3": 0.05336909594498281}, "udem1-1-0": {"driven_any": 0.26766677090601043, "sim_physics": 0.09886355996131896, "survival_time": 2.000000000000001, "driven_lanedir": 0.20634987115105471, "sim_render-ego": 0.052667641639709474, "in-drivable-lane": 0, "agent_compute-ego": 0.06098124384880066, "deviation-heading": 1.135246381689666, "set_robot_commands": 0.073398756980896, "deviation-center-line": 0.12400568266662276, "driven_lanedir_consec": 0.20634987115105471, "sim_compute_sim_state": 0.03101869821548462, "sim_compute_performance-ego": 0.0555594801902771, "sim_compute_robot_state-ego": 0.05666563510894775, "sim_compute_robot_state-npc0": 0.059556597471237184, "sim_compute_robot_state-npc1": 0.058063411712646486, "sim_compute_robot_state-npc2": 0.05895199179649353, "sim_compute_robot_state-npc3": 0.05696186423301697}, "udem1-2-0": {"driven_any": 0.18733816800450537, "sim_physics": 0.11369189421335855, "survival_time": 1.5000000000000009, "driven_lanedir": 0.17531370591599815, "sim_render-ego": 0.052576541900634766, "in-drivable-lane": 0, "agent_compute-ego": 0.06253329912821452, "deviation-heading": 0.4006765143176738, "set_robot_commands": 0.07828320662180582, "deviation-center-line": 0.1365397657126417, "driven_lanedir_consec": 0.17531370591599815, "sim_compute_sim_state": 0.032396737734476724, "sim_compute_performance-ego": 0.058304397265116374, "sim_compute_robot_state-ego": 0.057978185017903645, "sim_compute_robot_state-npc0": 0.05993693669637045, "sim_compute_robot_state-npc1": 0.05844870408376058, "sim_compute_robot_state-npc2": 0.0599135955174764, "sim_compute_robot_state-npc3": 0.05966228644053141}, "udem1-3-0": {"driven_any": 0.23553102299404055, "sim_physics": 0.10797321796417236, "survival_time": 1.800000000000001, "driven_lanedir": 0.20761829611164465, "sim_render-ego": 0.0512114961942037, "in-drivable-lane": 0, "agent_compute-ego": 0.06029429700639513, "deviation-heading": 0.5834959123509181, "set_robot_commands": 0.07428764634662205, "deviation-center-line": 0.1523986725414952, "driven_lanedir_consec": 0.20761829611164465, "sim_compute_sim_state": 0.03424927923414442, "sim_compute_performance-ego": 0.0572663942972819, "sim_compute_robot_state-ego": 0.057440188195970326, "sim_compute_robot_state-npc0": 0.059699548615349665, "sim_compute_robot_state-npc1": 0.05750511089960734, "sim_compute_robot_state-npc2": 0.05698147084977892, "sim_compute_robot_state-npc3": 0.05791522396935357}, "udem1-4-0": {"driven_any": 1.3122512429058175, "sim_physics": 0.1058003117056454, "survival_time": 8.499999999999986, "driven_lanedir": 1.0276516752198268, "sim_render-ego": 0.051137502053204706, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.058296551423914295, "deviation-heading": 4.480112757195974, "set_robot_commands": 0.07314035051009234, "deviation-center-line": 0.50620172739154, "driven_lanedir_consec": 0.8248605276485121, "sim_compute_sim_state": 0.03140432413886575, "sim_compute_performance-ego": 0.05501239440020393, "sim_compute_robot_state-ego": 0.05523665652555578, "sim_compute_robot_state-npc0": 0.05750878418193144, "sim_compute_robot_state-npc1": 0.056188047633451574, "sim_compute_robot_state-npc2": 0.05555415574242087, "sim_compute_robot_state-npc3": 0.05559402073130888}}
set_robot_commands_max0.07828320662180582
set_robot_commands_mean0.0741794943458587
set_robot_commands_median0.073398756980896
set_robot_commands_min0.07178751126987727
sim_compute_performance-ego_max0.058304397265116374
sim_compute_performance-ego_mean0.05562497324094703
sim_compute_performance-ego_median0.0555594801902771
sim_compute_performance-ego_min0.05198220005185585
sim_compute_robot_state-ego_max0.057978185017903645
sim_compute_robot_state-ego_mean0.0561204252016783
sim_compute_robot_state-ego_median0.05666563510894775
sim_compute_robot_state-ego_min0.053281461160014
sim_compute_robot_state-npc0_max0.05993693669637045
sim_compute_robot_state-npc0_mean0.058731150290017686
sim_compute_robot_state-npc0_median0.059556597471237184
sim_compute_robot_state-npc0_min0.056953884485199696
sim_compute_robot_state-npc1_max0.05844870408376058
sim_compute_robot_state-npc1_mean0.05677247335536438
sim_compute_robot_state-npc1_median0.05750511089960734
sim_compute_robot_state-npc1_min0.053657092447355975
sim_compute_robot_state-npc2_max0.0599135955174764
sim_compute_robot_state-npc2_mean0.057027385257593634
sim_compute_robot_state-npc2_median0.05698147084977892
sim_compute_robot_state-npc2_min0.05373571238179845
sim_compute_robot_state-npc3_max0.05966228644053141
sim_compute_robot_state-npc3_mean0.05670049826383873
sim_compute_robot_state-npc3_median0.05696186423301697
sim_compute_robot_state-npc3_min0.05336909594498281
sim_compute_sim_state_max0.03424927923414442
sim_compute_sim_state_mean0.03197995586259311
sim_compute_sim_state_median0.03140432413886575
sim_compute_sim_state_min0.03083073998999408
sim_physics_max0.11369189421335855
sim_physics_mean0.10571878388411324
sim_physics_median0.1058003117056454
sim_physics_min0.09886355996131896
sim_render-ego_max0.052667641639709474
sim_render-ego_mean0.05145570196265403
sim_render-ego_median0.0512114961942037
sim_render-ego_min0.0496853280255175
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean4.029999999999995
survival_time_min1.5000000000000009
No reset possible
201502965Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:15:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3413267165137295
survival_time_median7.199999999999982
deviation-center-line_median0.2308507720624728
in-drivable-lane_median3.599999999999987


other stats
agent_compute-ego_max0.18700478553771976
agent_compute-ego_mean0.18078395001124065
agent_compute-ego_median0.181970903078715
agent_compute-ego_min0.1735318884963081
deviation-center-line_max1.2329977110745145
deviation-center-line_mean0.4235464747886325
deviation-center-line_min0.1860005752625475
deviation-heading_max2.127327872860572
deviation-heading_mean1.3892400287058124
deviation-heading_median1.3574412465595886
deviation-heading_min0.7618930589113966
driven_any_max1.527607535434541
driven_any_mean0.8974439386730124
driven_any_median0.7453299047262127
driven_any_min0.6373008840752825
driven_lanedir_consec_max1.1059403880188825
driven_lanedir_consec_mean0.461861377885567
driven_lanedir_consec_min0.22830451641695504
driven_lanedir_max1.1059403880188825
driven_lanedir_mean0.46189460753363576
driven_lanedir_median0.3413267165137295
driven_lanedir_min0.22830451641695504
in-drivable-lane_max4.5
in-drivable-lane_mean3.3099999999999925
in-drivable-lane_min1.699999999999994
per-episodes
details{"udem1-0-0": {"driven_any": 1.527607535434541, "sim_physics": 0.04751564900080363, "survival_time": 14.950000000000076, "driven_lanedir": 1.1059403880188825, "sim_render-ego": 0.06152413368225098, "in-drivable-lane": 4.5, "agent_compute-ego": 0.181970903078715, "deviation-heading": 2.127327872860572, "set_robot_commands": 0.07525146802266439, "deviation-center-line": 1.2329977110745145, "driven_lanedir_consec": 1.1059403880188825, "sim_compute_sim_state": 0.03595600366592407, "sim_compute_performance-ego": 0.06324440161387125, "sim_compute_robot_state-ego": 0.06243778864542643, "sim_compute_robot_state-npc0": 0.0695353627204895, "sim_compute_robot_state-npc1": 0.06469186385472615, "sim_compute_robot_state-npc2": 0.06429479042689006, "sim_compute_robot_state-npc3": 0.06421693483988444}, "udem1-1-0": {"driven_any": 0.6862087837734212, "sim_physics": 0.046371049880981445, "survival_time": 4.99999999999999, "driven_lanedir": 0.22830451641695504, "sim_render-ego": 0.06153415441513062, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.18700478553771976, "deviation-heading": 0.7618930589113966, "set_robot_commands": 0.07746380805969239, "deviation-center-line": 0.2452674805381732, "driven_lanedir_consec": 0.22830451641695504, "sim_compute_sim_state": 0.035759110450744626, "sim_compute_performance-ego": 0.06351709842681885, "sim_compute_robot_state-ego": 0.06610637426376342, "sim_compute_robot_state-npc0": 0.06936257123947144, "sim_compute_robot_state-npc1": 0.06734920501708984, "sim_compute_robot_state-npc2": 0.06411568403244018, "sim_compute_robot_state-npc3": 0.06462367534637452}, "udem1-2-0": {"driven_any": 0.6373008840752825, "sim_physics": 0.04644887678084835, "survival_time": 4.6499999999999915, "driven_lanedir": 0.28282499594025623, "sim_render-ego": 0.060500855086952125, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.18212007194437008, "deviation-heading": 1.3281213913288836, "set_robot_commands": 0.0757005496691632, "deviation-center-line": 0.1860005752625475, "driven_lanedir_consec": 0.28265884769991256, "sim_compute_sim_state": 0.03455034379036196, "sim_compute_performance-ego": 0.0631456426394883, "sim_compute_robot_state-ego": 0.0615001340066233, "sim_compute_robot_state-npc0": 0.06782992424503449, "sim_compute_robot_state-npc1": 0.06464907430833386, "sim_compute_robot_state-npc2": 0.06312766382771154, "sim_compute_robot_state-npc3": 0.06176883174527076}, "udem1-3-0": {"driven_any": 0.8907725853556039, "sim_physics": 0.04783505366908179, "survival_time": 7.199999999999982, "driven_lanedir": 0.3413267165137295, "sim_render-ego": 0.0612473769320382, "in-drivable-lane": 3.599999999999987, "agent_compute-ego": 0.1792921009990904, "deviation-heading": 1.3574412465595886, "set_robot_commands": 0.07552695936626858, "deviation-center-line": 0.22261583500545432, "driven_lanedir_consec": 0.3413267165137295, "sim_compute_sim_state": 0.035036906599998474, "sim_compute_performance-ego": 0.06220772034592099, "sim_compute_robot_state-ego": 0.06172145571973589, "sim_compute_robot_state-npc0": 0.06798023813300663, "sim_compute_robot_state-npc1": 0.06405729717678493, "sim_compute_robot_state-npc2": 0.06160236895084381, "sim_compute_robot_state-npc3": 0.06400342285633087}, "udem1-4-0": {"driven_any": 0.7453299047262127, "sim_physics": 0.04725729283832368, "survival_time": 8.399999999999984, "driven_lanedir": 0.3510764207783559, "sim_render-ego": 0.05813509793508621, "in-drivable-lane": 4.249999999999991, "agent_compute-ego": 0.1735318884963081, "deviation-heading": 1.371416573868622, "set_robot_commands": 0.07327239570163545, "deviation-center-line": 0.2308507720624728, "driven_lanedir_consec": 0.3510764207783559, "sim_compute_sim_state": 0.033924345459256856, "sim_compute_performance-ego": 0.05986530014446804, "sim_compute_robot_state-ego": 0.059346478609811695, "sim_compute_robot_state-npc0": 0.06539925507136754, "sim_compute_robot_state-npc1": 0.062326104868026005, "sim_compute_robot_state-npc2": 0.058686070498966035, "sim_compute_robot_state-npc3": 0.05928200483322144}}
set_robot_commands_max0.07746380805969239
set_robot_commands_mean0.0754430361638848
set_robot_commands_median0.07552695936626858
set_robot_commands_min0.07327239570163545
sim_compute_performance-ego_max0.06351709842681885
sim_compute_performance-ego_mean0.06239603263411349
sim_compute_performance-ego_median0.0631456426394883
sim_compute_performance-ego_min0.05986530014446804
sim_compute_robot_state-ego_max0.06610637426376342
sim_compute_robot_state-ego_mean0.06222244624907214
sim_compute_robot_state-ego_median0.06172145571973589
sim_compute_robot_state-ego_min0.059346478609811695
sim_compute_robot_state-npc0_max0.0695353627204895
sim_compute_robot_state-npc0_mean0.06802147028187393
sim_compute_robot_state-npc0_median0.06798023813300663
sim_compute_robot_state-npc0_min0.06539925507136754
sim_compute_robot_state-npc1_max0.06734920501708984
sim_compute_robot_state-npc1_mean0.06461470904499216
sim_compute_robot_state-npc1_median0.06464907430833386
sim_compute_robot_state-npc1_min0.062326104868026005
sim_compute_robot_state-npc2_max0.06429479042689006
sim_compute_robot_state-npc2_mean0.06236531554737033
sim_compute_robot_state-npc2_median0.06312766382771154
sim_compute_robot_state-npc2_min0.058686070498966035
sim_compute_robot_state-npc3_max0.06462367534637452
sim_compute_robot_state-npc3_mean0.06277897392421641
sim_compute_robot_state-npc3_median0.06400342285633087
sim_compute_robot_state-npc3_min0.05928200483322144
sim_compute_sim_state_max0.03595600366592407
sim_compute_sim_state_mean0.03504534199325719
sim_compute_sim_state_median0.035036906599998474
sim_compute_sim_state_min0.033924345459256856
sim_physics_max0.04783505366908179
sim_physics_mean0.04708558443400779
sim_physics_median0.04725729283832368
sim_physics_min0.046371049880981445
sim_render-ego_max0.06153415441513062
sim_render-ego_mean0.06058832361029163
sim_render-ego_median0.0612473769320382
sim_render-ego_min0.05813509793508621
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.040000000000004
survival_time_min4.6499999999999915
No reset possible
201412987Artem Ioselevskiichallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:04:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.49604180092783734
survival_time_median1.800000000000001
deviation-center-line_median0.10185884176887024
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14350972637053458
agent_compute-ego_mean0.1352167401434045
agent_compute-ego_median0.13539069228702122
agent_compute-ego_min0.1291156465357
deviation-center-line_max0.16615056462085478
deviation-center-line_mean0.11297380423617062
deviation-center-line_min0.04718892689168499
deviation-heading_max0.6385229768063306
deviation-heading_mean0.4779190624899159
deviation-heading_median0.46716531762198565
deviation-heading_min0.3698409859250326
driven_any_max1.007529917217735
driven_any_mean0.5611628317578303
driven_any_median0.5435841630850775
driven_any_min0.2609396098687415
driven_lanedir_consec_max0.6693728496357081
driven_lanedir_consec_mean0.4648435429586037
driven_lanedir_consec_min0.2005359572943295
driven_lanedir_max0.6693728496357081
driven_lanedir_mean0.4648435429586037
driven_lanedir_median0.49604180092783734
driven_lanedir_min0.2005359572943295
in-drivable-lane_max0.7499999999999973
in-drivable-lane_mean0.15999999999999948
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.007529917217735, "sim_physics": 0.026520861953985495, "survival_time": 3.049999999999997, "driven_lanedir": 0.6693728496357081, "sim_render-ego": 0.05434826162994885, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.1298372628258877, "deviation-heading": 0.6385229768063306, "set_robot_commands": 0.07368395758456871, "deviation-center-line": 0.1627240010918179, "driven_lanedir_consec": 0.6693728496357081, "sim_compute_sim_state": 0.036838965337784566, "sim_compute_performance-ego": 0.05883590901484255, "sim_compute_robot_state-ego": 0.05961814473886959}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2609396098687415, "sim_physics": 0.02568604729392312, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2005359572943295, "sim_render-ego": 0.05370548638430509, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1291156465357, "deviation-heading": 0.4074758775415485, "set_robot_commands": 0.0749067176472057, "deviation-center-line": 0.04718892689168499, "driven_lanedir_consec": 0.2005359572943295, "sim_compute_sim_state": 0.03878193551843816, "sim_compute_performance-ego": 0.06165026534687389, "sim_compute_robot_state-ego": 0.05961876565759832}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5490354496964475, "sim_physics": 0.028650406079414565, "survival_time": 1.950000000000001, "driven_lanedir": 0.5357212889310636, "sim_render-ego": 0.06094073026608198, "in-drivable-lane": 0, "agent_compute-ego": 0.1382303726978791, "deviation-heading": 0.3698409859250326, "set_robot_commands": 0.07755128542582194, "deviation-center-line": 0.16615056462085478, "driven_lanedir_consec": 0.5357212889310636, "sim_compute_sim_state": 0.04011459839649689, "sim_compute_performance-ego": 0.06388499186589168, "sim_compute_robot_state-ego": 0.06505024127471142}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4447250189211501, "sim_physics": 0.030105490838327715, "survival_time": 1.5500000000000007, "driven_lanedir": 0.42254581800408, "sim_render-ego": 0.05753499461758521, "in-drivable-lane": 0, "agent_compute-ego": 0.14350972637053458, "deviation-heading": 0.46716531762198565, "set_robot_commands": 0.0814588685189524, "deviation-center-line": 0.08694668680762518, "driven_lanedir_consec": 0.42254581800408, "sim_compute_sim_state": 0.03685237515357233, "sim_compute_performance-ego": 0.06469352014603154, "sim_compute_robot_state-ego": 0.06536555290222168}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5435841630850775, "sim_physics": 0.03038812345928616, "survival_time": 1.800000000000001, "driven_lanedir": 0.49604180092783734, "sim_render-ego": 0.05868517690234714, "in-drivable-lane": 0, "agent_compute-ego": 0.13539069228702122, "deviation-heading": 0.5065901545546819, "set_robot_commands": 0.07816751797993977, "deviation-center-line": 0.10185884176887024, "driven_lanedir_consec": 0.49604180092783734, "sim_compute_sim_state": 0.040504402584499784, "sim_compute_performance-ego": 0.06395158502790663, "sim_compute_robot_state-ego": 0.06329341067208184}}
set_robot_commands_max0.0814588685189524
set_robot_commands_mean0.0771536694312977
set_robot_commands_median0.07755128542582194
set_robot_commands_min0.07368395758456871
sim_compute_performance-ego_max0.06469352014603154
sim_compute_performance-ego_mean0.06260325428030926
sim_compute_performance-ego_median0.06388499186589168
sim_compute_performance-ego_min0.05883590901484255
sim_compute_robot_state-ego_max0.06536555290222168
sim_compute_robot_state-ego_mean0.06258922304909656
sim_compute_robot_state-ego_median0.06329341067208184
sim_compute_robot_state-ego_min0.05961814473886959
sim_compute_sim_state_max0.040504402584499784
sim_compute_sim_state_mean0.03861845539815835
sim_compute_sim_state_median0.03878193551843816
sim_compute_sim_state_min0.036838965337784566
sim_physics_max0.03038812345928616
sim_physics_mean0.028270185924987413
sim_physics_median0.028650406079414565
sim_physics_min0.02568604729392312
sim_render-ego_max0.06094073026608198
sim_render-ego_mean0.057042929960053654
sim_render-ego_median0.05753499461758521
sim_render-ego_min0.05370548638430509
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.89
survival_time_min1.1000000000000003
No reset possible
200833058Andrea Censi 🇨🇭rotationaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:24:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.001621553835582712
survival_time_median14.950000000000076
deviation-center-line_median0.020496615645074896
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.14378689289093016
agent_compute-ego_mean0.1358606807390849
agent_compute-ego_median0.1342129158973694
agent_compute-ego_min0.13247790018717448
deviation-center-line_max0.034243395950175545
deviation-center-line_mean0.02028480553598812
deviation-center-line_min0.010043762422846911
deviation-heading_max5.710971395353194
deviation-heading_mean5.590630029300645
deviation-heading_median5.619632497922813
deviation-heading_min5.44205878651432
driven_any_max0.030228674333635432
driven_any_mean0.028207635433959065
driven_any_median0.02834813564469051
driven_any_min0.025948766964484338
driven_lanedir_consec_max0.0029865023810193847
driven_lanedir_consec_mean-0.0004915616196521589
driven_lanedir_consec_min-0.004399119925452499
driven_lanedir_max0.0029865023810193847
driven_lanedir_mean-0.0004915616196521589
driven_lanedir_median-0.001621553835582712
driven_lanedir_min-0.004399119925452499
in-drivable-lane_max7.700000000000045
in-drivable-lane_mean7.620000000000043
in-drivable-lane_min7.550000000000043
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.030228674333635432, "sim_physics": 0.025836803118387857, "survival_time": 14.950000000000076, "driven_lanedir": 0.0027298895861300743, "sim_render-ego": 0.062000812689463294, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.14378689289093016, "deviation-heading": 5.619632497922813, "set_robot_commands": 0.07714736461639404, "deviation-center-line": 0.020496615645074896, "driven_lanedir_consec": 0.0027298895861300743, "sim_compute_sim_state": 0.03687343994776408, "sim_compute_performance-ego": 0.06492096741994222, "sim_compute_robot_state-ego": 0.06385894378026326, "sim_compute_robot_state-npc0": 0.07090197563171387, "sim_compute_robot_state-npc1": 0.06713570992151896, "sim_compute_robot_state-npc2": 0.06620245377222697, "sim_compute_robot_state-npc3": 0.06560283660888672}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02834813564469051, "sim_physics": 0.023583865960439047, "survival_time": 14.950000000000076, "driven_lanedir": -0.002153526304375042, "sim_render-ego": 0.05555148522059123, "in-drivable-lane": 7.700000000000045, "agent_compute-ego": 0.1335009495417277, "deviation-heading": 5.44205878651432, "set_robot_commands": 0.07407657543818157, "deviation-center-line": 0.010909283151615335, "driven_lanedir_consec": -0.002153526304375042, "sim_compute_sim_state": 0.03429448207219442, "sim_compute_performance-ego": 0.058644118309021, "sim_compute_robot_state-ego": 0.05898871262868245, "sim_compute_robot_state-npc0": 0.06428606669108072, "sim_compute_robot_state-npc1": 0.06047485113143921, "sim_compute_robot_state-npc2": 0.05928717454274495, "sim_compute_robot_state-npc3": 0.05951355377833049}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.02692112510326492, "sim_physics": 0.024053354263305664, "survival_time": 14.950000000000076, "driven_lanedir": 0.0029865023810193847, "sim_render-ego": 0.05858349561691284, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.1342129158973694, "deviation-heading": 5.545561606292364, "set_robot_commands": 0.07467800935109456, "deviation-center-line": 0.034243395950175545, "driven_lanedir_consec": 0.0029865023810193847, "sim_compute_sim_state": 0.0337976328531901, "sim_compute_performance-ego": 0.0597723118464152, "sim_compute_robot_state-ego": 0.059443953037261965, "sim_compute_robot_state-npc0": 0.06475753863652547, "sim_compute_robot_state-npc1": 0.061192397276560465, "sim_compute_robot_state-npc2": 0.0608667786916097, "sim_compute_robot_state-npc3": 0.06071986039479574}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.025948766964484338, "sim_physics": 0.02411184708277385, "survival_time": 14.950000000000076, "driven_lanedir": -0.004399119925452499, "sim_render-ego": 0.05717624425888061, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.13247790018717448, "deviation-heading": 5.634925860420532, "set_robot_commands": 0.07398648262023926, "deviation-center-line": 0.010043762422846911, "driven_lanedir_consec": -0.004399119925452499, "sim_compute_sim_state": 0.035130051771799724, "sim_compute_performance-ego": 0.05974202871322632, "sim_compute_robot_state-ego": 0.06023115555445353, "sim_compute_robot_state-npc0": 0.06499807039896648, "sim_compute_robot_state-npc1": 0.06222313404083252, "sim_compute_robot_state-npc2": 0.059920248985290525, "sim_compute_robot_state-npc3": 0.060824437141418455}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.029591475123720113, "sim_physics": 0.024080820083618164, "survival_time": 14.950000000000076, "driven_lanedir": -0.001621553835582712, "sim_render-ego": 0.05834447145462037, "in-drivable-lane": 7.550000000000043, "agent_compute-ego": 0.13532474517822266, "deviation-heading": 5.710971395353194, "set_robot_commands": 0.07379672050476074, "deviation-center-line": 0.02573097051022792, "driven_lanedir_consec": -0.001621553835582712, "sim_compute_sim_state": 0.03440976142883301, "sim_compute_performance-ego": 0.061365782419840496, "sim_compute_robot_state-ego": 0.05982333342234294, "sim_compute_robot_state-npc0": 0.06686026493708293, "sim_compute_robot_state-npc1": 0.0632956870396932, "sim_compute_robot_state-npc2": 0.06120031992594401, "sim_compute_robot_state-npc3": 0.061529652277628584}}
set_robot_commands_max0.07714736461639404
set_robot_commands_mean0.07473703050613403
set_robot_commands_median0.07407657543818157
set_robot_commands_min0.07379672050476074
sim_compute_performance-ego_max0.06492096741994222
sim_compute_performance-ego_mean0.06088904174168904
sim_compute_performance-ego_median0.0597723118464152
sim_compute_performance-ego_min0.058644118309021
sim_compute_robot_state-ego_max0.06385894378026326
sim_compute_robot_state-ego_mean0.060469219684600825
sim_compute_robot_state-ego_median0.05982333342234294
sim_compute_robot_state-ego_min0.05898871262868245
sim_compute_robot_state-npc0_max0.07090197563171387
sim_compute_robot_state-npc0_mean0.06636078325907388
sim_compute_robot_state-npc0_median0.06499807039896648
sim_compute_robot_state-npc0_min0.06428606669108072
sim_compute_robot_state-npc1_max0.06713570992151896
sim_compute_robot_state-npc1_mean0.06286435588200887
sim_compute_robot_state-npc1_median0.06222313404083252
sim_compute_robot_state-npc1_min0.06047485113143921
sim_compute_robot_state-npc2_max0.06620245377222697
sim_compute_robot_state-npc2_mean0.06149539518356323
sim_compute_robot_state-npc2_median0.0608667786916097
sim_compute_robot_state-npc2_min0.05928717454274495
sim_compute_robot_state-npc3_max0.06560283660888672
sim_compute_robot_state-npc3_mean0.06163806804021199
sim_compute_robot_state-npc3_median0.060824437141418455
sim_compute_robot_state-npc3_min0.05951355377833049
sim_compute_sim_state_max0.03687343994776408
sim_compute_sim_state_mean0.034901073614756264
sim_compute_sim_state_median0.03440976142883301
sim_compute_sim_state_min0.0337976328531901
sim_physics_max0.025836803118387857
sim_physics_mean0.024333338101704915
sim_physics_median0.024080820083618164
sim_physics_min0.023583865960439047
sim_render-ego_max0.062000812689463294
sim_render-ego_mean0.05833130184809367
sim_render-ego_median0.05834447145462037
sim_render-ego_min0.05555148522059123
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
200762636Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:06:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7060476436119825
survival_time_median2.9499999999999975
deviation-center-line_median0.11000911211661404
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13142735675229864
agent_compute-ego_mean0.12644752101696904
agent_compute-ego_median0.13004010915756226
agent_compute-ego_min0.11809293031692504
deviation-center-line_max0.2756124593780862
deviation-center-line_mean0.14761657707365936
deviation-center-line_min0.05521015531316102
deviation-heading_max1.16360603086641
deviation-heading_mean0.4999185982159845
deviation-heading_median0.3379975413110555
deviation-heading_min0.23494529737543027
driven_any_max2.1872512115945857
driven_any_mean1.055944540531118
driven_any_median1.167808122478256
driven_any_min0.3209290725136122
driven_lanedir_consec_max0.9419039350715476
driven_lanedir_consec_mean0.6173219551829218
driven_lanedir_consec_min0.30305117192114617
driven_lanedir_max1.1635498459086595
driven_lanedir_mean0.6971981394313693
driven_lanedir_median0.7060476436119825
driven_lanedir_min0.30305117192114617
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.09889661815931212, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05401399000635687, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.13037199344275133, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.07362543636897825, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03266072048331207, "sim_compute_performance-ego": 0.05674115891726512, "sim_compute_robot_state-ego": 0.058265038256375294, "sim_compute_robot_state-npc0": 0.06373213597063748, "sim_compute_robot_state-npc1": 0.05878849974218405, "sim_compute_robot_state-npc2": 0.0577688104701492, "sim_compute_robot_state-npc3": 0.057384236803594627}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.0940081775188446, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.05378401279449463, "in-drivable-lane": 0, "agent_compute-ego": 0.13004010915756226, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.07266918818155925, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03246187170346578, "sim_compute_performance-ego": 0.05797359347343445, "sim_compute_robot_state-ego": 0.06033615271250407, "sim_compute_robot_state-npc0": 0.06319982806841533, "sim_compute_robot_state-npc1": 0.05887173612912496, "sim_compute_robot_state-npc2": 0.05581560730934143, "sim_compute_robot_state-npc3": 0.05799009402592977}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.10339572470066911, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.055007033428903354, "in-drivable-lane": 0, "agent_compute-ego": 0.13142735675229864, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.07330490775027518, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.033093848470914164, "sim_compute_performance-ego": 0.060637405363179867, "sim_compute_robot_state-ego": 0.06055374064687955, "sim_compute_robot_state-npc0": 0.06485722428661282, "sim_compute_robot_state-npc1": 0.06074930045564296, "sim_compute_robot_state-npc2": 0.060193748797400526, "sim_compute_robot_state-npc3": 0.05740689019025382}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.10844311471712792, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.051552081512192545, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12230521541530805, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.07234936245417191, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.031533390788708704, "sim_compute_performance-ego": 0.055986000319658696, "sim_compute_robot_state-ego": 0.058526709928350934, "sim_compute_robot_state-npc0": 0.05995865999642065, "sim_compute_robot_state-npc1": 0.05539960376286911, "sim_compute_robot_state-npc2": 0.05651521682739258, "sim_compute_robot_state-npc3": 0.05615827188653461}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.0840948462486267, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.051244604587554934, "in-drivable-lane": 0, "agent_compute-ego": 0.11809293031692504, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.06895809173583985, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03137804269790649, "sim_compute_performance-ego": 0.05452131032943726, "sim_compute_robot_state-ego": 0.05654333829879761, "sim_compute_robot_state-npc0": 0.06184859275817871, "sim_compute_robot_state-npc1": 0.05934809446334839, "sim_compute_robot_state-npc2": 0.05843770503997803, "sim_compute_robot_state-npc3": 0.05630269050598145}}
set_robot_commands_max0.07362543636897825
set_robot_commands_mean0.07218139729816489
set_robot_commands_median0.07266918818155925
set_robot_commands_min0.06895809173583985
sim_compute_performance-ego_max0.060637405363179867
sim_compute_performance-ego_mean0.057171893680595075
sim_compute_performance-ego_median0.05674115891726512
sim_compute_performance-ego_min0.05452131032943726
sim_compute_robot_state-ego_max0.06055374064687955
sim_compute_robot_state-ego_mean0.05884499596858149
sim_compute_robot_state-ego_median0.058526709928350934
sim_compute_robot_state-ego_min0.05654333829879761
sim_compute_robot_state-npc0_max0.06485722428661282
sim_compute_robot_state-npc0_mean0.062719288216053
sim_compute_robot_state-npc0_median0.06319982806841533
sim_compute_robot_state-npc0_min0.05995865999642065
sim_compute_robot_state-npc1_max0.06074930045564296
sim_compute_robot_state-npc1_mean0.05863144691063389
sim_compute_robot_state-npc1_median0.05887173612912496
sim_compute_robot_state-npc1_min0.05539960376286911
sim_compute_robot_state-npc2_max0.060193748797400526
sim_compute_robot_state-npc2_mean0.05774621768885235
sim_compute_robot_state-npc2_median0.0577688104701492
sim_compute_robot_state-npc2_min0.05581560730934143
sim_compute_robot_state-npc3_max0.05799009402592977
sim_compute_robot_state-npc3_mean0.05704843668245886
sim_compute_robot_state-npc3_median0.057384236803594627
sim_compute_robot_state-npc3_min0.05615827188653461
sim_compute_sim_state_max0.033093848470914164
sim_compute_sim_state_mean0.032225574828861445
sim_compute_sim_state_median0.03246187170346578
sim_compute_sim_state_min0.03137804269790649
sim_physics_max0.10844311471712792
sim_physics_mean0.09776769626891609
sim_physics_median0.09889661815931212
sim_physics_min0.0840948462486267
sim_render-ego_max0.055007033428903354
sim_render-ego_mean0.05312034446590046
sim_render-ego_median0.05378401279449463
sim_render-ego_min0.051244604587554934
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean2.679999999999997
survival_time_min1.0000000000000002
No reset possible
200622928Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0675002469158481
survival_time_median1.5500000000000007
deviation-center-line_median0.08337535340229546
in-drivable-lane_median0.7000000000000005


other stats
agent_compute-ego_max0.17946286305137302
agent_compute-ego_mean0.1714177706328264
agent_compute-ego_median0.17120064458539408
agent_compute-ego_min0.16321111718813577
deviation-center-line_max0.16230617558684243
deviation-center-line_mean0.096772197776865
deviation-center-line_min0.0087764122904385
deviation-heading_max2.739898220538133
deviation-heading_mean1.419914078627453
deviation-heading_median0.6009130791532286
deviation-heading_min0.5080916334908137
driven_any_max0.9009884635805052
driven_any_mean0.42299571510685263
driven_any_median0.1366936961756453
driven_any_min0.11409835247626278
driven_lanedir_consec_max0.22920727697283172
driven_lanedir_consec_mean0.1159936680354646
driven_lanedir_consec_min0.014202202138056563
driven_lanedir_max0.22920727697283172
driven_lanedir_mean0.1159936680354646
driven_lanedir_median0.0675002469158481
driven_lanedir_min0.014202202138056563
in-drivable-lane_max3.499999999999992
in-drivable-lane_mean1.589999999999997
in-drivable-lane_min0.15000000000000013
per-episodes
details{"udem1-0-0": {"driven_any": 0.9009884635805052, "sim_physics": 0.10411098831934286, "survival_time": 7.049999999999983, "driven_lanedir": 0.22920727697283172, "sim_render-ego": 0.057608668685804866, "in-drivable-lane": 3.499999999999992, "agent_compute-ego": 0.1680062510443072, "deviation-heading": 2.6860972201511686, "set_robot_commands": 0.07725013570582613, "deviation-center-line": 0.1509784834453189, "driven_lanedir_consec": 0.22920727697283172, "sim_compute_sim_state": 0.03461626573657313, "sim_compute_performance-ego": 0.06200982154683864, "sim_compute_robot_state-ego": 0.06150138124506524, "sim_compute_robot_state-npc0": 0.06684985397555304, "sim_compute_robot_state-npc1": 0.061835965366228256, "sim_compute_robot_state-npc2": 0.061994326030108945, "sim_compute_robot_state-npc3": 0.06210948389472691}, "udem1-1-0": {"driven_any": 0.846607148123163, "sim_physics": 0.10676151600436888, "survival_time": 6.8999999999999835, "driven_lanedir": 0.21364172899202716, "sim_render-ego": 0.05626902545707813, "in-drivable-lane": 3.399999999999993, "agent_compute-ego": 0.17946286305137302, "deviation-heading": 2.739898220538133, "set_robot_commands": 0.0773031296937362, "deviation-center-line": 0.16230617558684243, "driven_lanedir_consec": 0.21364172899202716, "sim_compute_sim_state": 0.03352189582327138, "sim_compute_performance-ego": 0.05782652937847635, "sim_compute_robot_state-ego": 0.05903075225111367, "sim_compute_robot_state-npc0": 0.06690312122953111, "sim_compute_robot_state-npc1": 0.0619337178658748, "sim_compute_robot_state-npc2": 0.06094807991083118, "sim_compute_robot_state-npc3": 0.06034300983815953}, "udem1-2-0": {"driven_any": 0.11659091517868676, "sim_physics": 0.10558512806892396, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0675002469158481, "sim_render-ego": 0.05284606417020162, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.16321111718813577, "deviation-heading": 0.5080916334908137, "set_robot_commands": 0.07380788524945577, "deviation-center-line": 0.08337535340229546, "driven_lanedir_consec": 0.0675002469158481, "sim_compute_sim_state": 0.031185030937194824, "sim_compute_performance-ego": 0.0588474174340566, "sim_compute_robot_state-ego": 0.06037850181261698, "sim_compute_robot_state-npc0": 0.06800593932469685, "sim_compute_robot_state-npc1": 0.06058931350708008, "sim_compute_robot_state-npc2": 0.05722626050313314, "sim_compute_robot_state-npc3": 0.05701693892478943}, "udem1-3-0": {"driven_any": 0.11409835247626278, "sim_physics": 0.10745119094848632, "survival_time": 1.2500000000000004, "driven_lanedir": 0.05541688515855947, "sim_render-ego": 0.060898942947387694, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17520797729492188, "deviation-heading": 0.5645702398039198, "set_robot_commands": 0.07601129531860351, "deviation-center-line": 0.07842456415942965, "driven_lanedir_consec": 0.05541688515855947, "sim_compute_sim_state": 0.03505177497863769, "sim_compute_performance-ego": 0.06518161773681641, "sim_compute_robot_state-ego": 0.06409002304077148, "sim_compute_robot_state-npc0": 0.06324975967407226, "sim_compute_robot_state-npc1": 0.060657405853271486, "sim_compute_robot_state-npc2": 0.06004633903503418, "sim_compute_robot_state-npc3": 0.05914323806762695}, "udem1-4-0": {"driven_any": 0.1366936961756453, "sim_physics": 0.10084689817120952, "survival_time": 1.5500000000000007, "driven_lanedir": 0.014202202138056563, "sim_render-ego": 0.0583381345195155, "in-drivable-lane": 0.7000000000000005, "agent_compute-ego": 0.17120064458539408, "deviation-heading": 0.6009130791532286, "set_robot_commands": 0.07476657436740014, "deviation-center-line": 0.0087764122904385, "driven_lanedir_consec": 0.014202202138056563, "sim_compute_sim_state": 0.034093272301458546, "sim_compute_performance-ego": 0.06226326573279596, "sim_compute_robot_state-ego": 0.06393547981016097, "sim_compute_robot_state-npc0": 0.07122243604352398, "sim_compute_robot_state-npc1": 0.06284443024666078, "sim_compute_robot_state-npc2": 0.06110516671211489, "sim_compute_robot_state-npc3": 0.062475450577274445}}
set_robot_commands_max0.0773031296937362
set_robot_commands_mean0.07582780406700435
set_robot_commands_median0.07601129531860351
set_robot_commands_min0.07380788524945577
sim_compute_performance-ego_max0.06518161773681641
sim_compute_performance-ego_mean0.061225730365796795
sim_compute_performance-ego_median0.06200982154683864
sim_compute_performance-ego_min0.05782652937847635
sim_compute_robot_state-ego_max0.06409002304077148
sim_compute_robot_state-ego_mean0.06178722763194566
sim_compute_robot_state-ego_median0.06150138124506524
sim_compute_robot_state-ego_min0.05903075225111367
sim_compute_robot_state-npc0_max0.07122243604352398
sim_compute_robot_state-npc0_mean0.06724622204947545
sim_compute_robot_state-npc0_median0.06690312122953111
sim_compute_robot_state-npc0_min0.06324975967407226
sim_compute_robot_state-npc1_max0.06284443024666078
sim_compute_robot_state-npc1_mean0.06157216656782307
sim_compute_robot_state-npc1_median0.061835965366228256
sim_compute_robot_state-npc1_min0.06058931350708008
sim_compute_robot_state-npc2_max0.061994326030108945
sim_compute_robot_state-npc2_mean0.06026403443824446
sim_compute_robot_state-npc2_median0.06094807991083118
sim_compute_robot_state-npc2_min0.05722626050313314
sim_compute_robot_state-npc3_max0.062475450577274445
sim_compute_robot_state-npc3_mean0.060217624260515454
sim_compute_robot_state-npc3_median0.06034300983815953
sim_compute_robot_state-npc3_min0.05701693892478943
sim_compute_sim_state_max0.03505177497863769
sim_compute_sim_state_mean0.033693647955427106
sim_compute_sim_state_median0.034093272301458546
sim_compute_sim_state_min0.031185030937194824
sim_physics_max0.10745119094848632
sim_physics_mean0.1049511443024663
sim_physics_median0.10558512806892396
sim_physics_min0.10084689817120952
sim_render-ego_max0.060898942947387694
sim_render-ego_mean0.05719216715599755
sim_render-ego_median0.057608668685804866
sim_render-ego_min0.05284606417020162
simulation-passed1
survival_time_max7.049999999999983
survival_time_mean3.589999999999994
survival_time_min1.2000000000000004
No reset possible
200513014Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
200352940Bhairav MehtaBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
200022443Jacopo Tanirandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:06:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.630782078032722
survival_time_median2.6499999999999986
deviation-center-line_median0.10342694179960472
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.14716920099760356
agent_compute-ego_mean0.1446170742430836
agent_compute-ego_median0.14512670481646503
agent_compute-ego_min0.14085271983470732
deviation-center-line_max0.24274593434117447
deviation-center-line_mean0.1423794188959262
deviation-center-line_min0.05838775199208855
deviation-heading_max0.9510803390140998
deviation-heading_mean0.5404741772455786
deviation-heading_median0.4662935751765816
deviation-heading_min0.3138996563005005
driven_any_max2.1937495917222662
driven_any_mean1.101203967779493
driven_any_median1.072953759306336
driven_any_min0.3121624499492532
driven_lanedir_consec_max1.8128454170816104
driven_lanedir_consec_mean0.8194262040404128
driven_lanedir_consec_min0.29255031695938905
driven_lanedir_max1.8128454170816104
driven_lanedir_mean0.8194262040404128
driven_lanedir_median0.630782078032722
driven_lanedir_min0.29255031695938905
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.4999999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.029747558964623347, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.052362177107069224, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14583477046754623, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.0735184285375807, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.03296780917379591, "sim_compute_performance-ego": 0.05687276522318522, "sim_compute_robot_state-ego": 0.05794630116886563, "sim_compute_robot_state-npc0": 0.06425166130065918, "sim_compute_robot_state-npc1": 0.05940299563937717, "sim_compute_robot_state-npc2": 0.05846951736344232, "sim_compute_robot_state-npc3": 0.05967974000506931}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.02629296867935746, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.05651250591984502, "in-drivable-lane": 0, "agent_compute-ego": 0.14512670481646503, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.07737914721171062, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.0315204108202899, "sim_compute_performance-ego": 0.05711961675573279, "sim_compute_robot_state-ego": 0.06072145038180881, "sim_compute_robot_state-npc0": 0.06425048686839917, "sim_compute_robot_state-npc1": 0.0588244773723461, "sim_compute_robot_state-npc2": 0.05982960595024957, "sim_compute_robot_state-npc3": 0.05941911096926088}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.029442120524286068, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.05537450197830941, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14085271983470732, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.07486199406744207, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.0320905458579943, "sim_compute_performance-ego": 0.058515828790016544, "sim_compute_robot_state-ego": 0.05823866140495226, "sim_compute_robot_state-npc0": 0.06668378079979165, "sim_compute_robot_state-npc1": 0.06015036407026272, "sim_compute_robot_state-npc2": 0.05860400894313183, "sim_compute_robot_state-npc3": 0.058220004572451696}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.030450213630244416, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.056228048396560384, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.14410197509909575, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.07511923448094782, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.03232781842069806, "sim_compute_performance-ego": 0.06122386230612701, "sim_compute_robot_state-ego": 0.06193455660118247, "sim_compute_robot_state-npc0": 0.06870392133604805, "sim_compute_robot_state-npc1": 0.0629743090215719, "sim_compute_robot_state-npc2": 0.05979591045739516, "sim_compute_robot_state-npc3": 0.06030286483044894}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.02677743058455618, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.05795393492046155, "in-drivable-lane": 0, "agent_compute-ego": 0.14716920099760356, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.07903229562859786, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.03312725769846063, "sim_compute_performance-ego": 0.05915384543569464, "sim_compute_robot_state-ego": 0.05903520082172595, "sim_compute_robot_state-npc0": 0.0684404498652408, "sim_compute_robot_state-npc1": 0.06233505198830053, "sim_compute_robot_state-npc2": 0.06280570281179328, "sim_compute_robot_state-npc3": 0.05944462826377467}}
set_robot_commands_max0.07903229562859786
set_robot_commands_mean0.07598221998525581
set_robot_commands_median0.07511923448094782
set_robot_commands_min0.0735184285375807
sim_compute_performance-ego_max0.06122386230612701
sim_compute_performance-ego_mean0.05857718370215124
sim_compute_performance-ego_median0.058515828790016544
sim_compute_performance-ego_min0.05687276522318522
sim_compute_robot_state-ego_max0.06193455660118247
sim_compute_robot_state-ego_mean0.059575234075707015
sim_compute_robot_state-ego_median0.05903520082172595
sim_compute_robot_state-ego_min0.05794630116886563
sim_compute_robot_state-npc0_max0.06870392133604805
sim_compute_robot_state-npc0_mean0.06646606003402777
sim_compute_robot_state-npc0_median0.06668378079979165
sim_compute_robot_state-npc0_min0.06425048686839917
sim_compute_robot_state-npc1_max0.0629743090215719
sim_compute_robot_state-npc1_mean0.06073743961837168
sim_compute_robot_state-npc1_median0.06015036407026272
sim_compute_robot_state-npc1_min0.0588244773723461
sim_compute_robot_state-npc2_max0.06280570281179328
sim_compute_robot_state-npc2_mean0.059900949105202425
sim_compute_robot_state-npc2_median0.05979591045739516
sim_compute_robot_state-npc2_min0.05846951736344232
sim_compute_robot_state-npc3_max0.06030286483044894
sim_compute_robot_state-npc3_mean0.0594132697282011
sim_compute_robot_state-npc3_median0.05944462826377467
sim_compute_robot_state-npc3_min0.058220004572451696
sim_compute_sim_state_max0.03312725769846063
sim_compute_sim_state_mean0.032406768394247755
sim_compute_sim_state_median0.03232781842069806
sim_compute_sim_state_min0.0315204108202899
sim_physics_max0.030450213630244416
sim_physics_mean0.02854205847661349
sim_physics_median0.029442120524286068
sim_physics_min0.02629296867935746
sim_render-ego_max0.05795393492046155
sim_render-ego_mean0.055686233664449115
sim_render-ego_median0.056228048396560384
sim_render-ego_min0.052362177107069224
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.739999999999997
survival_time_min0.9500000000000004
No reset possible
199922472Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199852529Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199642587Julian Zillybaseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199512665Rami Al-Naim 🇷🇺Modidfied configaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199352871Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199273043Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199052681Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-342170:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198942755Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198832832Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198732877Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198632945Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198542978Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-342170:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198473031Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198402894Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:01:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198342636Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.630782078032722
survival_time_median2.6499999999999986
deviation-center-line_median0.10342694179960472
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.14046578937106663
agent_compute-ego_mean0.13406449564875517
agent_compute-ego_median0.13483643862936232
agent_compute-ego_min0.12867385462710731
deviation-center-line_max0.24274593434117447
deviation-center-line_mean0.1423794188959262
deviation-center-line_min0.05838775199208855
deviation-heading_max0.9510803390140998
deviation-heading_mean0.5404741772455786
deviation-heading_median0.4662935751765816
deviation-heading_min0.3138996563005005
driven_any_max2.1937495917222662
driven_any_mean1.101203967779493
driven_any_median1.072953759306336
driven_any_min0.3121624499492532
driven_lanedir_consec_max1.8128454170816104
driven_lanedir_consec_mean0.8194262040404128
driven_lanedir_consec_min0.29255031695938905
driven_lanedir_max1.8128454170816104
driven_lanedir_mean0.8194262040404128
driven_lanedir_median0.630782078032722
driven_lanedir_min0.29255031695938905
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.4999999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.030442671643363103, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.0533108479446835, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.13483643862936232, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.07522629035843743, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.03256033526526557, "sim_compute_performance-ego": 0.056512779659695096, "sim_compute_robot_state-ego": 0.058285146951675415, "sim_compute_robot_state-npc0": 0.06294370690981548, "sim_compute_robot_state-npc1": 0.06056794855329725, "sim_compute_robot_state-npc2": 0.05901193618774414, "sim_compute_robot_state-npc3": 0.05851087636417813}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.026683772051775898, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.05538108613755968, "in-drivable-lane": 0, "agent_compute-ego": 0.14046578937106663, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.07652015156216091, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.0338537163204617, "sim_compute_performance-ego": 0.05788396022937916, "sim_compute_robot_state-ego": 0.05976418212608055, "sim_compute_robot_state-npc0": 0.06476978019431785, "sim_compute_robot_state-npc1": 0.06185642878214518, "sim_compute_robot_state-npc2": 0.06008200292234068, "sim_compute_robot_state-npc3": 0.06113078859117296}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.02880768868529681, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.05590862440831453, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13516853388073374, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.07396081813330789, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.03257885025542916, "sim_compute_performance-ego": 0.0589384453967937, "sim_compute_robot_state-ego": 0.05953912827575091, "sim_compute_robot_state-npc0": 0.0625042290363497, "sim_compute_robot_state-npc1": 0.058985409227389735, "sim_compute_robot_state-npc2": 0.058671976756123664, "sim_compute_robot_state-npc3": 0.0591896274714794}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.028941042018386553, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.05591249915788758, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.13117786173550589, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.07448547741152206, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.03327498346004846, "sim_compute_performance-ego": 0.05999501246326375, "sim_compute_robot_state-ego": 0.06057024451921571, "sim_compute_robot_state-npc0": 0.06404895152685777, "sim_compute_robot_state-npc1": 0.060557639823769625, "sim_compute_robot_state-npc2": 0.059079233205543376, "sim_compute_robot_state-npc3": 0.05936959554564278}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.026206618861148234, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.05446181799236097, "in-drivable-lane": 0, "agent_compute-ego": 0.12867385462710731, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.0753839141444156, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.03176090591832211, "sim_compute_performance-ego": 0.05745905324032432, "sim_compute_robot_state-ego": 0.05702437852558337, "sim_compute_robot_state-npc0": 0.06410635145086992, "sim_compute_robot_state-npc1": 0.058981280577810186, "sim_compute_robot_state-npc2": 0.05643451841253983, "sim_compute_robot_state-npc3": 0.055714004918148645}}
set_robot_commands_max0.07652015156216091
set_robot_commands_mean0.07511533032196878
set_robot_commands_median0.07522629035843743
set_robot_commands_min0.07396081813330789
sim_compute_performance-ego_max0.05999501246326375
sim_compute_performance-ego_mean0.0581578501978912
sim_compute_performance-ego_median0.05788396022937916
sim_compute_performance-ego_min0.056512779659695096
sim_compute_robot_state-ego_max0.06057024451921571
sim_compute_robot_state-ego_mean0.059036616079661194
sim_compute_robot_state-ego_median0.05953912827575091
sim_compute_robot_state-ego_min0.05702437852558337
sim_compute_robot_state-npc0_max0.06476978019431785
sim_compute_robot_state-npc0_mean0.06367460382364214
sim_compute_robot_state-npc0_median0.06404895152685777
sim_compute_robot_state-npc0_min0.0625042290363497
sim_compute_robot_state-npc1_max0.06185642878214518
sim_compute_robot_state-npc1_mean0.0601897413928824
sim_compute_robot_state-npc1_median0.060557639823769625
sim_compute_robot_state-npc1_min0.058981280577810186
sim_compute_robot_state-npc2_max0.06008200292234068
sim_compute_robot_state-npc2_mean0.05865593349685834
sim_compute_robot_state-npc2_median0.05901193618774414
sim_compute_robot_state-npc2_min0.05643451841253983
sim_compute_robot_state-npc3_max0.06113078859117296
sim_compute_robot_state-npc3_mean0.05878297857812438
sim_compute_robot_state-npc3_median0.0591896274714794
sim_compute_robot_state-npc3_min0.055714004918148645
sim_compute_sim_state_max0.0338537163204617
sim_compute_sim_state_mean0.0328057582439054
sim_compute_sim_state_median0.03257885025542916
sim_compute_sim_state_min0.03176090591832211
sim_physics_max0.030442671643363103
sim_physics_mean0.02821635865199412
sim_physics_median0.02880768868529681
sim_physics_min0.026206618861148234
sim_render-ego_max0.05591249915788758
sim_render-ego_mean0.05499497512816125
sim_render-ego_median0.05538108613755968
sim_render-ego_min0.0533108479446835
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.739999999999997
survival_time_min0.9500000000000004
No reset possible
198322672Rami Al-Naim 🇷🇺Modidfied configaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198022660Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:11:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4615557169467661
survival_time_median3.4999999999999956
deviation-center-line_median0.3389924730399202
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07739016503998727
agent_compute-ego_mean0.07162808789422502
agent_compute-ego_median0.07205048288617816
agent_compute-ego_min0.06741366704305013
deviation-center-line_max1.3668625896446585
deviation-center-line_mean0.5671847605928119
deviation-center-line_min0.12184105327993287
deviation-heading_max3.31612654849037
deviation-heading_mean1.498271924619187
deviation-heading_median1.200015996043308
deviation-heading_min0.5433313373427111
driven_any_max2.3557016573021934
driven_any_mean0.9585068683959872
driven_any_median0.5154632091919716
driven_any_min0.21812893445976075
driven_lanedir_consec_max2.2517720923603637
driven_lanedir_consec_mean0.900641283628208
driven_lanedir_consec_min0.16277880841911865
driven_lanedir_max2.252936105410885
driven_lanedir_mean0.9009194308414544
driven_lanedir_median0.4615557169467661
driven_lanedir_min0.16277880841911865
in-drivable-lane_max0.1999999999999993
in-drivable-lane_mean0.039999999999999855
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4690337028860367, "sim_physics": 0.0280931083779586, "survival_time": 9.5, "driven_lanedir": 1.435385083487429, "sim_render-ego": 0.06152471492165013, "in-drivable-lane": 0, "agent_compute-ego": 0.07274296283721923, "deviation-heading": 1.6996093313514915, "set_robot_commands": 0.08066333846042031, "deviation-center-line": 0.8645306295248034, "driven_lanedir_consec": 1.435158360471718, "sim_compute_sim_state": 0.036172070001301015, "sim_compute_performance-ego": 0.06335190597333407, "sim_compute_robot_state-ego": 0.06156828779923289, "sim_compute_robot_state-npc0": 0.07050237530156185, "sim_compute_robot_state-npc1": 0.06681238224631862, "sim_compute_robot_state-npc2": 0.06585109610306589, "sim_compute_robot_state-npc3": 0.06548894330074913}, "udem1-1-0": {"driven_any": 0.23420683813997276, "sim_physics": 0.02713650975908552, "survival_time": 1.7500000000000009, "driven_lanedir": 0.16277880841911865, "sim_render-ego": 0.06149276324680873, "in-drivable-lane": 0, "agent_compute-ego": 0.0685431616646903, "deviation-heading": 1.200015996043308, "set_robot_commands": 0.0743098327091762, "deviation-center-line": 0.12184105327993287, "driven_lanedir_consec": 0.16277880841911865, "sim_compute_sim_state": 0.03298495156424386, "sim_compute_performance-ego": 0.06069009644644601, "sim_compute_robot_state-ego": 0.059365647179739814, "sim_compute_robot_state-npc0": 0.0638094357081822, "sim_compute_robot_state-npc1": 0.06213089397975376, "sim_compute_robot_state-npc2": 0.0626401696886335, "sim_compute_robot_state-npc3": 0.05618523188999721}, "udem1-2-0": {"driven_any": 0.5154632091919716, "sim_physics": 0.033331891468593056, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4615557169467661, "sim_render-ego": 0.0632990632738386, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07205048288617816, "deviation-heading": 0.7322764098680526, "set_robot_commands": 0.07839365346091134, "deviation-center-line": 0.3389924730399202, "driven_lanedir_consec": 0.4615557169467661, "sim_compute_sim_state": 0.03648723193577358, "sim_compute_performance-ego": 0.06448981080736432, "sim_compute_robot_state-ego": 0.06281285626547677, "sim_compute_robot_state-npc0": 0.07266110692705427, "sim_compute_robot_state-npc1": 0.06725279944283621, "sim_compute_robot_state-npc2": 0.06440728051321847, "sim_compute_robot_state-npc3": 0.06399476528167725}, "udem1-3-0": {"driven_any": 0.21812893445976075, "sim_physics": 0.028655370076497395, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1919414399430728, "sim_render-ego": 0.058510816458499794, "in-drivable-lane": 0, "agent_compute-ego": 0.07739016503998727, "deviation-heading": 0.5433313373427111, "set_robot_commands": 0.08200178001866196, "deviation-center-line": 0.14369705747474448, "driven_lanedir_consec": 0.1919414399430728, "sim_compute_sim_state": 0.03433518698721221, "sim_compute_performance-ego": 0.060809092088179154, "sim_compute_robot_state-ego": 0.06127590121644916, "sim_compute_robot_state-npc0": 0.06500584428960626, "sim_compute_robot_state-npc1": 0.05955909237717137, "sim_compute_robot_state-npc2": 0.06003112503976533, "sim_compute_robot_state-npc3": 0.059140595522793854}, "udem1-4-0": {"driven_any": 2.3557016573021934, "sim_physics": 0.0274207599957784, "survival_time": 14.950000000000076, "driven_lanedir": 2.252936105410885, "sim_render-ego": 0.057664663791656495, "in-drivable-lane": 0, "agent_compute-ego": 0.06741366704305013, "deviation-heading": 3.31612654849037, "set_robot_commands": 0.07686870098114014, "deviation-center-line": 1.3668625896446585, "driven_lanedir_consec": 2.2517720923603637, "sim_compute_sim_state": 0.03430793285369873, "sim_compute_performance-ego": 0.06101203838984171, "sim_compute_robot_state-ego": 0.06117953062057495, "sim_compute_robot_state-npc0": 0.06766036033630371, "sim_compute_robot_state-npc1": 0.06387495915095011, "sim_compute_robot_state-npc2": 0.06206997791926066, "sim_compute_robot_state-npc3": 0.062400243282318114}}
set_robot_commands_max0.08200178001866196
set_robot_commands_mean0.07844746112606199
set_robot_commands_median0.07839365346091134
set_robot_commands_min0.0743098327091762
sim_compute_performance-ego_max0.06448981080736432
sim_compute_performance-ego_mean0.06207058874103305
sim_compute_performance-ego_median0.06101203838984171
sim_compute_performance-ego_min0.06069009644644601
sim_compute_robot_state-ego_max0.06281285626547677
sim_compute_robot_state-ego_mean0.06124044461629472
sim_compute_robot_state-ego_median0.06127590121644916
sim_compute_robot_state-ego_min0.059365647179739814
sim_compute_robot_state-npc0_max0.07266110692705427
sim_compute_robot_state-npc0_mean0.06792782451254167
sim_compute_robot_state-npc0_median0.06766036033630371
sim_compute_robot_state-npc0_min0.0638094357081822
sim_compute_robot_state-npc1_max0.06725279944283621
sim_compute_robot_state-npc1_mean0.06392602543940601
sim_compute_robot_state-npc1_median0.06387495915095011
sim_compute_robot_state-npc1_min0.05955909237717137
sim_compute_robot_state-npc2_max0.06585109610306589
sim_compute_robot_state-npc2_mean0.06299992985278877
sim_compute_robot_state-npc2_median0.0626401696886335
sim_compute_robot_state-npc2_min0.06003112503976533
sim_compute_robot_state-npc3_max0.06548894330074913
sim_compute_robot_state-npc3_mean0.06144195585550712
sim_compute_robot_state-npc3_median0.062400243282318114
sim_compute_robot_state-npc3_min0.05618523188999721
sim_compute_sim_state_max0.03648723193577358
sim_compute_sim_state_mean0.03485747466844588
sim_compute_sim_state_median0.03433518698721221
sim_compute_sim_state_min0.03298495156424386
sim_physics_max0.033331891468593056
sim_physics_mean0.028927527935582592
sim_physics_median0.0280931083779586
sim_physics_min0.02713650975908552
sim_render-ego_max0.0632990632738386
sim_render-ego_mean0.060498404338490755
sim_render-ego_median0.06149276324680873
sim_render-ego_min0.057664663791656495
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.270000000000016
survival_time_min1.6500000000000008
No reset possible
197862648Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4677520238097679
survival_time_median2.849999999999998
deviation-center-line_median0.13993923038273243
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.07060656881636115
agent_compute-ego_mean0.06842956348064044
agent_compute-ego_median0.06778351465861003
agent_compute-ego_min0.06751887421858938
deviation-center-line_max0.441991081977021
deviation-center-line_mean0.24301419493149473
deviation-center-line_min0.11233303566656118
deviation-heading_max1.965590298952019
deviation-heading_mean0.904977224642509
deviation-heading_median0.6817498444220604
deviation-heading_min0.23880859753921196
driven_any_max2.234618045439434
driven_any_mean1.1136680430892796
driven_any_median0.7854280860806753
driven_any_min0.3734823939695258
driven_lanedir_consec_max1.4162453958283412
driven_lanedir_consec_mean0.7217431069832176
driven_lanedir_consec_min0.3618460409658957
driven_lanedir_max1.4162453958283412
driven_lanedir_mean0.7217431069832176
driven_lanedir_median0.4677520238097679
driven_lanedir_min0.3618460409658957
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean0.9999999999999964
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.02899505226475418, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.06196825975065778, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.07060656881636115, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.07910957306053988, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.036022541629281014, "sim_compute_performance-ego": 0.06340534975574275, "sim_compute_robot_state-ego": 0.06415002816801618, "sim_compute_robot_state-npc0": 0.07119379073950895, "sim_compute_robot_state-npc1": 0.0656555883444039, "sim_compute_robot_state-npc2": 0.06468438191019046, "sim_compute_robot_state-npc3": 0.0635855957201332}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.027013922992505525, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.06013031382309763, "in-drivable-lane": 0, "agent_compute-ego": 0.06751887421858938, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.0752941370010376, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.03514087827582108, "sim_compute_performance-ego": 0.061021077005486736, "sim_compute_robot_state-ego": 0.06210551136418393, "sim_compute_robot_state-npc0": 0.07012659625003212, "sim_compute_robot_state-npc1": 0.06303698138186806, "sim_compute_robot_state-npc2": 0.06339200546866969, "sim_compute_robot_state-npc3": 0.06211777737266139}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.03008201666045607, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.06274414899056419, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06767132826018751, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.07524568992748595, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.03536573209260639, "sim_compute_performance-ego": 0.06393100086011384, "sim_compute_robot_state-ego": 0.06358762373004043, "sim_compute_robot_state-npc0": 0.06815670247663531, "sim_compute_robot_state-npc1": 0.06470977632622969, "sim_compute_robot_state-npc2": 0.06415331154538874, "sim_compute_robot_state-npc3": 0.06253713473939058}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.02920273498252586, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.06422824329800075, "in-drivable-lane": 0, "agent_compute-ego": 0.06778351465861003, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.07466509607103136, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.03690853825321904, "sim_compute_performance-ego": 0.06707957938865379, "sim_compute_robot_state-ego": 0.06639525625440809, "sim_compute_robot_state-npc0": 0.06875218285454644, "sim_compute_robot_state-npc1": 0.06409142635486743, "sim_compute_robot_state-npc2": 0.06263762933236582, "sim_compute_robot_state-npc3": 0.06551603917722348}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.03080344767797561, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.06492364028143505, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06856753144945417, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.0759495837347848, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.03832012320321704, "sim_compute_performance-ego": 0.06526814755939302, "sim_compute_robot_state-ego": 0.06285299195183648, "sim_compute_robot_state-npc0": 0.07464249928792317, "sim_compute_robot_state-npc1": 0.06900405126904684, "sim_compute_robot_state-npc2": 0.06880597462729802, "sim_compute_robot_state-npc3": 0.06850790599035839}}
set_robot_commands_max0.07910957306053988
set_robot_commands_mean0.07605281595897592
set_robot_commands_median0.0752941370010376
set_robot_commands_min0.07466509607103136
sim_compute_performance-ego_max0.06707957938865379
sim_compute_performance-ego_mean0.06414103091387803
sim_compute_performance-ego_median0.06393100086011384
sim_compute_performance-ego_min0.061021077005486736
sim_compute_robot_state-ego_max0.06639525625440809
sim_compute_robot_state-ego_mean0.06381828229369702
sim_compute_robot_state-ego_median0.06358762373004043
sim_compute_robot_state-ego_min0.06210551136418393
sim_compute_robot_state-npc0_max0.07464249928792317
sim_compute_robot_state-npc0_mean0.07057435432172919
sim_compute_robot_state-npc0_median0.07012659625003212
sim_compute_robot_state-npc0_min0.06815670247663531
sim_compute_robot_state-npc1_max0.06900405126904684
sim_compute_robot_state-npc1_mean0.06529956473528319
sim_compute_robot_state-npc1_median0.06470977632622969
sim_compute_robot_state-npc1_min0.06303698138186806
sim_compute_robot_state-npc2_max0.06880597462729802
sim_compute_robot_state-npc2_mean0.06473466057678255
sim_compute_robot_state-npc2_median0.06415331154538874
sim_compute_robot_state-npc2_min0.06263762933236582
sim_compute_robot_state-npc3_max0.06850790599035839
sim_compute_robot_state-npc3_mean0.0644528905999534
sim_compute_robot_state-npc3_median0.0635855957201332
sim_compute_robot_state-npc3_min0.06211777737266139
sim_compute_sim_state_max0.03832012320321704
sim_compute_sim_state_mean0.03635156269082891
sim_compute_sim_state_median0.036022541629281014
sim_compute_sim_state_min0.03514087827582108
sim_physics_max0.03080344767797561
sim_physics_mean0.02921943491564345
sim_physics_median0.02920273498252586
sim_physics_min0.027013922992505525
sim_render-ego_max0.06492364028143505
sim_render-ego_mean0.06279892122875108
sim_render-ego_median0.06274414899056419
sim_render-ego_min0.06013031382309763
simulation-passed1
survival_time_max7.84999999999998
survival_time_mean4.049999999999993
survival_time_min1.3500000000000003
No reset possible
197612774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.42023600843424624
survival_time_median2.9499999999999975
deviation-center-line_median0.30614354212515077
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1212325154281244
agent_compute-ego_mean0.09497400387891168
agent_compute-ego_median0.090438150141361
agent_compute-ego_min0.0831487019191726
deviation-center-line_max1.1274627052597173
deviation-center-line_mean0.4569305829796095
deviation-center-line_min0.12359623261482168
deviation-heading_max1.6898248523475965
deviation-heading_mean0.960921381851567
deviation-heading_median1.0794684601744635
deviation-heading_min0.4163948185728488
driven_any_max1.873595510596352
driven_any_mean0.7785899908083372
driven_any_median0.4270811131348941
driven_any_min0.2583041074646399
driven_lanedir_consec_max1.7179069684975172
driven_lanedir_consec_mean0.7271457338135366
driven_lanedir_consec_min0.2301576351919188
driven_lanedir_max1.7179069684975172
driven_lanedir_mean0.7272050454401864
driven_lanedir_median0.42023600843424624
driven_lanedir_min0.2301576351919188
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.15999999999999942
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.0515610722580937, "sim_physics": 0.02687308214006633, "survival_time": 6.849999999999984, "driven_lanedir": 1.0299528814544023, "sim_render-ego": 0.05554091669347165, "in-drivable-lane": 0, "agent_compute-ego": 0.090438150141361, "deviation-heading": 1.0794684601744635, "set_robot_commands": 0.07812869287755368, "deviation-center-line": 0.5564443313504773, "driven_lanedir_consec": 1.0296563233211538, "sim_compute_sim_state": 0.03297494449754701, "sim_compute_performance-ego": 0.058539627242262346, "sim_compute_robot_state-ego": 0.05985713875206718, "sim_compute_robot_state-npc0": 0.06635062189867896, "sim_compute_robot_state-npc1": 0.0596800320339899, "sim_compute_robot_state-npc2": 0.0598004003510858, "sim_compute_robot_state-npc3": 0.05919382345937464}, "udem1-1-0": {"driven_any": 0.2824081505877065, "sim_physics": 0.025614284887546447, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2301576351919188, "sim_render-ego": 0.06427696856056772, "in-drivable-lane": 0, "agent_compute-ego": 0.1212325154281244, "deviation-heading": 1.089349013400306, "set_robot_commands": 0.07740883129398997, "deviation-center-line": 0.12359623261482168, "driven_lanedir_consec": 0.2301576351919188, "sim_compute_sim_state": 0.032798993878248264, "sim_compute_performance-ego": 0.0630350229216785, "sim_compute_robot_state-ego": 0.061703530753531105, "sim_compute_robot_state-npc0": 0.06715143599161287, "sim_compute_robot_state-npc1": 0.06280903118412669, "sim_compute_robot_state-npc2": 0.06179048956894293, "sim_compute_robot_state-npc3": 0.061774608565539846}, "udem1-2-0": {"driven_any": 0.4270811131348941, "sim_physics": 0.029677128387709795, "survival_time": 2.9499999999999975, "driven_lanedir": 0.42023600843424624, "sim_render-ego": 0.055902836686473785, "in-drivable-lane": 0, "agent_compute-ego": 0.08705929982460152, "deviation-heading": 0.4163948185728488, "set_robot_commands": 0.07400707875267934, "deviation-center-line": 0.30614354212515077, "driven_lanedir_consec": 0.42023600843424624, "sim_compute_sim_state": 0.03203079255960756, "sim_compute_performance-ego": 0.0575006048558122, "sim_compute_robot_state-ego": 0.057796437861555715, "sim_compute_robot_state-npc0": 0.06352171251329325, "sim_compute_robot_state-npc1": 0.057264170404207906, "sim_compute_robot_state-npc2": 0.05648506293862553, "sim_compute_robot_state-npc3": 0.05734320010169078}, "udem1-3-0": {"driven_any": 0.2583041074646399, "sim_physics": 0.025415985207808644, "survival_time": 1.900000000000001, "driven_lanedir": 0.2377717336228471, "sim_render-ego": 0.052258849143981934, "in-drivable-lane": 0, "agent_compute-ego": 0.09299135208129884, "deviation-heading": 0.5295697647626202, "set_robot_commands": 0.07206016465237267, "deviation-center-line": 0.1710061035478807, "driven_lanedir_consec": 0.2377717336228471, "sim_compute_sim_state": 0.030386943566171748, "sim_compute_performance-ego": 0.055436667643095315, "sim_compute_robot_state-ego": 0.05616550069106253, "sim_compute_robot_state-npc0": 0.05872264033869693, "sim_compute_robot_state-npc1": 0.05625743614999872, "sim_compute_robot_state-npc2": 0.05554733150883725, "sim_compute_robot_state-npc3": 0.05462569939462762}, "udem1-4-0": {"driven_any": 1.873595510596352, "sim_physics": 0.02523119679055952, "survival_time": 11.950000000000037, "driven_lanedir": 1.7179069684975172, "sim_render-ego": 0.05348592422996106, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0831487019191726, "deviation-heading": 1.6898248523475965, "set_robot_commands": 0.07458644432004027, "deviation-center-line": 1.1274627052597173, "driven_lanedir_consec": 1.7179069684975172, "sim_compute_sim_state": 0.03142763680493981, "sim_compute_performance-ego": 0.05691846344760272, "sim_compute_robot_state-ego": 0.057570210061811504, "sim_compute_robot_state-npc0": 0.0616160167311026, "sim_compute_robot_state-npc1": 0.056859983061148034, "sim_compute_robot_state-npc2": 0.05655478034558156, "sim_compute_robot_state-npc3": 0.05680768459910628}}
set_robot_commands_max0.07812869287755368
set_robot_commands_mean0.07523824237932719
set_robot_commands_median0.07458644432004027
set_robot_commands_min0.07206016465237267
sim_compute_performance-ego_max0.0630350229216785
sim_compute_performance-ego_mean0.05828607722209021
sim_compute_performance-ego_median0.0575006048558122
sim_compute_performance-ego_min0.055436667643095315
sim_compute_robot_state-ego_max0.061703530753531105
sim_compute_robot_state-ego_mean0.0586185636240056
sim_compute_robot_state-ego_median0.057796437861555715
sim_compute_robot_state-ego_min0.05616550069106253
sim_compute_robot_state-npc0_max0.06715143599161287
sim_compute_robot_state-npc0_mean0.06347248549467693
sim_compute_robot_state-npc0_median0.06352171251329325
sim_compute_robot_state-npc0_min0.05872264033869693
sim_compute_robot_state-npc1_max0.06280903118412669
sim_compute_robot_state-npc1_mean0.05857413056669425
sim_compute_robot_state-npc1_median0.057264170404207906
sim_compute_robot_state-npc1_min0.05625743614999872
sim_compute_robot_state-npc2_max0.06179048956894293
sim_compute_robot_state-npc2_mean0.05803561294261461
sim_compute_robot_state-npc2_median0.05655478034558156
sim_compute_robot_state-npc2_min0.05554733150883725
sim_compute_robot_state-npc3_max0.061774608565539846
sim_compute_robot_state-npc3_mean0.05794900322406784
sim_compute_robot_state-npc3_median0.05734320010169078
sim_compute_robot_state-npc3_min0.05462569939462762
sim_compute_sim_state_max0.03297494449754701
sim_compute_sim_state_mean0.03192386226130288
sim_compute_sim_state_median0.03203079255960756
sim_compute_sim_state_min0.030386943566171748
sim_physics_max0.029677128387709795
sim_physics_mean0.026562335482738147
sim_physics_median0.025614284887546447
sim_physics_min0.02523119679055952
sim_render-ego_max0.06427696856056772
sim_render-ego_mean0.056293099062891226
sim_render-ego_median0.05554091669347165
sim_render-ego_min0.052258849143981934
simulation-passed1
survival_time_max11.950000000000037
survival_time_mean5.140000000000003
survival_time_min1.900000000000001
No reset possible
197602786Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197592799Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationfailednoidsc-rudolf-342170:01:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197563026Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197432940Bhairav MehtaBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197273043Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197123018Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196712370Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225306900765771
survival_time_median10.750000000000018
deviation-center-line_median0.40864173779456053
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.1463158075456266
agent_compute-ego_mean0.14180559306669302
agent_compute-ego_median0.142077869592711
agent_compute-ego_min0.13823292066725038
deviation-center-line_max0.6491801892887803
deviation-center-line_mean0.3683230725655418
deviation-center-line_min0.1475671628461062
deviation-heading_max2.2060076411946548
deviation-heading_mean1.4163758252990906
deviation-heading_median1.5250264276913703
deviation-heading_min0.6970592634293067
driven_any_max1.6057043265958648
driven_any_mean1.3484469345214642
driven_any_median1.5756972277649912
driven_any_min0.9900494571900692
driven_lanedir_consec_max1.4904214722299334
driven_lanedir_consec_mean1.0721437270256324
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.4904214722299334
driven_lanedir_mean1.0721437270256324
driven_lanedir_median1.225306900765771
driven_lanedir_min0.6474115509746436
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.4300000000000082
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.017351990981067687, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.05718457441535785, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.13823292066725038, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.07448386288375305, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.03995629866346181, "sim_compute_performance-ego": 0.062487965865100886, "sim_compute_robot_state-ego": 0.06447094807521903}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.017150769268509246, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.05625857924022814, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14389370305694804, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.07452763084077486, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.03913481914213974, "sim_compute_performance-ego": 0.063908646576596, "sim_compute_robot_state-ego": 0.06472402767543375}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.01732638705471706, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.05792196769885418, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.1385076644709292, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.07524684405647586, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.040280356000891714, "sim_compute_performance-ego": 0.06324003737069031, "sim_compute_robot_state-ego": 0.0661552625921275}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.01650297253630882, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.0583011505215667, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.142077869592711, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.07491615206696266, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.040964683266573175, "sim_compute_performance-ego": 0.06453349534855332, "sim_compute_robot_state-ego": 0.06575810188470885}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.016353550884458754, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.06218097496915747, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.1463158075456266, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.07888663366988853, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.04163710717801695, "sim_compute_performance-ego": 0.0659210052755144, "sim_compute_robot_state-ego": 0.06662918572072629}}
set_robot_commands_max0.07888663366988853
set_robot_commands_mean0.075612224703571
set_robot_commands_median0.07491615206696266
set_robot_commands_min0.07448386288375305
sim_compute_performance-ego_max0.0659210052755144
sim_compute_performance-ego_mean0.06401823008729098
sim_compute_performance-ego_median0.063908646576596
sim_compute_performance-ego_min0.062487965865100886
sim_compute_robot_state-ego_max0.06662918572072629
sim_compute_robot_state-ego_mean0.06554750518964308
sim_compute_robot_state-ego_median0.06575810188470885
sim_compute_robot_state-ego_min0.06447094807521903
sim_compute_sim_state_max0.04163710717801695
sim_compute_sim_state_mean0.04039465285021668
sim_compute_sim_state_median0.040280356000891714
sim_compute_sim_state_min0.03913481914213974
sim_physics_max0.017351990981067687
sim_physics_mean0.016937134145012314
sim_physics_median0.017150769268509246
sim_physics_min0.016353550884458754
sim_render-ego_max0.06218097496915747
sim_render-ego_mean0.058369449369032864
sim_render-ego_median0.05792196769885418
sim_render-ego_min0.05625857924022814
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean9.300000000000004
survival_time_min6.849999999999984
No reset possible
196602383Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05781258621334695
survival_time_median1.3000000000000005
deviation-center-line_median0.03686083524659073
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.29788840734041655
agent_compute-ego_mean0.2814866080153421
agent_compute-ego_median0.2775633663966738
agent_compute-ego_min0.276060684521993
deviation-center-line_max0.052999902399748305
deviation-center-line_mean0.035893135971220624
deviation-center-line_min0.017754426016333643
deviation-heading_max0.7066773636439447
deviation-heading_mean0.6525710841566645
deviation-heading_median0.6733046791926303
deviation-heading_min0.5316951814075588
driven_any_max0.1551480632035477
driven_any_mean0.1492555339808228
driven_any_median0.14817796814405595
driven_any_min0.14391625918062995
driven_lanedir_consec_max0.09579473165234063
driven_lanedir_consec_mean0.06554204941277782
driven_lanedir_consec_min0.040869073316082805
driven_lanedir_max0.09579473165234063
driven_lanedir_mean0.06554204941277782
driven_lanedir_median0.05781258621334695
driven_lanedir_min0.040869073316082805
in-drivable-lane_max0.5000000000000003
in-drivable-lane_mean0.26000000000000023
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14391625918062995, "sim_physics": 0.018171539673438437, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05781258621334695, "sim_render-ego": 0.057014951339134805, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.29788840734041655, "deviation-heading": 0.650459173716218, "set_robot_commands": 0.07529810758737418, "deviation-center-line": 0.033208811800648615, "driven_lanedir_consec": 0.05781258621334695, "sim_compute_sim_state": 0.038499767963702865, "sim_compute_performance-ego": 0.0582048067679772, "sim_compute_robot_state-ego": 0.06274730425614578}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15161250066052973, "sim_physics": 0.01643209457397461, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08272186537884885, "sim_render-ego": 0.0545074462890625, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.2766894340515137, "deviation-heading": 0.6733046791926303, "set_robot_commands": 0.07197092056274414, "deviation-center-line": 0.038641704392781834, "driven_lanedir_consec": 0.08272186537884885, "sim_compute_sim_state": 0.03594210624694824, "sim_compute_performance-ego": 0.06035599708557129, "sim_compute_robot_state-ego": 0.06251113891601562}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1551480632035477, "sim_physics": 0.017267446517944336, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09579473165234063, "sim_render-ego": 0.05506799697875977, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.2792311477661133, "deviation-heading": 0.7007190228229713, "set_robot_commands": 0.07448320388793946, "deviation-center-line": 0.052999902399748305, "driven_lanedir_consec": 0.09579473165234063, "sim_compute_sim_state": 0.03763315200805664, "sim_compute_performance-ego": 0.06050044059753418, "sim_compute_robot_state-ego": 0.06378413200378417}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14742287871535076, "sim_physics": 0.018700361251831055, "survival_time": 1.4500000000000006, "driven_lanedir": 0.040869073316082805, "sim_render-ego": 0.06034597035112052, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.2775633663966738, "deviation-heading": 0.5316951814075588, "set_robot_commands": 0.07275503257225299, "deviation-center-line": 0.017754426016333643, "driven_lanedir_consec": 0.040869073316082805, "sim_compute_sim_state": 0.039342954240996264, "sim_compute_performance-ego": 0.0646093384972934, "sim_compute_robot_state-ego": 0.06364463937693629}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14817796814405595, "sim_physics": 0.015797805786132813, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05051199050326982, "sim_render-ego": 0.05702060063680013, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.276060684521993, "deviation-heading": 0.7066773636439447, "set_robot_commands": 0.07317892710367839, "deviation-center-line": 0.03686083524659073, "driven_lanedir_consec": 0.05051199050326982, "sim_compute_sim_state": 0.03832266330718994, "sim_compute_performance-ego": 0.05929996967315674, "sim_compute_robot_state-ego": 0.06588212649027507}}
set_robot_commands_max0.07529810758737418
set_robot_commands_mean0.07353723834279782
set_robot_commands_median0.07317892710367839
set_robot_commands_min0.07197092056274414
sim_compute_performance-ego_max0.0646093384972934
sim_compute_performance-ego_mean0.06059411052430656
sim_compute_performance-ego_median0.06035599708557129
sim_compute_performance-ego_min0.0582048067679772
sim_compute_robot_state-ego_max0.06588212649027507
sim_compute_robot_state-ego_mean0.0637138682086314
sim_compute_robot_state-ego_median0.06364463937693629
sim_compute_robot_state-ego_min0.06251113891601562
sim_compute_sim_state_max0.039342954240996264
sim_compute_sim_state_mean0.03794812875337879
sim_compute_sim_state_median0.03832266330718994
sim_compute_sim_state_min0.03594210624694824
sim_physics_max0.018700361251831055
sim_physics_mean0.01727384956066425
sim_physics_median0.017267446517944336
sim_physics_min0.015797805786132813
sim_render-ego_max0.06034597035112052
sim_render-ego_mean0.05679139311897554
sim_render-ego_median0.057014951339134805
sim_render-ego_min0.0545074462890625
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.3500000000000003
survival_time_min1.2500000000000004
No reset possible
196362409jiang pengBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:21:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3614583993086016
survival_time_median14.950000000000076
deviation-center-line_median1.011969887428033
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.4665331276257833
agent_compute-ego_mean0.3477239651679993
agent_compute-ego_median0.31946917057037355
agent_compute-ego_min0.30433988332748413
deviation-center-line_max1.0119709059919424
deviation-center-line_mean1.0119700704341597
deviation-center-line_min1.0119697838947566
deviation-heading_max6.81542792438532
deviation-heading_mean6.815427924385318
deviation-heading_median6.815427924385319
deviation-heading_min6.815427924385317
driven_any_max4.390824152784936
driven_any_mean4.390824152784928
driven_any_median4.390824152784926
driven_any_min4.390824152784922
driven_lanedir_consec_max-1.361452200425545
driven_lanedir_consec_mean-1.3614594960339783
driven_lanedir_consec_min-1.3614696049818191
driven_lanedir_max-2.315814608416598
driven_lanedir_mean-2.3158178509092298
driven_lanedir_median-2.3158179462767055
driven_lanedir_min-2.315821760973971
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.017747774124145507, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.053399226665496825, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.4665331276257833, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.07398117144902547, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.0363671612739563, "sim_compute_performance-ego": 0.059657704830169675, "sim_compute_robot_state-ego": 0.061487579345703126}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.390824152784936, "sim_physics": 0.016266809304555256, "survival_time": 14.950000000000076, "driven_lanedir": -2.315820330462275, "sim_render-ego": 0.054014839331309, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.33034019947052, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.07514517784118652, "deviation-center-line": 1.0119709059919424, "driven_lanedir_consec": -1.3614650750283808, "sim_compute_sim_state": 0.037010237375895184, "sim_compute_performance-ego": 0.05845551570256551, "sim_compute_robot_state-ego": 0.06043392181396484}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784926, "sim_physics": 0.015629239877065024, "survival_time": 14.950000000000076, "driven_lanedir": -2.315821760973971, "sim_render-ego": 0.05377012093861898, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.31946917057037355, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.07549660921096801, "deviation-center-line": 1.0119697838947566, "driven_lanedir_consec": -1.3614696049818191, "sim_compute_sim_state": 0.03577156623204549, "sim_compute_performance-ego": 0.05833051681518555, "sim_compute_robot_state-ego": 0.05929224491119385}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.015641160806020103, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.0553427791595459, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.31793744484583536, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.07317200342814127, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03624800205230713, "sim_compute_performance-ego": 0.0592923633257548, "sim_compute_robot_state-ego": 0.0599445366859436}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784922, "sim_physics": 0.01632845083872477, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.05423267523447672, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.30433988332748413, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.07595660448074341, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.0357508111000061, "sim_compute_performance-ego": 0.0588838251431783, "sim_compute_robot_state-ego": 0.06008690277735392}}
set_robot_commands_max0.07595660448074341
set_robot_commands_mean0.07475031328201294
set_robot_commands_median0.07514517784118652
set_robot_commands_min0.07317200342814127
sim_compute_performance-ego_max0.059657704830169675
sim_compute_performance-ego_mean0.05892398516337076
sim_compute_performance-ego_median0.0588838251431783
sim_compute_performance-ego_min0.05833051681518555
sim_compute_robot_state-ego_max0.061487579345703126
sim_compute_robot_state-ego_mean0.06024903710683187
sim_compute_robot_state-ego_median0.06008690277735392
sim_compute_robot_state-ego_min0.05929224491119385
sim_compute_sim_state_max0.037010237375895184
sim_compute_sim_state_mean0.036229555606842045
sim_compute_sim_state_median0.03624800205230713
sim_compute_sim_state_min0.0357508111000061
sim_physics_max0.017747774124145507
sim_physics_mean0.01632268699010213
sim_physics_median0.016266809304555256
sim_physics_min0.015629239877065024
sim_render-ego_max0.0553427791595459
sim_render-ego_mean0.05415192826588948
sim_render-ego_median0.054014839331309
sim_render-ego_min0.053399226665496825
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
196102421Andrea Censi 🇨🇭random_agentaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12573336503084967
agent_compute-ego_mean0.1186564263772638
agent_compute-ego_median0.11745024257236056
agent_compute-ego_min0.11337991480557424
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.023631820138895285, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05424999740888488, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.11337991480557424, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07435880067213527, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03346952852213158, "sim_compute_performance-ego": 0.05716212290637898, "sim_compute_robot_state-ego": 0.05701318776832437, "sim_compute_robot_state-npc0": 0.06180197337888322, "sim_compute_robot_state-npc1": 0.05689181021924289, "sim_compute_robot_state-npc2": 0.05600075451832897, "sim_compute_robot_state-npc3": 0.05688522446830318}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.026674985885620117, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.05405157804489136, "in-drivable-lane": 0, "agent_compute-ego": 0.11610292846506293, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07370895147323608, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.033161483027718285, "sim_compute_performance-ego": 0.05855021693489768, "sim_compute_robot_state-ego": 0.05957346070896496, "sim_compute_robot_state-npc0": 0.06288377263329246, "sim_compute_robot_state-npc1": 0.06040294603867964, "sim_compute_robot_state-npc2": 0.05919634212147106, "sim_compute_robot_state-npc3": 0.05794652483680032}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02393138143751356, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.05370760493808323, "in-drivable-lane": 0, "agent_compute-ego": 0.11745024257236056, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07343574629889595, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.030794620513916016, "sim_compute_performance-ego": 0.058152230580647786, "sim_compute_robot_state-ego": 0.05666047732035319, "sim_compute_robot_state-npc0": 0.06295302708943686, "sim_compute_robot_state-npc1": 0.05720870229932997, "sim_compute_robot_state-npc2": 0.05772422154744466, "sim_compute_robot_state-npc3": 0.05694112777709961}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.025361751516660053, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.054542869329452515, "in-drivable-lane": 0, "agent_compute-ego": 0.12061568101247153, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07382234434286754, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.034048259258270264, "sim_compute_performance-ego": 0.05856724580128988, "sim_compute_robot_state-ego": 0.0583728700876236, "sim_compute_robot_state-npc0": 0.06480817000071208, "sim_compute_robot_state-npc1": 0.06161610782146454, "sim_compute_robot_state-npc2": 0.061055347323417664, "sim_compute_robot_state-npc3": 0.060683046778043113}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.0253747631521786, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05909652219099157, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12573336503084967, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07694401460535386, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03415041811325971, "sim_compute_performance-ego": 0.06243614589466768, "sim_compute_robot_state-ego": 0.06217528090757482, "sim_compute_robot_state-npc0": 0.06995344161987305, "sim_compute_robot_state-npc1": 0.06320435159346637, "sim_compute_robot_state-npc2": 0.06238614461001228, "sim_compute_robot_state-npc3": 0.06082159982008093}}
set_robot_commands_max0.07694401460535386
set_robot_commands_mean0.07445397147849775
set_robot_commands_median0.07382234434286754
set_robot_commands_min0.07343574629889595
sim_compute_performance-ego_max0.06243614589466768
sim_compute_performance-ego_mean0.0589735924235764
sim_compute_performance-ego_median0.05855021693489768
sim_compute_performance-ego_min0.05716212290637898
sim_compute_robot_state-ego_max0.06217528090757482
sim_compute_robot_state-ego_mean0.05875905535856818
sim_compute_robot_state-ego_median0.0583728700876236
sim_compute_robot_state-ego_min0.05666047732035319
sim_compute_robot_state-npc0_max0.06995344161987305
sim_compute_robot_state-npc0_mean0.06448007694443954
sim_compute_robot_state-npc0_median0.06295302708943686
sim_compute_robot_state-npc0_min0.06180197337888322
sim_compute_robot_state-npc1_max0.06320435159346637
sim_compute_robot_state-npc1_mean0.05986478359443668
sim_compute_robot_state-npc1_median0.06040294603867964
sim_compute_robot_state-npc1_min0.05689181021924289
sim_compute_robot_state-npc2_max0.06238614461001228
sim_compute_robot_state-npc2_mean0.05927256202413493
sim_compute_robot_state-npc2_median0.05919634212147106
sim_compute_robot_state-npc2_min0.05600075451832897
sim_compute_robot_state-npc3_max0.06082159982008093
sim_compute_robot_state-npc3_mean0.05865550473606542
sim_compute_robot_state-npc3_median0.05794652483680032
sim_compute_robot_state-npc3_min0.05688522446830318
sim_compute_sim_state_max0.03415041811325971
sim_compute_sim_state_mean0.03312486188705917
sim_compute_sim_state_median0.03346952852213158
sim_compute_sim_state_min0.030794620513916016
sim_physics_max0.026674985885620117
sim_physics_mean0.02499494042617352
sim_physics_median0.025361751516660053
sim_physics_min0.023631820138895285
sim_render-ego_max0.05909652219099157
sim_render-ego_mean0.055129714382460705
sim_render-ego_median0.05424999740888488
sim_render-ego_min0.05370760493808323
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
195662499Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06702871940724364
survival_time_median1.6500000000000008
deviation-center-line_median0.02956913651165367
in-drivable-lane_median0.6000000000000005


other stats
agent_compute-ego_max0.7487593293190002
agent_compute-ego_mean0.5639679628508563
agent_compute-ego_median0.5338270302974817
agent_compute-ego_min0.37377008524808014
deviation-center-line_max0.07490215733823825
deviation-center-line_mean0.041632452406624214
deviation-center-line_min0.02111937935322349
deviation-heading_max2.685241206303329
deviation-heading_mean1.2491712379719666
deviation-heading_median0.6666211678633496
deviation-heading_min0.5869394737439414
driven_any_max0.7204979421900164
driven_any_mean0.3174419896258348
driven_any_median0.16034555304438028
driven_any_min0.14171380142947834
driven_lanedir_consec_max0.2173907157927344
driven_lanedir_consec_mean0.10327060870181316
driven_lanedir_consec_min0.04732713942658817
driven_lanedir_max0.2173907157927344
driven_lanedir_mean0.10327060870181316
driven_lanedir_median0.06702871940724364
driven_lanedir_min0.04732713942658817
in-drivable-lane_max3.449999999999992
in-drivable-lane_mean1.399999999999998
in-drivable-lane_min0.5000000000000004
per-episodes
details{"udem1-0-0": {"driven_any": 0.14883283597740252, "sim_physics": 0.05680890381336212, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05351659826715305, "sim_render-ego": 0.06980440765619278, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.7487593293190002, "deviation-heading": 0.6666211678633496, "set_robot_commands": 0.1013452336192131, "deviation-center-line": 0.02956913651165367, "driven_lanedir_consec": 0.05351659826715305, "sim_compute_sim_state": 0.04424741864204407, "sim_compute_performance-ego": 0.07598628848791122, "sim_compute_robot_state-ego": 0.08197478950023651, "sim_compute_robot_state-npc0": 0.07720288634300232, "sim_compute_robot_state-npc1": 0.07640854269266129, "sim_compute_robot_state-npc2": 0.0757351964712143, "sim_compute_robot_state-npc3": 0.07596682757139206}, "udem1-1-0": {"driven_any": 0.7204979421900164, "sim_physics": 0.049712332812222565, "survival_time": 7.149999999999983, "driven_lanedir": 0.2173907157927344, "sim_render-ego": 0.06572782076322116, "in-drivable-lane": 3.449999999999992, "agent_compute-ego": 0.6364676285456944, "deviation-heading": 2.685241206303329, "set_robot_commands": 0.09131853897254784, "deviation-center-line": 0.07490215733823825, "driven_lanedir_consec": 0.2173907157927344, "sim_compute_sim_state": 0.03956364584969474, "sim_compute_performance-ego": 0.06992070158044775, "sim_compute_robot_state-ego": 0.07149698017360447, "sim_compute_robot_state-npc0": 0.07196378541159464, "sim_compute_robot_state-npc1": 0.0690381810381696, "sim_compute_robot_state-npc2": 0.06830817335969085, "sim_compute_robot_state-npc3": 0.06847034634410085}, "udem1-2-0": {"driven_any": 0.16034555304438028, "sim_physics": 0.03278920144745798, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06702871940724364, "sim_render-ego": 0.05374911337187796, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.5338270302974817, "deviation-heading": 0.5914227621681916, "set_robot_commands": 0.07180483413465095, "deviation-center-line": 0.02867369232499846, "driven_lanedir_consec": 0.06702871940724364, "sim_compute_sim_state": 0.032731699221061936, "sim_compute_performance-ego": 0.056176763592344345, "sim_compute_robot_state-ego": 0.060245940179535835, "sim_compute_robot_state-npc0": 0.063887307138154, "sim_compute_robot_state-npc1": 0.057488809932361946, "sim_compute_robot_state-npc2": 0.05882160591356682, "sim_compute_robot_state-npc3": 0.05692729082974521}, "udem1-3-0": {"driven_any": 0.4158198154878965, "sim_physics": 0.03472905597467532, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1310898706153465, "sim_render-ego": 0.05506415750788546, "in-drivable-lane": 1.8999999999999972, "agent_compute-ego": 0.527015740844025, "deviation-heading": 1.7156315797810215, "set_robot_commands": 0.07260610865450454, "deviation-center-line": 0.05389789650500717, "driven_lanedir_consec": 0.1310898706153465, "sim_compute_sim_state": 0.032660637778797366, "sim_compute_performance-ego": 0.05841188869257083, "sim_compute_robot_state-ego": 0.06134690635505764, "sim_compute_robot_state-npc0": 0.06121319189838979, "sim_compute_robot_state-npc1": 0.059454613718493234, "sim_compute_robot_state-npc2": 0.05969056863894408, "sim_compute_robot_state-npc3": 0.058422458582911}, "udem1-4-0": {"driven_any": 0.14171380142947834, "sim_physics": 0.02618723927122174, "survival_time": 1.6500000000000008, "driven_lanedir": 0.04732713942658817, "sim_render-ego": 0.052798740791551994, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.37377008524808014, "deviation-heading": 0.5869394737439414, "set_robot_commands": 0.07119686675794197, "deviation-center-line": 0.02111937935322349, "driven_lanedir_consec": 0.04732713942658817, "sim_compute_sim_state": 0.032847440604007606, "sim_compute_performance-ego": 0.057322877826112686, "sim_compute_robot_state-ego": 0.060016054095643936, "sim_compute_robot_state-npc0": 0.0639319708853057, "sim_compute_robot_state-npc1": 0.05754424586440578, "sim_compute_robot_state-npc2": 0.05525209686972878, "sim_compute_robot_state-npc3": 0.055720979517156426}}
set_robot_commands_max0.1013452336192131
set_robot_commands_mean0.08165431642777167
set_robot_commands_median0.07260610865450454
set_robot_commands_min0.07119686675794197
sim_compute_performance-ego_max0.07598628848791122
sim_compute_performance-ego_mean0.06356370403587737
sim_compute_performance-ego_median0.05841188869257083
sim_compute_performance-ego_min0.056176763592344345
sim_compute_robot_state-ego_max0.08197478950023651
sim_compute_robot_state-ego_mean0.06701613406081566
sim_compute_robot_state-ego_median0.06134690635505764
sim_compute_robot_state-ego_min0.060016054095643936
sim_compute_robot_state-npc0_max0.07720288634300232
sim_compute_robot_state-npc0_mean0.0676398283352893
sim_compute_robot_state-npc0_median0.0639319708853057
sim_compute_robot_state-npc0_min0.06121319189838979
sim_compute_robot_state-npc1_max0.07640854269266129
sim_compute_robot_state-npc1_mean0.06398687864921837
sim_compute_robot_state-npc1_median0.059454613718493234
sim_compute_robot_state-npc1_min0.057488809932361946
sim_compute_robot_state-npc2_max0.0757351964712143
sim_compute_robot_state-npc2_mean0.06356152825062897
sim_compute_robot_state-npc2_median0.05969056863894408
sim_compute_robot_state-npc2_min0.05525209686972878
sim_compute_robot_state-npc3_max0.07596682757139206
sim_compute_robot_state-npc3_mean0.06310158056906111
sim_compute_robot_state-npc3_median0.058422458582911
sim_compute_robot_state-npc3_min0.055720979517156426
sim_compute_sim_state_max0.04424741864204407
sim_compute_sim_state_mean0.03641016841912114
sim_compute_sim_state_median0.032847440604007606
sim_compute_sim_state_min0.032660637778797366
sim_physics_max0.05680890381336212
sim_physics_mean0.040045346663787944
sim_physics_median0.03472905597467532
sim_physics_min0.02618723927122174
sim_render-ego_max0.06980440765619278
sim_render-ego_mean0.059428848018145866
sim_render-ego_median0.05506415750788546
sim_render-ego_min0.052798740791551994
simulation-passed1
survival_time_max7.149999999999983
survival_time_mean3.2799999999999954
survival_time_min1.6000000000000008
No reset possible
195572509Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195382532Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-342170:02:14
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195262548Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0644153173153217
agent_compute-ego_mean0.06293802990954468
agent_compute-ego_median0.06392328789893617
agent_compute-ego_min0.060703779521741365
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.017685520939710663, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05669528391303086, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06127105689630276, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07849267924704202, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03901674107807439, "sim_compute_performance-ego": 0.06007578896313179, "sim_compute_robot_state-ego": 0.061871223333405286}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.015355192697965182, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.057913165826063887, "in-drivable-lane": 0, "agent_compute-ego": 0.0644153173153217, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.08119777532724234, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03592853362743671, "sim_compute_performance-ego": 0.0589976402429434, "sim_compute_robot_state-ego": 0.058061957359313965}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.015752315521240234, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05592625191871156, "in-drivable-lane": 0, "agent_compute-ego": 0.06392328789893617, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07304200720279774, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.037105326956891, "sim_compute_performance-ego": 0.06043505668640137, "sim_compute_robot_state-ego": 0.06159146288607983}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.018063513787238153, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05847795193011944, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06437670791542137, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07567667699122167, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03820942784403707, "sim_compute_performance-ego": 0.06148138413062462, "sim_compute_robot_state-ego": 0.06376356606955057}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.016123501878035695, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05457211795606112, "in-drivable-lane": 0, "agent_compute-ego": 0.060703779521741365, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07437939392892938, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03757024438757645, "sim_compute_performance-ego": 0.05928323143406918, "sim_compute_robot_state-ego": 0.05890290988119025}}
set_robot_commands_max0.08119777532724234
set_robot_commands_mean0.07655770653944663
set_robot_commands_median0.07567667699122167
set_robot_commands_min0.07304200720279774
sim_compute_performance-ego_max0.06148138413062462
sim_compute_performance-ego_mean0.06005462029143407
sim_compute_performance-ego_median0.06007578896313179
sim_compute_performance-ego_min0.0589976402429434
sim_compute_robot_state-ego_max0.06376356606955057
sim_compute_robot_state-ego_mean0.06083822390590797
sim_compute_robot_state-ego_median0.06159146288607983
sim_compute_robot_state-ego_min0.058061957359313965
sim_compute_sim_state_max0.03901674107807439
sim_compute_sim_state_mean0.03756605477880313
sim_compute_sim_state_median0.03757024438757645
sim_compute_sim_state_min0.03592853362743671
sim_physics_max0.018063513787238153
sim_physics_mean0.016596008964837986
sim_physics_median0.016123501878035695
sim_physics_min0.015355192697965182
sim_render-ego_max0.05847795193011944
sim_render-ego_mean0.05671695430879738
sim_render-ego_median0.05669528391303086
sim_render-ego_min0.05457211795606112
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
195132569Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06686159811521832
agent_compute-ego_mean0.0622369328254315
agent_compute-ego_median0.06090158475956447
agent_compute-ego_min0.0604102428142841
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.03231429049843236, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.05672304504796078, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06225107092606394, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.075240074960809, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03329022558111894, "sim_compute_performance-ego": 0.06087554379513389, "sim_compute_robot_state-ego": 0.0599626014107152, "sim_compute_robot_state-npc0": 0.06267337297138414, "sim_compute_robot_state-npc1": 0.0592867374420166, "sim_compute_robot_state-npc2": 0.0592724925593326, "sim_compute_robot_state-npc3": 0.061772065413625614}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.027234159017864027, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.05421711896595202, "in-drivable-lane": 0, "agent_compute-ego": 0.06686159811521832, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07470510507884778, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03353315278103477, "sim_compute_performance-ego": 0.05931096327932257, "sim_compute_robot_state-ego": 0.05988806799838418, "sim_compute_robot_state-npc0": 0.06342864663977373, "sim_compute_robot_state-npc1": 0.06035846785495156, "sim_compute_robot_state-npc2": 0.06346539447182103, "sim_compute_robot_state-npc3": 0.059130969800447165}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.028374543556800257, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.05744804480136969, "in-drivable-lane": 0, "agent_compute-ego": 0.0604102428142841, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07454293202131222, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.033805590409498945, "sim_compute_performance-ego": 0.05953650596814278, "sim_compute_robot_state-ego": 0.058787217506995566, "sim_compute_robot_state-npc0": 0.06726444073212452, "sim_compute_robot_state-npc1": 0.062414964040120445, "sim_compute_robot_state-npc2": 0.0589595880263891, "sim_compute_robot_state-npc3": 0.061736394197512895}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03094603310168629, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.05482665921600772, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06090158475956447, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07695945887498452, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.033908807056050906, "sim_compute_performance-ego": 0.06025321047071, "sim_compute_robot_state-ego": 0.05914661246286312, "sim_compute_robot_state-npc0": 0.0638075009198256, "sim_compute_robot_state-npc1": 0.05953105402664399, "sim_compute_robot_state-npc2": 0.05815200402703083, "sim_compute_robot_state-npc3": 0.05948172152881891}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.025191068649291992, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.056770416823300446, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0607601675120267, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07142286950891669, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03275546702471646, "sim_compute_performance-ego": 0.06060030243613503, "sim_compute_robot_state-ego": 0.059314185922796074, "sim_compute_robot_state-npc0": 0.06238787824457342, "sim_compute_robot_state-npc1": 0.06081829829649492, "sim_compute_robot_state-npc2": 0.05942945046858354, "sim_compute_robot_state-npc3": 0.06066446412693371}}
set_robot_commands_max0.07695945887498452
set_robot_commands_mean0.07457408808897405
set_robot_commands_median0.07470510507884778
set_robot_commands_min0.07142286950891669
sim_compute_performance-ego_max0.06087554379513389
sim_compute_performance-ego_mean0.060115305189888855
sim_compute_performance-ego_median0.06025321047071
sim_compute_performance-ego_min0.05931096327932257
sim_compute_robot_state-ego_max0.0599626014107152
sim_compute_robot_state-ego_mean0.05941973706035083
sim_compute_robot_state-ego_median0.059314185922796074
sim_compute_robot_state-ego_min0.058787217506995566
sim_compute_robot_state-npc0_max0.06726444073212452
sim_compute_robot_state-npc0_mean0.06391236790153629
sim_compute_robot_state-npc0_median0.06342864663977373
sim_compute_robot_state-npc0_min0.06238787824457342
sim_compute_robot_state-npc1_max0.062414964040120445
sim_compute_robot_state-npc1_mean0.0604819043320455
sim_compute_robot_state-npc1_median0.06035846785495156
sim_compute_robot_state-npc1_min0.0592867374420166
sim_compute_robot_state-npc2_max0.06346539447182103
sim_compute_robot_state-npc2_mean0.05985578591063142
sim_compute_robot_state-npc2_median0.0592724925593326
sim_compute_robot_state-npc2_min0.05815200402703083
sim_compute_robot_state-npc3_max0.061772065413625614
sim_compute_robot_state-npc3_mean0.06055712301346766
sim_compute_robot_state-npc3_median0.06066446412693371
sim_compute_robot_state-npc3_min0.059130969800447165
sim_compute_sim_state_max0.033908807056050906
sim_compute_sim_state_mean0.03345864857048401
sim_compute_sim_state_median0.03353315278103477
sim_compute_sim_state_min0.03275546702471646
sim_physics_max0.03231429049843236
sim_physics_mean0.028812018964814983
sim_physics_median0.028374543556800257
sim_physics_min0.025191068649291992
sim_render-ego_max0.05744804480136969
sim_render-ego_mean0.05599705697091813
sim_render-ego_median0.05672304504796078
sim_render-ego_min0.05421711896595202
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
195112573Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195092574Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195052582Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-342170:01:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194852608Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09553360022031344
agent_compute-ego_mean0.0794663734921688
agent_compute-ego_median0.09279921714295732
agent_compute-ego_min0.05554892667909948
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.024281152864781823, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.0469690212389318, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05554892667909948, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07026741562820063, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.030439449519645875, "sim_compute_performance-ego": 0.05370797762056676, "sim_compute_robot_state-ego": 0.054881360472702395, "sim_compute_robot_state-npc0": 0.056169730861012526, "sim_compute_robot_state-npc1": 0.05446134544000393, "sim_compute_robot_state-npc2": 0.0530804628279151, "sim_compute_robot_state-npc3": 0.0528548810540176}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.05993788058941181, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.07018965024214524, "in-drivable-lane": 0, "agent_compute-ego": 0.09553360022031344, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.11831984153160682, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.04474965425638052, "sim_compute_performance-ego": 0.07806158982790433, "sim_compute_robot_state-ego": 0.0958413894359882, "sim_compute_robot_state-npc0": 0.08138663035172683, "sim_compute_robot_state-npc1": 0.08037205842825082, "sim_compute_robot_state-npc2": 0.08088073363670936, "sim_compute_robot_state-npc3": 0.07901383363283597}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.06261237631452844, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.0732386771668779, "in-drivable-lane": 0, "agent_compute-ego": 0.09279921714295732, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.10271883518137832, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.04572904870865193, "sim_compute_performance-ego": 0.07965406458428566, "sim_compute_robot_state-ego": 0.09802166451799108, "sim_compute_robot_state-npc0": 0.08057403564453125, "sim_compute_robot_state-npc1": 0.08023820024855594, "sim_compute_robot_state-npc2": 0.07814737076454974, "sim_compute_robot_state-npc3": 0.07779159444443723}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.06318507351718106, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.07149208771003472, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.09410612661759932, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.11257994829953372, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04521993228367397, "sim_compute_performance-ego": 0.07945109723688482, "sim_compute_robot_state-ego": 0.09194122827970064, "sim_compute_robot_state-npc0": 0.08125329279637598, "sim_compute_robot_state-npc1": 0.07884612450232872, "sim_compute_robot_state-npc2": 0.0785520260150616, "sim_compute_robot_state-npc3": 0.07828119822910853}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.02679691816631116, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05264530056401303, "in-drivable-lane": 0, "agent_compute-ego": 0.05934399680087441, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07480638905575401, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03069336163370233, "sim_compute_performance-ego": 0.05462022204148142, "sim_compute_robot_state-ego": 0.06072503642032021, "sim_compute_robot_state-npc0": 0.05746382161190635, "sim_compute_robot_state-npc1": 0.05525648593902588, "sim_compute_robot_state-npc2": 0.05460773016277112, "sim_compute_robot_state-npc3": 0.054718852043151855}}
set_robot_commands_max0.11831984153160682
set_robot_commands_mean0.09573848593929472
set_robot_commands_median0.10271883518137832
set_robot_commands_min0.07026741562820063
sim_compute_performance-ego_max0.07965406458428566
sim_compute_performance-ego_mean0.0690989902622246
sim_compute_performance-ego_median0.07806158982790433
sim_compute_performance-ego_min0.05370797762056676
sim_compute_robot_state-ego_max0.09802166451799108
sim_compute_robot_state-ego_mean0.08028213582534052
sim_compute_robot_state-ego_median0.09194122827970064
sim_compute_robot_state-ego_min0.054881360472702395
sim_compute_robot_state-npc0_max0.08138663035172683
sim_compute_robot_state-npc0_mean0.07136950225311059
sim_compute_robot_state-npc0_median0.08057403564453125
sim_compute_robot_state-npc0_min0.056169730861012526
sim_compute_robot_state-npc1_max0.08037205842825082
sim_compute_robot_state-npc1_mean0.06983484291163307
sim_compute_robot_state-npc1_median0.07884612450232872
sim_compute_robot_state-npc1_min0.05446134544000393
sim_compute_robot_state-npc2_max0.08088073363670936
sim_compute_robot_state-npc2_mean0.0690536646814014
sim_compute_robot_state-npc2_median0.07814737076454974
sim_compute_robot_state-npc2_min0.0530804628279151
sim_compute_robot_state-npc3_max0.07901383363283597
sim_compute_robot_state-npc3_mean0.06853207188071024
sim_compute_robot_state-npc3_median0.07779159444443723
sim_compute_robot_state-npc3_min0.0528548810540176
sim_compute_sim_state_max0.04572904870865193
sim_compute_sim_state_mean0.03936628928041093
sim_compute_sim_state_median0.04474965425638052
sim_compute_sim_state_min0.030439449519645875
sim_physics_max0.06318507351718106
sim_physics_mean0.047362680290442855
sim_physics_median0.05993788058941181
sim_physics_min0.024281152864781823
sim_render-ego_max0.0732386771668779
sim_render-ego_mean0.06290694738440053
sim_render-ego_median0.07018965024214524
sim_render-ego_min0.0469690212389318
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
194742624Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.13311806179228283
agent_compute-ego_mean0.12836880828207323
agent_compute-ego_median0.12932979676031298
agent_compute-ego_min0.1225968049122737
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03154330783420139, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.052772790666610475, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13311806179228283, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07510173509991358, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03338992784893702, "sim_compute_performance-ego": 0.05793391333685981, "sim_compute_robot_state-ego": 0.05968789448813787, "sim_compute_robot_state-npc0": 0.06343311733669704, "sim_compute_robot_state-npc1": 0.058302413849603565, "sim_compute_robot_state-npc2": 0.057716388551015706, "sim_compute_robot_state-npc3": 0.0571144838181753}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.027669331606696632, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.050676154155357214, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13115558437272615, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07220641304464902, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03304859236174939, "sim_compute_performance-ego": 0.05603958111183316, "sim_compute_robot_state-ego": 0.059061466478833965, "sim_compute_robot_state-npc0": 0.06193092290092917, "sim_compute_robot_state-npc1": 0.06046316670436485, "sim_compute_robot_state-npc2": 0.058012957666434495, "sim_compute_robot_state-npc3": 0.057876180200015795}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.029172978093547207, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05151559845093758, "in-drivable-lane": 0, "agent_compute-ego": 0.12932979676031298, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07689191449073053, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03151244117367652, "sim_compute_performance-ego": 0.05487928467412149, "sim_compute_robot_state-ego": 0.05832663274580432, "sim_compute_robot_state-npc0": 0.05871924661820935, "sim_compute_robot_state-npc1": 0.056996560865832914, "sim_compute_robot_state-npc2": 0.05776434559975901, "sim_compute_robot_state-npc3": 0.057068001839422414}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.028387018974791185, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.04958021640777588, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12564379357277078, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07259664383340389, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.031106157505765876, "sim_compute_performance-ego": 0.053560092094096734, "sim_compute_robot_state-ego": 0.05529767908948533, "sim_compute_robot_state-npc0": 0.05834308583685692, "sim_compute_robot_state-npc1": 0.05563434641411964, "sim_compute_robot_state-npc2": 0.053230151217034526, "sim_compute_robot_state-npc3": 0.05458108922268482}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.024229503594912015, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.04833342020328228, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1225968049122737, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.0708980789551368, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.030337329094226543, "sim_compute_performance-ego": 0.05359803713285006, "sim_compute_robot_state-ego": 0.05499069048808171, "sim_compute_robot_state-npc0": 0.0562672523351816, "sim_compute_robot_state-npc1": 0.05389083807285015, "sim_compute_robot_state-npc2": 0.05328466800542978, "sim_compute_robot_state-npc3": 0.053518556631528415}}
set_robot_commands_max0.07689191449073053
set_robot_commands_mean0.07353895708476677
set_robot_commands_median0.07259664383340389
set_robot_commands_min0.0708980789551368
sim_compute_performance-ego_max0.05793391333685981
sim_compute_performance-ego_mean0.055202181669952256
sim_compute_performance-ego_median0.05487928467412149
sim_compute_performance-ego_min0.053560092094096734
sim_compute_robot_state-ego_max0.05968789448813787
sim_compute_robot_state-ego_mean0.05747287265806864
sim_compute_robot_state-ego_median0.05832663274580432
sim_compute_robot_state-ego_min0.05499069048808171
sim_compute_robot_state-npc0_max0.06343311733669704
sim_compute_robot_state-npc0_mean0.05973872500557481
sim_compute_robot_state-npc0_median0.05871924661820935
sim_compute_robot_state-npc0_min0.0562672523351816
sim_compute_robot_state-npc1_max0.06046316670436485
sim_compute_robot_state-npc1_mean0.057057465181354225
sim_compute_robot_state-npc1_median0.056996560865832914
sim_compute_robot_state-npc1_min0.05389083807285015
sim_compute_robot_state-npc2_max0.058012957666434495
sim_compute_robot_state-npc2_mean0.05600170220793471
sim_compute_robot_state-npc2_median0.057716388551015706
sim_compute_robot_state-npc2_min0.053230151217034526
sim_compute_robot_state-npc3_max0.057876180200015795
sim_compute_robot_state-npc3_mean0.056031662342365354
sim_compute_robot_state-npc3_median0.057068001839422414
sim_compute_robot_state-npc3_min0.053518556631528415
sim_compute_sim_state_max0.03338992784893702
sim_compute_sim_state_mean0.03187888959687107
sim_compute_sim_state_median0.03151244117367652
sim_compute_sim_state_min0.030337329094226543
sim_physics_max0.03154330783420139
sim_physics_mean0.02820042802082969
sim_physics_median0.028387018974791185
sim_physics_min0.024229503594912015
sim_render-ego_max0.052772790666610475
sim_render-ego_mean0.05057563597679269
sim_render-ego_median0.050676154155357214
sim_render-ego_min0.04833342020328228
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
194392656Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:17:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2600699265692286
survival_time_median8.599999999999987
deviation-center-line_median0.6840365850112707
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08175346324610155
agent_compute-ego_mean0.06757432073649114
agent_compute-ego_median0.06922435902413868
agent_compute-ego_min0.0559205732345581
deviation-center-line_max1.279428116122291
deviation-center-line_mean0.7228653210775722
deviation-center-line_min0.2929086707520042
deviation-heading_max3.569835137199871
deviation-heading_mean2.4063260424263633
deviation-heading_median2.2185971879096913
deviation-heading_min1.9340387013166151
driven_any_max2.3555153402526874
driven_any_mean1.548270195695586
driven_any_median1.335078113730401
driven_any_min0.7858727727075934
driven_lanedir_consec_max1.92009145613854
driven_lanedir_consec_mean1.304932864204436
driven_lanedir_consec_min0.6826927961183539
driven_lanedir_max1.92009145613854
driven_lanedir_mean1.3416678444586316
driven_lanedir_median1.2600699265692286
driven_lanedir_min0.6826927961183539
in-drivable-lane_max3.650000000000052
in-drivable-lane_mean0.7300000000000104
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7858727727075934, "sim_physics": 0.02620143663315546, "survival_time": 5.249999999999989, "driven_lanedir": 0.6826927961183539, "sim_render-ego": 0.05008417084103539, "in-drivable-lane": 0, "agent_compute-ego": 0.05840405963716053, "deviation-heading": 1.9340387013166151, "set_robot_commands": 0.07156494231451126, "deviation-center-line": 0.2929086707520042, "driven_lanedir_consec": 0.6826927961183539, "sim_compute_sim_state": 0.03116073381333124, "sim_compute_performance-ego": 0.055157250449770975, "sim_compute_robot_state-ego": 0.058108638581775486, "sim_compute_robot_state-npc0": 0.06036608559744699, "sim_compute_robot_state-npc1": 0.05824942361740839, "sim_compute_robot_state-npc2": 0.055188317525954475, "sim_compute_robot_state-npc3": 0.05545848891848609}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9619363977817437, "sim_physics": 0.02469020462036133, "survival_time": 12.500000000000044, "driven_lanedir": 1.92009145613854, "sim_render-ego": 0.04963991928100586, "in-drivable-lane": 0, "agent_compute-ego": 0.0559205732345581, "deviation-heading": 2.2363234195330652, "set_robot_commands": 0.07197620391845704, "deviation-center-line": 1.279428116122291, "driven_lanedir_consec": 1.92009145613854, "sim_compute_sim_state": 0.03118326950073242, "sim_compute_performance-ego": 0.05463589382171631, "sim_compute_robot_state-ego": 0.05760659599304199, "sim_compute_robot_state-npc0": 0.05775180721282959, "sim_compute_robot_state-npc1": 0.054842257499694826, "sim_compute_robot_state-npc2": 0.05530976867675781, "sim_compute_robot_state-npc3": 0.05521581649780274}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555153402526874, "sim_physics": 0.03463285446166992, "survival_time": 14.950000000000076, "driven_lanedir": 1.6051322059276782, "sim_render-ego": 0.05785725593566895, "in-drivable-lane": 3.650000000000052, "agent_compute-ego": 0.07256914854049683, "deviation-heading": 3.569835137199871, "set_robot_commands": 0.08427937587102254, "deviation-center-line": 0.6840365850112707, "driven_lanedir_consec": 1.421457304656701, "sim_compute_sim_state": 0.03626236120859782, "sim_compute_performance-ego": 0.0644270650545756, "sim_compute_robot_state-ego": 0.06873493909835815, "sim_compute_robot_state-npc0": 0.06576579650243124, "sim_compute_robot_state-npc1": 0.06415930191675821, "sim_compute_robot_state-npc2": 0.06364309549331665, "sim_compute_robot_state-npc3": 0.06348372936248779}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.335078113730401, "sim_physics": 0.04274190719737563, "survival_time": 8.599999999999987, "driven_lanedir": 1.2600699265692286, "sim_render-ego": 0.06603709764258806, "in-drivable-lane": 0, "agent_compute-ego": 0.08175346324610155, "deviation-heading": 2.2185971879096913, "set_robot_commands": 0.09311992068623388, "deviation-center-line": 0.6858786733767215, "driven_lanedir_consec": 1.2600699265692286, "sim_compute_sim_state": 0.0403360973956973, "sim_compute_performance-ego": 0.07127046862313914, "sim_compute_robot_state-ego": 0.07398084568422894, "sim_compute_robot_state-npc0": 0.07144719362258911, "sim_compute_robot_state-npc1": 0.07080594190331392, "sim_compute_robot_state-npc2": 0.07136410336161769, "sim_compute_robot_state-npc3": 0.07162852065507756}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.302948354005505, "sim_physics": 0.029757442928495866, "survival_time": 8.399999999999984, "driven_lanedir": 1.240352837539357, "sim_render-ego": 0.05677528892244611, "in-drivable-lane": 0, "agent_compute-ego": 0.06922435902413868, "deviation-heading": 2.072835766172574, "set_robot_commands": 0.07759339468819755, "deviation-center-line": 0.6720745601255739, "driven_lanedir_consec": 1.240352837539357, "sim_compute_sim_state": 0.034405018602098734, "sim_compute_performance-ego": 0.06155667986188616, "sim_compute_robot_state-ego": 0.0637500938915071, "sim_compute_robot_state-npc0": 0.0626547322386787, "sim_compute_robot_state-npc1": 0.06068310709226699, "sim_compute_robot_state-npc2": 0.060554186503092446, "sim_compute_robot_state-npc3": 0.06008452035131909}}
set_robot_commands_max0.09311992068623388
set_robot_commands_mean0.07970676749568445
set_robot_commands_median0.07759339468819755
set_robot_commands_min0.07156494231451126
sim_compute_performance-ego_max0.07127046862313914
sim_compute_performance-ego_mean0.06140947156221764
sim_compute_performance-ego_median0.06155667986188616
sim_compute_performance-ego_min0.05463589382171631
sim_compute_robot_state-ego_max0.07398084568422894
sim_compute_robot_state-ego_mean0.06443622264978233
sim_compute_robot_state-ego_median0.0637500938915071
sim_compute_robot_state-ego_min0.05760659599304199
sim_compute_robot_state-npc0_max0.07144719362258911
sim_compute_robot_state-npc0_mean0.06359712303479512
sim_compute_robot_state-npc0_median0.0626547322386787
sim_compute_robot_state-npc0_min0.05775180721282959
sim_compute_robot_state-npc1_max0.07080594190331392
sim_compute_robot_state-npc1_mean0.06174800640588847
sim_compute_robot_state-npc1_median0.06068310709226699
sim_compute_robot_state-npc1_min0.054842257499694826
sim_compute_robot_state-npc2_max0.07136410336161769
sim_compute_robot_state-npc2_mean0.06121189431214782
sim_compute_robot_state-npc2_median0.060554186503092446
sim_compute_robot_state-npc2_min0.055188317525954475
sim_compute_robot_state-npc3_max0.07162852065507756
sim_compute_robot_state-npc3_mean0.06117421515703465
sim_compute_robot_state-npc3_median0.06008452035131909
sim_compute_robot_state-npc3_min0.05521581649780274
sim_compute_sim_state_max0.0403360973956973
sim_compute_sim_state_mean0.0346694961040915
sim_compute_sim_state_median0.034405018602098734
sim_compute_sim_state_min0.03116073381333124
sim_physics_max0.04274190719737563
sim_physics_mean0.031604769168211644
sim_physics_median0.029757442928495866
sim_physics_min0.02469020462036133
sim_render-ego_max0.06603709764258806
sim_render-ego_mean0.056078746524548875
sim_render-ego_median0.05677528892244611
sim_render-ego_min0.04963991928100586
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.940000000000015
survival_time_min5.249999999999989
No reset possible
194372665Rami Al-Naim 🇷🇺Modidfied configaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-342170:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194352672Rami Al-Naim 🇷🇺Modidfied configaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-342170:00:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194222685Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:13:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6231898670488594
survival_time_median4.799999999999991
deviation-center-line_median0.2306909266529859
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09053800662358602
agent_compute-ego_mean0.0647391914992673
agent_compute-ego_median0.05965403061878832
agent_compute-ego_min0.056592002511024475
deviation-center-line_max1.028879107692084
deviation-center-line_mean0.4830096674533874
deviation-center-line_min0.09039661126305508
deviation-heading_max4.788939163703876
deviation-heading_mean2.0582454251731823
deviation-heading_median1.646228969459607
deviation-heading_min0.7043317050655629
driven_any_max2.355578748652322
driven_any_mean1.0629233870208463
driven_any_median0.7243316215538553
driven_any_min0.24223373073508864
driven_lanedir_consec_max2.1675987791413123
driven_lanedir_consec_mean0.966228948503478
driven_lanedir_consec_min0.20616189487875425
driven_lanedir_max2.1685030542076333
driven_lanedir_mean0.9670584585746976
driven_lanedir_median0.6231898670488594
driven_lanedir_min0.20616189487875425
in-drivable-lane_max0.2499999999999991
in-drivable-lane_mean0.05999999999999979
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4047391792546935, "sim_physics": 0.028149261579408752, "survival_time": 9.099999999999994, "driven_lanedir": 1.377815877712716, "sim_render-ego": 0.05203567101405217, "in-drivable-lane": 0, "agent_compute-ego": 0.06006796805413215, "deviation-heading": 1.4316196271258417, "set_robot_commands": 0.07295398004762418, "deviation-center-line": 0.8592265293080877, "driven_lanedir_consec": 1.3745726024229392, "sim_compute_sim_state": 0.03250271540421706, "sim_compute_performance-ego": 0.05606111196371225, "sim_compute_robot_state-ego": 0.05779889520708021, "sim_compute_robot_state-npc0": 0.06123043154622172, "sim_compute_robot_state-npc1": 0.056815311148926455, "sim_compute_robot_state-npc2": 0.05598766332144266, "sim_compute_robot_state-npc3": 0.057080485008575106}, "udem1-1-0": {"driven_any": 0.7243316215538553, "sim_physics": 0.02850348005692164, "survival_time": 4.799999999999991, "driven_lanedir": 0.6231898670488594, "sim_render-ego": 0.05344771593809128, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.056592002511024475, "deviation-heading": 1.7201076605110244, "set_robot_commands": 0.07061493148406346, "deviation-center-line": 0.2306909266529859, "driven_lanedir_consec": 0.6231898670488594, "sim_compute_sim_state": 0.03152732799450556, "sim_compute_performance-ego": 0.05547450731197993, "sim_compute_robot_state-ego": 0.05559150874614715, "sim_compute_robot_state-npc0": 0.05614065627257029, "sim_compute_robot_state-npc1": 0.054061755537986755, "sim_compute_robot_state-npc2": 0.054397813975811005, "sim_compute_robot_state-npc3": 0.05528125911951065}, "udem1-2-0": {"driven_any": 0.5877336549082731, "sim_physics": 0.032759340503547764, "survival_time": 3.949999999999994, "driven_lanedir": 0.459621599025525, "sim_render-ego": 0.05098131034947649, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.05965403061878832, "deviation-heading": 1.646228969459607, "set_robot_commands": 0.07200536848623541, "deviation-center-line": 0.20585516235072449, "driven_lanedir_consec": 0.459621599025525, "sim_compute_sim_state": 0.03155900858625581, "sim_compute_performance-ego": 0.05525505693652962, "sim_compute_robot_state-ego": 0.056302692316755464, "sim_compute_robot_state-npc0": 0.05779808382444744, "sim_compute_robot_state-npc1": 0.056149259398255165, "sim_compute_robot_state-npc2": 0.05881984626190572, "sim_compute_robot_state-npc3": 0.055953946294663826}, "udem1-3-0": {"driven_any": 0.24223373073508864, "sim_physics": 0.028593560059865315, "survival_time": 1.800000000000001, "driven_lanedir": 0.20616189487875425, "sim_render-ego": 0.05179064141379462, "in-drivable-lane": 0, "agent_compute-ego": 0.05684394968880547, "deviation-heading": 0.7043317050655629, "set_robot_commands": 0.06951016849941677, "deviation-center-line": 0.09039661126305508, "driven_lanedir_consec": 0.20616189487875425, "sim_compute_sim_state": 0.03227070967356364, "sim_compute_performance-ego": 0.055409630139668785, "sim_compute_robot_state-ego": 0.05422184202406141, "sim_compute_robot_state-npc0": 0.05592971377902561, "sim_compute_robot_state-npc1": 0.05606714222166273, "sim_compute_robot_state-npc2": 0.05576378769344754, "sim_compute_robot_state-npc3": 0.05593827035692003}, "udem1-4-0": {"driven_any": 2.355578748652322, "sim_physics": 0.0508148201306661, "survival_time": 14.950000000000076, "driven_lanedir": 2.1685030542076333, "sim_render-ego": 0.0690598464012146, "in-drivable-lane": 0, "agent_compute-ego": 0.09053800662358602, "deviation-heading": 4.788939163703876, "set_robot_commands": 0.097898903687795, "deviation-center-line": 1.028879107692084, "driven_lanedir_consec": 2.1675987791413123, "sim_compute_sim_state": 0.04148004452387491, "sim_compute_performance-ego": 0.07459885279337565, "sim_compute_robot_state-ego": 0.07972372770309448, "sim_compute_robot_state-npc0": 0.07301432530085246, "sim_compute_robot_state-npc1": 0.073322278658549, "sim_compute_robot_state-npc2": 0.07377854029337565, "sim_compute_robot_state-npc3": 0.07318852345148723}}
set_robot_commands_max0.097898903687795
set_robot_commands_mean0.07659667044102696
set_robot_commands_median0.07200536848623541
set_robot_commands_min0.06951016849941677
sim_compute_performance-ego_max0.07459885279337565
sim_compute_performance-ego_mean0.05935983182905325
sim_compute_performance-ego_median0.05547450731197993
sim_compute_performance-ego_min0.05525505693652962
sim_compute_robot_state-ego_max0.07972372770309448
sim_compute_robot_state-ego_mean0.060727733199427744
sim_compute_robot_state-ego_median0.056302692316755464
sim_compute_robot_state-ego_min0.05422184202406141
sim_compute_robot_state-npc0_max0.07301432530085246
sim_compute_robot_state-npc0_mean0.060822642144623504
sim_compute_robot_state-npc0_median0.05779808382444744
sim_compute_robot_state-npc0_min0.05592971377902561
sim_compute_robot_state-npc1_max0.073322278658549
sim_compute_robot_state-npc1_mean0.059283149393076016
sim_compute_robot_state-npc1_median0.056149259398255165
sim_compute_robot_state-npc1_min0.054061755537986755
sim_compute_robot_state-npc2_max0.07377854029337565
sim_compute_robot_state-npc2_mean0.05974953030919651
sim_compute_robot_state-npc2_median0.05598766332144266
sim_compute_robot_state-npc2_min0.054397813975811005
sim_compute_robot_state-npc3_max0.07318852345148723
sim_compute_robot_state-npc3_mean0.059488496846231365
sim_compute_robot_state-npc3_median0.055953946294663826
sim_compute_robot_state-npc3_min0.05528125911951065
sim_compute_sim_state_max0.04148004452387491
sim_compute_sim_state_mean0.0338679612364834
sim_compute_sim_state_median0.03227070967356364
sim_compute_sim_state_min0.03152732799450556
sim_physics_max0.0508148201306661
sim_physics_mean0.03376409246608192
sim_physics_median0.028593560059865315
sim_physics_min0.028149261579408752
sim_render-ego_max0.0690598464012146
sim_render-ego_mean0.055463037023325834
sim_render-ego_median0.05203567101405217
sim_render-ego_min0.05098131034947649
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.9200000000000115
survival_time_min1.800000000000001
No reset possible
194162727jiang pengtest for ppoaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-342170:02:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 136, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 301, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193872743Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationfailednoidsc-rudolf-342170:01:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193682774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:10:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4889045976301556
survival_time_median3.7499999999999942
deviation-center-line_median0.2494193891551898
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.18203642493800112
agent_compute-ego_mean0.11285260173464928
agent_compute-ego_median0.09988494962453842
agent_compute-ego_min0.08051202456156413
deviation-center-line_max0.8174959711140002
deviation-center-line_mean0.3412901636139237
deviation-center-line_min0.061484482735035824
deviation-heading_max2.410473163343411
deviation-heading_mean1.0316416677847595
deviation-heading_median0.7178167934226656
deviation-heading_min0.6154549109027005
driven_any_max1.7931247675942137
driven_any_mean0.7239204058527922
driven_any_median0.5556420301227285
driven_any_min0.2100687594789937
driven_lanedir_consec_max1.322879282392715
driven_lanedir_consec_mean0.5971083304892798
driven_lanedir_consec_min0.15553543067421716
driven_lanedir_max1.322879282392715
driven_lanedir_mean0.5971083304892798
driven_lanedir_median0.4889045976301556
driven_lanedir_min0.15553543067421716
in-drivable-lane_max2.450000000000027
in-drivable-lane_mean0.5600000000000052
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.8024578660913457, "sim_physics": 0.030701596781892597, "survival_time": 5.299999999999989, "driven_lanedir": 0.7928125336696206, "sim_render-ego": 0.053886975882188326, "in-drivable-lane": 0, "agent_compute-ego": 0.08243555392859117, "deviation-heading": 0.6154549109027005, "set_robot_commands": 0.07517484448990731, "deviation-center-line": 0.46705431232259825, "driven_lanedir_consec": 0.7928125336696206, "sim_compute_sim_state": 0.032701078450904704, "sim_compute_performance-ego": 0.05687374213956437, "sim_compute_robot_state-ego": 0.05911520966943705, "sim_compute_robot_state-npc0": 0.06093674785685989, "sim_compute_robot_state-npc1": 0.05879423753270563, "sim_compute_robot_state-npc2": 0.056752661489090826, "sim_compute_robot_state-npc3": 0.0579493540637898}, "udem1-1-0": {"driven_any": 0.2100687594789937, "sim_physics": 0.026714012026786804, "survival_time": 1.6000000000000008, "driven_lanedir": 0.15553543067421716, "sim_render-ego": 0.05109453201293945, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09988494962453842, "deviation-heading": 0.686281068649473, "set_robot_commands": 0.07469300180673599, "deviation-center-line": 0.061484482735035824, "driven_lanedir_consec": 0.15553543067421716, "sim_compute_sim_state": 0.030074067413806915, "sim_compute_performance-ego": 0.05578035116195679, "sim_compute_robot_state-ego": 0.05704943835735321, "sim_compute_robot_state-npc0": 0.06026715785264969, "sim_compute_robot_state-npc1": 0.05553588271141052, "sim_compute_robot_state-npc2": 0.05464760959148407, "sim_compute_robot_state-npc3": 0.05336063355207443}, "udem1-2-0": {"driven_any": 0.5556420301227285, "sim_physics": 0.03112672487894694, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4889045976301556, "sim_render-ego": 0.051865126291910806, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08051202456156413, "deviation-heading": 0.7178167934226656, "set_robot_commands": 0.07338123321533203, "deviation-center-line": 0.2494193891551898, "driven_lanedir_consec": 0.4889045976301556, "sim_compute_sim_state": 0.03129786809285482, "sim_compute_performance-ego": 0.056684172948201494, "sim_compute_robot_state-ego": 0.05729689598083496, "sim_compute_robot_state-npc0": 0.05713977813720703, "sim_compute_robot_state-npc1": 0.05534258842468262, "sim_compute_robot_state-npc2": 0.05578409512837728, "sim_compute_robot_state-npc3": 0.054671192169189455}, "udem1-3-0": {"driven_any": 0.2583086059766794, "sim_physics": 0.06273985536474931, "survival_time": 1.900000000000001, "driven_lanedir": 0.22540980807969113, "sim_render-ego": 0.0794541082884136, "in-drivable-lane": 0, "agent_compute-ego": 0.18203642493800112, "deviation-heading": 0.7281824026055476, "set_robot_commands": 0.10463773576836836, "deviation-center-line": 0.11099666274279454, "driven_lanedir_consec": 0.22540980807969113, "sim_compute_sim_state": 0.04619688736765008, "sim_compute_performance-ego": 0.08150221799549304, "sim_compute_robot_state-ego": 0.0929119022268998, "sim_compute_robot_state-npc0": 0.08220146831713225, "sim_compute_robot_state-npc1": 0.08045024620859247, "sim_compute_robot_state-npc2": 0.07968677345075105, "sim_compute_robot_state-npc3": 0.08207203839954577}, "udem1-4-0": {"driven_any": 1.7931247675942137, "sim_physics": 0.0392562343564096, "survival_time": 11.450000000000028, "driven_lanedir": 1.322879282392715, "sim_render-ego": 0.0645485455292281, "in-drivable-lane": 2.450000000000027, "agent_compute-ego": 0.11939405562055164, "deviation-heading": 2.410473163343411, "set_robot_commands": 0.08955171847447557, "deviation-center-line": 0.8174959711140002, "driven_lanedir_consec": 1.322879282392715, "sim_compute_sim_state": 0.03965831219369147, "sim_compute_performance-ego": 0.06922223682486854, "sim_compute_robot_state-ego": 0.07155061392804941, "sim_compute_robot_state-npc0": 0.07096935463784564, "sim_compute_robot_state-npc1": 0.07025267671809966, "sim_compute_robot_state-npc2": 0.06932447466787812, "sim_compute_robot_state-npc3": 0.06978578338456466}}
set_robot_commands_max0.10463773576836836
set_robot_commands_mean0.08348770675096386
set_robot_commands_median0.07517484448990731
set_robot_commands_min0.07338123321533203
sim_compute_performance-ego_max0.08150221799549304
sim_compute_performance-ego_mean0.06401254421401684
sim_compute_performance-ego_median0.05687374213956437
sim_compute_performance-ego_min0.05578035116195679
sim_compute_robot_state-ego_max0.0929119022268998
sim_compute_robot_state-ego_mean0.06758481203251489
sim_compute_robot_state-ego_median0.05911520966943705
sim_compute_robot_state-ego_min0.05704943835735321
sim_compute_robot_state-npc0_max0.08220146831713225
sim_compute_robot_state-npc0_mean0.06630290136033891
sim_compute_robot_state-npc0_median0.06093674785685989
sim_compute_robot_state-npc0_min0.05713977813720703
sim_compute_robot_state-npc1_max0.08045024620859247
sim_compute_robot_state-npc1_mean0.06407512631909817
sim_compute_robot_state-npc1_median0.05879423753270563
sim_compute_robot_state-npc1_min0.05534258842468262
sim_compute_robot_state-npc2_max0.07968677345075105
sim_compute_robot_state-npc2_mean0.06323912286551628
sim_compute_robot_state-npc2_median0.056752661489090826
sim_compute_robot_state-npc2_min0.05464760959148407
sim_compute_robot_state-npc3_max0.08207203839954577
sim_compute_robot_state-npc3_mean0.06356780031383283
sim_compute_robot_state-npc3_median0.0579493540637898
sim_compute_robot_state-npc3_min0.05336063355207443
sim_compute_sim_state_max0.04619688736765008
sim_compute_sim_state_mean0.035985642703781594
sim_compute_sim_state_median0.032701078450904704
sim_compute_sim_state_min0.030074067413806915
sim_physics_max0.06273985536474931
sim_physics_mean0.038107684681757056
sim_physics_median0.03112672487894694
sim_physics_min0.026714012026786804
sim_render-ego_max0.0794541082884136
sim_render-ego_mean0.06016985760093606
sim_render-ego_median0.053886975882188326
sim_render-ego_min0.05109453201293945
simulation-passed1
survival_time_max11.450000000000028
survival_time_mean4.8000000000000025
survival_time_min1.6000000000000008
No reset possible
193472808Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13239599676693187
agent_compute-ego_mean0.1292149938853151
agent_compute-ego_median0.1287018667976811
agent_compute-ego_min0.1271899753146701
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.024873517594247493, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05629924558243662, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1287018667976811, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07337509911015348, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03171357118858481, "sim_compute_performance-ego": 0.061913292363004864, "sim_compute_robot_state-ego": 0.060454553028322616, "sim_compute_robot_state-npc0": 0.06581592109968078, "sim_compute_robot_state-npc1": 0.059102908620294534, "sim_compute_robot_state-npc2": 0.05947870128559617, "sim_compute_robot_state-npc3": 0.056965985388126014}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.025884059342471035, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.056072874502702194, "in-drivable-lane": 0, "agent_compute-ego": 0.1300876411524686, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.0728271711956371, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03262456980618564, "sim_compute_performance-ego": 0.058581764047796074, "sim_compute_robot_state-ego": 0.061665778810327705, "sim_compute_robot_state-npc0": 0.06394268707795576, "sim_compute_robot_state-npc1": 0.06089574098587036, "sim_compute_robot_state-npc2": 0.061232989484613594, "sim_compute_robot_state-npc3": 0.05791297825899991}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02629291216532389, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.05356705453660753, "in-drivable-lane": 0, "agent_compute-ego": 0.1271899753146701, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07283572620815701, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.033777077992757164, "sim_compute_performance-ego": 0.06008570459153917, "sim_compute_robot_state-ego": 0.06064843071831597, "sim_compute_robot_state-npc0": 0.061477348539564346, "sim_compute_robot_state-npc1": 0.05826074812147353, "sim_compute_robot_state-npc2": 0.06160786416795519, "sim_compute_robot_state-npc3": 0.05952660242716471}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.025533681114514668, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.053359935681025185, "in-drivable-lane": 0, "agent_compute-ego": 0.1276994893948237, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0741492360830307, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.033487568298975624, "sim_compute_performance-ego": 0.058551316459973655, "sim_compute_robot_state-ego": 0.06034082671006521, "sim_compute_robot_state-npc0": 0.06046547989050547, "sim_compute_robot_state-npc1": 0.06049369772275289, "sim_compute_robot_state-npc2": 0.061029632886250816, "sim_compute_robot_state-npc3": 0.061441262563069664}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.025960406836341408, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05570859067580279, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13239599676693187, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07285526219536276, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.034248969134162456, "sim_compute_performance-ego": 0.06033308365765739, "sim_compute_robot_state-ego": 0.05988138914108277, "sim_compute_robot_state-npc0": 0.06229049317977008, "sim_compute_robot_state-npc1": 0.05969319273443783, "sim_compute_robot_state-npc2": 0.06147004926905913, "sim_compute_robot_state-npc3": 0.061410076477948355}}
set_robot_commands_max0.0741492360830307
set_robot_commands_mean0.07320849895846822
set_robot_commands_median0.07285526219536276
set_robot_commands_min0.0728271711956371
sim_compute_performance-ego_max0.061913292363004864
sim_compute_performance-ego_mean0.05989303222399424
sim_compute_performance-ego_median0.06008570459153917
sim_compute_performance-ego_min0.058551316459973655
sim_compute_robot_state-ego_max0.061665778810327705
sim_compute_robot_state-ego_mean0.060598195681622856
sim_compute_robot_state-ego_median0.060454553028322616
sim_compute_robot_state-ego_min0.05988138914108277
sim_compute_robot_state-npc0_max0.06581592109968078
sim_compute_robot_state-npc0_mean0.06279838595749529
sim_compute_robot_state-npc0_median0.06229049317977008
sim_compute_robot_state-npc0_min0.06046547989050547
sim_compute_robot_state-npc1_max0.06089574098587036
sim_compute_robot_state-npc1_mean0.05968925763696583
sim_compute_robot_state-npc1_median0.05969319273443783
sim_compute_robot_state-npc1_min0.05826074812147353
sim_compute_robot_state-npc2_max0.06160786416795519
sim_compute_robot_state-npc2_mean0.06096384741869498
sim_compute_robot_state-npc2_median0.061232989484613594
sim_compute_robot_state-npc2_min0.05947870128559617
sim_compute_robot_state-npc3_max0.061441262563069664
sim_compute_robot_state-npc3_mean0.05945138102306173
sim_compute_robot_state-npc3_median0.05952660242716471
sim_compute_robot_state-npc3_min0.056965985388126014
sim_compute_sim_state_max0.034248969134162456
sim_compute_sim_state_mean0.033170351284133134
sim_compute_sim_state_median0.033487568298975624
sim_compute_sim_state_min0.03171357118858481
sim_physics_max0.02629291216532389
sim_physics_mean0.025708915410579698
sim_physics_median0.025884059342471035
sim_physics_min0.024873517594247493
sim_render-ego_max0.05629924558243662
sim_render-ego_mean0.05500154019571486
sim_render-ego_median0.05570859067580279
sim_render-ego_min0.053359935681025185
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
192992861Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:14:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4859810225669756
survival_time_median7.049999999999983
deviation-center-line_median0.17426736990173092
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.08927338150725968
agent_compute-ego_mean0.08413082261537143
agent_compute-ego_median0.0833220396723066
agent_compute-ego_min0.0796888178967415
deviation-center-line_max0.25019790342318043
deviation-center-line_mean0.16339124489541643
deviation-center-line_min0.08619052063981153
deviation-heading_max2.040125562297356
deviation-heading_mean1.6687227758791956
deviation-heading_median1.632814462929599
deviation-heading_min1.415158341640376
driven_any_max1.176679831743056
driven_any_mean0.6351935225345445
driven_any_median0.5430208237082748
driven_any_min0.326034872298141
driven_lanedir_consec_max0.6189005306864326
driven_lanedir_consec_mean0.4560433452336109
driven_lanedir_consec_min0.2671153515255509
driven_lanedir_max0.6189005306864326
driven_lanedir_mean0.4560433452336109
driven_lanedir_median0.4859810225669756
driven_lanedir_min0.2671153515255509
in-drivable-lane_max7.750000000000095
in-drivable-lane_mean1.6600000000000186
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.176679831743056, "sim_physics": 0.025833771228790284, "survival_time": 14.950000000000076, "driven_lanedir": 0.4859810225669756, "sim_render-ego": 0.05364890416463216, "in-drivable-lane": 7.750000000000095, "agent_compute-ego": 0.08581033229827881, "deviation-heading": 2.040125562297356, "set_robot_commands": 0.07483145236968994, "deviation-center-line": 0.17426736990173092, "driven_lanedir_consec": 0.4859810225669756, "sim_compute_sim_state": 0.03351983626683553, "sim_compute_performance-ego": 0.05907703717549642, "sim_compute_robot_state-ego": 0.06101979811986288, "sim_compute_robot_state-npc0": 0.06203738927841187, "sim_compute_robot_state-npc1": 0.05948402325312296, "sim_compute_robot_state-npc2": 0.05908257007598877, "sim_compute_robot_state-npc3": 0.05989089488983154}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.326034872298141, "sim_physics": 0.03088687206136769, "survival_time": 4.3499999999999925, "driven_lanedir": 0.2671153515255509, "sim_render-ego": 0.05432322655601063, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.08927338150725968, "deviation-heading": 1.5868703988442918, "set_robot_commands": 0.07348061978131876, "deviation-center-line": 0.11748392774218525, "driven_lanedir_consec": 0.2671153515255509, "sim_compute_sim_state": 0.033193486860428736, "sim_compute_performance-ego": 0.05840928801174822, "sim_compute_robot_state-ego": 0.05990292286050731, "sim_compute_robot_state-npc0": 0.06487345695495605, "sim_compute_robot_state-npc1": 0.058400565180285226, "sim_compute_robot_state-npc2": 0.05775143634313824, "sim_compute_robot_state-npc3": 0.058503970332529354}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6515117869338354, "sim_physics": 0.026311821880794707, "survival_time": 8.399999999999984, "driven_lanedir": 0.6189005306864326, "sim_render-ego": 0.05270246522767203, "in-drivable-lane": 0, "agent_compute-ego": 0.0833220396723066, "deviation-heading": 1.632814462929599, "set_robot_commands": 0.07354648766063508, "deviation-center-line": 0.25019790342318043, "driven_lanedir_consec": 0.6189005306864326, "sim_compute_sim_state": 0.032537265902473814, "sim_compute_performance-ego": 0.05647909925097511, "sim_compute_robot_state-ego": 0.05840747838928586, "sim_compute_robot_state-npc0": 0.06061296519779023, "sim_compute_robot_state-npc1": 0.05892115263711838, "sim_compute_robot_state-npc2": 0.05706012390908741, "sim_compute_robot_state-npc3": 0.056719198113396055}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.47872029798941546, "sim_physics": 0.027160001754760743, "survival_time": 6.249999999999986, "driven_lanedir": 0.4041798365370513, "sim_render-ego": 0.05318840980529785, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0825595417022705, "deviation-heading": 1.415158341640376, "set_robot_commands": 0.07244341468811036, "deviation-center-line": 0.08619052063981153, "driven_lanedir_consec": 0.4041798365370513, "sim_compute_sim_state": 0.033066534042358396, "sim_compute_performance-ego": 0.06001057815551758, "sim_compute_robot_state-ego": 0.058784074783325195, "sim_compute_robot_state-npc0": 0.06156061172485352, "sim_compute_robot_state-npc1": 0.05889935684204101, "sim_compute_robot_state-npc2": 0.05691688346862793, "sim_compute_robot_state-npc3": 0.0582545223236084}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5430208237082748, "sim_physics": 0.026050303844695397, "survival_time": 7.049999999999983, "driven_lanedir": 0.5040399848520439, "sim_render-ego": 0.05330480244142789, "in-drivable-lane": 0, "agent_compute-ego": 0.0796888178967415, "deviation-heading": 1.6686451136843543, "set_robot_commands": 0.07068343703628432, "deviation-center-line": 0.18881650277017423, "driven_lanedir_consec": 0.5040399848520439, "sim_compute_sim_state": 0.0328058604653, "sim_compute_performance-ego": 0.058831661305529005, "sim_compute_robot_state-ego": 0.05997629875832416, "sim_compute_robot_state-npc0": 0.05914426019005742, "sim_compute_robot_state-npc1": 0.058139476370304186, "sim_compute_robot_state-npc2": 0.05691138734208777, "sim_compute_robot_state-npc3": 0.057878172989432694}}
set_robot_commands_max0.07483145236968994
set_robot_commands_mean0.0729970823072077
set_robot_commands_median0.07348061978131876
set_robot_commands_min0.07068343703628432
sim_compute_performance-ego_max0.06001057815551758
sim_compute_performance-ego_mean0.058561532779853265
sim_compute_performance-ego_median0.058831661305529005
sim_compute_performance-ego_min0.05647909925097511
sim_compute_robot_state-ego_max0.06101979811986288
sim_compute_robot_state-ego_mean0.059618114582261086
sim_compute_robot_state-ego_median0.05990292286050731
sim_compute_robot_state-ego_min0.05840747838928586
sim_compute_robot_state-npc0_max0.06487345695495605
sim_compute_robot_state-npc0_mean0.06164573666921382
sim_compute_robot_state-npc0_median0.06156061172485352
sim_compute_robot_state-npc0_min0.05914426019005742
sim_compute_robot_state-npc1_max0.05948402325312296
sim_compute_robot_state-npc1_mean0.05876891485657435
sim_compute_robot_state-npc1_median0.05889935684204101
sim_compute_robot_state-npc1_min0.058139476370304186
sim_compute_robot_state-npc2_max0.05908257007598877
sim_compute_robot_state-npc2_mean0.057544480227786035
sim_compute_robot_state-npc2_median0.05706012390908741
sim_compute_robot_state-npc2_min0.05691138734208777
sim_compute_robot_state-npc3_max0.05989089488983154
sim_compute_robot_state-npc3_mean0.05824935172975961
sim_compute_robot_state-npc3_median0.0582545223236084
sim_compute_robot_state-npc3_min0.056719198113396055
sim_compute_sim_state_max0.03351983626683553
sim_compute_sim_state_mean0.033024596707479294
sim_compute_sim_state_median0.033066534042358396
sim_compute_sim_state_min0.032537265902473814
sim_physics_max0.03088687206136769
sim_physics_mean0.02724855415408177
sim_physics_median0.026311821880794707
sim_physics_min0.025833771228790284
sim_render-ego_max0.05432322655601063
sim_render-ego_mean0.05343356163900811
sim_render-ego_median0.05330480244142789
sim_render-ego_min0.05270246522767203
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.200000000000005
survival_time_min4.3499999999999925
No reset possible
192702904Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-342170:18:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2418927466699294
survival_time_median9.299999999999995
deviation-center-line_median0.10702705399014605
in-drivable-lane_median1.6500000000000163


other stats
agent_compute-ego_max0.18743353605270385
agent_compute-ego_mean0.18522608835095905
agent_compute-ego_median0.18581315248954197
agent_compute-ego_min0.1812531973726006
deviation-center-line_max0.342758273107372
deviation-center-line_mean0.1505188249015432
deviation-center-line_min0.092501557680396
deviation-heading_max0.7831593945283434
deviation-heading_mean0.73426696700686
deviation-heading_median0.7645803213458144
deviation-heading_min0.6086052377516767
driven_any_max2.560662075893744
driven_any_mean1.6539534807080885
driven_any_median1.5735900983706534
driven_any_min0.9883350328679807
driven_lanedir_consec_max2.46769443171937
driven_lanedir_consec_mean1.370362792351512
driven_lanedir_consec_min0.6580748208119136
driven_lanedir_max2.46769443171937
driven_lanedir_mean1.370362792351512
driven_lanedir_median1.2418927466699294
driven_lanedir_min0.6580748208119136
in-drivable-lane_max1.6500000000000163
in-drivable-lane_mean1.41000000000001
in-drivable-lane_min0.4500000000000064
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9883350328679807, "sim_physics": 0.030353792575227113, "survival_time": 5.949999999999987, "driven_lanedir": 0.6580748208119136, "sim_render-ego": 0.05415264698637634, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.18581315248954197, "deviation-heading": 0.7346835622542522, "set_robot_commands": 0.07555976034212514, "deviation-center-line": 0.092501557680396, "driven_lanedir_consec": 0.6580748208119136, "sim_compute_sim_state": 0.03538288589285201, "sim_compute_performance-ego": 0.060296972258752135, "sim_compute_robot_state-ego": 0.06312264113866982, "sim_compute_robot_state-npc0": 0.06546752593096565, "sim_compute_robot_state-npc1": 0.06114726307011452, "sim_compute_robot_state-npc2": 0.06225133543254949, "sim_compute_robot_state-npc3": 0.06279155987651408}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.560662075893744, "sim_physics": 0.027641959190368652, "survival_time": 14.950000000000076, "driven_lanedir": 2.46769443171937, "sim_render-ego": 0.05551047404607137, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.18743353605270385, "deviation-heading": 0.6086052377516767, "set_robot_commands": 0.07606137196222941, "deviation-center-line": 0.342758273107372, "driven_lanedir_consec": 2.46769443171937, "sim_compute_sim_state": 0.034064566294352214, "sim_compute_performance-ego": 0.059090463320414226, "sim_compute_robot_state-ego": 0.060975584189097085, "sim_compute_robot_state-npc0": 0.06491033951441447, "sim_compute_robot_state-npc1": 0.06121379216512044, "sim_compute_robot_state-npc2": 0.05990694284439087, "sim_compute_robot_state-npc3": 0.0603008508682251}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5735900988605254, "sim_physics": 0.02737791948421027, "survival_time": 9.299999999999995, "driven_lanedir": 1.242323709475225, "sim_render-ego": 0.05533096226312781, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.1852261738110614, "deviation-heading": 0.7645803213458144, "set_robot_commands": 0.07492397677513861, "deviation-center-line": 0.10222630999251318, "driven_lanedir_consec": 1.242323709475225, "sim_compute_sim_state": 0.036329589864259125, "sim_compute_performance-ego": 0.059750901755466254, "sim_compute_robot_state-ego": 0.0615372593684863, "sim_compute_robot_state-npc0": 0.06472243288511871, "sim_compute_robot_state-npc1": 0.05932876115204186, "sim_compute_robot_state-npc2": 0.05953654166190855, "sim_compute_robot_state-npc3": 0.059589828214337746}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5735900983706534, "sim_physics": 0.027005137935761484, "survival_time": 9.299999999999995, "driven_lanedir": 1.2418927466699294, "sim_render-ego": 0.055439782399003226, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.1812531973726006, "deviation-heading": 0.7803063191542136, "set_robot_commands": 0.07501355166076332, "deviation-center-line": 0.10702705399014605, "driven_lanedir_consec": 1.2418927466699294, "sim_compute_sim_state": 0.03331184387207031, "sim_compute_performance-ego": 0.05889042346708236, "sim_compute_robot_state-ego": 0.059969227801087086, "sim_compute_robot_state-npc0": 0.06288767630054105, "sim_compute_robot_state-npc1": 0.06148390231593963, "sim_compute_robot_state-npc2": 0.05995522135047503, "sim_compute_robot_state-npc3": 0.0598674512678577}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5735900975475388, "sim_physics": 0.027177742732468473, "survival_time": 9.299999999999995, "driven_lanedir": 1.241828253081121, "sim_render-ego": 0.055003384108184485, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.18640438202888737, "deviation-heading": 0.7831593945283434, "set_robot_commands": 0.07620967588117046, "deviation-center-line": 0.1080809297372889, "driven_lanedir_consec": 1.241828253081121, "sim_compute_sim_state": 0.03455239470287036, "sim_compute_performance-ego": 0.05997260667944467, "sim_compute_robot_state-ego": 0.06077103076442596, "sim_compute_robot_state-npc0": 0.06579431154394663, "sim_compute_robot_state-npc1": 0.06123270783373105, "sim_compute_robot_state-npc2": 0.060261253387697285, "sim_compute_robot_state-npc3": 0.0606121491360408}}
set_robot_commands_max0.07620967588117046
set_robot_commands_mean0.0755536673242854
set_robot_commands_median0.07555976034212514
set_robot_commands_min0.07492397677513861
sim_compute_performance-ego_max0.060296972258752135
sim_compute_performance-ego_mean0.05960027349623194
sim_compute_performance-ego_median0.059750901755466254
sim_compute_performance-ego_min0.05889042346708236
sim_compute_robot_state-ego_max0.06312264113866982
sim_compute_robot_state-ego_mean0.06127514865235325
sim_compute_robot_state-ego_median0.060975584189097085
sim_compute_robot_state-ego_min0.059969227801087086
sim_compute_robot_state-npc0_max0.06579431154394663
sim_compute_robot_state-npc0_mean0.0647564572349973
sim_compute_robot_state-npc0_median0.06491033951441447
sim_compute_robot_state-npc0_min0.06288767630054105
sim_compute_robot_state-npc1_max0.06148390231593963
sim_compute_robot_state-npc1_mean0.060881285307389496
sim_compute_robot_state-npc1_median0.06121379216512044
sim_compute_robot_state-npc1_min0.05932876115204186
sim_compute_robot_state-npc2_max0.06225133543254949
sim_compute_robot_state-npc2_mean0.06038225893540424
sim_compute_robot_state-npc2_median0.05995522135047503
sim_compute_robot_state-npc2_min0.05953654166190855
sim_compute_robot_state-npc3_max0.06279155987651408
sim_compute_robot_state-npc3_mean0.060632367872595086
sim_compute_robot_state-npc3_median0.0603008508682251
sim_compute_robot_state-npc3_min0.059589828214337746
sim_compute_sim_state_max0.036329589864259125
sim_compute_sim_state_mean0.034728256125280806
sim_compute_sim_state_median0.03455239470287036
sim_compute_sim_state_min0.03331184387207031
sim_physics_max0.030353792575227113
sim_physics_mean0.027911310383607196
sim_physics_median0.02737791948421027
sim_physics_min0.027005137935761484
sim_render-ego_max0.05551047404607137
sim_render-ego_mean0.05508744996055265
sim_render-ego_median0.05533096226312781
sim_render-ego_min0.05415264698637634
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.76000000000001
survival_time_min5.949999999999987
No reset possible
192552948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-342170:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.14589703623790085
survival_time_median1.3500000000000003
deviation-center-line_median0.06185882086381747
in-drivable-lane_median0


other stats
agent_compute-ego_max0.4367453410075261
agent_compute-ego_mean0.4211987688427879
agent_compute-ego_median0.4302873346540663
agent_compute-ego_min0.3765024588658259
deviation-center-line_max0.06519734454592505
deviation-center-line_mean0.06191605945285415
deviation-center-line_min0.05855458373648231
deviation-heading_max0.6501588819097284
deviation-heading_mean0.6340939725981807
deviation-heading_median0.6439278475665279
deviation-heading_min0.6084523727596898
driven_any_max0.21682273583798217
driven_any_mean0.19712412369654425
driven_any_median0.1902234532099736
driven_any_min0.18001120653487984
driven_lanedir_consec_max0.16955904227791274
driven_lanedir_consec_mean0.14976235586831868
driven_lanedir_consec_min0.1320015023164376
driven_lanedir_max0.16955904227791274
driven_lanedir_mean0.14976235586831868
driven_lanedir_median0.14589703623790085
driven_lanedir_min0.1320015023164376
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20844306090907477, "sim_physics": 0.02854985660976834, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1644671217790643, "sim_render-ego": 0.05991972817314996, "in-drivable-lane": 0, "agent_compute-ego": 0.4302873346540663, "deviation-heading": 0.6084523727596898, "set_robot_commands": 0.07763851130450214, "deviation-center-line": 0.06519734454592505, "driven_lanedir_consec": 0.1644671217790643, "sim_compute_sim_state": 0.03425349129570855, "sim_compute_performance-ego": 0.05979062892772533, "sim_compute_robot_state-ego": 0.0608668327331543, "sim_compute_robot_state-npc0": 0.06315796463577836, "sim_compute_robot_state-npc1": 0.06211257863927771, "sim_compute_robot_state-npc2": 0.06084983437149613, "sim_compute_robot_state-npc3": 0.06018722498858416}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1902234532099736, "sim_physics": 0.02971009854917173, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14589703623790085, "sim_render-ego": 0.053771645934493455, "in-drivable-lane": 0, "agent_compute-ego": 0.42946015463935006, "deviation-heading": 0.6464074228863094, "set_robot_commands": 0.07868944274054633, "deviation-center-line": 0.06185882086381747, "driven_lanedir_consec": 0.14589703623790085, "sim_compute_sim_state": 0.03636227713690864, "sim_compute_performance-ego": 0.06019228476065176, "sim_compute_robot_state-ego": 0.06344635398299606, "sim_compute_robot_state-npc0": 0.06437932120429145, "sim_compute_robot_state-npc1": 0.0614273018307156, "sim_compute_robot_state-npc2": 0.0626220526518645, "sim_compute_robot_state-npc3": 0.0633234977722168}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19012016199081097, "sim_physics": 0.031934463060819186, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1368870767302779, "sim_render-ego": 0.05585153286273663, "in-drivable-lane": 0, "agent_compute-ego": 0.4367453410075261, "deviation-heading": 0.6501588819097284, "set_robot_commands": 0.0728991490143996, "deviation-center-line": 0.058808633419945334, "driven_lanedir_consec": 0.1368870767302779, "sim_compute_sim_state": 0.035269636374253496, "sim_compute_performance-ego": 0.06244216515467717, "sim_compute_robot_state-ego": 0.06299763459425706, "sim_compute_robot_state-npc0": 0.06712597150069016, "sim_compute_robot_state-npc1": 0.062038577519930325, "sim_compute_robot_state-npc2": 0.06226526773892916, "sim_compute_robot_state-npc3": 0.06200766563415527}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21682273583798217, "sim_physics": 0.034293336527688165, "survival_time": 1.4000000000000006, "driven_lanedir": 0.16955904227791274, "sim_render-ego": 0.05531763178961618, "in-drivable-lane": 0, "agent_compute-ego": 0.43299855504717144, "deviation-heading": 0.621523337868648, "set_robot_commands": 0.07256175790514265, "deviation-center-line": 0.06516091469810065, "driven_lanedir_consec": 0.16955904227791274, "sim_compute_sim_state": 0.035209877150399346, "sim_compute_performance-ego": 0.060613581112452915, "sim_compute_robot_state-ego": 0.0642571108681815, "sim_compute_robot_state-npc0": 0.06344062089920044, "sim_compute_robot_state-npc1": 0.06384835072926112, "sim_compute_robot_state-npc2": 0.06188276835850307, "sim_compute_robot_state-npc3": 0.05807033606937954}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18001120653487984, "sim_physics": 0.02758639592390794, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1320015023164376, "sim_render-ego": 0.055975024516765885, "in-drivable-lane": 0, "agent_compute-ego": 0.3765024588658259, "deviation-heading": 0.6439278475665279, "set_robot_commands": 0.07239993718954232, "deviation-center-line": 0.05855458373648231, "driven_lanedir_consec": 0.1320015023164376, "sim_compute_sim_state": 0.03476705917945275, "sim_compute_performance-ego": 0.06265362409444955, "sim_compute_robot_state-ego": 0.060051752970768854, "sim_compute_robot_state-npc0": 0.06526259275583121, "sim_compute_robot_state-npc1": 0.06310896690075214, "sim_compute_robot_state-npc2": 0.061717721132131725, "sim_compute_robot_state-npc3": 0.060692897209754355}}
set_robot_commands_max0.07868944274054633
set_robot_commands_mean0.07483775963082659
set_robot_commands_median0.0728991490143996
set_robot_commands_min0.07239993718954232
sim_compute_performance-ego_max0.06265362409444955
sim_compute_performance-ego_mean0.061138456809991346
sim_compute_performance-ego_median0.060613581112452915
sim_compute_performance-ego_min0.05979062892772533
sim_compute_robot_state-ego_max0.0642571108681815
sim_compute_robot_state-ego_mean0.06232393702987156
sim_compute_robot_state-ego_median0.06299763459425706
sim_compute_robot_state-ego_min0.060051752970768854
sim_compute_robot_state-npc0_max0.06712597150069016
sim_compute_robot_state-npc0_mean0.06467329419915832
sim_compute_robot_state-npc0_median0.06437932120429145
sim_compute_robot_state-npc0_min0.06315796463577836
sim_compute_robot_state-npc1_max0.06384835072926112
sim_compute_robot_state-npc1_mean0.06250715512398738
sim_compute_robot_state-npc1_median0.06211257863927771
sim_compute_robot_state-npc1_min0.0614273018307156
sim_compute_robot_state-npc2_max0.0626220526518645
sim_compute_robot_state-npc2_mean0.06186752885058492
sim_compute_robot_state-npc2_median0.06188276835850307
sim_compute_robot_state-npc2_min0.06084983437149613
sim_compute_robot_state-npc3_max0.0633234977722168
sim_compute_robot_state-npc3_mean0.060856324334818024
sim_compute_robot_state-npc3_median0.060692897209754355
sim_compute_robot_state-npc3_min0.05807033606937954
sim_compute_sim_state_max0.03636227713690864
sim_compute_sim_state_mean0.03517246822734456
sim_compute_sim_state_median0.035209877150399346
sim_compute_sim_state_min0.03425349129570855
sim_physics_max0.034293336527688165
sim_physics_mean0.030414830134271077
sim_physics_median0.02971009854917173
sim_physics_min0.02758639592390794
sim_render-ego_max0.05991972817314996
sim_render-ego_mean0.05616711265535242
sim_render-ego_median0.05585153286273663
sim_render-ego_min0.053771645934493455
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3400000000000003
survival_time_min1.3000000000000005
No reset possible