Duckietown Challenges Home Challenges Submissions

Evaluator 749

ID749
evaluatoridsc-rudolf-210821
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-210821
versiond-c:4.0.18;d-c-r:4.0.27;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success28 18070
# timeout
# failed3 18194
# error25 18144
# aborted
# host-error1 18574
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
186022836Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
185942856Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4928252223994596
survival_time_median7.149999999999983
deviation-center-line_median0.14342192020644903
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.07881213511739459
agent_compute-ego_mean0.07640296734242422
agent_compute-ego_median0.07594614108403523
agent_compute-ego_min0.07482530969254514
deviation-center-line_max0.2485712262207139
deviation-center-line_mean0.15987049452323904
deviation-center-line_min0.10537536168827034
deviation-heading_max1.800877921129074
deviation-heading_mean1.6295122117143437
deviation-heading_median1.595705043861163
deviation-heading_min1.532153803028544
driven_any_max1.176689375271906
driven_any_mean0.6078724170126785
driven_any_median0.5510519980911697
driven_any_min0.30594183153044874
driven_lanedir_consec_max0.6211161930827171
driven_lanedir_consec_mean0.43341248643950137
driven_lanedir_consec_min0.23551348664471072
driven_lanedir_max0.6211161930827171
driven_lanedir_mean0.43341248643950137
driven_lanedir_median0.4928252223994596
driven_lanedir_min0.23551348664471072
in-drivable-lane_max7.700000000000095
in-drivable-lane_mean1.6200000000000188
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.176689375271906, "sim_physics": 0.01361286719640096, "survival_time": 14.950000000000076, "driven_lanedir": 0.5036440097238764, "sim_render-ego": 0.04958120425542196, "in-drivable-lane": 7.700000000000095, "agent_compute-ego": 0.07594614108403523, "deviation-heading": 1.684381835088704, "set_robot_commands": 0.07156072060267131, "deviation-center-line": 0.13131842938195756, "driven_lanedir_consec": 0.5036440097238764, "sim_compute_sim_state": 0.03042940060297648, "sim_compute_performance-ego": 0.05142688194910685, "sim_compute_robot_state-ego": 0.05302211046218872}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.30594183153044874, "sim_physics": 0.014653249484736746, "survival_time": 4.099999999999993, "driven_lanedir": 0.23551348664471072, "sim_render-ego": 0.048391516615704795, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07541371845617527, "deviation-heading": 1.532153803028544, "set_robot_commands": 0.07045706307015769, "deviation-center-line": 0.10537536168827034, "driven_lanedir_consec": 0.23551348664471072, "sim_compute_sim_state": 0.03010151735166224, "sim_compute_performance-ego": 0.05096041574710753, "sim_compute_robot_state-ego": 0.05384235556532697}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.35416643568920503, "sim_physics": 0.014938019691629612, "survival_time": 4.699999999999991, "driven_lanedir": 0.3139635203467428, "sim_render-ego": 0.04990254057214615, "in-drivable-lane": 0, "agent_compute-ego": 0.07482530969254514, "deviation-heading": 1.5344424554642315, "set_robot_commands": 0.07271070175982536, "deviation-center-line": 0.1706655351188043, "driven_lanedir_consec": 0.3139635203467428, "sim_compute_sim_state": 0.03239239023086873, "sim_compute_performance-ego": 0.051497251429456346, "sim_compute_robot_state-ego": 0.05460149683850877}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6515124444806634, "sim_physics": 0.015060146649678549, "survival_time": 8.399999999999984, "driven_lanedir": 0.6211161930827171, "sim_render-ego": 0.04984936969620841, "in-drivable-lane": 0, "agent_compute-ego": 0.07881213511739459, "deviation-heading": 1.595705043861163, "set_robot_commands": 0.07149559117498852, "deviation-center-line": 0.2485712262207139, "driven_lanedir_consec": 0.6211161930827171, "sim_compute_sim_state": 0.03156145271800813, "sim_compute_performance-ego": 0.05202872980208624, "sim_compute_robot_state-ego": 0.05389543374379476}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5510519980911697, "sim_physics": 0.01446304954848923, "survival_time": 7.149999999999983, "driven_lanedir": 0.4928252223994596, "sim_render-ego": 0.04993488405134294, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.07701753236197091, "deviation-heading": 1.800877921129074, "set_robot_commands": 0.07166872157917156, "deviation-center-line": 0.14342192020644903, "driven_lanedir_consec": 0.4928252223994596, "sim_compute_sim_state": 0.03166843127537441, "sim_compute_performance-ego": 0.05181192684840489, "sim_compute_robot_state-ego": 0.05249261189173985}}
set_robot_commands_max0.07271070175982536
set_robot_commands_mean0.07157855963736288
set_robot_commands_median0.07156072060267131
set_robot_commands_min0.07045706307015769
sim_compute_performance-ego_max0.05202872980208624
sim_compute_performance-ego_mean0.051545041155232375
sim_compute_performance-ego_median0.051497251429456346
sim_compute_performance-ego_min0.05096041574710753
sim_compute_robot_state-ego_max0.05460149683850877
sim_compute_robot_state-ego_mean0.053570801700311824
sim_compute_robot_state-ego_median0.05384235556532697
sim_compute_robot_state-ego_min0.05249261189173985
sim_compute_sim_state_max0.03239239023086873
sim_compute_sim_state_mean0.031230638435777995
sim_compute_sim_state_median0.03156145271800813
sim_compute_sim_state_min0.03010151735166224
sim_physics_max0.015060146649678549
sim_physics_mean0.01454546651418702
sim_physics_median0.014653249484736746
sim_physics_min0.01361286719640096
sim_render-ego_max0.04993488405134294
sim_render-ego_mean0.04953190303816485
sim_render-ego_median0.04984936969620841
sim_render-ego_min0.048391516615704795
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.8600000000000065
survival_time_min4.099999999999993
No reset possible
185852867Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-2108210:06:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7216076169235373
survival_time_median2.549999999999999
deviation-center-line_median0.05101667077305426
in-drivable-lane_median0.7500000000000006


other stats
agent_compute-ego_max0.25220279340390805
agent_compute-ego_mean0.23897557108915543
agent_compute-ego_median0.24050357847502735
agent_compute-ego_min0.2217255573646695
deviation-center-line_max0.23008479216318772
deviation-center-line_mean0.09084087146143038
deviation-center-line_min0.03894113602189589
deviation-heading_max1.4724874964924817
deviation-heading_mean0.5473245169258643
deviation-heading_median0.2407705366366487
deviation-heading_min0.18742177370019453
driven_any_max2.3858219921159365
driven_any_mean1.3166022133550157
driven_any_median1.113483090510704
driven_any_min0.6754668627297741
driven_lanedir_consec_max1.6306012044276452
driven_lanedir_consec_mean0.8112112307580247
driven_lanedir_consec_min0.29947623126654443
driven_lanedir_max1.892160313120039
driven_lanedir_mean0.8665903086651301
driven_lanedir_median0.7216076169235373
driven_lanedir_min0.29947623126654443
in-drivable-lane_max1.1499999999999977
in-drivable-lane_mean0.7599999999999988
in-drivable-lane_min0.549999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.113483090510704, "sim_physics": 0.0149382048962163, "survival_time": 2.549999999999999, "driven_lanedir": 0.6363814996472956, "sim_render-ego": 0.054099746778899546, "in-drivable-lane": 0.7999999999999983, "agent_compute-ego": 0.23895802217371323, "deviation-heading": 0.6415828670819343, "set_robot_commands": 0.06925522579866297, "deviation-center-line": 0.05101667077305426, "driven_lanedir_consec": 0.6210452188041624, "sim_compute_sim_state": 0.033039761524574426, "sim_compute_performance-ego": 0.053802625805723904, "sim_compute_robot_state-ego": 0.05499873441808364}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0554149493686618, "sim_physics": 0.015048931945453993, "survival_time": 2.2, "driven_lanedir": 0.7833258823682342, "sim_render-ego": 0.05534998937086626, "in-drivable-lane": 0.5499999999999994, "agent_compute-ego": 0.24148790402845904, "deviation-heading": 0.18742177370019453, "set_robot_commands": 0.07355457544326782, "deviation-center-line": 0.03894113602189589, "driven_lanedir_consec": 0.7833258823682342, "sim_compute_sim_state": 0.03413015062158758, "sim_compute_performance-ego": 0.05388875982978127, "sim_compute_robot_state-ego": 0.056926174597306686}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3858219921159365, "sim_physics": 0.016228795051574707, "survival_time": 5.09999999999999, "driven_lanedir": 1.892160313120039, "sim_render-ego": 0.05494094128702201, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.2217255573646695, "deviation-heading": 1.4724874964924817, "set_robot_commands": 0.07362010432224647, "deviation-center-line": 0.23008479216318772, "driven_lanedir_consec": 1.6306012044276452, "sim_compute_sim_state": 0.03345644707773246, "sim_compute_performance-ego": 0.056760577594532687, "sim_compute_robot_state-ego": 0.06038543757270364}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6754668627297741, "sim_physics": 0.01471976800398393, "survival_time": 1.6500000000000008, "driven_lanedir": 0.29947623126654443, "sim_render-ego": 0.051450151385683, "in-drivable-lane": 0.7500000000000006, "agent_compute-ego": 0.24050357847502735, "deviation-heading": 0.2407705366366487, "set_robot_commands": 0.07168678081396854, "deviation-center-line": 0.04864138277729165, "driven_lanedir_consec": 0.29947623126654443, "sim_compute_sim_state": 0.03346798636696555, "sim_compute_performance-ego": 0.05427971030726577, "sim_compute_robot_state-ego": 0.058259711121067856}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3528241720500018, "sim_physics": 0.015632324748569064, "survival_time": 2.6999999999999984, "driven_lanedir": 0.7216076169235373, "sim_render-ego": 0.05363150437672933, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.25220279340390805, "deviation-heading": 0.19435991071806177, "set_robot_commands": 0.0703812042872111, "deviation-center-line": 0.08552037557172242, "driven_lanedir_consec": 0.7216076169235373, "sim_compute_sim_state": 0.033449014027913414, "sim_compute_performance-ego": 0.05514878696865506, "sim_compute_robot_state-ego": 0.05547786642003943}}
set_robot_commands_max0.07362010432224647
set_robot_commands_mean0.07169957813307139
set_robot_commands_median0.07168678081396854
set_robot_commands_min0.06925522579866297
sim_compute_performance-ego_max0.056760577594532687
sim_compute_performance-ego_mean0.05477609210119174
sim_compute_performance-ego_median0.05427971030726577
sim_compute_performance-ego_min0.053802625805723904
sim_compute_robot_state-ego_max0.06038543757270364
sim_compute_robot_state-ego_mean0.05720958482584025
sim_compute_robot_state-ego_median0.056926174597306686
sim_compute_robot_state-ego_min0.05499873441808364
sim_compute_sim_state_max0.03413015062158758
sim_compute_sim_state_mean0.03350867192375469
sim_compute_sim_state_median0.03345644707773246
sim_compute_sim_state_min0.033039761524574426
sim_physics_max0.016228795051574707
sim_physics_mean0.015313604929159596
sim_physics_median0.015048931945453993
sim_physics_min0.01471976800398393
sim_render-ego_max0.05534998937086626
sim_render-ego_mean0.05389446663984002
sim_render-ego_median0.054099746778899546
sim_render-ego_min0.051450151385683
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.8399999999999976
survival_time_min1.6500000000000008
No reset possible
185742857Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationhost-errornoidsc-rudolf-2108210:05:03
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 691, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/4842f3e325250fd6fe04671eb601cfe2ab3998442f145a3f29f2fbbabac4951b/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
185622860Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:21:21
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
185522370Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-2108210:14:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225306900765771
survival_time_median10.750000000000018
deviation-center-line_median0.40864173779456053
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.14520300759209526
agent_compute-ego_mean0.14298032693070437
agent_compute-ego_median0.1442105348720107
agent_compute-ego_min0.13882071954490494
deviation-center-line_max0.6491801892887803
deviation-center-line_mean0.3683230725655418
deviation-center-line_min0.1475671628461062
deviation-heading_max2.2060076411946548
deviation-heading_mean1.4163758252990906
deviation-heading_median1.5250264276913703
deviation-heading_min0.6970592634293067
driven_any_max1.6057043265958648
driven_any_mean1.3484469345214642
driven_any_median1.5756972277649912
driven_any_min0.9900494571900692
driven_lanedir_consec_max1.4904214722299334
driven_lanedir_consec_mean1.0721437270256324
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.4904214722299334
driven_lanedir_mean1.0721437270256324
driven_lanedir_median1.225306900765771
driven_lanedir_min0.6474115509746436
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.4300000000000082
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.01662407333044697, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.06219890992418468, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14169106037496662, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.07711483763276245, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.038692500093858016, "sim_compute_performance-ego": 0.06160461302283857, "sim_compute_robot_state-ego": 0.062394166164260974}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.0167812779001946, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.0593242227596088, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.13882071954490494, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.07588423429614435, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.03957030198869914, "sim_compute_performance-ego": 0.06056142549445159, "sim_compute_robot_state-ego": 0.06313715711997374}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.017005296031455824, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.0635779149863752, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.14497631226954438, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.07819429748261456, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.04063358007525115, "sim_compute_performance-ego": 0.06548723725460036, "sim_compute_robot_state-ego": 0.06487864336090772}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.015977204123208688, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.060645511538483375, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.1442105348720107, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.07848628620768702, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.039040790602218274, "sim_compute_performance-ego": 0.06180128496746684, "sim_compute_robot_state-ego": 0.06352556139923805}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.01664390166600545, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.062455092315320614, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.14520300759209526, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.07779024596567508, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.03979609189210115, "sim_compute_performance-ego": 0.0634422136677636, "sim_compute_robot_state-ego": 0.06365844386595267}}
set_robot_commands_max0.07848628620768702
set_robot_commands_mean0.0774939803169767
set_robot_commands_median0.07779024596567508
set_robot_commands_min0.07588423429614435
sim_compute_performance-ego_max0.06548723725460036
sim_compute_performance-ego_mean0.06257935488142419
sim_compute_performance-ego_median0.06180128496746684
sim_compute_performance-ego_min0.06056142549445159
sim_compute_robot_state-ego_max0.06487864336090772
sim_compute_robot_state-ego_mean0.06351879438206662
sim_compute_robot_state-ego_median0.06352556139923805
sim_compute_robot_state-ego_min0.062394166164260974
sim_compute_sim_state_max0.04063358007525115
sim_compute_sim_state_mean0.039546652930425544
sim_compute_sim_state_median0.03957030198869914
sim_compute_sim_state_min0.038692500093858016
sim_physics_max0.017005296031455824
sim_physics_mean0.01660635061026231
sim_physics_median0.01664390166600545
sim_physics_min0.015977204123208688
sim_render-ego_max0.0635779149863752
sim_render-ego_mean0.06164033030479453
sim_render-ego_median0.06219890992418468
sim_render-ego_min0.0593242227596088
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean9.300000000000004
survival_time_min6.849999999999984
No reset possible
185482399Liam Paull 🇨🇦random_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:11:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.13417179787412603
agent_compute-ego_mean0.1265430019549742
agent_compute-ego_median0.12410335002406953
agent_compute-ego_min0.12142212718140843
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03057296692378937, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06007630106002566, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.123058591570173, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07617349094814724, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.032861864756024074, "sim_compute_performance-ego": 0.05893239899287148, "sim_compute_robot_state-ego": 0.06073313667660668, "sim_compute_robot_state-npc0": 0.06462284875294519, "sim_compute_robot_state-npc1": 0.058459399238465326, "sim_compute_robot_state-npc2": 0.05754428439670139, "sim_compute_robot_state-npc3": 0.05767184212094262}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.02606933724646475, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05782995037004059, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.12142212718140843, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07482180875890396, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.032596980824190026, "sim_compute_performance-ego": 0.05760886622410195, "sim_compute_robot_state-ego": 0.05800142007715562, "sim_compute_robot_state-npc0": 0.06804979548734777, "sim_compute_robot_state-npc1": 0.060984475939881565, "sim_compute_robot_state-npc2": 0.05786017343109729, "sim_compute_robot_state-npc3": 0.05762636427785836}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03086082012422623, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06256317707800096, "in-drivable-lane": 0, "agent_compute-ego": 0.12410335002406953, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07797321581071423, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03444029438880182, "sim_compute_performance-ego": 0.05930910187382852, "sim_compute_robot_state-ego": 0.06054883233962521, "sim_compute_robot_state-npc0": 0.06909951856059413, "sim_compute_robot_state-npc1": 0.06333636853002733, "sim_compute_robot_state-npc2": 0.06176609377707205, "sim_compute_robot_state-npc3": 0.062431789213611234}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.030719247270137705, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06462108327987347, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13417179787412603, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07887877809240464, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03626229154302719, "sim_compute_performance-ego": 0.06180280573824619, "sim_compute_robot_state-ego": 0.06283920115612923, "sim_compute_robot_state-npc0": 0.07289909048283354, "sim_compute_robot_state-npc1": 0.06452602021237637, "sim_compute_robot_state-npc2": 0.06324694258101443, "sim_compute_robot_state-npc3": 0.06495005019167636}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02663720571077787, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05853864321341881, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1299591431250939, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07604789275389451, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03259278260744535, "sim_compute_performance-ego": 0.05916704581334041, "sim_compute_robot_state-ego": 0.06294365571095394, "sim_compute_robot_state-npc0": 0.06628196056072529, "sim_compute_robot_state-npc1": 0.060227815921490006, "sim_compute_robot_state-npc2": 0.05900439849266639, "sim_compute_robot_state-npc3": 0.057373046875}}
set_robot_commands_max0.07887877809240464
set_robot_commands_mean0.0767790372728129
set_robot_commands_median0.07617349094814724
set_robot_commands_min0.07482180875890396
sim_compute_performance-ego_max0.06180280573824619
sim_compute_performance-ego_mean0.059364043728477714
sim_compute_performance-ego_median0.05916704581334041
sim_compute_performance-ego_min0.05760886622410195
sim_compute_robot_state-ego_max0.06294365571095394
sim_compute_robot_state-ego_mean0.06101324919209413
sim_compute_robot_state-ego_median0.06073313667660668
sim_compute_robot_state-ego_min0.05800142007715562
sim_compute_robot_state-npc0_max0.07289909048283354
sim_compute_robot_state-npc0_mean0.06819064276888917
sim_compute_robot_state-npc0_median0.06804979548734777
sim_compute_robot_state-npc0_min0.06462284875294519
sim_compute_robot_state-npc1_max0.06452602021237637
sim_compute_robot_state-npc1_mean0.06150681596844813
sim_compute_robot_state-npc1_median0.060984475939881565
sim_compute_robot_state-npc1_min0.058459399238465326
sim_compute_robot_state-npc2_max0.06324694258101443
sim_compute_robot_state-npc2_mean0.05988437853571031
sim_compute_robot_state-npc2_median0.05900439849266639
sim_compute_robot_state-npc2_min0.05754428439670139
sim_compute_robot_state-npc3_max0.06495005019167636
sim_compute_robot_state-npc3_mean0.06001061853581772
sim_compute_robot_state-npc3_median0.05767184212094262
sim_compute_robot_state-npc3_min0.057373046875
sim_compute_sim_state_max0.03626229154302719
sim_compute_sim_state_mean0.03375084282389769
sim_compute_sim_state_median0.032861864756024074
sim_compute_sim_state_min0.03259278260744535
sim_physics_max0.03086082012422623
sim_physics_mean0.028971915455079184
sim_physics_median0.03057296692378937
sim_physics_min0.02606933724646475
sim_render-ego_max0.06462108327987347
sim_render-ego_mean0.06072583100027189
sim_render-ego_median0.06007630106002566
sim_render-ego_min0.05782995037004059
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
185372385Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.059067931910527616
survival_time_median1.6000000000000008
deviation-center-line_median0.02159784660508292
in-drivable-lane_median0.6000000000000005


other stats
agent_compute-ego_max0.2228211587475192
agent_compute-ego_mean0.2012618674942512
agent_compute-ego_median0.20190322399139404
agent_compute-ego_min0.17686761915683746
deviation-center-line_max0.061908720609756766
deviation-center-line_mean0.030616426602869385
deviation-center-line_min0.015240036849960111
deviation-heading_max1.4891885296183562
deviation-heading_mean0.7568849733547667
deviation-heading_median0.5830598771486855
deviation-heading_min0.5012748499315541
driven_any_max0.3813267523350526
driven_any_mean0.19744290771400125
driven_any_median0.1551075107456698
driven_any_min0.143976200309881
driven_lanedir_consec_max0.12785701398164173
driven_lanedir_consec_mean0.06831715285503943
driven_lanedir_consec_min0.04375144716339063
driven_lanedir_max0.12785701398164173
driven_lanedir_mean0.06831715285503943
driven_lanedir_median0.059067931910527616
driven_lanedir_min0.04375144716339063
in-drivable-lane_max1.6499999999999984
in-drivable-lane_mean0.78
in-drivable-lane_min0.4500000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3813267523350526, "sim_physics": 0.028289449842352616, "survival_time": 3.7999999999999945, "driven_lanedir": 0.12785701398164173, "sim_render-ego": 0.06708447556746633, "in-drivable-lane": 1.6499999999999984, "agent_compute-ego": 0.1870915983852587, "deviation-heading": 1.4891885296183562, "set_robot_commands": 0.07481479331066734, "deviation-center-line": 0.061908720609756766, "driven_lanedir_consec": 0.12785701398164173, "sim_compute_sim_state": 0.037067137266460215, "sim_compute_performance-ego": 0.06288130346097444, "sim_compute_robot_state-ego": 0.06465718934410497, "sim_compute_robot_state-npc0": 0.07188439682910316, "sim_compute_robot_state-npc1": 0.06455574537578382, "sim_compute_robot_state-npc2": 0.06466329725165117, "sim_compute_robot_state-npc3": 0.0641832665393227}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14959385912569506, "sim_physics": 0.025765955448150635, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04578777543742696, "sim_render-ego": 0.06158708781003952, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.21762573719024655, "deviation-heading": 0.5830598771486855, "set_robot_commands": 0.07233456522226334, "deviation-center-line": 0.021516778987121933, "driven_lanedir_consec": 0.04578777543742696, "sim_compute_sim_state": 0.035444475710392, "sim_compute_performance-ego": 0.06331737339496613, "sim_compute_robot_state-ego": 0.06417753547430038, "sim_compute_robot_state-npc0": 0.07057175785303116, "sim_compute_robot_state-npc1": 0.06484674662351608, "sim_compute_robot_state-npc2": 0.0627395436167717, "sim_compute_robot_state-npc3": 0.0603780597448349}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1551075107456698, "sim_physics": 0.027461424469947815, "survival_time": 1.6000000000000008, "driven_lanedir": 0.059067931910527616, "sim_render-ego": 0.0667891800403595, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.20190322399139404, "deviation-heading": 0.5693772420553864, "set_robot_commands": 0.07573339343070984, "deviation-center-line": 0.02159784660508292, "driven_lanedir_consec": 0.059067931910527616, "sim_compute_sim_state": 0.036862343549728394, "sim_compute_performance-ego": 0.063707135617733, "sim_compute_robot_state-ego": 0.06516481190919876, "sim_compute_robot_state-npc0": 0.07415255159139633, "sim_compute_robot_state-npc1": 0.06598712503910065, "sim_compute_robot_state-npc2": 0.06559983640909195, "sim_compute_robot_state-npc3": 0.06473655253648758}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.143976200309881, "sim_physics": 0.026723310351371765, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04375144716339063, "sim_render-ego": 0.06376759707927704, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.17686761915683746, "deviation-heading": 0.5012748499315541, "set_robot_commands": 0.07554491609334946, "deviation-center-line": 0.015240036849960111, "driven_lanedir_consec": 0.04375144716339063, "sim_compute_sim_state": 0.035712383687496185, "sim_compute_performance-ego": 0.0606103390455246, "sim_compute_robot_state-ego": 0.06166398525238037, "sim_compute_robot_state-npc0": 0.0681828036904335, "sim_compute_robot_state-npc1": 0.06365035474300385, "sim_compute_robot_state-npc2": 0.06454405188560486, "sim_compute_robot_state-npc3": 0.06339260935783386}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15721021605370766, "sim_physics": 0.021871497554163778, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06512159578221022, "sim_render-ego": 0.06555347288808515, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2228211587475192, "deviation-heading": 0.641524368019851, "set_robot_commands": 0.07419909969452888, "deviation-center-line": 0.032818749962425176, "driven_lanedir_consec": 0.06512159578221022, "sim_compute_sim_state": 0.03342107034498645, "sim_compute_performance-ego": 0.06016791251397902, "sim_compute_robot_state-ego": 0.0583524473251835, "sim_compute_robot_state-npc0": 0.07316101751019878, "sim_compute_robot_state-npc1": 0.06513158736690398, "sim_compute_robot_state-npc2": 0.06526817813996345, "sim_compute_robot_state-npc3": 0.06477658979354366}}
set_robot_commands_max0.07573339343070984
set_robot_commands_mean0.07452535355030376
set_robot_commands_median0.07481479331066734
set_robot_commands_min0.07233456522226334
sim_compute_performance-ego_max0.063707135617733
sim_compute_performance-ego_mean0.06213681280663543
sim_compute_performance-ego_median0.06288130346097444
sim_compute_performance-ego_min0.06016791251397902
sim_compute_robot_state-ego_max0.06516481190919876
sim_compute_robot_state-ego_mean0.0628031938610336
sim_compute_robot_state-ego_median0.06417753547430038
sim_compute_robot_state-ego_min0.0583524473251835
sim_compute_robot_state-npc0_max0.07415255159139633
sim_compute_robot_state-npc0_mean0.07159050549483259
sim_compute_robot_state-npc0_median0.07188439682910316
sim_compute_robot_state-npc0_min0.0681828036904335
sim_compute_robot_state-npc1_max0.06598712503910065
sim_compute_robot_state-npc1_mean0.06483431182966168
sim_compute_robot_state-npc1_median0.06484674662351608
sim_compute_robot_state-npc1_min0.06365035474300385
sim_compute_robot_state-npc2_max0.06559983640909195
sim_compute_robot_state-npc2_mean0.06456298146061662
sim_compute_robot_state-npc2_median0.06466329725165117
sim_compute_robot_state-npc2_min0.0627395436167717
sim_compute_robot_state-npc3_max0.06477658979354366
sim_compute_robot_state-npc3_mean0.06349341559440455
sim_compute_robot_state-npc3_median0.0641832665393227
sim_compute_robot_state-npc3_min0.0603780597448349
sim_compute_sim_state_max0.037067137266460215
sim_compute_sim_state_mean0.03570148211181265
sim_compute_sim_state_median0.035712383687496185
sim_compute_sim_state_min0.03342107034498645
sim_physics_max0.028289449842352616
sim_physics_mean0.02602232753319732
sim_physics_median0.026723310351371765
sim_physics_min0.021871497554163778
sim_render-ego_max0.06708447556746633
sim_render-ego_mean0.0649563626770455
sim_render-ego_median0.06555347288808515
sim_render-ego_min0.06158708781003952
simulation-passed1
survival_time_max3.7999999999999945
survival_time_mean2.0299999999999994
survival_time_min1.5500000000000007
No reset possible
185332391Liam Paull 🇨🇦random_agentaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.13594344986809626
agent_compute-ego_mean0.1290400374260789
agent_compute-ego_median0.13023614386717478
agent_compute-ego_min0.11974414339605367
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01678447903327222, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06142165975750617, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.11974414339605367, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07670443462875653, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04057331355112904, "sim_compute_performance-ego": 0.06183746625792305, "sim_compute_robot_state-ego": 0.06542478867296903}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01657003164291382, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06788925149224022, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13129169832576404, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07673150842840021, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04132793166420677, "sim_compute_performance-ego": 0.0669009035283869, "sim_compute_robot_state-ego": 0.0650454271923412}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01653646363152398, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06580737431844076, "in-drivable-lane": 0, "agent_compute-ego": 0.13594344986809626, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.0762978924645318, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04243799315558539, "sim_compute_performance-ego": 0.06507093641493056, "sim_compute_robot_state-ego": 0.06600904994540745}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.016950299342473347, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06854944427808125, "in-drivable-lane": 0, "agent_compute-ego": 0.13023614386717478, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07785190641880035, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04154997567335764, "sim_compute_performance-ego": 0.06621525684992473, "sim_compute_robot_state-ego": 0.06693295141061147}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.017251014709472656, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.0640634158078362, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12798475167330572, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07910542628344368, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03861404166502111, "sim_compute_performance-ego": 0.06481107894112081, "sim_compute_robot_state-ego": 0.06407099962234497}}
set_robot_commands_max0.07910542628344368
set_robot_commands_mean0.07733823364478651
set_robot_commands_median0.07673150842840021
set_robot_commands_min0.0762978924645318
sim_compute_performance-ego_max0.0669009035283869
sim_compute_performance-ego_mean0.06496712839845721
sim_compute_performance-ego_median0.06507093641493056
sim_compute_performance-ego_min0.06183746625792305
sim_compute_robot_state-ego_max0.06693295141061147
sim_compute_robot_state-ego_mean0.06549664336873481
sim_compute_robot_state-ego_median0.06542478867296903
sim_compute_robot_state-ego_min0.06407099962234497
sim_compute_sim_state_max0.04243799315558539
sim_compute_sim_state_mean0.04090065114185999
sim_compute_sim_state_median0.04132793166420677
sim_compute_sim_state_min0.03861404166502111
sim_physics_max0.017251014709472656
sim_physics_mean0.016818457671931207
sim_physics_median0.01678447903327222
sim_physics_min0.01653646363152398
sim_render-ego_max0.06854944427808125
sim_render-ego_mean0.06554622913082092
sim_render-ego_median0.06580737431844076
sim_render-ego_min0.06142165975750617
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
185162410jiang pengBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:23:33
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
185122417Andrea Censi 🇨🇭random_agentaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-2108210:05:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.12994380908853867
agent_compute-ego_mean0.12679137951600786
agent_compute-ego_median0.12647444009780884
agent_compute-ego_min0.12407627430829136
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.017767901690501086, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06373265554320137, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1275128058667453, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07486575504518905, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04105803651629754, "sim_compute_performance-ego": 0.06399876666518878, "sim_compute_robot_state-ego": 0.06374669075012207}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01793515140360052, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.060493778098713265, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.12407627430829136, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07604250582781705, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04022076996889981, "sim_compute_performance-ego": 0.06315761262720282, "sim_compute_robot_state-ego": 0.0684069340879267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.017745998170640733, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06646268632676866, "in-drivable-lane": 0, "agent_compute-ego": 0.12594956821865505, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07667981253729926, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04358315997653538, "sim_compute_performance-ego": 0.0669239150153266, "sim_compute_robot_state-ego": 0.06796218554178873}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01685663064320882, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06740430494149525, "in-drivable-lane": 0, "agent_compute-ego": 0.12647444009780884, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07732949654261272, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04138318200906118, "sim_compute_performance-ego": 0.0694367637236913, "sim_compute_robot_state-ego": 0.06714955468972524}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.018549456315882062, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.0671490185401019, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12994380908853867, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07883420060662662, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04296348726048189, "sim_compute_performance-ego": 0.06612240917542402, "sim_compute_robot_state-ego": 0.06700714195475858}}
set_robot_commands_max0.07883420060662662
set_robot_commands_mean0.07675035411190893
set_robot_commands_median0.07667981253729926
set_robot_commands_min0.07486575504518905
sim_compute_performance-ego_max0.0694367637236913
sim_compute_performance-ego_mean0.06592789344136671
sim_compute_performance-ego_median0.06612240917542402
sim_compute_performance-ego_min0.06315761262720282
sim_compute_robot_state-ego_max0.0684069340879267
sim_compute_robot_state-ego_mean0.06685450140486426
sim_compute_robot_state-ego_median0.06714955468972524
sim_compute_robot_state-ego_min0.06374669075012207
sim_compute_sim_state_max0.04358315997653538
sim_compute_sim_state_mean0.04184172714625515
sim_compute_sim_state_median0.04138318200906118
sim_compute_sim_state_min0.04022076996889981
sim_physics_max0.018549456315882062
sim_physics_mean0.017771027644766645
sim_physics_median0.017767901690501086
sim_physics_min0.01685663064320882
sim_render-ego_max0.06740430494149525
sim_render-ego_mean0.0650484886900561
sim_render-ego_median0.06646268632676866
sim_render-ego_min0.060493778098713265
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
185032436Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:40
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184892451Nicky EichmannBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:21:34
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184772471Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:09:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.15085440332239325
agent_compute-ego_mean0.14759327419137022
agent_compute-ego_median0.14732728004455567
agent_compute-ego_min0.14505216310609062
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.024017518421389022, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06095732832854649, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14505216310609062, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07684837647204129, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03524026780758264, "sim_compute_performance-ego": 0.06268552114378731, "sim_compute_robot_state-ego": 0.06193323855130178, "sim_compute_robot_state-npc0": 0.07182192802429199, "sim_compute_robot_state-npc1": 0.06451570762778228, "sim_compute_robot_state-npc2": 0.06447689488249005, "sim_compute_robot_state-npc3": 0.06379800472619399}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.027632301503961735, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06579989736730402, "in-drivable-lane": 0, "agent_compute-ego": 0.15085440332239325, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08019296689466997, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03622032837434248, "sim_compute_performance-ego": 0.06437443603168834, "sim_compute_robot_state-ego": 0.0642152266068892, "sim_compute_robot_state-npc0": 0.07186289808966896, "sim_compute_robot_state-npc1": 0.06544508717276833, "sim_compute_robot_state-npc2": 0.06385983662171797, "sim_compute_robot_state-npc3": 0.06477177143096924}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.023981184429592555, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06427803569369846, "in-drivable-lane": 0, "agent_compute-ego": 0.14732728004455567, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07576389842563205, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03476274808247884, "sim_compute_performance-ego": 0.06168171034918891, "sim_compute_robot_state-ego": 0.062186145782470705, "sim_compute_robot_state-npc0": 0.0721643712785509, "sim_compute_robot_state-npc1": 0.06649862395392524, "sim_compute_robot_state-npc2": 0.06853474511040582, "sim_compute_robot_state-npc3": 0.06341003312004936}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02377799650033315, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06251291930675507, "in-drivable-lane": 0, "agent_compute-ego": 0.1477241019407908, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07439847787221272, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03450205425421397, "sim_compute_performance-ego": 0.06143877406915029, "sim_compute_robot_state-ego": 0.0625033179918925, "sim_compute_robot_state-npc0": 0.06795594096183777, "sim_compute_robot_state-npc1": 0.06492095192273457, "sim_compute_robot_state-npc2": 0.06379567583401997, "sim_compute_robot_state-npc3": 0.06332787374655406}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.02589633534936344, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06437856660169713, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14700842254302082, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07605345810160917, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.0361327984753777, "sim_compute_performance-ego": 0.06481648893917308, "sim_compute_robot_state-ego": 0.06292919902240529, "sim_compute_robot_state-npc0": 0.06854929292903227, "sim_compute_robot_state-npc1": 0.06536274797776166, "sim_compute_robot_state-npc2": 0.06512367374756757, "sim_compute_robot_state-npc3": 0.06487839362200569}}
set_robot_commands_max0.08019296689466997
set_robot_commands_mean0.07665143555323305
set_robot_commands_median0.07605345810160917
set_robot_commands_min0.07439847787221272
sim_compute_performance-ego_max0.06481648893917308
sim_compute_performance-ego_mean0.06299938610659758
sim_compute_performance-ego_median0.06268552114378731
sim_compute_performance-ego_min0.06143877406915029
sim_compute_robot_state-ego_max0.0642152266068892
sim_compute_robot_state-ego_mean0.0627534255909919
sim_compute_robot_state-ego_median0.0625033179918925
sim_compute_robot_state-ego_min0.06193323855130178
sim_compute_robot_state-npc0_max0.0721643712785509
sim_compute_robot_state-npc0_mean0.07047088625667638
sim_compute_robot_state-npc0_median0.07182192802429199
sim_compute_robot_state-npc0_min0.06795594096183777
sim_compute_robot_state-npc1_max0.06649862395392524
sim_compute_robot_state-npc1_mean0.06534862373099441
sim_compute_robot_state-npc1_median0.06536274797776166
sim_compute_robot_state-npc1_min0.06451570762778228
sim_compute_robot_state-npc2_max0.06853474511040582
sim_compute_robot_state-npc2_mean0.06515816523924027
sim_compute_robot_state-npc2_median0.06447689488249005
sim_compute_robot_state-npc2_min0.06379567583401997
sim_compute_robot_state-npc3_max0.06487839362200569
sim_compute_robot_state-npc3_mean0.06403721532915448
sim_compute_robot_state-npc3_median0.06379800472619399
sim_compute_robot_state-npc3_min0.06332787374655406
sim_compute_sim_state_max0.03622032837434248
sim_compute_sim_state_mean0.03537163939879913
sim_compute_sim_state_median0.03524026780758264
sim_compute_sim_state_min0.03450205425421397
sim_physics_max0.027632301503961735
sim_physics_mean0.025061067240927985
sim_physics_median0.024017518421389022
sim_physics_min0.02377799650033315
sim_render-ego_max0.06579989736730402
sim_render-ego_mean0.06358534945960023
sim_render-ego_median0.06427803569369846
sim_render-ego_min0.06095732832854649
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
184612495Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09272285062974885
survival_time_median1.2500000000000004
deviation-center-line_median0.05202435992185225
in-drivable-lane_median0


other stats
agent_compute-ego_max0.25634315609931946
agent_compute-ego_mean0.21620019268989565
agent_compute-ego_median0.19554631233215333
agent_compute-ego_min0.1868474578857422
deviation-center-line_max0.05891302086549774
deviation-center-line_mean0.048633628459654646
deviation-center-line_min0.027142450294246417
deviation-heading_max0.7664076109463926
deviation-heading_mean0.6727170985378468
deviation-heading_median0.6728102365557884
deviation-heading_min0.5795136519997431
driven_any_max0.16948659897699153
driven_any_mean0.15571962071232223
driven_any_median0.153925075969997
driven_any_min0.13658552966209486
driven_lanedir_consec_max0.11740303872935431
driven_lanedir_consec_mean0.09482958816331118
driven_lanedir_consec_min0.06125121868719496
driven_lanedir_max0.11740303872935431
driven_lanedir_mean0.09482958816331118
driven_lanedir_median0.09272285062974885
driven_lanedir_min0.06125121868719496
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.06000000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16510157914814394, "sim_physics": 0.02662400404612223, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1164282642806449, "sim_render-ego": 0.05764717857042948, "in-drivable-lane": 0, "agent_compute-ego": 0.25634315609931946, "deviation-heading": 0.6193117299130809, "set_robot_commands": 0.07345559199651082, "deviation-center-line": 0.05202435992185225, "driven_lanedir_consec": 0.1164282642806449, "sim_compute_sim_state": 0.0333365797996521, "sim_compute_performance-ego": 0.056173741817474365, "sim_compute_robot_state-ego": 0.0645883580048879, "sim_compute_robot_state-npc0": 0.06127477685610453, "sim_compute_robot_state-npc1": 0.057717859745025635, "sim_compute_robot_state-npc2": 0.05743029713630676, "sim_compute_robot_state-npc3": 0.056627094745635986}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15349931980438383, "sim_physics": 0.022949347129234902, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08634256848961286, "sim_render-ego": 0.05555751690497765, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.2522236108779907, "deviation-heading": 0.7255422632742287, "set_robot_commands": 0.07359283704024094, "deviation-center-line": 0.04885479901044725, "driven_lanedir_consec": 0.08634256848961286, "sim_compute_sim_state": 0.031198629966148965, "sim_compute_performance-ego": 0.05729919213515062, "sim_compute_robot_state-ego": 0.05741023100339449, "sim_compute_robot_state-npc0": 0.07060065636268029, "sim_compute_robot_state-npc1": 0.05813406980954683, "sim_compute_robot_state-npc2": 0.055202025633591875, "sim_compute_robot_state-npc3": 0.05543707884274996}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16948659897699153, "sim_physics": 0.026413936614990235, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11740303872935431, "sim_render-ego": 0.055686750411987306, "in-drivable-lane": 0, "agent_compute-ego": 0.19554631233215333, "deviation-heading": 0.6728102365557884, "set_robot_commands": 0.07615969657897949, "deviation-center-line": 0.05623351220622958, "driven_lanedir_consec": 0.11740303872935431, "sim_compute_sim_state": 0.032776927947998045, "sim_compute_performance-ego": 0.054512948989868165, "sim_compute_robot_state-ego": 0.057429323196411135, "sim_compute_robot_state-npc0": 0.06239134788513184, "sim_compute_robot_state-npc1": 0.05899367332458496, "sim_compute_robot_state-npc2": 0.05835489273071289, "sim_compute_robot_state-npc3": 0.05830465316772461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13658552966209486, "sim_physics": 0.023955583572387695, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06125121868719496, "sim_render-ego": 0.057938976287841795, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.19004042625427245, "deviation-heading": 0.5795136519997431, "set_robot_commands": 0.07599872589111328, "deviation-center-line": 0.027142450294246417, "driven_lanedir_consec": 0.06125121868719496, "sim_compute_sim_state": 0.03004591941833496, "sim_compute_performance-ego": 0.05891104698181152, "sim_compute_robot_state-ego": 0.06076023101806641, "sim_compute_robot_state-npc0": 0.0607496452331543, "sim_compute_robot_state-npc1": 0.05934466361999512, "sim_compute_robot_state-npc2": 0.0579041862487793, "sim_compute_robot_state-npc3": 0.05450218200683594}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.153925075969997, "sim_physics": 0.02215020179748535, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09272285062974885, "sim_render-ego": 0.0609876823425293, "in-drivable-lane": 0, "agent_compute-ego": 0.1868474578857422, "deviation-heading": 0.7664076109463926, "set_robot_commands": 0.07387923240661622, "deviation-center-line": 0.05891302086549774, "driven_lanedir_consec": 0.09272285062974885, "sim_compute_sim_state": 0.03345599174499512, "sim_compute_performance-ego": 0.05815810203552246, "sim_compute_robot_state-ego": 0.058275279998779295, "sim_compute_robot_state-npc0": 0.07374826431274414, "sim_compute_robot_state-npc1": 0.06106554985046387, "sim_compute_robot_state-npc2": 0.0613786506652832, "sim_compute_robot_state-npc3": 0.06268134117126464}}
set_robot_commands_max0.07615969657897949
set_robot_commands_mean0.07461721678269215
set_robot_commands_median0.07387923240661622
set_robot_commands_min0.07345559199651082
sim_compute_performance-ego_max0.05891104698181152
sim_compute_performance-ego_mean0.05701100639196542
sim_compute_performance-ego_median0.05729919213515062
sim_compute_performance-ego_min0.054512948989868165
sim_compute_robot_state-ego_max0.0645883580048879
sim_compute_robot_state-ego_mean0.059692684644307846
sim_compute_robot_state-ego_median0.058275279998779295
sim_compute_robot_state-ego_min0.05741023100339449
sim_compute_robot_state-npc0_max0.07374826431274414
sim_compute_robot_state-npc0_mean0.06575293812996301
sim_compute_robot_state-npc0_median0.06239134788513184
sim_compute_robot_state-npc0_min0.0607496452331543
sim_compute_robot_state-npc1_max0.06106554985046387
sim_compute_robot_state-npc1_mean0.05905116326992328
sim_compute_robot_state-npc1_median0.05899367332458496
sim_compute_robot_state-npc1_min0.057717859745025635
sim_compute_robot_state-npc2_max0.0613786506652832
sim_compute_robot_state-npc2_mean0.058054010482934806
sim_compute_robot_state-npc2_median0.0579041862487793
sim_compute_robot_state-npc2_min0.055202025633591875
sim_compute_robot_state-npc3_max0.06268134117126464
sim_compute_robot_state-npc3_mean0.057510469986842214
sim_compute_robot_state-npc3_median0.056627094745635986
sim_compute_robot_state-npc3_min0.05450218200683594
sim_compute_sim_state_max0.03345599174499512
sim_compute_sim_state_mean0.032162809775425835
sim_compute_sim_state_median0.032776927947998045
sim_compute_sim_state_min0.03004591941833496
sim_physics_max0.02662400404612223
sim_physics_mean0.02441861463204408
sim_physics_median0.023955583572387695
sim_physics_min0.02215020179748535
sim_render-ego_max0.0609876823425293
sim_render-ego_mean0.05756362090355312
sim_render-ego_median0.05764717857042948
sim_render-ego_min0.05555751690497765
simulation-passed1
survival_time_max1.3000000000000005
survival_time_mean1.2500000000000004
survival_time_min1.2000000000000004
No reset possible
184572503Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184532509Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184462512Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184412521Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184362532Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184312540jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184202556Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-2108210:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06981577335948676
agent_compute-ego_mean0.06779240150750886
agent_compute-ego_median0.06724846990484941
agent_compute-ego_min0.0666961731054844
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.032732471666837994, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06435541102760717, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06681402858934904, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07632920114617599, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03688492774963379, "sim_compute_performance-ego": 0.06332857232344778, "sim_compute_robot_state-ego": 0.06312636074266936, "sim_compute_robot_state-npc0": 0.07194323037800036, "sim_compute_robot_state-npc1": 0.06646421583075272, "sim_compute_robot_state-npc2": 0.06594446081864207, "sim_compute_robot_state-npc3": 0.0653960202869616}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.028880125597903605, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.0643980628565738, "in-drivable-lane": 0, "agent_compute-ego": 0.06724846990484941, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07472988178855494, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03666418477108604, "sim_compute_performance-ego": 0.0652181725752981, "sim_compute_robot_state-ego": 0.06387544933118318, "sim_compute_robot_state-npc0": 0.07460049579018041, "sim_compute_robot_state-npc1": 0.06387977223647268, "sim_compute_robot_state-npc2": 0.06839208853872199, "sim_compute_robot_state-npc3": 0.06570785924008019}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.029768711481338892, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.0632171875391251, "in-drivable-lane": 0, "agent_compute-ego": 0.0666961731054844, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07633684843014447, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03726028173397749, "sim_compute_performance-ego": 0.06268980564215244, "sim_compute_robot_state-ego": 0.062308323688996144, "sim_compute_robot_state-npc0": 0.06649131652636406, "sim_compute_robot_state-npc1": 0.06278234261732835, "sim_compute_robot_state-npc2": 0.06235257784525553, "sim_compute_robot_state-npc3": 0.06492141576913688}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.029766932339735434, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06504613580838056, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06981577335948676, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07901782049259669, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03342309804029868, "sim_compute_performance-ego": 0.06405853889357875, "sim_compute_robot_state-ego": 0.06080917237510144, "sim_compute_robot_state-npc0": 0.0659612904132252, "sim_compute_robot_state-npc1": 0.06433261616129271, "sim_compute_robot_state-npc2": 0.06376638882596727, "sim_compute_robot_state-npc3": 0.06189850350500832}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.028840238397771664, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06289526549252597, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0683875625783747, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.0773353251543912, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03590900247747248, "sim_compute_performance-ego": 0.06055720285935835, "sim_compute_robot_state-ego": 0.05960030447353016, "sim_compute_robot_state-npc0": 0.06811014630577782, "sim_compute_robot_state-npc1": 0.06340965899554166, "sim_compute_robot_state-npc2": 0.0627648342739452, "sim_compute_robot_state-npc3": 0.0632623704996976}}
set_robot_commands_max0.07901782049259669
set_robot_commands_mean0.07674981540237266
set_robot_commands_median0.07633684843014447
set_robot_commands_min0.07472988178855494
sim_compute_performance-ego_max0.0652181725752981
sim_compute_performance-ego_mean0.06317045845876709
sim_compute_performance-ego_median0.06332857232344778
sim_compute_performance-ego_min0.06055720285935835
sim_compute_robot_state-ego_max0.06387544933118318
sim_compute_robot_state-ego_mean0.06194392212229605
sim_compute_robot_state-ego_median0.062308323688996144
sim_compute_robot_state-ego_min0.05960030447353016
sim_compute_robot_state-npc0_max0.07460049579018041
sim_compute_robot_state-npc0_mean0.06942129588270958
sim_compute_robot_state-npc0_median0.06811014630577782
sim_compute_robot_state-npc0_min0.0659612904132252
sim_compute_robot_state-npc1_max0.06646421583075272
sim_compute_robot_state-npc1_mean0.06417372116827762
sim_compute_robot_state-npc1_median0.06387977223647268
sim_compute_robot_state-npc1_min0.06278234261732835
sim_compute_robot_state-npc2_max0.06839208853872199
sim_compute_robot_state-npc2_mean0.0646440700605064
sim_compute_robot_state-npc2_median0.06376638882596727
sim_compute_robot_state-npc2_min0.06235257784525553
sim_compute_robot_state-npc3_max0.06570785924008019
sim_compute_robot_state-npc3_mean0.06423723386017692
sim_compute_robot_state-npc3_median0.06492141576913688
sim_compute_robot_state-npc3_min0.06189850350500832
sim_compute_sim_state_max0.03726028173397749
sim_compute_sim_state_mean0.0360282989544937
sim_compute_sim_state_median0.03666418477108604
sim_compute_sim_state_min0.03342309804029868
sim_physics_max0.032732471666837994
sim_physics_mean0.02999769589671751
sim_physics_median0.029766932339735434
sim_physics_min0.028840238397771664
sim_render-ego_max0.06504613580838056
sim_render-ego_mean0.06398241254484252
sim_render-ego_median0.06435541102760717
sim_render-ego_min0.06289526549252597
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
184122568Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:10:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.0699053312602796
agent_compute-ego_mean0.06807465226702052
agent_compute-ego_median0.0675474622032859
agent_compute-ego_min0.06653829109974396
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.03249422123557643, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06360374751843904, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06956817727339895, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07873251061690481, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.036157359574970446, "sim_compute_performance-ego": 0.06242883330897281, "sim_compute_robot_state-ego": 0.06299589307684647, "sim_compute_robot_state-npc0": 0.0689023494720459, "sim_compute_robot_state-npc1": 0.06405195938913445, "sim_compute_robot_state-npc2": 0.06327192406905324, "sim_compute_robot_state-npc3": 0.06266084972180819}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.0282453925986039, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.06509381846377724, "in-drivable-lane": 0, "agent_compute-ego": 0.0699053312602796, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.08067088378103156, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03685255427109568, "sim_compute_performance-ego": 0.06335455492923134, "sim_compute_robot_state-ego": 0.06365580935227244, "sim_compute_robot_state-npc0": 0.0710428325753463, "sim_compute_robot_state-npc1": 0.0676007960972033, "sim_compute_robot_state-npc2": 0.06724549594678376, "sim_compute_robot_state-npc3": 0.06661232521659449}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.029810226880587064, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.0637042461297451, "in-drivable-lane": 0, "agent_compute-ego": 0.06653829109974396, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07455142339070638, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03549885138487204, "sim_compute_performance-ego": 0.06248660576649201, "sim_compute_robot_state-ego": 0.06020886470109989, "sim_compute_robot_state-npc0": 0.06697546518765964, "sim_compute_robot_state-npc1": 0.06409935462169158, "sim_compute_robot_state-npc2": 0.06457973137879983, "sim_compute_robot_state-npc3": 0.06364882909334622}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.032267352225075305, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.063797158254704, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06681399949839417, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07692264838957451, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03609441703474018, "sim_compute_performance-ego": 0.0650790812264026, "sim_compute_robot_state-ego": 0.06255916810371506, "sim_compute_robot_state-npc0": 0.06676846826580209, "sim_compute_robot_state-npc1": 0.06281975961067307, "sim_compute_robot_state-npc2": 0.06298128316100214, "sim_compute_robot_state-npc3": 0.06228058438905528}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.027518993074243717, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06473438306288286, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0675474622032859, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07606117833744395, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03639787435531616, "sim_compute_performance-ego": 0.06591606681997125, "sim_compute_robot_state-ego": 0.06443683125756004, "sim_compute_robot_state-npc0": 0.07116648283871738, "sim_compute_robot_state-npc1": 0.06325264410539107, "sim_compute_robot_state-npc2": 0.06157972595908425, "sim_compute_robot_state-npc3": 0.06298692659898238}}
set_robot_commands_max0.08067088378103156
set_robot_commands_mean0.07738772890313225
set_robot_commands_median0.07692264838957451
set_robot_commands_min0.07455142339070638
sim_compute_performance-ego_max0.06591606681997125
sim_compute_performance-ego_mean0.063853028410214
sim_compute_performance-ego_median0.06335455492923134
sim_compute_performance-ego_min0.06242883330897281
sim_compute_robot_state-ego_max0.06443683125756004
sim_compute_robot_state-ego_mean0.06277131329829878
sim_compute_robot_state-ego_median0.06299589307684647
sim_compute_robot_state-ego_min0.06020886470109989
sim_compute_robot_state-npc0_max0.07116648283871738
sim_compute_robot_state-npc0_mean0.06897111966791425
sim_compute_robot_state-npc0_median0.0689023494720459
sim_compute_robot_state-npc0_min0.06676846826580209
sim_compute_robot_state-npc1_max0.0676007960972033
sim_compute_robot_state-npc1_mean0.06436490276481868
sim_compute_robot_state-npc1_median0.06405195938913445
sim_compute_robot_state-npc1_min0.06281975961067307
sim_compute_robot_state-npc2_max0.06724549594678376
sim_compute_robot_state-npc2_mean0.06393163210294464
sim_compute_robot_state-npc2_median0.06327192406905324
sim_compute_robot_state-npc2_min0.06157972595908425
sim_compute_robot_state-npc3_max0.06661232521659449
sim_compute_robot_state-npc3_mean0.0636379030039573
sim_compute_robot_state-npc3_median0.06298692659898238
sim_compute_robot_state-npc3_min0.06228058438905528
sim_compute_sim_state_max0.03685255427109568
sim_compute_sim_state_mean0.0362002113241989
sim_compute_sim_state_median0.036157359574970446
sim_compute_sim_state_min0.03549885138487204
sim_physics_max0.03249422123557643
sim_physics_mean0.030067237202817287
sim_physics_median0.029810226880587064
sim_physics_min0.027518993074243717
sim_render-ego_max0.06509381846377724
sim_render-ego_mean0.06418667068590965
sim_render-ego_median0.063797158254704
sim_render-ego_min0.06360374751843904
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
184072577Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184052581Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
184042582Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:01:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
183982608Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06521184193460565
agent_compute-ego_mean0.0631207205152846
agent_compute-ego_median0.06313562393188477
agent_compute-ego_min0.06043703963116902
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02764569259271389, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.058902504967480174, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06043703963116902, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07295885318663062, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.034971623885922315, "sim_compute_performance-ego": 0.06214617810598234, "sim_compute_robot_state-ego": 0.06278705596923828, "sim_compute_robot_state-npc0": 0.06961501807701297, "sim_compute_robot_state-npc1": 0.064209949679491, "sim_compute_robot_state-npc2": 0.06157705551240503, "sim_compute_robot_state-npc3": 0.06106987522869575}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.025997381943922777, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.06620441950284518, "in-drivable-lane": 0, "agent_compute-ego": 0.06458276968735915, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.07550488985501803, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03533475215618427, "sim_compute_performance-ego": 0.06321785083183876, "sim_compute_robot_state-ego": 0.06267332113706149, "sim_compute_robot_state-npc0": 0.06458029380211464, "sim_compute_robot_state-npc1": 0.06130489019247202, "sim_compute_robot_state-npc2": 0.06335737155033992, "sim_compute_robot_state-npc3": 0.06127582146571232}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.025273110004181556, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.06154009129138703, "in-drivable-lane": 0, "agent_compute-ego": 0.06313562393188477, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07579900356049234, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.036033102806578295, "sim_compute_performance-ego": 0.06181016374141612, "sim_compute_robot_state-ego": 0.060958557940543966, "sim_compute_robot_state-npc0": 0.06676112844588909, "sim_compute_robot_state-npc1": 0.06399563018311845, "sim_compute_robot_state-npc2": 0.062118662164566366, "sim_compute_robot_state-npc3": 0.06187743328987284}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.025380464700552132, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06022255761282785, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.062236327391404375, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07545347528143244, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.032568431162572166, "sim_compute_performance-ego": 0.060518814967228815, "sim_compute_robot_state-ego": 0.060104113358717695, "sim_compute_robot_state-npc0": 0.066621122779427, "sim_compute_robot_state-npc1": 0.060005486666501226, "sim_compute_robot_state-npc2": 0.059157992457295513, "sim_compute_robot_state-npc3": 0.05834359913081913}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.02365690783450478, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.06066864415218955, "in-drivable-lane": 0, "agent_compute-ego": 0.06521184193460565, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07640703728324488, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.033760390783611094, "sim_compute_performance-ego": 0.06202345145376105, "sim_compute_robot_state-ego": 0.06086741623125578, "sim_compute_robot_state-npc0": 0.06609412870909039, "sim_compute_robot_state-npc1": 0.062476384012322674, "sim_compute_robot_state-npc2": 0.060600600744548594, "sim_compute_robot_state-npc3": 0.05920345532266717}}
set_robot_commands_max0.07640703728324488
set_robot_commands_mean0.07522465183336366
set_robot_commands_median0.07550488985501803
set_robot_commands_min0.07295885318663062
sim_compute_performance-ego_max0.06321785083183876
sim_compute_performance-ego_mean0.06194329182004541
sim_compute_performance-ego_median0.06202345145376105
sim_compute_performance-ego_min0.060518814967228815
sim_compute_robot_state-ego_max0.06278705596923828
sim_compute_robot_state-ego_mean0.06147809292736345
sim_compute_robot_state-ego_median0.060958557940543966
sim_compute_robot_state-ego_min0.060104113358717695
sim_compute_robot_state-npc0_max0.06961501807701297
sim_compute_robot_state-npc0_mean0.06673433836270681
sim_compute_robot_state-npc0_median0.066621122779427
sim_compute_robot_state-npc0_min0.06458029380211464
sim_compute_robot_state-npc1_max0.064209949679491
sim_compute_robot_state-npc1_mean0.062398468146781086
sim_compute_robot_state-npc1_median0.062476384012322674
sim_compute_robot_state-npc1_min0.060005486666501226
sim_compute_robot_state-npc2_max0.06335737155033992
sim_compute_robot_state-npc2_mean0.06136233648583108
sim_compute_robot_state-npc2_median0.06157705551240503
sim_compute_robot_state-npc2_min0.059157992457295513
sim_compute_robot_state-npc3_max0.06187743328987284
sim_compute_robot_state-npc3_mean0.06035403688755344
sim_compute_robot_state-npc3_median0.06106987522869575
sim_compute_robot_state-npc3_min0.05834359913081913
sim_compute_sim_state_max0.036033102806578295
sim_compute_sim_state_mean0.03453366015897363
sim_compute_sim_state_median0.034971623885922315
sim_compute_sim_state_min0.032568431162572166
sim_physics_max0.02764569259271389
sim_physics_mean0.02559071141517503
sim_physics_median0.025380464700552132
sim_physics_min0.02365690783450478
sim_render-ego_max0.06620441950284518
sim_render-ego_mean0.06150764350534595
sim_render-ego_median0.06066864415218955
sim_render-ego_min0.058902504967480174
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
183872604Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07094585641901544
agent_compute-ego_mean0.06543535850723153
agent_compute-ego_median0.06616674981466154
agent_compute-ego_min0.05882204206366288
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.017549401376305555, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.0630687795034269, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06616674981466154, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0777380001254198, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03989839553833008, "sim_compute_performance-ego": 0.06479273772821194, "sim_compute_robot_state-ego": 0.06284406126999273}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.015808692345252402, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06731617450714111, "in-drivable-lane": 0, "agent_compute-ego": 0.06472450036268967, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.0727616365139301, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.040543739612285905, "sim_compute_performance-ego": 0.07105212945204514, "sim_compute_robot_state-ego": 0.06910869708428016}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.016330171138682265, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06759979877066105, "in-drivable-lane": 0, "agent_compute-ego": 0.07094585641901544, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07924416724671708, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.04204438595061607, "sim_compute_performance-ego": 0.06664821949410946, "sim_compute_robot_state-ego": 0.06504016734184102}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.019850185939243863, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06722410170586554, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06651764387612814, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07978248072194528, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04339734276572427, "sim_compute_performance-ego": 0.06660736786140191, "sim_compute_robot_state-ego": 0.066298830640185}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.014866170130277934, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05905558561023913, "in-drivable-lane": 0, "agent_compute-ego": 0.05882204206366288, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0724466976366545, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03603300922795346, "sim_compute_performance-ego": 0.057547845338520254, "sim_compute_robot_state-ego": 0.05910248505441766}}
set_robot_commands_max0.07978248072194528
set_robot_commands_mean0.07639459644893334
set_robot_commands_median0.0777380001254198
set_robot_commands_min0.0724466976366545
sim_compute_performance-ego_max0.07105212945204514
sim_compute_performance-ego_mean0.06532965997485773
sim_compute_performance-ego_median0.06660736786140191
sim_compute_performance-ego_min0.057547845338520254
sim_compute_robot_state-ego_max0.06910869708428016
sim_compute_robot_state-ego_mean0.06447884827814332
sim_compute_robot_state-ego_median0.06504016734184102
sim_compute_robot_state-ego_min0.05910248505441766
sim_compute_sim_state_max0.04339734276572427
sim_compute_sim_state_mean0.04038337461898196
sim_compute_sim_state_median0.040543739612285905
sim_compute_sim_state_min0.03603300922795346
sim_physics_max0.019850185939243863
sim_physics_mean0.016880924185952405
sim_physics_median0.016330171138682265
sim_physics_min0.014866170130277934
sim_render-ego_max0.06759979877066105
sim_render-ego_mean0.06485288801946676
sim_render-ego_median0.06722410170586554
sim_render-ego_min0.05905558561023913
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
183822616Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:05:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.14929932355880737
agent_compute-ego_mean0.1459494664957468
agent_compute-ego_median0.14444084728465362
agent_compute-ego_min0.1434176283062629
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.016281789203859726, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06459304971515008, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1434176283062629, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07878507758086582, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04018533904597445, "sim_compute_performance-ego": 0.06459041361538868, "sim_compute_robot_state-ego": 0.062441726900496576}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.015392986210909758, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06283036145296964, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14820462465286255, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08056326345963911, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04085626385428689, "sim_compute_performance-ego": 0.06326679749922319, "sim_compute_robot_state-ego": 0.061492323875427246}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015951628155178494, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06916512383355035, "in-drivable-lane": 0, "agent_compute-ego": 0.14438490867614745, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07590750058492025, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04054993523491753, "sim_compute_performance-ego": 0.06555678579542372, "sim_compute_robot_state-ego": 0.06369779374864366}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.016159539421399433, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0649142861366272, "in-drivable-lane": 0, "agent_compute-ego": 0.14929932355880737, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07614185909430186, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.040070176124572754, "sim_compute_performance-ego": 0.06316335995992024, "sim_compute_robot_state-ego": 0.0648291955391566}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.017308084403767306, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06239124957252951, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14444084728465362, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07715623168384328, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04152294818092795, "sim_compute_performance-ego": 0.06414737420923569, "sim_compute_robot_state-ego": 0.06320127669502706}}
set_robot_commands_max0.08056326345963911
set_robot_commands_mean0.07771078648071407
set_robot_commands_median0.07715623168384328
set_robot_commands_min0.07590750058492025
sim_compute_performance-ego_max0.06555678579542372
sim_compute_performance-ego_mean0.0641449462158383
sim_compute_performance-ego_median0.06414737420923569
sim_compute_performance-ego_min0.06316335995992024
sim_compute_robot_state-ego_max0.0648291955391566
sim_compute_robot_state-ego_mean0.06313246335175024
sim_compute_robot_state-ego_median0.06320127669502706
sim_compute_robot_state-ego_min0.061492323875427246
sim_compute_sim_state_max0.04152294818092795
sim_compute_sim_state_mean0.040636932488135914
sim_compute_sim_state_median0.04054993523491753
sim_compute_sim_state_min0.040070176124572754
sim_physics_max0.017308084403767306
sim_physics_mean0.016218805479022942
sim_physics_median0.016159539421399433
sim_physics_min0.015392986210909758
sim_render-ego_max0.06916512383355035
sim_render-ego_mean0.06477881414216535
sim_render-ego_median0.06459304971515008
sim_render-ego_min0.06239124957252951
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
183702637Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-2108210:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.14523225388628372
agent_compute-ego_mean0.13785336997826175
agent_compute-ego_median0.1365828747842826
agent_compute-ego_min0.12901580144488622
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.02877369002690391, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05457483397589789, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.12901580144488622, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07311676418970502, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03171801567077637, "sim_compute_performance-ego": 0.0551614799196758, "sim_compute_robot_state-ego": 0.05684447666955373, "sim_compute_robot_state-npc0": 0.060522420065743585, "sim_compute_robot_state-npc1": 0.058025220083811925, "sim_compute_robot_state-npc2": 0.05668794541131882, "sim_compute_robot_state-npc3": 0.056249512566460505}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.027780696457507564, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0615239236869064, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.1365828747842826, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07493558116987639, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03269503163356407, "sim_compute_performance-ego": 0.05942641520032696, "sim_compute_robot_state-ego": 0.05929444350448309, "sim_compute_robot_state-npc0": 0.06732957503374885, "sim_compute_robot_state-npc1": 0.0638125223271987, "sim_compute_robot_state-npc2": 0.06084751615337297, "sim_compute_robot_state-npc3": 0.05848271239037607}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.028608237543413715, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05659124928136026, "in-drivable-lane": 0, "agent_compute-ego": 0.13436595470674575, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07187518765849452, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03087949368261522, "sim_compute_performance-ego": 0.05579325845164637, "sim_compute_robot_state-ego": 0.056643670605074976, "sim_compute_robot_state-npc0": 0.06012540094314083, "sim_compute_robot_state-npc1": 0.05847045298545591, "sim_compute_robot_state-npc2": 0.056529475796607234, "sim_compute_robot_state-npc3": 0.055940824170266426}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.030710151854981767, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06245931919584883, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14523225388628372, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07717172389334821, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.0354439654248826, "sim_compute_performance-ego": 0.06103889231986188, "sim_compute_robot_state-ego": 0.06046768959532393, "sim_compute_robot_state-npc0": 0.06939225501202523, "sim_compute_robot_state-npc1": 0.06543224669517354, "sim_compute_robot_state-npc2": 0.0646967684968989, "sim_compute_robot_state-npc3": 0.06362499835643362}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.028041037229391243, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06493577131858239, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14406996506911057, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07606673240661621, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.035447184856121354, "sim_compute_performance-ego": 0.06196245780357948, "sim_compute_robot_state-ego": 0.06135789706156804, "sim_compute_robot_state-npc0": 0.0718810512469365, "sim_compute_robot_state-npc1": 0.06482755679350632, "sim_compute_robot_state-npc2": 0.06205821495789748, "sim_compute_robot_state-npc3": 0.06509304963625394}}
set_robot_commands_max0.07717172389334821
set_robot_commands_mean0.07463319786360807
set_robot_commands_median0.07493558116987639
set_robot_commands_min0.07187518765849452
sim_compute_performance-ego_max0.06196245780357948
sim_compute_performance-ego_mean0.05867650073901809
sim_compute_performance-ego_median0.05942641520032696
sim_compute_performance-ego_min0.0551614799196758
sim_compute_robot_state-ego_max0.06135789706156804
sim_compute_robot_state-ego_mean0.05892163548720075
sim_compute_robot_state-ego_median0.05929444350448309
sim_compute_robot_state-ego_min0.056643670605074976
sim_compute_robot_state-npc0_max0.0718810512469365
sim_compute_robot_state-npc0_mean0.06585014046031899
sim_compute_robot_state-npc0_median0.06732957503374885
sim_compute_robot_state-npc0_min0.06012540094314083
sim_compute_robot_state-npc1_max0.06543224669517354
sim_compute_robot_state-npc1_mean0.06211359977702928
sim_compute_robot_state-npc1_median0.0638125223271987
sim_compute_robot_state-npc1_min0.058025220083811925
sim_compute_robot_state-npc2_max0.0646967684968989
sim_compute_robot_state-npc2_mean0.060163984163219074
sim_compute_robot_state-npc2_median0.06084751615337297
sim_compute_robot_state-npc2_min0.056529475796607234
sim_compute_robot_state-npc3_max0.06509304963625394
sim_compute_robot_state-npc3_mean0.059878219423958115
sim_compute_robot_state-npc3_median0.05848271239037607
sim_compute_robot_state-npc3_min0.055940824170266426
sim_compute_sim_state_max0.035447184856121354
sim_compute_sim_state_mean0.03323673825359193
sim_compute_sim_state_median0.03269503163356407
sim_compute_sim_state_min0.03087949368261522
sim_physics_max0.030710151854981767
sim_physics_mean0.02878276262243964
sim_physics_median0.028608237543413715
sim_physics_min0.027780696457507564
sim_render-ego_max0.06493577131858239
sim_render-ego_mean0.06001701949171915
sim_render-ego_median0.0615239236869064
sim_render-ego_min0.05457483397589789
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
183662645Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-2108210:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06545141110053429
agent_compute-ego_mean0.057192375063855216
agent_compute-ego_median0.05644012004771131
agent_compute-ego_min0.05337304894517108
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.022795310834558997, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05143428139570283, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05337304894517108, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.06937935584928931, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02895806766137844, "sim_compute_performance-ego": 0.052310298128825865, "sim_compute_robot_state-ego": 0.052960384182813694, "sim_compute_robot_state-npc0": 0.05733310885545684, "sim_compute_robot_state-npc1": 0.05445127952389601, "sim_compute_robot_state-npc2": 0.05418895802846769, "sim_compute_robot_state-npc3": 0.05463280619644537}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.02274198715503399, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.05630075014554537, "in-drivable-lane": 0, "agent_compute-ego": 0.06545141110053429, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.07229355665353629, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.02918663391700158, "sim_compute_performance-ego": 0.05503485752986027, "sim_compute_robot_state-ego": 0.05748493854816143, "sim_compute_robot_state-npc0": 0.06308386876032902, "sim_compute_robot_state-npc1": 0.05411833066206712, "sim_compute_robot_state-npc2": 0.05653795829186073, "sim_compute_robot_state-npc3": 0.05447995662689209}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.02509238872122257, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.05288917460340135, "in-drivable-lane": 0, "agent_compute-ego": 0.05644012004771131, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07376549599018503, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03114668866421314, "sim_compute_performance-ego": 0.05547794889896474, "sim_compute_robot_state-ego": 0.05794222304161559, "sim_compute_robot_state-npc0": 0.06002288676322775, "sim_compute_robot_state-npc1": 0.05794736679564131, "sim_compute_robot_state-npc2": 0.057427979530172146, "sim_compute_robot_state-npc3": 0.05564450710377795}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.0230213259602641, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05051870922465901, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.053493814153985665, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.06938021523611886, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.02968447025005634, "sim_compute_performance-ego": 0.05307053209661127, "sim_compute_robot_state-ego": 0.05365872121119237, "sim_compute_robot_state-npc0": 0.05559992004226852, "sim_compute_robot_state-npc1": 0.05326079536270309, "sim_compute_robot_state-npc2": 0.052788275938767656, "sim_compute_robot_state-npc3": 0.053182701488117594}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.021979350792734248, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05465187524494372, "in-drivable-lane": 0, "agent_compute-ego": 0.05720348107187371, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07053023890445106, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.032112686257613335, "sim_compute_performance-ego": 0.054591555344431025, "sim_compute_robot_state-ego": 0.05581250316218326, "sim_compute_robot_state-npc0": 0.05971669523339523, "sim_compute_robot_state-npc1": 0.05582699650212338, "sim_compute_robot_state-npc2": 0.052869407754195366, "sim_compute_robot_state-npc3": 0.05366125859712299}}
set_robot_commands_max0.07376549599018503
set_robot_commands_mean0.07106977252671612
set_robot_commands_median0.07053023890445106
set_robot_commands_min0.06937935584928931
sim_compute_performance-ego_max0.05547794889896474
sim_compute_performance-ego_mean0.05409703839973863
sim_compute_performance-ego_median0.054591555344431025
sim_compute_performance-ego_min0.052310298128825865
sim_compute_robot_state-ego_max0.05794222304161559
sim_compute_robot_state-ego_mean0.05557175402919327
sim_compute_robot_state-ego_median0.05581250316218326
sim_compute_robot_state-ego_min0.052960384182813694
sim_compute_robot_state-npc0_max0.06308386876032902
sim_compute_robot_state-npc0_mean0.05915129593093547
sim_compute_robot_state-npc0_median0.05971669523339523
sim_compute_robot_state-npc0_min0.05559992004226852
sim_compute_robot_state-npc1_max0.05794736679564131
sim_compute_robot_state-npc1_mean0.055120953769286184
sim_compute_robot_state-npc1_median0.05445127952389601
sim_compute_robot_state-npc1_min0.05326079536270309
sim_compute_robot_state-npc2_max0.057427979530172146
sim_compute_robot_state-npc2_mean0.05476251590869271
sim_compute_robot_state-npc2_median0.05418895802846769
sim_compute_robot_state-npc2_min0.052788275938767656
sim_compute_robot_state-npc3_max0.05564450710377795
sim_compute_robot_state-npc3_mean0.05432024600247119
sim_compute_robot_state-npc3_median0.05447995662689209
sim_compute_robot_state-npc3_min0.053182701488117594
sim_compute_sim_state_max0.032112686257613335
sim_compute_sim_state_mean0.03021770935005257
sim_compute_sim_state_median0.02968447025005634
sim_compute_sim_state_min0.02895806766137844
sim_physics_max0.02509238872122257
sim_physics_mean0.023126072692762786
sim_physics_median0.022795310834558997
sim_physics_min0.021979350792734248
sim_render-ego_max0.05630075014554537
sim_render-ego_mean0.05315895812285045
sim_render-ego_median0.05288917460340135
sim_render-ego_min0.05051870922465901
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
183472680Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:21:05
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
183342703Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:19:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2542193176534493
survival_time_median14.950000000000076
deviation-center-line_median1.0611801260458549
in-drivable-lane_median1.550000000000014


other stats
agent_compute-ego_max0.05983867486317952
agent_compute-ego_mean0.05864053681585131
agent_compute-ego_median0.05934166287844066
agent_compute-ego_min0.0562496813138326
deviation-center-line_max1.201934424209917
deviation-center-line_mean1.057791998180345
deviation-center-line_min0.8784629240561268
deviation-heading_max7.311750160993953
deviation-heading_mean5.722035208834893
deviation-heading_median5.859422537183839
deviation-heading_min3.4642234515459145
driven_any_max2.355689058374569
driven_any_mean2.305049885985707
driven_any_median2.3552984295562713
driven_any_min2.1035978434262925
driven_lanedir_consec_max2.242615410961811
driven_lanedir_consec_mean1.336104921561677
driven_lanedir_consec_min0.875859363308106
driven_lanedir_max2.242615410961811
driven_lanedir_mean1.7652066378419686
driven_lanedir_median1.7192678956720222
driven_lanedir_min1.4582042128960828
in-drivable-lane_max2.7500000000000115
in-drivable-lane_mean1.4400000000000102
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1035978434262925, "sim_physics": 0.014811352726252103, "survival_time": 13.450000000000056, "driven_lanedir": 1.5202213074111568, "sim_render-ego": 0.05658438037319254, "in-drivable-lane": 1.550000000000014, "agent_compute-ego": 0.05934166287844066, "deviation-heading": 5.859422537183839, "set_robot_commands": 0.07397326838128186, "deviation-center-line": 0.8784629240561268, "driven_lanedir_consec": 1.0313035517645934, "sim_compute_sim_state": 0.035875994033529854, "sim_compute_performance-ego": 0.05771772125839744, "sim_compute_robot_state-ego": 0.05839827601351259}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355689058374569, "sim_physics": 0.014507993857065835, "survival_time": 14.950000000000076, "driven_lanedir": 2.242615410961811, "sim_render-ego": 0.05381230195363362, "in-drivable-lane": 0, "agent_compute-ego": 0.0562496813138326, "deviation-heading": 3.4642234515459145, "set_robot_commands": 0.07268127679824829, "deviation-center-line": 1.201934424209917, "driven_lanedir_consec": 2.242615410961811, "sim_compute_sim_state": 0.03411281744639079, "sim_compute_performance-ego": 0.05567871888478597, "sim_compute_robot_state-ego": 0.05732266902923584}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.355169053315221, "sim_physics": 0.015718080202738443, "survival_time": 14.950000000000076, "driven_lanedir": 1.4582042128960828, "sim_render-ego": 0.0561858868598938, "in-drivable-lane": 2.7500000000000115, "agent_compute-ego": 0.05803863843282064, "deviation-heading": 7.311750160993953, "set_robot_commands": 0.07325923840204875, "deviation-center-line": 1.0948979051500412, "driven_lanedir_consec": 0.875859363308106, "sim_compute_sim_state": 0.03513885656992594, "sim_compute_performance-ego": 0.05707306305567424, "sim_compute_robot_state-ego": 0.05799270788828532}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3552984295562713, "sim_physics": 0.01506225109100342, "survival_time": 14.950000000000076, "driven_lanedir": 1.7192678956720222, "sim_render-ego": 0.05670353571573893, "in-drivable-lane": 1.6000000000000068, "agent_compute-ego": 0.05983867486317952, "deviation-heading": 6.72411551882588, "set_robot_commands": 0.07373939593633017, "deviation-center-line": 1.0611801260458549, "driven_lanedir_consec": 1.2542193176534493, "sim_compute_sim_state": 0.03522492090861003, "sim_compute_performance-ego": 0.05830949624379476, "sim_compute_robot_state-ego": 0.05910419384638469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3554950452561805, "sim_physics": 0.014964796702067058, "survival_time": 14.950000000000076, "driven_lanedir": 1.8857243622687705, "sim_render-ego": 0.05500265995661418, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.05973402659098307, "deviation-heading": 5.250664375624881, "set_robot_commands": 0.07408522208531698, "deviation-center-line": 1.0524846114397846, "driven_lanedir_consec": 1.2765269641204249, "sim_compute_sim_state": 0.03517369270324707, "sim_compute_performance-ego": 0.0566237998008728, "sim_compute_robot_state-ego": 0.05807237307230632}}
set_robot_commands_max0.07408522208531698
set_robot_commands_mean0.07354768032064521
set_robot_commands_median0.07373939593633017
set_robot_commands_min0.07268127679824829
sim_compute_performance-ego_max0.05830949624379476
sim_compute_performance-ego_mean0.05708055984870504
sim_compute_performance-ego_median0.05707306305567424
sim_compute_performance-ego_min0.05567871888478597
sim_compute_robot_state-ego_max0.05910419384638469
sim_compute_robot_state-ego_mean0.05817804396994495
sim_compute_robot_state-ego_median0.05807237307230632
sim_compute_robot_state-ego_min0.05732266902923584
sim_compute_sim_state_max0.035875994033529854
sim_compute_sim_state_mean0.03510525633234073
sim_compute_sim_state_median0.03517369270324707
sim_compute_sim_state_min0.03411281744639079
sim_physics_max0.015718080202738443
sim_physics_mean0.015012894915825373
sim_physics_median0.014964796702067058
sim_physics_min0.014507993857065835
sim_render-ego_max0.05670353571573893
sim_render-ego_mean0.05565775297181462
sim_render-ego_median0.0561858868598938
sim_render-ego_min0.05381230195363362
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.650000000000071
survival_time_min13.450000000000056
No reset possible
183292715jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
183052771Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-2108210:18:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6568401103535195
survival_time_median4.449999999999992
deviation-center-line_median0.3855505969855864
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08637386831370267
agent_compute-ego_mean0.08465895637268557
agent_compute-ego_median0.085282396914354
agent_compute-ego_min0.08194885149106874
deviation-center-line_max1.2469381980748953
deviation-center-line_mean0.531585229724343
deviation-center-line_min0.22370927870760984
deviation-heading_max6.506783151942432
deviation-heading_mean1.8096488091294975
deviation-heading_median0.6665609404145512
deviation-heading_min0.5748616281658502
driven_any_max2.35502264147456
driven_any_mean0.9713185934372957
driven_any_median0.6681624618318277
driven_any_min0.48903448228546215
driven_lanedir_consec_max0.8778939155531527
driven_lanedir_consec_mean0.6658042472334758
driven_lanedir_consec_min0.4707465954274852
driven_lanedir_max1.6186330519262233
driven_lanedir_mean0.8139520745080897
driven_lanedir_median0.6568401103535195
driven_lanedir_min0.4707465954274852
in-drivable-lane_max2.0000000000000115
in-drivable-lane_mean0.4000000000000023
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.48903448228546215, "sim_physics": 0.025720222672419763, "survival_time": 3.349999999999996, "driven_lanedir": 0.4707465954274852, "sim_render-ego": 0.06148842555373462, "in-drivable-lane": 0, "agent_compute-ego": 0.085282396914354, "deviation-heading": 0.6991340001483806, "set_robot_commands": 0.07569690248859462, "deviation-center-line": 0.22370927870760984, "driven_lanedir_consec": 0.4707465954274852, "sim_compute_sim_state": 0.034862151786462584, "sim_compute_performance-ego": 0.0617976188659668, "sim_compute_robot_state-ego": 0.060912594866396774, "sim_compute_robot_state-npc0": 0.06283146943619002, "sim_compute_robot_state-npc1": 0.05931978439217183, "sim_compute_robot_state-npc2": 0.06078143262151462, "sim_compute_robot_state-npc3": 0.060997639129410926}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6681624618318277, "sim_physics": 0.027377999230717005, "survival_time": 4.449999999999992, "driven_lanedir": 0.6568401103535195, "sim_render-ego": 0.06115381369430028, "in-drivable-lane": 0, "agent_compute-ego": 0.08549054017227688, "deviation-heading": 0.6009043249762729, "set_robot_commands": 0.07672016808156217, "deviation-center-line": 0.3855505969855864, "driven_lanedir_consec": 0.6568401103535195, "sim_compute_sim_state": 0.03308815902538514, "sim_compute_performance-ego": 0.06112540705820148, "sim_compute_robot_state-ego": 0.059095029080851694, "sim_compute_robot_state-npc0": 0.06623762377192464, "sim_compute_robot_state-npc1": 0.0629957981323928, "sim_compute_robot_state-npc2": 0.06111001700497745, "sim_compute_robot_state-npc3": 0.06114269910233744}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.026471858496194357, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.05608426869570554, "in-drivable-lane": 0, "agent_compute-ego": 0.08194885149106874, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.07308487315754314, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.03292292814988356, "sim_compute_performance-ego": 0.05817071422115787, "sim_compute_robot_state-ego": 0.058781128663283125, "sim_compute_robot_state-npc0": 0.06220873109586946, "sim_compute_robot_state-npc1": 0.06004832603119232, "sim_compute_robot_state-npc2": 0.05848269148187323, "sim_compute_robot_state-npc3": 0.05764939496805379}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.35502264147456, "sim_physics": 0.02372692823410034, "survival_time": 14.950000000000076, "driven_lanedir": 1.6186330519262233, "sim_render-ego": 0.05945384661356608, "in-drivable-lane": 2.0000000000000115, "agent_compute-ego": 0.08419912497202556, "deviation-heading": 6.506783151942432, "set_robot_commands": 0.07553510824839274, "deviation-center-line": 1.2469381980748953, "driven_lanedir_consec": 0.8778939155531527, "sim_compute_sim_state": 0.033820932706197106, "sim_compute_performance-ego": 0.05907893657684326, "sim_compute_robot_state-ego": 0.05905256827672323, "sim_compute_robot_state-npc0": 0.0654181710879008, "sim_compute_robot_state-npc1": 0.06128053665161133, "sim_compute_robot_state-npc2": 0.060458144346872966, "sim_compute_robot_state-npc3": 0.06049654324849447}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.66013173045611, "sim_physics": 0.02495072917504744, "survival_time": 4.399999999999992, "driven_lanedir": 0.6504854738356993, "sim_render-ego": 0.05832069299437783, "in-drivable-lane": 0, "agent_compute-ego": 0.08637386831370267, "deviation-heading": 0.5748616281658502, "set_robot_commands": 0.0755194290117784, "deviation-center-line": 0.3804178622481398, "driven_lanedir_consec": 0.6504854738356993, "sim_compute_sim_state": 0.03320100090720437, "sim_compute_performance-ego": 0.05738540129228072, "sim_compute_robot_state-ego": 0.05779985135251826, "sim_compute_robot_state-npc0": 0.06349532983519814, "sim_compute_robot_state-npc1": 0.05989940599961714, "sim_compute_robot_state-npc2": 0.05800638686526905, "sim_compute_robot_state-npc3": 0.05926084518432617}}
set_robot_commands_max0.07672016808156217
set_robot_commands_mean0.0753112961975742
set_robot_commands_median0.07553510824839274
set_robot_commands_min0.07308487315754314
sim_compute_performance-ego_max0.0617976188659668
sim_compute_performance-ego_mean0.05951161560289002
sim_compute_performance-ego_median0.05907893657684326
sim_compute_performance-ego_min0.05738540129228072
sim_compute_robot_state-ego_max0.060912594866396774
sim_compute_robot_state-ego_mean0.05912823444795462
sim_compute_robot_state-ego_median0.05905256827672323
sim_compute_robot_state-ego_min0.05779985135251826
sim_compute_robot_state-npc0_max0.06623762377192464
sim_compute_robot_state-npc0_mean0.06403826504541661
sim_compute_robot_state-npc0_median0.06349532983519814
sim_compute_robot_state-npc0_min0.06220873109586946
sim_compute_robot_state-npc1_max0.0629957981323928
sim_compute_robot_state-npc1_mean0.06070877024139708
sim_compute_robot_state-npc1_median0.06004832603119232
sim_compute_robot_state-npc1_min0.05931978439217183
sim_compute_robot_state-npc2_max0.06111001700497745
sim_compute_robot_state-npc2_mean0.05976773446410146
sim_compute_robot_state-npc2_median0.060458144346872966
sim_compute_robot_state-npc2_min0.05800638686526905
sim_compute_robot_state-npc3_max0.06114269910233744
sim_compute_robot_state-npc3_mean0.05990942432652455
sim_compute_robot_state-npc3_median0.06049654324849447
sim_compute_robot_state-npc3_min0.05764939496805379
sim_compute_sim_state_max0.034862151786462584
sim_compute_sim_state_mean0.03357903451502655
sim_compute_sim_state_median0.03320100090720437
sim_compute_sim_state_min0.03292292814988356
sim_physics_max0.027377999230717005
sim_physics_mean0.025649547561695785
sim_physics_median0.025720222672419763
sim_physics_min0.02372692823410034
sim_render-ego_max0.06148842555373462
sim_render-ego_mean0.05930020951033686
sim_render-ego_median0.05945384661356608
sim_render-ego_min0.05608426869570554
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.34000000000001
survival_time_min3.349999999999996
No reset possible
183002778Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182962787Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182932795Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationfailednoidsc-rudolf-2108210:01:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182892800Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationfailednoidsc-rudolf-2108210:01:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182622691Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-2108210:15:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9950956763925678
survival_time_median10.500000000000014
deviation-center-line_median0.6232011567385014
in-drivable-lane_median0.39999999999999947


other stats
agent_compute-ego_max0.06308296322822571
agent_compute-ego_mean0.060089861429706
agent_compute-ego_median0.0606999397277832
agent_compute-ego_min0.05768326203028361
deviation-center-line_max1.113349215564051
deviation-center-line_mean0.7058026650514186
deviation-center-line_min0.42167706515814407
deviation-heading_max6.743132601709489
deviation-heading_mean4.035267363513252
deviation-heading_median3.43853161073366
deviation-heading_min2.102893867642292
driven_any_max2.355224382778739
driven_any_mean1.7232699911352023
driven_any_median1.6296414221670674
driven_any_min0.9091062791872035
driven_lanedir_consec_max1.4835894013001356
driven_lanedir_consec_mean1.0268480642922886
driven_lanedir_consec_min0.4521330915301818
driven_lanedir_max1.5643856293295637
driven_lanedir_mean1.2644844833616489
driven_lanedir_median1.301355718872153
driven_lanedir_min0.738841649775501
in-drivable-lane_max4.650000000000035
in-drivable-lane_mean1.4900000000000089
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6296414221670674, "sim_physics": 0.015406327020554316, "survival_time": 10.500000000000014, "driven_lanedir": 1.4835894013001356, "sim_render-ego": 0.05974336011069162, "in-drivable-lane": 0, "agent_compute-ego": 0.0606999397277832, "deviation-heading": 3.43853161073366, "set_robot_commands": 0.07371825263613746, "deviation-center-line": 0.6232011567385014, "driven_lanedir_consec": 1.4835894013001356, "sim_compute_sim_state": 0.03695197673070998, "sim_compute_performance-ego": 0.059769602048964726, "sim_compute_robot_state-ego": 0.059720935140337265}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9091062791872035, "sim_physics": 0.01551785388914477, "survival_time": 5.949999999999987, "driven_lanedir": 0.738841649775501, "sim_render-ego": 0.0548398915459128, "in-drivable-lane": 0.39999999999999947, "agent_compute-ego": 0.058013938054317184, "deviation-heading": 2.102893867642292, "set_robot_commands": 0.06868725063420143, "deviation-center-line": 0.42167706515814407, "driven_lanedir_consec": 0.4521330915301818, "sim_compute_sim_state": 0.034078275456148034, "sim_compute_performance-ego": 0.05769746043101078, "sim_compute_robot_state-ego": 0.0564524826883268}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.355224382778739, "sim_physics": 0.014581271807352702, "survival_time": 14.950000000000076, "driven_lanedir": 1.301355718872153, "sim_render-ego": 0.05500011444091797, "in-drivable-lane": 4.650000000000035, "agent_compute-ego": 0.05768326203028361, "deviation-heading": 5.07145433261216, "set_robot_commands": 0.07031979958216349, "deviation-center-line": 0.8026264324877179, "driven_lanedir_consec": 0.9691721347076654, "sim_compute_sim_state": 0.03458272139231364, "sim_compute_performance-ego": 0.05514022747675578, "sim_compute_robot_state-ego": 0.05724595228830973}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.355180273445244, "sim_physics": 0.016081812381744384, "survival_time": 14.950000000000076, "driven_lanedir": 1.5643856293295637, "sim_render-ego": 0.05962713797887166, "in-drivable-lane": 2.40000000000001, "agent_compute-ego": 0.06096920410792033, "deviation-heading": 6.743132601709489, "set_robot_commands": 0.07236539999643962, "deviation-center-line": 1.113349215564051, "driven_lanedir_consec": 0.9950956763925678, "sim_compute_sim_state": 0.03712514321009318, "sim_compute_performance-ego": 0.0609718934694926, "sim_compute_robot_state-ego": 0.060794684886932376}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.367197598097759, "sim_physics": 0.016039867292750965, "survival_time": 8.79999999999999, "driven_lanedir": 1.234250017530892, "sim_render-ego": 0.06328444182872772, "in-drivable-lane": 0, "agent_compute-ego": 0.06308296322822571, "deviation-heading": 2.820324404868658, "set_robot_commands": 0.07252951237288388, "deviation-center-line": 0.568159455308679, "driven_lanedir_consec": 1.234250017530892, "sim_compute_sim_state": 0.03851234371011907, "sim_compute_performance-ego": 0.06169980764389038, "sim_compute_robot_state-ego": 0.06166540357199582}}
set_robot_commands_max0.07371825263613746
set_robot_commands_mean0.07152404304436517
set_robot_commands_median0.07236539999643962
set_robot_commands_min0.06868725063420143
sim_compute_performance-ego_max0.06169980764389038
sim_compute_performance-ego_mean0.05905579821402286
sim_compute_performance-ego_median0.059769602048964726
sim_compute_performance-ego_min0.05514022747675578
sim_compute_robot_state-ego_max0.06166540357199582
sim_compute_robot_state-ego_mean0.059175891715180395
sim_compute_robot_state-ego_median0.059720935140337265
sim_compute_robot_state-ego_min0.0564524826883268
sim_compute_sim_state_max0.03851234371011907
sim_compute_sim_state_mean0.036250092099876785
sim_compute_sim_state_median0.03695197673070998
sim_compute_sim_state_min0.034078275456148034
sim_physics_max0.016081812381744384
sim_physics_mean0.015525426478309423
sim_physics_median0.01551785388914477
sim_physics_min0.014581271807352702
sim_render-ego_max0.06328444182872772
sim_render-ego_mean0.05849898918102435
sim_render-ego_median0.05962713797887166
sim_render-ego_min0.0548398915459128
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.03000000000003
survival_time_min5.949999999999987
No reset possible
182602779Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182472383Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:12:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12374251303298812
survival_time_median4.149999999999993
deviation-center-line_median0.07092102791858927
in-drivable-lane_median1.8499999999999976


other stats
agent_compute-ego_max0.20358222246170044
agent_compute-ego_mean0.18430190963715087
agent_compute-ego_median0.18312605539957685
agent_compute-ego_min0.1700754538178444
deviation-center-line_max0.3857373446360158
deviation-center-line_mean0.17275511787975134
deviation-center-line_min0.03065502591027881
deviation-heading_max5.7999384572180315
deviation-heading_mean2.5142376136274964
deviation-heading_median1.5720654507696683
deviation-heading_min0.6513882273606315
driven_any_max1.4766786761734647
driven_any_mean0.7210570414368423
driven_any_median0.36566008118587295
driven_any_min0.15909668773346783
driven_lanedir_consec_max0.5162597157221369
driven_lanedir_consec_mean0.22135053216228937
driven_lanedir_consec_min0.06386199768296708
driven_lanedir_max0.5162597157221369
driven_lanedir_mean0.22135053216228937
driven_lanedir_median0.12374251303298812
driven_lanedir_min0.06386199768296708
in-drivable-lane_max9.700000000000069
in-drivable-lane_mean3.920000000000021
in-drivable-lane_min0.4500000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15909668773346783, "sim_physics": 0.01554719607035319, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06386199768296708, "sim_render-ego": 0.061495419704552856, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1907992073983857, "deviation-heading": 0.6513882273606315, "set_robot_commands": 0.07618578275044759, "deviation-center-line": 0.03065502591027881, "driven_lanedir_consec": 0.06386199768296708, "sim_compute_sim_state": 0.04097406791918205, "sim_compute_performance-ego": 0.06352973706794507, "sim_compute_robot_state-ego": 0.06310876933011142}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4766786761734647, "sim_physics": 0.01604042689005534, "survival_time": 14.950000000000076, "driven_lanedir": 0.3317250350545653, "sim_render-ego": 0.06370819409688314, "in-drivable-lane": 9.700000000000069, "agent_compute-ego": 0.20358222246170044, "deviation-heading": 3.894309815407528, "set_robot_commands": 0.07720121701558431, "deviation-center-line": 0.3857373446360158, "driven_lanedir_consec": 0.3317250350545653, "sim_compute_sim_state": 0.04140421946843465, "sim_compute_performance-ego": 0.06492695331573486, "sim_compute_robot_state-ego": 0.06625478426615397}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.4391415674161174, "sim_physics": 0.01630488634109497, "survival_time": 14.950000000000076, "driven_lanedir": 0.5162597157221369, "sim_render-ego": 0.06579820553461711, "in-drivable-lane": 7.100000000000036, "agent_compute-ego": 0.18312605539957685, "deviation-heading": 5.7999384572180315, "set_robot_commands": 0.07796001672744751, "deviation-center-line": 0.34075505783446747, "driven_lanedir_consec": 0.5162597157221369, "sim_compute_sim_state": 0.04362361987431844, "sim_compute_performance-ego": 0.06676212549209595, "sim_compute_robot_state-ego": 0.06718333005905151}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16470819467528935, "sim_physics": 0.01702757179737091, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07116339931878946, "sim_render-ego": 0.0678207278251648, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1700754538178444, "deviation-heading": 0.6534861173816215, "set_robot_commands": 0.08011465519666672, "deviation-center-line": 0.03570713309940551, "driven_lanedir_consec": 0.07116339931878946, "sim_compute_sim_state": 0.044401854276657104, "sim_compute_performance-ego": 0.06704937666654587, "sim_compute_robot_state-ego": 0.06836407631635666}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36566008118587295, "sim_physics": 0.01807887295642531, "survival_time": 4.149999999999993, "driven_lanedir": 0.12374251303298812, "sim_render-ego": 0.0664895758571395, "in-drivable-lane": 1.8499999999999976, "agent_compute-ego": 0.17392660910824695, "deviation-heading": 1.5720654507696683, "set_robot_commands": 0.07786741026912827, "deviation-center-line": 0.07092102791858927, "driven_lanedir_consec": 0.12374251303298812, "sim_compute_sim_state": 0.042789094419364467, "sim_compute_performance-ego": 0.06452668718544834, "sim_compute_robot_state-ego": 0.06557843196822936}}
set_robot_commands_max0.08011465519666672
set_robot_commands_mean0.07786581639185489
set_robot_commands_median0.07786741026912827
set_robot_commands_min0.07618578275044759
sim_compute_performance-ego_max0.06704937666654587
sim_compute_performance-ego_mean0.06535897594555402
sim_compute_performance-ego_median0.06492695331573486
sim_compute_performance-ego_min0.06352973706794507
sim_compute_robot_state-ego_max0.06836407631635666
sim_compute_robot_state-ego_mean0.06609787838798059
sim_compute_robot_state-ego_median0.06625478426615397
sim_compute_robot_state-ego_min0.06310876933011142
sim_compute_sim_state_max0.044401854276657104
sim_compute_sim_state_mean0.04263857119159135
sim_compute_sim_state_median0.042789094419364467
sim_compute_sim_state_min0.04097406791918205
sim_physics_max0.01807887295642531
sim_physics_mean0.01659979081105994
sim_physics_median0.01630488634109497
sim_physics_min0.01554719607035319
sim_render-ego_max0.0678207278251648
sim_render-ego_mean0.06506242460367148
sim_render-ego_median0.06579820553461711
sim_render-ego_min0.061495419704552856
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.460000000000029
survival_time_min1.6000000000000008
No reset possible
182442401Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:55
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182092598Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:17:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3718955388188578
survival_time_median14.250000000000068
deviation-center-line_median1.0913625725679328
in-drivable-lane_median1.2000000000000002


other stats
agent_compute-ego_max0.06185475399619655
agent_compute-ego_mean0.06019480685606752
agent_compute-ego_median0.06052307593516815
agent_compute-ego_min0.05758928140004476
deviation-center-line_max1.3446469219133124
deviation-center-line_mean0.9996385490926424
deviation-center-line_min0.441975693506799
deviation-heading_max5.380312368891966
deviation-heading_mean4.083371647398661
deviation-heading_median4.153144182407269
deviation-heading_min2.459843470763079
driven_any_max2.3555959043314787
driven_any_mean2.078597272898532
driven_any_median2.243086731015725
driven_any_min1.3029696106309303
driven_lanedir_consec_max2.001297202025861
driven_lanedir_consec_mean1.4349105348896465
driven_lanedir_consec_min1.0775236221846518
driven_lanedir_max2.0609409749550753
driven_lanedir_mean1.734693288107308
driven_lanedir_median1.7585123811007786
driven_lanedir_min1.1366299814157594
in-drivable-lane_max1.3000000000000185
in-drivable-lane_mean1.000000000000005
in-drivable-lane_min0.4000000000000048
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.135761711385022, "sim_physics": 0.01468478629003951, "survival_time": 13.65000000000006, "driven_lanedir": 1.7160859010390654, "sim_render-ego": 0.05371032966362251, "in-drivable-lane": 1.2000000000000002, "agent_compute-ego": 0.06052307593516815, "deviation-heading": 4.592333207438047, "set_robot_commands": 0.07407154093731891, "deviation-center-line": 1.1335923412166118, "driven_lanedir_consec": 1.0775236221846518, "sim_compute_sim_state": 0.03528877754351158, "sim_compute_performance-ego": 0.056252752031598775, "sim_compute_robot_state-ego": 0.05827971081157307}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.243086731015725, "sim_physics": 0.014862317369695297, "survival_time": 14.250000000000068, "driven_lanedir": 1.7585123811007786, "sim_render-ego": 0.05407543600651256, "in-drivable-lane": 1.2500000000000062, "agent_compute-ego": 0.06185475399619655, "deviation-heading": 5.380312368891966, "set_robot_commands": 0.07240669685497618, "deviation-center-line": 1.0913625725679328, "driven_lanedir_consec": 1.3718955388188578, "sim_compute_sim_state": 0.03546237778245357, "sim_compute_performance-ego": 0.05705245837830661, "sim_compute_robot_state-ego": 0.05857486390230948}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555959043314787, "sim_physics": 0.01455013354619344, "survival_time": 14.950000000000076, "driven_lanedir": 2.001297202025861, "sim_render-ego": 0.05576692501703898, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.05940068324406942, "deviation-heading": 3.8312250074929457, "set_robot_commands": 0.07178133169809978, "deviation-center-line": 1.3446469219133124, "driven_lanedir_consec": 2.001297202025861, "sim_compute_sim_state": 0.034911410808563234, "sim_compute_performance-ego": 0.056577125390370686, "sim_compute_robot_state-ego": 0.05939144372940063}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3029696106309303, "sim_physics": 0.015151451031366983, "survival_time": 8.399999999999984, "driven_lanedir": 1.1366299814157594, "sim_render-ego": 0.05557702978452047, "in-drivable-lane": 0.4000000000000048, "agent_compute-ego": 0.06160623970485869, "deviation-heading": 2.459843470763079, "set_robot_commands": 0.07360100178491502, "deviation-center-line": 0.441975693506799, "driven_lanedir_consec": 1.1366299814157594, "sim_compute_sim_state": 0.034644844986143564, "sim_compute_performance-ego": 0.056129793326059975, "sim_compute_robot_state-ego": 0.057655184041886104}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3555724071295048, "sim_physics": 0.013993172645568848, "survival_time": 14.950000000000076, "driven_lanedir": 2.0609409749550753, "sim_render-ego": 0.054272541999816896, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.05758928140004476, "deviation-heading": 4.153144182407269, "set_robot_commands": 0.07106000502904256, "deviation-center-line": 0.986615216258556, "driven_lanedir_consec": 1.5872063300031, "sim_compute_sim_state": 0.03365384101867676, "sim_compute_performance-ego": 0.05660493532816569, "sim_compute_robot_state-ego": 0.056529270807902016}}
set_robot_commands_max0.07407154093731891
set_robot_commands_mean0.07258411526087047
set_robot_commands_median0.07240669685497618
set_robot_commands_min0.07106000502904256
sim_compute_performance-ego_max0.05705245837830661
sim_compute_performance-ego_mean0.05652341289090035
sim_compute_performance-ego_median0.056577125390370686
sim_compute_performance-ego_min0.056129793326059975
sim_compute_robot_state-ego_max0.05939144372940063
sim_compute_robot_state-ego_mean0.058086094658614265
sim_compute_robot_state-ego_median0.05827971081157307
sim_compute_robot_state-ego_min0.056529270807902016
sim_compute_sim_state_max0.03546237778245357
sim_compute_sim_state_mean0.03479225042786974
sim_compute_sim_state_median0.034911410808563234
sim_compute_sim_state_min0.03365384101867676
sim_physics_max0.015151451031366983
sim_physics_mean0.014648372176572815
sim_physics_median0.01468478629003951
sim_physics_min0.013993172645568848
sim_render-ego_max0.05576692501703898
sim_render-ego_mean0.05468045249430228
sim_render-ego_median0.054272541999816896
sim_render-ego_min0.05371032966362251
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.240000000000055
survival_time_min8.399999999999984
No reset possible
182062604Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.059574585694533125
agent_compute-ego_mean0.056538029784045096
agent_compute-ego_median0.05654272280241314
agent_compute-ego_min0.05408253611587897
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.01610094454230332, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.053596313406781455, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05408253611587897, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.06920538588268, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03519606881025361, "sim_compute_performance-ego": 0.05412988837172345, "sim_compute_robot_state-ego": 0.05831052326574558}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.014581524408780612, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05796206914461576, "in-drivable-lane": 0, "agent_compute-ego": 0.059574585694533125, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.06817159285912147, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03735700937417837, "sim_compute_performance-ego": 0.057477089074941784, "sim_compute_robot_state-ego": 0.05486859725071834}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.016523422078883396, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05894846611834587, "in-drivable-lane": 0, "agent_compute-ego": 0.05655920251886895, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07272933899088109, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.0395954263971207, "sim_compute_performance-ego": 0.05955978657336945, "sim_compute_robot_state-ego": 0.061108918900185445}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.017769103521829123, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05483022102942833, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05593110178853129, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07210777094075968, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03557284323723762, "sim_compute_performance-ego": 0.05913350084325769, "sim_compute_robot_state-ego": 0.05905464717320034}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.0157213336543033, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05204132356141743, "in-drivable-lane": 0, "agent_compute-ego": 0.05654272280241314, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07251127142655223, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03556912823727256, "sim_compute_performance-ego": 0.05369541519566586, "sim_compute_robot_state-ego": 0.058011061266848914}}
set_robot_commands_max0.07272933899088109
set_robot_commands_mean0.07094507201999889
set_robot_commands_median0.07210777094075968
set_robot_commands_min0.06817159285912147
sim_compute_performance-ego_max0.05955978657336945
sim_compute_performance-ego_mean0.05679913601179164
sim_compute_performance-ego_median0.057477089074941784
sim_compute_performance-ego_min0.05369541519566586
sim_compute_robot_state-ego_max0.061108918900185445
sim_compute_robot_state-ego_mean0.05827074957133972
sim_compute_robot_state-ego_median0.05831052326574558
sim_compute_robot_state-ego_min0.05486859725071834
sim_compute_sim_state_max0.0395954263971207
sim_compute_sim_state_mean0.03665809521121258
sim_compute_sim_state_median0.03557284323723762
sim_compute_sim_state_min0.03519606881025361
sim_physics_max0.017769103521829123
sim_physics_mean0.01613926564121995
sim_physics_median0.01610094454230332
sim_physics_min0.014581524408780612
sim_render-ego_max0.05894846611834587
sim_render-ego_mean0.05547567865211776
sim_render-ego_median0.05483022102942833
sim_render-ego_min0.05204132356141743
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
182022640Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:05:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05935729712974734
agent_compute-ego_mean0.057518829125019336
agent_compute-ego_median0.05796093207139235
agent_compute-ego_min0.0558546231343196
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.015876630457436165, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05470834708795315, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05935729712974734, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07230338236180747, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.033534535547582116, "sim_compute_performance-ego": 0.05573746053183951, "sim_compute_robot_state-ego": 0.05645497252301472}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.014720577460068924, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05163388985853929, "in-drivable-lane": 0, "agent_compute-ego": 0.0558546231343196, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07385071424337533, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.036914357772240274, "sim_compute_performance-ego": 0.05344482568594126, "sim_compute_robot_state-ego": 0.05787783402663011}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.015466375553861576, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05411821730593418, "in-drivable-lane": 0, "agent_compute-ego": 0.05625411804686201, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.06909650944648905, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03699174840399559, "sim_compute_performance-ego": 0.05464066850378158, "sim_compute_robot_state-ego": 0.058993050392637865}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.018505507773095436, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.055198839732578824, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05796093207139235, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07143617986322759, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03592828603891226, "sim_compute_performance-ego": 0.057503469697721715, "sim_compute_robot_state-ego": 0.05915172807462923}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.01472338877226177, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05937497866781134, "in-drivable-lane": 0, "agent_compute-ego": 0.05816717524277536, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07182821474577251, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03445917054226524, "sim_compute_performance-ego": 0.05766325875332481, "sim_compute_robot_state-ego": 0.057775484888177166}}
set_robot_commands_max0.07385071424337533
set_robot_commands_mean0.07170300013213439
set_robot_commands_median0.07182821474577251
set_robot_commands_min0.06909650944648905
sim_compute_performance-ego_max0.05766325875332481
sim_compute_performance-ego_mean0.055797936634521775
sim_compute_performance-ego_median0.05573746053183951
sim_compute_performance-ego_min0.05344482568594126
sim_compute_robot_state-ego_max0.05915172807462923
sim_compute_robot_state-ego_mean0.058050613981017817
sim_compute_robot_state-ego_median0.05787783402663011
sim_compute_robot_state-ego_min0.05645497252301472
sim_compute_sim_state_max0.03699174840399559
sim_compute_sim_state_mean0.035565619660999095
sim_compute_sim_state_median0.03592828603891226
sim_compute_sim_state_min0.033534535547582116
sim_physics_max0.018505507773095436
sim_physics_mean0.015858496003344776
sim_physics_median0.015466375553861576
sim_physics_min0.014720577460068924
sim_render-ego_max0.05937497866781134
sim_render-ego_mean0.05500685453056335
sim_render-ego_median0.05470834708795315
sim_render-ego_min0.05163388985853929
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
181972715jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:02:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181942742Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationfailednoidsc-rudolf-2108210:02:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181852843Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:54
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181762844Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-2108210:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181662831Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181582826Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6896127428821732
survival_time_median1.1500000000000004
deviation-center-line_median0.05610305022565209
in-drivable-lane_median0.20000000000000007


other stats
agent_compute-ego_max0.15078631043434143
agent_compute-ego_mean0.14401602845014252
agent_compute-ego_median0.14120058502469743
agent_compute-ego_min0.13872670090716818
deviation-center-line_max0.07504669169058735
deviation-center-line_mean0.05629372528587068
deviation-center-line_min0.031337769455374115
deviation-heading_max0.4695314592890065
deviation-heading_mean0.28295632700130013
deviation-heading_median0.28969351082790473
deviation-heading_min0.13822734158708538
driven_any_max1.1972535692377095
driven_any_mean1.069550703128448
driven_any_median1.0381750331691957
driven_any_min1.0257183998178268
driven_lanedir_consec_max0.8123144800841251
driven_lanedir_consec_mean0.6312226729648216
driven_lanedir_consec_min0.4373052105850964
driven_lanedir_max0.9325407987545682
driven_lanedir_mean0.7224147694584564
driven_lanedir_median0.8123144800841251
driven_lanedir_min0.48318684247252186
in-drivable-lane_max0.6000000000000004
in-drivable-lane_mean0.3000000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.02740567922592163, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.06074984584535871, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.14120058502469743, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07634978634970528, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.03554728201457432, "sim_compute_performance-ego": 0.05849266052246094, "sim_compute_robot_state-ego": 0.06293862206595284, "sim_compute_robot_state-npc0": 0.06954218660082136, "sim_compute_robot_state-npc1": 0.061050747122083394, "sim_compute_robot_state-npc2": 0.06072591883795602, "sim_compute_robot_state-npc3": 0.05960672242300851}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.024007896582285564, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.06328225135803223, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.15078631043434143, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.07627147436141968, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03528321782747904, "sim_compute_performance-ego": 0.0599710742632548, "sim_compute_robot_state-ego": 0.05930054187774658, "sim_compute_robot_state-npc0": 0.07436071832974751, "sim_compute_robot_state-npc1": 0.06452731291453044, "sim_compute_robot_state-npc2": 0.06506088376045227, "sim_compute_robot_state-npc3": 0.06481464703877766}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.027605274449224056, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.06869714156441066, "in-drivable-lane": 0, "agent_compute-ego": 0.14849983090939728, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.07601884137029233, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.03520366419916567, "sim_compute_performance-ego": 0.06392127534617549, "sim_compute_robot_state-ego": 0.06481415292491084, "sim_compute_robot_state-npc0": 0.07247534005538277, "sim_compute_robot_state-npc1": 0.07014528564784837, "sim_compute_robot_state-npc2": 0.0643046005912449, "sim_compute_robot_state-npc3": 0.0658659727677055}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.025645079820052437, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.0596638762432596, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.13872670090716818, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.07481640318165654, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.03423081273617952, "sim_compute_performance-ego": 0.059804377348526665, "sim_compute_robot_state-ego": 0.06219904319099758, "sim_compute_robot_state-npc0": 0.06270495704982591, "sim_compute_robot_state-npc1": 0.06458721990170686, "sim_compute_robot_state-npc2": 0.06117081642150879, "sim_compute_robot_state-npc3": 0.061580958573714546}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.023164624753205673, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.06421552533688753, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.14086671497510828, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.07818854373434315, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.03304370589878248, "sim_compute_performance-ego": 0.06369051725968071, "sim_compute_robot_state-ego": 0.06043337739032248, "sim_compute_robot_state-npc0": 0.07466085060783055, "sim_compute_robot_state-npc1": 0.06513344723245372, "sim_compute_robot_state-npc2": 0.05828915471615999, "sim_compute_robot_state-npc3": 0.061594310014144234}}
set_robot_commands_max0.07818854373434315
set_robot_commands_mean0.0763290097994834
set_robot_commands_median0.07627147436141968
set_robot_commands_min0.07481640318165654
sim_compute_performance-ego_max0.06392127534617549
sim_compute_performance-ego_mean0.06117598094801972
sim_compute_performance-ego_median0.0599710742632548
sim_compute_performance-ego_min0.05849266052246094
sim_compute_robot_state-ego_max0.06481415292491084
sim_compute_robot_state-ego_mean0.061937147489986064
sim_compute_robot_state-ego_median0.06219904319099758
sim_compute_robot_state-ego_min0.05930054187774658
sim_compute_robot_state-npc0_max0.07466085060783055
sim_compute_robot_state-npc0_mean0.07074881052872163
sim_compute_robot_state-npc0_median0.07247534005538277
sim_compute_robot_state-npc0_min0.06270495704982591
sim_compute_robot_state-npc1_max0.07014528564784837
sim_compute_robot_state-npc1_mean0.06508880256372455
sim_compute_robot_state-npc1_median0.06458721990170686
sim_compute_robot_state-npc1_min0.061050747122083394
sim_compute_robot_state-npc2_max0.06506088376045227
sim_compute_robot_state-npc2_mean0.0619102748654644
sim_compute_robot_state-npc2_median0.06117081642150879
sim_compute_robot_state-npc2_min0.05828915471615999
sim_compute_robot_state-npc3_max0.0658659727677055
sim_compute_robot_state-npc3_mean0.06269252216347009
sim_compute_robot_state-npc3_median0.061594310014144234
sim_compute_robot_state-npc3_min0.05960672242300851
sim_compute_sim_state_max0.03554728201457432
sim_compute_sim_state_mean0.03466173653523621
sim_compute_sim_state_median0.03520366419916567
sim_compute_sim_state_min0.03304370589878248
sim_physics_max0.027605274449224056
sim_physics_mean0.025565710966137876
sim_physics_median0.025645079820052437
sim_physics_min0.023164624753205673
sim_render-ego_max0.06869714156441066
sim_render-ego_mean0.06332172806958974
sim_render-ego_median0.06328225135803223
sim_render-ego_min0.0596638762432596
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2100000000000004
survival_time_min1.1500000000000004
No reset possible
181522804Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.14986884075662363
agent_compute-ego_mean0.1430583811631809
agent_compute-ego_median0.14413219028049046
agent_compute-ego_min0.1324632293299625
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.012641740881878395, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06564930210942807, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.14986884075662363, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.0779335706130318, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.0403803535129713, "sim_compute_performance-ego": 0.06783440838689389, "sim_compute_robot_state-ego": 0.06457661545794943}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.013481793196304983, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.06551347608151643, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1469991518103558, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07623126195824664, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.04076893433280613, "sim_compute_performance-ego": 0.06611536896747092, "sim_compute_robot_state-ego": 0.06739006871762483}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.013580625707452948, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.062928860837763, "in-drivable-lane": 0, "agent_compute-ego": 0.14182849363847214, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.0747003663669933, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.03648312525315718, "sim_compute_performance-ego": 0.06357787955891002, "sim_compute_robot_state-ego": 0.0647850361737338}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.013673067092895508, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.06597654024759929, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.14413219028049046, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.0721935166252984, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.04061373074849447, "sim_compute_performance-ego": 0.06156068378024631, "sim_compute_robot_state-ego": 0.06175631946987576}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.012378491853412828, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06132818523206209, "in-drivable-lane": 0, "agent_compute-ego": 0.1324632293299625, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.07345178252772282, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.036521974362825095, "sim_compute_performance-ego": 0.060303299050582085, "sim_compute_robot_state-ego": 0.060122778541163394}}
set_robot_commands_max0.0779335706130318
set_robot_commands_mean0.07490209961825858
set_robot_commands_median0.0747003663669933
set_robot_commands_min0.0721935166252984
sim_compute_performance-ego_max0.06783440838689389
sim_compute_performance-ego_mean0.06387832794882065
sim_compute_performance-ego_median0.06357787955891002
sim_compute_performance-ego_min0.060303299050582085
sim_compute_robot_state-ego_max0.06739006871762483
sim_compute_robot_state-ego_mean0.06372616367206944
sim_compute_robot_state-ego_median0.06457661545794943
sim_compute_robot_state-ego_min0.060122778541163394
sim_compute_sim_state_max0.04076893433280613
sim_compute_sim_state_mean0.03895362364205083
sim_compute_sim_state_median0.0403803535129713
sim_compute_sim_state_min0.03648312525315718
sim_physics_max0.013673067092895508
sim_physics_mean0.013151143746388932
sim_physics_median0.013481793196304983
sim_physics_min0.012378491853412828
sim_render-ego_max0.06597654024759929
sim_render-ego_mean0.06427927290167378
sim_render-ego_median0.06551347608151643
sim_render-ego_min0.06132818523206209
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
181442795Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-2108210:22:08
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
180882707Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8851457673653744
survival_time_median3.4999999999999956
deviation-center-line_median0.23932484147997415
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0722341707774571
agent_compute-ego_mean0.06796894107998616
agent_compute-ego_median0.06704223496573312
agent_compute-ego_min0.06559279057886694
deviation-center-line_max0.30218677769694013
deviation-center-line_mean0.2216864280827174
deviation-center-line_min0.10401604027369428
deviation-heading_max1.8463619024917823
deviation-heading_mean0.91118441233242
deviation-heading_median0.6243056250855269
deviation-heading_min0.3721329959876409
driven_any_max1.8111318011808593
driven_any_mean1.1266515511366988
driven_any_median1.124125141763516
driven_any_min0.56223996040486
driven_lanedir_consec_max1.0985805175011678
driven_lanedir_consec_mean0.8225630383441367
driven_lanedir_consec_min0.457250427887026
driven_lanedir_max1.0985805175011678
driven_lanedir_mean0.8692853291483784
driven_lanedir_median0.8851457673653744
driven_lanedir_min0.457250427887026
in-drivable-lane_max2.399999999999994
in-drivable-lane_mean0.5299999999999988
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.56223996040486, "sim_physics": 0.0214085256731188, "survival_time": 1.850000000000001, "driven_lanedir": 0.457250427887026, "sim_render-ego": 0.06337836626413706, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.06794451378487251, "deviation-heading": 0.3721329959876409, "set_robot_commands": 0.07421323415395376, "deviation-center-line": 0.10401604027369428, "driven_lanedir_consec": 0.457250427887026, "sim_compute_sim_state": 0.03702540655393858, "sim_compute_performance-ego": 0.06345736658250964, "sim_compute_robot_state-ego": 0.0636204126718882, "sim_compute_robot_state-npc0": 0.06708970585384884, "sim_compute_robot_state-npc1": 0.06323608192237648, "sim_compute_robot_state-npc2": 0.06456271377769676, "sim_compute_robot_state-npc3": 0.06607224490191485}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8111318011808593, "sim_physics": 0.023378450258643227, "survival_time": 5.649999999999988, "driven_lanedir": 0.8071453359009868, "sim_render-ego": 0.06490925982990096, "in-drivable-lane": 2.399999999999994, "agent_compute-ego": 0.06703099529300116, "deviation-heading": 1.8463619024917823, "set_robot_commands": 0.07427223382797916, "deviation-center-line": 0.2046300992082749, "driven_lanedir_consec": 0.5735338818797775, "sim_compute_sim_state": 0.03669914946091914, "sim_compute_performance-ego": 0.06453195926362434, "sim_compute_robot_state-ego": 0.06461851997713072, "sim_compute_robot_state-npc0": 0.07015742031873855, "sim_compute_robot_state-npc1": 0.06596989336266981, "sim_compute_robot_state-npc2": 0.06514209139663561, "sim_compute_robot_state-npc3": 0.06597647624733173}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8996560480244998, "sim_physics": 0.023184720958982195, "survival_time": 2.799999999999998, "driven_lanedir": 0.8851457673653744, "sim_render-ego": 0.06634657723563057, "in-drivable-lane": 0, "agent_compute-ego": 0.0722341707774571, "deviation-heading": 0.4143112168154284, "set_robot_commands": 0.07928785255977086, "deviation-center-line": 0.2582743817547035, "driven_lanedir_consec": 0.8851457673653744, "sim_compute_sim_state": 0.03734683990478515, "sim_compute_performance-ego": 0.06386350733893258, "sim_compute_robot_state-ego": 0.06455283505575997, "sim_compute_robot_state-npc0": 0.07521232536860875, "sim_compute_robot_state-npc1": 0.06932379943983895, "sim_compute_robot_state-npc2": 0.06870069674083165, "sim_compute_robot_state-npc3": 0.0668925302369254}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.124125141763516, "sim_physics": 0.024309536388942173, "survival_time": 3.4999999999999956, "driven_lanedir": 1.0985805175011678, "sim_render-ego": 0.06635944502694266, "in-drivable-lane": 0, "agent_compute-ego": 0.06704223496573312, "deviation-heading": 0.6243056250855269, "set_robot_commands": 0.07549049173082624, "deviation-center-line": 0.30218677769694013, "driven_lanedir_consec": 1.0985805175011678, "sim_compute_sim_state": 0.036945891380310056, "sim_compute_performance-ego": 0.06377109118870326, "sim_compute_robot_state-ego": 0.06540295737130301, "sim_compute_robot_state-npc0": 0.06909767900194441, "sim_compute_robot_state-npc1": 0.06542167322976249, "sim_compute_robot_state-npc2": 0.06660200187138149, "sim_compute_robot_state-npc3": 0.06566798005785261}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2361048043097582, "sim_physics": 0.02182729213268726, "survival_time": 3.8499999999999943, "driven_lanedir": 1.098304597087337, "sim_render-ego": 0.0614968306058413, "in-drivable-lane": 0, "agent_compute-ego": 0.06559279057886694, "deviation-heading": 1.2988103212817204, "set_robot_commands": 0.0750339650488519, "deviation-center-line": 0.23932484147997415, "driven_lanedir_consec": 1.098304597087337, "sim_compute_sim_state": 0.033506703067135504, "sim_compute_performance-ego": 0.05979248145958046, "sim_compute_robot_state-ego": 0.0599543336149934, "sim_compute_robot_state-npc0": 0.06443840187865418, "sim_compute_robot_state-npc1": 0.06296457872762308, "sim_compute_robot_state-npc2": 0.06101276967432592, "sim_compute_robot_state-npc3": 0.0611922431301761}}
set_robot_commands_max0.07928785255977086
set_robot_commands_mean0.07565955546427638
set_robot_commands_median0.0750339650488519
set_robot_commands_min0.07421323415395376
sim_compute_performance-ego_max0.06453195926362434
sim_compute_performance-ego_mean0.06308328116667006
sim_compute_performance-ego_median0.06377109118870326
sim_compute_performance-ego_min0.05979248145958046
sim_compute_robot_state-ego_max0.06540295737130301
sim_compute_robot_state-ego_mean0.06362981173821507
sim_compute_robot_state-ego_median0.06455283505575997
sim_compute_robot_state-ego_min0.0599543336149934
sim_compute_robot_state-npc0_max0.07521232536860875
sim_compute_robot_state-npc0_mean0.06919910648435895
sim_compute_robot_state-npc0_median0.06909767900194441
sim_compute_robot_state-npc0_min0.06443840187865418
sim_compute_robot_state-npc1_max0.06932379943983895
sim_compute_robot_state-npc1_mean0.06538320533645417
sim_compute_robot_state-npc1_median0.06542167322976249
sim_compute_robot_state-npc1_min0.06296457872762308
sim_compute_robot_state-npc2_max0.06870069674083165
sim_compute_robot_state-npc2_mean0.06520405469217427
sim_compute_robot_state-npc2_median0.06514209139663561
sim_compute_robot_state-npc2_min0.06101276967432592
sim_compute_robot_state-npc3_max0.0668925302369254
sim_compute_robot_state-npc3_mean0.06516029491484014
sim_compute_robot_state-npc3_median0.06597647624733173
sim_compute_robot_state-npc3_min0.0611922431301761
sim_compute_sim_state_max0.03734683990478515
sim_compute_sim_state_mean0.03630479807341769
sim_compute_sim_state_median0.036945891380310056
sim_compute_sim_state_min0.033506703067135504
sim_physics_max0.024309536388942173
sim_physics_mean0.02282170508247473
sim_physics_median0.023184720958982195
sim_physics_min0.0214085256731188
sim_render-ego_max0.06635944502694266
sim_render-ego_mean0.06449809579249052
sim_render-ego_median0.06490925982990096
sim_render-ego_min0.0614968306058413
simulation-passed1
survival_time_max5.649999999999988
survival_time_mean3.5299999999999954
survival_time_min1.850000000000001
No reset possible
180792694Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-2108210:10:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8869412521882549
survival_time_median2.799999999999998
deviation-center-line_median0.24799348333678065
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07246093273162842
agent_compute-ego_mean0.06665000382088003
agent_compute-ego_median0.06567346288802776
agent_compute-ego_min0.06086374212194373
deviation-center-line_max0.4537960424372494
deviation-center-line_mean0.2841354114555406
deviation-center-line_min0.20277586086040028
deviation-heading_max1.139954272688804
deviation-heading_mean0.5122812266797816
deviation-heading_median0.3631059086936373
deviation-heading_min0.3210833690622274
driven_any_max2.136130346421535
driven_any_mean1.1020709026168964
driven_any_median0.8996895288569846
driven_any_min0.7551425155777147
driven_lanedir_consec_max1.0408998228904
driven_lanedir_consec_mean0.8740182730781962
driven_lanedir_consec_min0.7430857843740948
driven_lanedir_max1.585258380416407
driven_lanedir_mean0.9828899845833976
driven_lanedir_median0.8869412521882549
driven_lanedir_min0.7430857843740948
in-drivable-lane_max1.4499999999999948
in-drivable-lane_mean0.289999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.136130346421535, "sim_physics": 0.021803756996437357, "survival_time": 6.749999999999984, "driven_lanedir": 1.585258380416407, "sim_render-ego": 0.061660819583468966, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06086374212194373, "deviation-heading": 1.139954272688804, "set_robot_commands": 0.07397137924476906, "deviation-center-line": 0.4537960424372494, "driven_lanedir_consec": 1.0408998228904, "sim_compute_sim_state": 0.03447970637568721, "sim_compute_performance-ego": 0.06099523968166775, "sim_compute_robot_state-ego": 0.06098621509693287, "sim_compute_robot_state-npc0": 0.06507623107345016, "sim_compute_robot_state-npc1": 0.06123493159258807, "sim_compute_robot_state-npc2": 0.06115879306086787, "sim_compute_robot_state-npc3": 0.06235142990394875}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9158755208280266, "sim_physics": 0.022544718625252706, "survival_time": 2.849999999999998, "driven_lanedir": 0.9049526795223062, "sim_render-ego": 0.05645490529244406, "in-drivable-lane": 0, "agent_compute-ego": 0.06323543347810444, "deviation-heading": 0.3459858274196875, "set_robot_commands": 0.07218163055286073, "deviation-center-line": 0.2743794195798585, "driven_lanedir_consec": 0.9049526795223062, "sim_compute_sim_state": 0.031843637165270354, "sim_compute_performance-ego": 0.05682749078984846, "sim_compute_robot_state-ego": 0.05699225894191809, "sim_compute_robot_state-npc0": 0.05984925387198465, "sim_compute_robot_state-npc1": 0.05636834679988392, "sim_compute_robot_state-npc2": 0.0553608400779858, "sim_compute_robot_state-npc3": 0.05687066546657629}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7551425155777147, "sim_physics": 0.021325831717633185, "survival_time": 2.3499999999999996, "driven_lanedir": 0.7430857843740948, "sim_render-ego": 0.05770541251973903, "in-drivable-lane": 0, "agent_compute-ego": 0.06567346288802776, "deviation-heading": 0.3631059086936373, "set_robot_commands": 0.07528026053246031, "deviation-center-line": 0.20277586086040028, "driven_lanedir_consec": 0.7430857843740948, "sim_compute_sim_state": 0.03382321114235736, "sim_compute_performance-ego": 0.05868384685922176, "sim_compute_robot_state-ego": 0.06153110240368133, "sim_compute_robot_state-npc0": 0.06125282226724828, "sim_compute_robot_state-npc1": 0.05853330328109416, "sim_compute_robot_state-npc2": 0.05842575621097646, "sim_compute_robot_state-npc3": 0.05941692311713036}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8996895288569846, "sim_physics": 0.0233836259160723, "survival_time": 2.799999999999998, "driven_lanedir": 0.8869412521882549, "sim_render-ego": 0.06950962969235011, "in-drivable-lane": 0, "agent_compute-ego": 0.07101644788469587, "deviation-heading": 0.3912767555345518, "set_robot_commands": 0.08462272371564593, "deviation-center-line": 0.24799348333678065, "driven_lanedir_consec": 0.8869412521882549, "sim_compute_sim_state": 0.03872727070535932, "sim_compute_performance-ego": 0.06837121077946254, "sim_compute_robot_state-ego": 0.06670168893677848, "sim_compute_robot_state-npc0": 0.07307863661221095, "sim_compute_robot_state-npc1": 0.06930229067802429, "sim_compute_robot_state-npc2": 0.06689795425959996, "sim_compute_robot_state-npc3": 0.06705213444573539}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.803516601400221, "sim_physics": 0.02272290229797363, "survival_time": 2.499999999999999, "driven_lanedir": 0.7942118264159251, "sim_render-ego": 0.06635749340057373, "in-drivable-lane": 0, "agent_compute-ego": 0.07246093273162842, "deviation-heading": 0.3210833690622274, "set_robot_commands": 0.07767411708831787, "deviation-center-line": 0.24173225106341437, "driven_lanedir_consec": 0.7942118264159251, "sim_compute_sim_state": 0.03843526840209961, "sim_compute_performance-ego": 0.06555856227874755, "sim_compute_robot_state-ego": 0.06650738716125489, "sim_compute_robot_state-npc0": 0.07211461067199706, "sim_compute_robot_state-npc1": 0.06686586856842042, "sim_compute_robot_state-npc2": 0.0652340841293335, "sim_compute_robot_state-npc3": 0.0662732982635498}}
set_robot_commands_max0.08462272371564593
set_robot_commands_mean0.07674602222681078
set_robot_commands_median0.07528026053246031
set_robot_commands_min0.07218163055286073
sim_compute_performance-ego_max0.06837121077946254
sim_compute_performance-ego_mean0.062087270077789615
sim_compute_performance-ego_median0.06099523968166775
sim_compute_performance-ego_min0.05682749078984846
sim_compute_robot_state-ego_max0.06670168893677848
sim_compute_robot_state-ego_mean0.06254373050811313
sim_compute_robot_state-ego_median0.06153110240368133
sim_compute_robot_state-ego_min0.05699225894191809
sim_compute_robot_state-npc0_max0.07307863661221095
sim_compute_robot_state-npc0_mean0.06627431089937823
sim_compute_robot_state-npc0_median0.06507623107345016
sim_compute_robot_state-npc0_min0.05984925387198465
sim_compute_robot_state-npc1_max0.06930229067802429
sim_compute_robot_state-npc1_mean0.06246094818400218
sim_compute_robot_state-npc1_median0.06123493159258807
sim_compute_robot_state-npc1_min0.05636834679988392
sim_compute_robot_state-npc2_max0.06689795425959996
sim_compute_robot_state-npc2_mean0.06141548554775272
sim_compute_robot_state-npc2_median0.06115879306086787
sim_compute_robot_state-npc2_min0.0553608400779858
sim_compute_robot_state-npc3_max0.06705213444573539
sim_compute_robot_state-npc3_mean0.06239289023938812
sim_compute_robot_state-npc3_median0.06235142990394875
sim_compute_robot_state-npc3_min0.05687066546657629
sim_compute_sim_state_max0.03872727070535932
sim_compute_sim_state_mean0.035461818758154774
sim_compute_sim_state_median0.03447970637568721
sim_compute_sim_state_min0.031843637165270354
sim_physics_max0.0233836259160723
sim_physics_mean0.02235616711067383
sim_physics_median0.022544718625252706
sim_physics_min0.021325831717633185
sim_render-ego_max0.06950962969235011
sim_render-ego_mean0.06233765209771518
sim_render-ego_median0.061660819583468966
sim_render-ego_min0.05645490529244406
simulation-passed1
survival_time_max6.749999999999984
survival_time_mean3.4499999999999957
survival_time_min2.3499999999999996
No reset possible
180702686Maxim ScherbakovPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-2108210:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1071078865215715
error_L20.018458736520115808


No reset possible