Duckietown Challenges Home Challenges Submissions

Evaluator 573

ID573
evaluatoridsc-rudolf-5891
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-5891
versiond-c:4.0.11;d-c-r:4.0.10;d-s:4.0.12
first heard
last heard
statusinactive
# evaluating
# success3 17197
# timeout
# failed1 17217
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172172353Andrea Censi 🇨🇭Baseline solution using imitation learning from logsaido2_LFVI_r3-v4-z2step1-simulationfailedyesidsc-rudolf-58910:01:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 285, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 92, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 173, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 254, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 282, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 66, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/project/graph_utils.py", line 8, in load_graph
               ||     graph_def.ParseFromString(f.read())
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/lib/io/file_io.py", line 125, in read
               ||     self._preread_check()
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/lib/io/file_io.py", line 85, in _preread_check
               ||     compat.as_bytes(self.__name), 1024 * 512, status)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/errors_impl.py", line 528, in __exit__
               ||     c_api.TF_GetCode(self.status.status))
               || tensorflow.python.framework.errors_impl.NotFoundError: frozen_graph.pb; No such file or directory
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 426, in <module>
    wrap(cie)
  File "experiment_manager.py", line 415, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 128, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 289, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
172092346Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2_LFV_r3-v4-z2step1-simulationsuccessyesidsc-rudolf-58910:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0767118215400786
survival_time_median1.2000000000000004
deviation-center-line_median0.047910987479903855
in-drivable-lane_median0.5500000000000002


other stats
agent_compute-ego_max0.25043458523957624
agent_compute-ego_mean0.21509763267518228
agent_compute-ego_median0.21247328411449085
agent_compute-ego_min0.18804523348808289
deviation-center-line_max0.05633988721074473
deviation-center-line_mean0.04679846502232715
deviation-center-line_min0.03950690367187397
deviation-heading_max0.9074512407070618
deviation-heading_mean0.6687850234037093
deviation-heading_median0.5627789373059345
deviation-heading_min0.49731205297404735
driven_any_max0.5257583896775828
driven_any_mean0.3353157418021889
driven_any_median0.26084588698539407
driven_any_min0.20722144587983057
driven_lanedir_consec_max0.15215852290381404
driven_lanedir_consec_mean0.09079627408464348
driven_lanedir_consec_min0.03824833805775141
driven_lanedir_max0.15215852290381404
driven_lanedir_mean0.09079627408464348
driven_lanedir_median0.0767118215400786
driven_lanedir_min0.03824833805775141
in-drivable-lane_max1.4999999999999991
in-drivable-lane_mean0.7999999999999999
in-drivable-lane_min0.4000000000000001
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.26084588698539407, "sim_physics": 0.022656043370564777, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0741668410201437, "sim_render-ego": 0.06632099548975627, "in-drivable-lane": 0.5000000000000002, "agent_compute-ego": 0.18804523348808289, "deviation-heading": 0.5627789373059345, "set_robot_commands": 0.07385991017023723, "deviation-center-line": 0.040288227218505994, "driven_lanedir_consec": 0.0741668410201437, "sim_compute_sim_state": 0.03496357798576355, "sim_compute_performance-ego": 0.05928086241086324, "sim_compute_robot_state-ego": 0.061244974533716835, "sim_compute_robot_state-npc0": 0.07187860210736592, "sim_compute_robot_state-npc1": 0.06369241078694661, "sim_compute_robot_state-npc2": 0.06468382477760315, "sim_compute_robot_state-npc3": 0.06601087252298991}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.46003604764740047, "sim_physics": 0.02188135302344034, "survival_time": 2.1500000000000004, "driven_lanedir": 0.15215852290381404, "sim_render-ego": 0.06315426493799964, "in-drivable-lane": 1.0499999999999998, "agent_compute-ego": 0.19407999792764352, "deviation-heading": 0.8192047113381457, "set_robot_commands": 0.07553102249322935, "deviation-center-line": 0.047910987479903855, "driven_lanedir_consec": 0.15215852290381404, "sim_compute_sim_state": 0.034279002699741094, "sim_compute_performance-ego": 0.06117488617120787, "sim_compute_robot_state-ego": 0.062077350394670355, "sim_compute_robot_state-npc0": 0.0734664284905722, "sim_compute_robot_state-npc1": 0.06729740320250045, "sim_compute_robot_state-npc2": 0.06435957620310229, "sim_compute_robot_state-npc3": 0.0650890594304994}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2227169388207367, "sim_physics": 0.021107066761363636, "survival_time": 1.1000000000000003, "driven_lanedir": 0.0767118215400786, "sim_render-ego": 0.06144170327620073, "in-drivable-lane": 0.4000000000000001, "agent_compute-ego": 0.23045506260611795, "deviation-heading": 0.557178174693357, "set_robot_commands": 0.07488348267295143, "deviation-center-line": 0.049946319530607186, "driven_lanedir_consec": 0.0767118215400786, "sim_compute_sim_state": 0.03427500074559992, "sim_compute_performance-ego": 0.06166195869445801, "sim_compute_robot_state-ego": 0.059507901018316094, "sim_compute_robot_state-npc0": 0.07087123394012451, "sim_compute_robot_state-npc1": 0.06395100463520396, "sim_compute_robot_state-npc2": 0.06297466971657494, "sim_compute_robot_state-npc3": 0.06012891639362682}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20722144587983057, "sim_physics": 0.025385462719461193, "survival_time": 1.1500000000000004, "driven_lanedir": 0.03824833805775141, "sim_render-ego": 0.062016632245934525, "in-drivable-lane": 0.5500000000000002, "agent_compute-ego": 0.25043458523957624, "deviation-heading": 0.49731205297404735, "set_robot_commands": 0.07290433800738791, "deviation-center-line": 0.03950690367187397, "driven_lanedir_consec": 0.03824833805775141, "sim_compute_sim_state": 0.0358606421429178, "sim_compute_performance-ego": 0.06283646044523819, "sim_compute_robot_state-ego": 0.062483269235362175, "sim_compute_robot_state-npc0": 0.06707372872725777, "sim_compute_robot_state-npc1": 0.06374164249586023, "sim_compute_robot_state-npc2": 0.06417342890863834, "sim_compute_robot_state-npc3": 0.06090421261994735}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5257583896775828, "sim_physics": 0.024135637283325195, "survival_time": 2.7499999999999982, "driven_lanedir": 0.11269584690142964, "sim_render-ego": 0.06572485837069425, "in-drivable-lane": 1.4999999999999991, "agent_compute-ego": 0.21247328411449085, "deviation-heading": 0.9074512407070618, "set_robot_commands": 0.07612690058621494, "deviation-center-line": 0.05633988721074473, "driven_lanedir_consec": 0.11269584690142964, "sim_compute_sim_state": 0.0346335844560103, "sim_compute_performance-ego": 0.06232244751670144, "sim_compute_robot_state-ego": 0.0644057880748402, "sim_compute_robot_state-npc0": 0.06987835710698909, "sim_compute_robot_state-npc1": 0.0665651798248291, "sim_compute_robot_state-npc2": 0.06349446556784889, "sim_compute_robot_state-npc3": 0.06413120356473055}}
set_robot_commands_max0.07612690058621494
set_robot_commands_mean0.07466113078600418
set_robot_commands_median0.07488348267295143
set_robot_commands_min0.07290433800738791
sim_compute_performance-ego_max0.06283646044523819
sim_compute_performance-ego_mean0.06145532304769376
sim_compute_performance-ego_median0.06166195869445801
sim_compute_performance-ego_min0.05928086241086324
sim_compute_robot_state-ego_max0.0644057880748402
sim_compute_robot_state-ego_mean0.061943856651381135
sim_compute_robot_state-ego_median0.062077350394670355
sim_compute_robot_state-ego_min0.059507901018316094
sim_compute_robot_state-npc0_max0.0734664284905722
sim_compute_robot_state-npc0_mean0.07063367007446189
sim_compute_robot_state-npc0_median0.07087123394012451
sim_compute_robot_state-npc0_min0.06707372872725777
sim_compute_robot_state-npc1_max0.06729740320250045
sim_compute_robot_state-npc1_mean0.06504952818906806
sim_compute_robot_state-npc1_median0.06395100463520396
sim_compute_robot_state-npc1_min0.06369241078694661
sim_compute_robot_state-npc2_max0.06468382477760315
sim_compute_robot_state-npc2_mean0.06393719303475351
sim_compute_robot_state-npc2_median0.06417342890863834
sim_compute_robot_state-npc2_min0.06297466971657494
sim_compute_robot_state-npc3_max0.06601087252298991
sim_compute_robot_state-npc3_mean0.06325285290635882
sim_compute_robot_state-npc3_median0.06413120356473055
sim_compute_robot_state-npc3_min0.06012891639362682
sim_compute_sim_state_max0.0358606421429178
sim_compute_sim_state_mean0.034802361606006534
sim_compute_sim_state_median0.0346335844560103
sim_compute_sim_state_min0.03427500074559992
sim_physics_max0.025385462719461193
sim_physics_mean0.023033112631631027
sim_physics_median0.022656043370564777
sim_physics_min0.021107066761363636
sim_render-ego_max0.06632099548975627
sim_render-ego_mean0.06373169086411709
sim_render-ego_median0.06315426493799964
sim_render-ego_min0.06144170327620073
simulation-passed1
survival_time_max2.7499999999999982
survival_time_mean1.67
survival_time_min1.1000000000000003
No reset possible
171992338Andrea Censi 🇨🇭Minimal agentaido2_LFV_r3-v4-z2step1-simulationsuccessyesidsc-rudolf-58910:12:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1498800277709961
agent_compute-ego_mean0.14145277156709515
agent_compute-ego_median0.14118647866132783
agent_compute-ego_min0.13626810312271118
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.021864368635065416, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.05879664771697101, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1366608598653008, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07309577044318705, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.034006567562327665, "sim_compute_performance-ego": 0.058434675721561205, "sim_compute_robot_state-ego": 0.060176793266745174, "sim_compute_robot_state-npc0": 0.06525467423831716, "sim_compute_robot_state-npc1": 0.06152561832876766, "sim_compute_robot_state-npc2": 0.06156987653059118, "sim_compute_robot_state-npc3": 0.06019142094780417}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.025905711310250417, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.061540024621146064, "in-drivable-lane": 0, "agent_compute-ego": 0.1432683884151398, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07524302270677355, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.034719750994727724, "sim_compute_performance-ego": 0.05982062173268152, "sim_compute_robot_state-ego": 0.0606101429651654, "sim_compute_robot_state-npc0": 0.0683242782713875, "sim_compute_robot_state-npc1": 0.0637363630627829, "sim_compute_robot_state-npc2": 0.06169340345594618, "sim_compute_robot_state-npc3": 0.06229549362545922}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.02327532768249512, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.06118263831505409, "in-drivable-lane": 0, "agent_compute-ego": 0.1498800277709961, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.0735500665811392, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.03490123748779297, "sim_compute_performance-ego": 0.05985038463885967, "sim_compute_robot_state-ego": 0.06250407512371357, "sim_compute_robot_state-npc0": 0.06877590326162485, "sim_compute_robot_state-npc1": 0.06452558590815617, "sim_compute_robot_state-npc2": 0.06201986166147085, "sim_compute_robot_state-npc3": 0.06238005711482121}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.02248085126644227, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06213464678787604, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14118647866132783, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07483533242853677, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.03356382032720054, "sim_compute_performance-ego": 0.06002208953950464, "sim_compute_robot_state-ego": 0.06060085064027368, "sim_compute_robot_state-npc0": 0.06982732982170291, "sim_compute_robot_state-npc1": 0.06265294261095, "sim_compute_robot_state-npc2": 0.06156605336724258, "sim_compute_robot_state-npc3": 0.061475922421711245}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.022613630294799805, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.05968402624130249, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.13626810312271118, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07411039113998413, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.03436398983001709, "sim_compute_performance-ego": 0.06083416223526001, "sim_compute_robot_state-ego": 0.060009431838989255, "sim_compute_robot_state-npc0": 0.06766854763031006, "sim_compute_robot_state-npc1": 0.06420119524002076, "sim_compute_robot_state-npc2": 0.06360249280929565, "sim_compute_robot_state-npc3": 0.06361021041870117}}
set_robot_commands_max0.07524302270677355
set_robot_commands_mean0.07416691665992413
set_robot_commands_median0.07411039113998413
set_robot_commands_min0.07309577044318705
sim_compute_performance-ego_max0.06083416223526001
sim_compute_performance-ego_mean0.05979238677357342
sim_compute_performance-ego_median0.05985038463885967
sim_compute_performance-ego_min0.058434675721561205
sim_compute_robot_state-ego_max0.06250407512371357
sim_compute_robot_state-ego_mean0.060780258766977416
sim_compute_robot_state-ego_median0.06060085064027368
sim_compute_robot_state-ego_min0.060009431838989255
sim_compute_robot_state-npc0_max0.06982732982170291
sim_compute_robot_state-npc0_mean0.0679701466446685
sim_compute_robot_state-npc0_median0.0683242782713875
sim_compute_robot_state-npc0_min0.06525467423831716
sim_compute_robot_state-npc1_max0.06452558590815617
sim_compute_robot_state-npc1_mean0.0633283410301355
sim_compute_robot_state-npc1_median0.0637363630627829
sim_compute_robot_state-npc1_min0.06152561832876766
sim_compute_robot_state-npc2_max0.06360249280929565
sim_compute_robot_state-npc2_mean0.062090337564909295
sim_compute_robot_state-npc2_median0.06169340345594618
sim_compute_robot_state-npc2_min0.06156605336724258
sim_compute_robot_state-npc3_max0.06361021041870117
sim_compute_robot_state-npc3_mean0.0619906209056994
sim_compute_robot_state-npc3_median0.06229549362545922
sim_compute_robot_state-npc3_min0.06019142094780417
sim_compute_sim_state_max0.03490123748779297
sim_compute_sim_state_mean0.0343110732404132
sim_compute_sim_state_median0.03436398983001709
sim_compute_sim_state_min0.03356382032720054
sim_physics_max0.025905711310250417
sim_physics_mean0.02322797783781061
sim_physics_median0.022613630294799805
sim_physics_min0.021864368635065416
sim_render-ego_max0.06213464678787604
sim_render-ego_mean0.06066759673646993
sim_render-ego_median0.06118263831505409
sim_render-ego_min0.05879664771697101
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171972323Bhairav MehtaBaseline solution using reinforcement learningaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-58910:15:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.33658589783620574
survival_time_median6.449999999999985
deviation-center-line_median0.17874387202185885
in-drivable-lane_median3.0499999999999927


other stats
agent_compute-ego_max0.27573566436767577
agent_compute-ego_mean0.20327721225330864
agent_compute-ego_median0.18924344607761928
agent_compute-ego_min0.16435229685879493
deviation-center-line_max0.4477125490982573
deviation-center-line_mean0.1889860029580198
deviation-center-line_min0.007073972380990444
deviation-heading_max4.531623984255645
deviation-heading_mean2.2366213289024457
deviation-heading_median2.344204860118814
deviation-heading_min0.2174140510204084
driven_any_max3.940689320031442
driven_any_mean2.1328437657283144
driven_any_median1.7198042478981754
driven_any_min0.15269096474731642
driven_lanedir_consec_max0.952491940056567
driven_lanedir_consec_mean0.4280683297586753
driven_lanedir_consec_min0.04394577526451915
driven_lanedir_max0.952491940056567
driven_lanedir_mean0.4404659717324727
driven_lanedir_median0.33658589783620574
driven_lanedir_min0.04394577526451915
in-drivable-lane_max12.750000000000076
in-drivable-lane_mean5.370000000000026
in-drivable-lane_min0.19999999999999996
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.8667358394946847, "sim_physics": 0.002969803015391032, "survival_time": 14.950000000000076, "driven_lanedir": 0.24994895631898073, "sim_render-ego": 0.06500908295313518, "in-drivable-lane": 12.750000000000076, "agent_compute-ego": 0.17826018969217935, "deviation-heading": 2.344204860118814, "set_robot_commands": 0.0802865719795227, "deviation-center-line": 0.25338795224286786, "driven_lanedir_consec": 0.18796074644999372, "sim_compute_sim_state": 0.04376115322113037, "sim_compute_performance-ego": 0.06646983702977498, "sim_compute_robot_state-ego": 0.1191353154182434}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7198042478981754, "sim_physics": 0.0029353762781897256, "survival_time": 6.449999999999985, "driven_lanedir": 0.6193572891860909, "sim_render-ego": 0.06638813018798828, "in-drivable-lane": 3.0499999999999927, "agent_compute-ego": 0.16435229685879493, "deviation-heading": 2.6541624667040584, "set_robot_commands": 0.07898958154426988, "deviation-center-line": 0.17874387202185885, "driven_lanedir_consec": 0.6193572891860909, "sim_compute_sim_state": 0.04335198106691819, "sim_compute_performance-ego": 0.06572502158408941, "sim_compute_robot_state-ego": 0.07634849881016931}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15269096474731642, "sim_physics": 0.0030285120010375977, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04394577526451915, "sim_render-ego": 0.06351020336151122, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.27573566436767577, "deviation-heading": 0.2174140510204084, "set_robot_commands": 0.08056964874267578, "deviation-center-line": 0.007073972380990444, "driven_lanedir_consec": 0.04394577526451915, "sim_compute_sim_state": 0.03809680938720703, "sim_compute_performance-ego": 0.06964616775512696, "sim_compute_robot_state-ego": 0.07734377384185791}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.940689320031442, "sim_physics": 0.003094499905904134, "survival_time": 14.950000000000076, "driven_lanedir": 0.952491940056567, "sim_render-ego": 0.06637814919153849, "in-drivable-lane": 9.200000000000063, "agent_compute-ego": 0.20879446427027384, "deviation-heading": 4.531623984255645, "set_robot_commands": 0.07923203150431316, "deviation-center-line": 0.4477125490982573, "driven_lanedir_consec": 0.952491940056567, "sim_compute_sim_state": 0.041869004567464195, "sim_compute_performance-ego": 0.06594874382019043, "sim_compute_robot_state-ego": 0.07396348396937052}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9842984564699524, "sim_physics": 0.003031294686453683, "survival_time": 3.4999999999999956, "driven_lanedir": 0.33658589783620574, "sim_render-ego": 0.06379988874707904, "in-drivable-lane": 1.649999999999998, "agent_compute-ego": 0.18924344607761928, "deviation-heading": 1.4357012824133035, "set_robot_commands": 0.08082410948617118, "deviation-center-line": 0.058011669046124544, "driven_lanedir_consec": 0.33658589783620574, "sim_compute_sim_state": 0.04416820321764265, "sim_compute_performance-ego": 0.06654957703181676, "sim_compute_robot_state-ego": 0.08001060145241874}}
set_robot_commands_max0.08082410948617118
set_robot_commands_mean0.07998038865139054
set_robot_commands_median0.0802865719795227
set_robot_commands_min0.07898958154426988
sim_compute_performance-ego_max0.06964616775512696
sim_compute_performance-ego_mean0.0668678694441997
sim_compute_performance-ego_median0.06646983702977498
sim_compute_performance-ego_min0.06572502158408941
sim_compute_robot_state-ego_max0.1191353154182434
sim_compute_robot_state-ego_mean0.08536033469841198
sim_compute_robot_state-ego_median0.07734377384185791
sim_compute_robot_state-ego_min0.07396348396937052
sim_compute_sim_state_max0.04416820321764265
sim_compute_sim_state_mean0.04224943029207249
sim_compute_sim_state_median0.04335198106691819
sim_compute_sim_state_min0.03809680938720703
sim_physics_max0.003094499905904134
sim_physics_mean0.0030118971773952343
sim_physics_median0.0030285120010375977
sim_physics_min0.0029353762781897256
sim_render-ego_max0.06638813018798828
sim_render-ego_mean0.06501709088825045
sim_render-ego_median0.06500908295313518
sim_render-ego_min0.06351020336151122
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.070000000000025
survival_time_min0.49999999999999994
No reset possible