Duckietown Challenges Home Challenges Submissions

Evaluator 574

ID574
evaluatoridsc-rudolf-6108
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-6108
versiond-c:4.0.11;d-c-r:4.0.10;d-s:4.0.12
first heard
last heard
statusinactive
# evaluating
# success4 17198
# timeout
# failed1 17213
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172132349Andrea Censi 🇨🇭Baseline solution using imitation learning from logsaido2_LFV_r3-v4-z2step1-simulationfailedyesidsc-rudolf-61080:01:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 285, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 92, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 173, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 254, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 282, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 66, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/project/graph_utils.py", line 8, in load_graph
               ||     graph_def.ParseFromString(f.read())
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/lib/io/file_io.py", line 125, in read
               ||     self._preread_check()
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/lib/io/file_io.py", line 85, in _preread_check
               ||     compat.as_bytes(self.__name), 1024 * 512, status)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/errors_impl.py", line 528, in __exit__
               ||     c_api.TF_GetCode(self.status.status))
               || tensorflow.python.framework.errors_impl.NotFoundError: frozen_graph.pb; No such file or directory
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 426, in <module>
    wrap(cie)
  File "experiment_manager.py", line 415, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 128, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 289, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
172072344Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2_LFV_r3-v4-z2step1-simulationsuccessyesidsc-rudolf-61080:12:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.332116072948907
survival_time_median3.949999999999994
deviation-center-line_median0.034452031723907796
in-drivable-lane_median1.8999999999999968


other stats
agent_compute-ego_max0.2506018212733378
agent_compute-ego_mean0.22313913363820476
agent_compute-ego_median0.22079347372055053
agent_compute-ego_min0.18556420538160537
deviation-center-line_max0.07928218285565024
deviation-center-line_mean0.049742647569582514
deviation-center-line_min0.027943529826405057
deviation-heading_max2.4860397999368335
deviation-heading_mean1.3428035802687248
deviation-heading_median1.4562195173236985
deviation-heading_min0.3485093942119219
driven_any_max1.5389427628629422
driven_any_mean0.8806771338288797
driven_any_median0.978288272224772
driven_any_min0.25831704422157903
driven_lanedir_consec_max0.4564240701868303
driven_lanedir_consec_mean0.28200952751291875
driven_lanedir_consec_min0.06618407762521927
driven_lanedir_max0.4564240701868303
driven_lanedir_mean0.28200952751291875
driven_lanedir_median0.332116072948907
driven_lanedir_min0.06618407762521927
in-drivable-lane_max3.299999999999992
in-drivable-lane_mean1.7599999999999971
in-drivable-lane_min0.55
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6274998332498095, "sim_physics": 0.023543850580851237, "survival_time": 2.25, "driven_lanedir": 0.19866486279169537, "sim_render-ego": 0.0745329115125868, "in-drivable-lane": 1.0499999999999998, "agent_compute-ego": 0.18556420538160537, "deviation-heading": 0.9111063479743744, "set_robot_commands": 0.07857445610894097, "deviation-center-line": 0.03168723175484288, "driven_lanedir_consec": 0.19866486279169537, "sim_compute_sim_state": 0.03703434732225206, "sim_compute_performance-ego": 0.07011639806959365, "sim_compute_robot_state-ego": 0.06594806247287327, "sim_compute_robot_state-npc0": 0.07493735419379341, "sim_compute_robot_state-npc1": 0.06877764595879449, "sim_compute_robot_state-npc2": 0.06731215582953559, "sim_compute_robot_state-npc3": 0.06610476705763076}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.000337756585296, "sim_physics": 0.02481360073331036, "survival_time": 3.949999999999994, "driven_lanedir": 0.3566585540119416, "sim_render-ego": 0.0661324368247503, "in-drivable-lane": 1.8999999999999968, "agent_compute-ego": 0.2184364011016073, "deviation-heading": 1.5121428418967957, "set_robot_commands": 0.0747398394572584, "deviation-center-line": 0.07928218285565024, "driven_lanedir_consec": 0.3566585540119416, "sim_compute_sim_state": 0.03706173353557345, "sim_compute_performance-ego": 0.06501942043063007, "sim_compute_robot_state-ego": 0.06794000577323045, "sim_compute_robot_state-npc0": 0.07125484188900719, "sim_compute_robot_state-npc1": 0.06592258622374715, "sim_compute_robot_state-npc2": 0.06504235690153098, "sim_compute_robot_state-npc3": 0.06518135795110389}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.978288272224772, "sim_physics": 0.025706392526626588, "survival_time": 3.999999999999994, "driven_lanedir": 0.332116072948907, "sim_render-ego": 0.06305047571659088, "in-drivable-lane": 1.9999999999999964, "agent_compute-ego": 0.22079347372055053, "deviation-heading": 1.4562195173236985, "set_robot_commands": 0.07887804210186004, "deviation-center-line": 0.034452031723907796, "driven_lanedir_consec": 0.332116072948907, "sim_compute_sim_state": 0.03561325967311859, "sim_compute_performance-ego": 0.06244592368602753, "sim_compute_robot_state-ego": 0.06350809037685394, "sim_compute_robot_state-npc0": 0.07032995522022248, "sim_compute_robot_state-npc1": 0.06440300941467285, "sim_compute_robot_state-npc2": 0.06387690007686615, "sim_compute_robot_state-npc3": 0.0655652791261673}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5389427628629422, "sim_physics": 0.022820878574866376, "survival_time": 6.549999999999985, "driven_lanedir": 0.4564240701868303, "sim_render-ego": 0.06426662525147882, "in-drivable-lane": 3.299999999999992, "agent_compute-ego": 0.2506018212733378, "deviation-heading": 2.4860397999368335, "set_robot_commands": 0.07493169799105812, "deviation-center-line": 0.07534826168710664, "driven_lanedir_consec": 0.4564240701868303, "sim_compute_sim_state": 0.03498055734707199, "sim_compute_performance-ego": 0.06172188365732441, "sim_compute_robot_state-ego": 0.06100964546203613, "sim_compute_robot_state-npc0": 0.06770503065968288, "sim_compute_robot_state-npc1": 0.06326009845005647, "sim_compute_robot_state-npc2": 0.06221075822378843, "sim_compute_robot_state-npc3": 0.06263287376811486}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.25831704422157903, "sim_physics": 0.01957593180916526, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06618407762521927, "sim_render-ego": 0.05501114238392223, "in-drivable-lane": 0.55, "agent_compute-ego": 0.24029976671392267, "deviation-heading": 0.3485093942119219, "set_robot_commands": 0.07418135079470548, "deviation-center-line": 0.027943529826405057, "driven_lanedir_consec": 0.06618407762521927, "sim_compute_sim_state": 0.031945358623157845, "sim_compute_performance-ego": 0.055962963537736374, "sim_compute_robot_state-ego": 0.05923407728021795, "sim_compute_robot_state-npc0": 0.06313366239721124, "sim_compute_robot_state-npc1": 0.059810670939358795, "sim_compute_robot_state-npc2": 0.05850653214888139, "sim_compute_robot_state-npc3": 0.05851416154341264}}
set_robot_commands_max0.07887804210186004
set_robot_commands_mean0.07626107729076459
set_robot_commands_median0.07493169799105812
set_robot_commands_min0.07418135079470548
sim_compute_performance-ego_max0.07011639806959365
sim_compute_performance-ego_mean0.06305331787626241
sim_compute_performance-ego_median0.06244592368602753
sim_compute_performance-ego_min0.055962963537736374
sim_compute_robot_state-ego_max0.06794000577323045
sim_compute_robot_state-ego_mean0.06352797627304235
sim_compute_robot_state-ego_median0.06350809037685394
sim_compute_robot_state-ego_min0.05923407728021795
sim_compute_robot_state-npc0_max0.07493735419379341
sim_compute_robot_state-npc0_mean0.06947216887198344
sim_compute_robot_state-npc0_median0.07032995522022248
sim_compute_robot_state-npc0_min0.06313366239721124
sim_compute_robot_state-npc1_max0.06877764595879449
sim_compute_robot_state-npc1_mean0.06443480219732596
sim_compute_robot_state-npc1_median0.06440300941467285
sim_compute_robot_state-npc1_min0.059810670939358795
sim_compute_robot_state-npc2_max0.06731215582953559
sim_compute_robot_state-npc2_mean0.0633897406361205
sim_compute_robot_state-npc2_median0.06387690007686615
sim_compute_robot_state-npc2_min0.05850653214888139
sim_compute_robot_state-npc3_max0.06610476705763076
sim_compute_robot_state-npc3_mean0.0635996878892859
sim_compute_robot_state-npc3_median0.06518135795110389
sim_compute_robot_state-npc3_min0.05851416154341264
sim_compute_sim_state_max0.03706173353557345
sim_compute_sim_state_mean0.035327051300234794
sim_compute_sim_state_median0.03561325967311859
sim_compute_sim_state_min0.031945358623157845
sim_physics_max0.025706392526626588
sim_physics_mean0.023292130844963965
sim_physics_median0.023543850580851237
sim_physics_min0.01957593180916526
sim_render-ego_max0.0745329115125868
sim_render-ego_mean0.0645987183378658
sim_render-ego_median0.06426662525147882
sim_render-ego_min0.05501114238392223
simulation-passed1
survival_time_max6.549999999999985
survival_time_mean3.5699999999999945
survival_time_min1.1000000000000003
No reset possible
172062340Andrea Censi 🇨🇭Minimal agent (Python 2)aido2_LF_r3-v4-z2step1-simulationsuccessyesidsc-rudolf-61080:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2501898935829012
survival_time_median2.6499999999999986
deviation-center-line_median0.02537368915309797
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.05277193717236789
agent_compute-ego_mean0.0512415288856467
agent_compute-ego_median0.05193870922304549
agent_compute-ego_min0.04695517366582697
deviation-center-line_max0.03958613065683618
deviation-center-line_mean0.02918970941936276
deviation-center-line_min0.020890767023363815
deviation-heading_max0.20304552908957563
deviation-heading_mean0.1920323650242732
deviation-heading_median0.1949200760095926
deviation-heading_min0.17840427823186208
driven_any_max1.59
driven_any_mean1.349999999999999
driven_any_median1.5899999999999932
driven_any_min0.9900000000000008
driven_lanedir_consec_max1.3567189392346433
driven_lanedir_consec_mean1.0593730735411984
driven_lanedir_consec_min0.6561020726944444
driven_lanedir_max1.3567189392346433
driven_lanedir_mean1.0593730735411984
driven_lanedir_median1.2501898935829012
driven_lanedir_min0.6561020726944444
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.4299999999999992
in-drivable-lane_min0.30000000000000027
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900000000000012, "sim_physics": 0.013049963748816288, "survival_time": 1.6500000000000008, "driven_lanedir": 0.6561020726944444, "sim_render-ego": 0.055207628192323624, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.04695517366582697, "deviation-heading": 0.18074641270076017, "set_robot_commands": 0.07087297150582979, "deviation-center-line": 0.020890767023363815, "driven_lanedir_consec": 0.6561020726944444, "sim_compute_sim_state": 0.03767802498557351, "sim_compute_performance-ego": 0.057931249791925606, "sim_compute_robot_state-ego": 0.05999252290436716}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900000000000008, "sim_physics": 0.013120867989280006, "survival_time": 1.6500000000000008, "driven_lanedir": 0.7836645686111028, "sim_render-ego": 0.0649539412874164, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.05265233733437278, "deviation-heading": 0.1949200760095926, "set_robot_commands": 0.07583847912875089, "deviation-center-line": 0.03958613065683618, "driven_lanedir_consec": 0.7836645686111028, "sim_compute_sim_state": 0.0428288560925108, "sim_compute_performance-ego": 0.0629012801430442, "sim_compute_robot_state-ego": 0.06518444870457504}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5899999999999932, "sim_physics": 0.013227786657945164, "survival_time": 2.6499999999999986, "driven_lanedir": 1.3567189392346433, "sim_render-ego": 0.062418141455020545, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.05188948703262041, "deviation-heading": 0.17840427823186208, "set_robot_commands": 0.07319697793924583, "deviation-center-line": 0.034724271110417856, "driven_lanedir_consec": 1.3567189392346433, "sim_compute_sim_state": 0.039063161274172226, "sim_compute_performance-ego": 0.062179282026470835, "sim_compute_robot_state-ego": 0.06301714789192632}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59, "sim_physics": 0.013515054054980009, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.06587648841570008, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.05193870922304549, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.07380298848422069, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.04104194551144006, "sim_compute_performance-ego": 0.06348794361330429, "sim_compute_robot_state-ego": 0.06449627426435363}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.59, "sim_physics": 0.012925872262918725, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.06305300964499419, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.05277193717236789, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.07885770977668043, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.04019540660786179, "sim_compute_performance-ego": 0.0619258610707409, "sim_compute_robot_state-ego": 0.0631252774652445}}
set_robot_commands_max0.07885770977668043
set_robot_commands_mean0.07451382536694554
set_robot_commands_median0.07380298848422069
set_robot_commands_min0.07087297150582979
sim_compute_performance-ego_max0.06348794361330429
sim_compute_performance-ego_mean0.06168512332909717
sim_compute_performance-ego_median0.062179282026470835
sim_compute_performance-ego_min0.057931249791925606
sim_compute_robot_state-ego_max0.06518444870457504
sim_compute_robot_state-ego_mean0.06316313424609332
sim_compute_robot_state-ego_median0.0631252774652445
sim_compute_robot_state-ego_min0.05999252290436716
sim_compute_sim_state_max0.0428288560925108
sim_compute_sim_state_mean0.040161478894311674
sim_compute_sim_state_median0.04019540660786179
sim_compute_sim_state_min0.03767802498557351
sim_physics_max0.013515054054980009
sim_physics_mean0.013167908942788038
sim_physics_median0.013120867989280006
sim_physics_min0.012925872262918725
sim_render-ego_max0.06587648841570008
sim_render-ego_mean0.06230184179909097
sim_render-ego_median0.06305300964499419
sim_render-ego_min0.055207628192323624
simulation-passed1
survival_time_max2.6499999999999986
survival_time_mean2.249999999999999
survival_time_min1.6500000000000008
No reset possible
172032337Andrea Censi 🇨🇭Minimal agentaido2_LF_r3-v4-z2step1-simulationsuccessyesidsc-rudolf-61080:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1434646950048559
agent_compute-ego_mean0.13983989620208237
agent_compute-ego_median0.14156243859267817
agent_compute-ego_min0.13088697478884742
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.013825058937072754, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.05946742085849538, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1434646950048559, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0770070517764372, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.039123948882607854, "sim_compute_performance-ego": 0.06300182202283074, "sim_compute_robot_state-ego": 0.06443668814266429}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.013529887275090292, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.05823078609648205, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.13088697478884742, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07490380605061848, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.03835890028211805, "sim_compute_performance-ego": 0.059366861979166664, "sim_compute_robot_state-ego": 0.06033890209500752}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.013394810603215145, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.05960181676424467, "in-drivable-lane": 0, "agent_compute-ego": 0.14301430262052095, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.08039087515610915, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.03761271696824294, "sim_compute_performance-ego": 0.06044148665208083, "sim_compute_robot_state-ego": 0.06175330602205717}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.014559204985455768, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.057992923550489475, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14156243859267817, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0761457943334812, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.037599371700752074, "sim_compute_performance-ego": 0.05996188303319419, "sim_compute_robot_state-ego": 0.06308495998382568}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.014536912441253665, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06180107831954956, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14027107000350952, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07712271928787232, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.03966642618179321, "sim_compute_performance-ego": 0.0633484148979187, "sim_compute_robot_state-ego": 0.0658282470703125}}
set_robot_commands_max0.08039087515610915
set_robot_commands_mean0.07711404932090367
set_robot_commands_median0.0770070517764372
set_robot_commands_min0.07490380605061848
sim_compute_performance-ego_max0.0633484148979187
sim_compute_performance-ego_mean0.06122409371703823
sim_compute_performance-ego_median0.06044148665208083
sim_compute_performance-ego_min0.059366861979166664
sim_compute_robot_state-ego_max0.0658282470703125
sim_compute_robot_state-ego_mean0.06308842066277343
sim_compute_robot_state-ego_median0.06308495998382568
sim_compute_robot_state-ego_min0.06033890209500752
sim_compute_sim_state_max0.03966642618179321
sim_compute_sim_state_mean0.03847227280310282
sim_compute_sim_state_median0.03835890028211805
sim_compute_sim_state_min0.037599371700752074
sim_physics_max0.014559204985455768
sim_physics_mean0.013969174848417525
sim_physics_median0.013825058937072754
sim_physics_min0.013394810603215145
sim_render-ego_max0.06180107831954956
sim_render-ego_mean0.059418805117852226
sim_render-ego_median0.05946742085849538
sim_render-ego_min0.057992923550489475
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171982317Julian ZillyBaseline solution using imitation learning from logsaido2_LFV_r1-v4step1-simulationsuccessyesidsc-rudolf-61080:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18482147694429377
survival_time_median1.3500000000000003
deviation-center-line_median0.0796215982274241
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2179848176461679
agent_compute-ego_mean0.21121188830926477
agent_compute-ego_median0.20785572611052416
agent_compute-ego_min0.20577315930966977
deviation-center-line_max0.08707529315155964
deviation-center-line_mean0.08097120325609464
deviation-center-line_min0.07757893162890622
deviation-heading_max0.7560020895565267
deviation-heading_mean0.7216166776769308
deviation-heading_median0.7366530474494495
deviation-heading_min0.6679507984834561
driven_any_max0.2425683527023217
driven_any_mean0.2290298726594342
driven_any_median0.22767271249920948
driven_any_min0.2212341045831002
driven_lanedir_consec_max0.1984134802735915
driven_lanedir_consec_mean0.1841948463590811
driven_lanedir_consec_min0.17277119420330234
driven_lanedir_max0.1984134802735915
driven_lanedir_mean0.1841948463590811
driven_lanedir_median0.18482147694429377
driven_lanedir_min0.17277119420330234
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22932966262753895, "sim_physics": 0.003133086057809683, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18751992700050923, "sim_render-ego": 0.07186454993027908, "in-drivable-lane": 0, "agent_compute-ego": 0.2171984635866605, "deviation-heading": 0.6679507984834561, "set_robot_commands": 0.07993325820335975, "deviation-center-line": 0.07757893162890622, "driven_lanedir_consec": 0.18751992700050923, "sim_compute_sim_state": 0.03929253724905161, "sim_compute_performance-ego": 0.06749579539665809, "sim_compute_robot_state-ego": 0.5080971717834473, "sim_compute_robot_state-npc0": 0.07557609448066124, "sim_compute_robot_state-npc1": 0.06955259579878587, "sim_compute_robot_state-npc2": 0.07153392755068265, "sim_compute_robot_state-npc3": 0.0696730246910682}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2425683527023217, "sim_physics": 0.0031151442692197604, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1984134802735915, "sim_render-ego": 0.06347222163759429, "in-drivable-lane": 0, "agent_compute-ego": 0.20785572611052416, "deviation-heading": 0.7366530474494495, "set_robot_commands": 0.08256989511950262, "deviation-center-line": 0.08707529315155964, "driven_lanedir_consec": 0.1984134802735915, "sim_compute_sim_state": 0.03859922803681472, "sim_compute_performance-ego": 0.0657678225944782, "sim_compute_robot_state-ego": 0.08295282002153068, "sim_compute_robot_state-npc0": 0.07544313628098061, "sim_compute_robot_state-npc1": 0.06795483622057684, "sim_compute_robot_state-npc2": 0.0663974038485823, "sim_compute_robot_state-npc3": 0.07052632035880253}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22767271249920948, "sim_physics": 0.0030908231382016783, "survival_time": 1.3500000000000003, "driven_lanedir": 0.18482147694429377, "sim_render-ego": 0.07255622192665383, "in-drivable-lane": 0, "agent_compute-ego": 0.2072472748933015, "deviation-heading": 0.7041554170496334, "set_robot_commands": 0.0765298914026331, "deviation-center-line": 0.07930110646342275, "driven_lanedir_consec": 0.18482147694429377, "sim_compute_sim_state": 0.03682504759894477, "sim_compute_performance-ego": 0.07182293468051487, "sim_compute_robot_state-ego": 0.08495535673918547, "sim_compute_robot_state-npc0": 0.07255405849880642, "sim_compute_robot_state-npc1": 0.0688088646641484, "sim_compute_robot_state-npc2": 0.06947167714436848, "sim_compute_robot_state-npc3": 0.06660828766999422}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2212341045831002, "sim_physics": 0.003343255431563766, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17277119420330234, "sim_render-ego": 0.0697928887826425, "in-drivable-lane": 0, "agent_compute-ego": 0.20577315930966977, "deviation-heading": 0.7560020895565267, "set_robot_commands": 0.08117483280323169, "deviation-center-line": 0.0796215982274241, "driven_lanedir_consec": 0.17277119420330234, "sim_compute_sim_state": 0.03633258077833387, "sim_compute_performance-ego": 0.06594486589784976, "sim_compute_robot_state-ego": 0.08416260613335504, "sim_compute_robot_state-npc0": 0.07464325869524921, "sim_compute_robot_state-npc1": 0.06710208786858453, "sim_compute_robot_state-npc2": 0.06637330408449527, "sim_compute_robot_state-npc3": 0.06471512052747938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22434453088500067, "sim_physics": 0.0032905825862178098, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17744815337370867, "sim_render-ego": 0.07194966740078396, "in-drivable-lane": 0, "agent_compute-ego": 0.2179848176461679, "deviation-heading": 0.7433220358455889, "set_robot_commands": 0.07792939080132379, "deviation-center-line": 0.08127908680916048, "driven_lanedir_consec": 0.17744815337370867, "sim_compute_sim_state": 0.04195834972240307, "sim_compute_performance-ego": 0.06665066436485008, "sim_compute_robot_state-ego": 0.08496292432149251, "sim_compute_robot_state-npc0": 0.07570404476589626, "sim_compute_robot_state-npc1": 0.06831761642738625, "sim_compute_robot_state-npc2": 0.06929190070540817, "sim_compute_robot_state-npc3": 0.06900634589018645}}
set_robot_commands_max0.08256989511950262
set_robot_commands_mean0.07962745366601018
set_robot_commands_median0.07993325820335975
set_robot_commands_min0.0765298914026331
sim_compute_performance-ego_max0.07182293468051487
sim_compute_performance-ego_mean0.0675364165868702
sim_compute_performance-ego_median0.06665066436485008
sim_compute_performance-ego_min0.0657678225944782
sim_compute_robot_state-ego_max0.5080971717834473
sim_compute_robot_state-ego_mean0.16902617579980225
sim_compute_robot_state-ego_median0.08495535673918547
sim_compute_robot_state-ego_min0.08295282002153068
sim_compute_robot_state-npc0_max0.07570404476589626
sim_compute_robot_state-npc0_mean0.07478411854431875
sim_compute_robot_state-npc0_median0.07544313628098061
sim_compute_robot_state-npc0_min0.07255405849880642
sim_compute_robot_state-npc1_max0.06955259579878587
sim_compute_robot_state-npc1_mean0.06834720019589638
sim_compute_robot_state-npc1_median0.06831761642738625
sim_compute_robot_state-npc1_min0.06710208786858453
sim_compute_robot_state-npc2_max0.07153392755068265
sim_compute_robot_state-npc2_mean0.06861364266670737
sim_compute_robot_state-npc2_median0.06929190070540817
sim_compute_robot_state-npc2_min0.06637330408449527
sim_compute_robot_state-npc3_max0.07052632035880253
sim_compute_robot_state-npc3_mean0.06810581982750616
sim_compute_robot_state-npc3_median0.06900634589018645
sim_compute_robot_state-npc3_min0.06471512052747938
sim_compute_sim_state_max0.04195834972240307
sim_compute_sim_state_mean0.0386015486771096
sim_compute_sim_state_median0.03859922803681472
sim_compute_sim_state_min0.03633258077833387
sim_physics_max0.003343255431563766
sim_physics_mean0.00319457829660254
sim_physics_median0.003133086057809683
sim_physics_min0.0030908231382016783
sim_render-ego_max0.07255622192665383
sim_render-ego_mean0.06992710993559073
sim_render-ego_median0.07186454993027908
sim_render-ego_min0.06347222163759429
simulation-passed1
survival_time_max1.4500000000000006
survival_time_mean1.3600000000000003
survival_time_min1.3000000000000005
No reset possible