Duckietown Challenges Home Challenges Submissions

Evaluator 563

ID563
evaluatornutonomy-P50-5849
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-5849
versiond-c:4.0.11;d-c-r:4.0.10;d-s:4.0.12
first heard
last heard
statusinactive
# evaluating
# success5 17194
# timeout
# failed1 17216
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172162352Andrea Censi 🇨🇭Baseline solution using imitation learning from logsaido2_LFV_r3-v4-z2step1-simulationfailedyesnutonomy-P50-58490:04:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 285, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 92, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 173, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 254, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 282, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 66, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/project/graph_utils.py", line 8, in load_graph
               ||     graph_def.ParseFromString(f.read())
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/lib/io/file_io.py", line 125, in read
               ||     self._preread_check()
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/lib/io/file_io.py", line 85, in _preread_check
               ||     compat.as_bytes(self.__name), 1024 * 512, status)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/errors_impl.py", line 528, in __exit__
               ||     c_api.TF_GetCode(self.status.status))
               || tensorflow.python.framework.errors_impl.NotFoundError: frozen_graph.pb; No such file or directory
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 426, in <module>
    wrap(cie)
  File "experiment_manager.py", line 415, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 128, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 289, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
172082343Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2_LF_r3-v4-z2step1-simulationsuccessyesnutonomy-P50-58490:10:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18970529359990485
survival_time_median2.1500000000000004
deviation-center-line_median0.04864723983061233
in-drivable-lane_median1


other stats
agent_compute-ego_max0.09106642146443213
agent_compute-ego_mean0.0894282239864963
agent_compute-ego_median0.08929899105658898
agent_compute-ego_min0.08796963324913612
deviation-center-line_max0.44662917358641385
deviation-center-line_mean0.12014582712639443
deviation-center-line_min0.01645255235956436
deviation-heading_max3.753038579223134
deviation-heading_mean1.3717675364393092
deviation-heading_median0.8412410809944371
deviation-heading_min0.48283320969837074
driven_any_max3.606813435973198
driven_any_mean1.1428567492654893
driven_any_median0.5176534558929295
driven_any_min0.34195445953950854
driven_lanedir_consec_max0.7179895084213377
driven_lanedir_consec_mean0.27754279767637474
driven_lanedir_consec_min0.09621080631549828
driven_lanedir_max0.7329214366776315
driven_lanedir_mean0.2805291833276335
driven_lanedir_median0.18970529359990485
driven_lanedir_min0.09621080631549828
in-drivable-lane_max10.150000000000071
in-drivable-lane_mean2.7900000000000142
in-drivable-lane_min0.6000000000000002
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5176534558929295, "sim_physics": 0.007840555767680323, "survival_time": 2.1500000000000004, "driven_lanedir": 0.18970529359990485, "sim_render-ego": 0.03505814907162688, "in-drivable-lane": 1, "agent_compute-ego": 0.09106642146443213, "deviation-heading": 0.8412410809944371, "set_robot_commands": 0.04952236109001692, "deviation-center-line": 0.04864723983061233, "driven_lanedir_consec": 0.18970529359990485, "sim_compute_sim_state": 0.020504308301349018, "sim_compute_performance-ego": 0.03578100648037223, "sim_compute_robot_state-ego": 0.0373344199601994}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.34195445953950854, "sim_physics": 0.007819148210378794, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09621080631549828, "sim_render-ego": 0.03466784954071045, "in-drivable-lane": 0.6500000000000001, "agent_compute-ego": 0.08796963324913612, "deviation-heading": 0.4967637228247081, "set_robot_commands": 0.0493162045112023, "deviation-center-line": 0.01645255235956436, "driven_lanedir_consec": 0.09621080631549828, "sim_compute_sim_state": 0.02047994503608117, "sim_compute_performance-ego": 0.03557687539320726, "sim_compute_robot_state-ego": 0.03749686938065749}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.606813435973198, "sim_physics": 0.007418893973032634, "survival_time": 14.950000000000076, "driven_lanedir": 0.7329214366776315, "sim_render-ego": 0.034455458323160805, "in-drivable-lane": 10.150000000000071, "agent_compute-ego": 0.0885272773106893, "deviation-heading": 3.753038579223134, "set_robot_commands": 0.04998115460077922, "deviation-center-line": 0.44662917358641385, "driven_lanedir_consec": 0.7179895084213377, "sim_compute_sim_state": 0.020420645078023273, "sim_compute_performance-ego": 0.0357343594233195, "sim_compute_robot_state-ego": 0.03763945897420248}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3464413018527576, "sim_physics": 0.008104902047377367, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12558516585750157, "sim_render-ego": 0.03470020110790546, "in-drivable-lane": 0.6000000000000002, "agent_compute-ego": 0.08929899105658898, "deviation-heading": 0.48283320969837074, "set_robot_commands": 0.0494241531078632, "deviation-center-line": 0.03503696178664129, "driven_lanedir_consec": 0.12558516585750157, "sim_compute_sim_state": 0.020452636938828688, "sim_compute_performance-ego": 0.03561514157515306, "sim_compute_robot_state-ego": 0.0376359224319458}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9014210930690534, "sim_physics": 0.008599482476711273, "survival_time": 3.1999999999999966, "driven_lanedir": 0.2582232141876313, "sim_render-ego": 0.03473540395498276, "in-drivable-lane": 1.549999999999998, "agent_compute-ego": 0.09027879685163498, "deviation-heading": 1.284961089455895, "set_robot_commands": 0.04958845302462578, "deviation-center-line": 0.05396320806874031, "driven_lanedir_consec": 0.2582232141876313, "sim_compute_sim_state": 0.020392928272485733, "sim_compute_performance-ego": 0.03679461032152176, "sim_compute_robot_state-ego": 0.0377001129090786}}
set_robot_commands_max0.04998115460077922
set_robot_commands_mean0.04956646526689749
set_robot_commands_median0.04952236109001692
set_robot_commands_min0.0493162045112023
sim_compute_performance-ego_max0.03679461032152176
sim_compute_performance-ego_mean0.03590039863871476
sim_compute_performance-ego_median0.0357343594233195
sim_compute_performance-ego_min0.03557687539320726
sim_compute_robot_state-ego_max0.0377001129090786
sim_compute_robot_state-ego_mean0.03756135673121676
sim_compute_robot_state-ego_median0.0376359224319458
sim_compute_robot_state-ego_min0.0373344199601994
sim_compute_sim_state_max0.020504308301349018
sim_compute_sim_state_mean0.02045009272535358
sim_compute_sim_state_median0.020452636938828688
sim_compute_sim_state_min0.020392928272485733
sim_physics_max0.008599482476711273
sim_physics_mean0.007956596495036078
sim_physics_median0.007840555767680323
sim_physics_min0.007418893973032634
sim_render-ego_max0.03505814907162688
sim_render-ego_mean0.034723412399677266
sim_render-ego_median0.03470020110790546
sim_render-ego_min0.034455458323160805
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.580000000000014
survival_time_min1.3000000000000005
No reset possible
172042341Andrea Censi 🇨🇭Minimal agent (Python 2)aido2_LFV_r3-v4-z2step1-simulationsuccessyesnutonomy-P50-58490:09:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2501898935829012
survival_time_median2.6499999999999986
deviation-center-line_median0.02537368915309797
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.034054472761334116
agent_compute-ego_mean0.03297297818716389
agent_compute-ego_median0.03283449388899893
agent_compute-ego_min0.032048788937655365
deviation-center-line_max0.03472425682418009
deviation-center-line_mean0.026347234341453415
deviation-center-line_min0.020890767023363815
deviation-heading_max0.20304552908957563
deviation-heading_mean0.19365741902006536
deviation-heading_median0.2030454232515352
deviation-heading_min0.1784042009688801
driven_any_max2.7599999999999936
driven_any_mean1.7039999999999988
driven_any_median1.59
driven_any_min0.9900000000000012
driven_lanedir_consec_max2.526717455318104
driven_lanedir_consec_mean1.3866776713319673
driven_lanedir_consec_min0.6561020726944444
driven_lanedir_max2.526717455318104
driven_lanedir_mean1.3866776713319673
driven_lanedir_median1.2501898935829012
driven_lanedir_min0.6561020726944444
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.4699999999999987
in-drivable-lane_min0.34999999999999876
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900000000000012, "sim_physics": 0.012851642839836351, "survival_time": 1.6500000000000008, "driven_lanedir": 0.6561020726944444, "sim_render-ego": 0.03527104493343469, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.032048788937655365, "deviation-heading": 0.18074641270076017, "set_robot_commands": 0.05010271794868238, "deviation-center-line": 0.020890767023363815, "driven_lanedir_consec": 0.6561020726944444, "sim_compute_sim_state": 0.02157818909847375, "sim_compute_performance-ego": 0.03633637139291474, "sim_compute_robot_state-ego": 0.03677456306688713, "sim_compute_robot_state-npc0": 0.03684366110599402, "sim_compute_robot_state-npc1": 0.03736928015044241, "sim_compute_robot_state-npc2": 0.036878015055800926, "sim_compute_robot_state-npc3": 0.03714712460835775}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7599999999999936, "sim_physics": 0.01501443334247755, "survival_time": 4.599999999999992, "driven_lanedir": 2.526717455318104, "sim_render-ego": 0.03518798558608345, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.0321101364882096, "deviation-heading": 0.1784042009688801, "set_robot_commands": 0.05043746077496072, "deviation-center-line": 0.03472425682418009, "driven_lanedir_consec": 2.526717455318104, "sim_compute_sim_state": 0.021138074605361275, "sim_compute_performance-ego": 0.03640729966370956, "sim_compute_robot_state-ego": 0.03743188277534817, "sim_compute_robot_state-npc0": 0.03669868603996609, "sim_compute_robot_state-npc1": 0.03740882096083268, "sim_compute_robot_state-npc2": 0.03682351889817611, "sim_compute_robot_state-npc3": 0.03683323186376821}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.59, "sim_physics": 0.013634407295371, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.035291847193016194, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.03283449388899893, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.05057976830680416, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.02119085023987968, "sim_compute_performance-ego": 0.03613907886001299, "sim_compute_robot_state-ego": 0.03762416119845408, "sim_compute_robot_state-npc0": 0.03614511579837439, "sim_compute_robot_state-npc1": 0.03800950410231104, "sim_compute_robot_state-npc2": 0.036954321951236366, "sim_compute_robot_state-npc3": 0.03652617616473504}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59, "sim_physics": 0.013662225795242022, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.03497549722779472, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.034054472761334116, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.050734038622874136, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.021348318963680623, "sim_compute_performance-ego": 0.03609127368567125, "sim_compute_robot_state-ego": 0.037706487583664225, "sim_compute_robot_state-npc0": 0.03632437058214871, "sim_compute_robot_state-npc1": 0.03771563745894522, "sim_compute_robot_state-npc2": 0.03709770148655154, "sim_compute_robot_state-npc3": 0.036805665717934664}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.59, "sim_physics": 0.013768470512246186, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501890414814851, "sim_render-ego": 0.035286039676306384, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.033816998859621444, "deviation-heading": 0.2030454232515352, "set_robot_commands": 0.05115490589501723, "deviation-center-line": 0.02537376955352725, "driven_lanedir_consec": 1.2501890414814851, "sim_compute_sim_state": 0.021150332576823683, "sim_compute_performance-ego": 0.03640013370873793, "sim_compute_robot_state-ego": 0.037408959190800506, "sim_compute_robot_state-npc0": 0.03665736936173349, "sim_compute_robot_state-npc1": 0.03771043273637879, "sim_compute_robot_state-npc2": 0.037285530342246, "sim_compute_robot_state-npc3": 0.03699579778707252}}
set_robot_commands_max0.05115490589501723
set_robot_commands_mean0.05060177830966772
set_robot_commands_median0.05057976830680416
set_robot_commands_min0.05010271794868238
sim_compute_performance-ego_max0.03640729966370956
sim_compute_performance-ego_mean0.03627483146220929
sim_compute_performance-ego_median0.03633637139291474
sim_compute_performance-ego_min0.03609127368567125
sim_compute_robot_state-ego_max0.037706487583664225
sim_compute_robot_state-ego_mean0.037389210763030825
sim_compute_robot_state-ego_median0.03743188277534817
sim_compute_robot_state-ego_min0.03677456306688713
sim_compute_robot_state-npc0_max0.03684366110599402
sim_compute_robot_state-npc0_mean0.03653384057764335
sim_compute_robot_state-npc0_median0.03665736936173349
sim_compute_robot_state-npc0_min0.03614511579837439
sim_compute_robot_state-npc1_max0.03800950410231104
sim_compute_robot_state-npc1_mean0.03764273508178203
sim_compute_robot_state-npc1_median0.03771043273637879
sim_compute_robot_state-npc1_min0.03736928015044241
sim_compute_robot_state-npc2_max0.037285530342246
sim_compute_robot_state-npc2_mean0.037007817546802185
sim_compute_robot_state-npc2_median0.036954321951236366
sim_compute_robot_state-npc2_min0.03682351889817611
sim_compute_robot_state-npc3_max0.03714712460835775
sim_compute_robot_state-npc3_mean0.036861599228373634
sim_compute_robot_state-npc3_median0.03683323186376821
sim_compute_robot_state-npc3_min0.03652617616473504
sim_compute_sim_state_max0.02157818909847375
sim_compute_sim_state_mean0.0212811530968438
sim_compute_sim_state_median0.02119085023987968
sim_compute_sim_state_min0.021138074605361275
sim_physics_max0.01501443334247755
sim_physics_mean0.01378623595703462
sim_physics_median0.013662225795242022
sim_physics_min0.012851642839836351
sim_render-ego_max0.035291847193016194
sim_render-ego_mean0.03520248292332709
sim_render-ego_median0.03527104493343469
sim_render-ego_min0.03497549722779472
simulation-passed1
survival_time_max4.599999999999992
survival_time_mean2.8399999999999976
survival_time_min1.6500000000000008
No reset possible
171962322Bhairav MehtaBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationsuccessyesnutonomy-P50-58490:10:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.32213713493258966
survival_time_median5.349999999999989
deviation-center-line_median0.10947866131513168
in-drivable-lane_median2.549999999999994


other stats
agent_compute-ego_max0.08707147059233292
agent_compute-ego_mean0.08491525548362211
agent_compute-ego_median0.084543350537618
agent_compute-ego_min0.08337404794782122
deviation-center-line_max0.30943856151569576
deviation-center-line_mean0.13558784946922783
deviation-center-line_min0.05474306385624051
deviation-heading_max5.845225846718547
deviation-heading_mean3.1290424969605697
deviation-heading_median2.2367740589508944
deviation-heading_min0.8872721522108287
driven_any_max2.668518652355622
driven_any_mean1.4397422331748193
driven_any_median1.0279164629042528
driven_any_min0.4524014048252397
driven_lanedir_consec_max0.7452268851592021
driven_lanedir_consec_mean0.414186975114613
driven_lanedir_consec_min0.1643975632198682
driven_lanedir_max0.7452268851592021
driven_lanedir_mean0.414186975114613
driven_lanedir_median0.32213713493258966
driven_lanedir_min0.1643975632198682
in-drivable-lane_max7.900000000000046
in-drivable-lane_mean4.100000000000016
in-drivable-lane_min1.1499999999999997
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4775303713478112, "sim_physics": 0.00206688176030698, "survival_time": 2.3, "driven_lanedir": 0.1643975632198682, "sim_render-ego": 0.03266474993332573, "in-drivable-lane": 1.1499999999999997, "agent_compute-ego": 0.08707147059233292, "deviation-heading": 0.8872721522108287, "set_robot_commands": 0.04658510892287544, "deviation-center-line": 0.05474306385624051, "driven_lanedir_consec": 0.1643975632198682, "sim_compute_sim_state": 0.018944740295410156, "sim_compute_performance-ego": 0.033800975136134934, "sim_compute_robot_state-ego": 0.24329155942668085}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0279164629042528, "sim_physics": 0.001524526382161078, "survival_time": 5.349999999999989, "driven_lanedir": 0.32213713493258966, "sim_render-ego": 0.032695790317571055, "in-drivable-lane": 2.549999999999994, "agent_compute-ego": 0.08337404794782122, "deviation-heading": 2.2367740589508944, "set_robot_commands": 0.04773833372882594, "deviation-center-line": 0.10947866131513168, "driven_lanedir_consec": 0.32213713493258966, "sim_compute_sim_state": 0.01904997424544575, "sim_compute_performance-ego": 0.03389539005600403, "sim_compute_robot_state-ego": 0.04089099001661639}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4524014048252397, "sim_physics": 0.0015138105912642045, "survival_time": 2.7499999999999982, "driven_lanedir": 0.1691852145557844, "sim_render-ego": 0.03228483200073242, "in-drivable-lane": 1.299999999999999, "agent_compute-ego": 0.08528193994001909, "deviation-heading": 1.0670422529827466, "set_robot_commands": 0.04696846008300781, "deviation-center-line": 0.05799695215306621, "driven_lanedir_consec": 0.1691852145557844, "sim_compute_sim_state": 0.019180883060802113, "sim_compute_performance-ego": 0.03395423022183505, "sim_compute_robot_state-ego": 0.04128106724132191}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.668518652355622, "sim_physics": 0.0015081477165222168, "survival_time": 14.950000000000076, "driven_lanedir": 0.7452268851592021, "sim_render-ego": 0.032754600048065186, "in-drivable-lane": 7.600000000000039, "agent_compute-ego": 0.084543350537618, "deviation-heading": 5.845225846718547, "set_robot_commands": 0.047044765949249265, "deviation-center-line": 0.30943856151569576, "driven_lanedir_consec": 0.7452268851592021, "sim_compute_sim_state": 0.01911054372787475, "sim_compute_performance-ego": 0.03411301851272583, "sim_compute_robot_state-ego": 0.0403946590423584}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.572344274441171, "sim_physics": 0.0015049473444620769, "survival_time": 14.950000000000076, "driven_lanedir": 0.6699880777056206, "sim_render-ego": 0.03347188154856364, "in-drivable-lane": 7.900000000000046, "agent_compute-ego": 0.08430546840031941, "deviation-heading": 5.608898173939833, "set_robot_commands": 0.046942893664042154, "deviation-center-line": 0.1462820085060051, "driven_lanedir_consec": 0.6699880777056206, "sim_compute_sim_state": 0.01910713275273641, "sim_compute_performance-ego": 0.0338070011138916, "sim_compute_robot_state-ego": 0.04029829422632853}}
set_robot_commands_max0.04773833372882594
set_robot_commands_mean0.04705591246960013
set_robot_commands_median0.04696846008300781
set_robot_commands_min0.04658510892287544
sim_compute_performance-ego_max0.03411301851272583
sim_compute_performance-ego_mean0.03391412300811829
sim_compute_performance-ego_median0.03389539005600403
sim_compute_performance-ego_min0.033800975136134934
sim_compute_robot_state-ego_max0.24329155942668085
sim_compute_robot_state-ego_mean0.08123131399066122
sim_compute_robot_state-ego_median0.04089099001661639
sim_compute_robot_state-ego_min0.04029829422632853
sim_compute_sim_state_max0.019180883060802113
sim_compute_sim_state_mean0.01907865481645384
sim_compute_sim_state_median0.01910713275273641
sim_compute_sim_state_min0.018944740295410156
sim_physics_max0.00206688176030698
sim_physics_mean0.0016236627589433113
sim_physics_median0.0015138105912642045
sim_physics_min0.0015049473444620769
sim_render-ego_max0.03347188154856364
sim_render-ego_mean0.0327743707696516
sim_render-ego_median0.032695790317571055
sim_render-ego_min0.03228483200073242
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.060000000000027
survival_time_min2.3
No reset possible
171952269Andrea Censi 🇨🇭Solution templateaido2_LFV_r1-v4step1-simulationsuccessyesnutonomy-P50-58490:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.07784560831581674
agent_compute-ego_mean0.07674517092218858
agent_compute-ego_median0.07661713123321533
agent_compute-ego_min0.07609593517640058
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014883840785307042, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03229585465262918, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07609593517640058, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0468600778018727, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01933014743468341, "sim_compute_performance-ego": 0.03316322494955624, "sim_compute_robot_state-ego": 0.1742765552857343, "sim_compute_robot_state-npc0": 0.03383796355303596, "sim_compute_robot_state-npc1": 0.033666253089904785, "sim_compute_robot_state-npc2": 0.03331696285920985, "sim_compute_robot_state-npc3": 0.034003177109886616}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.00147662843976702, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.032148066021147226, "in-drivable-lane": 0, "agent_compute-ego": 0.0761784901694646, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.048674541806417795, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.019044066232348247, "sim_compute_performance-ego": 0.03303179286775135, "sim_compute_robot_state-ego": 0.04696793783278693, "sim_compute_robot_state-npc0": 0.03390540773906405, "sim_compute_robot_state-npc1": 0.03387663856385246, "sim_compute_robot_state-npc2": 0.03354861622764951, "sim_compute_robot_state-npc3": 0.0338921206338065}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0014925699967604418, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.03267601453340971, "in-drivable-lane": 0, "agent_compute-ego": 0.07698868971604567, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04708235080425556, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.01925233327425443, "sim_compute_performance-ego": 0.03334333346440242, "sim_compute_robot_state-ego": 0.045502350880549505, "sim_compute_robot_state-npc0": 0.03423765989450308, "sim_compute_robot_state-npc1": 0.033864322075477016, "sim_compute_robot_state-npc2": 0.03408212661743164, "sim_compute_robot_state-npc3": 0.03418309138371394}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015163392555422898, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.032454237705323755, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07784560831581674, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04703559235828679, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.018847878386334675, "sim_compute_performance-ego": 0.03348624124759581, "sim_compute_robot_state-ego": 0.04598733564702476, "sim_compute_robot_state-npc0": 0.034089989778472156, "sim_compute_robot_state-npc1": 0.03418122268304592, "sim_compute_robot_state-npc2": 0.033742919200804175, "sim_compute_robot_state-npc3": 0.03415329281876727}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.001489152908325195, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.032926230430603026, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07661713123321533, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04689417600631714, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018718361854553223, "sim_compute_performance-ego": 0.03381145000457764, "sim_compute_robot_state-ego": 0.045608196258544925, "sim_compute_robot_state-npc0": 0.03428448677062988, "sim_compute_robot_state-npc1": 0.03380059957504272, "sim_compute_robot_state-npc2": 0.03362334728240967, "sim_compute_robot_state-npc3": 0.03364476680755615}}
set_robot_commands_max0.048674541806417795
set_robot_commands_mean0.04730934775543
set_robot_commands_median0.04703559235828679
set_robot_commands_min0.0468600778018727
sim_compute_performance-ego_max0.03381145000457764
sim_compute_performance-ego_mean0.03336720850677669
sim_compute_performance-ego_median0.03334333346440242
sim_compute_performance-ego_min0.03303179286775135
sim_compute_robot_state-ego_max0.1742765552857343
sim_compute_robot_state-ego_mean0.07166847518092809
sim_compute_robot_state-ego_median0.04598733564702476
sim_compute_robot_state-ego_min0.045502350880549505
sim_compute_robot_state-npc0_max0.03428448677062988
sim_compute_robot_state-npc0_mean0.034071101547141026
sim_compute_robot_state-npc0_median0.034089989778472156
sim_compute_robot_state-npc0_min0.03383796355303596
sim_compute_robot_state-npc1_max0.03418122268304592
sim_compute_robot_state-npc1_mean0.03387780719746458
sim_compute_robot_state-npc1_median0.033864322075477016
sim_compute_robot_state-npc1_min0.033666253089904785
sim_compute_robot_state-npc2_max0.03408212661743164
sim_compute_robot_state-npc2_mean0.03366279443750097
sim_compute_robot_state-npc2_median0.03362334728240967
sim_compute_robot_state-npc2_min0.03331696285920985
sim_compute_robot_state-npc3_max0.03418309138371394
sim_compute_robot_state-npc3_mean0.033975289750746096
sim_compute_robot_state-npc3_median0.034003177109886616
sim_compute_robot_state-npc3_min0.03364476680755615
sim_compute_sim_state_max0.01933014743468341
sim_compute_sim_state_mean0.019038557436434796
sim_compute_sim_state_median0.019044066232348247
sim_compute_sim_state_min0.018718361854553223
sim_physics_max0.0015163392555422898
sim_physics_mean0.00149261493578513
sim_physics_median0.001489152908325195
sim_physics_min0.00147662843976702
sim_render-ego_max0.032926230430603026
sim_render-ego_mean0.03250008066862258
sim_render-ego_median0.032454237705323755
sim_render-ego_min0.032148066021147226
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171942324Nikhil Khedekar 🇮🇳PredictorLastaido2-PREDstep1-simulationsuccessnonutonomy-P50-58490:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12845524379625448
error_L20.02416102881566029


No reset possible