Evaluator 1576

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

24357

4170

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LF-sim-testing

step1-simulation

failed

idsc-rudolf-6886

2019-10-21 23:18:38+00:00

2019-10-21 23:21:14+00:00

0:02:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24342

4163

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LF-sim-validation

step1-simulation

success

idsc-rudolf-6886

2019-10-21 14:47:08+00:00

2019-10-21 14:50:31+00:00

0:03:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.026916723251342773
agent_compute-ego_mean	0.025953664885284992
agent_compute-ego_median	0.025711871959544993
agent_compute-ego_min	0.02535065482644474
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989765
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.6182144577009443
driven_any_mean	0.861378585933269
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.06082532140943739, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.012539965135079843, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.025711871959544993, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.008003199542010273, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004926120793377912, "sim_compute_performance-ego": 0.007505156375743725, "sim_compute_robot_state-ego": 0.00878976892541956}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.06465703833336924, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.013070017683739756, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.026201832528207816, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.008590674867817, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.005372206370035808, "sim_compute_performance-ego": 0.007575095868578144, "sim_compute_robot_state-ego": 0.009453605203067554}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06656820633832146, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.012740682153140797, "in-drivable-lane": 0, "agent_compute-ego": 0.02535065482644474, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.00750882485333611, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0048877631916719325, "sim_compute_performance-ego": 0.007137789445764878, "sim_compute_robot_state-ego": 0.008658395094030043}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06522245407104492, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.013128261566162107, "in-drivable-lane": 0, "agent_compute-ego": 0.026916723251342773, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.008766508102416993, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.005116138458251953, "sim_compute_performance-ego": 0.00764577865600586, "sim_compute_robot_state-ego": 0.009561147689819336}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.060022004042999656, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.012627007086065753, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.025587241860884655, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.008325546602659587, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.004960373987125445, "sim_compute_performance-ego": 0.007424357571179354, "sim_compute_robot_state-ego": 0.008744520477101773}}
set_robot_commands_max	0.008766508102416993
set_robot_commands_mean	0.008238950793647993
set_robot_commands_median	0.008325546602659587
set_robot_commands_min	0.00750882485333611
sim_compute_performance-ego_max	0.00764577865600586
sim_compute_performance-ego_mean	0.007457635583454391
sim_compute_performance-ego_median	0.007505156375743725
sim_compute_performance-ego_min	0.007137789445764878
sim_compute_robot_state-ego_max	0.009561147689819336
sim_compute_robot_state-ego_mean	0.009041487477887654
sim_compute_robot_state-ego_median	0.00878976892541956
sim_compute_robot_state-ego_min	0.008658395094030043
sim_compute_sim_state_max	0.005372206370035808
sim_compute_sim_state_mean	0.00505252056009261
sim_compute_sim_state_median	0.004960373987125445
sim_compute_sim_state_min	0.0048877631916719325
sim_physics_max	0.06656820633832146
sim_physics_mean	0.06345900483903454
sim_physics_median	0.06465703833336924
sim_physics_min	0.060022004042999656
sim_render-ego_max	0.013128261566162107
sim_render-ego_mean	0.01282118672483765
sim_render-ego_median	0.012740682153140797
sim_render-ego_min	0.012539965135079843
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

24334

4146

Andrea Censi 🇨🇭

rotation

aido3-LFV-sim-testing

step1-simulation

success

idsc-rudolf-6886

2019-10-16 22:16:35+00:00

2019-10-16 22:58:15+00:00

0:41:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0004210035399991874
survival_time_median	14.950000000000076
deviation-center-line_median	0.35182572071982005
in-drivable-lane_median	7.550000000000045

other stats

agent_compute-ego_max	0.02622385263442993
agent_compute-ego_mean	0.02542098050647312
agent_compute-ego_median	0.02530264139175415
agent_compute-ego_min	0.02473055839538574
deviation-center-line_max	0.6113242374220981
deviation-center-line_mean	0.3495811985198474
deviation-center-line_min	0.020737127615471695
deviation-heading_max	5.986461294692883
deviation-heading_mean	5.6766931523863855
deviation-heading_median	5.657649106857694
deviation-heading_min	5.446954481754146
driven_any_max	0.026478672834058543
driven_any_mean	0.02338944237901383
driven_any_median	0.02328526772832417
driven_any_min	0.01977949840932533
driven_lanedir_consec_max	0.002175689624529298
driven_lanedir_consec_mean	-0.000897428691689206
driven_lanedir_consec_min	-0.004956006324957851
driven_lanedir_max	0.002175689624529298
driven_lanedir_mean	-0.000897428691689206
driven_lanedir_median	-0.0004210035399991874
driven_lanedir_min	-0.004956006324957851
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.566666666666709
in-drivable-lane_min	7.500000000000041
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834058543, "sim_physics": 0.11005757252375284, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.012285383542378745, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.025867118835449215, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.008453410466512044, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.0050389973322550454, "sim_compute_performance-ego": 0.007270038922627767, "sim_compute_robot_state-ego": 0.00900088628133138, "sim_compute_robot_state-npc0": 0.00839519739151001, "sim_compute_robot_state-npc1": 0.008341101010640463, "sim_compute_robot_state-npc2": 0.008268524010976155, "sim_compute_robot_state-npc3": 0.008101944923400878}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541210208, "sim_physics": 0.10945176601409912, "survival_time": 14.950000000000076, "driven_lanedir": -0.003645956811333395, "sim_render-ego": 0.012485029697418212, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.025197563966115315, "deviation-heading": 5.795316370396739, "set_robot_commands": 0.008271727561950683, "deviation-center-line": 0.6113242374220981, "driven_lanedir_consec": -0.003645956811333395, "sim_compute_sim_state": 0.005015191237131755, "sim_compute_performance-ego": 0.007226801713307698, "sim_compute_robot_state-ego": 0.008948497772216797, "sim_compute_robot_state-npc0": 0.008365174134572348, "sim_compute_robot_state-npc1": 0.008263062636057536, "sim_compute_robot_state-npc2": 0.008158651987711589, "sim_compute_robot_state-npc3": 0.00802462895711263}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672443435, "sim_physics": 0.10595189889272054, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017527010091673567, "sim_render-ego": 0.012068782647450763, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.02503920396169027, "deviation-heading": 5.603088381719547, "set_robot_commands": 0.008070197105407715, "deviation-center-line": 0.4891048530415207, "driven_lanedir_consec": 0.0017527010091673567, "sim_compute_sim_state": 0.00485361655553182, "sim_compute_performance-ego": 0.007017630736033122, "sim_compute_robot_state-ego": 0.008703509966532389, "sim_compute_robot_state-npc0": 0.00815452257792155, "sim_compute_robot_state-npc1": 0.008032406171162923, "sim_compute_robot_state-npc2": 0.007884290218353272, "sim_compute_robot_state-npc3": 0.007766376336415609}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661382513, "sim_physics": 0.10778830846150717, "survival_time": 14.950000000000076, "driven_lanedir": -0.003010841132988329, "sim_render-ego": 0.011835795243581136, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.025936065514882405, "deviation-heading": 5.536662996854859, "set_robot_commands": 0.008045502503712972, "deviation-center-line": 0.4305506258687733, "driven_lanedir_consec": -0.003010841132988329, "sim_compute_sim_state": 0.004896623293558756, "sim_compute_performance-ego": 0.007030677000681559, "sim_compute_robot_state-ego": 0.008783566951751708, "sim_compute_robot_state-npc0": 0.008088408311208089, "sim_compute_robot_state-npc1": 0.008055484294891358, "sim_compute_robot_state-npc2": 0.007938576539357504, "sim_compute_robot_state-npc3": 0.00782387653986613}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02594247225218261, "sim_physics": 0.10857483545939128, "survival_time": 14.950000000000076, "driven_lanedir": 0.00031446221011421915, "sim_render-ego": 0.012026518185933432, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.02554693619410197, "deviation-heading": 5.830135897709593, "set_robot_commands": 0.008160940806070964, "deviation-center-line": 0.020737127615471695, "driven_lanedir_consec": 0.00031446221011421915, "sim_compute_sim_state": 0.00490392525990804, "sim_compute_performance-ego": 0.0070439298947652185, "sim_compute_robot_state-ego": 0.008747299512227377, "sim_compute_robot_state-npc0": 0.008295541604359944, "sim_compute_robot_state-npc1": 0.008102656205495199, "sim_compute_robot_state-npc2": 0.008166850407918294, "sim_compute_robot_state-npc3": 0.007932095527648926}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.02624988077521305, "sim_physics": 0.10550894578297931, "survival_time": 14.950000000000076, "driven_lanedir": -0.0004210035399991874, "sim_render-ego": 0.012482990423838295, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.025283624331156412, "deviation-heading": 5.5185530445855715, "set_robot_commands": 0.008244950771331788, "deviation-center-line": 0.35182572071982005, "driven_lanedir_consec": -0.0004210035399991874, "sim_compute_sim_state": 0.004891602198282877, "sim_compute_performance-ego": 0.00716058890024821, "sim_compute_robot_state-ego": 0.008859304587046306, "sim_compute_robot_state-npc0": 0.008390345573425294, "sim_compute_robot_state-npc1": 0.008177193800608317, "sim_compute_robot_state-npc2": 0.008005712032318115, "sim_compute_robot_state-npc3": 0.007876744270324707}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.02328526772832417, "sim_physics": 0.10467097441355389, "survival_time": 14.950000000000076, "driven_lanedir": -0.003251075883798471, "sim_render-ego": 0.012157175540924072, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.02473055839538574, "deviation-heading": 5.658569132462587, "set_robot_commands": 0.008111729621887206, "deviation-center-line": 0.279436074750809, "driven_lanedir_consec": -0.003251075883798471, "sim_compute_sim_state": 0.0048624364535013835, "sim_compute_performance-ego": 0.007028157711029053, "sim_compute_robot_state-ego": 0.008796921571095784, "sim_compute_robot_state-npc0": 0.008116549650828043, "sim_compute_robot_state-npc1": 0.008072450160980224, "sim_compute_robot_state-npc2": 0.007961069742838542, "sim_compute_robot_state-npc3": 0.007723995844523112}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.023561644755161693, "sim_physics": 0.10567715485890708, "survival_time": 14.950000000000076, "driven_lanedir": 0.002175689624529298, "sim_render-ego": 0.011980355580647788, "in-drivable-lane": 7.500000000000044, "agent_compute-ego": 0.02513201316197713, "deviation-heading": 5.605918318469571, "set_robot_commands": 0.008114909331003825, "deviation-center-line": 0.3815932559652111, "driven_lanedir_consec": 0.002175689624529298, "sim_compute_sim_state": 0.004874279499053955, "sim_compute_performance-ego": 0.006978998978932699, "sim_compute_robot_state-ego": 0.008555472691853841, "sim_compute_robot_state-npc0": 0.008129332065582275, "sim_compute_robot_state-npc1": 0.008061911265055339, "sim_compute_robot_state-npc2": 0.007938980261484782, "sim_compute_robot_state-npc3": 0.007786287466684977}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.024191972983614415, "sim_physics": 0.10343981266021728, "survival_time": 14.950000000000076, "driven_lanedir": 0.001130242665409842, "sim_render-ego": 0.011984496116638184, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.025037532647450764, "deviation-heading": 5.446954481754146, "set_robot_commands": 0.008172475496927897, "deviation-center-line": 0.147917463467496, "driven_lanedir_consec": 0.001130242665409842, "sim_compute_sim_state": 0.004945461750030518, "sim_compute_performance-ego": 0.007060863176981608, "sim_compute_robot_state-ego": 0.008692758083343506, "sim_compute_robot_state-npc0": 0.00811567465464274, "sim_compute_robot_state-npc1": 0.008095470269521078, "sim_compute_robot_state-npc2": 0.008033326466878255, "sim_compute_robot_state-npc3": 0.007941267490386962}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.02125816620692276, "sim_physics": 0.11052736202875774, "survival_time": 14.950000000000076, "driven_lanedir": 0.00014695833410893755, "sim_render-ego": 0.01228657881418864, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.02530264139175415, "deviation-heading": 5.986461294692883, "set_robot_commands": 0.008335877259572346, "deviation-center-line": 0.28693076998913597, "driven_lanedir_consec": 0.00014695833410893755, "sim_compute_sim_state": 0.005128652254740397, "sim_compute_performance-ego": 0.007175844510396321, "sim_compute_robot_state-ego": 0.008912134965260823, "sim_compute_robot_state-npc0": 0.008349947134653727, "sim_compute_robot_state-npc1": 0.008352619012196858, "sim_compute_robot_state-npc2": 0.008220481077829996, "sim_compute_robot_state-npc3": 0.008102014859517415}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.021434292120207553, "sim_physics": 0.1012788772583008, "survival_time": 14.950000000000076, "driven_lanedir": 0.0006110716623699552, "sim_render-ego": 0.011469008127848308, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.025046155452728272, "deviation-heading": 5.8800646319787555, "set_robot_commands": 0.007876091003417969, "deviation-center-line": 0.15230669122649582, "driven_lanedir_consec": 0.0006110716623699552, "sim_compute_sim_state": 0.004737316767374674, "sim_compute_performance-ego": 0.00666108767191569, "sim_compute_robot_state-ego": 0.008264466921488444, "sim_compute_robot_state-npc0": 0.007779457569122314, "sim_compute_robot_state-npc1": 0.007825206915537517, "sim_compute_robot_state-npc2": 0.007774207592010498, "sim_compute_robot_state-npc3": 0.007661848862965902}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.01977949840932533, "sim_physics": 0.10176894426345826, "survival_time": 14.950000000000076, "driven_lanedir": -0.001467610376958639, "sim_render-ego": 0.012178076108296711, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.0255085547765096, "deviation-heading": 5.808176953181408, "set_robot_commands": 0.008302144209543864, "deviation-center-line": 0.4275036254592562, "driven_lanedir_consec": -0.001467610376958639, "sim_compute_sim_state": 0.004983508586883545, "sim_compute_performance-ego": 0.007152907053629557, "sim_compute_robot_state-ego": 0.008757568995157878, "sim_compute_robot_state-npc0": 0.00828438917795817, "sim_compute_robot_state-npc1": 0.008394845326741536, "sim_compute_robot_state-npc2": 0.008141067822774252, "sim_compute_robot_state-npc3": 0.00802178144454956}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.020981564902325674, "sim_physics": 0.10666499058405558, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014064336043808634, "sim_render-ego": 0.01194554328918457, "in-drivable-lane": 7.500000000000044, "agent_compute-ego": 0.02571672201156616, "deviation-heading": 5.599572893646449, "set_robot_commands": 0.00817027489344279, "deviation-center-line": 0.4665414695810384, "driven_lanedir_consec": -0.0014064336043808634, "sim_compute_sim_state": 0.004977073669433594, "sim_compute_performance-ego": 0.0069842529296875, "sim_compute_robot_state-ego": 0.008593786557515462, "sim_compute_robot_state-npc0": 0.008100825945536296, "sim_compute_robot_state-npc1": 0.008150483767191569, "sim_compute_robot_state-npc2": 0.008012207349141438, "sim_compute_robot_state-npc3": 0.007899826367696126}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.02255104803582274, "sim_physics": 0.10708879629770916, "survival_time": 14.950000000000076, "driven_lanedir": -0.004956006324957851, "sim_render-ego": 0.01224061091740926, "in-drivable-lane": 7.550000000000043, "agent_compute-ego": 0.025746164321899415, "deviation-heading": 5.731757883059763, "set_robot_commands": 0.008429617087046305, "deviation-center-line": 0.3321614108948844, "driven_lanedir_consec": -0.004956006324957851, "sim_compute_sim_state": 0.005040684541066488, "sim_compute_performance-ego": 0.007212016582489013, "sim_compute_robot_state-ego": 0.008878678480784098, "sim_compute_robot_state-npc0": 0.008281983534495036, "sim_compute_robot_state-npc1": 0.008279852867126465, "sim_compute_robot_state-npc2": 0.008242863019307455, "sim_compute_robot_state-npc3": 0.00813288927078247}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.0232271018070128, "sim_physics": 0.1065079132715861, "survival_time": 14.950000000000076, "driven_lanedir": -0.003593621651392098, "sim_render-ego": 0.012336354255676267, "in-drivable-lane": 7.550000000000045, "agent_compute-ego": 0.02622385263442993, "deviation-heading": 5.491515898426221, "set_robot_commands": 0.008589994112650554, "deviation-center-line": 0.3047713314741245, "driven_lanedir_consec": -0.003593621651392098, "sim_compute_sim_state": 0.0051621405283610025, "sim_compute_performance-ego": 0.007353589534759521, "sim_compute_robot_state-ego": 0.008998537063598632, "sim_compute_robot_state-npc0": 0.008491779168446859, "sim_compute_robot_state-npc1": 0.008504716555277507, "sim_compute_robot_state-npc2": 0.008470439910888672, "sim_compute_robot_state-npc3": 0.008342049916585286}}
set_robot_commands_max	0.008589994112650554
set_robot_commands_mean	0.008223322815365261
set_robot_commands_median	0.008172475496927897
set_robot_commands_min	0.007876091003417969
sim_compute_performance-ego_max	0.007353589534759521
sim_compute_performance-ego_mean	0.00709049235449897
sim_compute_performance-ego_median	0.007060863176981608
sim_compute_performance-ego_min	0.00666108767191569
sim_compute_robot_state-ego_max	0.00900088628133138
sim_compute_robot_state-ego_mean	0.00876622602674696
sim_compute_robot_state-ego_median	0.008783566951751708
sim_compute_robot_state-ego_min	0.008264466921488444
sim_compute_robot_state-npc0_max	0.008491779168446859
sim_compute_robot_state-npc0_mean	0.00822260856628418
sim_compute_robot_state-npc0_median	0.008281983534495036
sim_compute_robot_state-npc0_min	0.007779457569122314
sim_compute_robot_state-npc1_max	0.008504716555277507
sim_compute_robot_state-npc1_mean	0.008180630683898927
sim_compute_robot_state-npc1_median	0.008150483767191569
sim_compute_robot_state-npc1_min	0.007825206915537517
sim_compute_robot_state-npc2_max	0.008470439910888672
sim_compute_robot_state-npc2_mean	0.008081149895985922
sim_compute_robot_state-npc2_median	0.008033326466878255
sim_compute_robot_state-npc2_min	0.007774207592010498
sim_compute_robot_state-npc3_max	0.008342049916585286
sim_compute_robot_state-npc3_mean	0.007942508538564045
sim_compute_robot_state-npc3_median	0.007932095527648926
sim_compute_robot_state-npc3_min	0.007661848862965902
sim_compute_sim_state_max	0.0051621405283610025
sim_compute_sim_state_mean	0.00495410066180759
sim_compute_sim_state_median	0.004945461750030518
sim_compute_sim_state_min	0.004737316767374674
sim_physics_max	0.11052736202875774
sim_physics_mean	0.1063305435180664
sim_physics_median	0.1065079132715861
sim_physics_min	0.1012788772583008
sim_render-ego_max	0.012485029697418212
sim_render-ego_mean	0.01211751323276096
sim_render-ego_median	0.012157175540924072
sim_render-ego_min	0.011469008127848308
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24330

4149

Andrea Censi 🇨🇭

rotation

aido3-LFVI-sim-validation

step1-simulation

success

idsc-rudolf-6886

2019-10-16 22:00:35+00:00

2019-10-16 22:16:09+00:00

0:15:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00030504467687686443
survival_time_median	14.950000000000076
deviation-center-line_median	0.4891046565937845
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.028902765115102133
agent_compute-ego_mean	0.02829154555002849
agent_compute-ego_median	0.028079884052276613
agent_compute-ego_min	0.02795434395472209
deviation-center-line_max	0.6113246250082045
deviation-center-line_mean	0.4225460275157091
deviation-center-line_min	0.020737627062439232
deviation-heading_max	5.830135897709591
deviation-heading_mean	5.6845705507076865
deviation-heading_median	5.657649106857696
deviation-heading_min	5.53666299685486
driven_any_max	0.026478672834052443
driven_any_mean	0.02486423959225232
driven_any_median	0.02593019554120905
driven_any_min	0.022165452661382787
driven_lanedir_consec_max	0.002162616049345756
driven_lanedir_consec_mean	-0.0004886462276807446
driven_lanedir_consec_min	-0.0036402347654349576
driven_lanedir_max	0.002162616049345756
driven_lanedir_mean	-0.0004886462276807446
driven_lanedir_median	0.00030504467687686443
driven_lanedir_min	-0.0036402347654349576
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.600000000000042
in-drivable-lane_min	7.550000000000044
per-episodes	details {"udem1-0-0": {"driven_any": 0.026478672834052443, "sim_physics": 0.12822961966196697, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.012888386249542236, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.02795434395472209, "deviation-heading": 5.657649106857696, "set_robot_commands": 0.008907160758972167, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.005288885434468587, "sim_compute_performance-ego": 0.007459109624226888, "sim_compute_robot_state-ego": 0.009314935207366945, "sim_compute_robot_state-npc0": 0.008964212735493977, "sim_compute_robot_state-npc1": 0.00885207494099935, "sim_compute_robot_state-npc2": 0.008659600416819254, "sim_compute_robot_state-npc3": 0.00846427838007609}, "udem1-1-0": {"driven_any": 0.02593019554120905, "sim_physics": 0.13165420611699422, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.013389945824941, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.028512141704559325, "deviation-heading": 5.79531637039674, "set_robot_commands": 0.008977559407552084, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.005368556181589762, "sim_compute_performance-ego": 0.007482030391693115, "sim_compute_robot_state-ego": 0.009354369640350342, "sim_compute_robot_state-npc0": 0.009101943174997964, "sim_compute_robot_state-npc1": 0.008917467594146728, "sim_compute_robot_state-npc2": 0.008816229502360025, "sim_compute_robot_state-npc3": 0.008719929059346517}, "udem1-2-0": {"driven_any": 0.023804404672430148, "sim_physics": 0.12739954789479574, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.0130984894434611, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.028008592923482255, "deviation-heading": 5.603088381719548, "set_robot_commands": 0.009050657749176023, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.005297602812449138, "sim_compute_performance-ego": 0.007431684335072835, "sim_compute_robot_state-ego": 0.009338982899983724, "sim_compute_robot_state-npc0": 0.008959218660990398, "sim_compute_robot_state-npc1": 0.008760744730631511, "sim_compute_robot_state-npc2": 0.008621234893798829, "sim_compute_robot_state-npc3": 0.008486776351928712}, "udem1-3-0": {"driven_any": 0.022165452661382787, "sim_physics": 0.12954686244328817, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202352883, "sim_render-ego": 0.013288396994272868, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.028902765115102133, "deviation-heading": 5.53666299685486, "set_robot_commands": 0.009091044267018636, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202352883, "sim_compute_sim_state": 0.0054240711530049645, "sim_compute_performance-ego": 0.007460434436798096, "sim_compute_robot_state-ego": 0.00926318883895874, "sim_compute_robot_state-npc0": 0.009043190479278564, "sim_compute_robot_state-npc1": 0.009021868705749512, "sim_compute_robot_state-npc2": 0.008916443983713785, "sim_compute_robot_state-npc3": 0.008846904436747233}, "udem1-4-0": {"driven_any": 0.02594247225218716, "sim_physics": 0.1303136165936788, "survival_time": 14.950000000000076, "driven_lanedir": 0.00030504467687686443, "sim_render-ego": 0.013248440424601236, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.028079884052276613, "deviation-heading": 5.830135897709591, "set_robot_commands": 0.008932409286499023, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.00030504467687686443, "sim_compute_sim_state": 0.005379922389984131, "sim_compute_performance-ego": 0.007423353195190429, "sim_compute_robot_state-ego": 0.009367825190226236, "sim_compute_robot_state-npc0": 0.009023288091023762, "sim_compute_robot_state-npc1": 0.008927062352498372, "sim_compute_robot_state-npc2": 0.008763251304626464, "sim_compute_robot_state-npc3": 0.008644445737202962}}
set_robot_commands_max	0.009091044267018636
set_robot_commands_mean	0.008991766293843587
set_robot_commands_median	0.008977559407552084
set_robot_commands_min	0.008907160758972167
sim_compute_performance-ego_max	0.007482030391693115
sim_compute_performance-ego_mean	0.007451322396596273
sim_compute_performance-ego_median	0.007459109624226888
sim_compute_performance-ego_min	0.007423353195190429
sim_compute_robot_state-ego_max	0.009367825190226236
sim_compute_robot_state-ego_mean	0.009327860355377197
sim_compute_robot_state-ego_median	0.009338982899983724
sim_compute_robot_state-ego_min	0.00926318883895874
sim_compute_robot_state-npc0_max	0.009101943174997964
sim_compute_robot_state-npc0_mean	0.009018370628356934
sim_compute_robot_state-npc0_median	0.009023288091023762
sim_compute_robot_state-npc0_min	0.008959218660990398
sim_compute_robot_state-npc1_max	0.009021868705749512
sim_compute_robot_state-npc1_mean	0.008895843664805095
sim_compute_robot_state-npc1_median	0.008917467594146728
sim_compute_robot_state-npc1_min	0.008760744730631511
sim_compute_robot_state-npc2_max	0.008916443983713785
sim_compute_robot_state-npc2_mean	0.00875535202026367
sim_compute_robot_state-npc2_median	0.008763251304626464
sim_compute_robot_state-npc2_min	0.008621234893798829
sim_compute_robot_state-npc3_max	0.008846904436747233
sim_compute_robot_state-npc3_mean	0.008632466793060303
sim_compute_robot_state-npc3_median	0.008644445737202962
sim_compute_robot_state-npc3_min	0.00846427838007609
sim_compute_sim_state_max	0.0054240711530049645
sim_compute_sim_state_mean	0.0053518075942993164
sim_compute_sim_state_median	0.005368556181589762
sim_compute_sim_state_min	0.005288885434468587
sim_physics_max	0.13165420611699422
sim_physics_mean	0.1294287705421448
sim_physics_median	0.12954686244328817
sim_physics_min	0.12739954789479574
sim_render-ego_max	0.013389945824941
sim_render-ego_mean	0.013182731787363688
sim_render-ego_median	0.013248440424601236
sim_render-ego_min	0.012888386249542236
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24327

4153

Andrea Censi 🇨🇭

minimal_agent_python2 (Python 2)

aido3-LF-sim-testing

step1-simulation

success

idsc-rudolf-6886

2019-10-16 17:09:34+00:00

2019-10-16 17:19:04+00:00

0:09:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6560989890090594
survival_time_median	3.649999999999995
deviation-center-line_median	0.14678748740599404
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.010148587979768453
agent_compute-ego_mean	0.009382715412171094
agent_compute-ego_median	0.009350061416625977
agent_compute-ego_min	0.00878923233241251
deviation-center-line_max	0.4005818627784723
deviation-center-line_mean	0.19535396696552737
deviation-center-line_min	0.12422801598242109
deviation-heading_max	1.0645521116851462
deviation-heading_mean	0.5821209778469638
deviation-heading_median	0.5423458590238992
deviation-heading_min	0.29987290367335917
driven_any_max	2.1648273185719797
driven_any_mean	0.9348502469008624
driven_any_median	0.9948273195001768
driven_any_min	0.2750262368649079
driven_lanedir_consec_max	2.0050790504729665
driven_lanedir_consec_mean	0.738495147174259
driven_lanedir_consec_min	0.2671322113623069
driven_lanedir_max	2.0050790504729665
driven_lanedir_mean	0.738495147174259
driven_lanedir_median	0.6560989890090594
driven_lanedir_min	0.2671322113623069
in-drivable-lane_max	1.5499999999999945
in-drivable-lane_mean	0.5433333333333313
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.0597166557834573, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.012052431498488336, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.009130886156265047, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.007960920464502622, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.004586801137009712, "sim_compute_performance-ego": 0.007552195901740087, "sim_compute_robot_state-ego": 0.008860006724318413}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009827319290899, "sim_physics": 0.05877366903665904, "survival_time": 3.699999999999995, "driven_lanedir": 0.8760331754635476, "sim_render-ego": 0.015173934601448676, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.009200508530075485, "deviation-heading": 1.047774623333474, "set_robot_commands": 0.007820783434687433, "deviation-center-line": 0.29642020115014733, "driven_lanedir_consec": 0.8760331754635476, "sim_compute_sim_state": 0.004623419529682881, "sim_compute_performance-ego": 0.007064964320208575, "sim_compute_robot_state-ego": 0.008680353293547759}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2750262368649079, "sim_physics": 0.06683158874511719, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2671322113623069, "sim_render-ego": 0.012930984497070312, "in-drivable-lane": 0, "agent_compute-ego": 0.0094879150390625, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.008158121109008789, "deviation-center-line": 0.12422801598242109, "driven_lanedir_consec": 0.2671322113623069, "sim_compute_sim_state": 0.004774141311645508, "sim_compute_performance-ego": 0.007539424896240234, "sim_compute_robot_state-ego": 0.00913538932800293}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4548365617710419, "sim_physics": 0.06006713815637537, "survival_time": 1.850000000000001, "driven_lanedir": 0.4333629680464388, "sim_render-ego": 0.012053515460040118, "in-drivable-lane": 0, "agent_compute-ego": 0.00922485300012537, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.00798706106237463, "deviation-center-line": 0.12501321046442526, "driven_lanedir_consec": 0.4333629680464388, "sim_compute_sim_state": 0.004587708292780696, "sim_compute_performance-ego": 0.006957621187777133, "sim_compute_robot_state-ego": 0.008493197930825723}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.05668535828590393, "survival_time": 5.599999999999988, "driven_lanedir": 1.1257539445961453, "sim_render-ego": 0.011600096310888016, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.009114691189357212, "deviation-heading": 0.31699480744097813, "set_robot_commands": 0.007785324539457049, "deviation-center-line": 0.4005818627784723, "driven_lanedir_consec": 1.1257539445961453, "sim_compute_sim_state": 0.004547106368201119, "sim_compute_performance-ego": 0.006926823939595904, "sim_compute_robot_state-ego": 0.008416160941123962}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.454836561771035, "sim_physics": 0.06136219565932815, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.012076506743559966, "in-drivable-lane": 0, "agent_compute-ego": 0.009098703796799118, "deviation-heading": 0.6191860504142409, "set_robot_commands": 0.0077877431302457245, "deviation-center-line": 0.13177329190693754, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.004539347983695366, "sim_compute_performance-ego": 0.0069874943913640205, "sim_compute_robot_state-ego": 0.008315260345871383}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0248273191286392, "sim_physics": 0.058505824406941735, "survival_time": 3.7499999999999942, "driven_lanedir": 0.5418367454355217, "sim_render-ego": 0.012412265141805013, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.009490315119425457, "deviation-heading": 0.5423458590238992, "set_robot_commands": 0.007991183598836262, "deviation-center-line": 0.14678748740599404, "driven_lanedir_consec": 0.5418367454355217, "sim_compute_sim_state": 0.004727945327758789, "sim_compute_performance-ego": 0.007271048227945964, "sim_compute_robot_state-ego": 0.008591121037801106}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3049465552081734, "sim_physics": 0.06443427227161548, "survival_time": 1.3500000000000003, "driven_lanedir": 0.29745564201515107, "sim_render-ego": 0.012625190946790908, "in-drivable-lane": 0, "agent_compute-ego": 0.009489244884914825, "deviation-heading": 0.29987290367335917, "set_robot_commands": 0.008109578379878291, "deviation-center-line": 0.1306820468362013, "driven_lanedir_consec": 0.29745564201515107, "sim_compute_sim_state": 0.00486826013635706, "sim_compute_performance-ego": 0.0072029343357792605, "sim_compute_robot_state-ego": 0.00891646632441768}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.7098274382089755, "sim_physics": 0.054901816226817945, "survival_time": 2.6999999999999984, "driven_lanedir": 0.7032085791835883, "sim_render-ego": 0.012105681278087477, "in-drivable-lane": 0, "agent_compute-ego": 0.009381426705254449, "deviation-heading": 0.36899467884091897, "set_robot_commands": 0.00800513779675519, "deviation-center-line": 0.18371297048277177, "driven_lanedir_consec": 0.7032085791835883, "sim_compute_sim_state": 0.0043938469003748015, "sim_compute_performance-ego": 0.006940303025422273, "sim_compute_robot_state-ego": 0.008313642607794868}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9948273195001768, "sim_physics": 0.05655303066723967, "survival_time": 3.649999999999995, "driven_lanedir": 0.6560989890090594, "sim_render-ego": 0.011745851333827188, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.00878923233241251, "deviation-heading": 0.6658599650846626, "set_robot_commands": 0.007622212579805557, "deviation-center-line": 0.1561741058626541, "driven_lanedir_consec": 0.6560989890090594, "sim_compute_sim_state": 0.004507626572700396, "sim_compute_performance-ego": 0.006906130542493847, "sim_compute_robot_state-ego": 0.008314126158413822}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5798273185720009, "sim_physics": 0.05748298764228821, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014600726933682, "sim_render-ego": 0.012101409690720696, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.00933672274862017, "deviation-heading": 0.5156620482368139, "set_robot_commands": 0.00791766813823155, "deviation-center-line": 0.20858216306835017, "driven_lanedir_consec": 1.2014600726933682, "sim_compute_sim_state": 0.0045242926904133385, "sim_compute_performance-ego": 0.007020203130585807, "sim_compute_robot_state-ego": 0.008435922009604318}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0098273192909009, "sim_physics": 0.06371460411999677, "survival_time": 3.699999999999995, "driven_lanedir": 0.6405535448452878, "sim_render-ego": 0.01258000812015018, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.009534191440891576, "deviation-heading": 1.0645521116851462, "set_robot_commands": 0.008055454975849873, "deviation-center-line": 0.2228681204106694, "driven_lanedir_consec": 0.6405535448452878, "sim_compute_sim_state": 0.004872537947989799, "sim_compute_performance-ego": 0.007402287947165, "sim_compute_robot_state-ego": 0.009019226641268344}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9948273195001752, "sim_physics": 0.05907053816808413, "survival_time": 3.649999999999995, "driven_lanedir": 0.7695653387571403, "sim_render-ego": 0.012323604871148933, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.009350061416625977, "deviation-heading": 0.4813700122068389, "set_robot_commands": 0.007905711866404912, "deviation-center-line": 0.1442443284046606, "driven_lanedir_consec": 0.7695653387571403, "sim_compute_sim_state": 0.0046557530964890575, "sim_compute_performance-ego": 0.007294651580183473, "sim_compute_robot_state-ego": 0.008706295326964496}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4698344777618675, "sim_physics": 0.06829598702882465, "survival_time": 1.900000000000001, "driven_lanedir": 0.4595449996397094, "sim_render-ego": 0.013584990250436885, "in-drivable-lane": 0, "agent_compute-ego": 0.010148587979768453, "deviation-heading": 0.398367781186276, "set_robot_commands": 0.008659438083046362, "deviation-center-line": 0.1252701007981349, "driven_lanedir_consec": 0.4595449996397094, "sim_compute_sim_state": 0.00517184483377557, "sim_compute_performance-ego": 0.008016918834887053, "sim_compute_robot_state-ego": 0.00938989614185534}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1648273185719797, "sim_physics": 0.062406652021092295, "survival_time": 7.549999999999981, "driven_lanedir": 2.0050790504729665, "sim_render-ego": 0.012668510146488418, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.009963390842968264, "deviation-heading": 0.9808458191188588, "set_robot_commands": 0.008386488781859543, "deviation-center-line": 0.3896160126120228, "driven_lanedir_consec": 2.0050790504729665, "sim_compute_sim_state": 0.004925721528514331, "sim_compute_performance-ego": 0.007560174196761175, "sim_compute_robot_state-ego": 0.009125679534002644}}
set_robot_commands_max	0.008659438083046362
set_robot_commands_mean	0.008010188529396254
set_robot_commands_median	0.00798706106237463
set_robot_commands_min	0.007622212579805557
sim_compute_performance-ego_max	0.008016918834887053
sim_compute_performance-ego_mean	0.007242878430543321
sim_compute_performance-ego_median	0.0072029343357792605
sim_compute_performance-ego_min	0.006906130542493847
sim_compute_robot_state-ego_max	0.00938989614185534
sim_compute_robot_state-ego_mean	0.00871418295638752
sim_compute_robot_state-ego_median	0.008680353293547759
sim_compute_robot_state-ego_min	0.008313642607794868
sim_compute_sim_state_max	0.00517184483377557
sim_compute_sim_state_mean	0.004687090243825896
sim_compute_sim_state_median	0.004623419529682881
sim_compute_sim_state_min	0.0043938469003748015
sim_physics_max	0.06829598702882465
sim_physics_mean	0.060586821214649464
sim_physics_median	0.0597166557834573
sim_physics_min	0.054901816226817945
sim_render-ego_max	0.015173934601448676
sim_render-ego_mean	0.012535665392730074
sim_render-ego_median	0.012323604871148933
sim_render-ego_min	0.011600096310888016
simulation-passed	1
survival_time_max	7.549999999999981
survival_time_mean	3.4499999999999957
survival_time_min	1.2500000000000004

No reset possible

24326

4154

Andrea Censi 🇨🇭

minimal_agent_python2 (Python 2)

aido3-LF-sim-validation

step1-simulation

success

idsc-rudolf-6886

2019-10-16 17:05:42+00:00

2019-10-16 17:09:21+00:00

0:03:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6707441932890994
survival_time_median	3.649999999999995
deviation-center-line_median	0.14435558631904788
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.009609837789793272
agent_compute-ego_mean	0.009369221850257905
agent_compute-ego_median	0.009452630366597856
agent_compute-ego_min	0.009136171340942382
deviation-center-line_max	0.4005818627784723
deviation-center-line_mean	0.21811977533890275
deviation-center-line_min	0.12422801598242109
deviation-heading_max	1.047774623333474
deviation-heading_mean	0.5589514876466882
deviation-heading_median	0.5590533399929921
deviation-heading_min	0.3001803644882976
driven_any_max	1.5798273185719856
driven_any_mean	0.8628689511998026
driven_any_median	0.9948273195001778
driven_any_min	0.2750262368649079
driven_lanedir_consec_max	1.1257539445961453
driven_lanedir_consec_mean	0.6746052985515076
driven_lanedir_consec_min	0.2671322113623069
driven_lanedir_max	1.1257539445961453
driven_lanedir_mean	0.6746052985515076
driven_lanedir_median	0.6707441932890994
driven_lanedir_min	0.2671322113623069
in-drivable-lane_max	1.499999999999995
in-drivable-lane_mean	0.5299999999999981
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.059729151529808566, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.012713644602527358, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.009487299069966357, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.008047515398835482, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.004767976395071369, "sim_compute_performance-ego": 0.007779823590631355, "sim_compute_robot_state-ego": 0.009195631497526825}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009827319290899, "sim_physics": 0.062436055492710425, "survival_time": 3.699999999999995, "driven_lanedir": 0.8760331754635476, "sim_render-ego": 0.012930290119068042, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.009609837789793272, "deviation-heading": 1.047774623333474, "set_robot_commands": 0.008205127071689916, "deviation-center-line": 0.29642020115014733, "driven_lanedir_consec": 0.8760331754635476, "sim_compute_sim_state": 0.004969255344287769, "sim_compute_performance-ego": 0.007561512895532556, "sim_compute_robot_state-ego": 0.009491208437326792}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2750262368649079, "sim_physics": 0.06109348297119141, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2671322113623069, "sim_render-ego": 0.012716541290283203, "in-drivable-lane": 0, "agent_compute-ego": 0.009136171340942382, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.00796269416809082, "deviation-center-line": 0.12422801598242109, "driven_lanedir_consec": 0.2671322113623069, "sim_compute_sim_state": 0.004597244262695313, "sim_compute_performance-ego": 0.00741734504699707, "sim_compute_robot_state-ego": 0.009084291458129884}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4548365617710419, "sim_physics": 0.06294048154676282, "survival_time": 1.850000000000001, "driven_lanedir": 0.4333629680464388, "sim_render-ego": 0.012094323699538771, "in-drivable-lane": 0, "agent_compute-ego": 0.009160170683989654, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.00783188278610642, "deviation-center-line": 0.12501321046442526, "driven_lanedir_consec": 0.4333629680464388, "sim_compute_sim_state": 0.0048122277130951754, "sim_compute_performance-ego": 0.007178538554423564, "sim_compute_robot_state-ego": 0.008668635342572187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.05834588834217617, "survival_time": 5.599999999999988, "driven_lanedir": 1.1257539445961453, "sim_render-ego": 0.012537934950419835, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.009452630366597856, "deviation-heading": 0.31699480744097813, "set_robot_commands": 0.008026440228734697, "deviation-center-line": 0.4005818627784723, "driven_lanedir_consec": 1.1257539445961453, "sim_compute_sim_state": 0.004673280886241368, "sim_compute_performance-ego": 0.00727892347744533, "sim_compute_robot_state-ego": 0.008856654167175293}}
set_robot_commands_max	0.008205127071689916
set_robot_commands_mean	0.008014731930691469
set_robot_commands_median	0.008026440228734697
set_robot_commands_min	0.00783188278610642
sim_compute_performance-ego_max	0.007779823590631355
sim_compute_performance-ego_mean	0.007443228713005975
sim_compute_performance-ego_median	0.00741734504699707
sim_compute_performance-ego_min	0.007178538554423564
sim_compute_robot_state-ego_max	0.009491208437326792
sim_compute_robot_state-ego_mean	0.009059284180546197
sim_compute_robot_state-ego_median	0.009084291458129884
sim_compute_robot_state-ego_min	0.008668635342572187
sim_compute_sim_state_max	0.004969255344287769
sim_compute_sim_state_mean	0.004763996920278199
sim_compute_sim_state_median	0.004767976395071369
sim_compute_sim_state_min	0.004597244262695313
sim_physics_max	0.06294048154676282
sim_physics_mean	0.06090901197652989
sim_physics_median	0.06109348297119141
sim_physics_min	0.05834588834217617
sim_render-ego_max	0.012930290119068042
sim_render-ego_mean	0.012598546932367444
sim_render-ego_median	0.012713644602527358
sim_render-ego_min	0.012094323699538771
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	3.209999999999996
survival_time_min	1.2500000000000004

No reset possible

24323

4157

Andrea Censi 🇨🇭

minimal_agent_python2 (Python 2)

aido3-LFVI-sim-testing

step1-simulation

success

idsc-rudolf-6886

2019-10-16 16:49:47+00:00

2019-10-16 17:05:34+00:00

0:15:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4674075261701268
survival_time_median	3.699999999999995
deviation-center-line_median	0.2037212999690195
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.01007554680109024
agent_compute-ego_mean	0.009725185434999848
agent_compute-ego_median	0.009763408016848874
agent_compute-ego_min	0.00929529602463181
deviation-center-line_max	0.5183621890690367
deviation-center-line_mean	0.2365365432439713
deviation-center-line_min	0.1001276403534276
deviation-heading_max	1.8192903310562811
deviation-heading_mean	0.7195980419067693
deviation-heading_median	0.5070424162880826
deviation-heading_min	0.2495279988048577
driven_any_max	2.764827318571964
driven_any_mean	1.0818349506618754
driven_any_median	1.0098273192909006
driven_any_min	0.3648701917101222
driven_lanedir_consec_max	1.9044523873117627
driven_lanedir_consec_mean	0.759860328609196
driven_lanedir_consec_min	0.3272146444894328
driven_lanedir_max	1.9045033171069223
driven_lanedir_mean	0.7732651243581526
driven_lanedir_median	0.6173586051289615
driven_lanedir_min	0.3272146444894328
in-drivable-lane_max	3.7999999999999887
in-drivable-lane_mean	0.8633333333333326
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.12005692774111086, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.01192749513162149, "in-drivable-lane": 0, "agent_compute-ego": 0.00929529602463181, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.007976740330189198, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.004663997942262942, "sim_compute_performance-ego": 0.007106615616394593, "sim_compute_robot_state-ego": 0.00877350729864997, "sim_compute_robot_state-npc0": 0.007720530570090354, "sim_compute_robot_state-npc1": 0.007631170857060063, "sim_compute_robot_state-npc2": 0.007593584490251971, "sim_compute_robot_state-npc3": 0.007543868846721477}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.12531908782752785, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.01270741385382575, "in-drivable-lane": 0, "agent_compute-ego": 0.009915512961310309, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.008206657461217931, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.004805854848913244, "sim_compute_performance-ego": 0.00728136784321553, "sim_compute_robot_state-ego": 0.008738517761230469, "sim_compute_robot_state-npc0": 0.007871511820200327, "sim_compute_robot_state-npc1": 0.007997667467271959, "sim_compute_robot_state-npc2": 0.007812139150258657, "sim_compute_robot_state-npc3": 0.008928930437242662}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.11900152749573158, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.012118833743973285, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.009661445554518542, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.008088560293841836, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.004720855232895605, "sim_compute_performance-ego": 0.007131379171712509, "sim_compute_robot_state-ego": 0.0087391793333142, "sim_compute_robot_state-npc0": 0.007773004620280487, "sim_compute_robot_state-npc1": 0.007861502123194815, "sim_compute_robot_state-npc2": 0.00780589533167959, "sim_compute_robot_state-npc3": 0.007655442155749592}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.11892099655111422, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.01231646787433724, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.009771187268002496, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.008216483430712636, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.004687384161025441, "sim_compute_performance-ego": 0.007155850295621063, "sim_compute_robot_state-ego": 0.00877852340019186, "sim_compute_robot_state-npc0": 0.007888486872168735, "sim_compute_robot_state-npc1": 0.007859641968891882, "sim_compute_robot_state-npc2": 0.007781978677080564, "sim_compute_robot_state-npc3": 0.007636482178852821}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.1277649775147438, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.012918546795845032, "in-drivable-lane": 0, "agent_compute-ego": 0.01007554680109024, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.008405216038227081, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.004897572100162506, "sim_compute_performance-ego": 0.007560797035694122, "sim_compute_robot_state-ego": 0.00917777419090271, "sim_compute_robot_state-npc0": 0.008152775466442108, "sim_compute_robot_state-npc1": 0.008072055876255035, "sim_compute_robot_state-npc2": 0.00810311734676361, "sim_compute_robot_state-npc3": 0.008070416748523712}, "udem1-5-0": {"driven_any": 1.0548273189057942, "sim_physics": 0.12332331669795048, "survival_time": 3.8499999999999943, "driven_lanedir": 0.39637369698573455, "sim_render-ego": 0.012590033667428151, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.009763408016848874, "deviation-heading": 1.272726140232846, "set_robot_commands": 0.008253097534179688, "deviation-center-line": 0.2037212999690195, "driven_lanedir_consec": 0.39637369698573455, "sim_compute_sim_state": 0.004884744619394278, "sim_compute_performance-ego": 0.007411442793808974, "sim_compute_robot_state-ego": 0.008899828056236367, "sim_compute_robot_state-npc0": 0.008022450781487798, "sim_compute_robot_state-npc1": 0.008058696598201603, "sim_compute_robot_state-npc2": 0.008044023018378716, "sim_compute_robot_state-npc3": 0.007941394657283635}, "udem1-6-0": {"driven_any": 0.8898273241328052, "sim_physics": 0.13596965688647647, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8871438691197218, "sim_render-ego": 0.01235041112610788, "in-drivable-lane": 0, "agent_compute-ego": 0.009812557336055872, "deviation-heading": 0.2564691131854334, "set_robot_commands": 0.008170760039127234, "deviation-center-line": 0.3019392944051749, "driven_lanedir_consec": 0.8871438691197218, "sim_compute_sim_state": 0.004760572404572458, "sim_compute_performance-ego": 0.007052486593073065, "sim_compute_robot_state-ego": 0.008720004197322962, "sim_compute_robot_state-npc0": 0.007994294166564941, "sim_compute_robot_state-npc1": 0.007930488297433563, "sim_compute_robot_state-npc2": 0.007794452436042555, "sim_compute_robot_state-npc3": 0.007810415643634218}, "udem1-7-0": {"driven_any": 1.0098273192909006, "sim_physics": 0.13246524978328394, "survival_time": 3.699999999999995, "driven_lanedir": 0.8892952338440012, "sim_render-ego": 0.01231423906377844, "in-drivable-lane": 0, "agent_compute-ego": 0.009530083553211109, "deviation-heading": 1.3305395181824708, "set_robot_commands": 0.008132879798476761, "deviation-center-line": 0.2328954250769578, "driven_lanedir_consec": 0.8751257158125099, "sim_compute_sim_state": 0.004780282845368257, "sim_compute_performance-ego": 0.006997730280901934, "sim_compute_robot_state-ego": 0.00876009464263916, "sim_compute_robot_state-npc0": 0.007818251042752652, "sim_compute_robot_state-npc1": 0.007926016240506558, "sim_compute_robot_state-npc2": 0.007840159777048472, "sim_compute_robot_state-npc3": 0.007722964157929292}, "udem1-8-0": {"driven_any": 1.024827319128602, "sim_physics": 0.1095163631439209, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6173586051289615, "sim_render-ego": 0.0124439271291097, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.010013478597005208, "deviation-heading": 1.2558531851712094, "set_robot_commands": 0.008434391021728516, "deviation-center-line": 0.25318000812184893, "driven_lanedir_consec": 0.6173586051289615, "sim_compute_sim_state": 0.004524459838867187, "sim_compute_performance-ego": 0.007216752370198568, "sim_compute_robot_state-ego": 0.008679545720418295, "sim_compute_robot_state-npc0": 0.007704804738362631, "sim_compute_robot_state-npc1": 0.007803805669148763, "sim_compute_robot_state-npc2": 0.007764921188354492, "sim_compute_robot_state-npc3": 0.0076711591084798175}, "udem1-9-0": {"driven_any": 0.45483656177104664, "sim_physics": 0.13482564848822515, "survival_time": 1.850000000000001, "driven_lanedir": 0.4388914430822646, "sim_render-ego": 0.01224024231369431, "in-drivable-lane": 0, "agent_compute-ego": 0.00957247373220083, "deviation-heading": 0.49131063474122394, "set_robot_commands": 0.007916792018993481, "deviation-center-line": 0.1166531854243332, "driven_lanedir_consec": 0.4388914430822646, "sim_compute_sim_state": 0.004622253211768898, "sim_compute_performance-ego": 0.0070522991386619775, "sim_compute_robot_state-ego": 0.008576573552312079, "sim_compute_robot_state-npc0": 0.007654016082351272, "sim_compute_robot_state-npc1": 0.007816907521840688, "sim_compute_robot_state-npc2": 0.007716217556515256, "sim_compute_robot_state-npc3": 0.007609779770309861}, "udem1-10-0": {"driven_any": 0.3648701917101222, "sim_physics": 0.12244807520220356, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552109787971164, "sim_render-ego": 0.01241878540285172, "in-drivable-lane": 0, "agent_compute-ego": 0.010010650081019248, "deviation-heading": 0.5070424162880826, "set_robot_commands": 0.008303673036636846, "deviation-center-line": 0.1001276403534276, "driven_lanedir_consec": 0.34552109787971164, "sim_compute_sim_state": 0.004824784494215442, "sim_compute_performance-ego": 0.007393490883611863, "sim_compute_robot_state-ego": 0.008661239377913936, "sim_compute_robot_state-npc0": 0.007753918247838174, "sim_compute_robot_state-npc1": 0.007880764622842111, "sim_compute_robot_state-npc2": 0.007752756918630292, "sim_compute_robot_state-npc3": 0.007896015720982705}, "udem1-11-0": {"driven_any": 0.4098472254790859, "sim_physics": 0.1125940154580509, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054397040222266, "sim_render-ego": 0.012816408101250143, "in-drivable-lane": 0, "agent_compute-ego": 0.00998525058521944, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.008568167686462402, "deviation-center-line": 0.16731842400967326, "driven_lanedir_consec": 0.4054397040222266, "sim_compute_sim_state": 0.00455012040979722, "sim_compute_performance-ego": 0.007231347701128791, "sim_compute_robot_state-ego": 0.008445978164672852, "sim_compute_robot_state-npc0": 0.007509119370404412, "sim_compute_robot_state-npc1": 0.007708858041202321, "sim_compute_robot_state-npc2": 0.007927158299614401, "sim_compute_robot_state-npc3": 0.007633538807139677}, "udem1-12-0": {"driven_any": 1.4748273185722356, "sim_physics": 0.11833382334027973, "survival_time": 5.249999999999989, "driven_lanedir": 0.3272146444894328, "sim_render-ego": 0.011796360924130394, "in-drivable-lane": 3.7999999999999887, "agent_compute-ego": 0.009504016240437825, "deviation-heading": 0.3112188917063981, "set_robot_commands": 0.008009345190865652, "deviation-center-line": 0.16525953982768174, "driven_lanedir_consec": 0.3272146444894328, "sim_compute_sim_state": 0.004526510692778088, "sim_compute_performance-ego": 0.006923857189360119, "sim_compute_robot_state-ego": 0.008537594477335613, "sim_compute_robot_state-npc0": 0.007635747818719773, "sim_compute_robot_state-npc1": 0.007591104507446289, "sim_compute_robot_state-npc2": 0.007541747320265997, "sim_compute_robot_state-npc3": 0.007409111658732096}, "udem1-13-0": {"driven_any": 0.9948273195001724, "sim_physics": 0.10696102821663636, "survival_time": 3.649999999999995, "driven_lanedir": 0.6553480498428992, "sim_render-ego": 0.0120196669069055, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.009568100106226256, "deviation-heading": 0.7740959733116568, "set_robot_commands": 0.008065200831792126, "deviation-center-line": 0.19736301642105017, "driven_lanedir_consec": 0.6553480498428992, "sim_compute_sim_state": 0.004489134435784327, "sim_compute_performance-ego": 0.006867036427537056, "sim_compute_robot_state-ego": 0.00847625732421875, "sim_compute_robot_state-npc0": 0.007578611373901367, "sim_compute_robot_state-npc1": 0.007485108832790427, "sim_compute_robot_state-npc2": 0.007549204238473553, "sim_compute_robot_state-npc3": 0.007556239219561015}, "udem1-14-0": {"driven_any": 1.219827318592, "sim_physics": 0.12281594493172386, "survival_time": 4.399999999999992, "driven_lanedir": 0.6539905402707253, "sim_render-ego": 0.012136245315725151, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.009398774667219684, "deviation-heading": 1.8192903310562811, "set_robot_commands": 0.008013746955178001, "deviation-center-line": 0.26377380229393954, "driven_lanedir_consec": 0.4674075261701268, "sim_compute_sim_state": 0.0045219280503012915, "sim_compute_performance-ego": 0.007137965072285046, "sim_compute_robot_state-ego": 0.008772942152890291, "sim_compute_robot_state-npc0": 0.007624769752675837, "sim_compute_robot_state-npc1": 0.007609475742686878, "sim_compute_robot_state-npc2": 0.007591456174850464, "sim_compute_robot_state-npc3": 0.007545482028614391}}
set_robot_commands_max	0.008568167686462402
set_robot_commands_mean	0.008184114111175292
set_robot_commands_median	0.008170760039127234
set_robot_commands_min	0.007916792018993481
sim_compute_performance-ego_max	0.007560797035694122
sim_compute_performance-ego_mean	0.007168027894213682
sim_compute_performance-ego_median	0.007137965072285046
sim_compute_performance-ego_min	0.006867036427537056
sim_compute_robot_state-ego_max	0.00917777419090271
sim_compute_robot_state-ego_mean	0.008715837310016633
sim_compute_robot_state-ego_median	0.008738517761230469
sim_compute_robot_state-ego_min	0.008445978164672852
sim_compute_robot_state-npc0_max	0.008152775466442108
sim_compute_robot_state-npc0_mean	0.007780152848282725
sim_compute_robot_state-npc0_median	0.007753918247838174
sim_compute_robot_state-npc0_min	0.007509119370404412
sim_compute_robot_state-npc1_max	0.008072055876255035
sim_compute_robot_state-npc1_mean	0.007815550957784863
sim_compute_robot_state-npc1_median	0.007859641968891882
sim_compute_robot_state-npc1_min	0.007485108832790427
sim_compute_robot_state-npc2_max	0.00810311734676361
sim_compute_robot_state-npc2_mean	0.007774587461613907
sim_compute_robot_state-npc2_median	0.007781978677080564
sim_compute_robot_state-npc2_min	0.007541747320265997
sim_compute_robot_state-npc3_max	0.008928930437242662
sim_compute_robot_state-npc3_mean	0.0077754160759837985
sim_compute_robot_state-npc3_median	0.007655442155749592
sim_compute_robot_state-npc3_min	0.007409111658732096
sim_compute_sim_state_max	0.004897572100162506
sim_compute_sim_state_mean	0.004684030352540479
sim_compute_sim_state_median	0.004687384161025441
sim_compute_sim_state_min	0.004489134435784327
sim_physics_max	0.13596965688647647
sim_physics_mean	0.12202110928526531
sim_physics_median	0.12244807520220356
sim_physics_min	0.10696102821663636
sim_render-ego_max	0.012918546795845032
sim_render-ego_mean	0.012341005156705614
sim_render-ego_median	0.01231646787433724
sim_render-ego_min	0.011796360924130394
simulation-passed	1
survival_time_max	9.55
survival_time_mean	3.939999999999995
survival_time_min	1.5500000000000007

No reset possible

24320

4140

Andrea Censi 🇨🇭

rotation

aido3-LFVI-sim-validation

step1-simulation

success

idsc-rudolf-6886

2019-10-16 16:33:29+00:00

2019-10-16 16:49:06+00:00

0:15:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00030504467687686443
survival_time_median	14.950000000000076
deviation-center-line_median	0.4891046565937845
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.027212907473246256
agent_compute-ego_mean	0.026451474030812584
agent_compute-ego_median	0.026406496365865072
agent_compute-ego_min	0.02552311897277832
deviation-center-line_max	0.6113246250082045
deviation-center-line_mean	0.4225460275157091
deviation-center-line_min	0.020737627062439232
deviation-heading_max	5.830135897709591
deviation-heading_mean	5.6845705507076865
deviation-heading_median	5.657649106857696
deviation-heading_min	5.53666299685486
driven_any_max	0.026478672834052443
driven_any_mean	0.02486423959225232
driven_any_median	0.02593019554120905
driven_any_min	0.022165452661382787
driven_lanedir_consec_max	0.002162616049345756
driven_lanedir_consec_mean	-0.0004886462276807446
driven_lanedir_consec_min	-0.0036402347654349576
driven_lanedir_max	0.002162616049345756
driven_lanedir_mean	-0.0004886462276807446
driven_lanedir_median	0.00030504467687686443
driven_lanedir_min	-0.0036402347654349576
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.600000000000042
in-drivable-lane_min	7.550000000000044
per-episodes	details {"udem1-0-0": {"driven_any": 0.026478672834052443, "sim_physics": 0.12378991921742756, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.012264185746510824, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.026214756965637208, "deviation-heading": 5.657649106857696, "set_robot_commands": 0.008287295500437419, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.004968632062276205, "sim_compute_performance-ego": 0.007117487589518229, "sim_compute_robot_state-ego": 0.008809192180633545, "sim_compute_robot_state-npc0": 0.00842116117477417, "sim_compute_robot_state-npc1": 0.0081976850827535, "sim_compute_robot_state-npc2": 0.008072224458058675, "sim_compute_robot_state-npc3": 0.007955197493235271}, "udem1-1-0": {"driven_any": 0.02593019554120905, "sim_physics": 0.12635753711064657, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.012312430540720622, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.027212907473246256, "deviation-heading": 5.79531637039674, "set_robot_commands": 0.008355464935302735, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.004943830172220866, "sim_compute_performance-ego": 0.007134323120117188, "sim_compute_robot_state-ego": 0.008863298892974854, "sim_compute_robot_state-npc0": 0.00832485834757487, "sim_compute_robot_state-npc1": 0.008297779560089112, "sim_compute_robot_state-npc2": 0.008093133767445882, "sim_compute_robot_state-npc3": 0.007987407048543295}, "udem1-2-0": {"driven_any": 0.023804404672430148, "sim_physics": 0.12483500639597576, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.012318315505981446, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.026406496365865072, "deviation-heading": 5.603088381719548, "set_robot_commands": 0.008395292758941651, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.00500002384185791, "sim_compute_performance-ego": 0.007229768435160319, "sim_compute_robot_state-ego": 0.008950769106547038, "sim_compute_robot_state-npc0": 0.008468636671702067, "sim_compute_robot_state-npc1": 0.008313150405883788, "sim_compute_robot_state-npc2": 0.008176883856455486, "sim_compute_robot_state-npc3": 0.008055251439412435}, "udem1-3-0": {"driven_any": 0.022165452661382787, "sim_physics": 0.12634495417277017, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202352883, "sim_render-ego": 0.012210980256398518, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.02690009037653605, "deviation-heading": 5.53666299685486, "set_robot_commands": 0.008352585633595784, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202352883, "sim_compute_sim_state": 0.00493402640024821, "sim_compute_performance-ego": 0.007125205198923747, "sim_compute_robot_state-ego": 0.008756195704142253, "sim_compute_robot_state-npc0": 0.008168443044026693, "sim_compute_robot_state-npc1": 0.00803205172220866, "sim_compute_robot_state-npc2": 0.007961746056874592, "sim_compute_robot_state-npc3": 0.007873520056406657}, "udem1-4-0": {"driven_any": 0.02594247225218716, "sim_physics": 0.122741748491923, "survival_time": 14.950000000000076, "driven_lanedir": 0.00030504467687686443, "sim_render-ego": 0.012248419920603434, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.02552311897277832, "deviation-heading": 5.830135897709591, "set_robot_commands": 0.008179262479146321, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.00030504467687686443, "sim_compute_sim_state": 0.0049286492665608726, "sim_compute_performance-ego": 0.0072195132573445635, "sim_compute_robot_state-ego": 0.008763091564178467, "sim_compute_robot_state-npc0": 0.00815807819366455, "sim_compute_robot_state-npc1": 0.008083949089050293, "sim_compute_robot_state-npc2": 0.007933750947316487, "sim_compute_robot_state-npc3": 0.007854207356770834}}
set_robot_commands_max	0.008395292758941651
set_robot_commands_mean	0.00831398026148478
set_robot_commands_median	0.008352585633595784
set_robot_commands_min	0.008179262479146321
sim_compute_performance-ego_max	0.007229768435160319
sim_compute_performance-ego_mean	0.007165259520212809
sim_compute_performance-ego_median	0.007134323120117188
sim_compute_performance-ego_min	0.007117487589518229
sim_compute_robot_state-ego_max	0.008950769106547038
sim_compute_robot_state-ego_mean	0.00882850948969523
sim_compute_robot_state-ego_median	0.008809192180633545
sim_compute_robot_state-ego_min	0.008756195704142253
sim_compute_robot_state-npc0_max	0.008468636671702067
sim_compute_robot_state-npc0_mean	0.008308235486348469
sim_compute_robot_state-npc0_median	0.00832485834757487
sim_compute_robot_state-npc0_min	0.00815807819366455
sim_compute_robot_state-npc1_max	0.008313150405883788
sim_compute_robot_state-npc1_mean	0.008184923171997071
sim_compute_robot_state-npc1_median	0.0081976850827535
sim_compute_robot_state-npc1_min	0.00803205172220866
sim_compute_robot_state-npc2_max	0.008176883856455486
sim_compute_robot_state-npc2_mean	0.008047547817230225
sim_compute_robot_state-npc2_median	0.008072224458058675
sim_compute_robot_state-npc2_min	0.007933750947316487
sim_compute_robot_state-npc3_max	0.008055251439412435
sim_compute_robot_state-npc3_mean	0.007945116678873699
sim_compute_robot_state-npc3_median	0.007955197493235271
sim_compute_robot_state-npc3_min	0.007854207356770834
sim_compute_sim_state_max	0.00500002384185791
sim_compute_sim_state_mean	0.0049550323486328126
sim_compute_sim_state_median	0.004943830172220866
sim_compute_sim_state_min	0.0049286492665608726
sim_physics_max	0.12635753711064657
sim_physics_mean	0.1248138330777486
sim_physics_median	0.12483500639597576
sim_physics_min	0.122741748491923
sim_render-ego_max	0.012318315505981446
sim_render-ego_mean	0.012270866394042968
sim_render-ego_median	0.012264185746510824
sim_render-ego_min	0.012210980256398518
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24313

4128

Andrea Censi 🇨🇭

rotation

aido3-LFV-sim-validation

step1-simulation

error

idsc-rudolf-6886

2019-10-16 15:01:23+00:00

2019-10-16 15:02:06+00:00

0:00:43

Unexpected exception [...]

Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 77, in main
    agent_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 83, in _get_node_protocol
    timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 215, in read_one
    data = object_from_ipce(msg[FIELD_DATA], klass)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 66, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 169, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 338, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 169, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 338, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 161, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 428, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 140, in object_from_ipce_
    sr = typelike_from_ipce_sr(schema, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_typelike_from_ipce.py", line 111, in typelike_from_ipce_sr
    sre = typelike_from_ipce_sr_(schema0, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_typelike_from_ipce.py", line 229, in typelike_from_ipce_sr_
    schema, schema_id=schema_id, ieds=ieds, iedo=iedo
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_typelike_from_ipce.py", line 441, in typelike_from_ipce_dataclass
    ordered = res[X_ORDER]
KeyError: 'order'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

ID	1576
evaluator	`idsc-rudolf-6886`
owner	Andrea Censi 🇨🇭
machine	idsc-rudolf
process	idsc-rudolf-6886
version	d-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard	2019-10-16 11:32:40+00:00
last heard	2019-10-23 08:32:08+00:00
status	inactive
# evaluating
# success	7 `24320`
# timeout
# failed	1 `24357`
# error	1 `24313`
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator 1576

Evaluator jobs