Evaluator 1863

LFv-sim

success

2020-10-18 16:57:26+00:00

2020-10-18 17:21:44+00:00

0:24:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.4054131312023622
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.030801042715708413
agent_compute-ego_mean	0.028973749478658033
agent_compute-ego_median	0.02978338162104289
agent_compute-ego_min	0.02525691270828247
complete-iteration_max	0.2921697680155436
complete-iteration_mean	0.2764370911121368
complete-iteration_median	0.27230661789576216
complete-iteration_min	0.2660279766718547
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.41778364329376794
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.8869656519179927
deviation-heading_median	1.6198720948235377
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	8.215966626878722e-14
driven_any_median	1.3278267374516872e-13
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	3.564357757568359e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	3.564357757568359e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_state_dump_max	0.02087790012359619
get_state_dump_mean	0.01928633983929952
get_state_dump_median	0.019891743659973146
get_state_dump_min	0.01684008280436198
get_ui_image_max	0.05443480094273885
get_ui_image_mean	0.048861116806666056
get_ui_image_median	0.047407201528549194
get_ui_image_min	0.04639147679011027
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.047605780760447185, "step_physics": 0.09667451779047648, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019903250535329185, "sim_render-ego": 0.008346552848815919, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029710593223571776, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2708648649851481, "set_robot_commands": 0.007622543176015218, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028998181025187173, "sim_compute_performance-ego": 0.007208169301350912, "sim_compute_robot_state-ego": 0.012783833344777423, "sim_compute_robot_state-parked0": 0.011769426663716637}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04699512799580892, "step_physics": 0.09529720624287924, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019323031107584637, "sim_render-ego": 0.008164926369984945, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028639771938323975, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.26629607677459716, "set_robot_commands": 0.007638169924418132, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02931211630503337, "sim_compute_performance-ego": 0.006790703932444255, "sim_compute_robot_state-ego": 0.01233404318491618, "sim_compute_robot_state-parked0": 0.011565499305725098}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04639572302500407, "step_physics": 0.0902322498957316, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02058408975601196, "sim_render-ego": 0.008283139069875082, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030481383005777993, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2660279766718547, "set_robot_commands": 0.00814413070678711, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.029743276437123618, "sim_compute_performance-ego": 0.007067255973815918, "sim_compute_robot_state-ego": 0.012307712237040202, "sim_compute_robot_state-parked0": 0.0125311279296875}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04639147679011027, "step_physics": 0.09069443623224896, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020645628770192465, "sim_render-ego": 0.008350712458292643, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03065714359283447, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.26686824321746827, "set_robot_commands": 0.008041152159372966, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02928490956624349, "sim_compute_performance-ego": 0.007196101347605387, "sim_compute_robot_state-ego": 0.012641648451487224, "sim_compute_robot_state-parked0": 0.01269963026046753}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04878015120824178, "step_physics": 0.09244542598724365, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.02087790012359619, "sim_render-ego": 0.008802994887034099, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03041081508000692, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.27374837080637615, "set_robot_commands": 0.008570717970530191, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.029454292456309, "sim_compute_performance-ego": 0.007648456891377767, "sim_compute_robot_state-ego": 0.01354060649871826, "sim_compute_robot_state-parked0": 0.012955429553985596}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.0, "get_ui_image": 0.0472086222966512, "step_physics": 0.09118978897730508, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.020484453837076824, "sim_render-ego": 0.008454657395680746, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030801042715708413, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.26649869441986085, "set_robot_commands": 0.007832825978597005, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.0289649232228597, "sim_compute_performance-ego": 0.006959661642710368, "sim_compute_robot_state-ego": 0.012104543050130208, "sim_compute_robot_state-parked0": 0.012235188484191894}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04716792265574137, "step_physics": 0.1148447036743164, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019880236784617103, "sim_render-ego": 0.007996301651000976, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029856170018513997, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2862496852874756, "set_robot_commands": 0.007331685225168864, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028789130846659343, "sim_compute_performance-ego": 0.006621000766754151, "sim_compute_robot_state-ego": 0.011781280835469563, "sim_compute_robot_state-parked0": 0.011725746790568032}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.049802653789520264, "step_physics": 0.12873610496520996, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01684008280436198, "sim_render-ego": 0.0072663680712382, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02689554532368978, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2921697680155436, "set_robot_commands": 0.006628053983052572, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028483211199442547, "sim_compute_performance-ego": 0.006054495175679525, "sim_compute_robot_state-ego": 0.010643943945566814, "sim_compute_robot_state-parked0": 0.0105976406733195}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.05443480094273885, "step_physics": 0.11888911883036296, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.016907487710316974, "sim_render-ego": 0.006984500090281168, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02525691270828247, "deviation-heading": 2.800123339068113, "complete-iteration": 0.2855885044733683, "set_robot_commands": 0.006816879113515218, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.029117860794067384, "sim_compute_performance-ego": 0.005903906027475993, "sim_compute_robot_state-ego": 0.010506839752197263, "sim_compute_robot_state-parked0": 0.010554168224334717}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.05382890860239665, "step_physics": 0.11846319834391277, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.017417236963907876, "sim_render-ego": 0.007332925001780192, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027028117179870605, "deviation-heading": 2.800123339068113, "complete-iteration": 0.2900587264696757, "set_robot_commands": 0.006925144990285238, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03088611920674642, "sim_compute_performance-ego": 0.0062697656949361165, "sim_compute_robot_state-ego": 0.01114559014638265, "sim_compute_robot_state-parked0": 0.010523922443389892}}
set_robot_commands_max	0.008570717970530191
set_robot_commands_mean	0.007555130322774252
set_robot_commands_median	0.007630356550216675
set_robot_commands_min	0.006628053983052572
sim_compute_performance-ego_max	0.007648456891377767
sim_compute_performance-ego_mean	0.006771951675415039
sim_compute_performance-ego_median	0.006875182787577311
sim_compute_performance-ego_min	0.005903906027475993
sim_compute_robot_state-ego_max	0.01354060649871826
sim_compute_robot_state-ego_mean	0.01197900414466858
sim_compute_robot_state-ego_median	0.012206127643585203
sim_compute_robot_state-ego_min	0.010506839752197263
sim_compute_robot_state-parked0_max	0.012955429553985596
sim_compute_robot_state-parked0_mean	0.01171577803293864
sim_compute_robot_state-parked0_median	0.011747586727142332
sim_compute_robot_state-parked0_min	0.010523922443389892
sim_compute_sim_state_max	0.03088611920674642
sim_compute_sim_state_mean	0.029303402105967206
sim_compute_sim_state_median	0.029201385180155436
sim_compute_sim_state_min	0.028483211199442547
sim_render-ego_max	0.008802994887034099
sim_render-ego_mean	0.007998307784398395
sim_render-ego_median	0.008224032719930014
sim_render-ego_min	0.006984500090281168
simulation-passed	1
step_physics_max	0.12873610496520996
step_physics_mean	0.1037466750939687
step_physics_median	0.09598586201667786
step_physics_min	0.0902322498957316
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

33421

6837

Melisande Teng

exercise_ros_template

LFv-sim

failed

2020-10-18 16:47:46+00:00

2020-10-18 16:51:11+00:00

0:03:25

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 443, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 15 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 43, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 213, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 447, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33397

6824

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

success

2020-10-17 15:11:22+00:00

2020-10-17 15:25:33+00:00

0:14:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8663192123075183
survival_time_median	6.974999999999984
deviation-center-line_median	0.43953950080321413
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.03160598675409953
agent_compute-ego_mean	0.030542519699793453
agent_compute-ego_median	0.030477240584255043
agent_compute-ego_min	0.03008122996586125
complete-iteration_max	0.287254143384547
complete-iteration_mean	0.2679877049012491
complete-iteration_median	0.26696510944158425
complete-iteration_min	0.2546890296936035
deviation-center-line_max	0.7685570080477407
deviation-center-line_mean	0.4304685002974763
deviation-center-line_min	0.16835056051603542
deviation-heading_max	3.059172501581355
deviation-heading_mean	1.3399988201554027
deviation-heading_median	1.1530405834144584
deviation-heading_min	1.0486559385261456
driven_any_max	1.9336494449616832
driven_any_mean	0.9767500499368488
driven_any_median	0.881123493262099
driven_any_min	0.6786437709443108
driven_lanedir_consec_max	1.8663154058489624
driven_lanedir_consec_mean	0.9512442541715252
driven_lanedir_consec_min	0.638291557304621
driven_lanedir_max	1.8663154058489624
driven_lanedir_mean	0.9512442541715252
driven_lanedir_median	0.8663192123075183
driven_lanedir_min	0.638291557304621
get_state_dump_max	0.02255592315025579
get_state_dump_mean	0.02094689723831612
get_state_dump_median	0.02086395320939083
get_state_dump_min	0.02043477064225732
get_ui_image_max	0.04751251596923268
get_ui_image_mean	0.04643732383841049
get_ui_image_median	0.04650931643717217
get_ui_image_min	0.04530681263316761
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.9336494449616832, "get_ui_image": 0.046542309919993086, "step_physics": 0.09041765848795572, "survival_time": 14.950000000000076, "driven_lanedir": 1.8663154058489624, "get_state_dump": 0.020885520776112873, "sim_render-ego": 0.007853894233703614, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03160598675409953, "deviation-heading": 3.059172501581355, "complete-iteration": 0.2684573284784953, "set_robot_commands": 0.006937088171641032, "deviation-center-line": 0.7685570080477407, "driven_lanedir_consec": 1.8663154058489624, "sim_compute_sim_state": 0.03482281525929769, "sim_compute_performance-ego": 0.006402943929036458, "sim_compute_robot_state-ego": 0.010962274074554443, "sim_compute_robot_state-parked0": 0.011767746607462564}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.043772769563302, "get_ui_image": 0.04739348045209559, "step_physics": 0.09211981441916488, "survival_time": 8.199999999999982, "driven_lanedir": 1.0285285253579826, "get_state_dump": 0.02043477064225732, "sim_render-ego": 0.008083991888092786, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03008122996586125, "deviation-heading": 1.1508329322682502, "complete-iteration": 0.2667426554168143, "set_robot_commands": 0.008007420272361941, "deviation-center-line": 0.4190501897372116, "driven_lanedir_consec": 1.0285285253579826, "sim_compute_sim_state": 0.02874244713201755, "sim_compute_performance-ego": 0.006933411447013297, "sim_compute_robot_state-ego": 0.012204540938865848, "sim_compute_robot_state-parked0": 0.012493736860228748}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7848610319093443, "get_ui_image": 0.04582007217407227, "step_physics": 0.08729533195495605, "survival_time": 6.249999999999986, "driven_lanedir": 0.7660602022385734, "get_state_dump": 0.020889970779418947, "sim_render-ego": 0.007573163986206054, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030383516311645507, "deviation-heading": 1.3124007702258924, "complete-iteration": 0.2546890296936035, "set_robot_commands": 0.0065413894653320315, "deviation-center-line": 0.37013036142263306, "driven_lanedir_consec": 0.7660602022385734, "sim_compute_sim_state": 0.02766060447692871, "sim_compute_performance-ego": 0.006205114364624023, "sim_compute_robot_state-ego": 0.010536123275756835, "sim_compute_robot_state-parked0": 0.011531290054321288}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.8977192308976615, "get_ui_image": 0.04673661144686417, "step_physics": 0.09135718916503476, "survival_time": 7.099999999999983, "driven_lanedir": 0.8819882589791053, "get_state_dump": 0.020512293761884664, "sim_render-ego": 0.008362864104794785, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030507957431632027, "deviation-heading": 1.3072018308268245, "complete-iteration": 0.26718756346635414, "set_robot_commands": 0.008408830199443119, "deviation-center-line": 0.4600288118692167, "driven_lanedir_consec": 0.8819882589791053, "sim_compute_sim_state": 0.02813713987108687, "sim_compute_performance-ego": 0.007227137055195553, "sim_compute_robot_state-ego": 0.012901606694073744, "sim_compute_robot_state-parked0": 0.0127850569469828}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.6786437709443108, "get_ui_image": 0.04751251596923268, "step_physics": 0.09249907239861443, "survival_time": 5.449999999999989, "driven_lanedir": 0.638291557304621, "get_state_dump": 0.020630517137159996, "sim_render-ego": 0.00819047000430046, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03078098034639971, "deviation-heading": 1.0606223236499142, "complete-iteration": 0.27112308992158385, "set_robot_commands": 0.007282862969494741, "deviation-center-line": 0.16835056051603542, "driven_lanedir_consec": 0.638291557304621, "sim_compute_sim_state": 0.033926152308052834, "sim_compute_performance-ego": 0.006604179329828385, "sim_compute_robot_state-ego": 0.011543717953043249, "sim_compute_robot_state-parked0": 0.011896702127719145}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.6852813905835614, "get_ui_image": 0.04647632295435125, "step_physics": 0.09013968381014738, "survival_time": 5.4999999999999885, "driven_lanedir": 0.6402115535082075, "get_state_dump": 0.020973151380365544, "sim_render-ego": 0.007685069604353471, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030792804197831588, "deviation-heading": 1.0831185150197755, "complete-iteration": 0.26414103507995607, "set_robot_commands": 0.006386897780678489, "deviation-center-line": 0.16985074768982433, "driven_lanedir_consec": 0.6402115535082075, "sim_compute_sim_state": 0.032958847826177425, "sim_compute_performance-ego": 0.006174950166182085, "sim_compute_robot_state-ego": 0.010558228059248493, "sim_compute_robot_state-parked0": 0.01174144528128884}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.9707472276891296, "get_ui_image": 0.0465848679636039, "step_physics": 0.11340332342908271, "survival_time": 7.649999999999981, "driven_lanedir": 0.9587042091106404, "get_state_dump": 0.02255592315025579, "sim_render-ego": 0.008021708407433204, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030455212187922857, "deviation-heading": 1.0486559385261456, "complete-iteration": 0.287254143384547, "set_robot_commands": 0.007506418851465961, "deviation-center-line": 0.4841081180286745, "driven_lanedir_consec": 0.9587042091106404, "sim_compute_sim_state": 0.028098907346039818, "sim_compute_performance-ego": 0.006875267215803557, "sim_compute_robot_state-ego": 0.011535404554379533, "sim_compute_robot_state-parked0": 0.011962215884838229}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.8645277556265367, "get_ui_image": 0.046043556102000886, "step_physics": 0.11324240517442244, "survival_time": 6.849999999999984, "driven_lanedir": 0.8506501656359313, "get_state_dump": 0.020671531231734003, "sim_render-ego": 0.008125512269291564, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03014937804563202, "deviation-heading": 1.052436304816914, "complete-iteration": 0.28406095156704425, "set_robot_commands": 0.007400371732502958, "deviation-center-line": 0.40613318983421515, "driven_lanedir_consec": 0.8506501656359313, "sim_compute_sim_state": 0.028113608812763743, "sim_compute_performance-ego": 0.006440526377545656, "sim_compute_robot_state-ego": 0.011680037435823984, "sim_compute_robot_state-parked0": 0.011944187818652524}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.050409729995914, "get_ui_image": 0.04530681263316761, "step_physics": 0.08948944409688314, "survival_time": 8.249999999999982, "driven_lanedir": 1.038297289937525, "get_state_dump": 0.02107290788130327, "sim_render-ego": 0.00776030800559304, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0301688627763228, "deviation-heading": 1.1552482345606665, "complete-iteration": 0.2578745278445157, "set_robot_commands": 0.006872009508537524, "deviation-center-line": 0.5962695576664093, "driven_lanedir_consec": 1.038297289937525, "sim_compute_sim_state": 0.02823758125305176, "sim_compute_performance-ego": 0.006293445644956646, "sim_compute_robot_state-ego": 0.011056340824473989, "sim_compute_robot_state-parked0": 0.011362343123464874}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.8578881471970455, "get_ui_image": 0.045956688768723435, "step_physics": 0.08987155030755435, "survival_time": 6.799999999999984, "driven_lanedir": 0.8433953737937037, "get_state_dump": 0.02084238564266878, "sim_render-ego": 0.007623830262352438, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03049926898058723, "deviation-heading": 1.1702988500782885, "complete-iteration": 0.2583467241595773, "set_robot_commands": 0.00671087994295008, "deviation-center-line": 0.4622064581628017, "driven_lanedir_consec": 0.8433953737937037, "sim_compute_sim_state": 0.028580032727297616, "sim_compute_performance-ego": 0.006266643019283519, "sim_compute_robot_state-ego": 0.01038138656055226, "sim_compute_robot_state-parked0": 0.011361357043771184}}
set_robot_commands_max	0.008408830199443119
set_robot_commands_mean	0.0072054168894407885
set_robot_commands_median	0.0071099755705678865
set_robot_commands_min	0.006386897780678489
sim_compute_performance-ego_max	0.007227137055195553
sim_compute_performance-ego_mean	0.006542361854946917
sim_compute_performance-ego_median	0.006421735153291057
sim_compute_performance-ego_min	0.006174950166182085
sim_compute_robot_state-ego_max	0.012901606694073744
sim_compute_robot_state-ego_mean	0.011335966037077238
sim_compute_robot_state-ego_median	0.01129587268942676
sim_compute_robot_state-ego_min	0.01038138656055226
sim_compute_robot_state-parked0_max	0.0127850569469828
sim_compute_robot_state-parked0_mean	0.01188460817487302
sim_compute_robot_state-parked0_median	0.011832224367590856
sim_compute_robot_state-parked0_min	0.011361357043771184
sim_compute_sim_state_max	0.03482281525929769
sim_compute_sim_state_mean	0.0299278137012714
sim_compute_sim_state_median	0.028408806990174687
sim_compute_sim_state_min	0.02766060447692871
sim_render-ego_max	0.008362864104794785
sim_render-ego_mean	0.007928081276612143
sim_render-ego_median	0.00793780132056841
sim_render-ego_min	0.007573163986206054
simulation-passed	1
step_physics_max	0.11340332342908271
step_physics_mean	0.0949835473243816
step_physics_median	0.09088742382649526
step_physics_min	0.08729533195495605
survival_time_max	14.950000000000076
survival_time_mean	7.699999999999994
survival_time_min	5.449999999999989

No reset possible

33377

6812

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-10-15 23:53:08+00:00

2020-10-16 00:17:21+00:00

0:24:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.4054131312023622
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.03232559204101562
agent_compute-ego_mean	0.031403084595998124
agent_compute-ego_median	0.03136949936548869
agent_compute-ego_min	0.030764344533284502
complete-iteration_max	0.29020405769348145
complete-iteration_mean	0.27158806355794274
complete-iteration_median	0.2697152062257131
complete-iteration_min	0.25868504762649536
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.41778364329376794
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.8869656519179927
deviation-heading_median	1.6198720948235377
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	8.215966626878722e-14
driven_any_median	1.3278267374516872e-13
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	3.564357757568359e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	3.564357757568359e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_state_dump_max	0.020827587445576987
get_state_dump_mean	0.020612264156341552
get_state_dump_median	0.020637065172195435
get_state_dump_min	0.020388551553090415
get_ui_image_max	0.04870365142822266
get_ui_image_mean	0.04743604111671447
get_ui_image_median	0.04732536594072978
get_ui_image_min	0.046278685728708906
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04727864980697632, "step_physics": 0.09044284184773764, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020569827556610108, "sim_render-ego": 0.007991021474202473, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031741963227589924, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.26463112195332844, "set_robot_commands": 0.00722469170888265, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.029290790557861327, "sim_compute_performance-ego": 0.006700730323791504, "sim_compute_robot_state-ego": 0.011383686065673828, "sim_compute_robot_state-parked0": 0.011749250888824465}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.047945868174235025, "step_physics": 0.09209456046422322, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02064133644104004, "sim_render-ego": 0.008669923941294353, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031444440682729086, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2726022362709045, "set_robot_commands": 0.008602248032887777, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02961816946665446, "sim_compute_performance-ego": 0.007382381757100424, "sim_compute_robot_state-ego": 0.01317888895670573, "sim_compute_robot_state-parked0": 0.01276843786239624}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.0471488356590271, "step_physics": 0.09114134391148886, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020769042174021403, "sim_render-ego": 0.008617466290791829, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03116741975148519, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2696174804369609, "set_robot_commands": 0.008506614367167155, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02893953005472819, "sim_compute_performance-ego": 0.007382299105326335, "sim_compute_robot_state-ego": 0.012924296061197917, "sim_compute_robot_state-parked0": 0.012759002844492594}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04713405927022298, "step_physics": 0.08898061752319336, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020441513856252036, "sim_render-ego": 0.008388330141703287, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03079568068186442, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2663208071390788, "set_robot_commands": 0.008451259136199952, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02905562003453573, "sim_compute_performance-ego": 0.007309288183848063, "sim_compute_robot_state-ego": 0.01290778954823812, "sim_compute_robot_state-parked0": 0.012598897616068522}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04870365142822266, "step_physics": 0.09208645184834796, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.020827587445576987, "sim_render-ego": 0.00864238977432251, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03232559204101562, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.27438289086023965, "set_robot_commands": 0.008277072111765543, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.02994489828745524, "sim_compute_performance-ego": 0.007508141994476318, "sim_compute_robot_state-ego": 0.012964080969492597, "sim_compute_robot_state-parked0": 0.012843459447224936}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.0, "get_ui_image": 0.04742323478062948, "step_physics": 0.09169612487157186, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.02065682808558146, "sim_render-ego": 0.008485987981160481, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0320778226852417, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2698129320144653, "set_robot_commands": 0.008216073513031006, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.0286308487256368, "sim_compute_performance-ego": 0.0072206711769104, "sim_compute_robot_state-ego": 0.012679720719655356, "sim_compute_robot_state-parked0": 0.012468863328297932}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.047372082074483235, "step_physics": 0.11174573183059693, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020388551553090415, "sim_render-ego": 0.008563404083251952, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03097458362579346, "deviation-heading": 0.486072248607516, "complete-iteration": 0.29020405769348145, "set_robot_commands": 0.008612897396087647, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.029010779062906902, "sim_compute_performance-ego": 0.007283077239990234, "sim_compute_robot_state-ego": 0.01304114580154419, "sim_compute_robot_state-parked0": 0.012954752445220949}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.046278685728708906, "step_physics": 0.11132232030232748, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020640192031860353, "sim_render-ego": 0.007783531347910563, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03132562239964803, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2821234718958537, "set_robot_commands": 0.006774060726165772, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028792176246643063, "sim_compute_performance-ego": 0.006403506596883138, "sim_compute_robot_state-ego": 0.010948934555053712, "sim_compute_robot_state-parked0": 0.01159202734629313}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.0484614364306132, "step_physics": 0.0895023481051127, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020633938312530516, "sim_render-ego": 0.008460267384847005, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030764344533284502, "deviation-heading": 2.800123339068113, "complete-iteration": 0.26750058968861895, "set_robot_commands": 0.008049800395965576, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.029132778644561767, "sim_compute_performance-ego": 0.007178244590759278, "sim_compute_robot_state-ego": 0.012581252257029217, "sim_compute_robot_state-parked0": 0.012475598653157552}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.04661390781402588, "step_physics": 0.08853197971979777, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020553824106852213, "sim_render-ego": 0.007806267738342285, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031413376331329346, "deviation-heading": 2.800123339068113, "complete-iteration": 0.25868504762649536, "set_robot_commands": 0.006644526322682699, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028372241655985515, "sim_compute_performance-ego": 0.006319072246551514, "sim_compute_robot_state-ego": 0.010694403648376464, "sim_compute_robot_state-parked0": 0.011474659442901613}}
set_robot_commands_max	0.008612897396087647
set_robot_commands_mean	0.007935924371083578
set_robot_commands_median	0.008246572812398274
set_robot_commands_min	0.006644526322682699
sim_compute_performance-ego_max	0.007508141994476318
sim_compute_performance-ego_mean	0.007068741321563721
sim_compute_performance-ego_median	0.007251874208450317
sim_compute_performance-ego_min	0.006319072246551514
sim_compute_robot_state-ego_max	0.01317888895670573
sim_compute_robot_state-ego_mean	0.012330419858296714
sim_compute_robot_state-ego_median	0.012793755133946736
sim_compute_robot_state-ego_min	0.010694403648376464
sim_compute_robot_state-parked0_max	0.012954752445220949
sim_compute_robot_state-parked0_mean	0.012368494987487794
sim_compute_robot_state-parked0_median	0.012537248134613037
sim_compute_robot_state-parked0_min	0.011474659442901613
sim_compute_sim_state_max	0.02994489828745524
sim_compute_sim_state_mean	0.029078783273696902
sim_compute_sim_state_median	0.02903319954872131
sim_compute_sim_state_min	0.028372241655985515
sim_render-ego_max	0.008669923941294353
sim_render-ego_mean	0.008340859015782673
sim_render-ego_median	0.008473127683003744
sim_render-ego_min	0.007783531347910563
simulation-passed	1
step_physics_max	0.11174573183059693
step_physics_mean	0.09475443204243976
step_physics_median	0.09141873439153037
step_physics_min	0.08853197971979777
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

33367

6807

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

success

2020-10-14 21:13:13+00:00

2020-10-14 21:21:22+00:00

0:08:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3779614325037599
survival_time_median	3.324999999999996
deviation-center-line_median	0.2512291229945154
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.03473125642804957
agent_compute-ego_mean	0.030005622866467175
agent_compute-ego_median	0.029996201250926557
agent_compute-ego_min	0.027741648934104225
complete-iteration_max	0.27475315116974247
complete-iteration_mean	0.2666891292317632
complete-iteration_median	0.2675806170631857
complete-iteration_min	0.2541138029098511
deviation-center-line_max	0.4359954898526317
deviation-center-line_mean	0.29610686139604797
deviation-center-line_min	0.1976220429196164
deviation-heading_max	2.286581164642681
deviation-heading_mean	1.07288114246569
deviation-heading_median	0.8187349528959728
deviation-heading_min	0.6619984625395918
driven_any_max	0.7848624465560211
driven_any_mean	0.4529593274252224
driven_any_median	0.39333939708839494
driven_any_min	0.28695965996455974
driven_lanedir_consec_max	0.6802395853288715
driven_lanedir_consec_mean	0.4200814296448714
driven_lanedir_consec_min	0.27347748091279467
driven_lanedir_max	0.6802395853288715
driven_lanedir_mean	0.4200814296448714
driven_lanedir_median	0.3779614325037599
driven_lanedir_min	0.27347748091279467
get_state_dump_max	0.02517861478468951
get_state_dump_mean	0.0209654605208738
get_state_dump_median	0.0209231989929475
get_state_dump_min	0.01950094916603782
get_ui_image_max	0.04888071435870546
get_ui_image_mean	0.04647686183744522
get_ui_image_median	0.04612272853477328
get_ui_image_min	0.04520374298095703
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.3934999890991786, "get_ui_image": 0.04765587066536519, "step_physics": 0.09355300220090952, "survival_time": 3.349999999999996, "driven_lanedir": 0.3781075339199065, "get_state_dump": 0.019752812029710454, "sim_render-ego": 0.008259292858750072, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03473125642804957, "deviation-heading": 0.8218240116725859, "complete-iteration": 0.27240628982657816, "set_robot_commands": 0.007502271168267549, "deviation-center-line": 0.25178734328466934, "driven_lanedir_consec": 0.3781075339199065, "sim_compute_sim_state": 0.029605527422321375, "sim_compute_performance-ego": 0.006859448418688418, "sim_compute_robot_state-ego": 0.012202878496540129, "sim_compute_robot_state-parked0": 0.012033124468219816}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.3931788050776113, "get_ui_image": 0.04888071435870546, "step_physics": 0.09546146609566428, "survival_time": 3.2999999999999963, "driven_lanedir": 0.37781533108761334, "get_state_dump": 0.01950094916603782, "sim_render-ego": 0.008483706098614317, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027741648934104225, "deviation-heading": 0.8156458941193596, "complete-iteration": 0.271473714799592, "set_robot_commands": 0.007857882615291712, "deviation-center-line": 0.25067090270436143, "driven_lanedir_consec": 0.37781533108761334, "sim_compute_sim_state": 0.03086675297130238, "sim_compute_performance-ego": 0.00738975496003122, "sim_compute_robot_state-ego": 0.01279972538803563, "sim_compute_robot_state-parked0": 0.0122437368739735}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.2935983318061053, "get_ui_image": 0.048025865180819645, "step_physics": 0.09475122246087768, "survival_time": 2.549999999999999, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.019742334590238685, "sim_render-ego": 0.007928955788705862, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028658165651209214, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.2638405164082845, "set_robot_commands": 0.006737208833881453, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.029027924818151137, "sim_compute_performance-ego": 0.006469679813758999, "sim_compute_robot_state-ego": 0.011317089492199468, "sim_compute_robot_state-parked0": 0.010936718361050474}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.2935983318061053, "get_ui_image": 0.04601834334579168, "step_physics": 0.09662445386250812, "survival_time": 2.549999999999999, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.02517861478468951, "sim_render-ego": 0.008017745672487746, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027903622271967868, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.26996740172891054, "set_robot_commands": 0.007159705255545822, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.028932655558866614, "sim_compute_performance-ego": 0.006686187257953719, "sim_compute_robot_state-ego": 0.011570893081964233, "sim_compute_robot_state-parked0": 0.01162106850567986}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.7848624465560211, "get_ui_image": 0.04628842353820801, "step_physics": 0.09393100357055664, "survival_time": 6.249999999999986, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.01996078681945801, "sim_render-ego": 0.007405471801757812, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02984855842590332, "deviation-heading": 2.286581164642681, "complete-iteration": 0.2651938323974609, "set_robot_commands": 0.006406362533569336, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.033493022918701175, "sim_compute_performance-ego": 0.00622247314453125, "sim_compute_robot_state-ego": 0.010670448303222656, "sim_compute_robot_state-parked0": 0.010715255737304688}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.7848624465560211, "get_ui_image": 0.04622711372375488, "step_physics": 0.09017939949035644, "survival_time": 6.249999999999986, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.020940135955810547, "sim_render-ego": 0.007590656280517578, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030724382400512697, "deviation-heading": 2.286581164642681, "complete-iteration": 0.26459393119812014, "set_robot_commands": 0.006531902313232422, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.034020429611206056, "sim_compute_performance-ego": 0.006346221923828125, "sim_compute_robot_state-ego": 0.010677303314208984, "sim_compute_robot_state-parked0": 0.011100418090820312}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.5060368017110307, "get_ui_image": 0.04571889107485851, "step_physics": 0.1043440520045269, "survival_time": 4.149999999999993, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.020909217466790992, "sim_render-ego": 0.007830243512808558, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030143844075949795, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.27475315116974247, "set_robot_commands": 0.00713214529566018, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.028674295149653792, "sim_compute_performance-ego": 0.006770383880799075, "sim_compute_robot_state-ego": 0.011650668569357998, "sim_compute_robot_state-parked0": 0.011321311973663695}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.5060368017110307, "get_ui_image": 0.04521219127149467, "step_physics": 0.10345463005893202, "survival_time": 4.149999999999993, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.02099356306604592, "sim_render-ego": 0.007677684347313571, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030288228069443306, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.27164034671094045, "set_robot_commands": 0.00659780617219856, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.029064299112342925, "sim_compute_performance-ego": 0.0064424779041703925, "sim_compute_robot_state-ego": 0.01086540681770049, "sim_compute_robot_state-parked0": 0.010784002671758813}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.28695965996455974, "get_ui_image": 0.04553746223449707, "step_physics": 0.09031130313873292, "survival_time": 2.499999999999999, "driven_lanedir": 0.27347748091279467, "get_state_dump": 0.020937180519104003, "sim_render-ego": 0.007793717384338379, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02983014106750488, "deviation-heading": 0.7091497238590456, "complete-iteration": 0.25890830516815183, "set_robot_commands": 0.0065372085571289065, "deviation-center-line": 0.2427625776281645, "driven_lanedir_consec": 0.27347748091279467, "sim_compute_sim_state": 0.028848562240600582, "sim_compute_performance-ego": 0.006599431037902832, "sim_compute_robot_state-ego": 0.010880346298217774, "sim_compute_robot_state-parked0": 0.011372137069702148}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.28695965996455974, "get_ui_image": 0.04520374298095703, "step_physics": 0.08577978610992432, "survival_time": 2.499999999999999, "driven_lanedir": 0.27347748091279467, "get_state_dump": 0.021739010810852052, "sim_render-ego": 0.007810831069946289, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030186381340026856, "deviation-heading": 0.7091497238590456, "complete-iteration": 0.2541138029098511, "set_robot_commands": 0.006568331718444825, "deviation-center-line": 0.2427625776281645, "driven_lanedir_consec": 0.27347748091279467, "sim_compute_sim_state": 0.02810486316680908, "sim_compute_performance-ego": 0.006415400505065918, "sim_compute_robot_state-ego": 0.010992255210876463, "sim_compute_robot_state-parked0": 0.011054863929748537}}
set_robot_commands_max	0.007857882615291712
set_robot_commands_mean	0.006903082446322076
set_robot_commands_median	0.006667507503040007
set_robot_commands_min	0.006406362533569336
sim_compute_performance-ego_max	0.00738975496003122
sim_compute_performance-ego_mean	0.006620145884672994
sim_compute_performance-ego_median	0.006534555425830916
sim_compute_performance-ego_min	0.00622247314453125
sim_compute_robot_state-ego_max	0.01279972538803563
sim_compute_robot_state-ego_mean	0.01136270149723238
sim_compute_robot_state-ego_median	0.011154672351537966
sim_compute_robot_state-ego_min	0.010670448303222656
sim_compute_robot_state-parked0_max	0.0122437368739735
sim_compute_robot_state-parked0_mean	0.011318263768192184
sim_compute_robot_state-parked0_median	0.011210865032242005
sim_compute_robot_state-parked0_min	0.010715255737304688
sim_compute_sim_state_max	0.034020429611206056
sim_compute_sim_state_mean	0.030063833296995513
sim_compute_sim_state_median	0.02904611196524703
sim_compute_sim_state_min	0.02810486316680908
sim_render-ego_max	0.008483706098614317
sim_render-ego_mean	0.00787983048152402
sim_render-ego_median	0.007820537291377425
sim_render-ego_min	0.007405471801757812
simulation-passed	1
step_physics_max	0.1043440520045269
step_physics_mean	0.09483903189929888
step_physics_median	0.09434111301571715
step_physics_min	0.08577978610992432
survival_time_max	6.249999999999986
survival_time_mean	3.7549999999999946
survival_time_min	2.499999999999999

No reset possible

33361

6804

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

failed

2020-10-14 20:01:37+00:00

2020-10-14 20:04:49+00:00

0:03:12

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 443, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 43, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 213, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 447, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33358

6802

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

failed

2020-10-14 18:20:53+00:00

2020-10-14 18:21:59+00:00

0:01:06

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 443, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 66, in on_received_get_commands
             ||     context.write('commands', commands)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 99, in write
             ||     self._write(topic, data, timing, with_schema)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 112, in _write
             ||     check_isinstance(data, klass)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_checks.py", line 13, in check_isinstance
             ||     raise_type_mismatch(ob, expected, **kwargs)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_checks.py", line 25, in raise_type_mismatch
             ||     raise ZValueError(msg, expected=expected, obtained=type(ob), **kwargs)
             || zuper_commons.types.exceptions.ZValueError: Object not of expected type:
             || │ expected: dataclass aido_schemas.schemas.Duckiebot1Commands
             || │            field  wheels : dataclass aido_schemas.schemas.PWMCommands
             || │                             field  motor_left : float
             || │                             field motor_right : float
             || │                                       __doc__
             || │                                                         PWM commands are floats between -1 and 1.
             || │            field    LEDS : dataclass aido_schemas.schemas.LEDSCommands
             || │                             field      center : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                             field  front_left : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                             field front_right : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                             field   back_left : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                             field  back_right : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                                       __doc__   LEDSCommands(center: aido_schemas.schemas.RGB, fro
             || │                  __doc__   Duckiebot1Commands(wheels: aido_schemas.schemas.PW
             || │ obtained: dict
             || │   object: dict[2]
             || │           │ wheels: {motor_left: 0.0, motor_right: 0.0}
             || │           │ LEDS:
             || │           │ dict[5]
             || │           │ │ center: {r: 0.5, g: 0.5, b: 0.5}
             || │           │ │ front_left: {r: 0.5, g: 0.5, b: 0.5}
             || │           │ │ front_right: {r: 0.5, g: 0.5, b: 0.5}
             || │           │ │ back_left: {r: 0.5, g: 0.5, b: 0.5}
             || │           │ │ back_right: {r: 0.5, g: 0.5, b: 0.5}
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 43, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 213, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 447, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33352

6799

Julian Schilliger

PredictorMean

step1-simulation

aborted

yes

2020-10-13 15:53:07+00:00

2020-10-13 15:53:34+00:00

0:00:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.2822601598849146
error_L2	0.09658325085945546

No reset possible

33337

6790

Boyang SUN - ETHZ

PredictorLast

step1-simulation

success

yes

2020-10-11 17:38:04+00:00

2020-10-11 17:38:32+00:00

0:00:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10402747277259183
error_L2	0.017077843115852403

No reset possible

33333

6788

Andrej Studer 🇨🇭

PredictorLast

step1-simulation

success

yes

2020-10-11 14:56:03+00:00

2020-10-11 14:56:31+00:00

0:00:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11015067680306638
error_L2	0.018850454491335003

No reset possible

33312

6776

Arjun Bhardwaj 🇨🇭

PredictorLast

step1-simulation

success

yes

2020-10-09 22:56:01+00:00

2020-10-09 22:56:27+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12984752460437057
error_L2	0.026168358893200135

No reset possible

33308

6774

Jonathan Peel

PredictorLast

step1-simulation

success

yes

2020-10-09 13:07:25+00:00

2020-10-09 13:07:51+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10808708048811506
error_L2	0.01890819086512937

No reset possible

33294

6771

Jonathan Peel

PredictorLast

step1-simulation

host-error

yes

2020-10-08 13:46:12+00:00

2020-10-08 13:46:24+00:00

0:00:12

Error while running [...]

Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job33294-171845', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job33294-171845', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job33294-171845_evaluation" with the default driver
stderr | could not find an available, non-overlapping IPv4 address pool among the defaults to assign to the network
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33290

6770

Yueshan Li 🇨🇭

PredictorLast

step1-simulation

success

yes