Evaluator 4772

LFv-sim

success

yes

2020-12-03 21:35:32+00:00

2020-12-03 21:45:34+00:00

0:10:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6802040444950532
survival_time_median	16.850000000000104
deviation-center-line_median	0.6257290246613993
in-drivable-lane_median	5.650000000000027

other stats

agent_compute-ego0_max	0.013403873765066769
agent_compute-ego0_mean	0.01245852501634039
agent_compute-ego0_median	0.012267455999350071
agent_compute-ego0_min	0.01189531430159465
complete-iteration_max	0.2336737975645601
complete-iteration_mean	0.1794407361605256
complete-iteration_median	0.16682638803400002
complete-iteration_min	0.15043637100954232
deviation-center-line_max	1.8290838142640249
deviation-center-line_mean	0.7965754916991898
deviation-center-line_min	0.10576010320993597
deviation-heading_max	5.2380138566704755
deviation-heading_mean	2.482922195151132
deviation-heading_median	1.9512848926405315
deviation-heading_min	0.7911051386529898
driven_any_max	5.485168064782831
driven_any_mean	3.053165173809763
driven_any_median	3.0484427195506667
driven_any_min	0.6306071913548879
driven_lanedir_consec_max	3.367558460408598
driven_lanedir_consec_mean	1.7380404570145909
driven_lanedir_consec_min	0.22419527865965885
driven_lanedir_max	3.367558460408598
driven_lanedir_mean	1.7380404570145909
driven_lanedir_median	1.6802040444950532
driven_lanedir_min	0.22419527865965885
get_duckie_state_max	1.0769018966160463e-06
get_duckie_state_mean	1.0327917293891592e-06
get_duckie_state_median	1.0286843114714144e-06
get_duckie_state_min	9.968963979977613e-07
get_robot_state_max	0.0035751588273756573
get_robot_state_mean	0.003486064389458403
get_robot_state_median	0.003458263609246105
get_robot_state_min	0.003452571511965746
get_state_dump_max	0.00437867523419975
get_state_dump_mean	0.004297457763159149
get_state_dump_median	0.004272133309735098
get_state_dump_min	0.004266889198966648
get_ui_image_max	0.03660769676894284
get_ui_image_mean	0.03091866286880058
get_ui_image_median	0.03062417436768368
get_ui_image_min	0.025818605970892108
in-drivable-lane_max	15.90000000000019
in-drivable-lane_mean	7.500000000000059
in-drivable-lane_min	2.799999999999992
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.665716458241799, "get_ui_image": 0.028521316358358553, "step_physics": 0.09306058128281396, "survival_time": 25.200000000000223, "driven_lanedir": 3.367558460408598, "get_state_dump": 0.00437867523419975, "get_robot_state": 0.0035751588273756573, "sim_render-ego0": 0.003651107183777459, "get_duckie_state": 1.0466811680557705e-06, "in-drivable-lane": 7.000000000000061, "deviation-heading": 3.0705199082545613, "agent_compute-ego0": 0.01189531430159465, "complete-iteration": 0.1596949067446265, "set_robot_commands": 0.002144366915863339, "deviation-center-line": 1.8290838142640249, "driven_lanedir_consec": 3.367558460408598, "sim_compute_sim_state": 0.010509831362431592, "sim_compute_performance-ego0": 0.0018868611590697032}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6306071913548879, "get_ui_image": 0.03660769676894284, "step_physics": 0.15691751308655472, "survival_time": 4.399999999999992, "driven_lanedir": 0.22419527865965885, "get_state_dump": 0.0042720510718527805, "get_robot_state": 0.0034531689761729723, "sim_render-ego0": 0.003605920277284772, "get_duckie_state": 1.0769018966160463e-06, "in-drivable-lane": 2.799999999999992, "deviation-heading": 0.7911051386529898, "agent_compute-ego0": 0.013403873765066769, "complete-iteration": 0.2336737975645601, "set_robot_commands": 0.0034741230225295164, "deviation-center-line": 0.10576010320993597, "driven_lanedir_consec": 0.22419527865965885, "sim_compute_sim_state": 0.010038472293468005, "sim_compute_performance-ego0": 0.0018301760212758953}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4311689808595345, "get_ui_image": 0.03272703237700881, "step_physics": 0.10478646992242824, "survival_time": 8.499999999999986, "driven_lanedir": 0.707275657578087, "get_state_dump": 0.004272215547617416, "get_robot_state": 0.003452571511965746, "sim_render-ego0": 0.0036575557195652297, "get_duckie_state": 9.968963979977613e-07, "in-drivable-lane": 4.299999999999993, "deviation-heading": 0.8320498770265018, "agent_compute-ego0": 0.012519309395237974, "complete-iteration": 0.17395786932337354, "set_robot_commands": 0.0020777551751387747, "deviation-center-line": 0.2708529286108065, "driven_lanedir_consec": 0.707275657578087, "sim_compute_sim_state": 0.008562958031369928, "sim_compute_performance-ego0": 0.0018308887704771165}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.485168064782831, "get_ui_image": 0.025818605970892108, "step_physics": 0.09158071264717148, "survival_time": 32.15000000000031, "driven_lanedir": 2.6531324314120193, "get_state_dump": 0.004266889198966648, "get_robot_state": 0.0034633582423192373, "sim_render-ego0": 0.0035861145635569316, "get_duckie_state": 1.0106874548870584e-06, "in-drivable-lane": 15.90000000000019, "deviation-heading": 5.2380138566704755, "agent_compute-ego0": 0.012015602603462173, "complete-iteration": 0.15043637100954232, "set_robot_commands": 0.002030684340814626, "deviation-center-line": 0.9806051207119922, "driven_lanedir_consec": 2.6531324314120193, "sim_compute_sim_state": 0.005781932647183815, "sim_compute_performance-ego0": 0.001821253980909075}}
set_robot_commands_max	0.0034741230225295164
set_robot_commands_mean	0.0024317323635865643
set_robot_commands_median	0.002111061045501057
set_robot_commands_min	0.002030684340814626
sim_compute_performance-ego0_max	0.0018868611590697032
sim_compute_performance-ego0_mean	0.0018422949829329477
sim_compute_performance-ego0_median	0.0018305323958765056
sim_compute_performance-ego0_min	0.001821253980909075
sim_compute_sim_state_max	0.010509831362431592
sim_compute_sim_state_mean	0.008723298583613336
sim_compute_sim_state_median	0.009300715162418965
sim_compute_sim_state_min	0.005781932647183815
sim_render-ego0_max	0.0036575557195652297
sim_render-ego0_mean	0.003625174436046098
sim_render-ego0_median	0.003628513730531116
sim_render-ego0_min	0.0035861145635569316
simulation-passed	1
step_physics_max	0.15691751308655472
step_physics_mean	0.1115863192347421
step_physics_median	0.0989235256026211
step_physics_min	0.09158071264717148
survival_time_max	32.15000000000031
survival_time_mean	17.562500000000128
survival_time_min	4.399999999999992

No reset possible

58123

9373

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 21:30:17+00:00

2020-12-03 21:35:09+00:00

0:04:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47469644768734554
survival_time_median	5.799999999999987
deviation-center-line_median	0.1652944732306097
in-drivable-lane_median	3.424999999999989

other stats

agent_compute-ego0_max	0.013303043635468505
agent_compute-ego0_mean	0.01255721300055139
agent_compute-ego0_median	0.012331018717856922
agent_compute-ego0_min	0.012263770931023212
complete-iteration_max	0.1869588383531149
complete-iteration_mean	0.16673749413810948
complete-iteration_median	0.1687869699145061
complete-iteration_min	0.1424171983703109
deviation-center-line_max	0.2107574672154177
deviation-center-line_mean	0.1581138428629571
deviation-center-line_min	0.09110895777519126
deviation-heading_max	1.6028043324994483
deviation-heading_mean	0.9765701606930464
deviation-heading_median	0.9303809734441494
deviation-heading_min	0.4427143633844387
driven_any_max	2.7421381859627276
driven_any_mean	1.6170509091491754
driven_any_median	1.3305380001207268
driven_any_min	1.0649894503925208
driven_lanedir_consec_max	0.6308086958038627
driven_lanedir_consec_mean	0.4762920812562057
driven_lanedir_consec_min	0.32496673384626873
driven_lanedir_max	0.6308086958038627
driven_lanedir_mean	0.4762920812562057
driven_lanedir_median	0.47469644768734554
driven_lanedir_min	0.32496673384626873
get_duckie_state_max	1.5605579723011365e-06
get_duckie_state_mean	1.4748367929788689e-06
get_duckie_state_median	1.4614373904341624e-06
get_duckie_state_min	1.415914418746014e-06
get_robot_state_max	0.0036564178118422695
get_robot_state_mean	0.003551583465744096
get_robot_state_median	0.0035253658575765097
get_robot_state_min	0.0034991843359810965
get_state_dump_max	0.0045224488053691985
get_state_dump_mean	0.004458710069573683
get_state_dump_median	0.004472378865598211
get_state_dump_min	0.004367633741729113
get_ui_image_max	0.0364669149955817
get_ui_image_mean	0.03088388821729549
get_ui_image_median	0.03054699786344142
get_ui_image_min	0.02597464214671742
in-drivable-lane_max	8.850000000000005
in-drivable-lane_mean	4.462499999999994
in-drivable-lane_min	2.1499999999999924
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.7421381859627276, "get_ui_image": 0.028425787137523632, "step_physics": 0.09208010320794092, "survival_time": 10.90000000000002, "driven_lanedir": 0.32496673384626873, "get_state_dump": 0.0045224488053691985, "get_robot_state": 0.0036564178118422695, "sim_render-ego0": 0.003844338464954673, "get_duckie_state": 1.4860336094686429e-06, "in-drivable-lane": 8.850000000000005, "deviation-heading": 1.3836203939543363, "agent_compute-ego0": 0.013303043635468505, "complete-iteration": 0.1600518400810625, "set_robot_commands": 0.0022005751797053367, "deviation-center-line": 0.2107574672154177, "driven_lanedir_consec": 0.32496673384626873, "sim_compute_sim_state": 0.00999557808653949, "sim_compute_performance-ego0": 0.001950270509066647}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2746330422663896, "get_ui_image": 0.0364669149955817, "step_physics": 0.11281027203112576, "survival_time": 5.599999999999988, "driven_lanedir": 0.3485414367201807, "get_state_dump": 0.0044593515649306035, "get_robot_state": 0.003500145093529625, "sim_render-ego0": 0.003648878198809328, "get_duckie_state": 1.436841171399682e-06, "in-drivable-lane": 3.3999999999999906, "deviation-heading": 1.6028043324994483, "agent_compute-ego0": 0.012387735653767544, "complete-iteration": 0.1869588383531149, "set_robot_commands": 0.002071754067345003, "deviation-center-line": 0.17269441294522414, "driven_lanedir_consec": 0.3485414367201807, "sim_compute_sim_state": 0.009674378200969865, "sim_compute_performance-ego0": 0.0018626208853932608}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0649894503925208, "get_ui_image": 0.032668208589359204, "step_physics": 0.10921104343570008, "survival_time": 4.849999999999991, "driven_lanedir": 0.6308086958038627, "get_state_dump": 0.004367633741729113, "get_robot_state": 0.0034991843359810965, "sim_render-ego0": 0.003620785109850825, "get_duckie_state": 1.415914418746014e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.4771415529339624, "agent_compute-ego0": 0.0122743017819463, "complete-iteration": 0.17752209974794972, "set_robot_commands": 0.002053314325760822, "deviation-center-line": 0.09110895777519126, "driven_lanedir_consec": 0.6308086958038627, "sim_compute_sim_state": 0.007922101993950046, "sim_compute_performance-ego0": 0.0018346431303997428}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3864429579750637, "get_ui_image": 0.02597464214671742, "step_physics": 0.08336787184407889, "survival_time": 5.999999999999987, "driven_lanedir": 0.6008514586545104, "get_state_dump": 0.004485406166265819, "get_robot_state": 0.003550586621623394, "sim_render-ego0": 0.0036681604779456273, "get_duckie_state": 1.5605579723011365e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.4427143633844387, "agent_compute-ego0": 0.012263770931023212, "complete-iteration": 0.1424171983703109, "set_robot_commands": 0.002113320610739968, "deviation-center-line": 0.15789453351599525, "driven_lanedir_consec": 0.6008514586545104, "sim_compute_sim_state": 0.005025847884249096, "sim_compute_performance-ego0": 0.0018887342500292568}}
set_robot_commands_max	0.0022005751797053367
set_robot_commands_mean	0.0021097410458877823
set_robot_commands_median	0.0020925373390424853
set_robot_commands_min	0.002053314325760822
sim_compute_performance-ego0_max	0.001950270509066647
sim_compute_performance-ego0_mean	0.0018840671937222267
sim_compute_performance-ego0_median	0.0018756775677112587
sim_compute_performance-ego0_min	0.0018346431303997428
sim_compute_sim_state_max	0.00999557808653949
sim_compute_sim_state_mean	0.008154476541427124
sim_compute_sim_state_median	0.008798240097459956
sim_compute_sim_state_min	0.005025847884249096
sim_render-ego0_max	0.003844338464954673
sim_render-ego0_mean	0.003695540562890113
sim_render-ego0_median	0.0036585193383774778
sim_render-ego0_min	0.003620785109850825
simulation-passed	1
step_physics_max	0.11281027203112576
step_physics_mean	0.09936732262971142
step_physics_median	0.1006455733218205
step_physics_min	0.08336787184407889
survival_time_max	10.90000000000002
survival_time_mean	6.837499999999996
survival_time_min	4.849999999999991

No reset possible

58116

9660

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 21:26:13+00:00

2020-12-03 21:30:08+00:00

0:03:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 162 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58105

9767

exercise_ros_template

LFv-sim

success

yes

2020-12-03 21:17:11+00:00

2020-12-03 21:26:05+00:00

0:08:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1108313832913292
survival_time_median	16.200000000000095
deviation-center-line_median	0.37641359451828454
in-drivable-lane_median	6.8000000000000735

other stats

agent_compute-ego0_max	0.013342722406927144
agent_compute-ego0_mean	0.012682693166132488
agent_compute-ego0_median	0.012552880832404072
agent_compute-ego0_min	0.012282288592794666
complete-iteration_max	0.2508883161364861
complete-iteration_mean	0.18736080276461317
complete-iteration_median	0.177708139100072
complete-iteration_min	0.1431386167218226
deviation-center-line_max	0.5942633524166987
deviation-center-line_mean	0.35717302565048836
deviation-center-line_min	0.08160156114868562
deviation-heading_max	1.817727433447506
deviation-heading_mean	1.1945365015158929
deviation-heading_median	1.1748092954513132
deviation-heading_min	0.6107999817134392
driven_any_max	3.0738810628639364
driven_any_mean	2.325480239926512
driven_any_median	2.9613988436701715
driven_any_min	0.305242209501768
driven_lanedir_consec_max	2.0747648001084418
driven_lanedir_consec_mean	1.112768148519571
driven_lanedir_consec_min	0.15464502738718355
driven_lanedir_max	2.0747648001084418
driven_lanedir_mean	1.112768148519571
driven_lanedir_median	1.1108313832913292
driven_lanedir_min	0.15464502738718355
get_duckie_state_max	1.2102650433051877e-06
get_duckie_state_mean	1.1511607306658104e-06
get_duckie_state_median	1.1492704659673617e-06
get_duckie_state_min	1.0958369474233308e-06
get_robot_state_max	0.003683772755832207
get_robot_state_mean	0.003555011044821596
get_robot_state_median	0.0035262151427988735
get_robot_state_min	0.00348384113785643
get_state_dump_max	0.004687634183139336
get_state_dump_mean	0.004539806942662104
get_state_dump_median	0.004526784086680058
get_state_dump_min	0.004418025414148967
get_ui_image_max	0.03658951003596468
get_ui_image_mean	0.03101594987531429
get_ui_image_median	0.03073686266125425
get_ui_image_min	0.026000564142783976
in-drivable-lane_max	12.0000000000001
in-drivable-lane_mean	6.712500000000061
in-drivable-lane_min	1.2499999999999982
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.9858554305769993, "get_ui_image": 0.028634140404259285, "step_physics": 0.09862252706434668, "survival_time": 16.350000000000097, "driven_lanedir": 2.0747648001084418, "get_state_dump": 0.004687634183139336, "get_robot_state": 0.003683772755832207, "sim_render-ego0": 0.0037767770813732617, "get_duckie_state": 1.2102650433051877e-06, "in-drivable-lane": 5.200000000000074, "deviation-heading": 1.52429673034159, "agent_compute-ego0": 0.012501718067541356, "complete-iteration": 0.1664007669541894, "set_robot_commands": 0.002213957833080757, "deviation-center-line": 0.5942633524166987, "driven_lanedir_consec": 2.0747648001084418, "sim_compute_sim_state": 0.010240995302432922, "sim_compute_performance-ego0": 0.001964834405154717}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.305242209501768, "get_ui_image": 0.03658951003596468, "step_physics": 0.17529651803790397, "survival_time": 2.5999999999999988, "driven_lanedir": 0.15464502738718355, "get_state_dump": 0.004632135607161612, "get_robot_state": 0.003531420005942291, "sim_render-ego0": 0.003834450019980377, "get_duckie_state": 1.1696005767246462e-06, "in-drivable-lane": 1.2499999999999982, "deviation-heading": 0.8253218605610363, "agent_compute-ego0": 0.013342722406927144, "complete-iteration": 0.2508883161364861, "set_robot_commands": 0.0021532121694312904, "deviation-center-line": 0.08160156114868562, "driven_lanedir_consec": 0.15464502738718355, "sim_compute_sim_state": 0.009543427881204858, "sim_compute_performance-ego0": 0.0018875598907470703}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0738810628639364, "get_ui_image": 0.03283958491824922, "step_physics": 0.11737222188994996, "survival_time": 16.750000000000103, "driven_lanedir": 1.5171140615695284, "get_state_dump": 0.004418025414148967, "get_robot_state": 0.0035210102796554565, "sim_render-ego0": 0.003693418133826483, "get_duckie_state": 1.1289403552100772e-06, "in-drivable-lane": 8.400000000000073, "deviation-heading": 1.817727433447506, "agent_compute-ego0": 0.012604043597266789, "complete-iteration": 0.1890155112459546, "set_robot_commands": 0.002052550514539083, "deviation-center-line": 0.5751543312505918, "driven_lanedir_consec": 1.5171140615695284, "sim_compute_sim_state": 0.01057853443281991, "sim_compute_performance-ego0": 0.0018644467705772037}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.9369422567633436, "get_ui_image": 0.026000564142783976, "step_physics": 0.08393854087924366, "survival_time": 16.050000000000093, "driven_lanedir": 0.70454870501313, "get_state_dump": 0.004421432566198503, "get_robot_state": 0.00348384113785643, "sim_render-ego0": 0.003631502204800245, "get_duckie_state": 1.0958369474233308e-06, "in-drivable-lane": 12.0000000000001, "deviation-heading": 0.6107999817134392, "agent_compute-ego0": 0.012282288592794666, "complete-iteration": 0.1431386167218226, "set_robot_commands": 0.0020366588734691926, "deviation-center-line": 0.17767285778597733, "driven_lanedir_consec": 0.70454870501313, "sim_compute_sim_state": 0.0054368439668454, "sim_compute_performance-ego0": 0.0018376933861963497}}
set_robot_commands_max	0.002213957833080757
set_robot_commands_mean	0.0021140948476300807
set_robot_commands_median	0.0021028813419851867
set_robot_commands_min	0.0020366588734691926
sim_compute_performance-ego0_max	0.001964834405154717
sim_compute_performance-ego0_mean	0.001888633613168835
sim_compute_performance-ego0_median	0.001876003330662137
sim_compute_performance-ego0_min	0.0018376933861963497
sim_compute_sim_state_max	0.01057853443281991
sim_compute_sim_state_mean	0.008949950395825773
sim_compute_sim_state_median	0.00989221159181889
sim_compute_sim_state_min	0.0054368439668454
sim_render-ego0_max	0.003834450019980377
sim_render-ego0_mean	0.0037340368599950912
sim_render-ego0_median	0.003735097607599872
sim_render-ego0_min	0.003631502204800245
simulation-passed	1
step_physics_max	0.17529651803790397
step_physics_mean	0.11880745196786106
step_physics_median	0.10799737447714831
step_physics_min	0.08393854087924366
survival_time_max	16.750000000000103
survival_time_mean	12.937500000000073
survival_time_min	2.5999999999999988

No reset possible

58098

9772

Étienne Boucher 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 21:11:52+00:00

2020-12-03 21:16:41+00:00

0:04:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4714219780033067
survival_time_median	5.07499999999999
deviation-center-line_median	0.1214762842491089
in-drivable-lane_median	2.9749999999999917

other stats

agent_compute-ego0_max	0.01324998804953246
agent_compute-ego0_mean	0.012755061731138806
agent_compute-ego0_median	0.012769885007265676
agent_compute-ego0_min	0.01223048886049141
complete-iteration_max	0.19830090975024037
complete-iteration_mean	0.1776090421371635
complete-iteration_median	0.1805201136319149
complete-iteration_min	0.1510950315345838
deviation-center-line_max	0.16882745413824904
deviation-center-line_mean	0.1310901802878212
deviation-center-line_min	0.11258069851481804
deviation-heading_max	1.3276355501868602
deviation-heading_mean	0.905457237293556
deviation-heading_median	0.9668478057888696
deviation-heading_min	0.3604977874096246
driven_any_max	3.549936865397883
driven_any_mean	1.920846722235859
driven_any_median	1.409844680535787
driven_any_min	1.313760662473979
driven_lanedir_consec_max	0.6876610105440744
driven_lanedir_consec_mean	0.47363179331420246
driven_lanedir_consec_min	0.264022206706122
driven_lanedir_max	0.6876610105440744
driven_lanedir_mean	0.47363179331420246
driven_lanedir_median	0.4714219780033067
driven_lanedir_min	0.264022206706122
get_duckie_state_max	1.2682885238804767e-06
get_duckie_state_mean	1.2159213080871297e-06
get_duckie_state_median	1.2282714565739787e-06
get_duckie_state_min	1.1388537953200849e-06
get_robot_state_max	0.003688300605368825
get_robot_state_mean	0.003587916631594552
get_robot_state_median	0.003566495706847616
get_robot_state_min	0.003530374507314151
get_state_dump_max	0.004711660663638494
get_state_dump_mean	0.00455783642540242
get_state_dump_median	0.0045306403781034165
get_state_dump_min	0.004458404281764355
get_ui_image_max	0.03634455031955365
get_ui_image_mean	0.031229272832364225
get_ui_image_median	0.03117575552156148
get_ui_image_min	0.026221029966780284
in-drivable-lane_max	9.600000000000026
in-drivable-lane_mean	4.5125
in-drivable-lane_min	2.499999999999991
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.549936865397883, "get_ui_image": 0.02904097379836361, "step_physics": 0.10296421029926402, "survival_time": 11.250000000000025, "driven_lanedir": 0.264022206706122, "get_state_dump": 0.004711660663638494, "get_robot_state": 0.003688300605368825, "sim_render-ego0": 0.0038093687158770265, "get_duckie_state": 1.2364007730399612e-06, "in-drivable-lane": 9.600000000000026, "deviation-heading": 1.205582215734519, "agent_compute-ego0": 0.01324998804953246, "complete-iteration": 0.17120430954789692, "set_robot_commands": 0.0021717812107727593, "deviation-center-line": 0.16882745413824904, "driven_lanedir_consec": 0.264022206706122, "sim_compute_sim_state": 0.009549693723695468, "sim_compute_performance-ego0": 0.001938093025072486}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.313760662473979, "get_ui_image": 0.03634455031955365, "step_physics": 0.12397458381259564, "survival_time": 4.799999999999991, "driven_lanedir": 0.2981027436111843, "get_state_dump": 0.004487902847761961, "get_robot_state": 0.003530374507314151, "sim_render-ego0": 0.0036861749039482825, "get_duckie_state": 1.2682885238804767e-06, "in-drivable-lane": 3.0999999999999934, "deviation-heading": 1.3276355501868602, "agent_compute-ego0": 0.012414888008353636, "complete-iteration": 0.19830090975024037, "set_robot_commands": 0.0021124820119326876, "deviation-center-line": 0.12531691201889109, "driven_lanedir_consec": 0.2981027436111843, "sim_compute_sim_state": 0.009772030348630296, "sim_compute_performance-ego0": 0.0018991932426531291}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4011088356277135, "get_ui_image": 0.03331053724475935, "step_physics": 0.11880761969323252, "survival_time": 5.04999999999999, "driven_lanedir": 0.6876610105440744, "get_state_dump": 0.004573377908444872, "get_robot_state": 0.003578959726819805, "sim_render-ego0": 0.0037459812912286495, "get_duckie_state": 1.2201421401079962e-06, "in-drivable-lane": 2.499999999999991, "deviation-heading": 0.7281133958432203, "agent_compute-ego0": 0.013124882006177715, "complete-iteration": 0.1898359177159328, "set_robot_commands": 0.0021349355286242916, "deviation-center-line": 0.11763565647932672, "driven_lanedir_consec": 0.6876610105440744, "sim_compute_sim_state": 0.008582547599194097, "sim_compute_performance-ego0": 0.001897568796195236}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4185805254438604, "get_ui_image": 0.026221029966780284, "step_physics": 0.0919685410064401, "survival_time": 5.09999999999999, "driven_lanedir": 0.6447412123954293, "get_state_dump": 0.004458404281764355, "get_robot_state": 0.003554031686875427, "sim_render-ego0": 0.0036482162845944896, "get_duckie_state": 1.1388537953200849e-06, "in-drivable-lane": 2.84999999999999, "deviation-heading": 0.3604977874096246, "agent_compute-ego0": 0.01223048886049141, "complete-iteration": 0.1510950315345838, "set_robot_commands": 0.002073595824750882, "deviation-center-line": 0.11258069851481804, "driven_lanedir_consec": 0.6447412123954293, "sim_compute_sim_state": 0.004988455077976856, "sim_compute_performance-ego0": 0.0018732918118967593}}
set_robot_commands_max	0.0021717812107727593
set_robot_commands_mean	0.002123198644020155
set_robot_commands_median	0.0021237087702784896
set_robot_commands_min	0.002073595824750882
sim_compute_performance-ego0_max	0.001938093025072486
sim_compute_performance-ego0_mean	0.0019020367189544025
sim_compute_performance-ego0_median	0.0018983810194241823
sim_compute_performance-ego0_min	0.0018732918118967593
sim_compute_sim_state_max	0.009772030348630296
sim_compute_sim_state_mean	0.008223181687374178
sim_compute_sim_state_median	0.00906612066144478
sim_compute_sim_state_min	0.004988455077976856
sim_render-ego0_max	0.0038093687158770265
sim_render-ego0_mean	0.003722435298912112
sim_render-ego0_median	0.0037160780975884662
sim_render-ego0_min	0.0036482162845944896
simulation-passed	1
step_physics_max	0.12397458381259564
step_physics_mean	0.10942873870288308
step_physics_median	0.11088591499624828
step_physics_min	0.0919685410064401
survival_time_max	11.250000000000025
survival_time_mean	6.549999999999999
survival_time_min	4.799999999999991

No reset possible

58089

9776

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 21:05:44+00:00

2020-12-03 21:11:33+00:00

0:05:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5144264224273064
survival_time_median	8.52499999999999
deviation-center-line_median	0.24577752675584005
in-drivable-lane_median	4.924999999999995

other stats

agent_compute-ego0_max	0.012502177868014068
agent_compute-ego0_mean	0.01218889209455089
agent_compute-ego0_median	0.012240106029124929
agent_compute-ego0_min	0.011773178451939634
complete-iteration_max	0.20419780517879285
complete-iteration_mean	0.1695928917337683
complete-iteration_median	0.16481181107416676
complete-iteration_min	0.14455013960794685
deviation-center-line_max	0.2825936301697553
deviation-center-line_mean	0.21689243890013288
deviation-center-line_min	0.09342107191909615
deviation-heading_max	1.8040620665917184
deviation-heading_mean	1.3120152392434563
deviation-heading_median	1.2689403346678478
deviation-heading_min	0.9061182210464124
driven_any_max	2.992392654304244
driven_any_mean	1.7729205361847369
driven_any_median	1.7434065505631735
driven_any_min	0.6124763893083562
driven_lanedir_consec_max	0.5183367761834681
driven_lanedir_consec_mean	0.4313059878015645
driven_lanedir_consec_min	0.17803433016817705
driven_lanedir_max	0.5183367761834681
driven_lanedir_mean	0.4313059878015645
driven_lanedir_median	0.5144264224273064
driven_lanedir_min	0.17803433016817705
get_duckie_state_max	1.7968016099764813e-06
get_duckie_state_mean	1.737063629976179e-06
get_duckie_state_median	1.7396928848250855e-06
get_duckie_state_min	1.6720671402780634e-06
get_robot_state_max	0.003550510657461066
get_robot_state_mean	0.0035100214724722205
get_robot_state_median	0.0034989675707427165
get_robot_state_min	0.003491640090942383
get_state_dump_max	0.004516880135787161
get_state_dump_mean	0.004407772380045215
get_state_dump_median	0.004398776585668016
get_state_dump_min	0.004316656213057668
get_ui_image_max	0.035583784705714175
get_ui_image_mean	0.03067162202759706
get_ui_image_median	0.03064646225899561
get_ui_image_min	0.025809778886682847
in-drivable-lane_max	11.050000000000074
in-drivable-lane_mean	5.762500000000014
in-drivable-lane_min	2.149999999999994
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.1234974639533015, "get_ui_image": 0.028706836700439452, "step_physics": 0.09625673545034308, "survival_time": 9.45, "driven_lanedir": 0.5143568582803235, "get_state_dump": 0.004516880135787161, "get_robot_state": 0.003550510657461066, "sim_render-ego0": 0.003721702726263749, "get_duckie_state": 1.7216331080386514e-06, "in-drivable-lane": 6.100000000000003, "deviation-heading": 1.06781521344291, "agent_compute-ego0": 0.012113716727808902, "complete-iteration": 0.161815471398203, "set_robot_commands": 0.0020964057821976512, "deviation-center-line": 0.2825936301697553, "driven_lanedir_consec": 0.5143568582803235, "sim_compute_sim_state": 0.008882645556801244, "sim_compute_performance-ego0": 0.0018932342529296875}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6124763893083562, "get_ui_image": 0.035583784705714175, "step_physics": 0.131327233816448, "survival_time": 3.7499999999999942, "driven_lanedir": 0.17803433016817705, "get_state_dump": 0.004316656213057668, "get_robot_state": 0.003492195355264764, "sim_render-ego0": 0.0036491971266897102, "get_duckie_state": 1.6720671402780634e-06, "in-drivable-lane": 2.149999999999994, "deviation-heading": 0.9061182210464124, "agent_compute-ego0": 0.011773178451939634, "complete-iteration": 0.20419780517879285, "set_robot_commands": 0.002333434004532663, "deviation-center-line": 0.09342107191909615, "driven_lanedir_consec": 0.17803433016817705, "sim_compute_sim_state": 0.00980650123796965, "sim_compute_performance-ego0": 0.00184105258238943}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.992392654304244, "get_ui_image": 0.03258608781755177, "step_physics": 0.09678716395553008, "survival_time": 14.40000000000007, "driven_lanedir": 0.5144959865742893, "get_state_dump": 0.004394242507776175, "get_robot_state": 0.003505739786220669, "sim_render-ego0": 0.0036728621354152583, "get_duckie_state": 1.7968016099764813e-06, "in-drivable-lane": 11.050000000000074, "deviation-heading": 1.470065455892786, "agent_compute-ego0": 0.012366495330440958, "complete-iteration": 0.16780815075013053, "set_robot_commands": 0.002201231293199797, "deviation-center-line": 0.23651984034763812, "driven_lanedir_consec": 0.5144959865742893, "sim_compute_sim_state": 0.010366870457738328, "sim_compute_performance-ego0": 0.0018518515524154715}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3633156371730455, "get_ui_image": 0.025809778886682847, "step_physics": 0.08464508742288826, "survival_time": 7.599999999999981, "driven_lanedir": 0.5183367761834681, "get_state_dump": 0.004403310663559858, "get_robot_state": 0.003491640090942383, "sim_render-ego0": 0.003605124218011994, "get_duckie_state": 1.7577526616115195e-06, "in-drivable-lane": 3.7499999999999862, "deviation-heading": 1.8040620665917184, "agent_compute-ego0": 0.012502177868014068, "complete-iteration": 0.14455013960794685, "set_robot_commands": 0.002810587290844886, "deviation-center-line": 0.25503521316404193, "driven_lanedir_consec": 0.5183367761834681, "sim_compute_sim_state": 0.0053275722304200815, "sim_compute_performance-ego0": 0.0018796983108021856}}
set_robot_commands_max	0.002810587290844886
set_robot_commands_mean	0.0023604145926937495
set_robot_commands_median	0.0022673326488662302
set_robot_commands_min	0.0020964057821976512
sim_compute_performance-ego0_max	0.0018932342529296875
sim_compute_performance-ego0_mean	0.0018664591746341936
sim_compute_performance-ego0_median	0.0018657749316088284
sim_compute_performance-ego0_min	0.00184105258238943
sim_compute_sim_state_max	0.010366870457738328
sim_compute_sim_state_mean	0.008595897370732325
sim_compute_sim_state_median	0.009344573397385446
sim_compute_sim_state_min	0.0053275722304200815
sim_render-ego0_max	0.003721702726263749
sim_render-ego0_mean	0.0036622215515951777
sim_render-ego0_median	0.003661029631052484
sim_render-ego0_min	0.003605124218011994
simulation-passed	1
step_physics_max	0.131327233816448
step_physics_mean	0.10225405516130236
step_physics_median	0.09652194970293658
step_physics_min	0.08464508742288826
survival_time_max	14.40000000000007
survival_time_mean	8.800000000000011
survival_time_min	3.7499999999999942

No reset possible

58081

10004

Mo Kleit 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 20:47:47+00:00

2020-12-03 21:05:15+00:00

0:17:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.9821810358762249
survival_time_median	24.550000000000217
deviation-center-line_median	0.9997821366774816
in-drivable-lane_median	6.525000000000093

other stats

agent_compute-ego0_max	0.01280361941430421
agent_compute-ego0_mean	0.012226657066713682
agent_compute-ego0_median	0.012247058009742797
agent_compute-ego0_min	0.011608892833064934
complete-iteration_max	0.1799463675572322
complete-iteration_mean	0.16125684695444042
complete-iteration_median	0.16191991287772467
complete-iteration_min	0.1412411945050801
deviation-center-line_max	3.051959292161935
deviation-center-line_mean	1.4932248360243354
deviation-center-line_min	0.9213757785804428
deviation-heading_max	15.493817735334265
deviation-heading_mean	6.764969317942317
deviation-heading_median	4.619096725046295
deviation-heading_min	2.327866086342415
driven_any_max	9.78976183184652
driven_any_mean	4.570709020482053
driven_any_median	3.1309303663796517
driven_any_min	2.2312135173223924
driven_lanedir_consec_max	9.481840120711562
driven_lanedir_consec_mean	3.743610001267172
driven_lanedir_consec_min	1.5282378126046767
driven_lanedir_max	9.481840120711562
driven_lanedir_mean	3.743610001267172
driven_lanedir_median	1.9821810358762249
driven_lanedir_min	1.5282378126046767
get_duckie_state_max	1.1912988286332028e-06
get_duckie_state_mean	1.156430397665263e-06
get_duckie_state_median	1.1596705887343855e-06
get_duckie_state_min	1.1150815845590778e-06
get_robot_state_max	0.003712968270581468
get_robot_state_mean	0.0035524232964093657
get_robot_state_median	0.00350116266277967
get_robot_state_min	0.003494399589496654
get_state_dump_max	0.004747405088037476
get_state_dump_mean	0.004468117257153219
get_state_dump_median	0.00438015241921093
get_state_dump_min	0.00436475910215354
get_ui_image_max	0.03549984523228237
get_ui_image_mean	0.030430459050346265
get_ui_image_median	0.030348420755870645
get_ui_image_min	0.02552514945736138
in-drivable-lane_max	17.000000000000238
in-drivable-lane_mean	7.512500000000106
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.3458808969899825, "get_ui_image": 0.02854165636507192, "step_physics": 0.09061736719948904, "survival_time": 26.55000000000024, "driven_lanedir": 2.084497610549839, "get_state_dump": 0.004747405088037476, "get_robot_state": 0.003712968270581468, "sim_render-ego0": 0.0038554179937319646, "get_duckie_state": 1.1495181492396765e-06, "in-drivable-lane": 17.000000000000238, "deviation-heading": 2.327866086342415, "agent_compute-ego0": 0.012214988694155129, "complete-iteration": 0.15913809600629306, "set_robot_commands": 0.0023003292263002323, "deviation-center-line": 0.9213757785804428, "driven_lanedir_consec": 2.084497610549839, "sim_compute_sim_state": 0.011056100515494669, "sim_compute_performance-ego0": 0.002011081329861978}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.2312135173223924, "get_ui_image": 0.03549984523228237, "step_physics": 0.10591567545146732, "survival_time": 18.150000000000123, "driven_lanedir": 1.8798644612026103, "get_state_dump": 0.004378577510079184, "get_robot_state": 0.003494399589496654, "sim_render-ego0": 0.003631931084852952, "get_duckie_state": 1.1698230282290952e-06, "in-drivable-lane": 3.450000000000049, "deviation-heading": 3.7732008097904393, "agent_compute-ego0": 0.01227912732533046, "complete-iteration": 0.1799463675572322, "set_robot_commands": 0.0020452141761779785, "deviation-center-line": 0.9566735789514113, "driven_lanedir_consec": 1.8798644612026103, "sim_compute_sim_state": 0.01078203680751088, "sim_compute_performance-ego0": 0.0018476503235953195}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.915979835769321, "get_ui_image": 0.032155185146669374, "step_physics": 0.0938368255058221, "survival_time": 22.550000000000185, "driven_lanedir": 1.5282378126046767, "get_state_dump": 0.004381727328342674, "get_robot_state": 0.0035038052406986204, "sim_render-ego0": 0.003675414925127958, "get_duckie_state": 1.1150815845590778e-06, "in-drivable-lane": 9.600000000000136, "deviation-heading": 5.4649926403021505, "agent_compute-ego0": 0.01280361941430421, "complete-iteration": 0.1647017297491563, "set_robot_commands": 0.0020892314151325056, "deviation-center-line": 1.042890694403552, "driven_lanedir_consec": 1.5282378126046767, "sim_compute_sim_state": 0.010325932397251636, "sim_compute_performance-ego0": 0.0018575523806884224}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.78976183184652, "get_ui_image": 0.02552514945736138, "step_physics": 0.08264818298727349, "survival_time": 59.99999999999873, "driven_lanedir": 9.481840120711562, "get_state_dump": 0.00436475910215354, "get_robot_state": 0.00349852008486072, "sim_render-ego0": 0.003568429732501358, "get_duckie_state": 1.1912988286332028e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.493817735334265, "agent_compute-ego0": 0.011608892833064934, "complete-iteration": 0.1412411945050801, "set_robot_commands": 0.002046569400187039, "deviation-center-line": 3.051959292161935, "driven_lanedir_consec": 9.481840120711562, "sim_compute_sim_state": 0.0060617191209880435, "sim_compute_performance-ego0": 0.0018458898418848956}}
set_robot_commands_max	0.0023003292263002323
set_robot_commands_mean	0.002120336054449439
set_robot_commands_median	0.0020679004076597724
set_robot_commands_min	0.0020452141761779785
sim_compute_performance-ego0_max	0.002011081329861978
sim_compute_performance-ego0_mean	0.001890543469007654
sim_compute_performance-ego0_median	0.001852601352141871
sim_compute_performance-ego0_min	0.0018458898418848956
sim_compute_sim_state_max	0.011056100515494669
sim_compute_sim_state_mean	0.009556447210311306
sim_compute_sim_state_median	0.010553984602381258
sim_compute_sim_state_min	0.0060617191209880435
sim_render-ego0_max	0.0038554179937319646
sim_render-ego0_mean	0.003682798434053558
sim_render-ego0_median	0.0036536730049904543
sim_render-ego0_min	0.003568429732501358
simulation-passed	1
step_physics_max	0.10591567545146732
step_physics_mean	0.093254512786013
step_physics_median	0.09222709635265558
step_physics_min	0.08264818298727349
survival_time_max	59.99999999999873
survival_time_mean	31.81249999999982
survival_time_min	18.150000000000123

No reset possible

58057

10023

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 20:14:21+00:00

2020-12-03 20:47:30+00:00

0:33:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.487253973131469
survival_time_median	59.99999999999873
deviation-center-line_median	2.431140910588952
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.011900963136099658
agent_compute-ego0_mean	0.011813124550272286
agent_compute-ego0_median	0.011872226054424251
agent_compute-ego0_min	0.01160708295614098
complete-iteration_max	0.18175304561332303
complete-iteration_mean	0.1635793315977181
complete-iteration_median	0.16516866046721296
complete-iteration_min	0.1422269598431234
deviation-center-line_max	3.345584919022154
deviation-center-line_mean	2.595840190516849
deviation-center-line_min	2.1754940218673378
deviation-heading_max	10.989835176106482
deviation-heading_mean	10.310583773135074
deviation-heading_median	10.760980577925196
deviation-heading_min	8.73053876058342
driven_any_max	5.876746966030879
driven_any_mean	5.714679538332436
driven_any_median	5.696732154263424
driven_any_min	5.588506878772016
driven_lanedir_consec_max	5.563966245900959
driven_lanedir_consec_mean	5.06486037431265
driven_lanedir_consec_min	3.720967305086703
driven_lanedir_max	5.619407244638493
driven_lanedir_mean	5.539470359200598
driven_lanedir_median	5.5557084901776355
driven_lanedir_min	5.427057211808625
get_duckie_state_max	1.6734959382399433e-06
get_duckie_state_mean	1.6167201567053495e-06
get_duckie_state_median	1.6327007525568698e-06
get_duckie_state_min	1.5279831834677156e-06
get_robot_state_max	0.003554023771262189
get_robot_state_mean	0.003507108612918139
get_robot_state_median	0.003503765591376032
get_robot_state_min	0.003466879497658303
get_state_dump_max	0.00442513280069699
get_state_dump_mean	0.004391236170245448
get_state_dump_median	0.004399574368720646
get_state_dump_min	0.0043406631428435085
get_ui_image_max	0.035868814843183355
get_ui_image_mean	0.030495359538298263
get_ui_image_median	0.030165910919341912
get_ui_image_min	0.025780801471325877
in-drivable-lane_max	1.249999999999929
in-drivable-lane_mean	0.31249999999998224
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.876746966030879, "get_ui_image": 0.028139085793475325, "step_physics": 0.0928518120990407, "survival_time": 59.99999999999873, "driven_lanedir": 5.619407244638493, "get_state_dump": 0.00442513280069699, "get_robot_state": 0.0035317531731801663, "sim_render-ego0": 0.003847058667032844, "get_duckie_state": 1.5279831834677156e-06, "in-drivable-lane": 1.249999999999929, "deviation-heading": 8.73053876058342, "agent_compute-ego0": 0.011889915283673213, "complete-iteration": 0.15982090603004984, "set_robot_commands": 0.0023194717229355582, "deviation-center-line": 3.345584919022154, "driven_lanedir_consec": 3.720967305086703, "sim_compute_sim_state": 0.010745524963073984, "sim_compute_performance-ego0": 0.001997343805012953}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.70494302930247, "get_ui_image": 0.035868814843183355, "step_physics": 0.10668077893697848, "survival_time": 59.99999999999873, "driven_lanedir": 5.563966245900959, "get_state_dump": 0.004395106749967373, "get_robot_state": 0.003554023771262189, "sim_render-ego0": 0.0036557977344471647, "get_duckie_state": 1.6734959382399433e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.654212588454737, "agent_compute-ego0": 0.011900963136099658, "complete-iteration": 0.18175304561332303, "set_robot_commands": 0.0021835514945253345, "deviation-center-line": 2.5361201818319468, "driven_lanedir_consec": 5.563966245900959, "sim_compute_sim_state": 0.011541701276336086, "sim_compute_performance-ego0": 0.0019002490794033336}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.688521279224378, "get_ui_image": 0.0321927360452085, "step_physics": 0.09846063239886103, "survival_time": 59.99999999999873, "driven_lanedir": 5.547450734454312, "get_state_dump": 0.0043406631428435085, "get_robot_state": 0.003466879497658303, "sim_render-ego0": 0.0035854312998369075, "get_duckie_state": 1.6405421629436407e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.867748567395656, "agent_compute-ego0": 0.01185453682517529, "complete-iteration": 0.17051641490437605, "set_robot_commands": 0.0020343266756310254, "deviation-center-line": 2.3261616393459565, "driven_lanedir_consec": 5.547450734454312, "sim_compute_sim_state": 0.012674947265383605, "sim_compute_performance-ego0": 0.0018362302168719873}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.588506878772016, "get_ui_image": 0.025780801471325877, "step_physics": 0.08344500189915387, "survival_time": 59.99999999999873, "driven_lanedir": 5.427057211808625, "get_state_dump": 0.004404041987473919, "get_robot_state": 0.003475778009571898, "sim_render-ego0": 0.003574391388079209, "get_duckie_state": 1.624859342170099e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.989835176106482, "agent_compute-ego0": 0.01160708295614098, "complete-iteration": 0.1422269598431234, "set_robot_commands": 0.0020661314361597677, "deviation-center-line": 2.1754940218673378, "driven_lanedir_consec": 5.427057211808625, "sim_compute_sim_state": 0.0059655500788375, "sim_compute_performance-ego0": 0.0018368150471251377}}
set_robot_commands_max	0.0023194717229355582
set_robot_commands_mean	0.002150870332312921
set_robot_commands_median	0.002124841465342551
set_robot_commands_min	0.0020343266756310254
sim_compute_performance-ego0_max	0.001997343805012953
sim_compute_performance-ego0_mean	0.0018926595371033528
sim_compute_performance-ego0_median	0.0018685320632642352
sim_compute_performance-ego0_min	0.0018362302168719873
sim_compute_sim_state_max	0.012674947265383605
sim_compute_sim_state_mean	0.010231930895907793
sim_compute_sim_state_median	0.011143613119705034
sim_compute_sim_state_min	0.0059655500788375
sim_render-ego0_max	0.003847058667032844
sim_render-ego0_mean	0.0036656697723490314
sim_render-ego0_median	0.003620614517142036
sim_render-ego0_min	0.003574391388079209
simulation-passed	1
step_physics_max	0.10668077893697848
step_physics_mean	0.09535955633350852
step_physics_median	0.09565622224895089
step_physics_min	0.08344500189915387
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58044

10030

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 19:40:06+00:00

2020-12-03 20:13:43+00:00

0:33:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.5408409211420215
survival_time_median	59.99999999999873
deviation-center-line_median	2.825062546709809
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.012397942594644131
agent_compute-ego0_mean	0.012154460399970722
agent_compute-ego0_median	0.012147073543240483
agent_compute-ego0_min	0.011925751918757783
complete-iteration_max	0.18163489620453313
complete-iteration_mean	0.16689772307128334
complete-iteration_median	0.1705786381831872
complete-iteration_min	0.1447987197142259
deviation-center-line_max	3.899436979518198
deviation-center-line_mean	2.923122375536652
deviation-center-line_min	2.142927429208791
deviation-heading_max	11.74276744360586
deviation-heading_mean	9.186028779138756
deviation-heading_median	9.8572156446738
deviation-heading_min	5.2869163836015725
driven_any_max	5.950672890811887
driven_any_mean	5.745632803475029
driven_any_median	5.707420472487284
driven_any_min	5.617017378113667
driven_lanedir_consec_max	5.9005058917507505
driven_lanedir_consec_mean	5.623028344398378
driven_lanedir_consec_min	5.509925643558715
driven_lanedir_max	5.9005058917507505
driven_lanedir_mean	5.623028344398378
driven_lanedir_median	5.5408409211420215
driven_lanedir_min	5.509925643558715
get_duckie_state_max	1.287579437179629e-06
get_duckie_state_mean	1.2079246038203437e-06
get_duckie_state_median	1.2106542087018145e-06
get_duckie_state_min	1.122810560698116e-06
get_robot_state_max	0.003754243564843933
get_robot_state_mean	0.003671231664884696
get_robot_state_median	0.003663243004721864
get_robot_state_min	0.0036041970852511217
get_state_dump_max	0.004725524726060904
get_state_dump_mean	0.0046785491690052045
get_state_dump_median	0.004672327605413458
get_state_dump_min	0.004644016739132998
get_ui_image_max	0.035736322204437385
get_ui_image_mean	0.030592824745734073
get_ui_image_median	0.030457369691624832
get_ui_image_min	0.02572023739524924
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.950672890811887, "get_ui_image": 0.028139017305207393, "step_physics": 0.09492981860679352, "survival_time": 59.99999999999873, "driven_lanedir": 5.9005058917507505, "get_state_dump": 0.004675367888959619, "get_robot_state": 0.003683559304967113, "sim_render-ego0": 0.003770817328650787, "get_duckie_state": 1.122810560698116e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.2869163836015725, "agent_compute-ego0": 0.012110260900708658, "complete-iteration": 0.16186547219802894, "set_robot_commands": 0.00225833313947514, "deviation-center-line": 3.899436979518198, "driven_lanedir_consec": 5.9005058917507505, "sim_compute_sim_state": 0.010252351467059514, "sim_compute_performance-ego0": 0.001967021567339107}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.722122726543633, "get_ui_image": 0.035736322204437385, "step_physics": 0.10591627695876096, "survival_time": 59.99999999999873, "driven_lanedir": 5.570503116462701, "get_state_dump": 0.004725524726060904, "get_robot_state": 0.003642926704476616, "sim_render-ego0": 0.003784601734043855, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.77419997640161, "agent_compute-ego0": 0.011925751918757783, "complete-iteration": 0.18163489620453313, "set_robot_commands": 0.0022679254673204255, "deviation-center-line": 3.1292712332459165, "driven_lanedir_consec": 5.570503116462701, "sim_compute_sim_state": 0.011570540792638317, "sim_compute_performance-ego0": 0.0019829293075548818}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.692718218430934, "get_ui_image": 0.03277572207804227, "step_physics": 0.1044896683228403, "survival_time": 59.99999999999873, "driven_lanedir": 5.509925643558715, "get_state_dump": 0.004669287321867295, "get_robot_state": 0.003754243564843933, "sim_render-ego0": 0.0038466840659847463, "get_duckie_state": 1.2047979655015676e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.74276744360586, "agent_compute-ego0": 0.012397942594644131, "complete-iteration": 0.17929180416834542, "set_robot_commands": 0.002288838409563584, "deviation-center-line": 2.520853860173701, "driven_lanedir_consec": 5.509925643558715, "sim_compute_sim_state": 0.012928863846193642, "sim_compute_performance-ego0": 0.00205872696107075}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.617017378113667, "get_ui_image": 0.02572023739524924, "step_physics": 0.08442904172987863, "survival_time": 59.99999999999873, "driven_lanedir": 5.511178725821342, "get_state_dump": 0.004644016739132998, "get_robot_state": 0.0036041970852511217, "sim_render-ego0": 0.003791789627392822, "get_duckie_state": 1.287579437179629e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.94023131294599, "agent_compute-ego0": 0.012183886185772314, "complete-iteration": 0.1447987197142259, "set_robot_commands": 0.0022865376007944025, "deviation-center-line": 2.142927429208791, "driven_lanedir_consec": 5.511178725821342, "sim_compute_sim_state": 0.006044421366708265, "sim_compute_performance-ego0": 0.002007538234065911}}
set_robot_commands_max	0.002288838409563584
set_robot_commands_mean	0.0022754086542883883
set_robot_commands_median	0.002277231534057414
set_robot_commands_min	0.00225833313947514
sim_compute_performance-ego0_max	0.00205872696107075
sim_compute_performance-ego0_mean	0.0020040540175076628
sim_compute_performance-ego0_median	0.0019952337708103963
sim_compute_performance-ego0_min	0.001967021567339107
sim_compute_sim_state_max	0.012928863846193642
sim_compute_sim_state_mean	0.010199044368149937
sim_compute_sim_state_median	0.010911446129848916
sim_compute_sim_state_min	0.006044421366708265
sim_render-ego0_max	0.0038466840659847463
sim_render-ego0_mean	0.0037984731890180526
sim_render-ego0_median	0.0037881956807183383
sim_render-ego0_min	0.003770817328650787
simulation-passed	1
step_physics_max	0.10591627695876096
step_physics_mean	0.09744120140456836
step_physics_median	0.09970974346481692
step_physics_min	0.08442904172987863
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58013

10049

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 19:04:12+00:00

2020-12-03 19:39:41+00:00

0:35:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.4611773466305
survival_time_median	59.99999999999873
deviation-center-line_median	3.399068994547944
in-drivable-lane_median	0.1750000000000025

other stats

agent_compute-ego0_max	0.012256526430878016
agent_compute-ego0_mean	0.011985016504394125
agent_compute-ego0_median	0.011980340343827908
agent_compute-ego0_min	0.011722858899042668
complete-iteration_max	0.19051124511610756
complete-iteration_mean	0.17264589610246694
complete-iteration_median	0.17451590304569242
complete-iteration_min	0.1510405332023754
deviation-center-line_max	3.903856180636365
deviation-center-line_mean	3.36970061297303
deviation-center-line_min	2.7768082821598665
deviation-heading_max	14.462207845548882
deviation-heading_mean	12.012930637867909
deviation-heading_median	11.934748069753253
deviation-heading_min	9.720018566416243
driven_any_max	9.495127580186956
driven_any_mean	8.860203603694568
driven_any_median	8.747514233279967
driven_any_min	8.450658368031387
driven_lanedir_consec_max	9.289584038643468
driven_lanedir_consec_mean	8.588356164626134
driven_lanedir_consec_min	8.141485926600065
driven_lanedir_max	9.289584038643468
driven_lanedir_mean	8.588356164626134
driven_lanedir_median	8.4611773466305
driven_lanedir_min	8.141485926600065
get_duckie_state_max	1.244104275794748e-06
get_duckie_state_mean	1.225939996038051e-06
get_duckie_state_median	1.2247488957261365e-06
get_duckie_state_min	1.2101579169051831e-06
get_robot_state_max	0.00374277267329004
get_robot_state_mean	0.003589480197201363
get_robot_state_median	0.0035603185378939384
get_robot_state_min	0.0034945110397275343
get_state_dump_max	0.004710431896975197
get_state_dump_mean	0.004537863695651268
get_state_dump_median	0.004541656953111279
get_state_dump_min	0.0043577089794073175
get_ui_image_max	0.03544242773127496
get_ui_image_mean	0.03069854179687246
get_ui_image_median	0.03057600248862464
get_ui_image_min	0.026199734478965588
in-drivable-lane_max	0.6999999999999602
in-drivable-lane_mean	0.2624999999999913
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.495127580186956, "get_ui_image": 0.028474658454685383, "step_physics": 0.09529416765598928, "survival_time": 59.99999999999873, "driven_lanedir": 9.289584038643468, "get_state_dump": 0.004710431896975197, "get_robot_state": 0.00374277267329004, "sim_render-ego0": 0.0038530117863917928, "get_duckie_state": 1.2325903061129072e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.46042878866558, "agent_compute-ego0": 0.012112655607885764, "complete-iteration": 0.16199274086932358, "set_robot_commands": 0.0023195779293800375, "deviation-center-line": 2.9473853596643713, "driven_lanedir_consec": 9.289584038643468, "sim_compute_sim_state": 0.009343856379551058, "sim_compute_performance-ego0": 0.0020520109419620205}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.450658368031387, "get_ui_image": 0.03544242773127496, "step_physics": 0.11540623687883896, "survival_time": 59.99999999999873, "driven_lanedir": 8.141485926600065, "get_state_dump": 0.0043577089794073175, "get_robot_state": 0.0034945110397275343, "sim_render-ego0": 0.003601995534841266, "get_duckie_state": 1.2101579169051831e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 13.409067350840925, "agent_compute-ego0": 0.012256526430878016, "complete-iteration": 0.19051124511610756, "set_robot_commands": 0.0020314517565115007, "deviation-center-line": 3.8507526294315166, "driven_lanedir_consec": 8.141485926600065, "sim_compute_sim_state": 0.012004663108489, "sim_compute_performance-ego0": 0.0018410948690625651}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.574913890961357, "get_ui_image": 0.0326773465225639, "step_physics": 0.1136413805689244, "survival_time": 59.99999999999873, "driven_lanedir": 8.154654857725403, "get_state_dump": 0.00445282489036541, "get_robot_state": 0.003564144749129245, "sim_render-ego0": 0.003668480372051712, "get_duckie_state": 1.2169074853393655e-06, "in-drivable-lane": 0.6999999999999602, "deviation-heading": 14.462207845548882, "agent_compute-ego0": 0.011848025079770052, "complete-iteration": 0.18703906522206123, "set_robot_commands": 0.0021489399061115654, "deviation-center-line": 3.903856180636365, "driven_lanedir_consec": 8.154654857725403, "sim_compute_sim_state": 0.013063049634033, "sim_compute_performance-ego0": 0.0019007967870300951}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.920114575598577, "get_ui_image": 0.026199734478965588, "step_physics": 0.09116171976608796, "survival_time": 59.99999999999873, "driven_lanedir": 8.767699835535597, "get_state_dump": 0.004630489015857147, "get_robot_state": 0.0035564923266586316, "sim_render-ego0": 0.0036668783421321873, "get_duckie_state": 1.244104275794748e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.720018566416243, "agent_compute-ego0": 0.011722858899042668, "complete-iteration": 0.1510405332023754, "set_robot_commands": 0.00211474619539056, "deviation-center-line": 2.7768082821598665, "driven_lanedir_consec": 8.767699835535597, "sim_compute_sim_state": 0.006013707852581955, "sim_compute_performance-ego0": 0.0018942131785727064}}
set_robot_commands_max	0.0023195779293800375
set_robot_commands_mean	0.002153678946848416
set_robot_commands_median	0.0021318430507510627
set_robot_commands_min	0.0020314517565115007
sim_compute_performance-ego0_max	0.0020520109419620205
sim_compute_performance-ego0_mean	0.001922028944156847
sim_compute_performance-ego0_median	0.001897504982801401
sim_compute_performance-ego0_min	0.0018410948690625651
sim_compute_sim_state_max	0.013063049634033
sim_compute_sim_state_mean	0.010106319243663751
sim_compute_sim_state_median	0.010674259744020028
sim_compute_sim_state_min	0.006013707852581955
sim_render-ego0_max	0.0038530117863917928
sim_render-ego0_mean	0.003697591508854239
sim_render-ego0_median	0.00366767935709195
sim_render-ego0_min	0.003601995534841266
simulation-passed	1
step_physics_max	0.11540623687883896
step_physics_mean	0.10387587621746017
step_physics_median	0.10446777411245683
step_physics_min	0.09116171976608796
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57991

10036

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 17:52:26+00:00

2020-12-03 18:25:56+00:00

0:33:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.610411705620159
survival_time_median	59.99999999999873
deviation-center-line_median	2.8858939474750684
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.01208230934968896
agent_compute-ego0_mean	0.011891167080471854
agent_compute-ego0_median	0.01188891684383675
agent_compute-ego0_min	0.01170452528452496
complete-iteration_max	0.19005109090590655
complete-iteration_mean	0.16635658649679624
complete-iteration_median	0.16700297112667392
complete-iteration_min	0.14136931282793055
deviation-center-line_max	3.382418718778238
deviation-center-line_mean	2.9143959762750775
deviation-center-line_min	2.5033772913719363
deviation-heading_max	10.92904204004973
deviation-heading_mean	8.616572538398842
deviation-heading_median	8.740255425172187
deviation-heading_min	6.056737263201267
driven_any_max	9.36962225178621
driven_any_mean	8.796976740783172
driven_any_median	8.740835214119434
driven_any_min	8.336614283107616
driven_lanedir_consec_max	9.257992499169712
driven_lanedir_consec_mean	8.669413849727137
driven_lanedir_consec_min	8.198839488498518
driven_lanedir_max	9.257992499169712
driven_lanedir_mean	8.669413849727137
driven_lanedir_median	8.610411705620159
driven_lanedir_min	8.198839488498518
get_duckie_state_max	1.2713010662501302e-06
get_duckie_state_mean	1.2214237406887083e-06
get_duckie_state_median	1.2188926525258898e-06
get_duckie_state_min	1.1766085914529234e-06
get_robot_state_max	0.0035712988946360416
get_robot_state_mean	0.0035258525118641217
get_robot_state_median	0.003517386319734572
get_robot_state_min	0.0034973385133513007
get_state_dump_max	0.00442903960972007
get_state_dump_mean	0.004365063874945851
get_state_dump_median	0.0043489884377319946
get_state_dump_min	0.004333239014599345
get_ui_image_max	0.03583429397691001
get_ui_image_mean	0.030397916763251667
get_ui_image_median	0.03012138490970685
get_ui_image_min	0.025514603256682967
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.36962225178621, "get_ui_image": 0.028058957696258775, "step_physics": 0.08882062282292273, "survival_time": 59.99999999999873, "driven_lanedir": 9.257992499169712, "get_state_dump": 0.004342564933008199, "get_robot_state": 0.0035712988946360416, "sim_render-ego0": 0.003634563989186664, "get_duckie_state": 1.2059890658134822e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.771644358447582, "agent_compute-ego0": 0.0118912518967399, "complete-iteration": 0.1535047015778528, "set_robot_commands": 0.00207782784270605, "deviation-center-line": 2.6911193851485615, "driven_lanedir_consec": 9.257992499169712, "sim_compute_sim_state": 0.009172100905673292, "sim_compute_performance-ego0": 0.001859880704665363}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.336614283107616, "get_ui_image": 0.03583429397691001, "step_physics": 0.11429603629862636, "survival_time": 59.99999999999873, "driven_lanedir": 8.198839488498518, "get_state_dump": 0.0043554119424557905, "get_robot_state": 0.0034973385133513007, "sim_render-ego0": 0.0036372429723048783, "get_duckie_state": 1.1766085914529234e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.70886649189679, "agent_compute-ego0": 0.01208230934968896, "complete-iteration": 0.19005109090590655, "set_robot_commands": 0.0020386039168511106, "deviation-center-line": 3.080668509801575, "driven_lanedir_consec": 8.198839488498518, "sim_compute_sim_state": 0.012380720673750878, "sim_compute_performance-ego0": 0.0018527601084840188}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.757455320554476, "get_ui_image": 0.032183812123154916, "step_physics": 0.10772633810623004, "survival_time": 59.99999999999873, "driven_lanedir": 8.555228876816576, "get_state_dump": 0.004333239014599345, "get_robot_state": 0.003500252341747681, "sim_render-ego0": 0.0036087790496343378, "get_duckie_state": 1.2713010662501302e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.92904204004973, "agent_compute-ego0": 0.011886581790933602, "complete-iteration": 0.18050124067549503, "set_robot_commands": 0.0020577510528818556, "deviation-center-line": 3.382418718778238, "driven_lanedir_consec": 8.555228876816576, "sim_compute_sim_state": 0.013277420294870446, "sim_compute_performance-ego0": 0.001850983780885517}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.724215107684392, "get_ui_image": 0.025514603256682967, "step_physics": 0.0826224452947002, "survival_time": 59.99999999999873, "driven_lanedir": 8.665594534423743, "get_state_dump": 0.00442903960972007, "get_robot_state": 0.0035345202977214627, "sim_render-ego0": 0.003603586249307827, "get_duckie_state": 1.2317962392382977e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.056737263201267, "agent_compute-ego0": 0.01170452528452496, "complete-iteration": 0.14136931282793055, "set_robot_commands": 0.0020360182365906625, "deviation-center-line": 2.5033772913719363, "driven_lanedir_consec": 8.665594534423743, "sim_compute_sim_state": 0.005986191648726261, "sim_compute_performance-ego0": 0.0018616546500632408}}
set_robot_commands_max	0.00207782784270605
set_robot_commands_mean	0.0020525502622574195
set_robot_commands_median	0.002048177484866483
set_robot_commands_min	0.0020360182365906625
sim_compute_performance-ego0_max	0.0018616546500632408
sim_compute_performance-ego0_mean	0.0018563198110245348
sim_compute_performance-ego0_median	0.0018563204065746909
sim_compute_performance-ego0_min	0.001850983780885517
sim_compute_sim_state_max	0.013277420294870446
sim_compute_sim_state_mean	0.01020410838075522
sim_compute_sim_state_median	0.010776410789712084
sim_compute_sim_state_min	0.005986191648726261
sim_render-ego0_max	0.0036372429723048783
sim_render-ego0_mean	0.0036210430651084265
sim_render-ego0_median	0.0036216715194105006
sim_render-ego0_min	0.003603586249307827
simulation-passed	1
step_physics_max	0.11429603629862636
step_physics_mean	0.09836636063061983
step_physics_median	0.0982734804645764
step_physics_min	0.0826224452947002
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57989

10073

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 17:12:48+00:00

2020-12-03 17:30:39+00:00

0:17:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.7726503235422937
survival_time_median	31.89999999999947
deviation-center-line_median	0.6504599013709986
in-drivable-lane_median	19.89999999999953

other stats

agent_compute-ego0_max	0.012650729734686356
agent_compute-ego0_mean	0.012440419090428851
agent_compute-ego0_median	0.012506766268625636
agent_compute-ego0_min	0.012097414089777783
complete-iteration_max	0.23369862567419297
complete-iteration_mean	0.18364920696875991
complete-iteration_median	0.17597871428561038
complete-iteration_min	0.14894077362962607
deviation-center-line_max	1.1209316423761433
deviation-center-line_mean	0.6474672757099338
deviation-center-line_min	0.16801765772159458
deviation-heading_max	5.440361954825968
deviation-heading_mean	3.4976638871980006
deviation-heading_median	3.4900767163925783
deviation-heading_min	1.5701401611808774
driven_any_max	9.824080989467266
driven_any_mean	5.23058949665907
driven_any_median	5.4052468643255205
driven_any_min	0.2877832685179708
driven_lanedir_consec_max	3.023877773948395
driven_lanedir_consec_mean	1.67551788097443
driven_lanedir_consec_min	0.13289310286473863
driven_lanedir_max	3.7698441936515295
driven_lanedir_mean	1.893882441234291
driven_lanedir_median	1.836396234210448
driven_lanedir_min	0.13289310286473863
get_duckie_state_max	1.819654442798132e-06
get_duckie_state_mean	1.7988370005816586e-06
get_duckie_state_median	1.8071881532078544e-06
get_duckie_state_min	1.761317253112793e-06
get_robot_state_max	0.0036632918885775977
get_robot_state_mean	0.003602480917681831
get_robot_state_median	0.0035885046806013532
get_robot_state_min	0.0035696224209470218
get_state_dump_max	0.004697102534620068
get_state_dump_mean	0.004574626264421483
get_state_dump_median	0.004538691294653271
get_state_dump_min	0.004524019933759322
get_ui_image_max	0.036414088874027646
get_ui_image_mean	0.030830823269014818
get_ui_image_median	0.030399749917104493
get_ui_image_min	0.026109704367822652
in-drivable-lane_max	42.74999999999952
in-drivable-lane_mean	21.16249999999965
in-drivable-lane_min	2.0999999999999925
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.747625005081682, "get_ui_image": 0.02805542264665876, "step_physics": 0.09324267166001456, "survival_time": 55.94999999999896, "driven_lanedir": 3.7698441936515295, "get_state_dump": 0.004550970239298684, "get_robot_state": 0.0036632918885775977, "sim_render-ego0": 0.0038136852639062066, "get_duckie_state": 1.761317253112793e-06, "in-drivable-lane": 36.39999999999907, "deviation-heading": 5.243647732086763, "agent_compute-ego0": 0.012624061746256693, "complete-iteration": 0.15923206742320742, "set_robot_commands": 0.002208748034068516, "deviation-center-line": 1.0006736139868313, "driven_lanedir_consec": 2.898756205882253, "sim_compute_sim_state": 0.00903832699571337, "sim_compute_performance-ego0": 0.0019607428993497576}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2877832685179708, "get_ui_image": 0.036414088874027646, "step_physics": 0.15882439997004366, "survival_time": 4.299999999999993, "driven_lanedir": 0.13289310286473863, "get_state_dump": 0.004526412350007857, "get_robot_state": 0.003582159678141276, "sim_render-ego0": 0.003704608171835713, "get_duckie_state": 1.819654442798132e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 1.5701401611808774, "agent_compute-ego0": 0.01238947079099458, "complete-iteration": 0.23369862567419297, "set_robot_commands": 0.0020704844902301655, "deviation-center-line": 0.16801765772159458, "driven_lanedir_consec": 0.13289310286473863, "sim_compute_sim_state": 0.010240220475470884, "sim_compute_performance-ego0": 0.0018747675007787243}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.062868723569359, "get_ui_image": 0.03274407718755022, "step_physics": 0.1225174544732782, "survival_time": 7.84999999999998, "driven_lanedir": 0.6489146944725014, "get_state_dump": 0.004697102534620068, "get_robot_state": 0.0035948496830614306, "sim_render-ego0": 0.003784415088122404, "get_duckie_state": 1.8017201484004152e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 1.7365057006983942, "agent_compute-ego0": 0.012650729734686356, "complete-iteration": 0.19272536114801336, "set_robot_commands": 0.0023206834551654284, "deviation-center-line": 0.30024618875516584, "driven_lanedir_consec": 0.6465444412023343, "sim_compute_sim_state": 0.008413947081264061, "sim_compute_performance-ego0": 0.0019233347494390944}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.824080989467266, "get_ui_image": 0.026109704367822652, "step_physics": 0.08842815983603142, "survival_time": 59.99999999999873, "driven_lanedir": 3.023877773948395, "get_state_dump": 0.004524019933759322, "get_robot_state": 0.0035696224209470218, "sim_render-ego0": 0.003771326921067567, "get_duckie_state": 1.8126561580152932e-06, "in-drivable-lane": 42.74999999999952, "deviation-heading": 5.440361954825968, "agent_compute-ego0": 0.012097414089777783, "complete-iteration": 0.14894077362962607, "set_robot_commands": 0.0021531826054226053, "deviation-center-line": 1.1209316423761433, "driven_lanedir_consec": 3.023877773948395, "sim_compute_sim_state": 0.006294808717294101, "sim_compute_performance-ego0": 0.0019179504181721329}}
set_robot_commands_max	0.0023206834551654284
set_robot_commands_mean	0.002188274646221679
set_robot_commands_median	0.0021809653197455607
set_robot_commands_min	0.0020704844902301655
sim_compute_performance-ego0_max	0.0019607428993497576
sim_compute_performance-ego0_mean	0.0019191988919349272
sim_compute_performance-ego0_median	0.0019206425838056136
sim_compute_performance-ego0_min	0.0018747675007787243
sim_compute_sim_state_max	0.010240220475470884
sim_compute_sim_state_mean	0.008496825817435605
sim_compute_sim_state_median	0.008726137038488716
sim_compute_sim_state_min	0.006294808717294101
sim_render-ego0_max	0.0038136852639062066
sim_render-ego0_mean	0.003768508861232973
sim_render-ego0_median	0.0037778710045949858
sim_render-ego0_min	0.003704608171835713
simulation-passed	1
step_physics_max	0.15882439997004366
step_physics_mean	0.11575317148484196
step_physics_median	0.10788006306664638
step_physics_min	0.08842815983603142
survival_time_max	59.99999999999873
survival_time_mean	32.024999999999416
survival_time_min	4.299999999999993

No reset possible

57968

10715

Philippe Reddy 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 15:39:57+00:00

2020-12-03 15:59:02+00:00

0:19:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8719254152971148
survival_time_median	37.94999999999991
deviation-center-line_median	1.163695089536318
in-drivable-lane_median	7.050000000000059

other stats

agent_compute-ego0_max	0.01311026964432154
agent_compute-ego0_mean	0.01257599520419933
agent_compute-ego0_median	0.012599228679708734
agent_compute-ego0_min	0.01199525381305831
complete-iteration_max	0.18946766608800644
complete-iteration_mean	0.1619741523367148
complete-iteration_median	0.16069515339660023
complete-iteration_min	0.1370386364656523
deviation-center-line_max	1.5223679125934826
deviation-center-line_mean	1.0238878762314765
deviation-center-line_min	0.24579341325978735
deviation-heading_max	7.056216704158008
deviation-heading_mean	4.992011918158896
deviation-heading_median	5.458627346470479
deviation-heading_min	1.994576275536621
driven_any_max	4.169090512119718
driven_any_mean	2.4823441449550767
driven_any_median	2.57755823971351
driven_any_min	0.6051695882735688
driven_lanedir_consec_max	4.118118456160696
driven_lanedir_consec_mean	1.5093894791649825
driven_lanedir_consec_min	0.17558862990500446
driven_lanedir_max	4.118118456160696
driven_lanedir_mean	1.5093894791649825
driven_lanedir_median	0.8719254152971148
driven_lanedir_min	0.17558862990500446
get_duckie_state_max	1.102834692017211e-06
get_duckie_state_mean	1.080146390057488e-06
get_duckie_state_median	1.0923018460529851e-06
get_duckie_state_min	1.0331471761067708e-06
get_robot_state_max	0.003602835506816943
get_robot_state_mean	0.0035454211332675172
get_robot_state_median	0.0035362654547268736
get_robot_state_min	0.0035063181167993792
get_state_dump_max	0.004442386191350462
get_state_dump_mean	0.004403813767906068
get_state_dump_median	0.004405849976488549
get_state_dump_min	0.004361168927296711
get_ui_image_max	0.03554851703154735
get_ui_image_mean	0.03022496693384352
get_ui_image_median	0.029963952467365967
get_ui_image_min	0.025423445769094805
in-drivable-lane_max	38.499999999999496
in-drivable-lane_mean	13.149999999999904
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.1313670160948557, "get_ui_image": 0.02787825695448783, "step_physics": 0.08881680360945576, "survival_time": 45.89999999999953, "driven_lanedir": 0.35223363149327797, "get_state_dump": 0.004442386191350462, "get_robot_state": 0.003602835506816943, "sim_render-ego0": 0.003658471610782195, "get_duckie_state": 1.0911736057684134e-06, "in-drivable-lane": 38.499999999999496, "deviation-heading": 4.720547647018528, "agent_compute-ego0": 0.012653787714612627, "complete-iteration": 0.1550723432327121, "set_robot_commands": 0.0021265860610480405, "deviation-center-line": 0.8077467737388687, "driven_lanedir_consec": 0.35223363149327797, "sim_compute_sim_state": 0.009944088181421989, "sim_compute_performance-ego0": 0.001876193888169248}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6051695882735688, "get_ui_image": 0.03554851703154735, "step_physics": 0.1144576023786496, "survival_time": 9.700000000000005, "driven_lanedir": 0.17558862990500446, "get_state_dump": 0.00437469726953751, "get_robot_state": 0.0035063181167993792, "sim_render-ego0": 0.003670048102354392, "get_duckie_state": 1.0331471761067708e-06, "in-drivable-lane": 6.300000000000007, "deviation-heading": 1.994576275536621, "agent_compute-ego0": 0.01311026964432154, "complete-iteration": 0.18946766608800644, "set_robot_commands": 0.002080092063316932, "deviation-center-line": 0.24579341325978735, "driven_lanedir_consec": 0.17558862990500446, "sim_compute_sim_state": 0.010801279850495168, "sim_compute_performance-ego0": 0.001847699972299429}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.0237494633321647, "get_ui_image": 0.03204964798024411, "step_physics": 0.0964208125274709, "survival_time": 30.00000000000029, "driven_lanedir": 1.3916171991009516, "get_state_dump": 0.004437002683439588, "get_robot_state": 0.0035359942774209323, "sim_render-ego0": 0.003654770763860566, "get_duckie_state": 1.102834692017211e-06, "in-drivable-lane": 7.800000000000111, "deviation-heading": 6.1967070459224285, "agent_compute-ego0": 0.01254466964480484, "complete-iteration": 0.1663179635604884, "set_robot_commands": 0.0020965042209466563, "deviation-center-line": 1.5223679125934826, "driven_lanedir_consec": 1.3916171991009516, "sim_compute_sim_state": 0.00964745348582847, "sim_compute_performance-ego0": 0.0018591488062244485}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.169090512119718, "get_ui_image": 0.025423445769094805, "step_physics": 0.07808927433576116, "survival_time": 59.99999999999873, "driven_lanedir": 4.118118456160696, "get_state_dump": 0.004361168927296711, "get_robot_state": 0.0035365366320328153, "sim_render-ego0": 0.0036104680298766328, "get_duckie_state": 1.0934300863375573e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.056216704158008, "agent_compute-ego0": 0.01199525381305831, "complete-iteration": 0.1370386364656523, "set_robot_commands": 0.002100003748313275, "deviation-center-line": 1.5196434053337675, "driven_lanedir_consec": 4.118118456160696, "sim_compute_sim_state": 0.0059876501510582, "sim_compute_performance-ego0": 0.0018633664597281809}}
set_robot_commands_max	0.0021265860610480405
set_robot_commands_mean	0.002100796523406226
set_robot_commands_median	0.0020982539846299657
set_robot_commands_min	0.002080092063316932
sim_compute_performance-ego0_max	0.001876193888169248
sim_compute_performance-ego0_mean	0.0018616022816053265
sim_compute_performance-ego0_median	0.0018612576329763144
sim_compute_performance-ego0_min	0.001847699972299429
sim_compute_sim_state_max	0.010801279850495168
sim_compute_sim_state_mean	0.009095117917200956
sim_compute_sim_state_median	0.009795770833625228
sim_compute_sim_state_min	0.0059876501510582
sim_render-ego0_max	0.003670048102354392
sim_render-ego0_mean	0.003648439626718446
sim_render-ego0_median	0.0036566211873213807
sim_render-ego0_min	0.0036104680298766328
simulation-passed	1
step_physics_max	0.1144576023786496
step_physics_mean	0.09444612321283435
step_physics_median	0.09261880806846332
step_physics_min	0.07808927433576116
survival_time_max	59.99999999999873
survival_time_mean	36.39999999999963
survival_time_min	9.700000000000005

No reset possible

57966

10726

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 15:36:55+00:00

2020-12-03 15:39:36+00:00

0:02:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57961

10718

exercise_ros_template

LFv-sim

host-error

yes

2020-12-03 15:32:40+00:00

2020-12-03 15:35:33+00:00

0:02:53

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57960

10728

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 15:28:29+00:00

2020-12-03 15:31:22+00:00

0:02:53

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57947

10730

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 15:10:28+00:00

2020-12-03 15:27:43+00:00

0:17:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3949299599593223
survival_time_median	28.150000000000265
deviation-center-line_median	0.4141304639043551
in-drivable-lane_median	18.825000000000227

other stats

agent_compute-ego0_max	0.013206520833467182
agent_compute-ego0_mean	0.0129504995297531
agent_compute-ego0_median	0.013132802044279909
agent_compute-ego0_min	0.012329873196985402
complete-iteration_max	0.2011168266597547
complete-iteration_mean	0.16998634246853606
complete-iteration_median	0.1643975230331498
complete-iteration_min	0.15003349714808994
deviation-center-line_max	0.9729294704034972
deviation-center-line_mean	0.4878933575716469
deviation-center-line_min	0.15038303207438014
deviation-heading_max	3.865211532462167
deviation-heading_mean	2.553853617297305
deviation-heading_median	2.6372364373449626
deviation-heading_min	1.075730062037127
driven_any_max	10.861123038640846
driven_any_mean	5.406777706590495
driven_any_median	4.646066706414992
driven_any_min	1.473854374891155
driven_lanedir_consec_max	2.3992713626859343
driven_lanedir_consec_mean	1.4585081457542937
driven_lanedir_consec_min	0.6449013004125947
driven_lanedir_max	2.3992713626859343
driven_lanedir_mean	1.4585081457542937
driven_lanedir_median	1.3949299599593223
driven_lanedir_min	0.6449013004125947
get_duckie_state_max	1.553176105886266e-06
get_duckie_state_mean	1.368200167761682e-06
get_duckie_state_median	1.346792655381543e-06
get_duckie_state_min	1.2260392543973771e-06
get_robot_state_max	0.003743139066194233
get_robot_state_mean	0.003643885955018198
get_robot_state_median	0.00363462758452996
get_robot_state_min	0.003563149584818641
get_state_dump_max	0.004771768419366134
get_state_dump_mean	0.004579553106042268
get_state_dump_median	0.0046138493479162025
get_state_dump_min	0.004318745308970531
get_ui_image_max	0.03631307074898168
get_ui_image_mean	0.030573198099250173
get_ui_image_median	0.03007094584530664
get_ui_image_min	0.025837829957405727
in-drivable-lane_max	48.34999999999883
in-drivable-lane_mean	22.912499999999824
in-drivable-lane_min	5.650000000000005
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 10.861123038640846, "get_ui_image": 0.027816108621030327, "step_physics": 0.08759042841508724, "survival_time": 59.99999999999873, "driven_lanedir": 2.1106867727374077, "get_state_dump": 0.004318745308970531, "get_robot_state": 0.003563149584818641, "sim_render-ego0": 0.0036584550792430463, "get_duckie_state": 1.2260392543973771e-06, "in-drivable-lane": 48.34999999999883, "deviation-heading": 3.602576746371184, "agent_compute-ego0": 0.012329873196985402, "complete-iteration": 0.15209323083431298, "set_robot_commands": 0.0021099988665807057, "deviation-center-line": 0.5978748658771825, "driven_lanedir_consec": 2.1106867727374077, "sim_compute_sim_state": 0.008771239867516104, "sim_compute_performance-ego0": 0.0018604492565475832}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.473854374891155, "get_ui_image": 0.03631307074898168, "step_physics": 0.1248159082312333, "survival_time": 9.45, "driven_lanedir": 0.6449013004125947, "get_state_dump": 0.004771768419366134, "get_robot_state": 0.003743139066194233, "sim_render-ego0": 0.0038938735660753753, "get_duckie_state": 1.3702794125205592e-06, "in-drivable-lane": 5.650000000000005, "deviation-heading": 1.075730062037127, "agent_compute-ego0": 0.013206520833467182, "complete-iteration": 0.2011168266597547, "set_robot_commands": 0.0022008004941438375, "deviation-center-line": 0.15038303207438014, "driven_lanedir_consec": 0.6449013004125947, "sim_compute_sim_state": 0.010057922413474637, "sim_compute_performance-ego0": 0.002029935937178762}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.534601117753581, "get_ui_image": 0.032325783069582954, "step_physics": 0.10327774415845456, "survival_time": 27.550000000000257, "driven_lanedir": 0.6791731471812369, "get_state_dump": 0.0046084480009217195, "get_robot_state": 0.003660712985024936, "sim_render-ego0": 0.003824914711109106, "get_duckie_state": 1.553176105886266e-06, "in-drivable-lane": 23.500000000000252, "deviation-heading": 1.6718961283187412, "agent_compute-ego0": 0.013163901325585186, "complete-iteration": 0.17670181523198666, "set_robot_commands": 0.0022100542766460476, "deviation-center-line": 0.2303860619315277, "driven_lanedir_consec": 0.6791731471812369, "sim_compute_sim_state": 0.011555446230846905, "sim_compute_performance-ego0": 0.0019911341909049215}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.757532295076401, "get_ui_image": 0.025837829957405727, "step_physics": 0.08860824960801336, "survival_time": 28.750000000000274, "driven_lanedir": 2.3992713626859343, "get_state_dump": 0.0046192506949106855, "get_robot_state": 0.003608542184034983, "sim_render-ego0": 0.0037747944394747415, "get_duckie_state": 1.3233058982425266e-06, "in-drivable-lane": 14.1500000000002, "deviation-heading": 3.865211532462167, "agent_compute-ego0": 0.013101702762974631, "complete-iteration": 0.15003349714808994, "set_robot_commands": 0.0021496829059388903, "deviation-center-line": 0.9729294704034972, "driven_lanedir_consec": 2.3992713626859343, "sim_compute_sim_state": 0.006311269683970345, "sim_compute_performance-ego0": 0.00193320545885298}}
set_robot_commands_max	0.0022100542766460476
set_robot_commands_mean	0.0021676341358273705
set_robot_commands_median	0.002175241700041364
set_robot_commands_min	0.0021099988665807057
sim_compute_performance-ego0_max	0.002029935937178762
sim_compute_performance-ego0_mean	0.0019536812108710616
sim_compute_performance-ego0_median	0.0019621698248789505
sim_compute_performance-ego0_min	0.0018604492565475832
sim_compute_sim_state_max	0.011555446230846905
sim_compute_sim_state_mean	0.009173969548951996
sim_compute_sim_state_median	0.00941458114049537
sim_compute_sim_state_min	0.006311269683970345
sim_render-ego0_max	0.0038938735660753753
sim_render-ego0_mean	0.003788009448975567
sim_render-ego0_median	0.003799854575291923
sim_render-ego0_min	0.0036584550792430463
simulation-passed	1
step_physics_max	0.1248159082312333
step_physics_mean	0.10107308260319713
step_physics_median	0.09594299688323396
step_physics_min	0.08759042841508724
survival_time_max	59.99999999999873
survival_time_mean	31.437499999999815
survival_time_min	9.45

No reset possible

57935

10740

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 14:48:20+00:00

2020-12-03 15:09:57+00:00

0:21:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.3253143960627307
survival_time_median	47.29999999999945
deviation-center-line_median	1.2567598625814256
in-drivable-lane_median	5.324999999999969

other stats

agent_compute-ego0_max	0.013147504204615863
agent_compute-ego0_mean	0.012479978490135296
agent_compute-ego0_median	0.012637762211445951
agent_compute-ego0_min	0.011496885333033426
complete-iteration_max	0.21238436434004043
complete-iteration_mean	0.17261834044786073
complete-iteration_median	0.16947145166584243
complete-iteration_min	0.13914609411971754
deviation-center-line_max	2.9194706150214973
deviation-center-line_mean	1.4093450580342282
deviation-center-line_min	0.20438989195256463
deviation-heading_max	10.156129660404709
deviation-heading_mean	5.320097969297207
deviation-heading_median	4.64234721155411
deviation-heading_min	1.8395677936758976
driven_any_max	7.705490884038414
driven_any_mean	5.0836260703274725
driven_any_median	6.158657330706738
driven_any_min	0.311698735858
driven_lanedir_consec_max	7.565966526846982
driven_lanedir_consec_mean	3.593019286258738
driven_lanedir_consec_min	0.1554818260625086
driven_lanedir_max	7.565966526846982
driven_lanedir_mean	3.593019286258738
driven_lanedir_median	3.3253143960627307
driven_lanedir_min	0.1554818260625086
get_duckie_state_max	1.1525880684959798e-06
get_duckie_state_mean	1.1196447991169308e-06
get_duckie_state_median	1.113600545115285e-06
get_duckie_state_min	1.0987900377411728e-06
get_robot_state_max	0.003670536938511792
get_robot_state_mean	0.0035777487837428223
get_robot_state_median	0.003566187585422538
get_robot_state_min	0.0035080830256144207
get_state_dump_max	0.004577175363317713
get_state_dump_mean	0.004524210959135923
get_state_dump_median	0.004559363162156909
get_state_dump_min	0.004400942148912162
get_ui_image_max	0.03544394175211588
get_ui_image_mean	0.03043672989177186
get_ui_image_median	0.030357889489722293
get_ui_image_min	0.025587198835526972
in-drivable-lane_max	38.84999999999894
in-drivable-lane_mean	12.37499999999972
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.841431797324585, "get_ui_image": 0.028223357331357137, "step_physics": 0.0948017259352823, "survival_time": 34.60000000000017, "driven_lanedir": 3.9148098613731905, "get_state_dump": 0.004577175363317713, "get_robot_state": 0.003670536938511792, "sim_render-ego0": 0.003763125228331374, "get_duckie_state": 1.1119319590999275e-06, "in-drivable-lane": 9.049999999999944, "deviation-heading": 3.879132974526666, "agent_compute-ego0": 0.012314857342542508, "complete-iteration": 0.16232518269042087, "set_robot_commands": 0.002200881124058843, "deviation-center-line": 1.191345548189372, "driven_lanedir_consec": 3.9148098613731905, "sim_compute_sim_state": 0.010752380324304532, "sim_compute_performance-ego0": 0.0019477456163018295}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.311698735858, "get_ui_image": 0.03544394175211588, "step_physics": 0.138229677412245, "survival_time": 4.449999999999992, "driven_lanedir": 0.1554818260625086, "get_state_dump": 0.004559532801310221, "get_robot_state": 0.0035080830256144207, "sim_render-ego0": 0.003679278161790636, "get_duckie_state": 1.1152691311306424e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 1.8395677936758976, "agent_compute-ego0": 0.012960667080349392, "complete-iteration": 0.21238436434004043, "set_robot_commands": 0.002070739534166124, "deviation-center-line": 0.20438989195256463, "driven_lanedir_consec": 0.1554818260625086, "sim_compute_sim_state": 0.009985420438978408, "sim_compute_performance-ego0": 0.0018764813741048176}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.4758828640888915, "get_ui_image": 0.03249242164808745, "step_physics": 0.1033053511286854, "survival_time": 59.99999999999873, "driven_lanedir": 2.735818930752271, "get_state_dump": 0.004559193523003597, "get_robot_state": 0.003547323434974232, "sim_render-ego0": 0.003781683736796383, "get_duckie_state": 1.0987900377411728e-06, "in-drivable-lane": 38.84999999999894, "deviation-heading": 5.405561448581554, "agent_compute-ego0": 0.013147504204615863, "complete-iteration": 0.17661772064126402, "set_robot_commands": 0.00208964236669993, "deviation-center-line": 1.3221741769734792, "driven_lanedir_consec": 2.735818930752271, "sim_compute_sim_state": 0.011738044038402548, "sim_compute_performance-ego0": 0.001884920809489305}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.705490884038414, "get_ui_image": 0.025587198835526972, "step_physics": 0.08011918838176997, "survival_time": 59.99999999999873, "driven_lanedir": 7.565966526846982, "get_state_dump": 0.004400942148912162, "get_robot_state": 0.003585051735870844, "sim_render-ego0": 0.0036731181196328704, "get_duckie_state": 1.1525880684959798e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.156129660404709, "agent_compute-ego0": 0.011496885333033426, "complete-iteration": 0.13914609411971754, "set_robot_commands": 0.0022057039751597588, "deviation-center-line": 2.9194706150214973, "driven_lanedir_consec": 7.565966526846982, "sim_compute_sim_state": 0.0060898352423675054, "sim_compute_performance-ego0": 0.0019175015718712596}}
set_robot_commands_max	0.0022057039751597588
set_robot_commands_mean	0.002141741750021164
set_robot_commands_median	0.0021452617453793866
set_robot_commands_min	0.002070739534166124
sim_compute_performance-ego0_max	0.0019477456163018295
sim_compute_performance-ego0_mean	0.001906662342941803
sim_compute_performance-ego0_median	0.0019012111906802824
sim_compute_performance-ego0_min	0.0018764813741048176
sim_compute_sim_state_max	0.011738044038402548
sim_compute_sim_state_mean	0.009641420011013249
sim_compute_sim_state_median	0.01036890038164147
sim_compute_sim_state_min	0.0060898352423675054
sim_render-ego0_max	0.003781683736796383
sim_render-ego0_mean	0.003724301311637816
sim_render-ego0_median	0.003721201695061005
sim_render-ego0_min	0.0036731181196328704
simulation-passed	1
step_physics_max	0.138229677412245
step_physics_mean	0.10411398571449566
step_physics_median	0.09905353853198384
step_physics_min	0.08011918838176997
survival_time_max	59.99999999999873
survival_time_mean	39.762499999999406
survival_time_min	4.449999999999992

No reset possible

57931

10742

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 14:42:08+00:00

2020-12-03 14:47:45+00:00

0:05:37

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 513 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57927

10748

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 14:36:37+00:00

2020-12-03 14:41:47+00:00

0:05:10

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 527 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57922

10759

exercise_ros_template

LFv-sim

success

yes

2020-12-03 14:26:10+00:00

2020-12-03 14:35:18+00:00

0:09:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9867306319733088
survival_time_median	13.575000000000058
deviation-center-line_median	0.24420743547193435
in-drivable-lane_median	6.3250000000000455

other stats

agent_compute-ego0_max	0.0139010793284366
agent_compute-ego0_mean	0.012988223747203225
agent_compute-ego0_median	0.012775231997172036
agent_compute-ego0_min	0.012501351666032222
complete-iteration_max	0.22479266166687012
complete-iteration_mean	0.1895397046745489
complete-iteration_median	0.185831688370621
complete-iteration_min	0.16170278029008345
deviation-center-line_max	0.8127384461972961
deviation-center-line_mean	0.36320992860110063
deviation-center-line_min	0.15168639726323777
deviation-heading_max	3.634379566479617
deviation-heading_mean	1.956516168506468
deviation-heading_median	1.7917631944913612
deviation-heading_min	0.6081587185635318
driven_any_max	5.283466383620802
driven_any_mean	3.202275528115158
driven_any_median	2.9948640273804092
driven_any_min	1.5359076740790103
driven_lanedir_consec_max	3.462549769917823
driven_lanedir_consec_mean	1.5023177959763154
driven_lanedir_consec_min	0.573260150040821
driven_lanedir_max	3.462549769917823
driven_lanedir_mean	1.5023177959763154
driven_lanedir_median	0.9867306319733088
driven_lanedir_min	0.573260150040821
get_duckie_state_max	1.3582634203361743e-06
get_duckie_state_mean	1.312120204146779e-06
get_duckie_state_median	1.3167502587301689e-06
get_duckie_state_min	1.2567168787906045e-06
get_robot_state_max	0.0036517209128329622
get_robot_state_mean	0.003569790804119962
get_robot_state_median	0.00354901113008198
get_robot_state_min	0.003529420043482925
get_state_dump_max	0.004597518318577817
get_state_dump_mean	0.004537394240712435
get_state_dump_median	0.004536528640576717
get_state_dump_min	0.00447900136311849
get_ui_image_max	0.035842498143514
get_ui_image_mean	0.030866332245215275
get_ui_image_median	0.03067301354910198
get_ui_image_min	0.02627680373914314
in-drivable-lane_max	12.300000000000086
in-drivable-lane_mean	7.35000000000004
in-drivable-lane_min	4.449999999999984
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.283466383620802, "get_ui_image": 0.028319641163474636, "step_physics": 0.10574992759185924, "survival_time": 22.75000000000019, "driven_lanedir": 3.462549769917823, "get_state_dump": 0.00458107496562757, "get_robot_state": 0.0036517209128329622, "sim_render-ego0": 0.0037582067021152423, "get_duckie_state": 1.2888197313275254e-06, "in-drivable-lane": 7.550000000000107, "deviation-heading": 3.634379566479617, "agent_compute-ego0": 0.012501351666032222, "complete-iteration": 0.17351341770406356, "set_robot_commands": 0.0022168337253102087, "deviation-center-line": 0.8127384461972961, "driven_lanedir_consec": 3.462549769917823, "sim_compute_sim_state": 0.01067308741703368, "sim_compute_performance-ego0": 0.001979465547360872}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5359076740790103, "get_ui_image": 0.035842498143514, "step_physics": 0.15070663452148436, "survival_time": 7.449999999999981, "driven_lanedir": 0.573260150040821, "get_state_dump": 0.00447900136311849, "get_robot_state": 0.0035344362258911133, "sim_render-ego0": 0.0036566940943400066, "get_duckie_state": 1.3446807861328124e-06, "in-drivable-lane": 4.449999999999984, "deviation-heading": 1.1690300227414114, "agent_compute-ego0": 0.01270792007446289, "complete-iteration": 0.22479266166687012, "set_robot_commands": 0.002080128987630208, "deviation-center-line": 0.1756996914610268, "driven_lanedir_consec": 0.573260150040821, "sim_compute_sim_state": 0.00983016808827718, "sim_compute_performance-ego0": 0.001870698928833008}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.270330269764891, "get_ui_image": 0.03302638593472933, "step_physics": 0.12385045540960211, "survival_time": 18.950000000000134, "driven_lanedir": 1.3314231659677562, "get_state_dump": 0.004597518318577817, "get_robot_state": 0.0035635860342728464, "sim_render-ego0": 0.00379884870428788, "get_duckie_state": 1.2567168787906045e-06, "in-drivable-lane": 12.300000000000086, "deviation-heading": 2.4144963662413113, "agent_compute-ego0": 0.0139010793284366, "complete-iteration": 0.19814995903717844, "set_robot_commands": 0.0021345050711380808, "deviation-center-line": 0.3127151794828419, "driven_lanedir_consec": 1.3314231659677562, "sim_compute_sim_state": 0.011239405054795114, "sim_compute_performance-ego0": 0.001956752099488911}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.719397784995928, "get_ui_image": 0.02627680373914314, "step_physics": 0.10164015220873283, "survival_time": 8.199999999999982, "driven_lanedir": 0.6420380979788614, "get_state_dump": 0.004491982315525864, "get_robot_state": 0.003529420043482925, "sim_render-ego0": 0.003675677559592507, "get_duckie_state": 1.3582634203361743e-06, "in-drivable-lane": 5.0999999999999845, "deviation-heading": 0.6081587185635318, "agent_compute-ego0": 0.012842543919881185, "complete-iteration": 0.16170278029008345, "set_robot_commands": 0.0020867997949773616, "deviation-center-line": 0.15168639726323777, "driven_lanedir_consec": 0.6420380979788614, "sim_compute_sim_state": 0.005176583203402432, "sim_compute_performance-ego0": 0.0018981268911650688}}
set_robot_commands_max	0.0022168337253102087
set_robot_commands_mean	0.002129566894763965
set_robot_commands_median	0.002110652433057721
set_robot_commands_min	0.002080128987630208
sim_compute_performance-ego0_max	0.001979465547360872
sim_compute_performance-ego0_mean	0.0019262608667119647
sim_compute_performance-ego0_median	0.00192743949532699
sim_compute_performance-ego0_min	0.001870698928833008
sim_compute_sim_state_max	0.011239405054795114
sim_compute_sim_state_mean	0.009229810940877103
sim_compute_sim_state_median	0.01025162775265543
sim_compute_sim_state_min	0.005176583203402432
sim_render-ego0_max	0.00379884870428788
sim_render-ego0_mean	0.003722356765083909
sim_render-ego0_median	0.0037169421308538746
sim_render-ego0_min	0.0036566940943400066
simulation-passed	1
step_physics_max	0.15070663452148436
step_physics_mean	0.12048679243291964
step_physics_median	0.11480019150073068
step_physics_min	0.10164015220873283
survival_time_max	22.75000000000019
survival_time_mean	14.337500000000071
survival_time_min	7.449999999999981

No reset possible

57907

10773

exercise_ros_template

LFv-sim

success

yes

2020-12-03 14:04:56+00:00

2020-12-03 14:25:20+00:00

0:20:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.1795670057280105
survival_time_median	36.69999999999985
deviation-center-line_median	1.018394116019949
in-drivable-lane_median	17.7749999999996

other stats

agent_compute-ego0_max	0.01273190659820718
agent_compute-ego0_mean	0.012295818761037691
agent_compute-ego0_median	0.01219006745831631
agent_compute-ego0_min	0.01207123352931096
complete-iteration_max	0.20943270229157948
complete-iteration_mean	0.1740154127863021
complete-iteration_median	0.16773440732205097
complete-iteration_min	0.1511601342095269
deviation-center-line_max	2.076120268066904
deviation-center-line_mean	1.0930189049973107
deviation-center-line_min	0.2591671198824409
deviation-heading_max	9.045956295327702
deviation-heading_mean	6.155920657627437
deviation-heading_median	7.095358134636889
deviation-heading_min	1.387010065908265
driven_any_max	10.32469952117654
driven_any_mean	6.029110020232002
driven_any_median	5.971723633983487
driven_any_min	1.8482932917844923
driven_lanedir_consec_max	5.689693151642075
driven_lanedir_consec_mean	2.6649978767321705
driven_lanedir_consec_min	0.6111643438305865
driven_lanedir_max	6.5058042952656985
driven_lanedir_mean	2.8897881288635587
driven_lanedir_median	2.221091938178975
driven_lanedir_min	0.6111643438305865
get_duckie_state_max	1.758591741578192e-06
get_duckie_state_mean	1.665090820360621e-06
get_duckie_state_median	1.6612855214921257e-06
get_duckie_state_min	1.5792004968800414e-06
get_robot_state_max	0.003488117610286614
get_robot_state_mean	0.003475149524238356
get_robot_state_median	0.003475526348575131
get_robot_state_min	0.00346142778951655
get_state_dump_max	0.004369034338249731
get_state_dump_mean	0.004335954170504874
get_state_dump_median	0.004340267693748986
get_state_dump_min	0.004294246956271792
get_ui_image_max	0.03550520170302618
get_ui_image_mean	0.03019811960321567
get_ui_image_median	0.029905001938670496
get_ui_image_min	0.025477272832495533
in-drivable-lane_max	26.34999999999998
in-drivable-lane_mean	17.324999999999807
in-drivable-lane_min	7.400000000000038
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 10.32469952117654, "get_ui_image": 0.027841409775339297, "step_physics": 0.0953210039400836, "survival_time": 59.99999999999873, "driven_lanedir": 6.5058042952656985, "get_state_dump": 0.004294246956271792, "get_robot_state": 0.003488117610286614, "sim_render-ego0": 0.003712971343485938, "get_duckie_state": 1.5792004968800414e-06, "in-drivable-lane": 20.04999999999904, "deviation-heading": 9.045956295327702, "agent_compute-ego0": 0.012222965392939355, "complete-iteration": 0.16062672191813626, "set_robot_commands": 0.002152531073551988, "deviation-center-line": 2.076120268066904, "driven_lanedir_consec": 5.689693151642075, "sim_compute_sim_state": 0.00960793264898829, "sim_compute_performance-ego0": 0.001911076975305511}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.239637936742217, "get_ui_image": 0.03550520170302618, "step_physics": 0.13548063550676617, "survival_time": 26.200000000000237, "driven_lanedir": 1.4518913396418252, "get_state_dump": 0.004329516547066824, "get_robot_state": 0.00348703248160226, "sim_render-ego0": 0.003693963913690476, "get_duckie_state": 1.6271500360398066e-06, "in-drivable-lane": 15.500000000000169, "deviation-heading": 5.796520769974235, "agent_compute-ego0": 0.012157169523693266, "complete-iteration": 0.20943270229157948, "set_robot_commands": 0.002162638618832542, "deviation-center-line": 0.841468977996031, "driven_lanedir_consec": 1.368841474739897, "sim_compute_sim_state": 0.010650195621308828, "sim_compute_performance-ego0": 0.0018893119267054967}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.703809331224757, "get_ui_image": 0.031968594102001695, "step_physics": 0.10380054630299725, "survival_time": 47.199999999999456, "driven_lanedir": 2.990292536716124, "get_state_dump": 0.004369034338249731, "get_robot_state": 0.00346142778951655, "sim_render-ego0": 0.0036178215470894304, "get_duckie_state": 1.6954210069444444e-06, "in-drivable-lane": 26.34999999999998, "deviation-heading": 8.394195499299544, "agent_compute-ego0": 0.01273190659820718, "complete-iteration": 0.1748420927259657, "set_robot_commands": 0.002027611000828011, "deviation-center-line": 1.195319254043867, "driven_lanedir_consec": 2.990292536716124, "sim_compute_sim_state": 0.010958338288403062, "sim_compute_performance-ego0": 0.0018364838191441129}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8482932917844923, "get_ui_image": 0.025477272832495533, "step_physics": 0.09319564419933872, "survival_time": 11.65000000000003, "driven_lanedir": 0.6111643438305865, "get_state_dump": 0.004351018840431148, "get_robot_state": 0.0034640202155480017, "sim_render-ego0": 0.003617447665613941, "get_duckie_state": 1.758591741578192e-06, "in-drivable-lane": 7.400000000000038, "deviation-heading": 1.387010065908265, "agent_compute-ego0": 0.01207123352931096, "complete-iteration": 0.1511601342095269, "set_robot_commands": 0.0020437464754805607, "deviation-center-line": 0.2591671198824409, "driven_lanedir_consec": 0.6111643438305865, "sim_compute_sim_state": 0.005027883073203584, "sim_compute_performance-ego0": 0.0018406973944769965}}
set_robot_commands_max	0.002162638618832542
set_robot_commands_mean	0.0020966317921732756
set_robot_commands_median	0.0020981387745162743
set_robot_commands_min	0.002027611000828011
sim_compute_performance-ego0_max	0.001911076975305511
sim_compute_performance-ego0_mean	0.0018693925289080292
sim_compute_performance-ego0_median	0.0018650046605912464
sim_compute_performance-ego0_min	0.0018364838191441129
sim_compute_sim_state_max	0.010958338288403062
sim_compute_sim_state_mean	0.00906108740797594
sim_compute_sim_state_median	0.01012906413514856
sim_compute_sim_state_min	0.005027883073203584
sim_render-ego0_max	0.003712971343485938
sim_render-ego0_mean	0.003660551117469946
sim_render-ego0_median	0.003655892730389954
sim_render-ego0_min	0.003617447665613941
simulation-passed	1
step_physics_max	0.13548063550676617
step_physics_mean	0.10694945748729642
step_physics_median	0.09956077512154042
step_physics_min	0.09319564419933872
survival_time_max	59.99999999999873
survival_time_mean	36.26249999999961
survival_time_min	11.65000000000003

No reset possible

57899

10786

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 13:59:50+00:00

2020-12-03 14:03:03+00:00

0:03:13

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 46 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57894

10774

Étienne Boucher 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 13:52:44+00:00

2020-12-03 13:57:12+00:00

0:04:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.670643036047734
survival_time_median	5.1999999999999895
deviation-center-line_median	0.10606285350325924
in-drivable-lane_median	2.349999999999994

other stats

agent_compute-ego0_max	0.012646855979130183
agent_compute-ego0_mean	0.012551759336502152
agent_compute-ego0_median	0.01256256936683892
agent_compute-ego0_min	0.012435042633200591
complete-iteration_max	0.23175017587069807
complete-iteration_mean	0.1844948716895352
complete-iteration_median	0.18011548029494046
complete-iteration_min	0.1459983502975618
deviation-center-line_max	0.3383669843456174
deviation-center-line_mean	0.15193970345478774
deviation-center-line_min	0.05726612246701504
deviation-heading_max	0.8724830219129411
deviation-heading_mean	0.5417326935726854
deviation-heading_median	0.46692714371256205
deviation-heading_min	0.3605934649526761
driven_any_max	3.078236192747742
driven_any_mean	1.6500539181492375
driven_any_median	1.4447800176603711
driven_any_min	0.6324194445284651
driven_lanedir_consec_max	1.1225450940752169
driven_lanedir_consec_mean	0.664704736271979
driven_lanedir_consec_min	0.19498777891723096
driven_lanedir_max	1.1225450940752169
driven_lanedir_mean	0.664704736271979
driven_lanedir_median	0.670643036047734
driven_lanedir_min	0.19498777891723096
get_duckie_state_max	1.3064856481070471e-06
get_duckie_state_mean	1.2378862227220594e-06
get_duckie_state_median	1.2182618433228424e-06
get_duckie_state_min	1.2085355561355064e-06
get_robot_state_max	0.0035545151188688456
get_robot_state_mean	0.0035171546580141507
get_robot_state_median	0.003514256496328258
get_robot_state_min	0.0034855905205312403
get_state_dump_max	0.004456794486855561
get_state_dump_mean	0.004392349635896081
get_state_dump_median	0.004396268836066957
get_state_dump_min	0.00432006638459485
get_ui_image_max	0.035726563683871566
get_ui_image_mean	0.030417313264086983
get_ui_image_median	0.029881315778924698
get_ui_image_min	0.026180057814626984
in-drivable-lane_max	7.500000000000005
in-drivable-lane_mean	3.437499999999997
in-drivable-lane_min	1.5499999999999945
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.4535089535390369, "get_ui_image": 0.027557606966990344, "step_physics": 0.11391858559734416, "survival_time": 5.249999999999989, "driven_lanedir": 1.1225450940752169, "get_state_dump": 0.004456794486855561, "get_robot_state": 0.0035545151188688456, "sim_render-ego0": 0.004003335844795659, "get_duckie_state": 1.212335982412662e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 0.8724830219129411, "agent_compute-ego0": 0.012435042633200591, "complete-iteration": 0.17889898678041857, "set_robot_commands": 0.002369752470052467, "deviation-center-line": 0.3383669843456174, "driven_lanedir_consec": 1.1225450940752169, "sim_compute_sim_state": 0.008465472257362222, "sim_compute_performance-ego0": 0.0020646644088457215}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6324194445284651, "get_ui_image": 0.035726563683871566, "step_physics": 0.15841731942933182, "survival_time": 2.849999999999998, "driven_lanedir": 0.19498777891723096, "get_state_dump": 0.004418077140018858, "get_robot_state": 0.003519477515385069, "sim_render-ego0": 0.003665771977654819, "get_duckie_state": 1.2085355561355064e-06, "in-drivable-lane": 1.8499999999999976, "deviation-heading": 0.5278673200508, "agent_compute-ego0": 0.012646855979130183, "complete-iteration": 0.23175017587069807, "set_robot_commands": 0.0020916626371186354, "deviation-center-line": 0.05726612246701504, "driven_lanedir_consec": 0.19498777891723096, "sim_compute_sim_state": 0.009328887380402663, "sim_compute_performance-ego0": 0.001863405622284988}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4360510817817058, "get_ui_image": 0.03220502459085905, "step_physics": 0.11297429066437942, "survival_time": 5.14999999999999, "driven_lanedir": 0.6623535283483811, "get_state_dump": 0.004374460532115056, "get_robot_state": 0.003509035477271447, "sim_render-ego0": 0.003673835442616389, "get_duckie_state": 1.224187704233023e-06, "in-drivable-lane": 2.84999999999999, "deviation-heading": 0.4059869673743241, "agent_compute-ego0": 0.012580894506894626, "complete-iteration": 0.1813319738094623, "set_robot_commands": 0.002061972251305213, "deviation-center-line": 0.1087841978630558, "driven_lanedir_consec": 0.6623535283483811, "sim_compute_sim_state": 0.008032133946051965, "sim_compute_performance-ego0": 0.0018502427981450008}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.078236192747742, "get_ui_image": 0.026180057814626984, "step_physics": 0.08705939186943902, "survival_time": 9.850000000000003, "driven_lanedir": 0.6789325437470868, "get_state_dump": 0.00432006638459485, "get_robot_state": 0.0034855905205312403, "sim_render-ego0": 0.0035843957554210315, "get_duckie_state": 1.3064856481070471e-06, "in-drivable-lane": 7.500000000000005, "deviation-heading": 0.3605934649526761, "agent_compute-ego0": 0.012544244226783212, "complete-iteration": 0.1459983502975618, "set_robot_commands": 0.0020697586464159417, "deviation-center-line": 0.1033415091434627, "driven_lanedir_consec": 0.6789325437470868, "sim_compute_sim_state": 0.0048535147098579794, "sim_compute_performance-ego0": 0.001831800046593252}}
set_robot_commands_max	0.002369752470052467
set_robot_commands_mean	0.002148286501223064
set_robot_commands_median	0.002080710641767289
set_robot_commands_min	0.002061972251305213
sim_compute_performance-ego0_max	0.0020646644088457215
sim_compute_performance-ego0_mean	0.0019025282189672405
sim_compute_performance-ego0_median	0.0018568242102149945
sim_compute_performance-ego0_min	0.001831800046593252
sim_compute_sim_state_max	0.009328887380402663
sim_compute_sim_state_mean	0.007670002073418707
sim_compute_sim_state_median	0.008248803101707093
sim_compute_sim_state_min	0.0048535147098579794
sim_render-ego0_max	0.004003335844795659
sim_render-ego0_mean	0.0037318347551219743
sim_render-ego0_median	0.003669803710135604
sim_render-ego0_min	0.0035843957554210315
simulation-passed	1
step_physics_max	0.15841731942933182
step_physics_mean	0.1180923968901236
step_physics_median	0.1134464381308618
step_physics_min	0.08705939186943902
survival_time_max	9.850000000000003
survival_time_mean	5.774999999999996
survival_time_min	2.849999999999998

No reset possible

57874

10787

exercise_ros_template

LFv-sim

success

yes

2020-12-03 13:39:08+00:00

2020-12-03 13:52:34+00:00

0:13:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.1675612743763075
survival_time_median	25.22500000000022
deviation-center-line_median	0.7256394193952614
in-drivable-lane_median	11.225000000000128

other stats

agent_compute-ego0_max	0.01304704162422451
agent_compute-ego0_mean	0.012359546740488055
agent_compute-ego0_median	0.0122207793409995
agent_compute-ego0_min	0.011949586655728707
complete-iteration_max	0.22880104294529668
complete-iteration_mean	0.18040133796333435
complete-iteration_median	0.16966236462728854
complete-iteration_min	0.1534795796534636
deviation-center-line_max	1.4194480087284491
deviation-center-line_mean	0.7885466466107927
deviation-center-line_min	0.2834597389241985
deviation-heading_max	4.6921109128554574
deviation-heading_mean	2.549966787144023
deviation-heading_median	2.1068414173636696
deviation-heading_min	1.2940734009932953
driven_any_max	6.825602917157656
driven_any_mean	4.46467661546954
driven_any_median	5.064838264995334
driven_any_min	0.903427014729836
driven_lanedir_consec_max	4.152759592854342
driven_lanedir_consec_mean	2.2508991011999253
driven_lanedir_consec_min	0.5157142631927445
driven_lanedir_max	4.152759592854342
driven_lanedir_mean	2.2508991011999253
driven_lanedir_median	2.1675612743763075
driven_lanedir_min	0.5157142631927445
get_duckie_state_max	1.6380700288585432e-06
get_duckie_state_mean	1.509592896235213e-06
get_duckie_state_median	1.4828783422290286e-06
get_duckie_state_min	1.434544871624251e-06
get_robot_state_max	0.0035777177129473004
get_robot_state_mean	0.003523765361802106
get_robot_state_median	0.0035100341958512215
get_robot_state_min	0.003497275342558681
get_state_dump_max	0.004510495397779677
get_state_dump_mean	0.004486576865730738
get_state_dump_median	0.004485782938208475
get_state_dump_min	0.004464246188726326
get_ui_image_max	0.036304696842476177
get_ui_image_mean	0.030851819206633713
get_ui_image_median	0.03061041893186909
get_ui_image_min	0.025881742120320517
in-drivable-lane_max	18.05000000000006
in-drivable-lane_mean	10.687500000000076
in-drivable-lane_min	2.249999999999992
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.337461716110859, "get_ui_image": 0.02849144908718597, "step_physics": 0.08954078317584849, "survival_time": 26.55000000000024, "driven_lanedir": 4.152759592854342, "get_state_dump": 0.004485074738810833, "get_robot_state": 0.0035777177129473004, "sim_render-ego0": 0.0036701931989282593, "get_duckie_state": 1.434544871624251e-06, "in-drivable-lane": 6.150000000000087, "deviation-heading": 2.2151727729855577, "agent_compute-ego0": 0.012090348211446203, "complete-iteration": 0.1561484959788789, "set_robot_commands": 0.002107518059866769, "deviation-center-line": 1.0563115972195372, "driven_lanedir_consec": 4.152759592854342, "sim_compute_sim_state": 0.01021538461957659, "sim_compute_performance-ego0": 0.001892413411821638}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.903427014729836, "get_ui_image": 0.036304696842476177, "step_physics": 0.15450321524231522, "survival_time": 5.349999999999989, "driven_lanedir": 0.5157142631927445, "get_state_dump": 0.004510495397779677, "get_robot_state": 0.0035062807577627675, "sim_render-ego0": 0.003649601229914912, "get_duckie_state": 1.503361596001519e-06, "in-drivable-lane": 2.249999999999992, "deviation-heading": 1.2940734009932953, "agent_compute-ego0": 0.012351210470552798, "complete-iteration": 0.22880104294529668, "set_robot_commands": 0.002069967764395255, "deviation-center-line": 0.2834597389241985, "driven_lanedir_consec": 0.5157142631927445, "sim_compute_sim_state": 0.009941204830452247, "sim_compute_performance-ego0": 0.0018830343529030128}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.792214813879809, "get_ui_image": 0.0327293887765522, "step_physics": 0.10956981734592382, "survival_time": 23.900000000000205, "driven_lanedir": 1.3984797147361845, "get_state_dump": 0.004486491137606117, "get_robot_state": 0.0035137876339396755, "sim_render-ego0": 0.003720879803619703, "get_duckie_state": 1.6380700288585432e-06, "in-drivable-lane": 16.300000000000168, "deviation-heading": 1.9985100617417817, "agent_compute-ego0": 0.01304704162422451, "complete-iteration": 0.1831762332756982, "set_robot_commands": 0.0021463714711103658, "deviation-center-line": 0.3949672415709857, "driven_lanedir_consec": 1.3984797147361845, "sim_compute_sim_state": 0.012001170494860047, "sim_compute_performance-ego0": 0.0018796044749855249}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.825602917157656, "get_ui_image": 0.025881742120320517, "step_physics": 0.0942387878451978, "survival_time": 33.60000000000023, "driven_lanedir": 2.936642834016431, "get_state_dump": 0.004464246188726326, "get_robot_state": 0.003497275342558681, "sim_render-ego0": 0.003581640801847778, "get_duckie_state": 1.462395088456538e-06, "in-drivable-lane": 18.05000000000006, "deviation-heading": 4.6921109128554574, "agent_compute-ego0": 0.011949586655728707, "complete-iteration": 0.1534795796534636, "set_robot_commands": 0.002110102201464626, "deviation-center-line": 1.4194480087284491, "driven_lanedir_consec": 2.936642834016431, "sim_compute_sim_state": 0.0058336435065758354, "sim_compute_performance-ego0": 0.001845374681265889}}
set_robot_commands_max	0.0021463714711103658
set_robot_commands_mean	0.002108489874209254
set_robot_commands_median	0.002108810130665698
set_robot_commands_min	0.002069967764395255
sim_compute_performance-ego0_max	0.001892413411821638
sim_compute_performance-ego0_mean	0.001875106730244016
sim_compute_performance-ego0_median	0.0018813194139442688
sim_compute_performance-ego0_min	0.001845374681265889
sim_compute_sim_state_max	0.012001170494860047
sim_compute_sim_state_mean	0.00949785086286618
sim_compute_sim_state_median	0.010078294725014418
sim_compute_sim_state_min	0.0058336435065758354
sim_render-ego0_max	0.003720879803619703
sim_render-ego0_mean	0.003655578758577663
sim_render-ego0_median	0.003659897214421586
sim_render-ego0_min	0.003581640801847778
simulation-passed	1
step_physics_max	0.15450321524231522
step_physics_mean	0.11196315090232134
step_physics_median	0.1019043025955608
step_physics_min	0.08954078317584849
survival_time_max	33.60000000000023
survival_time_mean	22.350000000000165
survival_time_min	5.349999999999989

No reset possible

57666

11428

Frank (Chude) Qian 🇨🇦

template-pytorch

LFVmultibodyv-sim

success

yes

2020-12-03 11:22:26+00:00

2020-12-03 13:38:49+00:00

2:16:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8966696425107561
survival_time_median	59.99999999999873
deviation-center-line_median	1.1544393072458223
in-drivable-lane_median	47.77499999999877

other stats

agent_compute-ego0_max	0.01486296498904518
agent_compute-ego0_mean	0.01365489668748006
agent_compute-ego0_median	0.014494382769340878
agent_compute-ego0_min	0.012046130074747991
agent_compute-ego1_max	0.012577140658820896
agent_compute-ego1_mean	0.01196448772036109
agent_compute-ego1_median	0.011895750682618
agent_compute-ego1_min	0.011350968001188583
agent_compute-ego2_max	0.012942034239375918
agent_compute-ego2_mean	0.012561505945265509
agent_compute-ego2_median	0.01275099723364888
agent_compute-ego2_min	0.011991486362771728
agent_compute-ego3_max	0.012762647187282997
agent_compute-ego3_mean	0.012377686147189556
agent_compute-ego3_median	0.012612658277538597
agent_compute-ego3_min	0.01175775297674708
complete-iteration_max	1.3230258807056057
complete-iteration_mean	1.1191441829584294
complete-iteration_median	1.23260282973862
complete-iteration_min	0.4475146934055071
deviation-center-line_max	2.6673187316112337
deviation-center-line_mean	1.200614950180187
deviation-center-line_min	0.06196892753910049
deviation-heading_max	23.67303622458044
deviation-heading_mean	10.037716597430656
deviation-heading_median	8.593292028858276
deviation-heading_min	0.7276183357575613
driven_any_max	14.495361299769334
driven_any_mean	5.114163998827543
driven_any_median	4.630543866080858
driven_any_min	0.21754061663116436
driven_lanedir_consec_max	3.0652347358301855
driven_lanedir_consec_mean	1.0491259442797944
driven_lanedir_consec_min	0.06868387746646598
driven_lanedir_max	3.0652347358301855
driven_lanedir_mean	1.106113786719868
driven_lanedir_median	0.9267334775445164
driven_lanedir_min	0.06868387746646598
get_duckie_state_max	1.4418269275725632e-06
get_duckie_state_mean	1.4035132008726447e-06
get_duckie_state_median	1.4195930550834917e-06
get_duckie_state_min	1.3636113404235078e-06
get_robot_state_max	0.014217856920926796
get_robot_state_mean	0.013073651220875915
get_robot_state_median	0.014153575222259952
get_robot_state_min	0.007060374546606872
get_state_dump_max	0.00960976078945036
get_state_dump_mean	0.009006837524045614
get_state_dump_median	0.009555358275287256
get_state_dump_min	0.006123948355300738
get_ui_image_max	0.04871412081881229
get_ui_image_mean	0.043579901896831016
get_ui_image_median	0.04670760554139759
get_ui_image_min	0.029350251976794545
in-drivable-lane_max	58.89999999999873
in-drivable-lane_mean	46.58214285714174
in-drivable-lane_min	29.449999999999367
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 4.220899403509926, "get_ui_image": 0.0424328042903014, "step_physics": 0.96870119764247, "survival_time": 59.99999999999873, "driven_lanedir": 0.14041415716790473, "get_state_dump": 0.009555358275287256, "get_robot_state": 0.014153575222259952, "sim_render-ego0": 0.0037184079223429537, "sim_render-ego1": 0.003629555610891782, "sim_render-ego2": 0.003843832373321305, "sim_render-ego3": 0.003659222544877357, "get_duckie_state": 1.4195930550834917e-06, "in-drivable-lane": 55.54999999999873, "deviation-heading": 3.3224454303643176, "agent_compute-ego0": 0.01241172561042017, "agent_compute-ego1": 0.011727331679230624, "agent_compute-ego2": 0.012942034239375918, "agent_compute-ego3": 0.01175775297674708, "complete-iteration": 1.1376185832075234, "set_robot_commands": 0.0021575648619868576, "deviation-center-line": 0.4865629189347032, "driven_lanedir_consec": 0.14041415716790473, "sim_compute_sim_state": 0.02256057184999134, "sim_compute_performance-ego0": 0.0019408999434319463, "sim_compute_performance-ego1": 0.001889163310283626, "sim_compute_performance-ego2": 0.00188448844007608, "sim_compute_performance-ego3": 0.0019719229451226356}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 7.350108213928643, "get_ui_image": 0.0424328042903014, "step_physics": 0.96870119764247, "survival_time": 59.99999999999873, "driven_lanedir": 0.7234800855560446, "get_state_dump": 0.009555358275287256, "get_robot_state": 0.014153575222259952, "sim_render-ego0": 0.0037184079223429537, "sim_render-ego1": 0.003629555610891782, "sim_render-ego2": 0.003843832373321305, "sim_render-ego3": 0.003659222544877357, "get_duckie_state": 1.4195930550834917e-06, "in-drivable-lane": 49.49999999999877, "deviation-heading": 8.196767732393052, "agent_compute-ego0": 0.01241172561042017, "agent_compute-ego1": 0.011727331679230624, "agent_compute-ego2": 0.012942034239375918, "agent_compute-ego3": 0.01175775297674708, "complete-iteration": 1.1376185832075234, "set_robot_commands": 0.0021575648619868576, "deviation-center-line": 1.1638875651650793, "driven_lanedir_consec": 0.21285350393999747, "sim_compute_sim_state": 0.02256057184999134, "sim_compute_performance-ego0": 0.0019408999434319463, "sim_compute_performance-ego1": 0.001889163310283626, "sim_compute_performance-ego2": 0.00188448844007608, "sim_compute_performance-ego3": 0.0019719229451226356}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 0.6561960088393087, "get_ui_image": 0.0424328042903014, "step_physics": 0.96870119764247, "survival_time": 59.99999999999873, "driven_lanedir": 0.14869466547544752, "get_state_dump": 0.009555358275287256, "get_robot_state": 0.014153575222259952, "sim_render-ego0": 0.0037184079223429537, "sim_render-ego1": 0.003629555610891782, "sim_render-ego2": 0.003843832373321305, "sim_render-ego3": 0.003659222544877357, "get_duckie_state": 1.4195930550834917e-06, "in-drivable-lane": 58.89999999999873, "deviation-heading": 0.7276183357575613, "agent_compute-ego0": 0.01241172561042017, "agent_compute-ego1": 0.011727331679230624, "agent_compute-ego2": 0.012942034239375918, "agent_compute-ego3": 0.01175775297674708, "complete-iteration": 1.1376185832075234, "set_robot_commands": 0.0021575648619868576, "deviation-center-line": 0.06407341079619469, "driven_lanedir_consec": 0.14869466547544752, "sim_compute_sim_state": 0.02256057184999134, "sim_compute_performance-ego0": 0.0019408999434319463, "sim_compute_performance-ego1": 0.001889163310283626, "sim_compute_performance-ego2": 0.00188448844007608, "sim_compute_performance-ego3": 0.0019719229451226356}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 9.957882114604688, "get_ui_image": 0.0424328042903014, "step_physics": 0.96870119764247, "survival_time": 59.99999999999873, "driven_lanedir": 3.0652347358301855, "get_state_dump": 0.009555358275287256, "get_robot_state": 0.014153575222259952, "sim_render-ego0": 0.0037184079223429537, "sim_render-ego1": 0.003629555610891782, "sim_render-ego2": 0.003843832373321305, "sim_render-ego3": 0.003659222544877357, "get_duckie_state": 1.4195930550834917e-06, "in-drivable-lane": 31.39999999999928, "deviation-heading": 22.86099472352165, "agent_compute-ego0": 0.01241172561042017, "agent_compute-ego1": 0.011727331679230624, "agent_compute-ego2": 0.012942034239375918, "agent_compute-ego3": 0.01175775297674708, "complete-iteration": 1.1376185832075234, "set_robot_commands": 0.0021575648619868576, "deviation-center-line": 2.5626454965083663, "driven_lanedir_consec": 3.0652347358301855, "sim_compute_sim_state": 0.02256057184999134, "sim_compute_performance-ego0": 0.0019408999434319463, "sim_compute_performance-ego1": 0.001889163310283626, "sim_compute_performance-ego2": 0.00188448844007608, "sim_compute_performance-ego3": 0.0019719229451226356}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.738728738287316, "get_ui_image": 0.04871412081881229, "step_physics": 1.1356560870273027, "survival_time": 59.99999999999873, "driven_lanedir": 1.3728961745856856, "get_state_dump": 0.009296838091771668, "get_robot_state": 0.013856159856575512, "sim_render-ego0": 0.0036158043577907287, "sim_render-ego1": 0.0036535652154292, "sim_render-ego2": 0.003785986785189893, "sim_render-ego3": 0.003592741678001283, "get_duckie_state": 1.3636113404235078e-06, "in-drivable-lane": 32.9999999999992, "deviation-heading": 20.79278356153992, "agent_compute-ego0": 0.01486296498904518, "agent_compute-ego1": 0.012577140658820896, "agent_compute-ego2": 0.01275099723364888, "agent_compute-ego3": 0.012612658277538597, "complete-iteration": 1.3230258807056057, "set_robot_commands": 0.0021244502881484465, "deviation-center-line": 2.2179593706245786, "driven_lanedir_consec": 1.3728961745856856, "sim_compute_sim_state": 0.03171258326077044, "sim_compute_performance-ego0": 0.0018858961221280444, "sim_compute_performance-ego1": 0.0018523398485906315, "sim_compute_performance-ego2": 0.0019064281107881089, "sim_compute_performance-ego3": 0.0018838672812634169}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 3.4518420989243404, "get_ui_image": 0.04871412081881229, "step_physics": 1.1356560870273027, "survival_time": 59.99999999999873, "driven_lanedir": 1.129986869532988, "get_state_dump": 0.009296838091771668, "get_robot_state": 0.013856159856575512, "sim_render-ego0": 0.0036158043577907287, "sim_render-ego1": 0.0036535652154292, "sim_render-ego2": 0.003785986785189893, "sim_render-ego3": 0.003592741678001283, "get_duckie_state": 1.3636113404235078e-06, "in-drivable-lane": 47.09999999999863, "deviation-heading": 9.260246451586482, "agent_compute-ego0": 0.01486296498904518, "agent_compute-ego1": 0.012577140658820896, "agent_compute-ego2": 0.01275099723364888, "agent_compute-ego3": 0.012612658277538597, "complete-iteration": 1.3230258807056057, "set_robot_commands": 0.0021244502881484465, "deviation-center-line": 1.0282414134656173, "driven_lanedir_consec": 1.129986869532988, "sim_compute_sim_state": 0.03171258326077044, "sim_compute_performance-ego0": 0.0018858961221280444, "sim_compute_performance-ego1": 0.0018523398485906315, "sim_compute_performance-ego2": 0.0019064281107881089, "sim_compute_performance-ego3": 0.0018838672812634169}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.8193323980362384, "get_ui_image": 0.04871412081881229, "step_physics": 1.1356560870273027, "survival_time": 59.99999999999873, "driven_lanedir": 0.5911516181048798, "get_state_dump": 0.009296838091771668, "get_robot_state": 0.013856159856575512, "sim_render-ego0": 0.0036158043577907287, "sim_render-ego1": 0.0036535652154292, "sim_render-ego2": 0.003785986785189893, "sim_render-ego3": 0.003592741678001283, "get_duckie_state": 1.3636113404235078e-06, "in-drivable-lane": 55.79999999999873, "deviation-heading": 3.2987511821419258, "agent_compute-ego0": 0.01486296498904518, "agent_compute-ego1": 0.012577140658820896, "agent_compute-ego2": 0.01275099723364888, "agent_compute-ego3": 0.012612658277538597, "complete-iteration": 1.3230258807056057, "set_robot_commands": 0.0021244502881484465, "deviation-center-line": 0.37894459999971414, "driven_lanedir_consec": 0.5911516181048798, "sim_compute_sim_state": 0.03171258326077044, "sim_compute_performance-ego0": 0.0018858961221280444, "sim_compute_performance-ego1": 0.0018523398485906315, "sim_compute_performance-ego2": 0.0019064281107881089, "sim_compute_performance-ego3": 0.0018838672812634169}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 7.569659025438158, "get_ui_image": 0.04871412081881229, "step_physics": 1.1356560870273027, "survival_time": 59.99999999999873, "driven_lanedir": 1.4539090409785411, "get_state_dump": 0.009296838091771668, "get_robot_state": 0.013856159856575512, "sim_render-ego0": 0.0036158043577907287, "sim_render-ego1": 0.0036535652154292, "sim_render-ego2": 0.003785986785189893, "sim_render-ego3": 0.003592741678001283, "get_duckie_state": 1.3636113404235078e-06, "in-drivable-lane": 43.59999999999879, "deviation-heading": 13.44663122673615, "agent_compute-ego0": 0.01486296498904518, "agent_compute-ego1": 0.012577140658820896, "agent_compute-ego2": 0.01275099723364888, "agent_compute-ego3": 0.012612658277538597, "complete-iteration": 1.3230258807056057, "set_robot_commands": 0.0021244502881484465, "deviation-center-line": 1.4863630476552587, "driven_lanedir_consec": 1.166705828433559, "sim_compute_sim_state": 0.03171258326077044, "sim_compute_performance-ego0": 0.0018858961221280444, "sim_compute_performance-ego1": 0.0018523398485906315, "sim_compute_performance-ego2": 0.0019064281107881089, "sim_compute_performance-ego3": 0.0018838672812634169}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 4.5512904539427605, "get_ui_image": 0.04670760554139759, "step_physics": 1.0428996074209602, "survival_time": 59.99999999999873, "driven_lanedir": 1.5042173091910982, "get_state_dump": 0.00960976078945036, "get_robot_state": 0.014217856920926796, "sim_render-ego0": 0.0037511826355590312, "sim_render-ego1": 0.0037369368773118145, "sim_render-ego2": 0.0037312116551458784, "sim_render-ego3": 0.003895049488216912, "get_duckie_state": 1.4418269275725632e-06, "in-drivable-lane": 29.449999999999367, "deviation-heading": 23.67303622458044, "agent_compute-ego0": 0.014494382769340878, "agent_compute-ego1": 0.011895750682618, "agent_compute-ego2": 0.011991486362771728, "agent_compute-ego3": 0.012762647187282997, "complete-iteration": 1.23260282973862, "set_robot_commands": 0.0023175062089041804, "deviation-center-line": 2.6673187316112337, "driven_lanedir_consec": 1.5042173091910982, "sim_compute_sim_state": 0.036191526797292234, "sim_compute_performance-ego0": 0.0019917658822522573, "sim_compute_performance-ego1": 0.0018965151784422, "sim_compute_performance-ego2": 0.001918482045944684, "sim_compute_performance-ego3": 0.0019145115130549167}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 7.551367084873302, "get_ui_image": 0.04670760554139759, "step_physics": 1.0428996074209602, "survival_time": 59.99999999999873, "driven_lanedir": 2.2022781328138605, "get_state_dump": 0.00960976078945036, "get_robot_state": 0.014217856920926796, "sim_render-ego0": 0.0037511826355590312, "sim_render-ego1": 0.0037369368773118145, "sim_render-ego2": 0.0037312116551458784, "sim_render-ego3": 0.003895049488216912, "get_duckie_state": 1.4418269275725632e-06, "in-drivable-lane": 34.84999999999912, "deviation-heading": 18.459531595276015, "agent_compute-ego0": 0.014494382769340878, "agent_compute-ego1": 0.011895750682618, "agent_compute-ego2": 0.011991486362771728, "agent_compute-ego3": 0.012762647187282997, "complete-iteration": 1.23260282973862, "set_robot_commands": 0.0023175062089041804, "deviation-center-line": 2.1963406645882935, "driven_lanedir_consec": 2.2022781328138605, "sim_compute_sim_state": 0.036191526797292234, "sim_compute_performance-ego0": 0.0019917658822522573, "sim_compute_performance-ego1": 0.0018965151784422, "sim_compute_performance-ego2": 0.001918482045944684, "sim_compute_performance-ego3": 0.0019145115130549167}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 14.495361299769334, "get_ui_image": 0.04670760554139759, "step_physics": 1.0428996074209602, "survival_time": 59.99999999999873, "driven_lanedir": 2.300895329996101, "get_state_dump": 0.00960976078945036, "get_robot_state": 0.014217856920926796, "sim_render-ego0": 0.0037511826355590312, "sim_render-ego1": 0.0037369368773118145, "sim_render-ego2": 0.0037312116551458784, "sim_render-ego3": 0.003895049488216912, "get_duckie_state": 1.4418269275725632e-06, "in-drivable-lane": 48.04999999999893, "deviation-heading": 5.771220493083785, "agent_compute-ego0": 0.014494382769340878, "agent_compute-ego1": 0.011895750682618, "agent_compute-ego2": 0.011991486362771728, "agent_compute-ego3": 0.012762647187282997, "complete-iteration": 1.23260282973862, "set_robot_commands": 0.0023175062089041804, "deviation-center-line": 1.1449910493265654, "driven_lanedir_consec": 2.300895329996101, "sim_compute_sim_state": 0.036191526797292234, "sim_compute_performance-ego0": 0.0019917658822522573, "sim_compute_performance-ego1": 0.0018965151784422, "sim_compute_performance-ego2": 0.001918482045944684, "sim_compute_performance-ego3": 0.0019145115130549167}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.21754061663116436, "get_ui_image": 0.04670760554139759, "step_physics": 1.0428996074209602, "survival_time": 59.99999999999873, "driven_lanedir": 0.12039860189042528, "get_state_dump": 0.00960976078945036, "get_robot_state": 0.014217856920926796, "sim_render-ego0": 0.0037511826355590312, "sim_render-ego1": 0.0037369368773118145, "sim_render-ego2": 0.0037312116551458784, "sim_render-ego3": 0.003895049488216912, "get_duckie_state": 1.4418269275725632e-06, "in-drivable-lane": 58.59999999999873, "deviation-heading": 0.8454071353635112, "agent_compute-ego0": 0.014494382769340878, "agent_compute-ego1": 0.011895750682618, "agent_compute-ego2": 0.011991486362771728, "agent_compute-ego3": 0.012762647187282997, "complete-iteration": 1.23260282973862, "set_robot_commands": 0.0023175062089041804, "deviation-center-line": 0.06196892753910049, "driven_lanedir_consec": 0.12039860189042528, "sim_compute_sim_state": 0.036191526797292234, "sim_compute_performance-ego0": 0.0019917658822522573, "sim_compute_performance-ego1": 0.0018965151784422, "sim_compute_performance-ego2": 0.001918482045944684, "sim_compute_performance-ego3": 0.0019145115130549167}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 4.709797278218955, "get_ui_image": 0.029350251976794545, "step_physics": 0.3594122006434584, "survival_time": 59.99999999999873, "driven_lanedir": 0.6633524154885242, "get_state_dump": 0.006123948355300738, "get_robot_state": 0.007060374546606872, "sim_render-ego0": 0.0036596372463026214, "sim_render-ego1": 0.0036243540758296514, "get_duckie_state": 1.3745297599493911e-06, "in-drivable-lane": 47.49999999999862, "deviation-heading": 8.989816325323499, "agent_compute-ego0": 0.012046130074747991, "agent_compute-ego1": 0.011350968001188583, "complete-iteration": 0.4475146934055071, "set_robot_commands": 0.002172323984468509, "deviation-center-line": 1.2671247013322484, "driven_lanedir_consec": 0.6633524154885242, "sim_compute_sim_state": 0.006764571930744765, "sim_compute_performance-ego0": 0.001876078874840526, "sim_compute_performance-ego1": 0.001857787941417329}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 0.30829124858146256, "get_ui_image": 0.029350251976794545, "step_physics": 0.3594122006434584, "survival_time": 59.99999999999873, "driven_lanedir": 0.06868387746646598, "get_state_dump": 0.006123948355300738, "get_robot_state": 0.007060374546606872, "sim_render-ego0": 0.0036596372463026214, "sim_render-ego1": 0.0036243540758296514, "get_duckie_state": 1.3745297599493911e-06, "in-drivable-lane": 58.84999999999873, "deviation-heading": 0.8827819463609148, "agent_compute-ego0": 0.012046130074747991, "agent_compute-ego1": 0.011350968001188583, "complete-iteration": 0.4475146934055071, "set_robot_commands": 0.002172323984468509, "deviation-center-line": 0.08218740497566586, "driven_lanedir_consec": 0.06868387746646598, "sim_compute_sim_state": 0.006764571930744765, "sim_compute_performance-ego0": 0.001876078874840526, "sim_compute_performance-ego1": 0.001857787941417329}}
set_robot_commands_max	0.0023175062089041804
set_robot_commands_mean	0.0021959095289353536
set_robot_commands_median	0.0021575648619868576
set_robot_commands_min	0.0021244502881484465
sim_compute_performance-ego0_max	0.0019917658822522573
sim_compute_performance-ego0_mean	0.00193045753863786
sim_compute_performance-ego0_median	0.0019408999434319463
sim_compute_performance-ego0_min	0.001876078874840526
sim_compute_performance-ego1_max	0.0018965151784422
sim_compute_performance-ego1_mean	0.0018762606594357489
sim_compute_performance-ego1_median	0.001889163310283626
sim_compute_performance-ego1_min	0.0018523398485906315
sim_compute_performance-ego2_max	0.001918482045944684
sim_compute_performance-ego2_mean	0.0019031328656029577
sim_compute_performance-ego2_median	0.0019064281107881089
sim_compute_performance-ego2_min	0.00188448844007608
sim_compute_performance-ego3_max	0.0019719229451226356
sim_compute_performance-ego3_mean	0.0019234339131469892
sim_compute_performance-ego3_median	0.0019145115130549167
sim_compute_performance-ego3_min	0.0018838672812634169
sim_compute_sim_state_max	0.036191526797292234
sim_compute_sim_state_mean	0.02681341939240753
sim_compute_sim_state_median	0.03171258326077044
sim_compute_sim_state_min	0.006764571930744765
sim_render-ego0_max	0.0037511826355590312
sim_render-ego0_mean	0.0036900610110982912
sim_render-ego0_median	0.0037184079223429537
sim_render-ego0_min	0.0036158043577907287
sim_render-ego1_max	0.0037369368773118145
sim_render-ego1_mean	0.003666352783299321
sim_render-ego1_median	0.0036535652154292
sim_render-ego1_min	0.0036243540758296514
sim_render-ego2_max	0.003843832373321305
sim_render-ego2_mean	0.0037870102712190255
sim_render-ego2_median	0.003785986785189893
sim_render-ego2_min	0.0037312116551458784
sim_render-ego3_max	0.003895049488216912
sim_render-ego3_mean	0.0037156712370318497
sim_render-ego3_median	0.003659222544877357
sim_render-ego3_min	0.003592741678001283
simulation-passed	1
step_physics_max	1.1356560870273027
step_physics_mean	0.9505608549749892
step_physics_median	1.0428996074209602
step_physics_min	0.3594122006434584
survival_time_max	59.99999999999873
survival_time_mean	59.999999999998735
survival_time_min	59.99999999999873

No reset possible

57612

10912

Dishank Bansal 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 10:48:22+00:00

2020-12-03 11:22:00+00:00

0:33:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	9.16191697171902
survival_time_median	59.99999999999873
deviation-center-line_median	2.7436084419895215
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.011910831600700588
agent_compute-ego0_mean	0.011708905258146949
agent_compute-ego0_median	0.011745660727863804
agent_compute-ego0_min	0.011433467976159597
complete-iteration_max	0.1942527286218267
complete-iteration_mean	0.17057898896222906
complete-iteration_median	0.16996236327883602
complete-iteration_min	0.14813850066941744
deviation-center-line_max	2.821277543652848
deviation-center-line_mean	2.543362182678577
deviation-center-line_min	1.8649543030824176
deviation-heading_max	10.333119461086742
deviation-heading_mean	9.049955331330152
deviation-heading_median	8.707515525282925
deviation-heading_min	8.451670813668027
driven_any_max	9.854859779314207
driven_any_mean	9.442505764094657
driven_any_median	9.328238317315858
driven_any_min	9.258686642432696
driven_lanedir_consec_max	9.69766901093232
driven_lanedir_consec_mean	9.2776224348858
driven_lanedir_consec_min	9.088986785172844
driven_lanedir_max	9.69766901093232
driven_lanedir_mean	9.2776224348858
driven_lanedir_median	9.16191697171902
driven_lanedir_min	9.088986785172844
get_duckie_state_max	1.0392350221454452e-06
get_duckie_state_mean	1.0099041769645494e-06
get_duckie_state_median	1.0089612225509504e-06
get_duckie_state_min	9.824592406108516e-07
get_robot_state_max	0.003575021877177649
get_robot_state_mean	0.00355350504707635
get_robot_state_median	0.0035644859001102494
get_robot_state_min	0.0035100265109072517
get_state_dump_max	0.004550692441560744
get_state_dump_mean	0.00441568995594085
get_state_dump_median	0.004384303073104871
get_state_dump_min	0.004343461235992914
get_ui_image_max	0.035481777516729526
get_ui_image_mean	0.030370533615226653
get_ui_image_median	0.030255797403638908
get_ui_image_min	0.025488762136899264
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.854859779314207, "get_ui_image": 0.027985215484847833, "step_physics": 0.09109771718192756, "survival_time": 59.99999999999873, "driven_lanedir": 9.69766901093232, "get_state_dump": 0.004417346974991442, "get_robot_state": 0.003575021877177649, "sim_render-ego0": 0.003692308135274844, "get_duckie_state": 1.0074723471610572e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.493629265981824, "agent_compute-ego0": 0.011910831600700588, "complete-iteration": 0.1560003773358144, "set_robot_commands": 0.0022308516760452105, "deviation-center-line": 2.821277543652848, "driven_lanedir_consec": 9.69766901093232, "sim_compute_sim_state": 0.00909176635106934, "sim_compute_performance-ego0": 0.0019173104002711972}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.292236139671967, "get_ui_image": 0.035481777516729526, "step_physics": 0.11834766763533083, "survival_time": 59.99999999999873, "driven_lanedir": 9.088986785172844, "get_state_dump": 0.0043512591712183005, "get_robot_state": 0.003557973856929935, "sim_render-ego0": 0.003715780553571589, "get_duckie_state": 9.824592406108516e-07, "in-drivable-lane": 0.0, "deviation-heading": 10.333119461086742, "agent_compute-ego0": 0.01188431473000659, "complete-iteration": 0.1942527286218267, "set_robot_commands": 0.0022211718023269996, "deviation-center-line": 2.715224663254005, "driven_lanedir_consec": 9.088986785172844, "sim_compute_sim_state": 0.01269104022169788, "sim_compute_performance-ego0": 0.0019220732133851063}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.364240494959748, "get_ui_image": 0.03252637932242998, "step_physics": 0.11071336636634592, "survival_time": 59.99999999999873, "driven_lanedir": 9.21635916398306, "get_state_dump": 0.004550692441560744, "get_robot_state": 0.0035709979432905644, "sim_render-ego0": 0.003682197678793876, "get_duckie_state": 1.0392350221454452e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.451670813668027, "agent_compute-ego0": 0.011607006725721018, "complete-iteration": 0.18392434922185769, "set_robot_commands": 0.0021110698642778356, "deviation-center-line": 2.771992220725038, "driven_lanedir_consec": 9.21635916398306, "sim_compute_sim_state": 0.01318218547239788, "sim_compute_performance-ego0": 0.001898372500861912}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.258686642432696, "get_ui_image": 0.025488762136899264, "step_physics": 0.08972656438987917, "survival_time": 59.99999999999873, "driven_lanedir": 9.107474779454977, "get_state_dump": 0.004343461235992914, "get_robot_state": 0.0035100265109072517, "sim_render-ego0": 0.003580165643874652, "get_duckie_state": 1.0104500979408436e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.921401784584026, "agent_compute-ego0": 0.011433467976159597, "complete-iteration": 0.14813850066941744, "set_robot_commands": 0.002154434848883865, "deviation-center-line": 1.8649543030824176, "driven_lanedir_consec": 9.107474779454977, "sim_compute_sim_state": 0.005971523049868315, "sim_compute_performance-ego0": 0.001850795984069672}}
set_robot_commands_max	0.0022308516760452105
set_robot_commands_mean	0.0021793820478834777
set_robot_commands_median	0.0021878033256054323
set_robot_commands_min	0.0021110698642778356
sim_compute_performance-ego0_max	0.0019220732133851063
sim_compute_performance-ego0_mean	0.001897138024646972
sim_compute_performance-ego0_median	0.0019078414505665543
sim_compute_performance-ego0_min	0.001850795984069672
sim_compute_sim_state_max	0.01318218547239788
sim_compute_sim_state_mean	0.010234128773758353
sim_compute_sim_state_median	0.01089140328638361
sim_compute_sim_state_min	0.005971523049868315
sim_render-ego0_max	0.003715780553571589
sim_render-ego0_mean	0.00366761300287874
sim_render-ego0_median	0.00368725290703436
sim_render-ego0_min	0.003580165643874652
simulation-passed	1
step_physics_max	0.11834766763533083
step_physics_mean	0.10247132889337086
step_physics_median	0.10090554177413674
step_physics_min	0.08972656438987917
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57510

10905

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 10:07:41+00:00

2020-12-03 10:47:57+00:00

0:40:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	1.2422730096440104
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.013128435284172268
agent_compute-ego0_mean	0.012419876061708704
agent_compute-ego0_median	0.012323535451484064
agent_compute-ego0_min	0.011903998059694417
complete-iteration_max	0.3218102796587916
complete-iteration_mean	0.26836853385666426
complete-iteration_median	0.27059303830803483
complete-iteration_min	0.2104777791517958
deviation-center-line_max	4.053503393024394
deviation-center-line_mean	1.731069028434027
deviation-center-line_min	0.386226701423694
deviation-heading_max	27.859809596736422
deviation-heading_mean	14.925250437835436
deviation-heading_median	14.309269950178932
deviation-heading_min	3.22265225424745
driven_any_max	2.6645352591003757e-13
driven_any_mean	1.9984014443252818e-13
driven_any_median	2.6645352591003757e-13
driven_any_min	0.0
driven_lanedir_consec_max	0.000286102294921875
driven_lanedir_consec_mean	7.152557373046875e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.000286102294921875
driven_lanedir_mean	7.152557373046875e-05
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	1.1644990716151254e-06
get_duckie_state_mean	1.1286171747186995e-06
get_duckie_state_median	1.1314460379594966e-06
get_duckie_state_min	1.0870775513406795e-06
get_robot_state_max	0.003573262224983514
get_robot_state_mean	0.0035088751635682473
get_robot_state_median	0.0034906236853428823
get_robot_state_min	0.003480991058603711
get_state_dump_max	0.004286281075902426
get_state_dump_mean	0.004280854522139703
get_state_dump_median	0.004280545431608761
get_state_dump_min	0.004276046149438863
get_ui_image_max	0.034958973812322436
get_ui_image_mean	0.029761461939640983
get_ui_image_median	0.029465589098489654
get_ui_image_min	0.025155695749262193
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02730660652935654, "step_physics": 0.18763156556566987, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004280528458429316, "get_robot_state": 0.0034886027851470007, "sim_render-ego0": 0.003577439612294117, "get_duckie_state": 1.0870775513406795e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012547981927635073, "complete-iteration": 0.2510533148204159, "set_robot_commands": 0.002040060036982426, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008276213416449732, "sim_compute_performance-ego0": 0.0018301164974876489}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.034958973812322436, "step_physics": 0.2471053054390303, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.0042805624047882055, "get_robot_state": 0.003480991058603711, "sim_render-ego0": 0.003618511530282992, "get_duckie_state": 1.139088931627615e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013128435284172268, "complete-iteration": 0.3218102796587916, "set_robot_commands": 0.0020598886809083047, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011264152669787506, "sim_compute_performance-ego0": 0.001838562391282716}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03162457166762277, "step_physics": 0.22208949985551796, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004276046149438863, "get_robot_state": 0.003492644585538764, "sim_render-ego0": 0.003666705037036803, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012099088975333057, "complete-iteration": 0.2901327617956538, "set_robot_commands": 0.0022921335885764953, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008629840974704511, "sim_compute_performance-ego0": 0.0018862782668114505}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.025155695749262193, "step_physics": 0.15190172354247944, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004286281075902426, "get_robot_state": 0.003573262224983514, "sim_render-ego0": 0.00362191033502304, "get_duckie_state": 1.1238031442913782e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.011903998059694417, "complete-iteration": 0.2104777791517958, "set_robot_commands": 0.0021763705492615203, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.005901784126605717, "sim_compute_performance-ego0": 0.001880695381132788}}
set_robot_commands_max	0.0022921335885764953
set_robot_commands_mean	0.0021421132139321864
set_robot_commands_median	0.0021181296150849125
set_robot_commands_min	0.002040060036982426
sim_compute_performance-ego0_max	0.0018862782668114505
sim_compute_performance-ego0_mean	0.0018589131341786504
sim_compute_performance-ego0_median	0.001859628886207752
sim_compute_performance-ego0_min	0.0018301164974876489
sim_compute_sim_state_max	0.011264152669787506
sim_compute_sim_state_mean	0.008517997796886868
sim_compute_sim_state_median	0.008453027195577122
sim_compute_sim_state_min	0.005901784126605717
sim_render-ego0_max	0.003666705037036803
sim_render-ego0_mean	0.003621141628659238
sim_render-ego0_median	0.003620210932653016
sim_render-ego0_min	0.003577439612294117
simulation-passed	1
step_physics_max	0.2471053054390303
step_physics_mean	0.2021820236006744
step_physics_median	0.2048605327105939
step_physics_min	0.15190172354247944
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57479

11312

aido5-LFP-sim-validation

template-pytorch

LFP-sim

success

2020-12-03 09:57:35+00:00

2020-12-03 10:05:35+00:00

0:08:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.525000000000029
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.6441392428583057
deviation-center-line_median	0.42800742228014543

other stats

agent_compute-ego0_max	0.014139711155610926
agent_compute-ego0_mean	0.013408292556039684
agent_compute-ego0_median	0.01353800739941998
agent_compute-ego0_min	0.012417444269707862
complete-iteration_max	0.28088204720441035
complete-iteration_mean	0.22203462789824235
complete-iteration_median	0.21882887877560053
complete-iteration_min	0.16959870683735814
deviation-center-line_max	0.9042153477306406
deviation-center-line_mean	0.5162480793621512
deviation-center-line_min	0.3047621251576735
deviation-heading_max	4.0841288183501225
deviation-heading_mean	2.2997521720800904
deviation-heading_median	1.9991372431766692
deviation-heading_min	1.1166053836168996
driven_any_max	2.5432513041422737
driven_any_mean	1.6161639453735428
driven_any_median	1.681709975736677
driven_any_min	0.5579845258785426
driven_lanedir_consec_max	2.407899441544939
driven_lanedir_consec_mean	1.5586753534791724
driven_lanedir_consec_min	0.5385234866551398
driven_lanedir_max	2.407899441544939
driven_lanedir_mean	1.5586753534791724
driven_lanedir_median	1.6441392428583057
driven_lanedir_min	0.5385234866551398
get_duckie_state_max	0.02390680617474495
get_duckie_state_mean	0.017147524946432263
get_duckie_state_median	0.0203008002110433
get_duckie_state_min	0.004081693188897495
get_robot_state_max	0.003579851828123394
get_robot_state_mean	0.003550238522363419
get_robot_state_median	0.0035491204231940165
get_robot_state_min	0.003522861414942248
get_state_dump_max	0.00829816777655419
get_state_dump_mean	0.007218093679875528
get_state_dump_median	0.007733919192393867
get_state_dump_min	0.00510636855816019
get_ui_image_max	0.03860285422381233
get_ui_image_mean	0.03270843227793045
get_ui_image_median	0.033102700613736664
get_ui_image_min	0.02602547366043617
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 2.1341958937664995, "get_ui_image": 0.031319071384186443, "step_physics": 0.11864453173698264, "survival_time": 11.700000000000031, "driven_lanedir": 2.074891983493592, "get_state_dump": 0.00829816777655419, "get_robot_state": 0.0035229074194076215, "sim_render-ego0": 0.003555558590178794, "get_duckie_state": 0.02390680617474495, "in-drivable-lane": 0.0, "deviation-heading": 2.4241761539618354, "agent_compute-ego0": 0.012417444269707862, "complete-iteration": 0.2136045608114689, "set_robot_commands": 0.0020527078750285695, "deviation-center-line": 0.4925853375617271, "driven_lanedir_consec": 2.074891983493592, "sim_compute_sim_state": 0.007982820145627286, "sim_compute_performance-ego0": 0.00183083047258093}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5579845258785426, "get_ui_image": 0.03860285422381233, "step_physics": 0.17924230519463033, "survival_time": 4.199999999999993, "driven_lanedir": 0.5385234866551398, "get_state_dump": 0.007714058371151195, "get_robot_state": 0.0035753334269804115, "sim_render-ego0": 0.0036630630493164062, "get_duckie_state": 0.020192280937643612, "in-drivable-lane": 0.0, "deviation-heading": 1.1166053836168996, "agent_compute-ego0": 0.014139711155610926, "complete-iteration": 0.28088204720441035, "set_robot_commands": 0.002106930227840648, "deviation-center-line": 0.3047621251576735, "driven_lanedir_consec": 0.5385234866551398, "sim_compute_sim_state": 0.009693748810712027, "sim_compute_performance-ego0": 0.001875007853788488}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.2292240577068545, "get_ui_image": 0.034886329843286885, "step_physics": 0.12118286940089444, "survival_time": 11.350000000000026, "driven_lanedir": 1.2133865022230197, "get_state_dump": 0.007753780013636539, "get_robot_state": 0.003579851828123394, "sim_render-ego0": 0.004046647172225149, "get_duckie_state": 0.020409319484442995, "in-drivable-lane": 0.0, "deviation-heading": 1.574098332391503, "agent_compute-ego0": 0.0137556090689542, "complete-iteration": 0.22405319673973215, "set_robot_commands": 0.002424612379910653, "deviation-center-line": 0.3634295069985638, "driven_lanedir_consec": 1.2133865022230197, "sim_compute_sim_state": 0.013881964641704894, "sim_compute_performance-ego0": 0.0020521084467569986}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.5432513041422737, "get_ui_image": 0.02602547366043617, "step_physics": 0.10404552673471384, "survival_time": 14.45000000000007, "driven_lanedir": 2.407899441544939, "get_state_dump": 0.00510636855816019, "get_robot_state": 0.003522861414942248, "sim_render-ego0": 0.003581389887579556, "get_duckie_state": 0.004081693188897495, "in-drivable-lane": 0.0, "deviation-heading": 4.0841288183501225, "agent_compute-ego0": 0.013320405729885758, "complete-iteration": 0.16959870683735814, "set_robot_commands": 0.0021139449086682548, "deviation-center-line": 0.9042153477306406, "driven_lanedir_consec": 2.407899441544939, "sim_compute_sim_state": 0.005859027237727724, "sim_compute_performance-ego0": 0.001857793742212756}}
set_robot_commands_max	0.002424612379910653
set_robot_commands_mean	0.0021745488478620316
set_robot_commands_median	0.0021104375682544515
set_robot_commands_min	0.0020527078750285695
sim_compute_performance-ego0_max	0.0020521084467569986
sim_compute_performance-ego0_mean	0.001903935128834793
sim_compute_performance-ego0_median	0.001866400798000622
sim_compute_performance-ego0_min	0.00183083047258093
sim_compute_sim_state_max	0.013881964641704894
sim_compute_sim_state_mean	0.009354390208942983
sim_compute_sim_state_median	0.008838284478169658
sim_compute_sim_state_min	0.005859027237727724
sim_render-ego0_max	0.004046647172225149
sim_render-ego0_mean	0.003711664674824976
sim_render-ego0_median	0.003622226468447981
sim_render-ego0_min	0.003555558590178794
simulation-passed	1
step_physics_max	0.17924230519463033
step_physics_mean	0.1307788082668053
step_physics_median	0.11991370056893852
step_physics_min	0.10404552673471384
survival_time_max	14.45000000000007
survival_time_mean	10.42500000000003
survival_time_min	4.199999999999993

No reset possible

57467

11278

template-pytorch

LFv-sim

failed

yes

2020-12-03 09:55:19+00:00

2020-12-03 09:56:40+00:00

0:01:21

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 70, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 66, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/workspace/model.py", line 89, in predict
              ||     output = self.model(images)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torchvision/models/squeezenet.py", line 100, in forward
              ||     x = self.features(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 423, in forward
              ||     return self._conv_forward(input, self.weight)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 419, in _conv_forward
              ||     return F.conv2d(input, weight, self.bias, self.stride,
              || RuntimeError: Input type (torch.cuda.FloatTensor) and weight type (torch.FloatTensor) should be the same
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57410

11312

aido5-LFP-sim-validation

template-pytorch

LFP-sim

success

2020-12-03 09:44:56+00:00

2020-12-03 09:54:00+00:00

0:09:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.525000000000029
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.6441392428583057
deviation-center-line_median	0.42800742228014543

other stats

agent_compute-ego0_max	0.013624393238740809
agent_compute-ego0_mean	0.012614705346821572
agent_compute-ego0_median	0.01254928136910371
agent_compute-ego0_min	0.011735865410338057
complete-iteration_max	0.2953668930951287
complete-iteration_mean	0.2253881270617094
complete-iteration_median	0.21759193544069216
complete-iteration_min	0.17100174427032472
deviation-center-line_max	0.9042153477306406
deviation-center-line_mean	0.5184214979792945
deviation-center-line_min	0.3134557996262467
deviation-heading_max	4.0841288183501225
deviation-heading_mean	2.2936119953911724
deviation-heading_median	1.9991372431766692
deviation-heading_min	1.0920446768612275
driven_any_max	2.5432513041422737
driven_any_mean	1.6171885030376725
driven_any_median	1.681709975736677
driven_any_min	0.5620827565350613
driven_lanedir_consec_max	2.407899441544939
driven_lanedir_consec_mean	1.559649578128886
driven_lanedir_consec_min	0.5424203852539934
driven_lanedir_max	2.407899441544939
driven_lanedir_mean	1.559649578128886
driven_lanedir_median	1.6441392428583057
driven_lanedir_min	0.5424203852539934
get_duckie_state_max	0.02366718332818214
get_duckie_state_mean	0.01707792342224877
get_duckie_state_median	0.02020846154421599
get_duckie_state_min	0.00422758727238096
get_robot_state_max	0.003687280767104205
get_robot_state_mean	0.003568054684834588
get_robot_state_median	0.003550850180373795
get_robot_state_min	0.003483237611486557
get_state_dump_max	0.008224427446405938
get_state_dump_mean	0.007188847013249912
get_state_dump_median	0.007701312326917462
get_state_dump_min	0.005128335952758789
get_ui_image_max	0.03975647197050207
get_ui_image_mean	0.0333409762233052
get_ui_image_median	0.03363528695512325
get_ui_image_min	0.02633685901247222
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 2.1341958937664995, "get_ui_image": 0.03203534775591911, "step_physics": 0.12008214605615494, "survival_time": 11.700000000000031, "driven_lanedir": 2.074891983493592, "get_state_dump": 0.008224427446405938, "get_robot_state": 0.003483237611486557, "sim_render-ego0": 0.0035217163410592588, "get_duckie_state": 0.02366718332818214, "in-drivable-lane": 0.0, "deviation-heading": 2.4241761539618354, "agent_compute-ego0": 0.011735865410338057, "complete-iteration": 0.21456430009070865, "set_robot_commands": 0.002022399293615463, "deviation-center-line": 0.4925853375617271, "driven_lanedir_consec": 2.074891983493592, "sim_compute_sim_state": 0.007907120724941822, "sim_compute_performance-ego0": 0.001812572682157476}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5620827565350613, "get_ui_image": 0.03975647197050207, "step_physics": 0.19194387548110065, "survival_time": 4.199999999999993, "driven_lanedir": 0.5424203852539934, "get_state_dump": 0.007895379907944623, "get_robot_state": 0.003687280767104205, "sim_render-ego0": 0.0037491545957677504, "get_duckie_state": 0.02066628512214212, "in-drivable-lane": 0.0, "deviation-heading": 1.0920446768612275, "agent_compute-ego0": 0.013624393238740809, "complete-iteration": 0.2953668930951287, "set_robot_commands": 0.002178537144380457, "deviation-center-line": 0.3134557996262467, "driven_lanedir_consec": 0.5424203852539934, "sim_compute_sim_state": 0.009860355713788202, "sim_compute_performance-ego0": 0.001924733554615694}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.2292240577068545, "get_ui_image": 0.03523522615432739, "step_physics": 0.1213405780624925, "survival_time": 11.350000000000026, "driven_lanedir": 1.2133865022230197, "get_state_dump": 0.0075072447458903, "get_robot_state": 0.003486295541127523, "sim_render-ego0": 0.003592043592218767, "get_duckie_state": 0.019750637966289855, "in-drivable-lane": 0.0, "deviation-heading": 1.574098332391503, "agent_compute-ego0": 0.012241523516805549, "complete-iteration": 0.22061957079067565, "set_robot_commands": 0.002036925993467632, "deviation-center-line": 0.3634295069985638, "driven_lanedir_consec": 1.2133865022230197, "sim_compute_sim_state": 0.01354685896321347, "sim_compute_performance-ego0": 0.0018112115692674067}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.5432513041422737, "get_ui_image": 0.02633685901247222, "step_physics": 0.10520162500184158, "survival_time": 14.45000000000007, "driven_lanedir": 2.407899441544939, "get_state_dump": 0.005128335952758789, "get_robot_state": 0.0036154048196200663, "sim_render-ego0": 0.0036339480301429486, "get_duckie_state": 0.00422758727238096, "in-drivable-lane": 0.0, "deviation-heading": 4.0841288183501225, "agent_compute-ego0": 0.012857039221401871, "complete-iteration": 0.17100174427032472, "set_robot_commands": 0.0021118155841169687, "deviation-center-line": 0.9042153477306406, "driven_lanedir_consec": 2.407899441544939, "sim_compute_sim_state": 0.005902237727724273, "sim_compute_performance-ego0": 0.0019137933336455248}}
set_robot_commands_max	0.002178537144380457
set_robot_commands_mean	0.0020874195038951306
set_robot_commands_median	0.0020743707887923004
set_robot_commands_min	0.002022399293615463
sim_compute_performance-ego0_max	0.001924733554615694
sim_compute_performance-ego0_mean	0.0018655777849215251
sim_compute_performance-ego0_median	0.0018631830079015
sim_compute_performance-ego0_min	0.0018112115692674067
sim_compute_sim_state_max	0.01354685896321347
sim_compute_sim_state_mean	0.00930414328241694
sim_compute_sim_state_median	0.008883738219365011
sim_compute_sim_state_min	0.005902237727724273
sim_render-ego0_max	0.0037491545957677504
sim_render-ego0_mean	0.003624215639797181
sim_render-ego0_median	0.0036129958111808576
sim_render-ego0_min	0.0035217163410592588
simulation-passed	1
step_physics_max	0.19194387548110065
step_physics_mean	0.13464205615039743
step_physics_median	0.12071136205932372
step_physics_min	0.10520162500184158
survival_time_max	14.45000000000007
survival_time_mean	10.42500000000003
survival_time_min	4.199999999999993

No reset possible

56779

11427

Frank (Chude) Qian 🇨🇦

template-pytorch

LFVmultibodyv-sim

success

yes

2020-12-03 07:27:36+00:00

2020-12-03 09:43:35+00:00

2:15:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9754652402117122
survival_time_median	59.99999999999873
deviation-center-line_median	1.316916438808612
in-drivable-lane_median	37.47499999999928

other stats

agent_compute-ego0_max	0.01256607672654024
agent_compute-ego0_mean	0.01212185682943577
agent_compute-ego0_median	0.012106106938370855
agent_compute-ego0_min	0.011719249865097568
agent_compute-ego1_max	0.012186386106810304
agent_compute-ego1_mean	0.011637446400213714
agent_compute-ego1_median	0.011429081352227534
agent_compute-ego1_min	0.01130568733024756
agent_compute-ego2_max	0.01254566067164387
agent_compute-ego2_mean	0.012097108903408977
agent_compute-ego2_median	0.012364589006676464
agent_compute-ego2_min	0.0113810770319066
agent_compute-ego3_max	0.011745798696983268
agent_compute-ego3_mean	0.011475628096627886
agent_compute-ego3_median	0.011502060862405414
agent_compute-ego3_min	0.011179024730494973
complete-iteration_max	1.3297614654236094
complete-iteration_mean	1.1143648297434772
complete-iteration_median	1.2731762803861442
complete-iteration_min	0.40109446761411593
deviation-center-line_max	2.183496159508223
deviation-center-line_mean	1.305538988637906
deviation-center-line_min	0.05360247763801091
deviation-heading_max	23.689898144492304
deviation-heading_mean	14.88926168149314
deviation-heading_median	16.78782017471315
deviation-heading_min	0.7560411537985214
driven_any_max	9.058913516376691
driven_any_mean	5.388662156388226
driven_any_median	4.800851657391478
driven_any_min	0.16389578063048768
driven_lanedir_consec_max	2.366404918456605
driven_lanedir_consec_mean	1.0282713941495154
driven_lanedir_consec_min	0.08761852645256063
driven_lanedir_max	2.366404918456605
driven_lanedir_mean	1.0946092214108198
driven_lanedir_median	1.0299884650351068
driven_lanedir_min	0.08761852645256063
get_duckie_state_max	1.252044944540845e-06
get_duckie_state_mean	1.206839851750564e-06
get_duckie_state_median	1.246486476418577e-06
get_duckie_state_min	1.121817977104854e-06
get_robot_state_max	0.014036829128154212
get_robot_state_mean	0.012931463564422051
get_robot_state_median	0.013903685156054342
get_robot_state_min	0.006871542267557187
get_state_dump_max	0.00941679856858583
get_state_dump_mean	0.008799159343905977
get_state_dump_median	0.009224360431858545
get_state_dump_min	0.005908783826105402
get_ui_image_max	0.049055594389484286
get_ui_image_mean	0.0433542349540735
get_ui_image_median	0.04632227188542324
get_ui_image_min	0.02945109688173623
in-drivable-lane_max	58.69999999999872
in-drivable-lane_mean	40.5392857142848
in-drivable-lane_min	29.349999999999376
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.058913516376691, "get_ui_image": 0.04163640762348159, "step_physics": 0.9237962706102916, "survival_time": 59.99999999999873, "driven_lanedir": 2.366404918456605, "get_state_dump": 0.009201506790173838, "get_robot_state": 0.013883837057490037, "sim_render-ego0": 0.003635640545351916, "sim_render-ego1": 0.0035739081983860088, "sim_render-ego2": 0.0035837782511206886, "sim_render-ego3": 0.0035887838501815097, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 34.149999999999245, "deviation-heading": 19.605405245794856, "agent_compute-ego0": 0.011719249865097568, "agent_compute-ego1": 0.01130568733024756, "agent_compute-ego2": 0.0113810770319066, "agent_compute-ego3": 0.011179024730494973, "complete-iteration": 1.0967919244853583, "set_robot_commands": 0.0021661993466646446, "deviation-center-line": 2.126588615763215, "driven_lanedir_consec": 2.366404918456605, "sim_compute_sim_state": 0.032090457055491274, "sim_compute_performance-ego0": 0.0018965671898224868, "sim_compute_performance-ego1": 0.0018549273155015471, "sim_compute_performance-ego2": 0.0018502669370144631, "sim_compute_performance-ego3": 0.0018595861058548825}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.076096726492469, "get_ui_image": 0.04163640762348159, "step_physics": 0.9237962706102916, "survival_time": 59.99999999999873, "driven_lanedir": 1.026192024928517, "get_state_dump": 0.009201506790173838, "get_robot_state": 0.013883837057490037, "sim_render-ego0": 0.003635640545351916, "sim_render-ego1": 0.0035739081983860088, "sim_render-ego2": 0.0035837782511206886, "sim_render-ego3": 0.0035887838501815097, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 30.099999999999355, "deviation-heading": 23.42797331821297, "agent_compute-ego0": 0.011719249865097568, "agent_compute-ego1": 0.01130568733024756, "agent_compute-ego2": 0.0113810770319066, "agent_compute-ego3": 0.011179024730494973, "complete-iteration": 1.0967919244853583, "set_robot_commands": 0.0021661993466646446, "deviation-center-line": 1.4626064639613396, "driven_lanedir_consec": 1.026192024928517, "sim_compute_sim_state": 0.032090457055491274, "sim_compute_performance-ego0": 0.0018965671898224868, "sim_compute_performance-ego1": 0.0018549273155015471, "sim_compute_performance-ego2": 0.0018502669370144631, "sim_compute_performance-ego3": 0.0018595861058548825}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.131349210683588, "get_ui_image": 0.04163640762348159, "step_physics": 0.9237962706102916, "survival_time": 59.99999999999873, "driven_lanedir": 2.269258765634657, "get_state_dump": 0.009201506790173838, "get_robot_state": 0.013883837057490037, "sim_render-ego0": 0.003635640545351916, "sim_render-ego1": 0.0035739081983860088, "sim_render-ego2": 0.0035837782511206886, "sim_render-ego3": 0.0035887838501815097, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 34.14999999999915, "deviation-heading": 20.105500675733623, "agent_compute-ego0": 0.011719249865097568, "agent_compute-ego1": 0.01130568733024756, "agent_compute-ego2": 0.0113810770319066, "agent_compute-ego3": 0.011179024730494973, "complete-iteration": 1.0967919244853583, "set_robot_commands": 0.0021661993466646446, "deviation-center-line": 2.183496159508223, "driven_lanedir_consec": 1.4548775036208748, "sim_compute_sim_state": 0.032090457055491274, "sim_compute_performance-ego0": 0.0018965671898224868, "sim_compute_performance-ego1": 0.0018549273155015471, "sim_compute_performance-ego2": 0.0018502669370144631, "sim_compute_performance-ego3": 0.0018595861058548825}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 4.73421752253256, "get_ui_image": 0.04163640762348159, "step_physics": 0.9237962706102916, "survival_time": 59.99999999999873, "driven_lanedir": 1.4845629318948892, "get_state_dump": 0.009201506790173838, "get_robot_state": 0.013883837057490037, "sim_render-ego0": 0.003635640545351916, "sim_render-ego1": 0.0035739081983860088, "sim_render-ego2": 0.0035837782511206886, "sim_render-ego3": 0.0035887838501815097, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 29.349999999999376, "deviation-heading": 23.689898144492304, "agent_compute-ego0": 0.011719249865097568, "agent_compute-ego1": 0.01130568733024756, "agent_compute-ego2": 0.0113810770319066, "agent_compute-ego3": 0.011179024730494973, "complete-iteration": 1.0967919244853583, "set_robot_commands": 0.0021661993466646446, "deviation-center-line": 1.171226413655884, "driven_lanedir_consec": 1.4845629318948892, "sim_compute_sim_state": 0.032090457055491274, "sim_compute_performance-ego0": 0.0018965671898224868, "sim_compute_performance-ego1": 0.0018549273155015471, "sim_compute_performance-ego2": 0.0018502669370144631, "sim_compute_performance-ego3": 0.0018595861058548825}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 8.338248145928155, "get_ui_image": 0.049055594389484286, "step_physics": 1.1304889412148609, "survival_time": 59.99999999999873, "driven_lanedir": 1.4126972040667884, "get_state_dump": 0.009224360431858545, "get_robot_state": 0.013903685156054342, "sim_render-ego0": 0.003689694265640348, "sim_render-ego1": 0.003569235511862368, "sim_render-ego2": 0.003580439795463111, "sim_render-ego3": 0.0035539735465323695, "get_duckie_state": 1.246486476418577e-06, "in-drivable-lane": 44.149999999998656, "deviation-heading": 12.09723861055887, "agent_compute-ego0": 0.01256607672654024, "agent_compute-ego1": 0.012186386106810304, "agent_compute-ego2": 0.012364589006676464, "agent_compute-ego3": 0.011745798696983268, "complete-iteration": 1.3297614654236094, "set_robot_commands": 0.0021354772963194327, "deviation-center-line": 1.009847811562925, "driven_lanedir_consec": 1.4126972040667884, "sim_compute_sim_state": 0.04769116039577869, "sim_compute_performance-ego0": 0.001904460810106263, "sim_compute_performance-ego1": 0.001845271660823012, "sim_compute_performance-ego2": 0.0018535557634923776, "sim_compute_performance-ego3": 0.0018444363024709227}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 2.1887522122887435, "get_ui_image": 0.049055594389484286, "step_physics": 1.1304889412148609, "survival_time": 59.99999999999873, "driven_lanedir": 0.6821449671605673, "get_state_dump": 0.009224360431858545, "get_robot_state": 0.013903685156054342, "sim_render-ego0": 0.003689694265640348, "sim_render-ego1": 0.003569235511862368, "sim_render-ego2": 0.003580439795463111, "sim_render-ego3": 0.0035539735465323695, "get_duckie_state": 1.246486476418577e-06, "in-drivable-lane": 37.09999999999894, "deviation-heading": 17.494955319021845, "agent_compute-ego0": 0.01256607672654024, "agent_compute-ego1": 0.012186386106810304, "agent_compute-ego2": 0.012364589006676464, "agent_compute-ego3": 0.011745798696983268, "complete-iteration": 1.3297614654236094, "set_robot_commands": 0.0021354772963194327, "deviation-center-line": 1.1134949234261202, "driven_lanedir_consec": 0.6821449671605673, "sim_compute_sim_state": 0.04769116039577869, "sim_compute_performance-ego0": 0.001904460810106263, "sim_compute_performance-ego1": 0.001845271660823012, "sim_compute_performance-ego2": 0.0018535557634923776, "sim_compute_performance-ego3": 0.0018444363024709227}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 7.53631813482309, "get_ui_image": 0.049055594389484286, "step_physics": 1.1304889412148609, "survival_time": 59.99999999999873, "driven_lanedir": 0.7728980627631876, "get_state_dump": 0.009224360431858545, "get_robot_state": 0.013903685156054342, "sim_render-ego0": 0.003689694265640348, "sim_render-ego1": 0.003569235511862368, "sim_render-ego2": 0.003580439795463111, "sim_render-ego3": 0.0035539735465323695, "get_duckie_state": 1.246486476418577e-06, "in-drivable-lane": 50.54999999999912, "deviation-heading": 6.909867847635114, "agent_compute-ego0": 0.01256607672654024, "agent_compute-ego1": 0.012186386106810304, "agent_compute-ego2": 0.012364589006676464, "agent_compute-ego3": 0.011745798696983268, "complete-iteration": 1.3297614654236094, "set_robot_commands": 0.0021354772963194327, "deviation-center-line": 0.6987506221277281, "driven_lanedir_consec": 0.7728980627631876, "sim_compute_sim_state": 0.04769116039577869, "sim_compute_performance-ego0": 0.001904460810106263, "sim_compute_performance-ego1": 0.001845271660823012, "sim_compute_performance-ego2": 0.0018535557634923776, "sim_compute_performance-ego3": 0.0018444363024709227}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 4.867485792250397, "get_ui_image": 0.049055594389484286, "step_physics": 1.1304889412148609, "survival_time": 59.99999999999873, "driven_lanedir": 1.227594739939163, "get_state_dump": 0.009224360431858545, "get_robot_state": 0.013903685156054342, "sim_render-ego0": 0.003689694265640348, "sim_render-ego1": 0.003569235511862368, "sim_render-ego2": 0.003580439795463111, "sim_render-ego3": 0.0035539735465323695, "get_duckie_state": 1.246486476418577e-06, "in-drivable-lane": 37.84999999999961, "deviation-heading": 15.957473117412226, "agent_compute-ego0": 0.01256607672654024, "agent_compute-ego1": 0.012186386106810304, "agent_compute-ego2": 0.012364589006676464, "agent_compute-ego3": 0.011745798696983268, "complete-iteration": 1.3297614654236094, "set_robot_commands": 0.0021354772963194327, "deviation-center-line": 1.911706599509336, "driven_lanedir_consec": 1.227594739939163, "sim_compute_sim_state": 0.04769116039577869, "sim_compute_performance-ego0": 0.001904460810106263, "sim_compute_performance-ego1": 0.001845271660823012, "sim_compute_performance-ego2": 0.0018535557634923776, "sim_compute_performance-ego3": 0.0018444363024709227}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 8.032946667251625, "get_ui_image": 0.04632227188542324, "step_physics": 1.0914710419660405, "survival_time": 59.99999999999873, "driven_lanedir": 0.293378997726907, "get_state_dump": 0.00941679856858583, "get_robot_state": 0.014036829128154212, "sim_render-ego0": 0.003717655742495979, "sim_render-ego1": 0.0036056817917899226, "sim_render-ego2": 0.003803314515494189, "sim_render-ego3": 0.003642865958360709, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 56.649999999998734, "deviation-heading": 2.2120554028022745, "agent_compute-ego0": 0.012106106938370855, "agent_compute-ego1": 0.011429081352227534, "agent_compute-ego2": 0.01254566067164387, "agent_compute-ego3": 0.011502060862405414, "complete-iteration": 1.2731762803861442, "set_robot_commands": 0.002140670096645943, "deviation-center-line": 0.2948228640601014, "driven_lanedir_consec": 0.293378997726907, "sim_compute_sim_state": 0.0331068606698245, "sim_compute_performance-ego0": 0.0019376857592402449, "sim_compute_performance-ego1": 0.0018966140397680888, "sim_compute_performance-ego2": 0.0018683591552022892, "sim_compute_performance-ego3": 0.0019572146429209587}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.3400570009519033, "get_ui_image": 0.04632227188542324, "step_physics": 1.0914710419660405, "survival_time": 59.99999999999873, "driven_lanedir": 1.0337849051416967, "get_state_dump": 0.00941679856858583, "get_robot_state": 0.014036829128154212, "sim_render-ego0": 0.003717655742495979, "sim_render-ego1": 0.0036056817917899226, "sim_render-ego2": 0.003803314515494189, "sim_render-ego3": 0.003642865958360709, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 33.54999999999948, "deviation-heading": 20.571905065944097, "agent_compute-ego0": 0.012106106938370855, "agent_compute-ego1": 0.011429081352227534, "agent_compute-ego2": 0.01254566067164387, "agent_compute-ego3": 0.011502060862405414, "complete-iteration": 1.2731762803861442, "set_robot_commands": 0.002140670096645943, "deviation-center-line": 1.676975114879716, "driven_lanedir_consec": 0.9247384554949074, "sim_compute_sim_state": 0.0331068606698245, "sim_compute_performance-ego0": 0.0019376857592402449, "sim_compute_performance-ego1": 0.0018966140397680888, "sim_compute_performance-ego2": 0.0018683591552022892, "sim_compute_performance-ego3": 0.0019572146429209587}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.16389578063048768, "get_ui_image": 0.04632227188542324, "step_physics": 1.0914710419660405, "survival_time": 59.99999999999873, "driven_lanedir": 0.08761852645256063, "get_state_dump": 0.00941679856858583, "get_robot_state": 0.014036829128154212, "sim_render-ego0": 0.003717655742495979, "sim_render-ego1": 0.0036056817917899226, "sim_render-ego2": 0.003803314515494189, "sim_render-ego3": 0.003642865958360709, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 58.69999999999872, "deviation-heading": 0.7560411537985214, "agent_compute-ego0": 0.012106106938370855, "agent_compute-ego1": 0.011429081352227534, "agent_compute-ego2": 0.01254566067164387, "agent_compute-ego3": 0.011502060862405414, "complete-iteration": 1.2731762803861442, "set_robot_commands": 0.002140670096645943, "deviation-center-line": 0.05360247763801091, "driven_lanedir_consec": 0.08761852645256063, "sim_compute_sim_state": 0.0331068606698245, "sim_compute_performance-ego0": 0.0019376857592402449, "sim_compute_performance-ego1": 0.0018966140397680888, "sim_compute_performance-ego2": 0.0018683591552022892, "sim_compute_performance-ego3": 0.0019572146429209587}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 4.6705179901034235, "get_ui_image": 0.04632227188542324, "step_physics": 1.0914710419660405, "survival_time": 59.99999999999873, "driven_lanedir": 0.9028134867527084, "get_state_dump": 0.00941679856858583, "get_robot_state": 0.014036829128154212, "sim_render-ego0": 0.003717655742495979, "sim_render-ego1": 0.0036056817917899226, "sim_render-ego2": 0.003803314515494189, "sim_render-ego3": 0.003642865958360709, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 39.99999999999878, "deviation-heading": 16.080685030404457, "agent_compute-ego0": 0.012106106938370855, "agent_compute-ego1": 0.011429081352227534, "agent_compute-ego2": 0.01254566067164387, "agent_compute-ego3": 0.011502060862405414, "complete-iteration": 1.2731762803861442, "set_robot_commands": 0.002140670096645943, "deviation-center-line": 1.5365504559121754, "driven_lanedir_consec": 0.8975116167550192, "sim_compute_sim_state": 0.0331068606698245, "sim_compute_performance-ego0": 0.0019376857592402449, "sim_compute_performance-ego1": 0.0018966140397680888, "sim_compute_performance-ego2": 0.0018683591552022892, "sim_compute_performance-ego3": 0.0019572146429209587}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 8.338950808667375, "get_ui_image": 0.02945109688173623, "step_physics": 0.31010763154835824, "survival_time": 59.99999999999873, "driven_lanedir": 0.6430309375646427, "get_state_dump": 0.005908783826105402, "get_robot_state": 0.006871542267557187, "sim_render-ego0": 0.003598141928298785, "sim_render-ego1": 0.003556801218672854, "get_duckie_state": 1.121817977104854e-06, "in-drivable-lane": 51.69999999999868, "deviation-heading": 6.013020668647681, "agent_compute-ego0": 0.01207013074603307, "agent_compute-ego1": 0.01161981522292519, "complete-iteration": 0.40109446761411593, "set_robot_commands": 0.002102086784242095, "deviation-center-line": 0.8571133453966416, "driven_lanedir_consec": 0.6430309375646427, "sim_compute_sim_state": 0.009914772397374035, "sim_compute_performance-ego0": 0.0018475152967772216, "sim_compute_performance-ego1": 0.0018390304937052984}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.963520680454658, "get_ui_image": 0.02945109688173623, "step_physics": 0.31010763154835824, "survival_time": 59.99999999999873, "driven_lanedir": 1.1221486312685856, "get_state_dump": 0.005908783826105402, "get_robot_state": 0.006871542267557187, "sim_render-ego0": 0.003598141928298785, "sim_render-ego1": 0.003556801218672854, "get_duckie_state": 1.121817977104854e-06, "in-drivable-lane": 29.549999999999375, "deviation-heading": 23.527643940445117, "agent_compute-ego0": 0.01207013074603307, "agent_compute-ego1": 0.01161981522292519, "complete-iteration": 0.40109446761411593, "set_robot_commands": 0.002102086784242095, "deviation-center-line": 2.18076397352927, "driven_lanedir_consec": 1.1221486312685856, "sim_compute_sim_state": 0.009914772397374035, "sim_compute_performance-ego0": 0.0018475152967772216, "sim_compute_performance-ego1": 0.0018390304937052984}}
set_robot_commands_max	0.0021661993466646446
set_robot_commands_mean	0.0021409686090717336
set_robot_commands_median	0.002140670096645943
set_robot_commands_min	0.002102086784242095
sim_compute_performance-ego0_max	0.0019376857592402449
sim_compute_performance-ego0_mean	0.0019035632593021729
sim_compute_performance-ego0_median	0.001904460810106263
sim_compute_performance-ego0_min	0.0018475152967772216
sim_compute_performance-ego1_max	0.0018966140397680888
sim_compute_performance-ego1_mean	0.001861808075127228
sim_compute_performance-ego1_median	0.0018549273155015471
sim_compute_performance-ego1_min	0.0018390304937052984
sim_compute_performance-ego2_max	0.0018683591552022892
sim_compute_performance-ego2_mean	0.001857393951903043
sim_compute_performance-ego2_median	0.0018535557634923776
sim_compute_performance-ego2_min	0.0018502669370144631
sim_compute_performance-ego3_max	0.0019572146429209587
sim_compute_performance-ego3_mean	0.0018870790170822545
sim_compute_performance-ego3_median	0.0018595861058548825
sim_compute_performance-ego3_min	0.0018444363024709227
sim_compute_sim_state_max	0.04769116039577869
sim_compute_sim_state_mean	0.033670246948508994
sim_compute_sim_state_median	0.0331068606698245
sim_compute_sim_state_min	0.009914772397374035
sim_render-ego0_max	0.003717655742495979
sim_render-ego0_mean	0.003669160433610754
sim_render-ego0_median	0.003689694265640348
sim_render-ego0_min	0.003598141928298785
sim_render-ego1_max	0.0036056817917899226
sim_render-ego1_mean	0.00357920746039278
sim_render-ego1_median	0.0035739081983860088
sim_render-ego1_min	0.003556801218672854
sim_render-ego2_max	0.003803314515494189
sim_render-ego2_mean	0.00365584418735933
sim_render-ego2_median	0.0035837782511206886
sim_render-ego2_min	0.003580439795463111
sim_render-ego3_max	0.003642865958360709
sim_render-ego3_mean	0.003595207785024862
sim_render-ego3_median	0.0035887838501815097
sim_render-ego3_min	0.0035539735465323695
simulation-passed	1
step_physics_max	1.1304889412148609
step_physics_mean	0.9430885913043918
step_physics_median	1.0914710419660405
step_physics_min	0.31010763154835824
survival_time_max	59.99999999999873
survival_time_mean	59.999999999998735
survival_time_min	59.99999999999873

No reset possible

56672

11296

template-pytorch

LFv-sim

success

yes

2020-12-03 07:08:16+00:00

2020-12-03 07:25:15+00:00

0:16:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8779337187985691
survival_time_median	34.62499999999936
deviation-center-line_median	0.9800802267715676
in-drivable-lane_median	15.574999999999848

other stats

agent_compute-ego0_max	0.023110977438993232
agent_compute-ego0_mean	0.017864287171317127
agent_compute-ego0_median	0.017654279871543554
agent_compute-ego0_min	0.01303761150318816
complete-iteration_max	0.21776833922363992
complete-iteration_mean	0.17298941125245754
complete-iteration_median	0.16453988035170913
complete-iteration_min	0.14510954508277202
deviation-center-line_max	1.9869934444879211
deviation-center-line_mean	1.023742671743901
deviation-center-line_min	0.14781678894454983
deviation-heading_max	14.759513419978669
deviation-heading_mean	7.466810586943082
deviation-heading_median	6.927968946344067
deviation-heading_min	1.251791035105524
driven_any_max	5.380186230041713
driven_any_mean	2.89130944045137
driven_any_median	2.9455802338433585
driven_any_min	0.2938910640770515
driven_lanedir_consec_max	2.7307586193716245
driven_lanedir_consec_mean	1.1518953653750592
driven_lanedir_consec_min	0.12095540453147446
driven_lanedir_max	2.7307586193716245
driven_lanedir_mean	1.1518953653750592
driven_lanedir_median	0.8779337187985691
driven_lanedir_min	0.12095540453147446
get_duckie_state_max	1.1227851690248002e-06
get_duckie_state_mean	1.0717309840826124e-06
get_duckie_state_median	1.0590866940106878e-06
get_duckie_state_min	1.045965379284274e-06
get_robot_state_max	0.00349935524469609
get_robot_state_mean	0.003491756417966752
get_robot_state_median	0.003492269529748881
get_robot_state_min	0.003483131367673156
get_state_dump_max	0.004386421172849594
get_state_dump_mean	0.004324194199959534
get_state_dump_median	0.004313833057779989
get_state_dump_min	0.004282689511428566
get_ui_image_max	0.03492866837701132
get_ui_image_mean	0.029827776863337735
get_ui_image_median	0.02964713092042095
get_ui_image_min	0.02508817723549772
in-drivable-lane_max	35.19999999999925
in-drivable-lane_mean	17.062499999999734
in-drivable-lane_min	1.8999999999999932
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.1514931041801, "get_ui_image": 0.02758374738256501, "step_physics": 0.08640180023187007, "survival_time": 59.99999999999873, "driven_lanedir": 1.5265459592520825, "get_state_dump": 0.004282689511428566, "get_robot_state": 0.00349935524469609, "sim_render-ego0": 0.003640141316397204, "get_duckie_state": 1.046580140735585e-06, "in-drivable-lane": 35.19999999999925, "deviation-heading": 14.759513419978669, "agent_compute-ego0": 0.01303761150318816, "complete-iteration": 0.15048904641284036, "set_robot_commands": 0.0020822087096532714, "deviation-center-line": 1.9869934444879211, "driven_lanedir_consec": 1.5265459592520825, "sim_compute_sim_state": 0.008039972565751787, "sim_compute_performance-ego0": 0.001849476641957508}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2938910640770515, "get_ui_image": 0.03492866837701132, "step_physics": 0.13444727797840916, "survival_time": 4.249999999999993, "driven_lanedir": 0.12095540453147446, "get_state_dump": 0.00433369847231133, "get_robot_state": 0.0034885073817053506, "sim_render-ego0": 0.0036218803982402, "get_duckie_state": 1.1227851690248002e-06, "in-drivable-lane": 1.8999999999999932, "deviation-heading": 1.704324864244302, "agent_compute-ego0": 0.023110977438993232, "complete-iteration": 0.21776833922363992, "set_robot_commands": 0.0020987793456676393, "deviation-center-line": 0.14781678894454983, "driven_lanedir_consec": 0.12095540453147446, "sim_compute_sim_state": 0.009828905726588047, "sim_compute_performance-ego0": 0.0018361557361691496}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.7396673635066165, "get_ui_image": 0.03171051445827689, "step_physics": 0.10841341557041292, "survival_time": 9.249999999999996, "driven_lanedir": 0.2293214783450559, "get_state_dump": 0.004386421172849594, "get_robot_state": 0.003483131367673156, "sim_render-ego0": 0.003654828635595178, "get_duckie_state": 1.045965379284274e-06, "in-drivable-lane": 5.800000000000001, "deviation-heading": 1.251791035105524, "agent_compute-ego0": 0.01426971343255812, "complete-iteration": 0.17859071429057788, "set_robot_commands": 0.002069692457875898, "deviation-center-line": 0.238892904910579, "driven_lanedir_consec": 0.2293214783450559, "sim_compute_sim_state": 0.008700575879825059, "sim_compute_performance-ego0": 0.001830345840864284}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.380186230041713, "get_ui_image": 0.02508817723549772, "step_physics": 0.07736729841049664, "survival_time": 59.99999999999873, "driven_lanedir": 2.7307586193716245, "get_state_dump": 0.004293967643248648, "get_robot_state": 0.0034960316777924117, "sim_render-ego0": 0.0035883036382390893, "get_duckie_state": 1.0715932472857904e-06, "in-drivable-lane": 25.349999999999696, "deviation-heading": 12.151613028443832, "agent_compute-ego0": 0.021038846310528988, "complete-iteration": 0.14510954508277202, "set_robot_commands": 0.0020868629341220775, "deviation-center-line": 1.721267548632556, "driven_lanedir_consec": 2.7307586193716245, "sim_compute_sim_state": 0.006240162226083773, "sim_compute_performance-ego0": 0.0018375499560175888}}
set_robot_commands_max	0.0020987793456676393
set_robot_commands_mean	0.0020843858618297215
set_robot_commands_median	0.0020845358218876744
set_robot_commands_min	0.002069692457875898
sim_compute_performance-ego0_max	0.001849476641957508
sim_compute_performance-ego0_mean	0.0018383820437521327
sim_compute_performance-ego0_median	0.0018368528460933691
sim_compute_performance-ego0_min	0.001830345840864284
sim_compute_sim_state_max	0.009828905726588047
sim_compute_sim_state_mean	0.008202404099562167
sim_compute_sim_state_median	0.008370274222788424
sim_compute_sim_state_min	0.006240162226083773
sim_render-ego0_max	0.003654828635595178
sim_render-ego0_mean	0.003626288497117918
sim_render-ego0_median	0.003631010857318702
sim_render-ego0_min	0.0035883036382390893
simulation-passed	1
step_physics_max	0.13444727797840916
step_physics_mean	0.1016574480477972
step_physics_median	0.09740760790114147
step_physics_min	0.07736729841049664
survival_time_max	59.99999999999873
survival_time_mean	33.37499999999936
survival_time_min	4.249999999999993

No reset possible

56639

11305

template-pytorch

LFv-sim

failed

yes

2020-12-03 07:03:13+00:00

2020-12-03 07:07:29+00:00

0:04:16

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 70, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 67, in compute_action
              ||     return action.astype(float)
              || AttributeError: 'Tensor' object has no attribute 'astype'
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56595

11303

template-pytorch

LFv-sim

success

yes

2020-12-03 06:56:17+00:00

2020-12-03 07:01:55+00:00

0:05:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6721806698300066
survival_time_median	4.124999999999993
deviation-center-line_median	0.08533386991096248
in-drivable-lane_median	2.5249999999999932

other stats

agent_compute-ego0_max	0.013505258699403192
agent_compute-ego0_mean	0.013088537493532058
agent_compute-ego0_median	0.013204581745760958
agent_compute-ego0_min	0.012439727783203123
complete-iteration_max	0.1946571594790409
complete-iteration_mean	0.1718983572552889
complete-iteration_median	0.17268436205603535
complete-iteration_min	0.1475675454300441
deviation-center-line_max	0.19040734971183468
deviation-center-line_mean	0.10399419144485748
deviation-center-line_min	0.05490167624567018
deviation-heading_max	0.9553793536329298
deviation-heading_mean	0.5724429689420691
deviation-heading_median	0.5280329234303824
deviation-heading_min	0.27832667527458166
driven_any_max	2.943946079877587
driven_any_mean	1.8067027501792303
driven_any_median	1.494733112279917
driven_any_min	1.2933986962795003
driven_lanedir_consec_max	0.7206656660168335
driven_lanedir_consec_mean	0.6053427946939491
driven_lanedir_consec_min	0.35634417309895006
driven_lanedir_max	0.7206656660168335
driven_lanedir_mean	0.6053427946939491
driven_lanedir_median	0.6721806698300066
driven_lanedir_min	0.35634417309895006
get_duckie_state_max	1.143186520307492e-06
get_duckie_state_mean	1.1088825462829891e-06
get_duckie_state_median	1.109294959033896e-06
get_duckie_state_min	1.073753746756672e-06
get_robot_state_max	0.003517451947622926
get_robot_state_mean	0.0034973486303900236
get_robot_state_median	0.0034913372210960006
get_robot_state_min	0.003489268131745167
get_state_dump_max	0.004328465193844913
get_state_dump_mean	0.004311443197610571
get_state_dump_median	0.0043196658304561816
get_state_dump_min	0.004277975935685008
get_ui_image_max	0.03563317813371357
get_ui_image_mean	0.030880828376916653
get_ui_image_median	0.03068589926569198
get_ui_image_min	0.026518336842569074
in-drivable-lane_max	4.899999999999988
in-drivable-lane_mean	2.999999999999992
in-drivable-lane_min	2.0499999999999936
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.943946079877587, "get_ui_image": 0.028563962365589, "step_physics": 0.09219061719240064, "survival_time": 6.799999999999984, "driven_lanedir": 0.7206656660168335, "get_state_dump": 0.004327189313234204, "get_robot_state": 0.003517451947622926, "sim_render-ego0": 0.003609989681383119, "get_duckie_state": 1.073753746756672e-06, "in-drivable-lane": 4.899999999999988, "deviation-heading": 0.722746536250069, "agent_compute-ego0": 0.013505258699403192, "complete-iteration": 0.15900172282309427, "set_robot_commands": 0.0020811522964143403, "deviation-center-line": 0.19040734971183468, "driven_lanedir_consec": 0.7206656660168335, "sim_compute_sim_state": 0.00926387745098476, "sim_compute_performance-ego0": 0.001869603665205684}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2933986962795003, "get_ui_image": 0.03563317813371357, "step_physics": 0.12195058245407908, "survival_time": 3.7499999999999942, "driven_lanedir": 0.35634417309895006, "get_state_dump": 0.004277975935685008, "get_robot_state": 0.003490720924578215, "sim_render-ego0": 0.003627921405591463, "get_duckie_state": 1.0854319522255345e-06, "in-drivable-lane": 2.3499999999999948, "deviation-heading": 0.9553793536329298, "agent_compute-ego0": 0.012439727783203123, "complete-iteration": 0.1946571594790409, "set_robot_commands": 0.002063283794804623, "deviation-center-line": 0.09726035262309105, "driven_lanedir_consec": 0.35634417309895006, "sim_compute_sim_state": 0.009251779631564492, "sim_compute_performance-ego0": 0.001847944761577405}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3362885843534753, "get_ui_image": 0.03280783616579496, "step_physics": 0.11667858331631392, "survival_time": 3.8499999999999943, "driven_lanedir": 0.6733295829200957, "get_state_dump": 0.00431214234767816, "get_robot_state": 0.003489268131745167, "sim_render-ego0": 0.00373684442960299, "get_duckie_state": 1.143186520307492e-06, "in-drivable-lane": 2.0499999999999936, "deviation-heading": 0.33331931061069575, "agent_compute-ego0": 0.013492960196274975, "complete-iteration": 0.18636700128897643, "set_robot_commands": 0.002169330914815267, "deviation-center-line": 0.05490167624567018, "driven_lanedir_consec": 0.6733295829200957, "sim_compute_sim_state": 0.007721570821908804, "sim_compute_performance-ego0": 0.00188444822262495}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.653177640206359, "get_ui_image": 0.026518336842569074, "step_physics": 0.08800459711739186, "survival_time": 4.399999999999992, "driven_lanedir": 0.6710317567399176, "get_state_dump": 0.004328465193844913, "get_robot_state": 0.003491953517613786, "sim_render-ego0": 0.003579948725325338, "get_duckie_state": 1.1331579658422577e-06, "in-drivable-lane": 2.6999999999999913, "deviation-heading": 0.27832667527458166, "agent_compute-ego0": 0.01291620329524694, "complete-iteration": 0.1475675454300441, "set_robot_commands": 0.0020516025886107027, "deviation-center-line": 0.07340738719883391, "driven_lanedir_consec": 0.6710317567399176, "sim_compute_sim_state": 0.004767099123322562, "sim_compute_performance-ego0": 0.001836546351400654}}
set_robot_commands_max	0.002169330914815267
set_robot_commands_mean	0.0020913423986612337
set_robot_commands_median	0.0020722180456094817
set_robot_commands_min	0.0020516025886107027
sim_compute_performance-ego0_max	0.00188444822262495
sim_compute_performance-ego0_mean	0.0018596357502021733
sim_compute_performance-ego0_median	0.0018587742133915448
sim_compute_performance-ego0_min	0.001836546351400654
sim_compute_sim_state_max	0.00926387745098476
sim_compute_sim_state_mean	0.007751081756945154
sim_compute_sim_state_median	0.008486675226736648
sim_compute_sim_state_min	0.004767099123322562
sim_render-ego0_max	0.00373684442960299
sim_render-ego0_mean	0.0036386760604757273
sim_render-ego0_median	0.003618955543487291
sim_render-ego0_min	0.003579948725325338
simulation-passed	1
step_physics_max	0.12195058245407908
step_physics_mean	0.10470609502004638
step_physics_median	0.10443460025435727
step_physics_min	0.08800459711739186
survival_time_max	6.799999999999984
survival_time_mean	4.69999999999999
survival_time_min	3.7499999999999942

No reset possible

56082

11311

template-pytorch

LFv-sim

timeout

yes

2020-12-03 06:13:42+00:00

2020-12-03 06:54:57+00:00

0:41:15

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

55511

11281

template-pytorch

LFv-sim

success

yes

2020-12-03 05:31:07+00:00

2020-12-03 06:13:14+00:00

0:42:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1193994534395215
survival_time_median	59.99999999999873
deviation-center-line_median	2.034216432444211
in-drivable-lane_median	29.024999999999395

other stats

agent_compute-ego0_max	0.01768257794630319
agent_compute-ego0_mean	0.013531165357235569
agent_compute-ego0_median	0.012419191228658533
agent_compute-ego0_min	0.011603701025322018
complete-iteration_max	0.22591215764156092
complete-iteration_mean	0.20288618994592927
complete-iteration_median	0.21157345396592953
complete-iteration_min	0.16248569421029707
deviation-center-line_max	2.181032103445628
deviation-center-line_mean	1.8489328826377027
deviation-center-line_min	1.1462665622167605
deviation-heading_max	24.445390836470057
deviation-heading_mean	23.265376372529545
deviation-heading_median	23.64462655401071
deviation-heading_min	21.326861545626706
driven_any_max	3.82610038870031
driven_any_mean	3.4981879205862656
driven_any_median	3.447801580133577
driven_any_min	3.2710481333776
driven_lanedir_consec_max	1.1921191987443116
driven_lanedir_consec_mean	1.0485976905920826
driven_lanedir_consec_min	0.7634726567449759
driven_lanedir_max	1.1921191987443116
driven_lanedir_mean	1.0485976905920826
driven_lanedir_median	1.1193994534395215
driven_lanedir_min	0.7634726567449759
get_duckie_state_max	1.3342308660629488e-06
get_duckie_state_mean	1.2613256011378458e-06
get_duckie_state_median	1.2579011877410916e-06
get_duckie_state_min	1.1952691630062514e-06
get_robot_state_max	0.003526830752624461
get_robot_state_mean	0.0034952828727296548
get_robot_state_median	0.0034918828768892947
get_robot_state_min	0.003470534984515569
get_state_dump_max	0.004385249997852843
get_state_dump_mean	0.004318936232424695
get_state_dump_median	0.004331491670441766
get_state_dump_min	0.004227511590962406
get_ui_image_max	0.03547086544973864
get_ui_image_mean	0.03033802119222509
get_ui_image_median	0.03030533536486979
get_ui_image_min	0.025270548589422143
in-drivable-lane_max	34.94999999999908
in-drivable-lane_mean	30.224999999999326
in-drivable-lane_min	27.899999999999448
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.82610038870031, "get_ui_image": 0.02794280655675883, "step_physics": 0.1360223872973262, "survival_time": 59.99999999999873, "driven_lanedir": 1.1921191987443116, "get_state_dump": 0.004227511590962406, "get_robot_state": 0.003526830752624461, "sim_render-ego0": 0.0035820602874374707, "get_duckie_state": 1.2153193515901463e-06, "in-drivable-lane": 27.899999999999448, "deviation-heading": 24.445390836470057, "agent_compute-ego0": 0.011603701025322018, "complete-iteration": 0.19931743226380869, "set_robot_commands": 0.002063523522026831, "deviation-center-line": 2.008234962013169, "driven_lanedir_consec": 1.1921191987443116, "sim_compute_sim_state": 0.008423410784096443, "sim_compute_performance-ego0": 0.001851661119929559}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.2710481333776, "get_ui_image": 0.03547086544973864, "step_physics": 0.1488270594813643, "survival_time": 59.99999999999873, "driven_lanedir": 0.7634726567449759, "get_state_dump": 0.004385249997852843, "get_robot_state": 0.0035007613386143057, "sim_render-ego0": 0.003629330095899393, "get_duckie_state": 1.3342308660629488e-06, "in-drivable-lane": 34.94999999999908, "deviation-heading": 21.326861545626706, "agent_compute-ego0": 0.01252823924144837, "complete-iteration": 0.22382947566805036, "set_robot_commands": 0.0020848561286132203, "deviation-center-line": 2.0601979028752533, "driven_lanedir_consec": 0.7634726567449759, "sim_compute_sim_state": 0.011444220435708688, "sim_compute_performance-ego0": 0.001875176417837532}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.401199294867421, "get_ui_image": 0.032667864172980746, "step_physics": 0.15091902528773934, "survival_time": 59.99999999999873, "driven_lanedir": 1.0572956486949725, "get_state_dump": 0.004370859917951166, "get_robot_state": 0.0034830044151642836, "sim_render-ego0": 0.003728389342956797, "get_duckie_state": 1.3004830238920369e-06, "in-drivable-lane": 29.799999999999383, "deviation-heading": 22.95586289786761, "agent_compute-ego0": 0.01768257794630319, "complete-iteration": 0.22591215764156092, "set_robot_commands": 0.002189494092498195, "deviation-center-line": 1.1462665622167605, "driven_lanedir_consec": 1.0572956486949725, "sim_compute_sim_state": 0.008867121060424601, "sim_compute_performance-ego0": 0.0019259895512106816}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.4944038653997325, "get_ui_image": 0.025270548589422143, "step_physics": 0.1036860748294192, "survival_time": 59.99999999999873, "driven_lanedir": 1.181503258184071, "get_state_dump": 0.004292123422932366, "get_robot_state": 0.003470534984515569, "sim_render-ego0": 0.0035710430065856984, "get_duckie_state": 1.1952691630062514e-06, "in-drivable-lane": 28.249999999999403, "deviation-heading": 24.33339021015381, "agent_compute-ego0": 0.012310143215868694, "complete-iteration": 0.16248569421029707, "set_robot_commands": 0.0020414131269367608, "deviation-center-line": 2.181032103445628, "driven_lanedir_consec": 1.181503258184071, "sim_compute_sim_state": 0.005934125676341696, "sim_compute_performance-ego0": 0.001835478235541732}}
set_robot_commands_max	0.002189494092498195
set_robot_commands_mean	0.0020948217175187516
set_robot_commands_median	0.0020741898253200256
set_robot_commands_min	0.0020414131269367608
sim_compute_performance-ego0_max	0.0019259895512106816
sim_compute_performance-ego0_mean	0.001872076331129876
sim_compute_performance-ego0_median	0.0018634187688835455
sim_compute_performance-ego0_min	0.001835478235541732
sim_compute_sim_state_max	0.011444220435708688
sim_compute_sim_state_mean	0.008667219489142857
sim_compute_sim_state_median	0.008645265922260522
sim_compute_sim_state_min	0.005934125676341696
sim_render-ego0_max	0.003728389342956797
sim_render-ego0_mean	0.00362770568321984
sim_render-ego0_median	0.003605695191668432
sim_render-ego0_min	0.0035710430065856984
simulation-passed	1
step_physics_max	0.15091902528773934
step_physics_mean	0.13486363672396226
step_physics_median	0.14242472338934525
step_physics_min	0.1036860748294192
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

55391

11424

Frank (Chude) Qian 🇨🇦

template-pytorch

LFv-sim

success

yes

2020-12-03 05:24:26+00:00

2020-12-03 05:30:49+00:00

0:06:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24359104460306708
survival_time_median	4.449999999999992
deviation-center-line_median	0.14342124965936645
in-drivable-lane_median	2.4749999999999925

other stats

agent_compute-ego0_max	0.012898497581481934
agent_compute-ego0_mean	0.012419517980836185
agent_compute-ego0_median	0.012359873281449689
agent_compute-ego0_min	0.012059827778963434
complete-iteration_max	0.25116515159606934
complete-iteration_mean	0.21505355245114977
complete-iteration_median	0.21900051772594453
complete-iteration_min	0.17104802275664055
deviation-center-line_max	0.22526095737553323
deviation-center-line_mean	0.14697388732952063
deviation-center-line_min	0.07579209262381638
deviation-heading_max	2.888344078957074
deviation-heading_mean	1.3180399700225989
deviation-heading_median	0.925725814695316
deviation-heading_min	0.5323641717426887
driven_any_max	3.2010970607685354
driven_any_mean	1.2745090346221537
driven_any_median	0.7901193168979819
driven_any_min	0.3167004439241154
driven_lanedir_consec_max	0.41894430214509937
driven_lanedir_consec_mean	0.26621488711376595
driven_lanedir_consec_min	0.15873315710383018
driven_lanedir_max	0.41894430214509937
driven_lanedir_mean	0.26621488711376595
driven_lanedir_median	0.24359104460306708
driven_lanedir_min	0.15873315710383018
get_duckie_state_max	1.152889840554871e-06
get_duckie_state_mean	1.1050128851863005e-06
get_duckie_state_median	1.099523232907665e-06
get_duckie_state_min	1.068115234375e-06
get_robot_state_max	0.0035508418083190917
get_robot_state_mean	0.003506983515457362
get_robot_state_median	0.003504357501964441
get_robot_state_min	0.003468377249581473
get_state_dump_max	0.004335301262991769
get_state_dump_mean	0.004314169889871363
get_state_dump_median	0.004312725365161895
get_state_dump_min	0.004295927566169892
get_ui_image_max	0.03532813033279108
get_ui_image_mean	0.030228944963550684
get_ui_image_median	0.030217827558517457
get_ui_image_min	0.025151994404376755
in-drivable-lane_max	11.650000000000064
in-drivable-lane_mean	4.450000000000012
in-drivable-lane_min	1.199999999999999
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 0.9271690365602906, "get_ui_image": 0.027856197357177735, "step_physics": 0.13544760942459105, "survival_time": 4.94999999999999, "driven_lanedir": 0.41894430214509937, "get_state_dump": 0.0043038129806518555, "get_robot_state": 0.0035508418083190917, "sim_render-ego0": 0.003955667018890381, "get_duckie_state": 1.068115234375e-06, "in-drivable-lane": 2.4499999999999913, "deviation-heading": 1.1103012446271, "agent_compute-ego0": 0.012898497581481934, "complete-iteration": 0.2001730608940125, "set_robot_commands": 0.002403559684753418, "deviation-center-line": 0.19626416558443, "driven_lanedir_consec": 0.41894430214509937, "sim_compute_sim_state": 0.007631919384002686, "sim_compute_performance-ego0": 0.002044329643249512}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3167004439241154, "get_ui_image": 0.03532813033279108, "step_physics": 0.17920950967438368, "survival_time": 2.3999999999999995, "driven_lanedir": 0.15873315710383018, "get_state_dump": 0.004335301262991769, "get_robot_state": 0.003468377249581473, "sim_render-ego0": 0.0036264584988963846, "get_duckie_state": 1.1142419309032206e-06, "in-drivable-lane": 1.199999999999999, "deviation-heading": 0.7411503847635318, "agent_compute-ego0": 0.012420050951899317, "complete-iteration": 0.25116515159606934, "set_robot_commands": 0.0020604571517632933, "deviation-center-line": 0.07579209262381638, "driven_lanedir_consec": 0.15873315710383018, "sim_compute_sim_state": 0.008776805838760065, "sim_compute_performance-ego0": 0.001859494618007115}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.6530695972356733, "get_ui_image": 0.032579457759857176, "step_physics": 0.16934141218662263, "survival_time": 3.949999999999994, "driven_lanedir": 0.1989493713389645, "get_state_dump": 0.004321637749671936, "get_robot_state": 0.003493243455886841, "sim_render-ego0": 0.003650164604187011, "get_duckie_state": 1.0848045349121091e-06, "in-drivable-lane": 2.4999999999999933, "deviation-heading": 0.5323641717426887, "agent_compute-ego0": 0.01229969561100006, "complete-iteration": 0.23782797455787655, "set_robot_commands": 0.0020700186491012574, "deviation-center-line": 0.0905783337343029, "driven_lanedir_consec": 0.1989493713389645, "sim_compute_sim_state": 0.008143088221549988, "sim_compute_performance-ego0": 0.0018517255783081056}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.2010970607685354, "get_ui_image": 0.025151994404376755, "step_physics": 0.1117810930981732, "survival_time": 14.850000000000076, "driven_lanedir": 0.28823271786716964, "get_state_dump": 0.004295927566169892, "get_robot_state": 0.0035154715480420415, "sim_render-ego0": 0.003689205886533596, "get_duckie_state": 1.152889840554871e-06, "in-drivable-lane": 11.650000000000064, "deviation-heading": 2.888344078957074, "agent_compute-ego0": 0.012059827778963434, "complete-iteration": 0.17104802275664055, "set_robot_commands": 0.0021820588399899888, "deviation-center-line": 0.22526095737553323, "driven_lanedir_consec": 0.28823271786716964, "sim_compute_sim_state": 0.006390024351593632, "sim_compute_performance-ego0": 0.0019007049150914952}}
set_robot_commands_max	0.002403559684753418
set_robot_commands_mean	0.0021790235814019895
set_robot_commands_median	0.0021260387445456233
set_robot_commands_min	0.0020604571517632933
sim_compute_performance-ego0_max	0.002044329643249512
sim_compute_performance-ego0_mean	0.001914063688664057
sim_compute_performance-ego0_median	0.0018800997665493052
sim_compute_performance-ego0_min	0.0018517255783081056
sim_compute_sim_state_max	0.008776805838760065
sim_compute_sim_state_mean	0.007735459448976594
sim_compute_sim_state_median	0.007887503802776337
sim_compute_sim_state_min	0.006390024351593632
sim_render-ego0_max	0.003955667018890381
sim_render-ego0_mean	0.0037303740021268432
sim_render-ego0_median	0.003669685245360304
sim_render-ego0_min	0.0036264584988963846
simulation-passed	1
step_physics_max	0.17920950967438368
step_physics_mean	0.14894490609594263
step_physics_median	0.15239451080560684
step_physics_min	0.1117810930981732
survival_time_max	14.850000000000076
survival_time_mean	6.537500000000015
survival_time_min	2.3999999999999995

No reset possible

55233

11286

template-pytorch

LFv-sim

success

yes

2020-12-03 05:15:27+00:00

2020-12-03 05:23:37+00:00

0:08:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7248245369505859
survival_time_median	12.450000000000042
deviation-center-line_median	0.34941482345221514
in-drivable-lane_median	8.500000000000046

other stats

agent_compute-ego0_max	0.01292880052743956
agent_compute-ego0_mean	0.012476189196137783
agent_compute-ego0_median	0.012454598331682687
agent_compute-ego0_min	0.012066759593746205
complete-iteration_max	0.1595369503886689
complete-iteration_mean	0.15082219186191215
complete-iteration_median	0.15592068780300228
complete-iteration_min	0.1319104414529751
deviation-center-line_max	0.46940121651401545
deviation-center-line_mean	0.3186992949280616
deviation-center-line_min	0.1065663162938007
deviation-heading_max	4.336467346185212
deviation-heading_mean	2.0818201828799037
deviation-heading_median	1.5765003982979744
deviation-heading_min	0.8378125887384538
driven_any_max	4.960198894789485
driven_any_mean	2.9286108751051305
driven_any_median	2.6095128807802337
driven_any_min	1.5352188440705683
driven_lanedir_consec_max	0.7686881470235811
driven_lanedir_consec_mean	0.7267106605281017
driven_lanedir_consec_min	0.688505421187654
driven_lanedir_max	0.7686881470235811
driven_lanedir_mean	0.7267106605281017
driven_lanedir_median	0.7248245369505859
driven_lanedir_min	0.688505421187654
get_duckie_state_max	1.312688339588254e-06
get_duckie_state_mean	1.2634500654023583e-06
get_duckie_state_median	1.254126577737638e-06
get_duckie_state_min	1.2328587665459034e-06
get_robot_state_max	0.003573686577552973
get_robot_state_mean	0.003509550359608239
get_robot_state_median	0.003493372529804957
get_robot_state_min	0.003477769801270069
get_state_dump_max	0.004392043102619259
get_state_dump_mean	0.00429081661496004
get_state_dump_median	0.004270728337682452
get_state_dump_min	0.0042297666818559955
get_ui_image_max	0.035333443318169545
get_ui_image_mean	0.030449188957700907
get_ui_image_median	0.0301942711557893
get_ui_image_min	0.026074770201055496
in-drivable-lane_max	17.150000000000166
in-drivable-lane_mean	9.600000000000062
in-drivable-lane_min	4.249999999999996
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.5352188440705683, "get_ui_image": 0.028130906958912693, "step_physics": 0.08964967450430227, "survival_time": 8.549999999999986, "driven_lanedir": 0.7686881470235811, "get_state_dump": 0.004392043102619259, "get_robot_state": 0.003573686577552973, "sim_render-ego0": 0.003766155520150828, "get_duckie_state": 1.312688339588254e-06, "in-drivable-lane": 4.249999999999996, "deviation-heading": 1.5600003272520748, "agent_compute-ego0": 0.01292880052743956, "complete-iteration": 0.15538395144218622, "set_robot_commands": 0.00212843889413878, "deviation-center-line": 0.45825838845068784, "driven_lanedir_consec": 0.7686881470235811, "sim_compute_sim_state": 0.008802614932836489, "sim_compute_performance-ego0": 0.0019315162370371263}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.960198894789485, "get_ui_image": 0.035333443318169545, "step_physics": 0.08491389814452453, "survival_time": 22.650000000000187, "driven_lanedir": 0.7511545088821582, "get_state_dump": 0.0042297666818559955, "get_robot_state": 0.003477769801270069, "sim_render-ego0": 0.0036654624644880257, "get_duckie_state": 1.2703404027459906e-06, "in-drivable-lane": 17.150000000000166, "deviation-heading": 4.336467346185212, "agent_compute-ego0": 0.012268332132683977, "complete-iteration": 0.1595369503886689, "set_robot_commands": 0.0020299918851138213, "deviation-center-line": 0.46940121651401545, "driven_lanedir_consec": 0.7511545088821582, "sim_compute_sim_state": 0.011711194126616493, "sim_compute_performance-ego0": 0.0018276359541300636}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.222152760927856, "get_ui_image": 0.0322576353526659, "step_physics": 0.0856737671146952, "survival_time": 15.300000000000082, "driven_lanedir": 0.688505421187654, "get_state_dump": 0.004281794986041439, "get_robot_state": 0.0034989666084513215, "sim_render-ego0": 0.0037025217124615896, "get_duckie_state": 1.2379127527292851e-06, "in-drivable-lane": 11.150000000000084, "deviation-heading": 1.593000469343874, "agent_compute-ego0": 0.012640864530681398, "complete-iteration": 0.15645742416381836, "set_robot_commands": 0.0020434755455787483, "deviation-center-line": 0.2405712584537424, "driven_lanedir_consec": 0.688505421187654, "sim_compute_sim_state": 0.010428053548359328, "sim_compute_performance-ego0": 0.0018531569440512392}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.9968730006326112, "get_ui_image": 0.026074770201055496, "step_physics": 0.07347874814364577, "survival_time": 9.6, "driven_lanedir": 0.6984945650190137, "get_state_dump": 0.004259661689323465, "get_robot_state": 0.0034877784511585927, "sim_render-ego0": 0.0036077622922590976, "get_duckie_state": 1.2328587665459034e-06, "in-drivable-lane": 5.850000000000007, "deviation-heading": 0.8378125887384538, "agent_compute-ego0": 0.012066759593746205, "complete-iteration": 0.1319104414529751, "set_robot_commands": 0.002043460934890984, "deviation-center-line": 0.1065663162938007, "driven_lanedir_consec": 0.6984945650190137, "sim_compute_sim_state": 0.004979157077216113, "sim_compute_performance-ego0": 0.001833666173905289}}
set_robot_commands_max	0.00212843889413878
set_robot_commands_mean	0.0020613418149305835
set_robot_commands_median	0.0020434682402348664
set_robot_commands_min	0.0020299918851138213
sim_compute_performance-ego0_max	0.0019315162370371263
sim_compute_performance-ego0_mean	0.0018614938272809296
sim_compute_performance-ego0_median	0.001843411558978264
sim_compute_performance-ego0_min	0.0018276359541300636
sim_compute_sim_state_max	0.011711194126616493
sim_compute_sim_state_mean	0.008980254921257105
sim_compute_sim_state_median	0.00961533424059791
sim_compute_sim_state_min	0.004979157077216113
sim_render-ego0_max	0.003766155520150828
sim_render-ego0_mean	0.003685475497339885
sim_render-ego0_median	0.003683992088474807
sim_render-ego0_min	0.0036077622922590976
simulation-passed	1
step_physics_max	0.08964967450430227
step_physics_mean	0.08342902197679194
step_physics_median	0.08529383262960986
step_physics_min	0.07347874814364577
survival_time_max	22.650000000000187
survival_time_mean	14.025000000000066
survival_time_min	8.549999999999986

No reset possible

55131

11302

template-pytorch

LFv-sim

success

yes

2020-12-03 05:08:37+00:00

2020-12-03 05:14:14+00:00

0:05:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.670914908788469
survival_time_median	4.574999999999992
deviation-center-line_median	0.10290395195526128
in-drivable-lane_median	2.4249999999999954

other stats

agent_compute-ego0_max	0.014679277485067194
agent_compute-ego0_mean	0.013146710068908428
agent_compute-ego0_median	0.013176177023684638
agent_compute-ego0_min	0.011555208743197246
complete-iteration_max	0.1966631384456859
complete-iteration_mean	0.17410670916538457
complete-iteration_median	0.17923446012191271
complete-iteration_min	0.14129477797202694
deviation-center-line_max	0.25886930584394835
deviation-center-line_mean	0.13224792977628813
deviation-center-line_min	0.06431450935068168
deviation-heading_max	1.1587484298288175
deviation-heading_mean	0.6816953284469468
deviation-heading_median	0.6185708324222089
deviation-heading_min	0.3308912191145518
driven_any_max	1.6509721948001357
driven_any_mean	1.4552650289950222
driven_any_median	1.441890880256357
driven_any_min	1.286306160667239
driven_lanedir_consec_max	0.8352842926710846
driven_lanedir_consec_mean	0.6367862105620727
driven_lanedir_consec_min	0.37003073200026826
driven_lanedir_max	0.8352842926710846
driven_lanedir_mean	0.6367862105620727
driven_lanedir_median	0.670914908788469
driven_lanedir_min	0.37003073200026826
get_duckie_state_max	1.321119420668658e-06
get_duckie_state_mean	1.1657602262469815e-06
get_duckie_state_median	1.1486519992825e-06
get_duckie_state_min	1.0446174857542688e-06
get_robot_state_max	0.0035980018143801345
get_robot_state_mean	0.0035524466582646844
get_robot_state_median	0.0035536940881912725
get_robot_state_min	0.0035043966422960596
get_state_dump_max	0.004506408467012293
get_state_dump_mean	0.0044486284820901235
get_state_dump_median	0.00447079215300005
get_state_dump_min	0.0043465211553481015
get_ui_image_max	0.03855947606703814
get_ui_image_mean	0.032222786697307985
get_ui_image_median	0.03173814843833837
get_ui_image_min	0.026855373845517058
in-drivable-lane_max	3.049999999999989
in-drivable-lane_mean	2.537499999999993
in-drivable-lane_min	2.249999999999992
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.5366380877735335, "get_ui_image": 0.027566963864355972, "step_physics": 0.1008409765577808, "survival_time": 4.799999999999991, "driven_lanedir": 0.8352842926710846, "get_state_dump": 0.00443915239314443, "get_robot_state": 0.0035980018143801345, "sim_render-ego0": 0.0036627607247264114, "get_duckie_state": 1.0446174857542688e-06, "in-drivable-lane": 2.2999999999999963, "deviation-heading": 0.8495890969609824, "agent_compute-ego0": 0.014335182524219002, "complete-iteration": 0.1668856119372181, "set_robot_commands": 0.0021323518654734817, "deviation-center-line": 0.25886930584394835, "driven_lanedir_consec": 0.8352842926710846, "sim_compute_sim_state": 0.00833599591992565, "sim_compute_performance-ego0": 0.0019006876601386316}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.286306160667239, "get_ui_image": 0.03855947606703814, "step_physics": 0.12084539076861212, "survival_time": 4.199999999999993, "driven_lanedir": 0.37003073200026826, "get_state_dump": 0.004506408467012293, "get_robot_state": 0.0035436237559599037, "sim_render-ego0": 0.003679340025957893, "get_duckie_state": 1.321119420668658e-06, "in-drivable-lane": 2.5499999999999945, "deviation-heading": 1.1587484298288175, "agent_compute-ego0": 0.012017171523150277, "complete-iteration": 0.1966631384456859, "set_robot_commands": 0.0020802834454704735, "deviation-center-line": 0.12542776474100878, "driven_lanedir_consec": 0.37003073200026826, "sim_compute_sim_state": 0.009465868332806757, "sim_compute_performance-ego0": 0.0018880227032829736}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3471436727391808, "get_ui_image": 0.03590933301232078, "step_physics": 0.11703369563276116, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6705322484620189, "get_state_dump": 0.004502431912855668, "get_robot_state": 0.003563764420422641, "sim_render-ego0": 0.0038163363933563232, "get_duckie_state": 1.1677091771906072e-06, "in-drivable-lane": 2.249999999999992, "deviation-heading": 0.3875525678834354, "agent_compute-ego0": 0.014679277485067194, "complete-iteration": 0.19158330830660733, "set_robot_commands": 0.002091684124686501, "deviation-center-line": 0.06431450935068168, "driven_lanedir_consec": 0.6705322484620189, "sim_compute_sim_state": 0.0080043456771157, "sim_compute_performance-ego0": 0.0019109845161437988}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6509721948001357, "get_ui_image": 0.026855373845517058, "step_physics": 0.08264986751149002, "survival_time": 5.09999999999999, "driven_lanedir": 0.6712975691149192, "get_state_dump": 0.0043465211553481015, "get_robot_state": 0.0035043966422960596, "sim_render-ego0": 0.0035834543913313486, "get_duckie_state": 1.1295948213743931e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.3308912191145518, "agent_compute-ego0": 0.011555208743197246, "complete-iteration": 0.14129477797202694, "set_robot_commands": 0.0020336641848665996, "deviation-center-line": 0.08038013916951375, "driven_lanedir_consec": 0.6712975691149192, "sim_compute_sim_state": 0.0048646533373490125, "sim_compute_performance-ego0": 0.0018323115932131276}}
set_robot_commands_max	0.0021323518654734817
set_robot_commands_mean	0.002084495905124264
set_robot_commands_median	0.002085983785078487
set_robot_commands_min	0.0020336641848665996
sim_compute_performance-ego0_max	0.0019109845161437988
sim_compute_performance-ego0_mean	0.0018830016181946329
sim_compute_performance-ego0_median	0.0018943551817108023
sim_compute_performance-ego0_min	0.0018323115932131276
sim_compute_sim_state_max	0.009465868332806757
sim_compute_sim_state_mean	0.00766771581679928
sim_compute_sim_state_median	0.008170170798520674
sim_compute_sim_state_min	0.0048646533373490125
sim_render-ego0_max	0.0038163363933563232
sim_render-ego0_mean	0.0036854728838429944
sim_render-ego0_median	0.003671050375342152
sim_render-ego0_min	0.0035834543913313486
simulation-passed	1
step_physics_max	0.12084539076861212
step_physics_mean	0.10534248261766102
step_physics_median	0.10893733609527098
step_physics_min	0.08264986751149002
survival_time_max	5.09999999999999
survival_time_mean	4.612499999999992
survival_time_min	4.199999999999993

No reset possible

54941

11450

Cliff Chandler 🇺🇸

template-pytorch

LFt-sim

success

yes

2020-12-03 04:56:06+00:00

2020-12-03 05:08:00+00:00

0:11:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.28446315770893915
survival_time_median	5.974999999999987
deviation-center-line_median	0.2613798342619397
in-drivable-lane_median	3.974999999999989

other stats

agent_compute-ego0_max	0.013160713705591714
agent_compute-ego0_mean	0.012730432029279514
agent_compute-ego0_median	0.012724859868326496
agent_compute-ego0_min	0.012311294674873352
complete-iteration_max	0.28520529468854267
complete-iteration_mean	0.2382008569312979
complete-iteration_median	0.2374124915885641
complete-iteration_min	0.1927731498595207
deviation-center-line_max	1.135362737125026
deviation-center-line_mean	0.4340250037538541
deviation-center-line_min	0.07797760936651102
deviation-heading_max	4.849886862969334
deviation-heading_mean	2.156595861965884
deviation-heading_median	1.4546069090568905
deviation-heading_min	0.8672827667804208
driven_any_max	8.973725724075473
driven_any_mean	2.6835516017330345
driven_any_median	0.7712424858486162
driven_any_min	0.2179957111594316
driven_lanedir_consec_max	1.292496582385033
driven_lanedir_consec_mean	0.4874731552139352
driven_lanedir_consec_min	0.08846972305282952
driven_lanedir_max	1.292496582385033
driven_lanedir_mean	0.4874731552139352
driven_lanedir_median	0.28446315770893915
driven_lanedir_min	0.08846972305282952
get_duckie_state_max	1.8297239791515264e-06
get_duckie_state_mean	1.639397082867792e-06
get_duckie_state_median	1.6130426878570229e-06
get_duckie_state_min	1.5017789766055957e-06
get_robot_state_max	0.003579328457514445
get_robot_state_mean	0.003552040289799506
get_robot_state_median	0.0035592744161586313
get_robot_state_min	0.003510283869366313
get_state_dump_max	0.0045375177937169225
get_state_dump_mean	0.004416351520499682
get_state_dump_median	0.004445913688156956
get_state_dump_min	0.004236060911967892
get_ui_image_max	0.03496679663658142
get_ui_image_mean	0.02983716157766688
get_ui_image_median	0.029663519775013608
get_ui_image_min	0.02505481012405888
in-drivable-lane_max	50.04999999999882
in-drivable-lane_mean	14.499999999999698
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 8.973725724075473, "get_ui_image": 0.027640955334996106, "step_physics": 0.15478386033286062, "survival_time": 59.99999999999873, "driven_lanedir": 1.292496582385033, "get_state_dump": 0.004236060911967892, "get_robot_state": 0.003548962786036864, "sim_render-ego0": 0.0036091578195335265, "get_duckie_state": 1.5017789766055957e-06, "in-drivable-lane": 50.04999999999882, "deviation-heading": 4.849886862969334, "agent_compute-ego0": 0.013160713705591714, "complete-iteration": 0.21890853187821488, "set_robot_commands": 0.002092423982961688, "deviation-center-line": 1.135362737125026, "driven_lanedir_consec": 1.292496582385033, "sim_compute_sim_state": 0.007906192943118793, "sim_compute_performance-ego0": 0.001858859336147896}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2179957111594316, "get_ui_image": 0.03496679663658142, "step_physics": 0.21130092442035675, "survival_time": 2.3499999999999996, "driven_lanedir": 0.16861524620722257, "get_state_dump": 0.004418174425760905, "get_robot_state": 0.003579328457514445, "sim_render-ego0": 0.0036806315183639526, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.7671457535119246, "agent_compute-ego0": 0.012311294674873352, "complete-iteration": 0.28520529468854267, "set_robot_commands": 0.0021205047766367593, "deviation-center-line": 0.1874794467783175, "driven_lanedir_consec": 0.16861524620722257, "sim_compute_sim_state": 0.01083997388680776, "sim_compute_performance-ego0": 0.001909703016281128}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.5040759489178789, "get_ui_image": 0.031686084215031114, "step_physics": 0.18541983116504757, "survival_time": 4.249999999999993, "driven_lanedir": 0.08846972305282952, "get_state_dump": 0.004473652950553007, "get_robot_state": 0.003510283869366313, "sim_render-ego0": 0.003753897755645042, "get_duckie_state": 1.8297239791515264e-06, "in-drivable-lane": 3.0499999999999927, "deviation-heading": 0.8672827667804208, "agent_compute-ego0": 0.012633204460144045, "complete-iteration": 0.2559164512989133, "set_robot_commands": 0.0021088677783345066, "deviation-center-line": 0.07797760936651102, "driven_lanedir_consec": 0.08846972305282952, "sim_compute_sim_state": 0.010362866312958472, "sim_compute_performance-ego0": 0.0018925361855085504}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.0384090227793537, "get_ui_image": 0.02505481012405888, "step_physics": 0.13323921234376968, "survival_time": 7.699999999999981, "driven_lanedir": 0.40031106921065573, "get_state_dump": 0.0045375177937169225, "get_robot_state": 0.0035695860462803992, "sim_render-ego0": 0.0037297848732240737, "get_duckie_state": 1.636628181703629e-06, "in-drivable-lane": 4.899999999999985, "deviation-heading": 1.1420680646018564, "agent_compute-ego0": 0.012816515276508946, "complete-iteration": 0.1927731498595207, "set_robot_commands": 0.0022145809665802987, "deviation-center-line": 0.335280221745562, "driven_lanedir_consec": 0.40031106921065573, "sim_compute_sim_state": 0.005602824303411668, "sim_compute_performance-ego0": 0.001932290292555286}}
set_robot_commands_max	0.0022145809665802987
set_robot_commands_mean	0.002134094376128313
set_robot_commands_median	0.0021146862774856327
set_robot_commands_min	0.002092423982961688
sim_compute_performance-ego0_max	0.001932290292555286
sim_compute_performance-ego0_mean	0.0018983472076232152
sim_compute_performance-ego0_median	0.0019011196008948393
sim_compute_performance-ego0_min	0.001858859336147896
sim_compute_sim_state_max	0.01083997388680776
sim_compute_sim_state_mean	0.008677964361574175
sim_compute_sim_state_median	0.009134529628038634
sim_compute_sim_state_min	0.005602824303411668
sim_render-ego0_max	0.003753897755645042
sim_render-ego0_mean	0.003693367991691648
sim_render-ego0_median	0.003705208195794013
sim_render-ego0_min	0.0036091578195335265
simulation-passed	1
step_physics_max	0.21130092442035675
step_physics_mean	0.17118595706550865
step_physics_median	0.1701018457489541
step_physics_min	0.13323921234376968
survival_time_max	59.99999999999873
survival_time_mean	18.574999999999672
survival_time_min	2.3499999999999996

No reset possible

54910

11319

sim-exercise-1

LFv-sim

failed

yes

2020-12-03 04:52:12+00:00

2020-12-03 04:55:46+00:00

0:03:34

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54823

11359

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 04:37:05+00:00

2020-12-03 04:52:02+00:00

0:14:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1646585231460795
survival_time_median	23.850000000000204
deviation-center-line_median	0.4227641434875059
in-drivable-lane_median	17.700000000000195

other stats

agent_compute-ego0_max	0.012382181421402962
agent_compute-ego0_mean	0.012057194622628886
agent_compute-ego0_median	0.012050367848877176
agent_compute-ego0_min	0.011745861371358236
complete-iteration_max	0.1984395283845163
complete-iteration_mean	0.17829791814045903
complete-iteration_median	0.18191807544036903
complete-iteration_min	0.15091599329658176
deviation-center-line_max	0.8178865303951087
deviation-center-line_mean	0.45274466424129234
deviation-center-line_min	0.14756383959504887
deviation-heading_max	3.5697402640870433
deviation-heading_mean	2.179015810355746
deviation-heading_median	2.190388457184699
deviation-heading_min	0.7655460629665434
driven_any_max	11.585098325155236
driven_any_mean	5.627211885833123
driven_any_median	4.794574346866308
driven_any_min	1.3346005244446413
driven_lanedir_consec_max	3.629497534636787
driven_lanedir_consec_mean	1.6510450816652893
driven_lanedir_consec_min	0.6453657457322111
driven_lanedir_max	3.629497534636787
driven_lanedir_mean	1.727136022560568
driven_lanedir_median	1.3156550619214675
driven_lanedir_min	0.647736431762548
get_duckie_state_max	1.2000401814778646e-06
get_duckie_state_mean	1.1390213645952965e-06
get_duckie_state_median	1.1358049608046008e-06
get_duckie_state_min	1.08443535529412e-06
get_robot_state_max	0.0035178305641297373
get_robot_state_mean	0.003501986086496114
get_robot_state_median	0.003512089939225407
get_robot_state_min	0.003465933903403904
get_state_dump_max	0.004396897169851487
get_state_dump_mean	0.004342868158264425
get_state_dump_median	0.0043328498579286315
get_state_dump_min	0.004308875747348951
get_ui_image_max	0.03569037119547526
get_ui_image_mean	0.030493066413445385
get_ui_image_median	0.03038835362892147
get_ui_image_min	0.025505187200463336
in-drivable-lane_max	34.89999999999967
in-drivable-lane_mean	18.587500000000013
in-drivable-lane_min	4.049999999999986
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 11.585098325155236, "get_ui_image": 0.02805374814318372, "step_physics": 0.1082032891539308, "survival_time": 49.9999999999993, "driven_lanedir": 3.629497534636787, "get_state_dump": 0.004348282571081872, "get_robot_state": 0.00351013479890166, "sim_render-ego0": 0.003624836762587389, "get_duckie_state": 1.08443535529412e-06, "in-drivable-lane": 34.89999999999967, "deviation-heading": 3.5697402640870433, "agent_compute-ego0": 0.011841585109760236, "complete-iteration": 0.1725085615278124, "set_robot_commands": 0.002045116939030208, "deviation-center-line": 0.8178865303951087, "driven_lanedir_consec": 3.629497534636787, "sim_compute_sim_state": 0.008951102817927922, "sim_compute_performance-ego0": 0.0018598707048566668}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3346005244446413, "get_ui_image": 0.03569037119547526, "step_physics": 0.1189354960123698, "survival_time": 7.449999999999981, "driven_lanedir": 0.647736431762548, "get_state_dump": 0.004317417144775391, "get_robot_state": 0.0035140450795491537, "sim_render-ego0": 0.003635981877644857, "get_duckie_state": 1.2000401814778646e-06, "in-drivable-lane": 4.049999999999986, "deviation-heading": 1.1802650112754056, "agent_compute-ego0": 0.011745861371358236, "complete-iteration": 0.19132758935292565, "set_robot_commands": 0.002035228411356608, "deviation-center-line": 0.14756383959504887, "driven_lanedir_consec": 0.6453657457322111, "sim_compute_sim_state": 0.009505565961201983, "sim_compute_performance-ego0": 0.0018763415018717448}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.6300143892584815, "get_ui_image": 0.032722959114659216, "step_physics": 0.12755578756332395, "survival_time": 24.750000000000217, "driven_lanedir": 1.9148061314168887, "get_state_dump": 0.004396897169851487, "get_robot_state": 0.0035178305641297373, "sim_render-ego0": 0.003716359696080608, "get_duckie_state": 1.1272007419217017e-06, "in-drivable-lane": 15.550000000000194, "deviation-heading": 3.200511903093992, "agent_compute-ego0": 0.012382181421402962, "complete-iteration": 0.1984395283845163, "set_robot_commands": 0.0021017097657726655, "deviation-center-line": 0.6864666915388863, "driven_lanedir_consec": 1.612813053866112, "sim_compute_sim_state": 0.010078057166068783, "sim_compute_performance-ego0": 0.00189477349481275}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.9591343044741345, "get_ui_image": 0.025505187200463336, "step_physics": 0.0913339350534522, "survival_time": 22.95000000000019, "driven_lanedir": 0.7165039924260468, "get_state_dump": 0.004308875747348951, "get_robot_state": 0.003465933903403904, "sim_render-ego0": 0.0037028219388878865, "get_duckie_state": 1.1444091796875e-06, "in-drivable-lane": 19.850000000000193, "deviation-heading": 0.7655460629665434, "agent_compute-ego0": 0.01225915058799412, "complete-iteration": 0.15091599329658176, "set_robot_commands": 0.002132328696872877, "deviation-center-line": 0.15906159543612547, "driven_lanedir_consec": 0.7165039924260468, "sim_compute_sim_state": 0.00625859084336654, "sim_compute_performance-ego0": 0.001880129523899244}}
set_robot_commands_max	0.002132328696872877
set_robot_commands_mean	0.0020785959532580896
set_robot_commands_median	0.0020734133524014367
set_robot_commands_min	0.002035228411356608
sim_compute_performance-ego0_max	0.00189477349481275
sim_compute_performance-ego0_mean	0.0018777788063601016
sim_compute_performance-ego0_median	0.0018782355128854943
sim_compute_performance-ego0_min	0.0018598707048566668
sim_compute_sim_state_max	0.010078057166068783
sim_compute_sim_state_mean	0.008698329197141308
sim_compute_sim_state_median	0.009228334389564954
sim_compute_sim_state_min	0.00625859084336654
sim_render-ego0_max	0.003716359696080608
sim_render-ego0_mean	0.003670000068800185
sim_render-ego0_median	0.003669401908266372
sim_render-ego0_min	0.003624836762587389
simulation-passed	1
step_physics_max	0.12755578756332395
step_physics_mean	0.1115071269457692
step_physics_median	0.1135693925831503
step_physics_min	0.0913339350534522
survival_time_max	49.9999999999993
survival_time_mean	26.287499999999923
survival_time_min	7.449999999999981

No reset possible

54770

11363

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 04:28:30+00:00

2020-12-03 04:36:21+00:00

0:07:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7331311764753332
survival_time_median	8.899999999999997
deviation-center-line_median	0.22455280348729809
in-drivable-lane_median	3.8749999999999862

other stats

agent_compute-ego0_max	0.012561949673077916
agent_compute-ego0_mean	0.012413692133081218
agent_compute-ego0_median	0.01244490202265514
agent_compute-ego0_min	0.012203014813936671
complete-iteration_max	0.20870238417512052
complete-iteration_mean	0.1794557930398754
complete-iteration_median	0.1788076233283039
complete-iteration_min	0.15150554132777333
deviation-center-line_max	0.5087562630939194
deviation-center-line_mean	0.27537273150580105
deviation-center-line_min	0.14362905595468856
deviation-heading_max	1.471968565974778
deviation-heading_mean	0.8575014203110755
deviation-heading_median	0.7209193788717232
deviation-heading_min	0.5161983575260777
driven_any_max	4.917454800998607
driven_any_mean	2.588135345250225
driven_any_median	2.0619890011855113
driven_any_min	1.3111085776312714
driven_lanedir_consec_max	2.202559459379852
driven_lanedir_consec_mean	1.0889002799144087
driven_lanedir_consec_min	0.6867793073271167
driven_lanedir_max	2.202559459379852
driven_lanedir_mean	1.0889002799144087
driven_lanedir_median	0.7331311764753332
driven_lanedir_min	0.6867793073271167
get_duckie_state_max	1.7216865052568151e-06
get_duckie_state_mean	1.681047343373145e-06
get_duckie_state_median	1.6975755615172515e-06
get_duckie_state_min	1.6073517452012625e-06
get_robot_state_max	0.003680780889907321
get_robot_state_mean	0.0035967181538207583
get_robot_state_median	0.003594740420433581
get_robot_state_min	0.0035166108845085496
get_state_dump_max	0.004499223384451359
get_state_dump_mean	0.004402695204531336
get_state_dump_median	0.004400058713443682
get_state_dump_min	0.004311440006786624
get_ui_image_max	0.03619708214606439
get_ui_image_mean	0.030693057631829865
get_ui_image_median	0.030366330087240045
get_ui_image_min	0.025842488206774983
in-drivable-lane_max	20.5500000000002
in-drivable-lane_mean	7.462500000000048
in-drivable-lane_min	1.550000000000022
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.474246314145827, "get_ui_image": 0.02823923981708029, "step_physics": 0.10249304886601396, "survival_time": 10.300000000000011, "driven_lanedir": 2.202559459379852, "get_state_dump": 0.0044881940463890775, "get_robot_state": 0.003680780889907321, "sim_render-ego0": 0.0037741695625194607, "get_duckie_state": 1.6862067623414856e-06, "in-drivable-lane": 1.550000000000022, "deviation-heading": 1.471968565974778, "agent_compute-ego0": 0.012453216285521282, "complete-iteration": 0.168937793676404, "set_robot_commands": 0.002243434749363701, "deviation-center-line": 0.5087562630939194, "driven_lanedir_consec": 2.202559459379852, "sim_compute_sim_state": 0.009523187858470972, "sim_compute_performance-ego0": 0.001957566265898626}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3111085776312714, "get_ui_image": 0.03619708214606439, "step_physics": 0.13510535980438018, "survival_time": 7.099999999999983, "driven_lanedir": 0.7627504978027511, "get_state_dump": 0.004311923380498286, "get_robot_state": 0.0035294386056753304, "sim_render-ego0": 0.0036169799057753768, "get_duckie_state": 1.7089443606930178e-06, "in-drivable-lane": 2.9999999999999893, "deviation-heading": 0.9210054855528336, "agent_compute-ego0": 0.012203014813936671, "complete-iteration": 0.20870238417512052, "set_robot_commands": 0.0020599365234375, "deviation-center-line": 0.2904394017089256, "driven_lanedir_consec": 0.7627504978027511, "sim_compute_sim_state": 0.009766143518727975, "sim_compute_performance-ego0": 0.0018415717811851235}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.917454800998607, "get_ui_image": 0.0324934203573998, "step_physics": 0.11562066078186035, "survival_time": 23.4500000000002, "driven_lanedir": 0.7035118551479155, "get_state_dump": 0.004499223384451359, "get_robot_state": 0.003660042235191832, "sim_render-ego0": 0.0038353569964145098, "get_duckie_state": 1.7216865052568151e-06, "in-drivable-lane": 20.5500000000002, "deviation-heading": 0.5208332721906127, "agent_compute-ego0": 0.012436587759789, "complete-iteration": 0.18867745298020383, "set_robot_commands": 0.002316738189534938, "deviation-center-line": 0.15866620526567052, "driven_lanedir_consec": 0.7035118551479155, "sim_compute_sim_state": 0.011755963589282744, "sim_compute_performance-ego0": 0.0019798441136136967}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6497316882251956, "get_ui_image": 0.025842488206774983, "step_physics": 0.09263432104855972, "survival_time": 7.499999999999981, "driven_lanedir": 0.6867793073271167, "get_state_dump": 0.004311440006786624, "get_robot_state": 0.0035166108845085496, "sim_render-ego0": 0.003626782373087296, "get_duckie_state": 1.6073517452012625e-06, "in-drivable-lane": 4.749999999999983, "deviation-heading": 0.5161983575260777, "agent_compute-ego0": 0.012561949673077916, "complete-iteration": 0.15150554132777333, "set_robot_commands": 0.002133568391105197, "deviation-center-line": 0.14362905595468856, "driven_lanedir_consec": 0.6867793073271167, "sim_compute_sim_state": 0.00496014380297124, "sim_compute_performance-ego0": 0.001848200299092476}}
set_robot_commands_max	0.002316738189534938
set_robot_commands_mean	0.002188419463360334
set_robot_commands_median	0.002188501570234449
set_robot_commands_min	0.0020599365234375
sim_compute_performance-ego0_max	0.0019798441136136967
sim_compute_performance-ego0_mean	0.0019067956149474807
sim_compute_performance-ego0_median	0.001902883282495551
sim_compute_performance-ego0_min	0.0018415717811851235
sim_compute_sim_state_max	0.011755963589282744
sim_compute_sim_state_mean	0.009001359692363233
sim_compute_sim_state_median	0.009644665688599474
sim_compute_sim_state_min	0.00496014380297124
sim_render-ego0_max	0.0038353569964145098
sim_render-ego0_mean	0.003713322209449161
sim_render-ego0_median	0.003700475967803378
sim_render-ego0_min	0.0036169799057753768
simulation-passed	1
step_physics_max	0.13510535980438018
step_physics_mean	0.11146334762520356
step_physics_median	0.10905685482393716
step_physics_min	0.09263432104855972
survival_time_max	23.4500000000002
survival_time_mean	12.087500000000045
survival_time_min	7.099999999999983

No reset possible

54736

11382

Anthony Courchesne 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 04:21:57+00:00

2020-12-03 04:26:50+00:00

0:04:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4537521294667808
survival_time_median	4.849999999999991
deviation-center-line_median	0.1372302045495064
in-drivable-lane_median	2.9249999999999914

other stats

agent_compute-ego0_max	0.0126539354045022
agent_compute-ego0_mean	0.012482138642059135
agent_compute-ego0_median	0.012524966128520757
agent_compute-ego0_min	0.012224686906692829
complete-iteration_max	0.18888336293240812
complete-iteration_mean	0.166276865125115
complete-iteration_median	0.16696318458956733
complete-iteration_min	0.14229772838891722
deviation-center-line_max	0.18064186156548628
deviation-center-line_mean	0.13580620371952695
deviation-center-line_min	0.08812254421360871
deviation-heading_max	1.3553518917262792
deviation-heading_mean	0.8109541349827569
deviation-heading_median	0.7635798721631352
deviation-heading_min	0.36130490387847825
driven_any_max	3.7770759639506664
driven_any_mean	1.8771823288048448
driven_any_median	1.3312358804588105
driven_any_min	1.069181590351092
driven_lanedir_consec_max	0.607810552451685
driven_lanedir_consec_mean	0.4637043290792038
driven_lanedir_consec_min	0.3395025049315685
driven_lanedir_max	0.607810552451685
driven_lanedir_mean	0.4637043290792038
driven_lanedir_median	0.4537521294667808
driven_lanedir_min	0.3395025049315685
get_duckie_state_max	1.708666483561198e-06
get_duckie_state_mean	1.6405625067735738e-06
get_duckie_state_median	1.629669413926987e-06
get_duckie_state_min	1.5942447156791229e-06
get_robot_state_max	0.0036133841989429423
get_robot_state_mean	0.003600603351785703
get_robot_state_median	0.003604424793951736
get_robot_state_min	0.0035801796202963973
get_state_dump_max	0.0045693020441542114
get_state_dump_mean	0.004484852634343962
get_state_dump_median	0.004473180808766748
get_state_dump_min	0.004423746875688142
get_ui_image_max	0.0360209713590906
get_ui_image_mean	0.030806877991731433
get_ui_image_median	0.030730365180450026
get_ui_image_min	0.025745810246935077
in-drivable-lane_max	10.150000000000029
in-drivable-lane_mean	4.487500000000001
in-drivable-lane_min	1.949999999999993
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.7770759639506664, "get_ui_image": 0.028692837040793447, "step_physics": 0.08252851534089284, "survival_time": 11.900000000000034, "driven_lanedir": 0.3421609209918519, "get_state_dump": 0.0045693020441542114, "get_robot_state": 0.0036133841989429423, "sim_render-ego0": 0.004039442190066541, "get_duckie_state": 1.6030906134569496e-06, "in-drivable-lane": 10.150000000000029, "deviation-heading": 1.137718806131648, "agent_compute-ego0": 0.0126539354045022, "complete-iteration": 0.15085191207949586, "set_robot_commands": 0.002440478512432785, "deviation-center-line": 0.18064186156548628, "driven_lanedir_consec": 0.3421609209918519, "sim_compute_sim_state": 0.010142034067768433, "sim_compute_performance-ego0": 0.002090806242811131}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2613547353383314, "get_ui_image": 0.0360209713590906, "step_physics": 0.11453673941023806, "survival_time": 4.6499999999999915, "driven_lanedir": 0.3395025049315685, "get_state_dump": 0.00445862019315679, "get_robot_state": 0.0035801796202963973, "sim_render-ego0": 0.00392500897671314, "get_duckie_state": 1.6562482143970246e-06, "in-drivable-lane": 2.7999999999999936, "deviation-heading": 1.3553518917262792, "agent_compute-ego0": 0.012224686906692829, "complete-iteration": 0.18888336293240812, "set_robot_commands": 0.0023638365116525205, "deviation-center-line": 0.1434360692667694, "driven_lanedir_consec": 0.3395025049315685, "sim_compute_sim_state": 0.009641616902452832, "sim_compute_performance-ego0": 0.0020516451368940637}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.069181590351092, "get_ui_image": 0.0327678933201066, "step_physics": 0.11340679892574448, "survival_time": 4.099999999999993, "driven_lanedir": 0.607810552451685, "get_state_dump": 0.0044877414243767065, "get_robot_state": 0.0036105592566800407, "sim_render-ego0": 0.003921658159738563, "get_duckie_state": 1.5942447156791229e-06, "in-drivable-lane": 1.949999999999993, "deviation-heading": 0.3894409381946223, "agent_compute-ego0": 0.012627817062010247, "complete-iteration": 0.1830744570996388, "set_robot_commands": 0.0022861095796148463, "deviation-center-line": 0.08812254421360871, "driven_lanedir_consec": 0.607810552451685, "sim_compute_sim_state": 0.007884413362985634, "sim_compute_performance-ego0": 0.0019999986671539673}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4011170255792893, "get_ui_image": 0.025745810246935077, "step_physics": 0.08301001202826407, "survival_time": 5.04999999999999, "driven_lanedir": 0.5653433379417097, "get_state_dump": 0.004423746875688142, "get_robot_state": 0.0035982903312234316, "sim_render-ego0": 0.003818977112863578, "get_duckie_state": 1.708666483561198e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.36130490387847825, "agent_compute-ego0": 0.01242211519503126, "complete-iteration": 0.14229772838891722, "set_robot_commands": 0.0022475368836346794, "deviation-center-line": 0.13102433983224335, "driven_lanedir_consec": 0.5653433379417097, "sim_compute_sim_state": 0.004988822282529345, "sim_compute_performance-ego0": 0.0019617852042703066}}
set_robot_commands_max	0.002440478512432785
set_robot_commands_mean	0.002334490371833708
set_robot_commands_median	0.0023249730456336836
set_robot_commands_min	0.0022475368836346794
sim_compute_performance-ego0_max	0.002090806242811131
sim_compute_performance-ego0_mean	0.002026058812782367
sim_compute_performance-ego0_median	0.0020258219020240155
sim_compute_performance-ego0_min	0.0019617852042703066
sim_compute_sim_state_max	0.010142034067768433
sim_compute_sim_state_mean	0.00816422165393406
sim_compute_sim_state_median	0.008763015132719234
sim_compute_sim_state_min	0.004988822282529345
sim_render-ego0_max	0.004039442190066541
sim_render-ego0_mean	0.003926271609845456
sim_render-ego0_median	0.003923333568225851
sim_render-ego0_min	0.003818977112863578
simulation-passed	1
step_physics_max	0.11453673941023806
step_physics_mean	0.09837051642628486
step_physics_median	0.09820840547700428
step_physics_min	0.08252851534089284
survival_time_max	11.900000000000034
survival_time_mean	6.4250000000000025
survival_time_min	4.099999999999993

No reset possible

54647

11394

Yishu Malhotra 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 04:11:04+00:00

2020-12-03 04:21:12+00:00

0:10:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0380227095164762
survival_time_median	11.175000000000026
deviation-center-line_median	0.31580243017273646
in-drivable-lane_median	6.700000000000011

other stats

agent_compute-ego0_max	0.01218571662902832
agent_compute-ego0_mean	0.011985274763599752
agent_compute-ego0_median	0.0119344083054841
agent_compute-ego0_min	0.011886565814402492
complete-iteration_max	0.20694348310968677
complete-iteration_mean	0.1705378790560844
complete-iteration_median	0.16608934547775128
complete-iteration_min	0.1430293421591482
deviation-center-line_max	0.9736346410369242
deviation-center-line_mean	0.43674620787157786
deviation-center-line_min	0.1417453301039144
deviation-heading_max	2.9037044549536923
deviation-heading_mean	1.5409998220790206
deviation-heading_median	1.3045439254831983
deviation-heading_min	0.6512069823959935
driven_any_max	8.363037854656795
driven_any_mean	3.586674894454957
driven_any_median	2.333607295458635
driven_any_min	1.3164471322457625
driven_lanedir_consec_max	4.081410846317558
driven_lanedir_consec_mean	1.7137280229572496
driven_lanedir_consec_min	0.6974558264784876
driven_lanedir_max	4.081410846317558
driven_lanedir_mean	1.7137280229572496
driven_lanedir_median	1.0380227095164762
driven_lanedir_min	0.6974558264784876
get_duckie_state_max	1.2766930364793346e-06
get_duckie_state_mean	1.210098703550322e-06
get_duckie_state_median	1.2441843329076248e-06
get_duckie_state_min	1.0753331119067048e-06
get_robot_state_max	0.00361036970876797
get_robot_state_mean	0.00353755493294606
get_robot_state_median	0.0035406089206238608
get_robot_state_min	0.003458632181768548
get_state_dump_max	0.004470605988798557
get_state_dump_mean	0.004385422906819946
get_state_dump_median	0.004398971052661627
get_state_dump_min	0.004273143533157975
get_ui_image_max	0.0355162407941879
get_ui_image_mean	0.030070551716139263
get_ui_image_median	0.029733861443062837
get_ui_image_min	0.02529824318424348
in-drivable-lane_max	19.94999999999987
in-drivable-lane_mean	9.17499999999997
in-drivable-lane_min	3.349999999999988
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 8.363037854656795, "get_ui_image": 0.027638900547707883, "step_physics": 0.09513683331689872, "survival_time": 37.79999999999999, "driven_lanedir": 4.081410846317558, "get_state_dump": 0.004470605988798557, "get_robot_state": 0.00361036970876797, "sim_render-ego0": 0.0037465549050738033, "get_duckie_state": 1.2689411561429265e-06, "in-drivable-lane": 19.94999999999987, "deviation-heading": 2.9037044549536923, "agent_compute-ego0": 0.011886565814402492, "complete-iteration": 0.161548173884262, "set_robot_commands": 0.002244303689450222, "deviation-center-line": 0.9736346410369242, "driven_lanedir_consec": 4.081410846317558, "sim_compute_sim_state": 0.010755620827920528, "sim_compute_performance-ego0": 0.0019763388438457856}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3164471322457625, "get_ui_image": 0.0355162407941879, "step_physics": 0.13392206817675548, "survival_time": 7.79999999999998, "driven_lanedir": 0.7715778077249205, "get_state_dump": 0.004399802274764723, "get_robot_state": 0.0035295547193782344, "sim_render-ego0": 0.003707995080644158, "get_duckie_state": 1.219427509672323e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 1.0730426519311844, "agent_compute-ego0": 0.011919354177584314, "complete-iteration": 0.20694348310968677, "set_robot_commands": 0.0021435409594493305, "deviation-center-line": 0.2870378041357842, "driven_lanedir_consec": 0.7715778077249205, "sim_compute_sim_state": 0.009789082654722177, "sim_compute_performance-ego0": 0.0019380180699050803}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.080128760498701, "get_ui_image": 0.031828822338417787, "step_physics": 0.10148615461506257, "survival_time": 14.550000000000072, "driven_lanedir": 1.304467611308032, "get_state_dump": 0.004273143533157975, "get_robot_state": 0.003458632181768548, "sim_render-ego0": 0.0036046047733254622, "get_duckie_state": 1.0753331119067048e-06, "in-drivable-lane": 8.800000000000038, "deviation-heading": 1.5360451990352122, "agent_compute-ego0": 0.011949462433383889, "complete-iteration": 0.17063051707124058, "set_robot_commands": 0.001998971586358057, "deviation-center-line": 0.34456705620968864, "driven_lanedir_consec": 1.304467611308032, "sim_compute_sim_state": 0.010135980501566848, "sim_compute_performance-ego0": 0.0018253016145262}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.587085830418569, "get_ui_image": 0.02529824318424348, "step_physics": 0.0847376500406573, "survival_time": 7.699999999999981, "driven_lanedir": 0.6974558264784876, "get_state_dump": 0.0043981398305585305, "get_robot_state": 0.003551663121869487, "sim_render-ego0": 0.0037060337681924143, "get_duckie_state": 1.2766930364793346e-06, "in-drivable-lane": 4.599999999999984, "deviation-heading": 0.6512069823959935, "agent_compute-ego0": 0.01218571662902832, "complete-iteration": 0.1430293421591482, "set_robot_commands": 0.002151861498432775, "deviation-center-line": 0.1417453301039144, "driven_lanedir_consec": 0.6974558264784876, "sim_compute_sim_state": 0.004993587924588111, "sim_compute_performance-ego0": 0.0019282079512073149}}
set_robot_commands_max	0.002244303689450222
set_robot_commands_mean	0.0021346694334225965
set_robot_commands_median	0.002147701228941053
set_robot_commands_min	0.001998971586358057
sim_compute_performance-ego0_max	0.0019763388438457856
sim_compute_performance-ego0_mean	0.0019169666198710952
sim_compute_performance-ego0_median	0.0019331130105561976
sim_compute_performance-ego0_min	0.0018253016145262
sim_compute_sim_state_max	0.010755620827920528
sim_compute_sim_state_mean	0.008918567977199417
sim_compute_sim_state_median	0.009962531578144512
sim_compute_sim_state_min	0.004993587924588111
sim_render-ego0_max	0.0037465549050738033
sim_render-ego0_mean	0.00369129713180896
sim_render-ego0_median	0.003707014424418286
sim_render-ego0_min	0.0036046047733254622
simulation-passed	1
step_physics_max	0.13392206817675548
step_physics_mean	0.1038206765373435
step_physics_median	0.09831149396598064
step_physics_min	0.0847376500406573
survival_time_max	37.79999999999999
survival_time_mean	16.962500000000006
survival_time_min	7.699999999999981

No reset possible

54557

11449

Cliff Chandler 🇺🇸

template-pytorch

LFv-sim

success

yes

2020-12-03 03:54:01+00:00

2020-12-03 04:09:34+00:00

0:15:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4154005303150574
survival_time_median	6.1749999999999865
deviation-center-line_median	0.23088552495403192
in-drivable-lane_median	3.5749999999999873

other stats

agent_compute-ego0_max	0.01298391819000244
agent_compute-ego0_mean	0.012203418024630224
agent_compute-ego0_median	0.01215999609278154
agent_compute-ego0_min	0.011509761722955378
complete-iteration_max	0.28443156242370604
complete-iteration_mean	0.214307154481981
complete-iteration_median	0.19772534150947896
complete-iteration_min	0.17734637248526008
deviation-center-line_max	0.5695566853418847
deviation-center-line_mean	0.27574365248821997
deviation-center-line_min	0.0716468747029312
deviation-heading_max	2.658718849750731
deviation-heading_mean	1.4306991006824437
deviation-heading_median	1.2728430379145768
deviation-heading_min	0.5183914771498895
driven_any_max	10.945710418787026
driven_any_mean	3.3379434766230935
driven_any_median	1.0808905083427092
driven_any_min	0.24428247101992875
driven_lanedir_consec_max	1.1565558340453868
driven_lanedir_consec_mean	0.5147527637290426
driven_lanedir_consec_min	0.0716541602406684
driven_lanedir_max	1.1565558340453868
driven_lanedir_mean	0.5147527637290426
driven_lanedir_median	0.4154005303150574
driven_lanedir_min	0.0716541602406684
get_duckie_state_max	1.436471939086914e-06
get_duckie_state_mean	1.3094995782323768e-06
get_duckie_state_median	1.3171240340831668e-06
get_duckie_state_min	1.1672783056762597e-06
get_robot_state_max	0.0038598138232563816
get_robot_state_mean	0.003650512287062483
get_robot_state_median	0.0036110772689183553
get_robot_state_min	0.003520080787156841
get_state_dump_max	0.00465787410736084
get_state_dump_mean	0.004526914831282092
get_state_dump_median	0.0045274623142656425
get_state_dump_min	0.004394860589236244
get_ui_image_max	0.03534963607788086
get_ui_image_mean	0.03005510567370543
get_ui_image_median	0.02990401075329892
get_ui_image_min	0.025062765110343024
in-drivable-lane_max	53.14999999999869
in-drivable-lane_mean	15.374999999999664
in-drivable-lane_min	1.1999999999999988
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.1463598360449194, "get_ui_image": 0.027674360792766247, "step_physics": 0.1202575679897338, "survival_time": 6.399999999999985, "driven_lanedir": 0.509496119633936, "get_state_dump": 0.004625643870627233, "get_robot_state": 0.0038598138232563816, "sim_render-ego0": 0.003880787265393161, "get_duckie_state": 1.2752621672874273e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 1.4602990440402284, "agent_compute-ego0": 0.012324972670207652, "complete-iteration": 0.18524957257647848, "set_robot_commands": 0.002440034881118656, "deviation-center-line": 0.3298770040069391, "driven_lanedir_consec": 0.509496119633936, "sim_compute_sim_state": 0.008046713910361594, "sim_compute_performance-ego0": 0.002057724220808162}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.24428247101992875, "get_ui_image": 0.03534963607788086, "step_physics": 0.2110334300994873, "survival_time": 2.4499999999999993, "driven_lanedir": 0.0716541602406684, "get_state_dump": 0.00465787410736084, "get_robot_state": 0.003629093170166016, "sim_render-ego0": 0.0037477636337280274, "get_duckie_state": 1.3589859008789065e-06, "in-drivable-lane": 1.1999999999999988, "deviation-heading": 1.085387031788925, "agent_compute-ego0": 0.01298391819000244, "complete-iteration": 0.28443156242370604, "set_robot_commands": 0.0021502351760864257, "deviation-center-line": 0.0716468747029312, "driven_lanedir_consec": 0.0716541602406684, "sim_compute_sim_state": 0.008873190879821777, "sim_compute_performance-ego0": 0.001921544075012207}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.015421180640499, "get_ui_image": 0.032133660713831586, "step_physics": 0.14150222539901733, "survival_time": 5.949999999999987, "driven_lanedir": 0.3213049409961788, "get_state_dump": 0.004429280757904053, "get_robot_state": 0.003593061367670695, "sim_render-ego0": 0.0038028240203857424, "get_duckie_state": 1.436471939086914e-06, "in-drivable-lane": 3.999999999999986, "deviation-heading": 0.5183914771498895, "agent_compute-ego0": 0.011995019515355428, "complete-iteration": 0.21020111044247944, "set_robot_commands": 0.002118025223414103, "deviation-center-line": 0.13189404590112477, "driven_lanedir_consec": 0.3213049409961788, "sim_compute_sim_state": 0.008616159359614054, "sim_compute_performance-ego0": 0.0019274294376373292}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.945710418787026, "get_ui_image": 0.025062765110343024, "step_physics": 0.11929599808018768, "survival_time": 59.99999999999873, "driven_lanedir": 1.1565558340453868, "get_state_dump": 0.004394860589236244, "get_robot_state": 0.003520080787156841, "sim_render-ego0": 0.003570429192891625, "get_duckie_state": 1.1672783056762597e-06, "in-drivable-lane": 53.14999999999869, "deviation-heading": 2.658718849750731, "agent_compute-ego0": 0.011509761722955378, "complete-iteration": 0.17734637248526008, "set_robot_commands": 0.0020476257076469887, "deviation-center-line": 0.5695566853418847, "driven_lanedir_consec": 1.1565558340453868, "sim_compute_sim_state": 0.006020718271984447, "sim_compute_performance-ego0": 0.0018491385679856424}}
set_robot_commands_max	0.002440034881118656
set_robot_commands_mean	0.0021889802470665435
set_robot_commands_median	0.0021341301997502646
set_robot_commands_min	0.0020476257076469887
sim_compute_performance-ego0_max	0.002057724220808162
sim_compute_performance-ego0_mean	0.0019389590753608353
sim_compute_performance-ego0_median	0.001924486756324768
sim_compute_performance-ego0_min	0.0018491385679856424
sim_compute_sim_state_max	0.008873190879821777
sim_compute_sim_state_mean	0.007889195605445468
sim_compute_sim_state_median	0.008331436634987824
sim_compute_sim_state_min	0.006020718271984447
sim_render-ego0_max	0.003880787265393161
sim_render-ego0_mean	0.003750451028099639
sim_render-ego0_median	0.0037752938270568847
sim_render-ego0_min	0.003570429192891625
simulation-passed	1
step_physics_max	0.2110334300994873
step_physics_mean	0.1480223053921065
step_physics_median	0.13087989669437555
step_physics_min	0.11929599808018768
survival_time_max	59.99999999999873
survival_time_mean	18.699999999999676
survival_time_min	2.4499999999999993

No reset possible

54465

11525

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

success

yes

2020-12-03 03:16:05+00:00

2020-12-03 03:53:20+00:00

0:37:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.863254612408824
survival_time_median	59.99999999999873
deviation-center-line_median	3.5540366192562205
in-drivable-lane_median	15.699999999999696

other stats

agent_compute-ego0_max	0.012645416728206208
agent_compute-ego0_mean	0.01228244065839898
agent_compute-ego0_median	0.012231716406930992
agent_compute-ego0_min	0.012020913091527733
complete-iteration_max	0.2509729437387357
complete-iteration_mean	0.21564760779699807
complete-iteration_median	0.2147108819232712
complete-iteration_min	0.1821957236027142
deviation-center-line_max	4.202420503918291
deviation-center-line_mean	3.4664632480357973
deviation-center-line_min	2.5553592497124553
deviation-heading_max	16.632301522174394
deviation-heading_mean	13.796866931211428
deviation-heading_median	13.60011596153496
deviation-heading_min	11.354934279601396
driven_any_max	16.67433693223324
driven_any_mean	16.19571695868219
driven_any_median	16.667404016523662
driven_any_min	14.773722869448209
driven_lanedir_consec_max	12.351357712960572
driven_lanedir_consec_mean	10.351312625374169
driven_lanedir_consec_min	7.327383563718453
driven_lanedir_max	12.747216847996034
driven_lanedir_mean	11.00012416578478
driven_lanedir_median	11.472568339595547
driven_lanedir_min	8.308143135951982
get_duckie_state_max	1.7090304308787274e-06
get_duckie_state_mean	1.6514089754819597e-06
get_duckie_state_median	1.6785541589497777e-06
get_duckie_state_min	1.5394971531495564e-06
get_robot_state_max	0.00360924055224994
get_robot_state_mean	0.003551014692281219
get_robot_state_median	0.003546035458503615
get_robot_state_min	0.0035027472998677045
get_state_dump_max	0.004570905215337215
get_state_dump_mean	0.00443963838471809
get_state_dump_median	0.004458979240455407
get_state_dump_min	0.004269689842624331
get_ui_image_max	0.036204134197060416
get_ui_image_mean	0.030438397727050197
get_ui_image_median	0.029890883535282377
get_ui_image_min	0.025767689640575603
in-drivable-lane_max	20.89999999999905
in-drivable-lane_mean	15.637499999999562
in-drivable-lane_min	10.249999999999808
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 16.660799680857437, "get_ui_image": 0.027471940582936057, "step_physics": 0.12779537406591054, "survival_time": 59.99999999999873, "driven_lanedir": 11.81388918179283, "get_state_dump": 0.004269689842624331, "get_robot_state": 0.003543875993638114, "sim_render-ego0": 0.0035749742331651724, "get_duckie_state": 1.5394971531495564e-06, "in-drivable-lane": 14.849999999999664, "deviation-heading": 12.80561129249276, "agent_compute-ego0": 0.012020913091527733, "complete-iteration": 0.1921461368976882, "set_robot_commands": 0.002086276714251897, "deviation-center-line": 3.600642150274449, "driven_lanedir_consec": 11.81388918179283, "sim_compute_sim_state": 0.009462695435421551, "sim_compute_performance-ego0": 0.001850182964442473}, "LF-norm-zigzag-000-ego0": {"driven_any": 16.67433693223324, "get_ui_image": 0.036204134197060416, "step_physics": 0.17299302372706124, "survival_time": 59.99999999999873, "driven_lanedir": 12.747216847996034, "get_state_dump": 0.004570905215337215, "get_robot_state": 0.003548194923369116, "sim_render-ego0": 0.0036934666788449, "get_duckie_state": 1.7090304308787274e-06, "in-drivable-lane": 10.249999999999808, "deviation-heading": 16.632301522174394, "agent_compute-ego0": 0.012205498700932004, "complete-iteration": 0.2509729437387357, "set_robot_commands": 0.002095481735979091, "deviation-center-line": 3.507431088237993, "driven_lanedir_consec": 12.351357712960572, "sim_compute_sim_state": 0.013688172825567928, "sim_compute_performance-ego0": 0.0019044645819239175}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.773722869448209, "get_ui_image": 0.0323098264876287, "step_physics": 0.16193857648175994, "survival_time": 53.899999999999075, "driven_lanedir": 8.308143135951982, "get_state_dump": 0.004485244326728488, "get_robot_state": 0.00360924055224994, "sim_render-ego0": 0.0037961386220117096, "get_duckie_state": 1.7020744344942871e-06, "in-drivable-lane": 20.89999999999905, "deviation-heading": 11.354934279601396, "agent_compute-ego0": 0.012645416728206208, "complete-iteration": 0.23727562694885423, "set_robot_commands": 0.002218033893998847, "deviation-center-line": 2.5553592497124553, "driven_lanedir_consec": 7.327383563718453, "sim_compute_sim_state": 0.014230130887672346, "sim_compute_performance-ego0": 0.001971311321735824}, "LF-norm-small_loop-000-ego0": {"driven_any": 16.67400835218989, "get_ui_image": 0.025767689640575603, "step_physics": 0.12227096486151168, "survival_time": 59.99999999999873, "driven_lanedir": 11.131247497398268, "get_state_dump": 0.004432714154182326, "get_robot_state": 0.0035027472998677045, "sim_render-ego0": 0.003655004064605992, "get_duckie_state": 1.6550338834052678e-06, "in-drivable-lane": 16.549999999999727, "deviation-heading": 14.39462063057716, "agent_compute-ego0": 0.01225793411292998, "complete-iteration": 0.1821957236027142, "set_robot_commands": 0.0021092417238157656, "deviation-center-line": 4.202420503918291, "driven_lanedir_consec": 9.912620043024818, "sim_compute_sim_state": 0.00623561361250929, "sim_compute_performance-ego0": 0.0018958009152884884}}
set_robot_commands_max	0.002218033893998847
set_robot_commands_mean	0.0021272585170114
set_robot_commands_median	0.0021023617298974286
set_robot_commands_min	0.002086276714251897
sim_compute_performance-ego0_max	0.001971311321735824
sim_compute_performance-ego0_mean	0.001905439945847676
sim_compute_performance-ego0_median	0.001900132748606203
sim_compute_performance-ego0_min	0.001850182964442473
sim_compute_sim_state_max	0.014230130887672346
sim_compute_sim_state_mean	0.01090415319029278
sim_compute_sim_state_median	0.01157543413049474
sim_compute_sim_state_min	0.00623561361250929
sim_render-ego0_max	0.0037961386220117096
sim_render-ego0_mean	0.003679895899656943
sim_render-ego0_median	0.003674235371725446
sim_render-ego0_min	0.0035749742331651724
simulation-passed	1
step_physics_max	0.17299302372706124
step_physics_mean	0.14624948478406086
step_physics_median	0.14486697527383524
step_physics_min	0.12227096486151168
survival_time_max	59.99999999999873
survival_time_mean	58.474999999998815
survival_time_min	53.899999999999075

No reset possible

54403

11552

Himanshu Arora 🇨🇦

sim-exercise-2

LFv-sim

success

yes

2020-12-03 02:49:24+00:00

2020-12-03 03:15:38+00:00

0:26:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.9654218722199
survival_time_median	59.99999999999873
deviation-center-line_median	3.741859183712717
in-drivable-lane_median	5.524999999999888

other stats

agent_compute-ego0_max	0.011644382262408584
agent_compute-ego0_mean	0.011403279704946574
agent_compute-ego0_median	0.011564369701922287
agent_compute-ego0_min	0.010839997153533131
complete-iteration_max	0.22506377571507505
complete-iteration_mean	0.1838064808422157
complete-iteration_median	0.1800200977889227
complete-iteration_min	0.15012195207594237
deviation-center-line_max	3.961314219254884
deviation-center-line_mean	2.87334178432646
deviation-center-line_min	0.04833455062552379
deviation-heading_max	13.806995661669
deviation-heading_mean	9.740786032435452
deviation-heading_median	12.311458476849666
deviation-heading_min	0.5332315143734739
driven_any_max	17.000116473165235
driven_any_mean	11.931968198283643
driven_any_median	14.57489321035142
driven_any_min	1.577969899266508
driven_lanedir_consec_max	15.37430780032076
driven_lanedir_consec_mean	9.39732171368956
driven_lanedir_consec_min	0.2841353099976853
driven_lanedir_max	15.612003567244091
driven_lanedir_mean	10.406343828893474
driven_lanedir_median	12.86461821916606
driven_lanedir_min	0.2841353099976853
get_duckie_state_max	1.1468310836550597e-06
get_duckie_state_mean	1.134039489104655e-06
get_duckie_state_median	1.137427007124423e-06
get_duckie_state_min	1.1144728585147145e-06
get_robot_state_max	0.0035308536939279525
get_robot_state_mean	0.0034723261763798877
get_robot_state_median	0.0034550673068888824
get_robot_state_min	0.0034483163978138334
get_state_dump_max	0.004353652091744937
get_state_dump_mean	0.004301101889086938
get_state_dump_median	0.0042892494004031535
get_state_dump_min	0.004272256663796507
get_ui_image_max	0.03600288535419263
get_ui_image_mean	0.030334664041712648
get_ui_image_median	0.03007557638281093
get_ui_image_min	0.0251846180470361
in-drivable-lane_max	6.349999999999981
in-drivable-lane_mean	5.662499999999929
in-drivable-lane_min	5.249999999999958
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 17.000116473165235, "get_ui_image": 0.028258358806892796, "step_physics": 0.10927836781834484, "survival_time": 59.99999999999873, "driven_lanedir": 15.612003567244091, "get_state_dump": 0.004353652091744937, "get_robot_state": 0.0035308536939279525, "sim_render-ego0": 0.003648685674484723, "get_duckie_state": 1.1144728585147145e-06, "in-drivable-lane": 5.3999999999998405, "deviation-heading": 12.665727300239512, "agent_compute-ego0": 0.011611197413651773, "complete-iteration": 0.17401230186348057, "set_robot_commands": 0.0021728577959249655, "deviation-center-line": 3.8695292786468594, "driven_lanedir_consec": 15.37430780032076, "sim_compute_sim_state": 0.009197888028909524, "sim_compute_performance-ego0": 0.0018869290046151929}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.577969899266508, "get_ui_image": 0.03600288535419263, "step_physics": 0.15344708059963427, "survival_time": 7.549999999999981, "driven_lanedir": 0.2841353099976853, "get_state_dump": 0.004273334616108944, "get_robot_state": 0.003448971007999621, "sim_render-ego0": 0.003531554811879208, "get_duckie_state": 1.1403309671502364e-06, "in-drivable-lane": 6.349999999999981, "deviation-heading": 0.5332315143734739, "agent_compute-ego0": 0.010839997153533131, "complete-iteration": 0.22506377571507505, "set_robot_commands": 0.002021008416226036, "deviation-center-line": 0.04833455062552379, "driven_lanedir_consec": 0.2841353099976853, "sim_compute_sim_state": 0.009602331801464683, "sim_compute_performance-ego0": 0.001825872220491108}, "LF-norm-techtrack-000-ego0": {"driven_any": 13.116718896742624, "get_ui_image": 0.03189279395872906, "step_physics": 0.1150104112172504, "survival_time": 59.99999999999873, "driven_lanedir": 11.646336456439434, "get_state_dump": 0.004272256663796507, "get_robot_state": 0.003461163605778144, "sim_render-ego0": 0.003573266592351324, "get_duckie_state": 1.1468310836550597e-06, "in-drivable-lane": 5.649999999999937, "deviation-heading": 11.95718965345982, "agent_compute-ego0": 0.011644382262408584, "complete-iteration": 0.1860278937143648, "set_robot_commands": 0.0020742491818189026, "deviation-center-line": 3.6141890887785735, "driven_lanedir_consec": 10.735426097022088, "sim_compute_sim_state": 0.012188912033538436, "sim_compute_performance-ego0": 0.0018397374117404197}, "LF-norm-small_loop-000-ego0": {"driven_any": 16.033067523960217, "get_ui_image": 0.0251846180470361, "step_physics": 0.09221228870325145, "survival_time": 59.99999999999873, "driven_lanedir": 14.082899981892693, "get_state_dump": 0.0043051641846973635, "get_robot_state": 0.0034483163978138334, "sim_render-ego0": 0.003545784731887957, "get_duckie_state": 1.1345230470986092e-06, "in-drivable-lane": 5.249999999999958, "deviation-heading": 13.806995661669, "agent_compute-ego0": 0.011517541990192804, "complete-iteration": 0.15012195207594237, "set_robot_commands": 0.0021074653962172636, "deviation-center-line": 3.961314219254884, "driven_lanedir_consec": 11.19541764741771, "sim_compute_sim_state": 0.005914620217633783, "sim_compute_performance-ego0": 0.0018159876655877184}}
set_robot_commands_max	0.0021728577959249655
set_robot_commands_mean	0.002093895197546792
set_robot_commands_median	0.002090857289018083
set_robot_commands_min	0.002021008416226036
sim_compute_performance-ego0_max	0.0018869290046151929
sim_compute_performance-ego0_mean	0.0018421315756086095
sim_compute_performance-ego0_median	0.001832804816115764
sim_compute_performance-ego0_min	0.0018159876655877184
sim_compute_sim_state_max	0.012188912033538436
sim_compute_sim_state_mean	0.009225938020386609
sim_compute_sim_state_median	0.009400109915187103
sim_compute_sim_state_min	0.005914620217633783
sim_render-ego0_max	0.003648685674484723
sim_render-ego0_mean	0.003574822952650803
sim_render-ego0_median	0.0035595256621196404
sim_render-ego0_min	0.003531554811879208
simulation-passed	1
step_physics_max	0.15344708059963427
step_physics_mean	0.11748703708462024
step_physics_median	0.11214438951779762
step_physics_min	0.09221228870325145
survival_time_max	59.99999999999873
survival_time_mean	46.88749999999904
survival_time_min	7.549999999999981

No reset possible

54278

11608

exercise_state_estimation

LFv-sim

success

yes

2020-12-03 02:15:25+00:00

2020-12-03 02:48:35+00:00

0:33:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.9760237174689
survival_time_median	59.99999999999873
deviation-center-line_median	3.2119399844996774
in-drivable-lane_median	11.024999999999682

other stats

agent_compute-ego0_max	0.012694694517454835
agent_compute-ego0_mean	0.012383862983960192
agent_compute-ego0_median	0.012344835402070237
agent_compute-ego0_min	0.01215108661424546
complete-iteration_max	0.260992488690785
complete-iteration_mean	0.20719990032410757
complete-iteration_median	0.19620357594025525
complete-iteration_min	0.17539996072513475
deviation-center-line_max	4.306250892893054
deviation-center-line_mean	2.798837786488437
deviation-center-line_min	0.465220284061339
deviation-heading_max	17.109233409446524
deviation-heading_mean	10.76811920810003
deviation-heading_median	11.857817087262417
deviation-heading_min	2.2476092484287644
driven_any_max	7.920593945590803
driven_any_mean	6.163103453840404
driven_any_median	7.88069869886952
driven_any_min	0.9704224720317708
driven_lanedir_consec_max	5.397830055742758
driven_lanedir_consec_mean	3.000453480203721
driven_lanedir_consec_min	0.6519364301343251
driven_lanedir_max	6.50262307736312
driven_lanedir_mean	3.703246767438386
driven_lanedir_median	3.8292137811280496
driven_lanedir_min	0.6519364301343251
get_duckie_state_max	1.6867965583896558e-06
get_duckie_state_mean	1.5987703459036257e-06
get_duckie_state_median	1.6048410580588448e-06
get_duckie_state_min	1.4986027091071568e-06
get_robot_state_max	0.0036115326750387655
get_robot_state_mean	0.0035183387677966637
get_robot_state_median	0.0034900631733877675
get_robot_state_min	0.003481696049372355
get_state_dump_max	0.0044086023135348025
get_state_dump_mean	0.004319646422440733
get_state_dump_median	0.004296385966825389
get_state_dump_min	0.004277211442577353
get_ui_image_max	0.03505557207834153
get_ui_image_mean	0.02985633388123256
get_ui_image_median	0.029646225515551412
get_ui_image_min	0.025077312415485876
in-drivable-lane_max	37.949999999999065
in-drivable-lane_mean	15.637499999999608
in-drivable-lane_min	2.5499999999999963
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.8412429867117295, "get_ui_image": 0.0277303964470348, "step_physics": 0.11382083352856792, "survival_time": 59.99999999999873, "driven_lanedir": 6.50262307736312, "get_state_dump": 0.0044086023135348025, "get_robot_state": 0.0036115326750387655, "sim_render-ego0": 0.0037035660183896233, "get_duckie_state": 1.4986027091071568e-06, "in-drivable-lane": 8.399999999999853, "deviation-heading": 11.002252157421523, "agent_compute-ego0": 0.012502350080618752, "complete-iteration": 0.17996756182820672, "set_robot_commands": 0.0021710258836452412, "deviation-center-line": 4.104968185803567, "driven_lanedir_consec": 3.691449928424458, "sim_compute_sim_state": 0.01002144436355832, "sim_compute_performance-ego0": 0.0019231319030456797}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.9704224720317708, "get_ui_image": 0.03505557207834153, "step_physics": 0.1882998872370947, "survival_time": 8.349999999999984, "driven_lanedir": 0.6519364301343251, "get_state_dump": 0.004281605992998395, "get_robot_state": 0.003481696049372355, "sim_render-ego0": 0.0035732856818607877, "get_duckie_state": 1.643385205950056e-06, "in-drivable-lane": 2.5499999999999963, "deviation-heading": 2.2476092484287644, "agent_compute-ego0": 0.01215108661424546, "complete-iteration": 0.260992488690785, "set_robot_commands": 0.002088653189795358, "deviation-center-line": 0.465220284061339, "driven_lanedir_consec": 0.6519364301343251, "sim_compute_sim_state": 0.010144296146574475, "sim_compute_performance-ego0": 0.001837544497989473}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.920593945590803, "get_ui_image": 0.03156205458406802, "step_physics": 0.13979914762098328, "survival_time": 59.99999999999873, "driven_lanedir": 5.397830055742758, "get_state_dump": 0.004277211442577353, "get_robot_state": 0.0034840418635359613, "sim_render-ego0": 0.003577287151454192, "get_duckie_state": 1.6867965583896558e-06, "in-drivable-lane": 13.649999999999512, "deviation-heading": 17.109233409446524, "agent_compute-ego0": 0.012694694517454835, "complete-iteration": 0.21243959005230373, "set_robot_commands": 0.0020684080258892737, "deviation-center-line": 4.306250892893054, "driven_lanedir_consec": 5.397830055742758, "sim_compute_sim_state": 0.0130487870018647, "sim_compute_performance-ego0": 0.0018490688886173955}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920154411027311, "get_ui_image": 0.025077312415485876, "step_physics": 0.11672611180987584, "survival_time": 59.99999999999873, "driven_lanedir": 2.2605975065133412, "get_state_dump": 0.004311165940652382, "get_robot_state": 0.003496084483239574, "sim_render-ego0": 0.003598426402756614, "get_duckie_state": 1.5662969101676337e-06, "in-drivable-lane": 37.949999999999065, "deviation-heading": 12.713382017103308, "agent_compute-ego0": 0.01218732072352172, "complete-iteration": 0.17539996072513475, "set_robot_commands": 0.0020889642335890136, "deviation-center-line": 2.318911783195788, "driven_lanedir_consec": 2.2605975065133412, "sim_compute_sim_state": 0.005983217868280847, "sim_compute_performance-ego0": 0.0018535404777050416}}
set_robot_commands_max	0.0021710258836452412
set_robot_commands_mean	0.0021042628332297213
set_robot_commands_median	0.002088808711692186
set_robot_commands_min	0.0020684080258892737
sim_compute_performance-ego0_max	0.0019231319030456797
sim_compute_performance-ego0_mean	0.0018658214418393972
sim_compute_performance-ego0_median	0.0018513046831612188
sim_compute_performance-ego0_min	0.001837544497989473
sim_compute_sim_state_max	0.0130487870018647
sim_compute_sim_state_mean	0.009799436345069586
sim_compute_sim_state_median	0.0100828702550664
sim_compute_sim_state_min	0.005983217868280847
sim_render-ego0_max	0.0037035660183896233
sim_render-ego0_mean	0.003613141313615304
sim_render-ego0_median	0.003587856777105403
sim_render-ego0_min	0.0035732856818607877
simulation-passed	1
step_physics_max	0.1882998872370947
step_physics_mean	0.13966149504913045
step_physics_median	0.12826262971542957
step_physics_min	0.11382083352856792
survival_time_max	59.99999999999873
survival_time_mean	47.08749999999905
survival_time_min	8.349999999999984

No reset possible

54199

11636

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

yes

2020-12-03 01:49:42+00:00

2020-12-03 02:14:56+00:00

0:25:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.0210677030997015
survival_time_median	53.27499999999911
deviation-center-line_median	1.4150165423214784
in-drivable-lane_median	19.649999999999615

other stats

agent_compute-ego0_max	0.012819492765762264
agent_compute-ego0_mean	0.012519717534175445
agent_compute-ego0_median	0.012497857727563124
agent_compute-ego0_min	0.01226366191581326
complete-iteration_max	0.21327875824104803
complete-iteration_mean	0.18429956344748555
complete-iteration_median	0.1868307673530425
complete-iteration_min	0.15025796084280912
deviation-center-line_max	2.3599190817028837
deviation-center-line_mean	1.4360283743809434
deviation-center-line_min	0.554161331177933
deviation-heading_max	11.218649027368048
deviation-heading_mean	6.334775048949349
deviation-heading_median	5.834382639869597
deviation-heading_min	2.451685888690156
driven_any_max	12.209920853264054
driven_any_mean	8.845166589567048
driven_any_median	10.373114488178288
driven_any_min	2.4245165286475623
driven_lanedir_consec_max	7.860322730057282
driven_lanedir_consec_mean	4.326352681484952
driven_lanedir_consec_min	1.4029525896831234
driven_lanedir_max	8.359147634483252
driven_lanedir_mean	4.453069656874692
driven_lanedir_median	4.0210677030997015
driven_lanedir_min	1.410995586816109
get_duckie_state_max	1.2043719639593952e-06
get_duckie_state_mean	1.1880568820198654e-06
get_duckie_state_median	1.1868322024635233e-06
get_duckie_state_min	1.1741911591930197e-06
get_robot_state_max	0.0035596694557451895
get_robot_state_mean	0.003500828065411845
get_robot_state_median	0.003497217831785881
get_robot_state_min	0.003449207142330427
get_state_dump_max	0.004534231235029359
get_state_dump_mean	0.00438476263532551
get_state_dump_median	0.004359069705141241
get_state_dump_min	0.0042866798959901985
get_ui_image_max	0.03598666109729545
get_ui_image_mean	0.03064678851109777
get_ui_image_median	0.03046389975594838
get_ui_image_min	0.025672693435198856
in-drivable-lane_max	52.29999999999867
in-drivable-lane_mean	24.31249999999949
in-drivable-lane_min	5.650000000000059
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.27212651978214, "get_ui_image": 0.02847519555316974, "step_physics": 0.11524202511545928, "survival_time": 46.54999999999949, "driven_lanedir": 6.329879435484223, "get_state_dump": 0.004534231235029359, "get_robot_state": 0.0035596694557451895, "sim_render-ego0": 0.003774401967617575, "get_duckie_state": 1.2043719639593952e-06, "in-drivable-lane": 17.399999999999288, "deviation-heading": 7.649889776253771, "agent_compute-ego0": 0.012819492765762264, "complete-iteration": 0.1817399158498248, "set_robot_commands": 0.0021423467239085185, "deviation-center-line": 2.1593635234366086, "driven_lanedir_consec": 6.329879435484223, "sim_compute_sim_state": 0.009184003132095664, "sim_compute_performance-ego0": 0.0019337611648657803}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.4245165286475623, "get_ui_image": 0.03598666109729545, "step_physics": 0.13922278384706674, "survival_time": 14.600000000000072, "driven_lanedir": 1.410995586816109, "get_state_dump": 0.0043931576985954835, "get_robot_state": 0.003513839057688013, "sim_render-ego0": 0.00363611605387092, "get_duckie_state": 1.1741911591930197e-06, "in-drivable-lane": 5.650000000000059, "deviation-heading": 4.018875503485422, "agent_compute-ego0": 0.012457681597296289, "complete-iteration": 0.21327875824104803, "set_robot_commands": 0.0020545985511545434, "deviation-center-line": 0.6706695612063481, "driven_lanedir_consec": 1.4029525896831234, "sim_compute_sim_state": 0.010078212100084324, "sim_compute_performance-ego0": 0.0018617472144117127}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.209920853264054, "get_ui_image": 0.03245260395872702, "step_physics": 0.11959279863959446, "survival_time": 59.99999999999873, "driven_lanedir": 8.359147634483252, "get_state_dump": 0.0042866798959901985, "get_robot_state": 0.003449207142330427, "sim_render-ego0": 0.0035876707669400256, "get_duckie_state": 1.1817700261378863e-06, "in-drivable-lane": 21.89999999999994, "deviation-heading": 11.218649027368048, "agent_compute-ego0": 0.012538033857829962, "complete-iteration": 0.1919216188562601, "set_robot_commands": 0.0020755155199671865, "deviation-center-line": 2.3599190817028837, "driven_lanedir_consec": 7.860322730057282, "sim_compute_sim_state": 0.012039109133959412, "sim_compute_performance-ego0": 0.001827885368086714}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.474102456574435, "get_ui_image": 0.025672693435198856, "step_physics": 0.09089680277834725, "survival_time": 59.99999999999873, "driven_lanedir": 1.71225597071518, "get_state_dump": 0.004324981711686998, "get_robot_state": 0.0034805966058837484, "sim_render-ego0": 0.003600424275013132, "get_duckie_state": 1.1918943787891602e-06, "in-drivable-lane": 52.29999999999867, "deviation-heading": 2.451685888690156, "agent_compute-ego0": 0.01226366191581326, "complete-iteration": 0.15025796084280912, "set_robot_commands": 0.002026811825246438, "deviation-center-line": 0.554161331177933, "driven_lanedir_consec": 1.71225597071518, "sim_compute_sim_state": 0.006087267825645173, "sim_compute_performance-ego0": 0.001831851533608671}}
set_robot_commands_max	0.0021423467239085185
set_robot_commands_mean	0.002074818155069172
set_robot_commands_median	0.002065057035560865
set_robot_commands_min	0.002026811825246438
sim_compute_performance-ego0_max	0.0019337611648657803
sim_compute_performance-ego0_mean	0.0018638113202432197
sim_compute_performance-ego0_median	0.001846799374010192
sim_compute_performance-ego0_min	0.001827885368086714
sim_compute_sim_state_max	0.012039109133959412
sim_compute_sim_state_mean	0.009347148047946143
sim_compute_sim_state_median	0.009631107616089997
sim_compute_sim_state_min	0.006087267825645173
sim_render-ego0_max	0.003774401967617575
sim_render-ego0_mean	0.003649653265860413
sim_render-ego0_median	0.0036182701644420262
sim_render-ego0_min	0.0035876707669400256
simulation-passed	1
step_physics_max	0.13922278384706674
step_physics_mean	0.11623860259511692
step_physics_median	0.11741741187752686
step_physics_min	0.09089680277834725
survival_time_max	59.99999999999873
survival_time_mean	45.287499999999255
survival_time_min	14.600000000000072

No reset possible

53875

12643

Bea Baselines 🐤

template-pytorch

LFVmultibodyv-sim

success

yes

2020-12-02 23:34:29+00:00

2020-12-03 01:49:07+00:00

2:14:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9884741295813332
survival_time_median	59.99999999999873
deviation-center-line_median	1.6869417722911018
in-drivable-lane_median	40.82499999999885

other stats

agent_compute-ego0_max	0.015862491506025457
agent_compute-ego0_mean	0.01331177208161856
agent_compute-ego0_median	0.012930740226218346
agent_compute-ego0_min	0.011817524772599576
agent_compute-ego1_max	0.011858659223354825
agent_compute-ego1_mean	0.011379878558116565
agent_compute-ego1_median	0.011300503463173388
agent_compute-ego1_min	0.01103389273078912
agent_compute-ego2_max	0.01218581358459371
agent_compute-ego2_mean	0.011425795900533836
agent_compute-ego2_median	0.011265026341866297
agent_compute-ego2_min	0.010826547775141504
agent_compute-ego3_max	0.01138636690690853
agent_compute-ego3_mean	0.011132247905217704
agent_compute-ego3_median	0.011025125835459991
agent_compute-ego3_min	0.010985250973284592
complete-iteration_max	1.3385350317085514
complete-iteration_mean	1.138740836106399
complete-iteration_median	1.2771563246089357
complete-iteration_min	0.4034838726081816
deviation-center-line_max	2.782713727043242
deviation-center-line_mean	1.5065086973219544
deviation-center-line_min	0.06480231930509503
deviation-heading_max	23.00442407461409
deviation-heading_mean	13.56613914753582
deviation-heading_median	15.233554173497872
deviation-heading_min	0.6866504584270209
driven_any_max	9.57495344195894
driven_any_mean	5.049082865416262
driven_any_median	4.804023708951546
driven_any_min	0.2162730990379674
driven_lanedir_consec_max	1.637483221139553
driven_lanedir_consec_mean	0.9096758584503924
driven_lanedir_consec_min	0.10620327390227402
driven_lanedir_max	1.8002422720037723
driven_lanedir_mean	0.9725108762961538
driven_lanedir_median	0.9884741295813332
driven_lanedir_min	0.10620327390227402
get_duckie_state_max	1.1764100747342708e-06
get_duckie_state_mean	1.1594227155238704e-06
get_duckie_state_median	1.1742263908290942e-06
get_duckie_state_min	1.124597211165988e-06
get_robot_state_max	0.014064460273190004
get_robot_state_mean	0.01294032637168582
get_robot_state_median	0.01391595249668347
get_robot_state_min	0.00701660796267901
get_state_dump_max	0.009485656871684484
get_state_dump_mean	0.008895786222328794
get_state_dump_median	0.00935316324035492
get_state_dump_min	0.0060566196235193005
get_ui_image_max	0.04893119368922403
get_ui_image_mean	0.043182219735249126
get_ui_image_median	0.0460148915760126
get_ui_image_min	0.029304719983687708
in-drivable-lane_max	58.64999999999874
in-drivable-lane_mean	42.78571428571325
in-drivable-lane_min	31.44999999999929
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 4.221466832791312, "get_ui_image": 0.041539323816291496, "step_physics": 1.0021302269261445, "survival_time": 59.99999999999873, "driven_lanedir": 0.7415536648172059, "get_state_dump": 0.00935316324035492, "get_robot_state": 0.01391595249668347, "sim_render-ego0": 0.003592098086799412, "sim_render-ego1": 0.003531210229954652, "sim_render-ego2": 0.0035223526124850994, "sim_render-ego3": 0.003558875122832617, "get_duckie_state": 1.1742263908290942e-06, "in-drivable-lane": 39.69999999999901, "deviation-heading": 16.892377204061, "agent_compute-ego0": 0.012930740226218346, "agent_compute-ego1": 0.011153465901485192, "agent_compute-ego2": 0.010826547775141504, "agent_compute-ego3": 0.011025125835459991, "complete-iteration": 1.1681596337508202, "set_robot_commands": 0.002116274575607465, "deviation-center-line": 2.584460742171308, "driven_lanedir_consec": 0.719509119455904, "sim_compute_sim_state": 0.025032194925287583, "sim_compute_performance-ego0": 0.0018844755364893675, "sim_compute_performance-ego1": 0.001854470131498491, "sim_compute_performance-ego2": 0.0018366339998777265, "sim_compute_performance-ego3": 0.0018443054799533304}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 6.324931889856341, "get_ui_image": 0.041539323816291496, "step_physics": 1.0021302269261445, "survival_time": 59.99999999999873, "driven_lanedir": 1.637483221139553, "get_state_dump": 0.00935316324035492, "get_robot_state": 0.01391595249668347, "sim_render-ego0": 0.003592098086799412, "sim_render-ego1": 0.003531210229954652, "sim_render-ego2": 0.0035223526124850994, "sim_render-ego3": 0.003558875122832617, "get_duckie_state": 1.1742263908290942e-06, "in-drivable-lane": 33.5499999999994, "deviation-heading": 20.67091630006453, "agent_compute-ego0": 0.012930740226218346, "agent_compute-ego1": 0.011153465901485192, "agent_compute-ego2": 0.010826547775141504, "agent_compute-ego3": 0.011025125835459991, "complete-iteration": 1.1681596337508202, "set_robot_commands": 0.002116274575607465, "deviation-center-line": 2.5610646865203397, "driven_lanedir_consec": 1.637483221139553, "sim_compute_sim_state": 0.025032194925287583, "sim_compute_performance-ego0": 0.0018844755364893675, "sim_compute_performance-ego1": 0.001854470131498491, "sim_compute_performance-ego2": 0.0018366339998777265, "sim_compute_performance-ego3": 0.0018443054799533304}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 4.572781361265547, "get_ui_image": 0.041539323816291496, "step_physics": 1.0021302269261445, "survival_time": 59.99999999999873, "driven_lanedir": 1.1276160522685272, "get_state_dump": 0.00935316324035492, "get_robot_state": 0.01391595249668347, "sim_render-ego0": 0.003592098086799412, "sim_render-ego1": 0.003531210229954652, "sim_render-ego2": 0.0035223526124850994, "sim_render-ego3": 0.003558875122832617, "get_duckie_state": 1.1742263908290942e-06, "in-drivable-lane": 48.49999999999862, "deviation-heading": 8.530770730636743, "agent_compute-ego0": 0.012930740226218346, "agent_compute-ego1": 0.011153465901485192, "agent_compute-ego2": 0.010826547775141504, "agent_compute-ego3": 0.011025125835459991, "complete-iteration": 1.1681596337508202, "set_robot_commands": 0.002116274575607465, "deviation-center-line": 0.9820125413389889, "driven_lanedir_consec": 1.1275633165248584, "sim_compute_sim_state": 0.025032194925287583, "sim_compute_performance-ego0": 0.0018844755364893675, "sim_compute_performance-ego1": 0.001854470131498491, "sim_compute_performance-ego2": 0.0018366339998777265, "sim_compute_performance-ego3": 0.0018443054799533304}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 3.1772537904083267, "get_ui_image": 0.041539323816291496, "step_physics": 1.0021302269261445, "survival_time": 59.99999999999873, "driven_lanedir": 0.941958145049233, "get_state_dump": 0.00935316324035492, "get_robot_state": 0.01391595249668347, "sim_render-ego0": 0.003592098086799412, "sim_render-ego1": 0.003531210229954652, "sim_render-ego2": 0.0035223526124850994, "sim_render-ego3": 0.003558875122832617, "get_duckie_state": 1.1742263908290942e-06, "in-drivable-lane": 44.799999999998576, "deviation-heading": 11.485587261835214, "agent_compute-ego0": 0.012930740226218346, "agent_compute-ego1": 0.011153465901485192, "agent_compute-ego2": 0.010826547775141504, "agent_compute-ego3": 0.011025125835459991, "complete-iteration": 1.1681596337508202, "set_robot_commands": 0.002116274575607465, "deviation-center-line": 0.9408337739084124, "driven_lanedir_consec": 0.941958145049233, "sim_compute_sim_state": 0.025032194925287583, "sim_compute_performance-ego0": 0.0018844755364893675, "sim_compute_performance-ego1": 0.001854470131498491, "sim_compute_performance-ego2": 0.0018366339998777265, "sim_compute_performance-ego3": 0.0018443054799533304}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.245226433009073, "get_ui_image": 0.04893119368922403, "step_physics": 1.145267730350796, "survival_time": 59.99999999999873, "driven_lanedir": 1.2665674242275973, "get_state_dump": 0.00926812185435172, "get_robot_state": 0.013802425549687396, "sim_render-ego0": 0.0035793678051823877, "sim_render-ego1": 0.00356676477278202, "sim_render-ego2": 0.003525659901017849, "sim_render-ego3": 0.003516059433987099, "get_duckie_state": 1.1450444331871877e-06, "in-drivable-lane": 31.44999999999929, "deviation-heading": 22.583343103081106, "agent_compute-ego0": 0.011889208167121372, "agent_compute-ego1": 0.011300503463173388, "agent_compute-ego2": 0.011265026341866297, "agent_compute-ego3": 0.010985250973284592, "complete-iteration": 1.3385350317085514, "set_robot_commands": 0.002080533228547845, "deviation-center-line": 2.1656525926382426, "driven_lanedir_consec": 1.2665674242275973, "sim_compute_sim_state": 0.045780785971140485, "sim_compute_performance-ego0": 0.001853700482180275, "sim_compute_performance-ego1": 0.0018413035101338688, "sim_compute_performance-ego2": 0.0018316591709082969, "sim_compute_performance-ego3": 0.001822351913070996}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 5.035266056637545, "get_ui_image": 0.04893119368922403, "step_physics": 1.145267730350796, "survival_time": 59.99999999999873, "driven_lanedir": 1.0291022899311306, "get_state_dump": 0.00926812185435172, "get_robot_state": 0.013802425549687396, "sim_render-ego0": 0.0035793678051823877, "sim_render-ego1": 0.00356676477278202, "sim_render-ego2": 0.003525659901017849, "sim_render-ego3": 0.003516059433987099, "get_duckie_state": 1.1450444331871877e-06, "in-drivable-lane": 42.59999999999884, "deviation-heading": 14.039033073863012, "agent_compute-ego0": 0.011889208167121372, "agent_compute-ego1": 0.011300503463173388, "agent_compute-ego2": 0.011265026341866297, "agent_compute-ego3": 0.010985250973284592, "complete-iteration": 1.3385350317085514, "set_robot_commands": 0.002080533228547845, "deviation-center-line": 1.6911023418253412, "driven_lanedir_consec": 1.0291022899311306, "sim_compute_sim_state": 0.045780785971140485, "sim_compute_performance-ego0": 0.001853700482180275, "sim_compute_performance-ego1": 0.0018413035101338688, "sim_compute_performance-ego2": 0.0018316591709082969, "sim_compute_performance-ego3": 0.001822351913070996}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.57495344195894, "get_ui_image": 0.04893119368922403, "step_physics": 1.145267730350796, "survival_time": 59.99999999999873, "driven_lanedir": 1.8002422720037723, "get_state_dump": 0.00926812185435172, "get_robot_state": 0.013802425549687396, "sim_render-ego0": 0.0035793678051823877, "sim_render-ego1": 0.00356676477278202, "sim_render-ego2": 0.003525659901017849, "sim_render-ego3": 0.003516059433987099, "get_duckie_state": 1.1450444331871877e-06, "in-drivable-lane": 41.59999999999898, "deviation-heading": 15.300483730600195, "agent_compute-ego0": 0.011889208167121372, "agent_compute-ego1": 0.011300503463173388, "agent_compute-ego2": 0.011265026341866297, "agent_compute-ego3": 0.010985250973284592, "complete-iteration": 1.3385350317085514, "set_robot_commands": 0.002080533228547845, "deviation-center-line": 1.5061620656049373, "driven_lanedir_consec": 1.306054329891055, "sim_compute_sim_state": 0.045780785971140485, "sim_compute_performance-ego0": 0.001853700482180275, "sim_compute_performance-ego1": 0.0018413035101338688, "sim_compute_performance-ego2": 0.0018316591709082969, "sim_compute_performance-ego3": 0.001822351913070996}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.709940922612449, "get_ui_image": 0.04893119368922403, "step_physics": 1.145267730350796, "survival_time": 59.99999999999873, "driven_lanedir": 0.10620327390227402, "get_state_dump": 0.00926812185435172, "get_robot_state": 0.013802425549687396, "sim_render-ego0": 0.0035793678051823877, "sim_render-ego1": 0.00356676477278202, "sim_render-ego2": 0.003525659901017849, "sim_render-ego3": 0.003516059433987099, "get_duckie_state": 1.1450444331871877e-06, "in-drivable-lane": 58.64999999999874, "deviation-heading": 0.6866504584270209, "agent_compute-ego0": 0.011889208167121372, "agent_compute-ego1": 0.011300503463173388, "agent_compute-ego2": 0.011265026341866297, "agent_compute-ego3": 0.010985250973284592, "complete-iteration": 1.3385350317085514, "set_robot_commands": 0.002080533228547845, "deviation-center-line": 0.1413985775695685, "driven_lanedir_consec": 0.10620327390227402, "sim_compute_sim_state": 0.045780785971140485, "sim_compute_performance-ego0": 0.001853700482180275, "sim_compute_performance-ego1": 0.0018413035101338688, "sim_compute_performance-ego2": 0.0018316591709082969, "sim_compute_performance-ego3": 0.001822351913070996}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 3.881275388850821, "get_ui_image": 0.0460148915760126, "step_physics": 1.0906622779061654, "survival_time": 59.99999999999873, "driven_lanedir": 0.947845969231536, "get_state_dump": 0.009485656871684484, "get_robot_state": 0.014064460273190004, "sim_render-ego0": 0.003631645594905754, "sim_render-ego1": 0.0035877003459311046, "sim_render-ego2": 0.003704539742894613, "sim_render-ego3": 0.0035648957378759073, "get_duckie_state": 1.1764100747342708e-06, "in-drivable-lane": 40.04999999999872, "deviation-heading": 15.16662461639555, "agent_compute-ego0": 0.015862491506025457, "agent_compute-ego1": 0.011858659223354825, "agent_compute-ego2": 0.01218581358459371, "agent_compute-ego3": 0.01138636690690853, "complete-iteration": 1.2771563246089357, "set_robot_commands": 0.002146344895565341, "deviation-center-line": 1.8666588814029428, "driven_lanedir_consec": 0.947845969231536, "sim_compute_sim_state": 0.03468417922821172, "sim_compute_performance-ego0": 0.0019282998887823583, "sim_compute_performance-ego1": 0.0018821483249966053, "sim_compute_performance-ego2": 0.0018987377716242323, "sim_compute_performance-ego3": 0.0019061295416432555}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 6.1719485129041605, "get_ui_image": 0.0460148915760126, "step_physics": 1.0906622779061654, "survival_time": 59.99999999999873, "driven_lanedir": 1.3704345896585612, "get_state_dump": 0.009485656871684484, "get_robot_state": 0.014064460273190004, "sim_render-ego0": 0.003631645594905754, "sim_render-ego1": 0.0035877003459311046, "sim_render-ego2": 0.003704539742894613, "sim_render-ego3": 0.0035648957378759073, "get_duckie_state": 1.1764100747342708e-06, "in-drivable-lane": 35.99999999999929, "deviation-heading": 18.49293099744935, "agent_compute-ego0": 0.015862491506025457, "agent_compute-ego1": 0.011858659223354825, "agent_compute-ego2": 0.01218581358459371, "agent_compute-ego3": 0.01138636690690853, "complete-iteration": 1.2771563246089357, "set_robot_commands": 0.002146344895565341, "deviation-center-line": 1.8868167199594357, "driven_lanedir_consec": 1.3704345896585612, "sim_compute_sim_state": 0.03468417922821172, "sim_compute_performance-ego0": 0.0019282998887823583, "sim_compute_performance-ego1": 0.0018821483249966053, "sim_compute_performance-ego2": 0.0018987377716242323, "sim_compute_performance-ego3": 0.0019061295416432555}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.2162730990379674, "get_ui_image": 0.0460148915760126, "step_physics": 1.0906622779061654, "survival_time": 59.99999999999873, "driven_lanedir": 0.14290052938467168, "get_state_dump": 0.009485656871684484, "get_robot_state": 0.014064460273190004, "sim_render-ego0": 0.003631645594905754, "sim_render-ego1": 0.0035877003459311046, "sim_render-ego2": 0.003704539742894613, "sim_render-ego3": 0.0035648957378759073, "get_duckie_state": 1.1764100747342708e-06, "in-drivable-lane": 58.44999999999872, "deviation-heading": 0.7958592119055209, "agent_compute-ego0": 0.015862491506025457, "agent_compute-ego1": 0.011858659223354825, "agent_compute-ego2": 0.01218581358459371, "agent_compute-ego3": 0.01138636690690853, "complete-iteration": 1.2771563246089357, "set_robot_commands": 0.002146344895565341, "deviation-center-line": 0.06480231930509503, "driven_lanedir_consec": 0.14290052938467168, "sim_compute_sim_state": 0.03468417922821172, "sim_compute_performance-ego0": 0.0019282998887823583, "sim_compute_performance-ego1": 0.0018821483249966053, "sim_compute_performance-ego2": 0.0018987377716242323, "sim_compute_performance-ego3": 0.0019061295416432555}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 6.092861754328063, "get_ui_image": 0.0460148915760126, "step_physics": 1.0906622779061654, "survival_time": 59.99999999999873, "driven_lanedir": 1.6000108587237034, "get_state_dump": 0.009485656871684484, "get_robot_state": 0.014064460273190004, "sim_render-ego0": 0.003631645594905754, "sim_render-ego1": 0.0035877003459311046, "sim_render-ego2": 0.003704539742894613, "sim_render-ego3": 0.0035648957378759073, "get_duckie_state": 1.1764100747342708e-06, "in-drivable-lane": 32.049999999999216, "deviation-heading": 23.00442407461409, "agent_compute-ego0": 0.015862491506025457, "agent_compute-ego1": 0.011858659223354825, "agent_compute-ego2": 0.01218581358459371, "agent_compute-ego3": 0.01138636690690853, "complete-iteration": 1.2771563246089357, "set_robot_commands": 0.002146344895565341, "deviation-center-line": 1.682781202756862, "driven_lanedir_consec": 1.2366058321007325, "sim_compute_sim_state": 0.03468417922821172, "sim_compute_performance-ego0": 0.0019282998887823583, "sim_compute_performance-ego1": 0.0018821483249966053, "sim_compute_performance-ego2": 0.0018987377716242323, "sim_compute_performance-ego3": 0.0019061295416432555}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.5852775819263174, "get_ui_image": 0.029304719983687708, "step_physics": 0.31344048109380135, "survival_time": 59.99999999999873, "driven_lanedir": 0.7559515986403552, "get_state_dump": 0.0060566196235193005, "get_robot_state": 0.00701660796267901, "sim_render-ego0": 0.003578884019939032, "sim_render-ego1": 0.003557514489242973, "get_duckie_state": 1.124597211165988e-06, "in-drivable-lane": 33.69999999999929, "deviation-heading": 20.91343266363293, "agent_compute-ego0": 0.011817524772599576, "agent_compute-ego1": 0.01103389273078912, "complete-iteration": 0.4034838726081816, "set_robot_commands": 0.0021078600474539444, "deviation-center-line": 2.782713727043242, "driven_lanedir_consec": 0.7559515986403552, "sim_compute_sim_state": 0.00965240674650143, "sim_compute_performance-ego0": 0.001860919542654071, "sim_compute_performance-ego1": 0.001836083115983466}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 6.877703050240796, "get_ui_image": 0.029304719983687708, "step_physics": 0.31344048109380135, "survival_time": 59.99999999999873, "driven_lanedir": 0.14728237916803266, "get_state_dump": 0.0060566196235193005, "get_robot_state": 0.00701660796267901, "sim_render-ego0": 0.003578884019939032, "sim_render-ego1": 0.003557514489242973, "get_duckie_state": 1.124597211165988e-06, "in-drivable-lane": 57.89999999999873, "deviation-heading": 1.3635146389352115, "agent_compute-ego0": 0.011817524772599576, "agent_compute-ego1": 0.01103389273078912, "complete-iteration": 0.4034838726081816, "set_robot_commands": 0.0021078600474539444, "deviation-center-line": 0.2346615904626487, "driven_lanedir_consec": 0.14728237916803266, "sim_compute_sim_state": 0.00965240674650143, "sim_compute_performance-ego0": 0.001860919542654071, "sim_compute_performance-ego1": 0.001836083115983466}}
set_robot_commands_max	0.002146344895565341
set_robot_commands_mean	0.0021134522066993213
set_robot_commands_median	0.002116274575607465
set_robot_commands_min	0.002080533228547845
sim_compute_performance-ego0_max	0.0019282998887823583
sim_compute_performance-ego0_mean	0.001884838765365439
sim_compute_performance-ego0_median	0.0018844755364893675
sim_compute_performance-ego0_min	0.001853700482180275
sim_compute_performance-ego1_max	0.0018821483249966053
sim_compute_performance-ego1_mean	0.0018559895784630565
sim_compute_performance-ego1_median	0.001854470131498491
sim_compute_performance-ego1_min	0.001836083115983466
sim_compute_performance-ego2_max	0.0018987377716242323
sim_compute_performance-ego2_mean	0.001855676980803418
sim_compute_performance-ego2_median	0.0018366339998777265
sim_compute_performance-ego2_min	0.0018316591709082969
sim_compute_performance-ego3_max	0.0019061295416432555
sim_compute_performance-ego3_mean	0.0018575956448891936
sim_compute_performance-ego3_median	0.0018443054799533304
sim_compute_performance-ego3_min	0.001822351913070996
sim_compute_sim_state_max	0.045780785971140485
sim_compute_sim_state_mean	0.03152096099939728
sim_compute_sim_state_median	0.03468417922821172
sim_compute_sim_state_min	0.00965240674650143
sim_render-ego0_max	0.003631645594905754
sim_render-ego0_mean	0.0035978724276734477
sim_render-ego0_median	0.003592098086799412
sim_render-ego0_min	0.003578884019939032
sim_render-ego1_max	0.0035877003459311046
sim_render-ego1_mean	0.003561266455225503
sim_render-ego1_median	0.00356676477278202
sim_render-ego1_min	0.003531210229954652
sim_render-ego2_max	0.003704539742894613
sim_render-ego2_mean	0.003584184085465854
sim_render-ego2_median	0.003525659901017849
sim_render-ego2_min	0.0035223526124850994
sim_render-ego3_max	0.0035648957378759073
sim_render-ego3_mean	0.003546610098231874
sim_render-ego3_median	0.003558875122832617
sim_render-ego3_min	0.003516059433987099
simulation-passed	1
step_physics_max	1.145267730350796
step_physics_mean	0.969937278780002
step_physics_median	1.0906622779061654
step_physics_min	0.31344048109380135
survival_time_max	59.99999999999873
survival_time_mean	59.999999999998735
survival_time_min	59.99999999999873

No reset possible

53866

12645

Bea Baselines 🐤

template-pytorch

LFVIv-sim

success

yes

2020-12-02 23:27:51+00:00

2020-12-02 23:33:50+00:00

0:05:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1144032614242605
survival_time_median	12.125000000000089
deviation-center-line_median	0.22352295467604644
in-drivable-lane_median	9.025000000000086

other stats

agent_compute-ego0_max	0.01365658144156138
agent_compute-ego0_mean	0.01277264239282072
agent_compute-ego0_median	0.01277264239282072
agent_compute-ego0_min	0.011888703344080062
complete-iteration_max	0.34813287535126497
complete-iteration_mean	0.3440867398123716
complete-iteration_median	0.3440867398123716
complete-iteration_min	0.3400406042734782
deviation-center-line_max	0.4016957648852674
deviation-center-line_mean	0.22352295467604644
deviation-center-line_min	0.04535014446682544
deviation-heading_max	4.082260756992982
deviation-heading_mean	2.345232875630243
deviation-heading_median	2.345232875630243
deviation-heading_min	0.6082049942675046
driven_any_max	1.3394176949128695
driven_any_mean	0.6901858273471112
driven_any_median	0.6901858273471112
driven_any_min	0.04095395978135293
driven_lanedir_consec_max	0.2147529883346131
driven_lanedir_consec_mean	0.1144032614242605
driven_lanedir_consec_min	0.014053534513907897
driven_lanedir_max	0.2147529883346131
driven_lanedir_mean	0.1144032614242605
driven_lanedir_median	0.1144032614242605
driven_lanedir_min	0.014053534513907897
get_duckie_state_max	1.0780430057325775e-06
get_duckie_state_mean	1.0332433491289029e-06
get_duckie_state_median	1.0332433491289029e-06
get_duckie_state_min	9.884436925252278e-07
get_robot_state_max	0.003678361574808757
get_robot_state_mean	0.003620496145594545
get_robot_state_median	0.003620496145594545
get_robot_state_min	0.003562630716380334
get_state_dump_max	0.004525487621625264
get_state_dump_mean	0.0045169738256397255
get_state_dump_median	0.0045169738256397255
get_state_dump_min	0.004508460029654188
get_ui_image_max	0.03865729812065941
get_ui_image_mean	0.038486470993758154
get_ui_image_median	0.038486470993758154
get_ui_image_min	0.038315643866856895
in-drivable-lane_max	16.400000000000173
in-drivable-lane_mean	9.025000000000086
in-drivable-lane_min	1.6499999999999997
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.04095395978135293, "get_ui_image": 0.038315643866856895, "step_physics": 0.2630966355403264, "survival_time": 2.3499999999999996, "driven_lanedir": 0.014053534513907897, "get_state_dump": 0.004525487621625264, "get_robot_state": 0.003678361574808757, "sim_render-ego0": 0.003741621971130371, "get_duckie_state": 9.884436925252278e-07, "in-drivable-lane": 1.6499999999999997, "deviation-heading": 0.6082049942675046, "agent_compute-ego0": 0.01365658144156138, "complete-iteration": 0.3400406042734782, "set_robot_commands": 0.002161512772242228, "deviation-center-line": 0.04535014446682544, "driven_lanedir_consec": 0.014053534513907897, "sim_compute_sim_state": 0.00882814327875773, "sim_compute_performance-ego0": 0.001965259512265523}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.3394176949128695, "get_ui_image": 0.03865729812065941, "step_physics": 0.2702482583039442, "survival_time": 21.900000000000176, "driven_lanedir": 0.2147529883346131, "get_state_dump": 0.004508460029654188, "get_robot_state": 0.003562630716380334, "sim_render-ego0": 0.003800934159402695, "get_duckie_state": 1.0780430057325775e-06, "in-drivable-lane": 16.400000000000173, "deviation-heading": 4.082260756992982, "agent_compute-ego0": 0.011888703344080062, "complete-iteration": 0.34813287535126497, "set_robot_commands": 0.002219145824806022, "deviation-center-line": 0.4016957648852674, "driven_lanedir_consec": 0.2147529883346131, "sim_compute_sim_state": 0.01119965735763515, "sim_compute_performance-ego0": 0.0019737658576704648}}
set_robot_commands_max	0.002219145824806022
set_robot_commands_mean	0.002190329298524125
set_robot_commands_median	0.002190329298524125
set_robot_commands_min	0.002161512772242228
sim_compute_performance-ego0_max	0.0019737658576704648
sim_compute_performance-ego0_mean	0.0019695126849679943
sim_compute_performance-ego0_median	0.0019695126849679943
sim_compute_performance-ego0_min	0.001965259512265523
sim_compute_sim_state_max	0.01119965735763515
sim_compute_sim_state_mean	0.01001390031819644
sim_compute_sim_state_median	0.01001390031819644
sim_compute_sim_state_min	0.00882814327875773
sim_render-ego0_max	0.003800934159402695
sim_render-ego0_mean	0.003771278065266533
sim_render-ego0_median	0.003771278065266533
sim_render-ego0_min	0.003741621971130371
simulation-passed	1
step_physics_max	0.2702482583039442
step_physics_mean	0.2666724469221353
step_physics_median	0.2666724469221353
step_physics_min	0.2630966355403264
survival_time_max	21.900000000000176
survival_time_mean	12.125000000000089
survival_time_min	2.3499999999999996

No reset possible

53824

12651

Bea Baselines 🐤

template-pytorch

LFVIt-sim

success

yes

aido5-LFV-sim-validation

2020-12-02 22:50:53+00:00

2020-12-02 23:27:42+00:00

0:36:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4753802716945893
survival_time_median	31.59999999999936
deviation-center-line_median	0.9147239258537564
in-drivable-lane_median	20.149999999999626

other stats

agent_compute-ego0_max	0.012324650023600938
agent_compute-ego0_mean	0.011925439427482748
agent_compute-ego0_median	0.011925439427482748
agent_compute-ego0_min	0.011526228831364558
agent_compute-npc0_max	0.044678492510348534
agent_compute-npc0_mean	0.04339223034612604
agent_compute-npc0_median	0.04339223034612604
agent_compute-npc0_min	0.04210596818190355
agent_compute-npc1_max	0.04428372990578835
agent_compute-npc1_mean	0.037377896045024395
agent_compute-npc1_median	0.037377896045024395
agent_compute-npc1_min	0.03047206218426044
agent_compute-npc2_max	0.03611121249139358
agent_compute-npc2_mean	0.03330939402000287
agent_compute-npc2_median	0.03330939402000287
agent_compute-npc2_min	0.03050757554861215
complete-iteration_max	1.359701570523569
complete-iteration_mean	1.1405265878594175
complete-iteration_median	1.1405265878594175
complete-iteration_min	0.9213516051952656
deviation-center-line_max	1.7775159826486049
deviation-center-line_mean	0.9147239258537564
deviation-center-line_min	0.0519318690589078
deviation-heading_max	18.384504013377047
deviation-heading_mean	9.607612686460882
deviation-heading_median	9.607612686460882
deviation-heading_min	0.8307213595447194
driven_any_max	8.351417966890128
driven_any_mean	4.343832213977908
driven_any_median	4.343832213977908
driven_any_min	0.3362464610656872
driven_lanedir_consec_max	0.8280001122602292
driven_lanedir_consec_mean	0.4753802716945893
driven_lanedir_consec_min	0.1227604311289494
driven_lanedir_max	1.6910737431433216
driven_lanedir_mean	0.9069170871361356
driven_lanedir_median	0.9069170871361356
driven_lanedir_min	0.1227604311289494
get_duckie_state_max	1.4872872561439686e-06
get_duckie_state_mean	1.4552313872366478e-06
get_duckie_state_median	1.4552313872366478e-06
get_duckie_state_min	1.423175518329327e-06
get_robot_state_max	0.013776397228638
get_robot_state_mean	0.013627428036668197
get_robot_state_median	0.013627428036668197
get_robot_state_min	0.013478458844698392
get_state_dump_max	0.009167795914870042
get_state_dump_mean	0.009161950667968956
get_state_dump_median	0.009161950667968956
get_state_dump_min	0.009156105421067873
get_ui_image_max	0.053746766310471754
get_ui_image_mean	0.053237681145137536
get_ui_image_median	0.053237681145137536
get_ui_image_min	0.05272859597980331
in-drivable-lane_max	38.599999999999255
in-drivable-lane_mean	20.149999999999626
in-drivable-lane_min	1.699999999999996
per-episodes	details {"LFVI-norm-4way-000-ego0": {"driven_any": 0.3362464610656872, "get_ui_image": 0.053746766310471754, "step_physics": 0.6631855231065017, "survival_time": 3.1999999999999966, "driven_lanedir": 0.1227604311289494, "get_state_dump": 0.009167795914870042, "get_robot_state": 0.013478458844698392, "sim_render-ego0": 0.003554230469923753, "sim_render-npc0": 0.0034705162048339843, "sim_render-npc1": 0.003455495834350586, "sim_render-npc2": 0.0035643467536339395, "get_duckie_state": 1.423175518329327e-06, "in-drivable-lane": 1.699999999999996, "deviation-heading": 0.8307213595447194, "agent_compute-ego0": 0.011526228831364558, "agent_compute-npc0": 0.04210596818190355, "agent_compute-npc1": 0.03047206218426044, "agent_compute-npc2": 0.03050757554861215, "complete-iteration": 0.9213516051952656, "set_robot_commands": 0.0020354674412653997, "deviation-center-line": 0.0519318690589078, "driven_lanedir_consec": 0.1227604311289494, "sim_compute_sim_state": 0.03758603976323054, "sim_compute_performance-ego0": 0.0018256150759183444, "sim_compute_performance-npc0": 0.001791832997248723, "sim_compute_performance-npc1": 0.001790017348069411, "sim_compute_performance-npc2": 0.0018498970912053032}, "LFVI-norm-udem1-000-ego0": {"driven_any": 8.351417966890128, "get_ui_image": 0.05272859597980331, "step_physics": 1.077251195113526, "survival_time": 59.99999999999873, "driven_lanedir": 1.6910737431433216, "get_state_dump": 0.009156105421067873, "get_robot_state": 0.013776397228638, "sim_render-ego0": 0.003611544189008448, "sim_render-npc0": 0.0036209995403178622, "sim_render-npc1": 0.003646505166847045, "sim_render-npc2": 0.003715404562906461, "get_duckie_state": 1.4872872561439686e-06, "in-drivable-lane": 38.599999999999255, "deviation-heading": 18.384504013377047, "agent_compute-ego0": 0.012324650023600938, "agent_compute-npc0": 0.044678492510348534, "agent_compute-npc1": 0.04428372990578835, "agent_compute-npc2": 0.03611121249139358, "complete-iteration": 1.359701570523569, "set_robot_commands": 0.0022697605558676484, "deviation-center-line": 1.7775159826486049, "driven_lanedir_consec": 0.8280001122602292, "sim_compute_sim_state": 0.03821271404834909, "sim_compute_performance-ego0": 0.0018731312986019748, "sim_compute_performance-npc0": 0.001871071687645956, "sim_compute_performance-npc1": 0.0019070977076801232, "sim_compute_performance-npc2": 0.0019520264084789776}}
set_robot_commands_max	0.0022697605558676484
set_robot_commands_mean	0.002152613998566524
set_robot_commands_median	0.002152613998566524
set_robot_commands_min	0.0020354674412653997
sim_compute_performance-ego0_max	0.0018731312986019748
sim_compute_performance-ego0_mean	0.0018493731872601595
sim_compute_performance-ego0_median	0.0018493731872601595
sim_compute_performance-ego0_min	0.0018256150759183444
sim_compute_performance-npc0_max	0.001871071687645956
sim_compute_performance-npc0_mean	0.0018314523424473397
sim_compute_performance-npc0_median	0.0018314523424473397
sim_compute_performance-npc0_min	0.001791832997248723
sim_compute_performance-npc1_max	0.0019070977076801232
sim_compute_performance-npc1_mean	0.0018485575278747671
sim_compute_performance-npc1_median	0.0018485575278747671
sim_compute_performance-npc1_min	0.001790017348069411
sim_compute_performance-npc2_max	0.0019520264084789776
sim_compute_performance-npc2_mean	0.0019009617498421405
sim_compute_performance-npc2_median	0.0019009617498421405
sim_compute_performance-npc2_min	0.0018498970912053032
sim_compute_sim_state_max	0.03821271404834909
sim_compute_sim_state_mean	0.03789937690578982
sim_compute_sim_state_median	0.03789937690578982
sim_compute_sim_state_min	0.03758603976323054
sim_render-ego0_max	0.003611544189008448
sim_render-ego0_mean	0.0035828873294661
sim_render-ego0_median	0.0035828873294661
sim_render-ego0_min	0.003554230469923753
sim_render-npc0_max	0.0036209995403178622
sim_render-npc0_mean	0.0035457578725759235
sim_render-npc0_median	0.0035457578725759235
sim_render-npc0_min	0.0034705162048339843
sim_render-npc1_max	0.003646505166847045
sim_render-npc1_mean	0.0035510005005988153
sim_render-npc1_median	0.0035510005005988153
sim_render-npc1_min	0.003455495834350586
sim_render-npc2_max	0.003715404562906461
sim_render-npc2_mean	0.0036398756582702
sim_render-npc2_median	0.0036398756582702
sim_render-npc2_min	0.0035643467536339395
simulation-passed	1
step_physics_max	1.077251195113526
step_physics_mean	0.8702183591100139
step_physics_median	0.8702183591100139
step_physics_min	0.6631855231065017
survival_time_max	59.99999999999873
survival_time_mean	31.59999999999936
survival_time_min	3.1999999999999966

No reset possible

53807

12654

Bea Baselines 🐤

template-tensorflow

LFVv-sim

success

yes

2020-12-02 22:40:45+00:00

2020-12-02 22:50:25+00:00

0:09:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2537880480303647
survival_time_median	5.249999999999989
deviation-center-line_median	0.08220081452484745
in-drivable-lane_median	4.04999999999999

other stats

agent_compute-ego0_max	0.028801866116062287
agent_compute-ego0_mean	0.01727427621460102
agent_compute-ego0_median	0.0136291188697116
agent_compute-ego0_min	0.01303700100291859
agent_compute-npc0_max	0.024952875029656194
agent_compute-npc0_mean	0.021877403196311727
agent_compute-npc0_median	0.020979518771384063
agent_compute-npc0_min	0.020597700212822583
agent_compute-npc1_max	0.05688829638741233
agent_compute-npc1_mean	0.0462486506372334
agent_compute-npc1_median	0.048126683515660906
agent_compute-npc1_min	0.03373097200862697
agent_compute-npc2_max	0.04523585926402699
agent_compute-npc2_mean	0.037459093692079455
agent_compute-npc2_median	0.033881213150772395
agent_compute-npc2_min	0.033260208661438986
agent_compute-npc3_max	0.04543128230355003
agent_compute-npc3_mean	0.03983160108593484
agent_compute-npc3_median	0.03983160108593484
agent_compute-npc3_min	0.034231919868319645
complete-iteration_max	1.2051889072765003
complete-iteration_mean	0.8747939368086062
complete-iteration_median	0.955847607667482
complete-iteration_min	0.38229162462296024
deviation-center-line_max	0.10132675302433532
deviation-center-line_mean	0.07802063912228722
deviation-center-line_min	0.0463541744151187
deviation-heading_max	1.441470676196115
deviation-heading_mean	0.6953413259039197
deviation-heading_median	0.48654099083726865
deviation-heading_min	0.3668126457450268
driven_any_max	1.9494455215110944
driven_any_mean	1.6017607271069996
driven_any_median	1.8489098499968524
driven_any_min	0.7597776869231992
driven_lanedir_consec_max	0.4477739848079867
driven_lanedir_consec_mean	0.2829769491911273
driven_lanedir_consec_min	0.17655771589579317
driven_lanedir_max	0.4477739848079867
driven_lanedir_mean	0.2829769491911273
driven_lanedir_median	0.2537880480303647
driven_lanedir_min	0.17655771589579317
get_duckie_state_max	1.6147440130060369e-06
get_duckie_state_mean	1.3917856005684883e-06
get_duckie_state_median	1.3878436687865545e-06
get_duckie_state_min	1.1767110516948085e-06
get_robot_state_max	0.01744395845076617
get_robot_state_mean	0.013952044272757074
get_robot_state_median	0.015606825646629276
get_robot_state_min	0.007150567347003567
get_state_dump_max	0.011193401673260855
get_state_dump_mean	0.009447897111233427
get_state_dump_median	0.010218021624489796
get_state_dump_min	0.006162143522693265
get_ui_image_max	0.05624028552662243
get_ui_image_mean	0.046095687477385634
get_ui_image_median	0.04836726853488075
get_ui_image_min	0.03140792731315859
in-drivable-lane_max	4.449999999999985
in-drivable-lane_mean	3.5749999999999904
in-drivable-lane_min	1.749999999999997
per-episodes	details {"LFV-norm-loop-000-ego0": {"driven_any": 0.7597776869231992, "get_ui_image": 0.04336930884689581, "step_physics": 0.5616246481410793, "survival_time": 2.9999999999999973, "driven_lanedir": 0.26539363572756147, "get_state_dump": 0.009481637204279664, "get_robot_state": 0.014002885974821496, "sim_render-ego0": 0.0037214834181988825, "sim_render-npc0": 0.0035887858906730277, "sim_render-npc1": 0.003590063970597064, "sim_render-npc2": 0.0035612426820348523, "get_duckie_state": 1.3054394331134734e-06, "in-drivable-lane": 1.749999999999997, "deviation-heading": 0.41367078499277415, "agent_compute-ego0": 0.013886854296824971, "agent_compute-npc0": 0.020597700212822583, "agent_compute-npc1": 0.03373097200862697, "agent_compute-npc2": 0.033260208661438986, "complete-iteration": 0.7866365596896312, "set_robot_commands": 0.002109808999983991, "deviation-center-line": 0.06424043215326485, "driven_lanedir_consec": 0.26539363572756147, "sim_compute_sim_state": 0.025932999907946976, "sim_compute_performance-ego0": 0.0019138289279625063, "sim_compute_performance-npc0": 0.001889357801343574, "sim_compute_performance-npc1": 0.0018872276681368468, "sim_compute_performance-npc2": 0.0018990157080478356}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.8203670755705907, "get_ui_image": 0.05624028552662243, "step_physics": 0.8364932883869518, "survival_time": 5.449999999999989, "driven_lanedir": 0.17655771589579317, "get_state_dump": 0.01095440604469993, "get_robot_state": 0.017210765318437057, "sim_render-ego0": 0.003861048004843972, "sim_render-npc0": 0.0038245136087591, "sim_render-npc1": 0.0038031513040716, "sim_render-npc2": 0.003636243126609109, "sim_render-npc3": 0.0036449800838123663, "get_duckie_state": 1.6147440130060369e-06, "in-drivable-lane": 3.999999999999991, "deviation-heading": 1.441470676196115, "agent_compute-ego0": 0.01303700100291859, "agent_compute-npc0": 0.021024769002741032, "agent_compute-npc1": 0.05688829638741233, "agent_compute-npc2": 0.04523585926402699, "agent_compute-npc3": 0.04543128230355003, "complete-iteration": 1.2051889072765003, "set_robot_commands": 0.002114571224559437, "deviation-center-line": 0.10132675302433532, "driven_lanedir_consec": 0.17655771589579317, "sim_compute_sim_state": 0.06288580677726052, "sim_compute_performance-ego0": 0.002014201337640936, "sim_compute_performance-npc0": 0.0019838896664706143, "sim_compute_performance-npc1": 0.001970973881808194, "sim_compute_performance-npc2": 0.001906388456171209, "sim_compute_performance-npc3": 0.0019119175997647372}, "LFV-norm-techtrack-000-ego0": {"driven_any": 1.9494455215110944, "get_ui_image": 0.053365228222865685, "step_physics": 0.7945652709287756, "survival_time": 5.04999999999999, "driven_lanedir": 0.24218246033316793, "get_state_dump": 0.011193401673260855, "get_robot_state": 0.01744395845076617, "sim_render-ego0": 0.00368805960112927, "sim_render-npc0": 0.003603830057031968, "sim_render-npc1": 0.0036305422876395433, "sim_render-npc2": 0.003608252487930597, "sim_render-npc3": 0.0036649283240823183, "get_duckie_state": 1.4702479044596357e-06, "in-drivable-lane": 4.09999999999999, "deviation-heading": 0.3668126457450268, "agent_compute-ego0": 0.013371383442598231, "agent_compute-npc0": 0.020934268540027095, "agent_compute-npc1": 0.048126683515660906, "agent_compute-npc2": 0.033881213150772395, "agent_compute-npc3": 0.034231919868319645, "complete-iteration": 1.125058655645333, "set_robot_commands": 0.00221699826857623, "deviation-center-line": 0.0463541744151187, "driven_lanedir_consec": 0.24218246033316793, "sim_compute_sim_state": 0.05907713665681727, "sim_compute_performance-ego0": 0.0019433030895158357, "sim_compute_performance-npc0": 0.001909943187938017, "sim_compute_performance-npc1": 0.0018828873540840895, "sim_compute_performance-npc2": 0.0019061635522281423, "sim_compute_performance-npc3": 0.0019232969658047544}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.8774526244231136, "get_ui_image": 0.03140792731315859, "step_physics": 0.2559418870556739, "survival_time": 6.149999999999986, "driven_lanedir": 0.4477739848079867, "get_state_dump": 0.006162143522693265, "get_robot_state": 0.007150567347003567, "sim_render-ego0": 0.003877895493661203, "sim_render-npc0": 0.003827650700846026, "get_duckie_state": 1.1767110516948085e-06, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.5594111966817631, "agent_compute-ego0": 0.028801866116062287, "agent_compute-npc0": 0.024952875029656194, "complete-iteration": 0.38229162462296024, "set_robot_commands": 0.00222405118326987, "deviation-center-line": 0.10016119689643004, "driven_lanedir_consec": 0.4477739848079867, "sim_compute_sim_state": 0.011587383285645516, "sim_compute_performance-ego0": 0.0020337143251972813, "sim_compute_performance-npc0": 0.001993675385752032}}
set_robot_commands_max	0.00222405118326987
set_robot_commands_mean	0.0021663574190973816
set_robot_commands_median	0.002165784746567833
set_robot_commands_min	0.002109808999983991
sim_compute_performance-ego0_max	0.0020337143251972813
sim_compute_performance-ego0_mean	0.00197626192007914
sim_compute_performance-ego0_median	0.0019787522135783857
sim_compute_performance-ego0_min	0.0019138289279625063
sim_compute_performance-npc0_max	0.001993675385752032
sim_compute_performance-npc0_mean	0.001944216510376059
sim_compute_performance-npc0_median	0.0019469164272043157
sim_compute_performance-npc0_min	0.001889357801343574
sim_compute_performance-npc1_max	0.001970973881808194
sim_compute_performance-npc1_mean	0.0019136963013430435
sim_compute_performance-npc1_median	0.0018872276681368468
sim_compute_performance-npc1_min	0.0018828873540840895
sim_compute_performance-npc2_max	0.001906388456171209
sim_compute_performance-npc2_mean	0.0019038559054823955
sim_compute_performance-npc2_median	0.0019061635522281423
sim_compute_performance-npc2_min	0.0018990157080478356
sim_compute_performance-npc3_max	0.0019232969658047544
sim_compute_performance-npc3_mean	0.0019176072827847457
sim_compute_performance-npc3_median	0.0019176072827847457
sim_compute_performance-npc3_min	0.0019119175997647372
sim_compute_sim_state_max	0.06288580677726052
sim_compute_sim_state_mean	0.03987083165691757
sim_compute_sim_state_median	0.042505068282382125
sim_compute_sim_state_min	0.011587383285645516
sim_render-ego0_max	0.003877895493661203
sim_render-ego0_mean	0.003787121629458332
sim_render-ego0_median	0.003791265711521427
sim_render-ego0_min	0.00368805960112927
sim_render-npc0_max	0.003827650700846026
sim_render-npc0_mean	0.0037111950643275303
sim_render-npc0_median	0.0037141718328955343
sim_render-npc0_min	0.0035887858906730277
sim_render-npc1_max	0.0038031513040716
sim_render-npc1_mean	0.003674585854102736
sim_render-npc1_median	0.0036305422876395433
sim_render-npc1_min	0.003590063970597064
sim_render-npc2_max	0.003636243126609109
sim_render-npc2_mean	0.003601912765524853
sim_render-npc2_median	0.003608252487930597
sim_render-npc2_min	0.0035612426820348523
sim_render-npc3_max	0.0036649283240823183
sim_render-npc3_mean	0.0036549542039473423
sim_render-npc3_median	0.0036549542039473423
sim_render-npc3_min	0.0036449800838123663
simulation-passed	1
step_physics_max	0.8364932883869518
step_physics_mean	0.6121562736281201
step_physics_median	0.6780949595349275
step_physics_min	0.2559418870556739
survival_time_max	6.149999999999986
survival_time_mean	4.912499999999991
survival_time_min	2.9999999999999973

No reset possible

53781

12702

Bea Baselines 🐤

baseline-behavior-cloning

LFP-sim

success

yes

2020-12-02 22:24:02+00:00

2020-12-02 22:40:25+00:00

0:16:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.196665505134041
survival_time_median	12.950000000000085
deviation-center-line_median	0.927663368665382
in-drivable-lane_median	1.875000000000019

other stats

agent_compute-ego0_max	0.034271351284097154
agent_compute-ego0_mean	0.03253860635435481
agent_compute-ego0_median	0.032191878619946934
agent_compute-ego0_min	0.031499316893428206
complete-iteration_max	0.2591023765541675
complete-iteration_mean	0.24235352630493645
complete-iteration_median	0.2548651421752074
complete-iteration_min	0.20058144431516348
deviation-center-line_max	3.4489017606349948
deviation-center-line_mean	1.3369572676851256
deviation-center-line_min	0.04360057277474416
deviation-heading_max	13.986349264915305
deviation-heading_mean	5.841490367557776
deviation-heading_median	4.529971297138735
deviation-heading_min	0.3196696110383282
driven_any_max	14.38216967319174
driven_any_mean	5.138055043163549
driven_any_median	2.9126042335754745
driven_any_min	0.34484203231150856
driven_lanedir_consec_max	12.952735397556706
driven_lanedir_consec_mean	4.421927408082349
driven_lanedir_consec_min	0.3416432245046077
driven_lanedir_max	12.952735397556706
driven_lanedir_mean	4.421927408082349
driven_lanedir_median	2.196665505134041
driven_lanedir_min	0.3416432245046077
get_duckie_state_max	0.023868293762207032
get_duckie_state_mean	0.01691930726377523
get_duckie_state_median	0.01989392685657848
get_duckie_state_min	0.004021081579736917
get_robot_state_max	0.003551563754901663
get_robot_state_mean	0.003529791023622376
get_robot_state_median	0.0035387553938900133
get_robot_state_min	0.003490089551807814
get_state_dump_max	0.008425979614257813
get_state_dump_mean	0.007188829894801037
get_state_dump_median	0.007660395912928386
get_state_dump_min	0.005008548139089562
get_ui_image_max	0.03811914793438028
get_ui_image_mean	0.03266452553805227
get_ui_image_median	0.0333591483932338
get_ui_image_min	0.025820657431361187
in-drivable-lane_max	2.999999999999872
in-drivable-lane_mean	1.6874999999999776
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 0.34484203231150856, "get_ui_image": 0.031841187477111815, "step_physics": 0.14100983142852783, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3416432245046077, "get_state_dump": 0.008425979614257813, "get_robot_state": 0.0035465431213378908, "sim_render-ego0": 0.0036638975143432617, "get_duckie_state": 0.023868293762207032, "in-drivable-lane": 0.0, "deviation-heading": 0.3196696110383282, "agent_compute-ego0": 0.03218599319458008, "complete-iteration": 0.25432968616485596, "set_robot_commands": 0.00210726261138916, "deviation-center-line": 0.04360057277474416, "driven_lanedir_consec": 0.3416432245046077, "sim_compute_sim_state": 0.005769186019897461, "sim_compute_performance-ego0": 0.001835517883300781}, "LFP-norm-zigzag-000-ego0": {"driven_any": 14.38216967319174, "get_ui_image": 0.03811914793438028, "step_physics": 0.13371645150479172, "survival_time": 59.84999999999874, "driven_lanedir": 12.952735397556706, "get_state_dump": 0.007725602995374167, "get_robot_state": 0.003551563754901663, "sim_render-ego0": 0.0036657881458136, "get_duckie_state": 0.020091145583902657, "in-drivable-lane": 2.999999999999872, "deviation-heading": 13.986349264915305, "agent_compute-ego0": 0.034271351284097154, "complete-iteration": 0.2591023765541675, "set_robot_commands": 0.0021015694224973754, "deviation-center-line": 3.4489017606349948, "driven_lanedir_consec": 12.952735397556706, "sim_compute_sim_state": 0.013914599840549475, "sim_compute_performance-ego0": 0.0018656407055353283}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.076887460054886, "get_ui_image": 0.03487710930935578, "step_physics": 0.13678578708482825, "survival_time": 21.800000000000175, "driven_lanedir": 3.920842092827048, "get_state_dump": 0.007595188830482605, "get_robot_state": 0.003490089551807814, "sim_render-ego0": 0.003570293125353362, "get_duckie_state": 0.019696708129254305, "in-drivable-lane": 2.900000000000041, "deviation-heading": 7.629938637185581, "agent_compute-ego0": 0.032197764045313784, "complete-iteration": 0.2554005981855589, "set_robot_commands": 0.002044684826918543, "deviation-center-line": 1.5602630387700267, "driven_lanedir_consec": 3.920842092827048, "sim_compute_sim_state": 0.013256298868279708, "sim_compute_performance-ego0": 0.0018139060083734088}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.7483210070960632, "get_ui_image": 0.025820657431361187, "step_physics": 0.11719976850302824, "survival_time": 4.099999999999993, "driven_lanedir": 0.4724889174410347, "get_state_dump": 0.005008548139089562, "get_robot_state": 0.0035309676664421357, "sim_render-ego0": 0.0035887511379747504, "get_duckie_state": 0.004021081579736917, "in-drivable-lane": 0.849999999999997, "deviation-heading": 1.4300039570918877, "agent_compute-ego0": 0.031499316893428206, "complete-iteration": 0.20058144431516348, "set_robot_commands": 0.00207258994320789, "deviation-center-line": 0.29506369856073705, "driven_lanedir_consec": 0.4724889174410347, "sim_compute_sim_state": 0.005936519209160863, "sim_compute_performance-ego0": 0.001831264380949089}}
set_robot_commands_max	0.00210726261138916
set_robot_commands_mean	0.0020815267010032418
set_robot_commands_median	0.0020870796828526324
set_robot_commands_min	0.002044684826918543
sim_compute_performance-ego0_max	0.0018656407055353283
sim_compute_performance-ego0_mean	0.001836582244539652
sim_compute_performance-ego0_median	0.001833391132124935
sim_compute_performance-ego0_min	0.0018139060083734088
sim_compute_sim_state_max	0.013914599840549475
sim_compute_sim_state_mean	0.009719150984471877
sim_compute_sim_state_median	0.009596409038720286
sim_compute_sim_state_min	0.005769186019897461
sim_render-ego0_max	0.0036657881458136
sim_render-ego0_mean	0.0036221824808712433
sim_render-ego0_median	0.0036263243261590063
sim_render-ego0_min	0.003570293125353362
simulation-passed	1
step_physics_max	0.14100983142852783
step_physics_mean	0.132177959630294
step_physics_median	0.13525111929480998
step_physics_min	0.11719976850302824
survival_time_max	59.84999999999874
survival_time_mean	22.049999999999727
survival_time_min	2.4499999999999993

No reset possible

53720

12708

Bea Baselines 🐤

baseline-behavior-cloning

LFt-sim

success

yes

2020-12-02 21:48:46+00:00

2020-12-02 22:23:52+00:00

0:35:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	13.820564045270787
survival_time_median	59.99999999999873
deviation-center-line_median	2.6948718023073672
in-drivable-lane_median	1.5749999999999815

other stats

agent_compute-ego0_max	0.034098419718301666
agent_compute-ego0_mean	0.03269482482779929
agent_compute-ego0_median	0.032254983046767514
agent_compute-ego0_min	0.03217091349936048
complete-iteration_max	0.226449612276838
complete-iteration_mean	0.1915360610749104
complete-iteration_median	0.18706503637029565
complete-iteration_min	0.16556455928221234
deviation-center-line_max	3.4894594535881227
deviation-center-line_mean	2.821578567508868
deviation-center-line_min	2.407111211832615
deviation-heading_max	16.260644356721382
deviation-heading_mean	10.93757995670683
deviation-heading_median	9.836820113626072
deviation-heading_min	7.8160352428538
driven_any_max	14.590320105208209
driven_any_mean	14.590173821957087
driven_any_median	14.59020287365097
driven_any_min	14.5899694353182
driven_lanedir_consec_max	14.37755865151862
driven_lanedir_consec_mean	12.984490625234251
driven_lanedir_consec_min	9.919275758876813
driven_lanedir_max	14.37755865151862
driven_lanedir_mean	13.028336055334233
driven_lanedir_median	13.820564045270787
driven_lanedir_min	10.094657479276725
get_duckie_state_max	1.2000335642539095e-06
get_duckie_state_mean	1.1685686643475e-06
get_duckie_state_median	1.1783952419207951e-06
get_duckie_state_min	1.1174506092945006e-06
get_robot_state_max	0.0035547880606290006
get_robot_state_mean	0.003516731859742354
get_robot_state_median	0.0035091915495885995
get_robot_state_min	0.0034937562791632175
get_state_dump_max	0.004425848056434294
get_state_dump_mean	0.004379365366761829
get_state_dump_median	0.004383398829451409
get_state_dump_min	0.004324815751710204
get_ui_image_max	0.034997932519841256
get_ui_image_mean	0.02993970672653478
get_ui_image_median	0.02976914002039748
get_ui_image_min	0.025222614345502894
in-drivable-lane_max	14.299999999999596
in-drivable-lane_mean	4.36249999999989
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 14.590320105208209, "get_ui_image": 0.027735828857040724, "step_physics": 0.08941174367385343, "survival_time": 59.99999999999873, "driven_lanedir": 14.242919961712316, "get_state_dump": 0.004357071145190287, "get_robot_state": 0.0035547880606290006, "sim_render-ego0": 0.0037556500557955857, "get_duckie_state": 1.1174506092945006e-06, "in-drivable-lane": 0.4499999999999744, "deviation-heading": 7.8160352428538, "agent_compute-ego0": 0.034098419718301666, "complete-iteration": 0.17598489242032803, "set_robot_commands": 0.0022355517578760255, "deviation-center-line": 2.407111211832615, "driven_lanedir_consec": 14.242919961712316, "sim_compute_sim_state": 0.008822209233546832, "sim_compute_performance-ego0": 0.0019363455728726223}, "LF-norm-zigzag-000-ego0": {"driven_any": 14.5899694353182, "get_ui_image": 0.034997932519841256, "step_physics": 0.12973716515089254, "survival_time": 59.99999999999873, "driven_lanedir": 10.094657479276725, "get_state_dump": 0.004409726513712531, "get_robot_state": 0.0035200353268282697, "sim_render-ego0": 0.0036416945112039407, "get_duckie_state": 1.2000335642539095e-06, "in-drivable-lane": 14.299999999999596, "deviation-heading": 16.260644356721382, "agent_compute-ego0": 0.03225608054644658, "complete-iteration": 0.226449612276838, "set_robot_commands": 0.0021198667356314804, "deviation-center-line": 3.4894594535881227, "driven_lanedir_consec": 9.919275758876813, "sim_compute_sim_state": 0.01382391935184933, "sim_compute_performance-ego0": 0.00186726890138345}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.590209955123148, "get_ui_image": 0.03180245118375424, "step_physics": 0.1058821856826668, "survival_time": 59.99999999999873, "driven_lanedir": 13.39820812882926, "get_state_dump": 0.004425848056434294, "get_robot_state": 0.0034937562791632175, "sim_render-ego0": 0.0035986007004355906, "get_duckie_state": 1.161521320835339e-06, "in-drivable-lane": 2.6999999999999886, "deviation-heading": 11.086796304096588, "agent_compute-ego0": 0.03217091349936048, "complete-iteration": 0.1981451803202633, "set_robot_commands": 0.002082518197217651, "deviation-center-line": 2.6857518910283504, "driven_lanedir_consec": 13.39820812882926, "sim_compute_sim_state": 0.012753661923563352, "sim_compute_performance-ego0": 0.0018587979944818323}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.59019579217879, "get_ui_image": 0.025222614345502894, "step_physics": 0.08661697488541806, "survival_time": 59.99999999999873, "driven_lanedir": 14.37755865151862, "get_state_dump": 0.004324815751710204, "get_robot_state": 0.0034983477723489298, "sim_render-ego0": 0.0035810073547617384, "get_duckie_state": 1.1952691630062514e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.586843923155554, "agent_compute-ego0": 0.03225388554708845, "complete-iteration": 0.16556455928221234, "set_robot_commands": 0.0020792782058525246, "deviation-center-line": 2.7039917135863845, "driven_lanedir_consec": 14.37755865151862, "sim_compute_sim_state": 0.006065655707518922, "sim_compute_performance-ego0": 0.00184501418463892}}
set_robot_commands_max	0.0022355517578760255
set_robot_commands_mean	0.002129303724144421
set_robot_commands_median	0.0021011924664245656
set_robot_commands_min	0.0020792782058525246
sim_compute_performance-ego0_max	0.0019363455728726223
sim_compute_performance-ego0_mean	0.0018768566633442065
sim_compute_performance-ego0_median	0.0018630334479326411
sim_compute_performance-ego0_min	0.00184501418463892
sim_compute_sim_state_max	0.01382391935184933
sim_compute_sim_state_mean	0.010366361554119609
sim_compute_sim_state_median	0.010787935578555091
sim_compute_sim_state_min	0.006065655707518922
sim_render-ego0_max	0.0037556500557955857
sim_render-ego0_mean	0.003644238155549214
sim_render-ego0_median	0.0036201476058197657
sim_render-ego0_min	0.0035810073547617384
simulation-passed	1
step_physics_max	0.12973716515089254
step_physics_mean	0.10291201734820772
step_physics_median	0.09764696467826012
step_physics_min	0.08661697488541806
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

53680

12719

Bea Baselines 🐤

template-random

LFVmultibodyv-sim

success

yes

2020-12-02 21:34:01+00:00

2020-12-02 21:48:10+00:00

0:14:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.31012854656598865
survival_time_median	7.199999999999982
deviation-center-line_median	0.13122914314002487
in-drivable-lane_median	5.524999999999986

other stats

agent_compute-ego0_max	0.012595257697961267
agent_compute-ego0_mean	0.011696046788033465
agent_compute-ego0_median	0.011905977643769362
agent_compute-ego0_min	0.010429689564655736
agent_compute-ego1_max	0.01232354304729364
agent_compute-ego1_mean	0.010971037927497004
agent_compute-ego1_median	0.01072203044233651
agent_compute-ego1_min	0.01017365750578261
agent_compute-ego2_max	0.012125330093579415
agent_compute-ego2_mean	0.010859348453886558
agent_compute-ego2_median	0.010327217976252238
agent_compute-ego2_min	0.010125497291828024
agent_compute-ego3_max	0.01152033805847168
agent_compute-ego3_mean	0.01123992084859572
agent_compute-ego3_median	0.011427628688323192
agent_compute-ego3_min	0.010771795798992288
complete-iteration_max	0.9205538187271508
complete-iteration_mean	0.7566768525633403
complete-iteration_median	0.9118959246010616
complete-iteration_min	0.25481165315687043
deviation-center-line_max	1.0672426875511325
deviation-center-line_mean	0.1879462697481802
deviation-center-line_min	0.05396851872944276
deviation-heading_max	3.3492929289200277
deviation-heading_mean	0.9592275236952762
deviation-heading_median	0.689659712463426
deviation-heading_min	0.32662715962837463
driven_any_max	3.0190484717136594
driven_any_mean	1.718399147417843
driven_any_median	1.6862410533200602
driven_any_min	0.1869058045994669
driven_lanedir_consec_max	1.2758002154191843
driven_lanedir_consec_mean	0.40353758585741534
driven_lanedir_consec_min	0.10377209487601392
driven_lanedir_max	1.2758002154191843
driven_lanedir_mean	0.4035771331394597
driven_lanedir_median	0.31012854656598865
driven_lanedir_min	0.1043257568246343
get_duckie_state_max	1.7702579498291015e-06
get_duckie_state_mean	1.481871162952687e-06
get_duckie_state_median	1.3816050994090544e-06
get_duckie_state_min	1.2923931253367456e-06
get_robot_state_max	0.01476150292616624
get_robot_state_mean	0.013276371269562343
get_robot_state_median	0.01419939501532193
get_robot_state_min	0.007128713057213223
get_state_dump_max	0.009957853036049085
get_state_dump_mean	0.009136885332179417
get_state_dump_median	0.009570067504356648
get_state_dump_min	0.0061907694511806844
get_ui_image_max	0.05092597007751465
get_ui_image_mean	0.04499139448639591
get_ui_image_median	0.04741316992661049
get_ui_image_min	0.031320421966080814
in-drivable-lane_max	6.89999999999998
in-drivable-lane_mean	4.703571428571414
in-drivable-lane_min	0.0
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.2691155906198155, "get_ui_image": 0.043470529715220134, "step_physics": 0.5279037574927012, "survival_time": 5.949999999999987, "driven_lanedir": 1.2758002154191843, "get_state_dump": 0.009355793396631876, "get_robot_state": 0.013942044973373414, "sim_render-ego0": 0.003624387582143148, "sim_render-ego1": 0.003603613376617432, "sim_render-ego2": 0.0035325229167938233, "sim_render-ego3": 0.00359842578570048, "get_duckie_state": 1.7702579498291015e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 0.45754904014590214, "agent_compute-ego0": 0.011220083634058634, "agent_compute-ego1": 0.010266230503718058, "agent_compute-ego2": 0.010327217976252238, "agent_compute-ego3": 0.01152033805847168, "complete-iteration": 0.6885134140650432, "set_robot_commands": 0.0020988027254740397, "deviation-center-line": 0.15646912580678107, "driven_lanedir_consec": 1.2758002154191843, "sim_compute_sim_state": 0.02012295126914978, "sim_compute_performance-ego0": 0.0019131163756052653, "sim_compute_performance-ego1": 0.0018603006998697915, "sim_compute_performance-ego2": 0.001871750752131144, "sim_compute_performance-ego3": 0.001864558458328247}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.6780926551768194, "get_ui_image": 0.043470529715220134, "step_physics": 0.5279037574927012, "survival_time": 5.949999999999987, "driven_lanedir": 0.10711618180175232, "get_state_dump": 0.009355793396631876, "get_robot_state": 0.013942044973373414, "sim_render-ego0": 0.003624387582143148, "sim_render-ego1": 0.003603613376617432, "sim_render-ego2": 0.0035325229167938233, "sim_render-ego3": 0.00359842578570048, "get_duckie_state": 1.7702579498291015e-06, "in-drivable-lane": 5.349999999999987, "deviation-heading": 0.3831592495136061, "agent_compute-ego0": 0.011220083634058634, "agent_compute-ego1": 0.010266230503718058, "agent_compute-ego2": 0.010327217976252238, "agent_compute-ego3": 0.01152033805847168, "complete-iteration": 0.6885134140650432, "set_robot_commands": 0.0020988027254740397, "deviation-center-line": 0.05396851872944276, "driven_lanedir_consec": 0.10711618180175232, "sim_compute_sim_state": 0.02012295126914978, "sim_compute_performance-ego0": 0.0019131163756052653, "sim_compute_performance-ego1": 0.0018603006998697915, "sim_compute_performance-ego2": 0.001871750752131144, "sim_compute_performance-ego3": 0.001864558458328247}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.694389451463301, "get_ui_image": 0.043470529715220134, "step_physics": 0.5279037574927012, "survival_time": 5.949999999999987, "driven_lanedir": 0.406607066921172, "get_state_dump": 0.009355793396631876, "get_robot_state": 0.013942044973373414, "sim_render-ego0": 0.003624387582143148, "sim_render-ego1": 0.003603613376617432, "sim_render-ego2": 0.0035325229167938233, "sim_render-ego3": 0.00359842578570048, "get_duckie_state": 1.7702579498291015e-06, "in-drivable-lane": 4.249999999999987, "deviation-heading": 1.1187434533822138, "agent_compute-ego0": 0.011220083634058634, "agent_compute-ego1": 0.010266230503718058, "agent_compute-ego2": 0.010327217976252238, "agent_compute-ego3": 0.01152033805847168, "complete-iteration": 0.6885134140650432, "set_robot_commands": 0.0020988027254740397, "deviation-center-line": 0.13688757043584768, "driven_lanedir_consec": 0.406607066921172, "sim_compute_sim_state": 0.02012295126914978, "sim_compute_performance-ego0": 0.0019131163756052653, "sim_compute_performance-ego1": 0.0018603006998697915, "sim_compute_performance-ego2": 0.001871750752131144, "sim_compute_performance-ego3": 0.001864558458328247}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1425448777096594, "get_ui_image": 0.043470529715220134, "step_physics": 0.5279037574927012, "survival_time": 5.949999999999987, "driven_lanedir": 0.5218965164919902, "get_state_dump": 0.009355793396631876, "get_robot_state": 0.013942044973373414, "sim_render-ego0": 0.003624387582143148, "sim_render-ego1": 0.003603613376617432, "sim_render-ego2": 0.0035325229167938233, "sim_render-ego3": 0.00359842578570048, "get_duckie_state": 1.7702579498291015e-06, "in-drivable-lane": 4.399999999999986, "deviation-heading": 0.3544404557513553, "agent_compute-ego0": 0.011220083634058634, "agent_compute-ego1": 0.010266230503718058, "agent_compute-ego2": 0.010327217976252238, "agent_compute-ego3": 0.01152033805847168, "complete-iteration": 0.6885134140650432, "set_robot_commands": 0.0020988027254740397, "deviation-center-line": 0.16587541529140726, "driven_lanedir_consec": 0.5218965164919902, "sim_compute_sim_state": 0.02012295126914978, "sim_compute_performance-ego0": 0.0019131163756052653, "sim_compute_performance-ego1": 0.0018603006998697915, "sim_compute_performance-ego2": 0.001871750752131144, "sim_compute_performance-ego3": 0.001864558458328247}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.8816867130300416, "get_ui_image": 0.05092597007751465, "step_physics": 0.7345682703531705, "survival_time": 7.7499999999999805, "driven_lanedir": 0.1851520575044736, "get_state_dump": 0.009957853036049085, "get_robot_state": 0.01476150292616624, "sim_render-ego0": 0.004082681276859381, "sim_render-ego1": 0.003907495584243383, "sim_render-ego2": 0.003913725033784524, "sim_render-ego3": 0.003835484003409361, "get_duckie_state": 1.3816050994090544e-06, "in-drivable-lane": 6.89999999999998, "deviation-heading": 0.39644791658181455, "agent_compute-ego0": 0.012595257697961267, "agent_compute-ego1": 0.01232354304729364, "agent_compute-ego2": 0.012125330093579415, "agent_compute-ego3": 0.011427628688323192, "complete-iteration": 0.9205538187271508, "set_robot_commands": 0.0023209039981548604, "deviation-center-line": 0.06997677053071931, "driven_lanedir_consec": 0.1851520575044736, "sim_compute_sim_state": 0.028277771595196847, "sim_compute_performance-ego0": 0.00218815375597049, "sim_compute_performance-ego1": 0.002060682345659305, "sim_compute_performance-ego2": 0.00209273588963044, "sim_compute_performance-ego3": 0.0020468800495832395}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.7660349041174868, "get_ui_image": 0.05092597007751465, "step_physics": 0.7345682703531705, "survival_time": 7.7499999999999805, "driven_lanedir": 0.1043257568246343, "get_state_dump": 0.009957853036049085, "get_robot_state": 0.01476150292616624, "sim_render-ego0": 0.004082681276859381, "sim_render-ego1": 0.003907495584243383, "sim_render-ego2": 0.003913725033784524, "sim_render-ego3": 0.003835484003409361, "get_duckie_state": 1.3816050994090544e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 1.3096455759276513, "agent_compute-ego0": 0.012595257697961267, "agent_compute-ego1": 0.01232354304729364, "agent_compute-ego2": 0.012125330093579415, "agent_compute-ego3": 0.011427628688323192, "complete-iteration": 0.9205538187271508, "set_robot_commands": 0.0023209039981548604, "deviation-center-line": 0.0917848185813179, "driven_lanedir_consec": 0.10377209487601392, "sim_compute_sim_state": 0.028277771595196847, "sim_compute_performance-ego0": 0.00218815375597049, "sim_compute_performance-ego1": 0.002060682345659305, "sim_compute_performance-ego2": 0.00209273588963044, "sim_compute_performance-ego3": 0.0020468800495832395}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 3.0190484717136594, "get_ui_image": 0.05092597007751465, "step_physics": 0.7345682703531705, "survival_time": 7.7499999999999805, "driven_lanedir": 0.20025464560271344, "get_state_dump": 0.009957853036049085, "get_robot_state": 0.01476150292616624, "sim_render-ego0": 0.004082681276859381, "sim_render-ego1": 0.003907495584243383, "sim_render-ego2": 0.003913725033784524, "sim_render-ego3": 0.003835484003409361, "get_duckie_state": 1.3816050994090544e-06, "in-drivable-lane": 5.999999999999984, "deviation-heading": 1.9290183690775011, "agent_compute-ego0": 0.012595257697961267, "agent_compute-ego1": 0.01232354304729364, "agent_compute-ego2": 0.012125330093579415, "agent_compute-ego3": 0.011427628688323192, "complete-iteration": 0.9205538187271508, "set_robot_commands": 0.0023209039981548604, "deviation-center-line": 0.1330301499324933, "driven_lanedir_consec": 0.20025464560271344, "sim_compute_sim_state": 0.028277771595196847, "sim_compute_performance-ego0": 0.00218815375597049, "sim_compute_performance-ego1": 0.002060682345659305, "sim_compute_performance-ego2": 0.00209273588963044, "sim_compute_performance-ego3": 0.0020468800495832395}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.9289085866370536, "get_ui_image": 0.05092597007751465, "step_physics": 0.7345682703531705, "survival_time": 7.7499999999999805, "driven_lanedir": 0.28174509476718734, "get_state_dump": 0.009957853036049085, "get_robot_state": 0.01476150292616624, "sim_render-ego0": 0.004082681276859381, "sim_render-ego1": 0.003907495584243383, "sim_render-ego2": 0.003913725033784524, "sim_render-ego3": 0.003835484003409361, "get_duckie_state": 1.3816050994090544e-06, "in-drivable-lane": 6.64999999999998, "deviation-heading": 0.5457514830841956, "agent_compute-ego0": 0.012595257697961267, "agent_compute-ego1": 0.01232354304729364, "agent_compute-ego2": 0.012125330093579415, "agent_compute-ego3": 0.011427628688323192, "complete-iteration": 0.9205538187271508, "set_robot_commands": 0.0023209039981548604, "deviation-center-line": 0.07791543022692267, "driven_lanedir_consec": 0.28174509476718734, "sim_compute_sim_state": 0.028277771595196847, "sim_compute_performance-ego0": 0.00218815375597049, "sim_compute_performance-ego1": 0.002060682345659305, "sim_compute_performance-ego2": 0.00209273588963044, "sim_compute_performance-ego3": 0.0020468800495832395}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.1869058045994669, "get_ui_image": 0.04741316992661049, "step_physics": 0.7423655592162034, "survival_time": 7.199999999999982, "driven_lanedir": 0.1661152269572297, "get_state_dump": 0.009570067504356648, "get_robot_state": 0.01419939501532193, "sim_render-ego0": 0.003858372260784281, "sim_render-ego1": 0.0037439477854761586, "sim_render-ego2": 0.003702550098813813, "sim_render-ego3": 0.003738909754259833, "get_duckie_state": 1.2923931253367456e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.3492929289200277, "agent_compute-ego0": 0.011905977643769362, "agent_compute-ego1": 0.01072203044233651, "agent_compute-ego2": 0.010125497291828024, "agent_compute-ego3": 0.010771795798992288, "complete-iteration": 0.9118959246010616, "set_robot_commands": 0.002201284211257408, "deviation-center-line": 1.0672426875511325, "driven_lanedir_consec": 0.1661152269572297, "sim_compute_sim_state": 0.022755280856428476, "sim_compute_performance-ego0": 0.001996028834375842, "sim_compute_performance-ego1": 0.001971285918663288, "sim_compute_performance-ego2": 0.0019670108269000874, "sim_compute_performance-ego3": 0.0019594225390204066}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.7887771695825694, "get_ui_image": 0.04741316992661049, "step_physics": 0.7423655592162034, "survival_time": 7.199999999999982, "driven_lanedir": 0.3122449729100487, "get_state_dump": 0.009570067504356648, "get_robot_state": 0.01419939501532193, "sim_render-ego0": 0.003858372260784281, "sim_render-ego1": 0.0037439477854761586, "sim_render-ego2": 0.003702550098813813, "sim_render-ego3": 0.003738909754259833, "get_duckie_state": 1.2923931253367456e-06, "in-drivable-lane": 5.699999999999984, "deviation-heading": 1.185630598905456, "agent_compute-ego0": 0.011905977643769362, "agent_compute-ego1": 0.01072203044233651, "agent_compute-ego2": 0.010125497291828024, "agent_compute-ego3": 0.010771795798992288, "complete-iteration": 0.9118959246010616, "set_robot_commands": 0.002201284211257408, "deviation-center-line": 0.11628503989165792, "driven_lanedir_consec": 0.3122449729100487, "sim_compute_sim_state": 0.022755280856428476, "sim_compute_performance-ego0": 0.001996028834375842, "sim_compute_performance-ego1": 0.001971285918663288, "sim_compute_performance-ego2": 0.0019670108269000874, "sim_compute_performance-ego3": 0.0019594225390204066}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.5158150952340563, "get_ui_image": 0.04741316992661049, "step_physics": 0.7423655592162034, "survival_time": 7.199999999999982, "driven_lanedir": 0.3825744030097473, "get_state_dump": 0.009570067504356648, "get_robot_state": 0.01419939501532193, "sim_render-ego0": 0.003858372260784281, "sim_render-ego1": 0.0037439477854761586, "sim_render-ego2": 0.003702550098813813, "sim_render-ego3": 0.003738909754259833, "get_duckie_state": 1.2923931253367456e-06, "in-drivable-lane": 5.749999999999983, "deviation-heading": 0.8335679418426563, "agent_compute-ego0": 0.011905977643769362, "agent_compute-ego1": 0.01072203044233651, "agent_compute-ego2": 0.010125497291828024, "agent_compute-ego3": 0.010771795798992288, "complete-iteration": 0.9118959246010616, "set_robot_commands": 0.002201284211257408, "deviation-center-line": 0.13026241766457222, "driven_lanedir_consec": 0.3825744030097473, "sim_compute_sim_state": 0.022755280856428476, "sim_compute_performance-ego0": 0.001996028834375842, "sim_compute_performance-ego1": 0.001971285918663288, "sim_compute_performance-ego2": 0.0019670108269000874, "sim_compute_performance-ego3": 0.0019594225390204066}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.8421472446588565, "get_ui_image": 0.04741316992661049, "step_physics": 0.7423655592162034, "survival_time": 7.199999999999982, "driven_lanedir": 0.3080121202219286, "get_state_dump": 0.009570067504356648, "get_robot_state": 0.01419939501532193, "sim_render-ego0": 0.003858372260784281, "sim_render-ego1": 0.0037439477854761586, "sim_render-ego2": 0.003702550098813813, "sim_render-ego3": 0.003738909754259833, "get_duckie_state": 1.2923931253367456e-06, "in-drivable-lane": 6.149999999999983, "deviation-heading": 0.32662715962837463, "agent_compute-ego0": 0.011905977643769362, "agent_compute-ego1": 0.01072203044233651, "agent_compute-ego2": 0.010125497291828024, "agent_compute-ego3": 0.010771795798992288, "complete-iteration": 0.9118959246010616, "set_robot_commands": 0.002201284211257408, "deviation-center-line": 0.10068818766072882, "driven_lanedir_consec": 0.3080121202219286, "sim_compute_sim_state": 0.022755280856428476, "sim_compute_performance-ego0": 0.001996028834375842, "sim_compute_performance-ego1": 0.001971285918663288, "sim_compute_performance-ego2": 0.0019670108269000874, "sim_compute_performance-ego3": 0.0019594225390204066}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.6720607496535056, "get_ui_image": 0.031320421966080814, "step_physics": 0.16474857035371446, "survival_time": 4.799999999999991, "driven_lanedir": 0.7784718519897627, "get_state_dump": 0.0061907694511806844, "get_robot_state": 0.007128713057213223, "sim_render-ego0": 0.0036637193148898097, "sim_render-ego1": 0.003600435158641068, "get_duckie_state": 1.4845857915190078e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.3471197435066698, "agent_compute-ego0": 0.010429689564655736, "agent_compute-ego1": 0.01017365750578261, "complete-iteration": 0.25481165315687043, "set_robot_commands": 0.002075008510314312, "deviation-center-line": 0.13219586861547755, "driven_lanedir_consec": 0.7784718519897627, "sim_compute_sim_state": 0.009450951802361872, "sim_compute_performance-ego0": 0.0019243525475570835, "sim_compute_performance-ego1": 0.001893414664514286}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6720607496535107, "get_ui_image": 0.031320421966080814, "step_physics": 0.16474857035371446, "survival_time": 4.799999999999991, "driven_lanedir": 0.6197637535306103, "get_state_dump": 0.0061907694511806844, "get_robot_state": 0.007128713057213223, "sim_render-ego0": 0.0036637193148898097, "sim_render-ego1": 0.003600435158641068, "get_duckie_state": 1.4845857915190078e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 0.8921914154664431, "agent_compute-ego0": 0.010429689564655736, "agent_compute-ego1": 0.01017365750578261, "complete-iteration": 0.25481165315687043, "set_robot_commands": 0.002075008510314312, "deviation-center-line": 0.19866577555602236, "driven_lanedir_consec": 0.6197637535306103, "sim_compute_sim_state": 0.009450951802361872, "sim_compute_performance-ego0": 0.0019243525475570835, "sim_compute_performance-ego1": 0.001893414664514286}}
set_robot_commands_max	0.0023209039981548604
set_robot_commands_mean	0.0021881414828695614
set_robot_commands_median	0.002201284211257408
set_robot_commands_min	0.002075008510314312
sim_compute_performance-ego0_max	0.00218815375597049
sim_compute_performance-ego0_mean	0.002016992925637183
sim_compute_performance-ego0_median	0.001996028834375842
sim_compute_performance-ego0_min	0.0019131163756052653
sim_compute_performance-ego1_max	0.002060682345659305
sim_compute_performance-ego1_mean	0.001953993227557008
sim_compute_performance-ego1_median	0.001971285918663288
sim_compute_performance-ego1_min	0.0018603006998697915
sim_compute_performance-ego2_max	0.00209273588963044
sim_compute_performance-ego2_mean	0.0019771658228872244
sim_compute_performance-ego2_median	0.0019670108269000874
sim_compute_performance-ego2_min	0.001871750752131144
sim_compute_performance-ego3_max	0.0020468800495832395
sim_compute_performance-ego3_mean	0.001956953682310631
sim_compute_performance-ego3_median	0.0019594225390204066
sim_compute_performance-ego3_min	0.001864558458328247
sim_compute_sim_state_max	0.028277771595196847
sim_compute_sim_state_mean	0.021680422749130297
sim_compute_sim_state_median	0.022755280856428476
sim_compute_sim_state_min	0.009450951802361872
sim_render-ego0_max	0.004082681276859381
sim_render-ego0_mean	0.003827800222066205
sim_render-ego0_median	0.003858372260784281
sim_render-ego0_min	0.003624387582143148
sim_render-ego1_max	0.003907495584243383
sim_render-ego1_mean	0.0037300783787592886
sim_render-ego1_median	0.0037439477854761586
sim_render-ego1_min	0.003600435158641068
sim_render-ego2_max	0.003913725033784524
sim_render-ego2_mean	0.003716266016464052
sim_render-ego2_median	0.003702550098813813
sim_render-ego2_min	0.0035325229167938233
sim_render-ego3_max	0.003835484003409361
sim_render-ego3_mean	0.0037242731811232247
sim_render-ego3_median	0.003738909754259833
sim_render-ego3_min	0.00359842578570048
simulation-passed	1
step_physics_max	0.7423655592162034
step_physics_mean	0.5963462492111236
step_physics_median	0.7345682703531705
step_physics_min	0.16474857035371446
survival_time_max	7.7499999999999805
survival_time_mean	6.657142857142843
survival_time_min	4.799999999999991

No reset possible

53667

12723

Bea Baselines 🐤

template-random

LFt-sim

success

yes

2020-12-02 21:29:34+00:00

2020-12-02 21:33:26+00:00

0:03:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.39823866432635735
survival_time_median	5.09999999999999
deviation-center-line_median	0.10397503541459682
in-drivable-lane_median	3.84999999999999

other stats

agent_compute-ego0_max	0.012394016439264473
agent_compute-ego0_mean	0.011701722337940224
agent_compute-ego0_median	0.01164553840527825
agent_compute-ego0_min	0.011121796101939922
complete-iteration_max	0.19746546392087583
complete-iteration_mean	0.18679604927369137
complete-iteration_median	0.1935953366267017
complete-iteration_min	0.1625280599204861
deviation-center-line_max	0.1916486578940356
deviation-center-line_mean	0.11968167065023774
deviation-center-line_min	0.07912795387772167
deviation-heading_max	1.5873361005005349
deviation-heading_mean	0.6584974349448505
deviation-heading_median	0.3850529450534164
deviation-heading_min	0.2765477491720344
driven_any_max	2.35628224172167
driven_any_mean	1.6810923745425113
driven_any_median	1.8199196826448296
driven_any_min	0.7282478911587151
driven_lanedir_consec_max	0.5426135270162243
driven_lanedir_consec_mean	0.4093583698511538
driven_lanedir_consec_min	0.2983426237356763
driven_lanedir_max	0.5426135270162243
driven_lanedir_mean	0.4093583698511538
driven_lanedir_median	0.39823866432635735
driven_lanedir_min	0.2983426237356763
get_duckie_state_max	1.273773334644459e-06
get_duckie_state_mean	1.1594226355813138e-06
get_duckie_state_median	1.1406511155740956e-06
get_duckie_state_min	1.0826149765326051e-06
get_robot_state_max	0.003880383751609109
get_robot_state_mean	0.0036954133592286818
get_robot_state_median	0.003677900415969814
get_robot_state_min	0.0035454688533659903
get_state_dump_max	0.005012191425670277
get_state_dump_mean	0.004782195480971405
get_state_dump_median	0.0047992148006494
get_state_dump_min	0.004518160896916543
get_ui_image_max	0.03642311788374378
get_ui_image_mean	0.031406440472068975
get_ui_image_median	0.031035765875068178
get_ui_image_min	0.027131112254395778
in-drivable-lane_max	4.099999999999988
in-drivable-lane_mean	3.2999999999999914
in-drivable-lane_min	1.399999999999998
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 0.7282478911587151, "get_ui_image": 0.028911664269187235, "step_physics": 0.13007144061001866, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3854689511738134, "get_state_dump": 0.005012191425670277, "get_robot_state": 0.003880383751609109, "sim_render-ego0": 0.004077443209561435, "get_duckie_state": 1.1834231289950285e-06, "in-drivable-lane": 1.399999999999998, "deviation-heading": 0.4230962437026405, "agent_compute-ego0": 0.012394016439264473, "complete-iteration": 0.19574194821444424, "set_robot_commands": 0.0023785851218483664, "deviation-center-line": 0.07912795387772167, "driven_lanedir_consec": 0.3854689511738134, "sim_compute_sim_state": 0.006670210578224875, "sim_compute_performance-ego0": 0.0022664243524724787}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.35628224172167, "get_ui_image": 0.03642311788374378, "step_physics": 0.116963840300037, "survival_time": 6.149999999999986, "driven_lanedir": 0.5426135270162243, "get_state_dump": 0.004518160896916543, "get_robot_state": 0.0035454688533659903, "sim_render-ego0": 0.00364935205828759, "get_duckie_state": 1.0978791021531627e-06, "in-drivable-lane": 3.8999999999999897, "deviation-heading": 1.5873361005005349, "agent_compute-ego0": 0.01125740235851657, "complete-iteration": 0.19144872503895913, "set_robot_commands": 0.0020546759328534526, "deviation-center-line": 0.1916486578940356, "driven_lanedir_consec": 0.5426135270162243, "sim_compute_sim_state": 0.011113678255388814, "sim_compute_performance-ego0": 0.0018569903988992016}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.9505263322213937, "get_ui_image": 0.033159867480949116, "step_physics": 0.12324361447934752, "survival_time": 5.349999999999989, "driven_lanedir": 0.4110083774789013, "get_state_dump": 0.004883081824691208, "get_robot_state": 0.0037432776557074655, "sim_render-ego0": 0.003839062319861518, "get_duckie_state": 1.273773334644459e-06, "in-drivable-lane": 4.099999999999988, "deviation-heading": 0.34700964640419235, "agent_compute-ego0": 0.012033674452039933, "complete-iteration": 0.19746546392087583, "set_robot_commands": 0.0021630856725904676, "deviation-center-line": 0.09549354496776732, "driven_lanedir_consec": 0.4110083774789013, "sim_compute_sim_state": 0.012332819126270435, "sim_compute_performance-ego0": 0.0019902432406390153}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6893130330682662, "get_ui_image": 0.027131112254395778, "step_physics": 0.10198731568394875, "survival_time": 4.849999999999991, "driven_lanedir": 0.2983426237356763, "get_state_dump": 0.0047153477766075915, "get_robot_state": 0.003612523176232163, "sim_render-ego0": 0.003707635159395179, "get_duckie_state": 1.0826149765326051e-06, "in-drivable-lane": 3.7999999999999905, "deviation-heading": 0.2765477491720344, "agent_compute-ego0": 0.011121796101939922, "complete-iteration": 0.1625280599204861, "set_robot_commands": 0.0021047397535674424, "deviation-center-line": 0.11245652586142632, "driven_lanedir_consec": 0.2983426237356763, "sim_compute_sim_state": 0.0061796806296523735, "sim_compute_performance-ego0": 0.0018970820368552695}}
set_robot_commands_max	0.0023785851218483664
set_robot_commands_mean	0.0021752716202149323
set_robot_commands_median	0.0021339127130789552
set_robot_commands_min	0.0020546759328534526
sim_compute_performance-ego0_max	0.0022664243524724787
sim_compute_performance-ego0_mean	0.002002685007216491
sim_compute_performance-ego0_median	0.0019436626387471425
sim_compute_performance-ego0_min	0.0018569903988992016
sim_compute_sim_state_max	0.012332819126270435
sim_compute_sim_state_mean	0.009074097147384124
sim_compute_sim_state_median	0.008891944416806845
sim_compute_sim_state_min	0.0061796806296523735
sim_render-ego0_max	0.004077443209561435
sim_render-ego0_mean	0.0038183731867764306
sim_render-ego0_median	0.003773348739628348
sim_render-ego0_min	0.00364935205828759
simulation-passed	1
step_physics_max	0.13007144061001866
step_physics_mean	0.11806655276833795
step_physics_median	0.12010372738969226
step_physics_min	0.10198731568394875
survival_time_max	6.149999999999986
survival_time_mean	4.76249999999999
survival_time_min	2.6999999999999984

No reset possible

53645

12727

Bea Baselines 🐤

template-random

LFVIv-sim

success

yes

2020-12-02 21:20:10+00:00

2020-12-02 21:28:43+00:00

0:08:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5758601445640131
survival_time_median	6.099999999999986
deviation-center-line_median	0.17553830655708547
in-drivable-lane_median	3.29999999999999

other stats

agent_compute-ego0_max	0.011961758764166582
agent_compute-ego0_mean	0.011485589377428856
agent_compute-ego0_median	0.011485589377428856
agent_compute-ego0_min	0.011009419990691128
agent_compute-ego1_max	0.011700027867367391
agent_compute-ego1_mean	0.01130228763093679
agent_compute-ego1_median	0.01130228763093679
agent_compute-ego1_min	0.010904547394506189
agent_compute-ego2_max	0.012269386492277446
agent_compute-ego2_mean	0.01114627783121486
agent_compute-ego2_median	0.01114627783121486
agent_compute-ego2_min	0.010023169170152273
agent_compute-ego3_max	0.011898043281153629
agent_compute-ego3_mean	0.01119671798658188
agent_compute-ego3_median	0.01119671798658188
agent_compute-ego3_min	0.010495392692010134
complete-iteration_max	1.0025089841139945
complete-iteration_mean	0.9167362875953374
complete-iteration_median	0.9167362875953374
complete-iteration_min	0.8309635910766804
deviation-center-line_max	0.47013425987002005
deviation-center-line_mean	0.2174177284809568
deviation-center-line_min	0.0720091252708566
deviation-heading_max	3.0542186889712815
deviation-heading_mean	1.2634654122591242
deviation-heading_median	1.0697442157871273
deviation-heading_min	0.3081468886732283
driven_any_max	2.8773005288041658
driven_any_mean	1.716787495843618
driven_any_median	1.6399654313822998
driven_any_min	0.38662204608009304
driven_lanedir_consec_max	1.8220023141314807
driven_lanedir_consec_mean	0.7121644428869928
driven_lanedir_consec_min	0.30949264303267476
driven_lanedir_max	1.8220034571617316
driven_lanedir_mean	0.7349677350690881
driven_lanedir_median	0.5758601445640131
driven_lanedir_min	0.30949264303267476
get_duckie_state_max	1.7526133960445985e-06
get_duckie_state_mean	1.538859380999273e-06
get_duckie_state_median	1.538859380999273e-06
get_duckie_state_min	1.3251053659539477e-06
get_robot_state_max	0.014626588319477284
get_robot_state_mean	0.0144199638509634
get_robot_state_median	0.0144199638509634
get_robot_state_min	0.014213339382449522
get_state_dump_max	0.009903762215062192
get_state_dump_mean	0.009765104592656709
get_state_dump_median	0.009765104592656709
get_state_dump_min	0.009626446970251222
get_ui_image_max	0.055904052115434054
get_ui_image_mean	0.05459231702073936
get_ui_image_median	0.05459231702073936
get_ui_image_min	0.053280581926044665
in-drivable-lane_max	6.049999999999983
in-drivable-lane_mean	3.4749999999999894
in-drivable-lane_min	0.9999999999999998
per-episodes	details {"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.831813082003494, "get_ui_image": 0.055904052115434054, "step_physics": 0.6426222971733043, "survival_time": 7.499999999999981, "driven_lanedir": 1.8220034571617316, "get_state_dump": 0.009626446970251222, "get_robot_state": 0.014213339382449522, "sim_render-ego0": 0.003810121523623435, "sim_render-ego1": 0.00386190414428711, "sim_render-ego2": 0.003688679625656431, "sim_render-ego3": 0.0036859449171862064, "get_duckie_state": 1.7526133960445985e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.3442852314393885, "agent_compute-ego0": 0.011009419990691128, "agent_compute-ego1": 0.010904547394506189, "agent_compute-ego2": 0.010023169170152273, "agent_compute-ego3": 0.010495392692010134, "complete-iteration": 0.8309635910766804, "set_robot_commands": 0.002119364327942298, "deviation-center-line": 0.22968417496144336, "driven_lanedir_consec": 1.8220023141314807, "sim_compute_sim_state": 0.034274207045700375, "sim_compute_performance-ego0": 0.0020409577729686205, "sim_compute_performance-ego1": 0.0019565339120018563, "sim_compute_performance-ego2": 0.0019816168096681306, "sim_compute_performance-ego3": 0.0019388830424934033}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.3028841294963844, "get_ui_image": 0.055904052115434054, "step_physics": 0.6426222971733043, "survival_time": 7.499999999999981, "driven_lanedir": 0.4284094322301284, "get_state_dump": 0.009626446970251222, "get_robot_state": 0.014213339382449522, "sim_render-ego0": 0.003810121523623435, "sim_render-ego1": 0.00386190414428711, "sim_render-ego2": 0.003688679625656431, "sim_render-ego3": 0.0036859449171862064, "get_duckie_state": 1.7526133960445985e-06, "in-drivable-lane": 5.799999999999981, "deviation-heading": 1.002056979235454, "agent_compute-ego0": 0.011009419990691128, "agent_compute-ego1": 0.010904547394506189, "agent_compute-ego2": 0.010023169170152273, "agent_compute-ego3": 0.010495392692010134, "complete-iteration": 0.8309635910766804, "set_robot_commands": 0.002119364327942298, "deviation-center-line": 0.1213924381527276, "driven_lanedir_consec": 0.4284094322301284, "sim_compute_sim_state": 0.034274207045700375, "sim_compute_performance-ego0": 0.0020409577729686205, "sim_compute_performance-ego1": 0.0019565339120018563, "sim_compute_performance-ego2": 0.0019816168096681306, "sim_compute_performance-ego3": 0.0019388830424934033}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.9654839397698145, "get_ui_image": 0.055904052115434054, "step_physics": 0.6426222971733043, "survival_time": 7.499999999999981, "driven_lanedir": 0.3166075872147196, "get_state_dump": 0.009626446970251222, "get_robot_state": 0.014213339382449522, "sim_render-ego0": 0.003810121523623435, "sim_render-ego1": 0.00386190414428711, "sim_render-ego2": 0.003688679625656431, "sim_render-ego3": 0.0036859449171862064, "get_duckie_state": 1.7526133960445985e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1374314523388007, "agent_compute-ego0": 0.011009419990691128, "agent_compute-ego1": 0.010904547394506189, "agent_compute-ego2": 0.010023169170152273, "agent_compute-ego3": 0.010495392692010134, "complete-iteration": 0.8309635910766804, "set_robot_commands": 0.002119364327942298, "deviation-center-line": 0.10797637530751922, "driven_lanedir_consec": 0.3166075872147196, "sim_compute_sim_state": 0.034274207045700375, "sim_compute_performance-ego0": 0.0020409577729686205, "sim_compute_performance-ego1": 0.0019565339120018563, "sim_compute_performance-ego2": 0.0019816168096681306, "sim_compute_performance-ego3": 0.0019388830424934033}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.8773005288041658, "get_ui_image": 0.055904052115434054, "step_physics": 0.6426222971733043, "survival_time": 7.499999999999981, "driven_lanedir": 1.093112188430767, "get_state_dump": 0.009626446970251222, "get_robot_state": 0.014213339382449522, "sim_render-ego0": 0.003810121523623435, "sim_render-ego1": 0.00386190414428711, "sim_render-ego2": 0.003688679625656431, "sim_render-ego3": 0.0036859449171862064, "get_duckie_state": 1.7526133960445985e-06, "in-drivable-lane": 4.199999999999985, "deviation-heading": 1.4050102318329205, "agent_compute-ego0": 0.011009419990691128, "agent_compute-ego1": 0.010904547394506189, "agent_compute-ego2": 0.010023169170152273, "agent_compute-ego3": 0.010495392692010134, "complete-iteration": 0.8309635910766804, "set_robot_commands": 0.002119364327942298, "deviation-center-line": 0.2963999319120335, "driven_lanedir_consec": 1.019001024923512, "sim_compute_sim_state": 0.034274207045700375, "sim_compute_performance-ego0": 0.0020409577729686205, "sim_compute_performance-ego1": 0.0019565339120018563, "sim_compute_performance-ego2": 0.0019816168096681306, "sim_compute_performance-ego3": 0.0019388830424934033}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.6280751458799152, "get_ui_image": 0.053280581926044665, "step_physics": 0.8144996718356484, "survival_time": 4.699999999999991, "driven_lanedir": 0.7583962833546565, "get_state_dump": 0.009903762215062192, "get_robot_state": 0.014626588319477284, "sim_render-ego0": 0.003936571823923212, "sim_render-ego1": 0.003869606319226717, "sim_render-ego2": 0.003872899005287572, "sim_render-ego3": 0.0038746432254188937, "get_duckie_state": 1.3251053659539477e-06, "in-drivable-lane": 1.2999999999999958, "deviation-heading": 2.3745112943922093, "agent_compute-ego0": 0.011961758764166582, "agent_compute-ego1": 0.011700027867367391, "agent_compute-ego2": 0.012269386492277446, "agent_compute-ego3": 0.011898043281153629, "complete-iteration": 1.0025089841139945, "set_robot_commands": 0.00231245944374486, "deviation-center-line": 0.35315000024132365, "driven_lanedir_consec": 0.6500822524354004, "sim_compute_sim_state": 0.029371316809403268, "sim_compute_performance-ego0": 0.0021012657567074425, "sim_compute_performance-ego1": 0.002019493203414114, "sim_compute_performance-ego2": 0.0020048844186883225, "sim_compute_performance-ego3": 0.002033979014346474}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.651855716884684, "get_ui_image": 0.053280581926044665, "step_physics": 0.8144996718356484, "survival_time": 4.699999999999991, "driven_lanedir": 0.6448691596131364, "get_state_dump": 0.009903762215062192, "get_robot_state": 0.014626588319477284, "sim_render-ego0": 0.003936571823923212, "sim_render-ego1": 0.003869606319226717, "sim_render-ego2": 0.003872899005287572, "sim_render-ego3": 0.0038746432254188937, "get_duckie_state": 1.3251053659539477e-06, "in-drivable-lane": 2.8499999999999903, "deviation-heading": 0.3081468886732283, "agent_compute-ego0": 0.011961758764166582, "agent_compute-ego1": 0.011700027867367391, "agent_compute-ego2": 0.012269386492277446, "agent_compute-ego3": 0.011898043281153629, "complete-iteration": 1.0025089841139945, "set_robot_commands": 0.00231245944374486, "deviation-center-line": 0.08859552213173046, "driven_lanedir_consec": 0.6448691596131364, "sim_compute_sim_state": 0.029371316809403268, "sim_compute_performance-ego0": 0.0021012657567074425, "sim_compute_performance-ego1": 0.002019493203414114, "sim_compute_performance-ego2": 0.0020048844186883225, "sim_compute_performance-ego3": 0.002033979014346474}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.0902653778303937, "get_ui_image": 0.053280581926044665, "step_physics": 0.8144996718356484, "survival_time": 4.699999999999991, "driven_lanedir": 0.5068511295148899, "get_state_dump": 0.009903762215062192, "get_robot_state": 0.014626588319477284, "sim_render-ego0": 0.003936571823923212, "sim_render-ego1": 0.003869606319226717, "sim_render-ego2": 0.003872899005287572, "sim_render-ego3": 0.0038746432254188937, "get_duckie_state": 1.3251053659539477e-06, "in-drivable-lane": 0.9999999999999998, "deviation-heading": 3.0542186889712815, "agent_compute-ego0": 0.011961758764166582, "agent_compute-ego1": 0.011700027867367391, "agent_compute-ego2": 0.012269386492277446, "agent_compute-ego3": 0.011898043281153629, "complete-iteration": 1.0025089841139945, "set_robot_commands": 0.00231245944374486, "deviation-center-line": 0.47013425987002005, "driven_lanedir_consec": 0.5068511295148899, "sim_compute_sim_state": 0.029371316809403268, "sim_compute_performance-ego0": 0.0021012657567074425, "sim_compute_performance-ego1": 0.002019493203414114, "sim_compute_performance-ego2": 0.0020048844186883225, "sim_compute_performance-ego3": 0.002033979014346474}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.38662204608009304, "get_ui_image": 0.053280581926044665, "step_physics": 0.8144996718356484, "survival_time": 4.699999999999991, "driven_lanedir": 0.30949264303267476, "get_state_dump": 0.009903762215062192, "get_robot_state": 0.014626588319477284, "sim_render-ego0": 0.003936571823923212, "sim_render-ego1": 0.003869606319226717, "sim_render-ego2": 0.003872899005287572, "sim_render-ego3": 0.0038746432254188937, "get_duckie_state": 1.3251053659539477e-06, "in-drivable-lane": 3.549999999999991, "deviation-heading": 0.4820625311897111, "agent_compute-ego0": 0.011961758764166582, "agent_compute-ego1": 0.011700027867367391, "agent_compute-ego2": 0.012269386492277446, "agent_compute-ego3": 0.011898043281153629, "complete-iteration": 1.0025089841139945, "set_robot_commands": 0.00231245944374486, "deviation-center-line": 0.0720091252708566, "driven_lanedir_consec": 0.30949264303267476, "sim_compute_sim_state": 0.029371316809403268, "sim_compute_performance-ego0": 0.0021012657567074425, "sim_compute_performance-ego1": 0.002019493203414114, "sim_compute_performance-ego2": 0.0020048844186883225, "sim_compute_performance-ego3": 0.002033979014346474}}
set_robot_commands_max	0.00231245944374486
set_robot_commands_mean	0.002215911885843579
set_robot_commands_median	0.002215911885843579
set_robot_commands_min	0.002119364327942298
sim_compute_performance-ego0_max	0.0021012657567074425
sim_compute_performance-ego0_mean	0.0020711117648380315
sim_compute_performance-ego0_median	0.0020711117648380315
sim_compute_performance-ego0_min	0.0020409577729686205
sim_compute_performance-ego1_max	0.002019493203414114
sim_compute_performance-ego1_mean	0.001988013557707985
sim_compute_performance-ego1_median	0.001988013557707985
sim_compute_performance-ego1_min	0.0019565339120018563
sim_compute_performance-ego2_max	0.0020048844186883225
sim_compute_performance-ego2_mean	0.0019932506141782267
sim_compute_performance-ego2_median	0.0019932506141782267
sim_compute_performance-ego2_min	0.0019816168096681306
sim_compute_performance-ego3_max	0.002033979014346474
sim_compute_performance-ego3_mean	0.0019864310284199386
sim_compute_performance-ego3_median	0.0019864310284199386
sim_compute_performance-ego3_min	0.0019388830424934033
sim_compute_sim_state_max	0.034274207045700375
sim_compute_sim_state_mean	0.03182276192755182
sim_compute_sim_state_median	0.03182276192755182
sim_compute_sim_state_min	0.029371316809403268
sim_render-ego0_max	0.003936571823923212
sim_render-ego0_mean	0.0038733466737733233
sim_render-ego0_median	0.0038733466737733233
sim_render-ego0_min	0.003810121523623435
sim_render-ego1_max	0.003869606319226717
sim_render-ego1_mean	0.003865755231756913
sim_render-ego1_median	0.003865755231756913
sim_render-ego1_min	0.00386190414428711
sim_render-ego2_max	0.003872899005287572
sim_render-ego2_mean	0.0037807893154720015
sim_render-ego2_median	0.0037807893154720015
sim_render-ego2_min	0.003688679625656431
sim_render-ego3_max	0.0038746432254188937
sim_render-ego3_mean	0.00378029407130255
sim_render-ego3_median	0.00378029407130255
sim_render-ego3_min	0.0036859449171862064
simulation-passed	1
step_physics_max	0.8144996718356484
step_physics_mean	0.7285609845044764
step_physics_median	0.7285609845044764
step_physics_min	0.6426222971733043
survival_time_max	7.499999999999981
survival_time_mean	6.099999999999986
survival_time_min	4.699999999999991

No reset possible

53575

12658

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

success

yes

2020-12-02 20:56:29+00:00

2020-12-02 21:19:30+00:00

0:23:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.31992881737322587
survival_time_median	9.6
deviation-center-line_median	0.07835975569599478
in-drivable-lane_median	7.700000000000003

other stats

agent_compute-ego0_max	0.02973057542528425
agent_compute-ego0_mean	0.017871086186405764
agent_compute-ego0_median	0.013739312868661832
agent_compute-ego0_min	0.012613231964532842
agent_compute-ego1_max	0.028904400174579924
agent_compute-ego1_mean	0.017246666747591448
agent_compute-ego1_median	0.013217613487046
agent_compute-ego1_min	0.011743682524117316
agent_compute-ego2_max	0.029571815142555843
agent_compute-ego2_mean	0.01851379537660823
agent_compute-ego2_median	0.013184431508101151
agent_compute-ego2_min	0.01278513947916772
agent_compute-ego3_max	0.028675177740672277
agent_compute-ego3_mean	0.01803744872070671
agent_compute-ego3_median	0.013483567559039657
agent_compute-ego3_min	0.01195360086240821
complete-iteration_max	1.1561053518265012
complete-iteration_mean	0.9727871255160272
complete-iteration_median	1.1361838498881445
complete-iteration_min	0.35075207109804507
deviation-center-line_max	0.240965720156589
deviation-center-line_mean	0.08782909468281055
deviation-center-line_min	0.035997628531515474
deviation-heading_max	1.288730205627049
deviation-heading_mean	0.6257458456007571
deviation-heading_median	0.4977991644409327
deviation-heading_min	0.23223876370998295
driven_any_max	7.56053723655662
driven_any_mean	1.7767480361357042
driven_any_median	0.9885480670478064
driven_any_min	0.3581894199750563
driven_lanedir_consec_max	0.8622842577071264
driven_lanedir_consec_mean	0.34947683631418397
driven_lanedir_consec_min	0.107613810712069
driven_lanedir_max	0.8622842577071264
driven_lanedir_mean	0.34947683631418397
driven_lanedir_median	0.31992881737322587
driven_lanedir_min	0.107613810712069
get_duckie_state_max	1.3909809329966808e-06
get_duckie_state_mean	1.3203132937285323e-06
get_duckie_state_median	1.3907750447591143e-06
get_duckie_state_min	1.1947273549453988e-06
get_robot_state_max	0.01418746274615091
get_robot_state_mean	0.013009958292666832
get_robot_state_median	0.013901078021588104
get_robot_state_min	0.0072921629305239075
get_state_dump_max	0.009584810998704698
get_state_dump_mean	0.009003355167609936
get_state_dump_median	0.009423213919209692
get_state_dump_min	0.006382315247147171
get_ui_image_max	0.05186703091575986
get_ui_image_mean	0.046184222751664915
get_ui_image_median	0.04866171006711653
get_ui_image_min	0.03322024875217014
in-drivable-lane_max	16.75000000000012
in-drivable-lane_mean	9.260714285714313
in-drivable-lane_min	4.449999999999985
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.5127684067108719, "get_ui_image": 0.04450591427186576, "step_physics": 0.7759142040547745, "survival_time": 18.05000000000012, "driven_lanedir": 0.4503654774210149, "get_state_dump": 0.009312560545146797, "get_robot_state": 0.01380023179133294, "sim_render-ego0": 0.0035828338802190115, "sim_render-ego1": 0.003475745738540565, "sim_render-ego2": 0.00363231232153118, "sim_render-ego3": 0.0034649345756235703, "get_duckie_state": 1.1947273549453988e-06, "in-drivable-lane": 16.600000000000122, "deviation-heading": 0.4232034040154166, "agent_compute-ego0": 0.012613231964532842, "agent_compute-ego1": 0.011743682524117316, "agent_compute-ego2": 0.013184431508101151, "agent_compute-ego3": 0.01195360086240821, "complete-iteration": 0.9370897020424268, "set_robot_commands": 0.00218698398842996, "deviation-center-line": 0.05457625694553754, "driven_lanedir_consec": 0.4503654774210149, "sim_compute_sim_state": 0.013521350549729487, "sim_compute_performance-ego0": 0.0018916591096319547, "sim_compute_performance-ego1": 0.0019154127131509515, "sim_compute_performance-ego2": 0.0019069620258900344, "sim_compute_performance-ego3": 0.0018534989646785168}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.0773586972736953, "get_ui_image": 0.04450591427186576, "step_physics": 0.7759142040547745, "survival_time": 18.05000000000012, "driven_lanedir": 0.3375234935553282, "get_state_dump": 0.009312560545146797, "get_robot_state": 0.01380023179133294, "sim_render-ego0": 0.0035828338802190115, "sim_render-ego1": 0.003475745738540565, "sim_render-ego2": 0.00363231232153118, "sim_render-ego3": 0.0034649345756235703, "get_duckie_state": 1.1947273549453988e-06, "in-drivable-lane": 16.55000000000012, "deviation-heading": 0.7001902904689402, "agent_compute-ego0": 0.012613231964532842, "agent_compute-ego1": 0.011743682524117316, "agent_compute-ego2": 0.013184431508101151, "agent_compute-ego3": 0.01195360086240821, "complete-iteration": 0.9370897020424268, "set_robot_commands": 0.00218698398842996, "deviation-center-line": 0.09704769294060986, "driven_lanedir_consec": 0.3375234935553282, "sim_compute_sim_state": 0.013521350549729487, "sim_compute_performance-ego0": 0.0018916591096319547, "sim_compute_performance-ego1": 0.0019154127131509515, "sim_compute_performance-ego2": 0.0019069620258900344, "sim_compute_performance-ego3": 0.0018534989646785168}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.56053723655662, "get_ui_image": 0.04450591427186576, "step_physics": 0.7759142040547745, "survival_time": 18.05000000000012, "driven_lanedir": 0.5696451020408935, "get_state_dump": 0.009312560545146797, "get_robot_state": 0.01380023179133294, "sim_render-ego0": 0.0035828338802190115, "sim_render-ego1": 0.003475745738540565, "sim_render-ego2": 0.00363231232153118, "sim_render-ego3": 0.0034649345756235703, "get_duckie_state": 1.1947273549453988e-06, "in-drivable-lane": 15.850000000000117, "deviation-heading": 1.257654743808632, "agent_compute-ego0": 0.012613231964532842, "agent_compute-ego1": 0.011743682524117316, "agent_compute-ego2": 0.013184431508101151, "agent_compute-ego3": 0.01195360086240821, "complete-iteration": 0.9370897020424268, "set_robot_commands": 0.00218698398842996, "deviation-center-line": 0.12110374827365604, "driven_lanedir_consec": 0.5696451020408935, "sim_compute_sim_state": 0.013521350549729487, "sim_compute_performance-ego0": 0.0018916591096319547, "sim_compute_performance-ego1": 0.0019154127131509515, "sim_compute_performance-ego2": 0.0019069620258900344, "sim_compute_performance-ego3": 0.0018534989646785168}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6652715241546576, "get_ui_image": 0.04450591427186576, "step_physics": 0.7759142040547745, "survival_time": 18.05000000000012, "driven_lanedir": 0.3349137042084003, "get_state_dump": 0.009312560545146797, "get_robot_state": 0.01380023179133294, "sim_render-ego0": 0.0035828338802190115, "sim_render-ego1": 0.003475745738540565, "sim_render-ego2": 0.00363231232153118, "sim_render-ego3": 0.0034649345756235703, "get_duckie_state": 1.1947273549453988e-06, "in-drivable-lane": 16.75000000000012, "deviation-heading": 0.4084887793264565, "agent_compute-ego0": 0.012613231964532842, "agent_compute-ego1": 0.011743682524117316, "agent_compute-ego2": 0.013184431508101151, "agent_compute-ego3": 0.01195360086240821, "complete-iteration": 0.9370897020424268, "set_robot_commands": 0.00218698398842996, "deviation-center-line": 0.059540331760822546, "driven_lanedir_consec": 0.3349137042084003, "sim_compute_sim_state": 0.013521350549729487, "sim_compute_performance-ego0": 0.0018916591096319547, "sim_compute_performance-ego1": 0.0019154127131509515, "sim_compute_performance-ego2": 0.0019069620258900344, "sim_compute_performance-ego3": 0.0018534989646785168}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.7015305335933123, "get_ui_image": 0.05186703091575986, "step_physics": 0.9027790077148922, "survival_time": 6.249999999999986, "driven_lanedir": 0.3595163059741928, "get_state_dump": 0.009584810998704698, "get_robot_state": 0.01418746274615091, "sim_render-ego0": 0.0038750171661376953, "sim_render-ego1": 0.003710084491305881, "sim_render-ego2": 0.0037193033430311414, "sim_render-ego3": 0.003647297147720579, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 4.749999999999985, "deviation-heading": 0.6643405150101285, "agent_compute-ego0": 0.02973057542528425, "agent_compute-ego1": 0.028904400174579924, "agent_compute-ego2": 0.029571815142555843, "agent_compute-ego3": 0.028675177740672277, "complete-iteration": 1.1561053518265012, "set_robot_commands": 0.0022353577235388377, "deviation-center-line": 0.07551959725312567, "driven_lanedir_consec": 0.3595163059741928, "sim_compute_sim_state": 0.028950479295518663, "sim_compute_performance-ego0": 0.0020065061629764617, "sim_compute_performance-ego1": 0.00198519229888916, "sim_compute_performance-ego2": 0.0019521542957850863, "sim_compute_performance-ego3": 0.0019460329933772011}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.2937164428895458, "get_ui_image": 0.05186703091575986, "step_physics": 0.9027790077148922, "survival_time": 6.249999999999986, "driven_lanedir": 0.2548812266706846, "get_state_dump": 0.009584810998704698, "get_robot_state": 0.01418746274615091, "sim_render-ego0": 0.0038750171661376953, "sim_render-ego1": 0.003710084491305881, "sim_render-ego2": 0.0037193033430311414, "sim_render-ego3": 0.003647297147720579, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 4.999999999999987, "deviation-heading": 0.8922396401861884, "agent_compute-ego0": 0.02973057542528425, "agent_compute-ego1": 0.028904400174579924, "agent_compute-ego2": 0.029571815142555843, "agent_compute-ego3": 0.028675177740672277, "complete-iteration": 1.1561053518265012, "set_robot_commands": 0.0022353577235388377, "deviation-center-line": 0.11990974629795775, "driven_lanedir_consec": 0.2548812266706846, "sim_compute_sim_state": 0.028950479295518663, "sim_compute_performance-ego0": 0.0020065061629764617, "sim_compute_performance-ego1": 0.00198519229888916, "sim_compute_performance-ego2": 0.0019521542957850863, "sim_compute_performance-ego3": 0.0019460329933772011}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.4247680343537885, "get_ui_image": 0.05186703091575986, "step_physics": 0.9027790077148922, "survival_time": 6.249999999999986, "driven_lanedir": 0.5666684366800019, "get_state_dump": 0.009584810998704698, "get_robot_state": 0.01418746274615091, "sim_render-ego0": 0.0038750171661376953, "sim_render-ego1": 0.003710084491305881, "sim_render-ego2": 0.0037193033430311414, "sim_render-ego3": 0.003647297147720579, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.5017718770496762, "agent_compute-ego0": 0.02973057542528425, "agent_compute-ego1": 0.028904400174579924, "agent_compute-ego2": 0.029571815142555843, "agent_compute-ego3": 0.028675177740672277, "complete-iteration": 1.1561053518265012, "set_robot_commands": 0.0022353577235388377, "deviation-center-line": 0.09612834912269846, "driven_lanedir_consec": 0.5666684366800019, "sim_compute_sim_state": 0.028950479295518663, "sim_compute_performance-ego0": 0.0020065061629764617, "sim_compute_performance-ego1": 0.00198519229888916, "sim_compute_performance-ego2": 0.0019521542957850863, "sim_compute_performance-ego3": 0.0019460329933772011}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.8997374368219176, "get_ui_image": 0.05186703091575986, "step_physics": 0.9027790077148922, "survival_time": 6.249999999999986, "driven_lanedir": 0.24799316849660413, "get_state_dump": 0.009584810998704698, "get_robot_state": 0.01418746274615091, "sim_render-ego0": 0.0038750171661376953, "sim_render-ego1": 0.003710084491305881, "sim_render-ego2": 0.0037193033430311414, "sim_render-ego3": 0.003647297147720579, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 5.349999999999985, "deviation-heading": 0.23223876370998295, "agent_compute-ego0": 0.02973057542528425, "agent_compute-ego1": 0.028904400174579924, "agent_compute-ego2": 0.029571815142555843, "agent_compute-ego3": 0.028675177740672277, "complete-iteration": 1.1561053518265012, "set_robot_commands": 0.0022353577235388377, "deviation-center-line": 0.08119991413886389, "driven_lanedir_consec": 0.24799316849660413, "sim_compute_sim_state": 0.028950479295518663, "sim_compute_performance-ego0": 0.0020065061629764617, "sim_compute_performance-ego1": 0.00198519229888916, "sim_compute_performance-ego2": 0.0019521542957850863, "sim_compute_performance-ego3": 0.0019460329933772011}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8323887561616258, "get_ui_image": 0.04866171006711653, "step_physics": 0.9608317422125624, "survival_time": 9.6, "driven_lanedir": 0.1765162833684295, "get_state_dump": 0.009423213919209692, "get_robot_state": 0.013901078021588104, "sim_render-ego0": 0.003809754712593988, "sim_render-ego1": 0.003682431779377201, "sim_render-ego2": 0.003612295951250303, "sim_render-ego3": 0.003775917804302947, "get_duckie_state": 1.3909809329966808e-06, "in-drivable-lane": 8.75, "deviation-heading": 0.561819982638771, "agent_compute-ego0": 0.013739312868661832, "agent_compute-ego1": 0.013217613487046, "agent_compute-ego2": 0.01278513947916772, "agent_compute-ego3": 0.013483567559039657, "complete-iteration": 1.1361838498881445, "set_robot_commands": 0.0022184169354216425, "deviation-center-line": 0.054638405701831434, "driven_lanedir_consec": 0.1765162833684295, "sim_compute_sim_state": 0.01878340009580622, "sim_compute_performance-ego0": 0.001906791499241646, "sim_compute_performance-ego1": 0.0019071534507632871, "sim_compute_performance-ego2": 0.001913645106893747, "sim_compute_performance-ego3": 0.0018612177260799111}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 0.3947810960621528, "get_ui_image": 0.04866171006711653, "step_physics": 0.9608317422125624, "survival_time": 9.6, "driven_lanedir": 0.11553852058534696, "get_state_dump": 0.009423213919209692, "get_robot_state": 0.013901078021588104, "sim_render-ego0": 0.003809754712593988, "sim_render-ego1": 0.003682431779377201, "sim_render-ego2": 0.003612295951250303, "sim_render-ego3": 0.003775917804302947, "get_duckie_state": 1.3909809329966808e-06, "in-drivable-lane": 8.75, "deviation-heading": 0.4312991322773665, "agent_compute-ego0": 0.013739312868661832, "agent_compute-ego1": 0.013217613487046, "agent_compute-ego2": 0.01278513947916772, "agent_compute-ego3": 0.013483567559039657, "complete-iteration": 1.1361838498881445, "set_robot_commands": 0.0022184169354216425, "deviation-center-line": 0.035997628531515474, "driven_lanedir_consec": 0.11553852058534696, "sim_compute_sim_state": 0.01878340009580622, "sim_compute_performance-ego0": 0.001906791499241646, "sim_compute_performance-ego1": 0.0019071534507632871, "sim_compute_performance-ego2": 0.001913645106893747, "sim_compute_performance-ego3": 0.0018612177260799111}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.7319739454128618, "get_ui_image": 0.04866171006711653, "step_physics": 0.9608317422125624, "survival_time": 9.6, "driven_lanedir": 0.8622842577071264, "get_state_dump": 0.009423213919209692, "get_robot_state": 0.013901078021588104, "sim_render-ego0": 0.003809754712593988, "sim_render-ego1": 0.003682431779377201, "sim_render-ego2": 0.003612295951250303, "sim_render-ego3": 0.003775917804302947, "get_duckie_state": 1.3909809329966808e-06, "in-drivable-lane": 6.800000000000004, "deviation-heading": 1.288730205627049, "agent_compute-ego0": 0.013739312868661832, "agent_compute-ego1": 0.013217613487046, "agent_compute-ego2": 0.01278513947916772, "agent_compute-ego3": 0.013483567559039657, "complete-iteration": 1.1361838498881445, "set_robot_commands": 0.0022184169354216425, "deviation-center-line": 0.240965720156589, "driven_lanedir_consec": 0.8622842577071264, "sim_compute_sim_state": 0.01878340009580622, "sim_compute_performance-ego0": 0.001906791499241646, "sim_compute_performance-ego1": 0.0019071534507632871, "sim_compute_performance-ego2": 0.001913645106893747, "sim_compute_performance-ego3": 0.0018612177260799111}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3581894199750563, "get_ui_image": 0.04866171006711653, "step_physics": 0.9608317422125624, "survival_time": 9.6, "driven_lanedir": 0.20427199044043176, "get_state_dump": 0.009423213919209692, "get_robot_state": 0.013901078021588104, "sim_render-ego0": 0.003809754712593988, "sim_render-ego1": 0.003682431779377201, "sim_render-ego2": 0.003612295951250303, "sim_render-ego3": 0.003775917804302947, "get_duckie_state": 1.3909809329966808e-06, "in-drivable-lane": 8.600000000000001, "deviation-heading": 0.4938264518321893, "agent_compute-ego0": 0.013739312868661832, "agent_compute-ego1": 0.013217613487046, "agent_compute-ego2": 0.01278513947916772, "agent_compute-ego3": 0.013483567559039657, "complete-iteration": 1.1361838498881445, "set_robot_commands": 0.0022184169354216425, "deviation-center-line": 0.05828112308234561, "driven_lanedir_consec": 0.20427199044043176, "sim_compute_sim_state": 0.01878340009580622, "sim_compute_performance-ego0": 0.001906791499241646, "sim_compute_performance-ego1": 0.0019071534507632871, "sim_compute_performance-ego2": 0.001913645106893747, "sim_compute_performance-ego3": 0.0018612177260799111}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 0.8670218666933306, "get_ui_image": 0.03322024875217014, "step_physics": 0.2542038846898962, "survival_time": 6.699999999999984, "driven_lanedir": 0.107613810712069, "get_state_dump": 0.006382315247147171, "get_robot_state": 0.0072921629305239075, "sim_render-ego0": 0.003701231214735243, "sim_render-ego1": 0.0038214347980640552, "get_duckie_state": 1.289226390697338e-06, "in-drivable-lane": 5.849999999999984, "deviation-heading": 0.4440557967990175, "agent_compute-ego0": 0.012931362787882488, "agent_compute-ego1": 0.012995274861653644, "complete-iteration": 0.35075207109804507, "set_robot_commands": 0.0022511959075927736, "deviation-center-line": 0.04115941867266226, "driven_lanedir_consec": 0.107613810712069, "sim_compute_sim_state": 0.007437031357376664, "sim_compute_performance-ego0": 0.0020089873561152704, "sim_compute_performance-ego1": 0.0020355860392252604}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.554429109240424, "get_ui_image": 0.03322024875217014, "step_physics": 0.2542038846898962, "survival_time": 6.699999999999984, "driven_lanedir": 0.30494393053805147, "get_state_dump": 0.006382315247147171, "get_robot_state": 0.0072921629305239075, "sim_render-ego0": 0.003701231214735243, "sim_render-ego1": 0.0038214347980640552, "get_duckie_state": 1.289226390697338e-06, "in-drivable-lane": 5.5999999999999845, "deviation-heading": 0.460582255660784, "agent_compute-ego0": 0.012931362787882488, "agent_compute-ego1": 0.012995274861653644, "complete-iteration": 0.35075207109804507, "set_robot_commands": 0.0022511959075927736, "deviation-center-line": 0.09353939268113208, "driven_lanedir_consec": 0.30494393053805147, "sim_compute_sim_state": 0.007437031357376664, "sim_compute_performance-ego0": 0.0020089873561152704, "sim_compute_performance-ego1": 0.0020355860392252604}}
set_robot_commands_max	0.0022511959075927736
set_robot_commands_mean	0.0022189590289105224
set_robot_commands_median	0.0022184169354216425
set_robot_commands_min	0.00218698398842996
sim_compute_performance-ego0_max	0.0020089873561152704
sim_compute_performance-ego0_mean	0.0019455572714021992
sim_compute_performance-ego0_median	0.001906791499241646
sim_compute_performance-ego0_min	0.0018916591096319547
sim_compute_performance-ego1_max	0.0020355860392252604
sim_compute_performance-ego1_mean	0.00195015756640458
sim_compute_performance-ego1_median	0.0019154127131509515
sim_compute_performance-ego1_min	0.0019071534507632871
sim_compute_performance-ego2_max	0.0019521542957850863
sim_compute_performance-ego2_mean	0.0019242538095229555
sim_compute_performance-ego2_median	0.001913645106893747
sim_compute_performance-ego2_min	0.0019069620258900344
sim_compute_performance-ego3_max	0.0019460329933772011
sim_compute_performance-ego3_mean	0.0018869165613785424
sim_compute_performance-ego3_median	0.0018612177260799111
sim_compute_performance-ego3_min	0.0018534989646785168
sim_compute_sim_state_max	0.028950479295518663
sim_compute_sim_state_mean	0.01856392731992649
sim_compute_sim_state_median	0.01878340009580622
sim_compute_sim_state_min	0.007437031357376664
sim_render-ego0_max	0.0038750171661376953
sim_render-ego0_mean	0.003748063247519519
sim_render-ego0_median	0.003809754712593988
sim_render-ego0_min	0.0035828338802190115
sim_render-ego1_max	0.0038214347980640552
sim_render-ego1_mean	0.003651136973787336
sim_render-ego1_median	0.003682431779377201
sim_render-ego1_min	0.003475745738540565
sim_render-ego2_max	0.0037193033430311414
sim_render-ego2_mean	0.003654637205270874
sim_render-ego2_median	0.00363231232153118
sim_render-ego2_min	0.003612295951250303
sim_render-ego3_max	0.003775917804302947
sim_render-ego3_mean	0.0036293831758823654
sim_render-ego3_median	0.003647297147720579
sim_render-ego3_min	0.0034649345756235703
simulation-passed	1
step_physics_max	0.9608317422125624
step_physics_mean	0.7904648275220506
step_physics_median	0.9027790077148922
step_physics_min	0.2542038846898962
survival_time_max	18.05000000000012
survival_time_mean	10.64285714285717
survival_time_min	6.249999999999986

No reset possible

53570

12660

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

success

yes

2020-12-02 20:53:56+00:00

2020-12-02 20:56:15+00:00

0:02:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3546757283474695
survival_time_median	2.3249999999999997
deviation-center-line_median	0.14504365209840792
in-drivable-lane_median	0.749999999999999

other stats

agent_compute-ego0_max	0.05354005813598633
agent_compute-ego0_mean	0.033847696516248915
agent_compute-ego0_median	0.033847696516248915
agent_compute-ego0_min	0.014155334896511504
complete-iteration_max	0.365514702796936
complete-iteration_mean	0.3364675656954448
complete-iteration_median	0.3364675656954448
complete-iteration_min	0.30742042859395347
deviation-center-line_max	0.20601150490502904
deviation-center-line_mean	0.14504365209840792
deviation-center-line_min	0.08407579929178674
deviation-heading_max	0.5777034115619631
deviation-heading_mean	0.5408019921244627
deviation-heading_median	0.5408019921244627
deviation-heading_min	0.5039005726869622
driven_any_max	0.39799345054368834
driven_any_mean	0.39305596139242394
driven_any_median	0.39305596139242394
driven_any_min	0.38811847224115953
driven_lanedir_consec_max	0.37181220832561346
driven_lanedir_consec_mean	0.3546757283474695
driven_lanedir_consec_min	0.3375392483693256
driven_lanedir_max	0.37181220832561346
driven_lanedir_mean	0.3546757283474695
driven_lanedir_median	0.3546757283474695
driven_lanedir_min	0.3375392483693256
get_duckie_state_max	1.3669331868489583e-06
get_duckie_state_mean	1.3319651285807292e-06
get_duckie_state_median	1.3319651285807292e-06
get_duckie_state_min	1.2969970703125e-06
get_robot_state_max	0.003829383850097656
get_robot_state_mean	0.0037623405456542977
get_robot_state_median	0.0037623405456542977
get_robot_state_min	0.0036952972412109377
get_state_dump_max	0.004927120208740234
get_state_dump_mean	0.0048539288838704425
get_state_dump_median	0.0048539288838704425
get_state_dump_min	0.004780737559000651
get_ui_image_max	0.03906059265136719
get_ui_image_mean	0.03885739379458957
get_ui_image_median	0.03885739379458957
get_ui_image_min	0.03865419493781195
in-drivable-lane_max	0.7999999999999996
in-drivable-lane_mean	0.749999999999999
in-drivable-lane_min	0.6999999999999984
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.39799345054368834, "get_ui_image": 0.03906059265136719, "step_physics": 0.24663972854614255, "survival_time": 2.4499999999999993, "driven_lanedir": 0.37181220832561346, "get_state_dump": 0.004927120208740234, "get_robot_state": 0.003829383850097656, "sim_render-ego0": 0.0038695287704467777, "get_duckie_state": 1.2969970703125e-06, "in-drivable-lane": 0.6999999999999984, "deviation-heading": 0.5777034115619631, "agent_compute-ego0": 0.05354005813598633, "complete-iteration": 0.365514702796936, "set_robot_commands": 0.002280254364013672, "deviation-center-line": 0.20601150490502904, "driven_lanedir_consec": 0.37181220832561346, "sim_compute_sim_state": 0.00922548770904541, "sim_compute_performance-ego0": 0.0020601367950439453}, "LFI-norm-udem1-000-ego0": {"driven_any": 0.38811847224115953, "get_ui_image": 0.03865419493781195, "step_physics": 0.22911258803473575, "survival_time": 2.2, "driven_lanedir": 0.3375392483693256, "get_state_dump": 0.004780737559000651, "get_robot_state": 0.0036952972412109377, "sim_render-ego0": 0.00383909543355306, "get_duckie_state": 1.3669331868489583e-06, "in-drivable-lane": 0.7999999999999996, "deviation-heading": 0.5039005726869622, "agent_compute-ego0": 0.014155334896511504, "complete-iteration": 0.30742042859395347, "set_robot_commands": 0.0022178543938530817, "deviation-center-line": 0.08407579929178674, "driven_lanedir_consec": 0.3375392483693256, "sim_compute_sim_state": 0.008848487006293402, "sim_compute_performance-ego0": 0.002031400468614366}}
set_robot_commands_max	0.002280254364013672
set_robot_commands_mean	0.0022490543789333768
set_robot_commands_median	0.0022490543789333768
set_robot_commands_min	0.0022178543938530817
sim_compute_performance-ego0_max	0.0020601367950439453
sim_compute_performance-ego0_mean	0.0020457686318291557
sim_compute_performance-ego0_median	0.0020457686318291557
sim_compute_performance-ego0_min	0.002031400468614366
sim_compute_sim_state_max	0.00922548770904541
sim_compute_sim_state_mean	0.009036987357669406
sim_compute_sim_state_median	0.009036987357669406
sim_compute_sim_state_min	0.008848487006293402
sim_render-ego0_max	0.0038695287704467777
sim_render-ego0_mean	0.0038543121019999184
sim_render-ego0_median	0.0038543121019999184
sim_render-ego0_min	0.00383909543355306
simulation-passed	1
step_physics_max	0.24663972854614255
step_physics_mean	0.2378761582904392
step_physics_median	0.2378761582904392
step_physics_min	0.22911258803473575
survival_time_max	2.4499999999999993
survival_time_mean	2.3249999999999997
survival_time_min	2.2

No reset possible

53562

12660

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

success

yes

2020-12-02 20:51:34+00:00

2020-12-02 20:53:47+00:00

0:02:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.25841584985392485
survival_time_median	2.1000000000000005
deviation-center-line_median	0.08191768557491316
in-drivable-lane_median	1.0000000000000002

other stats

agent_compute-ego0_max	0.06178322652491128
agent_compute-ego0_mean	0.03768189890274834
agent_compute-ego0_median	0.03768189890274834
agent_compute-ego0_min	0.013580571280585397
complete-iteration_max	0.35287554089615986
complete-iteration_mean	0.33187867845623154
complete-iteration_median	0.33187867845623154
complete-iteration_min	0.31088181601630316
deviation-center-line_max	0.08407579929178674
deviation-center-line_mean	0.08191768557491316
deviation-center-line_min	0.07975957185803959
deviation-heading_max	0.5039005726869622
deviation-heading_mean	0.4520165333553478
deviation-heading_median	0.4520165333553478
deviation-heading_min	0.4001324940237334
driven_any_max	0.38811847224115953
driven_any_mean	0.3681989124447028
driven_any_median	0.3681989124447028
driven_any_min	0.34827935264824605
driven_lanedir_consec_max	0.3375392483693256
driven_lanedir_consec_mean	0.25841584985392485
driven_lanedir_consec_min	0.17929245133852412
driven_lanedir_max	0.3375392483693256
driven_lanedir_mean	0.25841584985392485
driven_lanedir_median	0.25841584985392485
driven_lanedir_min	0.17929245133852412
get_duckie_state_max	2.174842648389862e-06
get_duckie_state_mean	2.03579744995448e-06
get_duckie_state_median	2.03579744995448e-06
get_duckie_state_min	1.8967522515190973e-06
get_robot_state_max	0.0037294131953541825
get_robot_state_mean	0.003672131354892803
get_robot_state_median	0.003672131354892803
get_robot_state_min	0.003614849514431423
get_state_dump_max	0.004862860935490306
get_state_dump_mean	0.004778420311325611
get_state_dump_median	0.004778420311325611
get_state_dump_min	0.004693979687160916
get_ui_image_max	0.03909395535786946
get_ui_image_mean	0.03889575314715626
get_ui_image_median	0.03889575314715626
get_ui_image_min	0.03869755093644305
in-drivable-lane_max	1.2000000000000008
in-drivable-lane_mean	1.0000000000000002
in-drivable-lane_min	0.7999999999999996
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.34827935264824605, "get_ui_image": 0.03869755093644305, "step_physics": 0.22686162809046304, "survival_time": 2.000000000000001, "driven_lanedir": 0.17929245133852412, "get_state_dump": 0.004862860935490306, "get_robot_state": 0.0037294131953541825, "sim_render-ego0": 0.003854234044144793, "get_duckie_state": 2.174842648389862e-06, "in-drivable-lane": 1.2000000000000008, "deviation-heading": 0.4001324940237334, "agent_compute-ego0": 0.06178322652491128, "complete-iteration": 0.35287554089615986, "set_robot_commands": 0.0022516715817335175, "deviation-center-line": 0.07975957185803959, "driven_lanedir_consec": 0.17929245133852412, "sim_compute_sim_state": 0.008701115119747999, "sim_compute_performance-ego0": 0.0020426889745200553}, "LFI-norm-udem1-000-ego0": {"driven_any": 0.38811847224115953, "get_ui_image": 0.03909395535786946, "step_physics": 0.23297139803568523, "survival_time": 2.2, "driven_lanedir": 0.3375392483693256, "get_state_dump": 0.004693979687160916, "get_robot_state": 0.003614849514431423, "sim_render-ego0": 0.003796667522854275, "get_duckie_state": 1.8967522515190973e-06, "in-drivable-lane": 0.7999999999999996, "deviation-heading": 0.5039005726869622, "agent_compute-ego0": 0.013580571280585397, "complete-iteration": 0.31088181601630316, "set_robot_commands": 0.0021516746944851345, "deviation-center-line": 0.08407579929178674, "driven_lanedir_consec": 0.3375392483693256, "sim_compute_sim_state": 0.008938879436916776, "sim_compute_performance-ego0": 0.00195927619934082}}
set_robot_commands_max	0.0022516715817335175
set_robot_commands_mean	0.002201673138109326
set_robot_commands_median	0.002201673138109326
set_robot_commands_min	0.0021516746944851345
sim_compute_performance-ego0_max	0.0020426889745200553
sim_compute_performance-ego0_mean	0.0020009825869304375
sim_compute_performance-ego0_median	0.0020009825869304375
sim_compute_performance-ego0_min	0.00195927619934082
sim_compute_sim_state_max	0.008938879436916776
sim_compute_sim_state_mean	0.008819997278332388
sim_compute_sim_state_median	0.008819997278332388
sim_compute_sim_state_min	0.008701115119747999
sim_render-ego0_max	0.003854234044144793
sim_render-ego0_mean	0.003825450783499534
sim_render-ego0_median	0.003825450783499534
sim_render-ego0_min	0.003796667522854275
simulation-passed	1
step_physics_max	0.23297139803568523
step_physics_mean	0.22991651306307417
step_physics_median	0.22991651306307417
step_physics_min	0.22686162809046304
survival_time_max	2.2
survival_time_mean	2.1000000000000005
survival_time_min	2.000000000000001

No reset possible

53547

12661

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

success

yes

aido5-LFVI-sim-validation

2020-12-02 20:48:55+00:00

2020-12-02 20:51:20+00:00

0:02:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.304623914661863
survival_time_median	2.6749999999999985
deviation-center-line_median	0.13452886053512655
in-drivable-lane_median	1.2499999999999978

other stats

agent_compute-ego0_max	0.045471642166376114
agent_compute-ego0_mean	0.029915989976790215
agent_compute-ego0_median	0.029915989976790215
agent_compute-ego0_min	0.014360337787204318
complete-iteration_max	0.3291729614138603
complete-iteration_mean	0.32087373758355775
complete-iteration_median	0.32087373758355775
complete-iteration_min	0.31257451375325523
deviation-center-line_max	0.18498192177846637
deviation-center-line_mean	0.13452886053512655
deviation-center-line_min	0.08407579929178674
deviation-heading_max	0.5385238276631144
deviation-heading_mean	0.5212122001750383
deviation-heading_median	0.5212122001750383
deviation-heading_min	0.5039005726869622
driven_any_max	0.6025481292018801
driven_any_mean	0.4953333007215198
driven_any_median	0.4953333007215198
driven_any_min	0.38811847224115953
driven_lanedir_consec_max	0.3375392483693256
driven_lanedir_consec_mean	0.304623914661863
driven_lanedir_consec_min	0.2717085809544004
driven_lanedir_max	0.3375392483693256
driven_lanedir_mean	0.304623914661863
driven_lanedir_median	0.304623914661863
driven_lanedir_min	0.2717085809544004
get_duckie_state_max	1.949734157986111e-06
get_duckie_state_mean	1.7646286222669813e-06
get_duckie_state_median	1.7646286222669813e-06
get_duckie_state_min	1.5795230865478516e-06
get_robot_state_max	0.0038458704948425297
get_robot_state_mean	0.003783386945724487
get_robot_state_median	0.003783386945724487
get_robot_state_min	0.0037209033966064454
get_state_dump_max	0.004974186420440674
get_state_dump_mean	0.004912313487794664
get_state_dump_median	0.004912313487794664
get_state_dump_min	0.004850440555148655
get_ui_image_max	0.03889627382159233
get_ui_image_mean	0.03883014482756456
get_ui_image_median	0.03883014482756456
get_ui_image_min	0.03876401583353679
in-drivable-lane_max	1.6999999999999962
in-drivable-lane_mean	1.2499999999999978
in-drivable-lane_min	0.7999999999999996
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.6025481292018801, "get_ui_image": 0.03889627382159233, "step_physics": 0.21763040870428085, "survival_time": 3.149999999999997, "driven_lanedir": 0.2717085809544004, "get_state_dump": 0.004974186420440674, "get_robot_state": 0.0038458704948425297, "sim_render-ego0": 0.003935810178518295, "get_duckie_state": 1.5795230865478516e-06, "in-drivable-lane": 1.6999999999999962, "deviation-heading": 0.5385238276631144, "agent_compute-ego0": 0.045471642166376114, "complete-iteration": 0.3291729614138603, "set_robot_commands": 0.002315480262041092, "deviation-center-line": 0.18498192177846637, "driven_lanedir_consec": 0.2717085809544004, "sim_compute_sim_state": 0.009913045912981032, "sim_compute_performance-ego0": 0.0021094568073749542}, "LFI-norm-udem1-000-ego0": {"driven_any": 0.38811847224115953, "get_ui_image": 0.03876401583353679, "step_physics": 0.2338033782111274, "survival_time": 2.2, "driven_lanedir": 0.3375392483693256, "get_state_dump": 0.004850440555148655, "get_robot_state": 0.0037209033966064454, "sim_render-ego0": 0.003914234373304579, "get_duckie_state": 1.949734157986111e-06, "in-drivable-lane": 0.7999999999999996, "deviation-heading": 0.5039005726869622, "agent_compute-ego0": 0.014360337787204318, "complete-iteration": 0.31257451375325523, "set_robot_commands": 0.002267773946126302, "deviation-center-line": 0.08407579929178674, "driven_lanedir_consec": 0.3375392483693256, "sim_compute_sim_state": 0.008796479966905382, "sim_compute_performance-ego0": 0.0020124064551459418}}
set_robot_commands_max	0.002315480262041092
set_robot_commands_mean	0.002291627104083697
set_robot_commands_median	0.002291627104083697
set_robot_commands_min	0.002267773946126302
sim_compute_performance-ego0_max	0.0021094568073749542
sim_compute_performance-ego0_mean	0.002060931631260448
sim_compute_performance-ego0_median	0.002060931631260448
sim_compute_performance-ego0_min	0.0020124064551459418
sim_compute_sim_state_max	0.009913045912981032
sim_compute_sim_state_mean	0.009354762939943207
sim_compute_sim_state_median	0.009354762939943207
sim_compute_sim_state_min	0.008796479966905382
sim_render-ego0_max	0.003935810178518295
sim_render-ego0_mean	0.003925022275911437
sim_render-ego0_median	0.003925022275911437
sim_render-ego0_min	0.003914234373304579
simulation-passed	1
step_physics_max	0.2338033782111274
step_physics_mean	0.22571689345770413
step_physics_median	0.22571689345770413
step_physics_min	0.21763040870428085
survival_time_max	3.149999999999997
survival_time_mean	2.6749999999999985
survival_time_min	2.2

No reset possible

53520

12665

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

success

yes

aido5-LFP-sim-validation

2020-12-02 20:39:46+00:00

2020-12-02 20:48:46+00:00

0:09:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8829701080772763
survival_time_median	5.625
deviation-center-line_median	0.28378819204226835
in-drivable-lane_median	2.2500000000000044

other stats

agent_compute-ego0_max	0.024698261210792945
agent_compute-ego0_mean	0.019351932113913353
agent_compute-ego0_median	0.019351932113913353
agent_compute-ego0_min	0.014005603017033758
agent_compute-npc0_max	0.03869631917853104
agent_compute-npc0_mean	0.03553460956806818
agent_compute-npc0_median	0.03553460956806818
agent_compute-npc0_min	0.03237289995760531
agent_compute-npc1_max	0.04155838615015933
agent_compute-npc1_mean	0.037484822062984806
agent_compute-npc1_median	0.037484822062984806
agent_compute-npc1_min	0.03341125797581028
agent_compute-npc2_max	0.03678009259073358
agent_compute-npc2_mean	0.035351437203066785
agent_compute-npc2_median	0.035351437203066785
agent_compute-npc2_min	0.0339227818154
complete-iteration_max	1.3161111467762998
complete-iteration_mean	1.079528409573296
complete-iteration_median	1.079528409573296
complete-iteration_min	0.842945672370292
deviation-center-line_max	0.3535717872187618
deviation-center-line_mean	0.28378819204226835
deviation-center-line_min	0.21400459686577483
deviation-heading_max	1.7267635580153218
deviation-heading_mean	1.205381239163135
deviation-heading_median	1.205381239163135
deviation-heading_min	0.6839989203109482
driven_any_max	3.3171996006869966
driven_any_mean	1.7927025293057908
driven_any_median	1.7927025293057908
driven_any_min	0.2682054579245848
driven_lanedir_consec_max	1.5104000009884486
driven_lanedir_consec_mean	0.8829701080772763
driven_lanedir_consec_min	0.2555402151661039
driven_lanedir_max	1.6498712582172672
driven_lanedir_mean	0.9527057366916856
driven_lanedir_median	0.9527057366916856
driven_lanedir_min	0.2555402151661039
get_duckie_state_max	1.694705035235431e-06
get_duckie_state_mean	1.6372709152199974e-06
get_duckie_state_median	1.6372709152199974e-06
get_duckie_state_min	1.5798367952045642e-06
get_robot_state_max	0.014707712123268529
get_robot_state_mean	0.014519317034806838
get_robot_state_median	0.014519317034806838
get_robot_state_min	0.014330921946345148
get_state_dump_max	0.00980527024520071
get_state_dump_mean	0.009757381889592872
get_state_dump_median	0.009757381889592872
get_state_dump_min	0.009709493533985036
get_ui_image_max	0.052997202486605256
get_ui_image_mean	0.05293326308344031
get_ui_image_median	0.05293326308344031
get_ui_image_min	0.05286932368027537
in-drivable-lane_max	4.500000000000009
in-drivable-lane_mean	2.2500000000000044
in-drivable-lane_min	0.0
per-episodes	details {"LFVI-norm-4way-000-ego0": {"driven_any": 0.2682054579245848, "get_ui_image": 0.052997202486605256, "step_physics": 0.5802293468166042, "survival_time": 1.800000000000001, "driven_lanedir": 0.2555402151661039, "get_state_dump": 0.009709493533985036, "get_robot_state": 0.014330921946345148, "sim_render-ego0": 0.003916044492979307, "sim_render-npc0": 0.0036669357402904614, "sim_render-npc1": 0.0036528948191049937, "sim_render-npc2": 0.003999948501586914, "get_duckie_state": 1.694705035235431e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.6839989203109482, "agent_compute-ego0": 0.014005603017033758, "agent_compute-npc0": 0.03237289995760531, "agent_compute-npc1": 0.03341125797581028, "agent_compute-npc2": 0.0339227818154, "complete-iteration": 0.842945672370292, "set_robot_commands": 0.002547135224213471, "deviation-center-line": 0.21400459686577483, "driven_lanedir_consec": 0.2555402151661039, "sim_compute_sim_state": 0.03905800226572398, "sim_compute_performance-ego0": 0.0020397031629407728, "sim_compute_performance-npc0": 0.001923702858589791, "sim_compute_performance-npc1": 0.001917748837857633, "sim_compute_performance-npc2": 0.0021309272663013355}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.3171996006869966, "get_ui_image": 0.05286932368027537, "step_physics": 1.01904238023256, "survival_time": 9.45, "driven_lanedir": 1.6498712582172672, "get_state_dump": 0.00980527024520071, "get_robot_state": 0.014707712123268529, "sim_render-ego0": 0.004020466302570544, "sim_render-npc0": 0.003957650535985043, "sim_render-npc1": 0.003976774215698242, "sim_render-npc2": 0.004000007478814376, "get_duckie_state": 1.5798367952045642e-06, "in-drivable-lane": 4.500000000000009, "deviation-heading": 1.7267635580153218, "agent_compute-ego0": 0.024698261210792945, "agent_compute-npc0": 0.03869631917853104, "agent_compute-npc1": 0.04155838615015933, "agent_compute-npc2": 0.03678009259073358, "complete-iteration": 1.3161111467762998, "set_robot_commands": 0.0025450367676584343, "deviation-center-line": 0.3535717872187618, "driven_lanedir_consec": 1.5104000009884486, "sim_compute_sim_state": 0.043165934713263264, "sim_compute_performance-ego0": 0.002229621535853336, "sim_compute_performance-npc0": 0.0021006797489367033, "sim_compute_performance-npc1": 0.0021437519475033407, "sim_compute_performance-npc2": 0.0021990236483122173}}
set_robot_commands_max	0.002547135224213471
set_robot_commands_mean	0.0025460859959359526
set_robot_commands_median	0.0025460859959359526
set_robot_commands_min	0.0025450367676584343
sim_compute_performance-ego0_max	0.002229621535853336
sim_compute_performance-ego0_mean	0.0021346623493970545
sim_compute_performance-ego0_median	0.0021346623493970545
sim_compute_performance-ego0_min	0.0020397031629407728
sim_compute_performance-npc0_max	0.0021006797489367033
sim_compute_performance-npc0_mean	0.002012191303763247
sim_compute_performance-npc0_median	0.002012191303763247
sim_compute_performance-npc0_min	0.001923702858589791
sim_compute_performance-npc1_max	0.0021437519475033407
sim_compute_performance-npc1_mean	0.0020307503926804867
sim_compute_performance-npc1_median	0.0020307503926804867
sim_compute_performance-npc1_min	0.001917748837857633
sim_compute_performance-npc2_max	0.0021990236483122173
sim_compute_performance-npc2_mean	0.002164975457306776
sim_compute_performance-npc2_median	0.002164975457306776
sim_compute_performance-npc2_min	0.0021309272663013355
sim_compute_sim_state_max	0.043165934713263264
sim_compute_sim_state_mean	0.041111968489493625
sim_compute_sim_state_median	0.041111968489493625
sim_compute_sim_state_min	0.03905800226572398
sim_render-ego0_max	0.004020466302570544
sim_render-ego0_mean	0.003968255397774925
sim_render-ego0_median	0.003968255397774925
sim_render-ego0_min	0.003916044492979307
sim_render-npc0_max	0.003957650535985043
sim_render-npc0_mean	0.003812293138137752
sim_render-npc0_median	0.003812293138137752
sim_render-npc0_min	0.0036669357402904614
sim_render-npc1_max	0.003976774215698242
sim_render-npc1_mean	0.0038148345174016177
sim_render-npc1_median	0.0038148345174016177
sim_render-npc1_min	0.0036528948191049937
sim_render-npc2_max	0.004000007478814376
sim_render-npc2_mean	0.0039999779902006455
sim_render-npc2_median	0.0039999779902006455
sim_render-npc2_min	0.003999948501586914
simulation-passed	1
step_physics_max	1.01904238023256
step_physics_mean	0.7996358635245822
step_physics_median	0.7996358635245822
step_physics_min	0.5802293468166042
survival_time_max	9.45
survival_time_mean	5.625
survival_time_min	1.800000000000001

No reset possible

53510

12671

Bea Baselines 🐤

baseline-duckietown

LFP-sim

success

2020-12-02 20:30:23+00:00

2020-12-02 20:39:11+00:00

0:08:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	13.350000000000056
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.5015606118430425
deviation-center-line_median	0.6502252756260354

other stats

agent_compute-ego0_max	0.013155596278538214
agent_compute-ego0_mean	0.012414505448786825
agent_compute-ego0_median	0.012323447827696458
agent_compute-ego0_min	0.011855529861216164
complete-iteration_max	0.27219617478201324
complete-iteration_mean	0.22595821674602465
complete-iteration_median	0.22864032909948853
complete-iteration_min	0.17435603400310837
deviation-center-line_max	0.880484947271893
deviation-center-line_mean	0.6420531343923135
deviation-center-line_min	0.38727703904529
deviation-heading_max	2.5410047688832487
deviation-heading_mean	1.827345561697546
deviation-heading_median	1.789027317534182
deviation-heading_min	1.190322842838572
driven_any_max	2.059231870426373
driven_any_mean	1.4717546655791565
driven_any_median	1.6344158372404674
driven_any_min	0.558955117409318
driven_lanedir_consec_max	1.989606316194105
driven_lanedir_consec_mean	1.3825876828150203
driven_lanedir_consec_min	0.5376231913798906
driven_lanedir_max	1.989606316194105
driven_lanedir_mean	1.3825876828150203
driven_lanedir_median	1.5015606118430425
driven_lanedir_min	0.5376231913798906
get_duckie_state_max	0.025035120226854196
get_duckie_state_mean	0.017695981913287723
get_duckie_state_median	0.020791814552183197
get_duckie_state_min	0.0041651783219302995
get_robot_state_max	0.003747218123106199
get_robot_state_mean	0.003694452641822498
get_robot_state_median	0.0037043853910771023
get_robot_state_min	0.003621821662029588
get_state_dump_max	0.008586111244248466
get_state_dump_mean	0.00749464640181436
get_state_dump_median	0.008045595648238858
get_state_dump_min	0.005301283066531262
get_ui_image_max	0.03926863625784901
get_ui_image_mean	0.03394031998848486
get_ui_image_median	0.03479218548792271
get_ui_image_min	0.026908272720244993
in-drivable-lane_max	2.400000000000034
in-drivable-lane_mean	0.6000000000000085
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 2.019462493511017, "get_ui_image": 0.03297906053578195, "step_physics": 0.11667927130599696, "survival_time": 16.250000000000096, "driven_lanedir": 1.989606316194105, "get_state_dump": 0.008586111244248466, "get_robot_state": 0.003725710090684013, "sim_render-ego0": 0.003855964888824276, "get_duckie_state": 0.025035120226854196, "in-drivable-lane": 0.0, "deviation-heading": 2.058773681033399, "agent_compute-ego0": 0.011855529861216164, "complete-iteration": 0.21567800805612575, "set_robot_commands": 0.002370960873328835, "deviation-center-line": 0.7561721504344889, "driven_lanedir_consec": 1.989606316194105, "sim_compute_sim_state": 0.008509387267879183, "sim_compute_performance-ego0": 0.001991870213140008}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.558955117409318, "get_ui_image": 0.03926863625784901, "step_physics": 0.16822577414111556, "survival_time": 5.299999999999989, "driven_lanedir": 0.5376231913798906, "get_state_dump": 0.00818174576090875, "get_robot_state": 0.003747218123106199, "sim_render-ego0": 0.003877276572111611, "get_duckie_state": 0.02109663508762823, "in-drivable-lane": 0.0, "deviation-heading": 1.190322842838572, "agent_compute-ego0": 0.013155596278538214, "complete-iteration": 0.27219617478201324, "set_robot_commands": 0.002278223215976608, "deviation-center-line": 0.5442784008175819, "driven_lanedir_consec": 0.5376231913798906, "sim_compute_sim_state": 0.010286609703135267, "sim_compute_performance-ego0": 0.0019931236160135716}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.249369180969918, "get_ui_image": 0.036605310440063474, "step_physics": 0.1377243121465047, "survival_time": 10.450000000000014, "driven_lanedir": 1.2294077194078, "get_state_dump": 0.007909445535568964, "get_robot_state": 0.003683060691470192, "sim_render-ego0": 0.003837870416187105, "get_duckie_state": 0.020486994016738164, "in-drivable-lane": 0.0, "deviation-heading": 1.5192809540349652, "agent_compute-ego0": 0.0127156586874099, "complete-iteration": 0.24160265014285132, "set_robot_commands": 0.0022034009297688803, "deviation-center-line": 0.38727703904529, "driven_lanedir_consec": 1.2294077194078, "sim_compute_sim_state": 0.014359080223810106, "sim_compute_performance-ego0": 0.001988182749067034}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.059231870426373, "get_ui_image": 0.026908272720244993, "step_physics": 0.10854010696870736, "survival_time": 16.5500000000001, "driven_lanedir": 1.7737135042782852, "get_state_dump": 0.005301283066531262, "get_robot_state": 0.003621821662029588, "sim_render-ego0": 0.00367070106138666, "get_duckie_state": 0.0041651783219302995, "in-drivable-lane": 2.400000000000034, "deviation-heading": 2.5410047688832487, "agent_compute-ego0": 0.011931236967983016, "complete-iteration": 0.17435603400310837, "set_robot_commands": 0.0021457377686558, "deviation-center-line": 0.880484947271893, "driven_lanedir_consec": 1.7737135042782852, "sim_compute_sim_state": 0.006098974181945066, "sim_compute_performance-ego0": 0.0018971361309648995}}
set_robot_commands_max	0.002370960873328835
set_robot_commands_mean	0.002249580696932531
set_robot_commands_median	0.0022408120728727443
set_robot_commands_min	0.0021457377686558
sim_compute_performance-ego0_max	0.0019931236160135716
sim_compute_performance-ego0_mean	0.0019675781772963783
sim_compute_performance-ego0_median	0.001990026481103521
sim_compute_performance-ego0_min	0.0018971361309648995
sim_compute_sim_state_max	0.014359080223810106
sim_compute_sim_state_mean	0.009813512844192403
sim_compute_sim_state_median	0.009397998485507226
sim_compute_sim_state_min	0.006098974181945066
sim_render-ego0_max	0.003877276572111611
sim_render-ego0_mean	0.003810453234627413
sim_render-ego0_median	0.00384691765250569
sim_render-ego0_min	0.00367070106138666
simulation-passed	1
step_physics_max	0.16822577414111556
step_physics_mean	0.13279236614058115
step_physics_median	0.12720179172625085
step_physics_min	0.10854010696870736
survival_time_max	16.5500000000001
survival_time_mean	12.137500000000047
survival_time_min	5.299999999999989

No reset possible

53495

12676

Bea Baselines 🐤

baseline-duckietown

LFVIv-sim

success

yes

aido5-LFV-sim-validation

2020-12-02 20:18:14+00:00

2020-12-02 20:30:04+00:00

0:11:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.371076452637328
survival_time_median	31.04999999999943
deviation-center-line_median	2.500423523751616
in-drivable-lane_median	2.10000000000003

other stats

agent_compute-ego0_max	0.012606102487315302
agent_compute-ego0_mean	0.012278424436451444
agent_compute-ego0_median	0.012278424436451444
agent_compute-ego0_min	0.011950746385587586
complete-iteration_max	0.24641842945762304
complete-iteration_mean	0.22969332260894024
complete-iteration_median	0.22969332260894024
complete-iteration_min	0.2129682157602575
deviation-center-line_max	4.5628167532555475
deviation-center-line_mean	2.500423523751616
deviation-center-line_min	0.4380302942476845
deviation-heading_max	9.074397661415968
deviation-heading_mean	5.17858227506987
deviation-heading_median	5.17858227506987
deviation-heading_min	1.282766888723773
driven_any_max	7.502843560841448
driven_any_mean	3.981115154811026
driven_any_median	3.981115154811026
driven_any_min	0.4593867487806041
driven_lanedir_consec_max	4.298027427497462
driven_lanedir_consec_mean	2.371076452637328
driven_lanedir_consec_min	0.4441254777771939
driven_lanedir_max	6.7290446638560315
driven_lanedir_mean	3.5865850708166125
driven_lanedir_median	3.5865850708166125
driven_lanedir_min	0.4441254777771939
get_duckie_state_max	1.2154164521590525e-06
get_duckie_state_mean	1.1710549034358225e-06
get_duckie_state_median	1.1710549034358225e-06
get_duckie_state_min	1.1266933547125925e-06
get_robot_state_max	0.0036863295928291654
get_robot_state_mean	0.0036659021524415502
get_robot_state_median	0.0036659021524415502
get_robot_state_min	0.0036454747120539346
get_state_dump_max	0.004781735979992411
get_state_dump_mean	0.004717383493223916
get_state_dump_median	0.004717383493223916
get_state_dump_min	0.0046530310064554214
get_ui_image_max	0.03858054202535878
get_ui_image_mean	0.03843644737819399
get_ui_image_median	0.03843644737819399
get_ui_image_min	0.03829235273102919
in-drivable-lane_max	4.20000000000006
in-drivable-lane_mean	2.10000000000003
in-drivable-lane_min	0.0
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.4593867487806041, "get_ui_image": 0.03858054202535878, "step_physics": 0.16780371251313583, "survival_time": 4.549999999999992, "driven_lanedir": 0.4441254777771939, "get_state_dump": 0.004781735979992411, "get_robot_state": 0.0036863295928291654, "sim_render-ego0": 0.003962327604708465, "get_duckie_state": 1.2154164521590525e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.282766888723773, "agent_compute-ego0": 0.012606102487315302, "complete-iteration": 0.24641842945762304, "set_robot_commands": 0.002351247746011485, "deviation-center-line": 0.4380302942476845, "driven_lanedir_consec": 0.4441254777771939, "sim_compute_sim_state": 0.010482920252758524, "sim_compute_performance-ego0": 0.0020821742389513097}, "LFI-norm-udem1-000-ego0": {"driven_any": 7.502843560841448, "get_ui_image": 0.03829235273102919, "step_physics": 0.1329803458518452, "survival_time": 57.54999999999887, "driven_lanedir": 6.7290446638560315, "get_state_dump": 0.0046530310064554214, "get_robot_state": 0.0036454747120539346, "sim_render-ego0": 0.0037875320348474714, "get_duckie_state": 1.1266933547125925e-06, "in-drivable-lane": 4.20000000000006, "deviation-heading": 9.074397661415968, "agent_compute-ego0": 0.011950746385587586, "complete-iteration": 0.2129682157602575, "set_robot_commands": 0.0022157246453894507, "deviation-center-line": 4.5628167532555475, "driven_lanedir_consec": 4.298027427497462, "sim_compute_sim_state": 0.013396550590793291, "sim_compute_performance-ego0": 0.001968190280927552}}
set_robot_commands_max	0.002351247746011485
set_robot_commands_mean	0.002283486195700468
set_robot_commands_median	0.002283486195700468
set_robot_commands_min	0.0022157246453894507
sim_compute_performance-ego0_max	0.0020821742389513097
sim_compute_performance-ego0_mean	0.0020251822599394306
sim_compute_performance-ego0_median	0.0020251822599394306
sim_compute_performance-ego0_min	0.001968190280927552
sim_compute_sim_state_max	0.013396550590793291
sim_compute_sim_state_mean	0.011939735421775908
sim_compute_sim_state_median	0.011939735421775908
sim_compute_sim_state_min	0.010482920252758524
sim_render-ego0_max	0.003962327604708465
sim_render-ego0_mean	0.003874929819777968
sim_render-ego0_median	0.003874929819777968
sim_render-ego0_min	0.0037875320348474714
simulation-passed	1
step_physics_max	0.16780371251313583
step_physics_mean	0.1503920291824905
step_physics_median	0.1503920291824905
step_physics_min	0.1329803458518452
survival_time_max	57.54999999999887
survival_time_mean	31.04999999999943
survival_time_min	4.549999999999992

No reset possible

53466

12564

Bea Baselines 🐤

straight

LFVv-sim

success

yes

2020-12-02 19:58:41+00:00

2020-12-02 20:17:59+00:00

0:19:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6052853975330239
survival_time_median	10.400000000000013
deviation-center-line_median	0.33068119559683
in-drivable-lane_median	6.4250000000000185

other stats

agent_compute-ego0_max	0.010771652723006972
agent_compute-ego0_mean	0.010376559564068702
agent_compute-ego0_median	0.01041994994317276
agent_compute-ego0_min	0.009894685646922318
agent_compute-npc0_max	0.026374425206865584
agent_compute-npc0_mean	0.022072411885596492
agent_compute-npc0_median	0.02099351997736677
agent_compute-npc0_min	0.01992818238078684
agent_compute-npc1_max	0.05015522979897675
agent_compute-npc1_mean	0.04357481290171616
agent_compute-npc1_median	0.04759761598921314
agent_compute-npc1_min	0.03297159291695857
agent_compute-npc2_max	0.04462023155926938
agent_compute-npc2_mean	0.03707352506427294
agent_compute-npc2_median	0.03344257344904634
agent_compute-npc2_min	0.03315777018450308
agent_compute-npc3_max	0.04684217242675966
agent_compute-npc3_mean	0.04093083239620497
agent_compute-npc3_median	0.04093083239620497
agent_compute-npc3_min	0.035019492365650294
complete-iteration_max	1.121272291104818
complete-iteration_mean	0.8064507684366808
complete-iteration_median	0.9032451207434538
complete-iteration_min	0.2980405411549977
deviation-center-line_max	0.3928686233240577
deviation-center-line_mean	0.30090564831821964
deviation-center-line_min	0.14939157875516085
deviation-heading_max	2.4882932462564837
deviation-heading_mean	1.2598791665337652
deviation-heading_median	0.9819032459436928
deviation-heading_min	0.5874169279911909
driven_any_max	2.5526814329726717
driven_any_mean	1.6505206590139387
driven_any_median	1.5456861375242053
driven_any_min	0.958028928034673
driven_lanedir_consec_max	0.7818318353273331
driven_lanedir_consec_mean	0.6206463219842938
driven_lanedir_consec_min	0.4901826575437944
driven_lanedir_max	0.7818318353273331
driven_lanedir_mean	0.6206463219842938
driven_lanedir_median	0.6052853975330239
driven_lanedir_min	0.4901826575437944
get_duckie_state_max	1.6912592861947696e-06
get_duckie_state_mean	1.4488608792015406e-06
get_duckie_state_median	1.4655478572985912e-06
get_duckie_state_min	1.1730885160142095e-06
get_robot_state_max	0.01794544087435904
get_robot_state_mean	0.013956990345622531
get_robot_state_median	0.015372373607862913
get_robot_state_min	0.007137773292405265
get_state_dump_max	0.011140705235414996
get_state_dump_mean	0.00934257707210612
get_state_dump_median	0.010013235518345646
get_state_dump_min	0.006203132016318185
get_ui_image_max	0.057109028191004635
get_ui_image_mean	0.04611545031686739
get_ui_image_median	0.047803633446011615
get_ui_image_min	0.031745506184441705
in-drivable-lane_max	12.000000000000108
in-drivable-lane_mean	6.6125000000000345
in-drivable-lane_min	1.5999999999999943
per-episodes	details {"LFV-norm-loop-000-ego0": {"driven_any": 0.958028928034673, "get_ui_image": 0.0432107863218888, "step_physics": 0.4950284923332325, "survival_time": 6.849999999999984, "driven_lanedir": 0.7818318353273331, "get_state_dump": 0.00922598527825397, "get_robot_state": 0.013603671737339186, "sim_render-ego0": 0.003740227740743886, "sim_render-npc0": 0.003624368404996568, "sim_render-npc1": 0.003626063250113225, "sim_render-npc2": 0.0035944935204326243, "get_duckie_state": 1.1730885160142095e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 0.7131079805935505, "agent_compute-ego0": 0.01022949080536331, "agent_compute-npc0": 0.01992818238078684, "agent_compute-npc1": 0.03297159291695857, "agent_compute-npc2": 0.03315777018450308, "complete-iteration": 0.715282476466635, "set_robot_commands": 0.002602186755857606, "deviation-center-line": 0.14939157875516085, "driven_lanedir_consec": 0.7818318353273331, "sim_compute_sim_state": 0.026604210121044213, "sim_compute_performance-ego0": 0.0018815804218900375, "sim_compute_performance-npc0": 0.0018591068793034208, "sim_compute_performance-npc1": 0.0018686695375304291, "sim_compute_performance-npc2": 0.0018824753553971}, "LFV-norm-zigzag-000-ego0": {"driven_any": 2.5526814329726717, "get_ui_image": 0.057109028191004635, "step_physics": 0.7239599969812031, "survival_time": 16.5000000000001, "driven_lanedir": 0.6655453555451283, "get_state_dump": 0.011140705235414996, "get_robot_state": 0.01794544087435904, "sim_render-ego0": 0.003997067310298677, "sim_render-npc0": 0.0038100095673990393, "sim_render-npc1": 0.003819376320277096, "sim_render-npc2": 0.003961160463869032, "sim_render-npc3": 0.004172786845181284, "get_duckie_state": 1.6912592861947696e-06, "in-drivable-lane": 12.000000000000108, "deviation-heading": 1.2506985112938351, "agent_compute-ego0": 0.010771652723006972, "agent_compute-npc0": 0.02169881342400957, "agent_compute-npc1": 0.05015522979897675, "agent_compute-npc2": 0.04462023155926938, "agent_compute-npc3": 0.04684217242675966, "complete-iteration": 1.0912077650202725, "set_robot_commands": 0.0025681779463845797, "deviation-center-line": 0.3050692260162657, "driven_lanedir_consec": 0.6655453555451283, "sim_compute_sim_state": 0.06445984393808417, "sim_compute_performance-ego0": 0.0021049486546357954, "sim_compute_performance-npc0": 0.001998338814588472, "sim_compute_performance-npc1": 0.002049016088157262, "sim_compute_performance-npc2": 0.00212014261689431, "sim_compute_performance-npc3": 0.002214662257998371}, "LFV-norm-techtrack-000-ego0": {"driven_any": 1.4238275887832712, "get_ui_image": 0.05239648057013443, "step_physics": 0.7983116894653163, "survival_time": 9.650000000000002, "driven_lanedir": 0.5450254395209196, "get_state_dump": 0.010800485758437324, "get_robot_state": 0.017141075478386635, "sim_render-ego0": 0.003592049952634831, "sim_render-npc0": 0.003511760652679758, "sim_render-npc1": 0.003538964949932295, "sim_render-npc2": 0.0035286748532167415, "sim_render-npc3": 0.0035228286821817616, "get_duckie_state": 1.4133060101381285e-06, "in-drivable-lane": 5.0500000000000105, "deviation-heading": 2.4882932462564837, "agent_compute-ego0": 0.009894685646922318, "agent_compute-npc0": 0.020288226530723964, "agent_compute-npc1": 0.04759761598921314, "agent_compute-npc2": 0.03344257344904634, "agent_compute-npc3": 0.035019492365650294, "complete-iteration": 1.121272291104818, "set_robot_commands": 0.002152981217374507, "deviation-center-line": 0.3928686233240577, "driven_lanedir_consec": 0.5450254395209196, "sim_compute_sim_state": 0.058778018066563555, "sim_compute_performance-ego0": 0.0018577649421298629, "sim_compute_performance-npc0": 0.0018077830678408908, "sim_compute_performance-npc1": 0.0018297630487029088, "sim_compute_performance-npc2": 0.001837338368917249, "sim_compute_performance-npc3": 0.001844966534486751}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.667544686265139, "get_ui_image": 0.031745506184441705, "step_physics": 0.18923706667763843, "survival_time": 11.150000000000023, "driven_lanedir": 0.4901826575437944, "get_state_dump": 0.006203132016318185, "get_robot_state": 0.007137773292405265, "sim_render-ego0": 0.0039178069148744854, "sim_render-npc0": 0.0038420536688395903, "get_duckie_state": 1.5177897044590542e-06, "in-drivable-lane": 7.800000000000027, "deviation-heading": 0.5874169279911909, "agent_compute-ego0": 0.010610409080982208, "agent_compute-npc0": 0.026374425206865584, "complete-iteration": 0.2980405411549977, "set_robot_commands": 0.0023671729224068777, "deviation-center-line": 0.35629316517739434, "driven_lanedir_consec": 0.4901826575437944, "sim_compute_sim_state": 0.0100834955062185, "sim_compute_performance-ego0": 0.0020481677992003305, "sim_compute_performance-npc0": 0.0019984330449785504}}
set_robot_commands_max	0.002602186755857606
set_robot_commands_mean	0.0024226297105058923
set_robot_commands_median	0.0024676754343957285
set_robot_commands_min	0.002152981217374507
sim_compute_performance-ego0_max	0.0021049486546357954
sim_compute_performance-ego0_mean	0.0019731154544640065
sim_compute_performance-ego0_median	0.0019648741105451843
sim_compute_performance-ego0_min	0.0018577649421298629
sim_compute_performance-npc0_max	0.0019984330449785504
sim_compute_performance-npc0_mean	0.0019159154516778336
sim_compute_performance-npc0_median	0.0019287228469459464
sim_compute_performance-npc0_min	0.0018077830678408908
sim_compute_performance-npc1_max	0.002049016088157262
sim_compute_performance-npc1_mean	0.0019158162247968668
sim_compute_performance-npc1_median	0.0018686695375304291
sim_compute_performance-npc1_min	0.0018297630487029088
sim_compute_performance-npc2_max	0.00212014261689431
sim_compute_performance-npc2_mean	0.00194665211373622
sim_compute_performance-npc2_median	0.0018824753553971
sim_compute_performance-npc2_min	0.001837338368917249
sim_compute_performance-npc3_max	0.002214662257998371
sim_compute_performance-npc3_mean	0.0020298143962425613
sim_compute_performance-npc3_median	0.0020298143962425613
sim_compute_performance-npc3_min	0.001844966534486751
sim_compute_sim_state_max	0.06445984393808417
sim_compute_sim_state_mean	0.03998139190797761
sim_compute_sim_state_median	0.04269111409380389
sim_compute_sim_state_min	0.0100834955062185
sim_render-ego0_max	0.003997067310298677
sim_render-ego0_mean	0.00381178797963797
sim_render-ego0_median	0.0038290173278091857
sim_render-ego0_min	0.003592049952634831
sim_render-npc0_max	0.0038420536688395903
sim_render-npc0_mean	0.003697048073478739
sim_render-npc0_median	0.003717188986197804
sim_render-npc0_min	0.003511760652679758
sim_render-npc1_max	0.003819376320277096
sim_render-npc1_mean	0.003661468173440872
sim_render-npc1_median	0.003626063250113225
sim_render-npc1_min	0.003538964949932295
sim_render-npc2_max	0.003961160463869032
sim_render-npc2_mean	0.0036947762791727993
sim_render-npc2_median	0.0035944935204326243
sim_render-npc2_min	0.0035286748532167415
sim_render-npc3_max	0.004172786845181284
sim_render-npc3_mean	0.0038478077636815225
sim_render-npc3_median	0.0038478077636815225
sim_render-npc3_min	0.0035228286821817616
simulation-passed	1
step_physics_max	0.7983116894653163
step_physics_mean	0.5516343113643476
step_physics_median	0.6094942446572178
step_physics_min	0.18923706667763843
survival_time_max	16.5000000000001
survival_time_mean	11.037500000000026
survival_time_min	6.849999999999984

No reset possible

53461

12571

Bea Baselines 🐤

straight

LFVIv-sim

success

yes

2020-12-02 19:55:14+00:00

2020-12-02 19:58:12+00:00

0:02:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24868247149189004
survival_time_median	5.449999999999989
deviation-center-line_median	0.24738768645821865
in-drivable-lane_median	2.749999999999992

other stats

agent_compute-ego0_max	0.010755763334386489
agent_compute-ego0_mean	0.010682966410191067
agent_compute-ego0_median	0.010682966410191067
agent_compute-ego0_min	0.010610169485995644
complete-iteration_max	0.24886640380410588
complete-iteration_mean	0.23167486225857453
complete-iteration_median	0.23167486225857453
complete-iteration_min	0.2144833207130432
deviation-center-line_max	0.36460756442412073
deviation-center-line_mean	0.24738768645821865
deviation-center-line_min	0.13016780849231657
deviation-heading_max	3.1433779487453775
deviation-heading_mean	1.937210401851417
deviation-heading_median	1.937210401851417
deviation-heading_min	0.7310428549574565
driven_any_max	1.070993885628117
driven_any_mean	0.7262556777434203
driven_any_median	0.7262556777434203
driven_any_min	0.38151746985872353
driven_lanedir_consec_max	0.3721924726930572
driven_lanedir_consec_mean	0.24868247149189004
driven_lanedir_consec_min	0.12517247029072287
driven_lanedir_max	0.3721924726930572
driven_lanedir_mean	0.24868247149189004
driven_lanedir_median	0.24868247149189004
driven_lanedir_min	0.12517247029072287
get_duckie_state_max	1.4571767104299444e-06
get_duckie_state_mean	1.4210540812820103e-06
get_duckie_state_median	1.4210540812820103e-06
get_duckie_state_min	1.3849314521340762e-06
get_robot_state_max	0.003800465780145982
get_robot_state_mean	0.003731158172752097
get_robot_state_median	0.003731158172752097
get_robot_state_min	0.003661850565358212
get_state_dump_max	0.00486148104948156
get_state_dump_mean	0.004757315289494423
get_state_dump_median	0.004757315289494423
get_state_dump_min	0.004653149529507286
get_ui_image_max	0.038348650231080895
get_ui_image_mean	0.03830888659776918
get_ui_image_median	0.03830888659776918
get_ui_image_min	0.03826912296445746
in-drivable-lane_max	3.399999999999988
in-drivable-lane_mean	2.749999999999992
in-drivable-lane_min	2.0999999999999956
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.38151746985872353, "get_ui_image": 0.038348650231080895, "step_physics": 0.17304854533251593, "survival_time": 3.349999999999996, "driven_lanedir": 0.12517247029072287, "get_state_dump": 0.00486148104948156, "get_robot_state": 0.003800465780145982, "sim_render-ego0": 0.003904987783992992, "get_duckie_state": 1.3849314521340762e-06, "in-drivable-lane": 2.0999999999999956, "deviation-heading": 0.7310428549574565, "agent_compute-ego0": 0.010755763334386489, "complete-iteration": 0.24886640380410588, "set_robot_commands": 0.0022509027929867014, "deviation-center-line": 0.13016780849231657, "driven_lanedir_consec": 0.12517247029072287, "sim_compute_sim_state": 0.009769944583668429, "sim_compute_performance-ego0": 0.0020392291686114144}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.070993885628117, "get_ui_image": 0.03826912296445746, "step_physics": 0.13795732981280276, "survival_time": 7.549999999999981, "driven_lanedir": 0.3721924726930572, "get_state_dump": 0.004653149529507286, "get_robot_state": 0.003661850565358212, "sim_render-ego0": 0.0038363478685680182, "get_duckie_state": 1.4571767104299444e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 3.1433779487453775, "agent_compute-ego0": 0.010610169485995644, "complete-iteration": 0.2144833207130432, "set_robot_commands": 0.002187659865931461, "deviation-center-line": 0.36460756442412073, "driven_lanedir_consec": 0.3721924726930572, "sim_compute_sim_state": 0.01123937493876407, "sim_compute_performance-ego0": 0.0019832567164772435}}
set_robot_commands_max	0.0022509027929867014
set_robot_commands_mean	0.002219281329459081
set_robot_commands_median	0.002219281329459081
set_robot_commands_min	0.002187659865931461
sim_compute_performance-ego0_max	0.0020392291686114144
sim_compute_performance-ego0_mean	0.002011242942544329
sim_compute_performance-ego0_median	0.002011242942544329
sim_compute_performance-ego0_min	0.0019832567164772435
sim_compute_sim_state_max	0.01123937493876407
sim_compute_sim_state_mean	0.01050465976121625
sim_compute_sim_state_median	0.01050465976121625
sim_compute_sim_state_min	0.009769944583668429
sim_render-ego0_max	0.003904987783992992
sim_render-ego0_mean	0.0038706678262805058
sim_render-ego0_median	0.0038706678262805058
sim_render-ego0_min	0.0038363478685680182
simulation-passed	1
step_physics_max	0.17304854533251593
step_physics_mean	0.15550293757265934
step_physics_median	0.15550293757265934
step_physics_min	0.13795732981280276
survival_time_max	7.549999999999981
survival_time_mean	5.449999999999989
survival_time_min	3.349999999999996

No reset possible

53454

12571

Bea Baselines 🐤

straight

LFVIv-sim

success

yes

2020-12-02 19:51:35+00:00

2020-12-02 19:54:35+00:00

0:03:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24868247149189004
survival_time_median	5.449999999999989
deviation-center-line_median	0.24738768645821865
in-drivable-lane_median	2.749999999999992

other stats

agent_compute-ego0_max	0.010353014749639174
agent_compute-ego0_mean	0.01018373751234344
agent_compute-ego0_median	0.01018373751234344
agent_compute-ego0_min	0.010014460275047704
complete-iteration_max	0.2415852055830114
complete-iteration_mean	0.22435706595518273
complete-iteration_median	0.22435706595518273
complete-iteration_min	0.207128926327354
deviation-center-line_max	0.36460756442412073
deviation-center-line_mean	0.24738768645821865
deviation-center-line_min	0.13016780849231657
deviation-heading_max	3.1433779487453775
deviation-heading_mean	1.937210401851417
deviation-heading_median	1.937210401851417
deviation-heading_min	0.7310428549574565
driven_any_max	1.070993885628117
driven_any_mean	0.7262556777434203
driven_any_median	0.7262556777434203
driven_any_min	0.38151746985872353
driven_lanedir_consec_max	0.3721924726930572
driven_lanedir_consec_mean	0.24868247149189004
driven_lanedir_consec_min	0.12517247029072287
driven_lanedir_max	0.3721924726930572
driven_lanedir_mean	0.24868247149189004
driven_lanedir_median	0.24868247149189004
driven_lanedir_min	0.12517247029072287
get_duckie_state_max	1.2407177372982626e-06
get_duckie_state_mean	1.221664549765572e-06
get_duckie_state_median	1.221664549765572e-06
get_duckie_state_min	1.2026113622328814e-06
get_robot_state_max	0.00362315248040592
get_robot_state_mean	0.0035542631204652344
get_robot_state_median	0.0035542631204652344
get_robot_state_min	0.003485373760524549
get_state_dump_max	0.004408429650699391
get_state_dump_mean	0.0043701840904844065
get_state_dump_median	0.0043701840904844065
get_state_dump_min	0.004331938530269422
get_ui_image_max	0.03778325459536384
get_ui_image_mean	0.03773544830249928
get_ui_image_median	0.03773544830249928
get_ui_image_min	0.03768764200963472
in-drivable-lane_max	3.399999999999988
in-drivable-lane_mean	2.749999999999992
in-drivable-lane_min	2.0999999999999956
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.38151746985872353, "get_ui_image": 0.03778325459536384, "step_physics": 0.1680712945321027, "survival_time": 3.349999999999996, "driven_lanedir": 0.12517247029072287, "get_state_dump": 0.004408429650699391, "get_robot_state": 0.00362315248040592, "sim_render-ego0": 0.003729318871217615, "get_duckie_state": 1.2026113622328814e-06, "in-drivable-lane": 2.0999999999999956, "deviation-heading": 0.7310428549574565, "agent_compute-ego0": 0.010353014749639174, "complete-iteration": 0.2415852055830114, "set_robot_commands": 0.002095317139345057, "deviation-center-line": 0.13016780849231657, "driven_lanedir_consec": 0.12517247029072287, "sim_compute_sim_state": 0.00950552786097807, "sim_compute_performance-ego0": 0.0019402749398175407}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.070993885628117, "get_ui_image": 0.03768764200963472, "step_physics": 0.13318637170289693, "survival_time": 7.549999999999981, "driven_lanedir": 0.3721924726930572, "get_state_dump": 0.004331938530269422, "get_robot_state": 0.003485373760524549, "sim_render-ego0": 0.0036158357795916104, "get_duckie_state": 1.2407177372982626e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 3.1433779487453775, "agent_compute-ego0": 0.010014460275047704, "complete-iteration": 0.207128926327354, "set_robot_commands": 0.0020153632289484926, "deviation-center-line": 0.36460756442412073, "driven_lanedir_consec": 0.3721924726930572, "sim_compute_sim_state": 0.010885572747180336, "sim_compute_performance-ego0": 0.0018364975326939632}}
set_robot_commands_max	0.002095317139345057
set_robot_commands_mean	0.0020553401841467748
set_robot_commands_median	0.0020553401841467748
set_robot_commands_min	0.0020153632289484926
sim_compute_performance-ego0_max	0.0019402749398175407
sim_compute_performance-ego0_mean	0.001888386236255752
sim_compute_performance-ego0_median	0.001888386236255752
sim_compute_performance-ego0_min	0.0018364975326939632
sim_compute_sim_state_max	0.010885572747180336
sim_compute_sim_state_mean	0.010195550304079204
sim_compute_sim_state_median	0.010195550304079204
sim_compute_sim_state_min	0.00950552786097807
sim_render-ego0_max	0.003729318871217615
sim_render-ego0_mean	0.0036725773254046128
sim_render-ego0_median	0.0036725773254046128
sim_render-ego0_min	0.0036158357795916104
simulation-passed	1
step_physics_max	0.1680712945321027
step_physics_mean	0.1506288331174998
step_physics_median	0.1506288331174998
step_physics_min	0.13318637170289693
survival_time_max	7.549999999999981
survival_time_mean	5.449999999999989
survival_time_min	3.349999999999996

No reset possible

53446

12572

Bea Baselines 🐤

straight

LFVIv-sim

success

yes

2020-12-02 19:46:25+00:00

2020-12-02 19:51:03+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.621882608807794
survival_time_median	11.375000000000028
deviation-center-line_median	0.49572588831599385
in-drivable-lane_median	6.400000000000036

other stats

agent_compute-ego0_max	0.01095824177489687
agent_compute-ego0_mean	0.010726663888215807
agent_compute-ego0_median	0.010726663888215807
agent_compute-ego0_min	0.010495086001534749
complete-iteration_max	0.2067860456613394
complete-iteration_mean	0.20589922686698892
complete-iteration_median	0.20589922686698892
complete-iteration_min	0.2050124080726384
deviation-center-line_max	0.6702797201467701
deviation-center-line_mean	0.49572588831599385
deviation-center-line_min	0.3211720564852176
deviation-heading_max	2.537022110462463
deviation-heading_mean	2.4150494970903633
deviation-heading_median	2.4150494970903633
deviation-heading_min	2.293076883718264
driven_any_max	1.7598441791834574
driven_any_mean	1.7096148384926255
driven_any_median	1.7096148384926255
driven_any_min	1.6593854978017943
driven_lanedir_consec_max	0.8696473510010638
driven_lanedir_consec_mean	0.621882608807794
driven_lanedir_consec_min	0.3741178666145242
driven_lanedir_max	0.8790926140769271
driven_lanedir_mean	0.6266052403457256
driven_lanedir_median	0.6266052403457256
driven_lanedir_min	0.3741178666145242
get_duckie_state_max	1.3866995134924212e-06
get_duckie_state_mean	1.3417841434058412e-06
get_duckie_state_median	1.3417841434058412e-06
get_duckie_state_min	1.2968687733192617e-06
get_robot_state_max	0.0037173380231643473
get_robot_state_mean	0.003654817283224353
get_robot_state_median	0.003654817283224353
get_robot_state_min	0.003592296543284359
get_state_dump_max	0.0047532346751123266
get_state_dump_mean	0.004687819024089252
get_state_dump_median	0.004687819024089252
get_state_dump_min	0.004622403373066177
get_ui_image_max	0.038165870803354034
get_ui_image_mean	0.03765025755804517
get_ui_image_median	0.03765025755804517
get_ui_image_min	0.03713464431273632
in-drivable-lane_max	8.200000000000035
in-drivable-lane_mean	6.400000000000036
in-drivable-lane_min	4.600000000000038
per-episodes	details {"LFI-full-4way-000-ego0": {"driven_any": 1.6593854978017943, "get_ui_image": 0.038165870803354034, "step_physics": 0.12770597603289002, "survival_time": 11.100000000000025, "driven_lanedir": 0.8790926140769271, "get_state_dump": 0.0047532346751123266, "get_robot_state": 0.0037173380231643473, "sim_render-ego0": 0.003788218904503793, "get_duckie_state": 1.2968687733192617e-06, "in-drivable-lane": 4.600000000000038, "deviation-heading": 2.537022110462463, "agent_compute-ego0": 0.01095824177489687, "complete-iteration": 0.2050124080726384, "set_robot_commands": 0.002262447981556435, "deviation-center-line": 0.6702797201467701, "driven_lanedir_consec": 0.8696473510010638, "sim_compute_sim_state": 0.01159308095683966, "sim_compute_performance-ego0": 0.001993707477244561}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7598441791834574, "get_ui_image": 0.03713464431273632, "step_physics": 0.1329859933282575, "survival_time": 11.65000000000003, "driven_lanedir": 0.3741178666145242, "get_state_dump": 0.004622403373066177, "get_robot_state": 0.003592296543284359, "sim_render-ego0": 0.003679748274322249, "get_duckie_state": 1.3866995134924212e-06, "in-drivable-lane": 8.200000000000035, "deviation-heading": 2.293076883718264, "agent_compute-ego0": 0.010495086001534749, "complete-iteration": 0.2067860456613394, "set_robot_commands": 0.002107056797060192, "deviation-center-line": 0.3211720564852176, "driven_lanedir_consec": 0.3741178666145242, "sim_compute_sim_state": 0.010176838972629646, "sim_compute_performance-ego0": 0.0019154884876349033}}
set_robot_commands_max	0.002262447981556435
set_robot_commands_mean	0.0021847523893083138
set_robot_commands_median	0.0021847523893083138
set_robot_commands_min	0.002107056797060192
sim_compute_performance-ego0_max	0.001993707477244561
sim_compute_performance-ego0_mean	0.001954597982439732
sim_compute_performance-ego0_median	0.001954597982439732
sim_compute_performance-ego0_min	0.0019154884876349033
sim_compute_sim_state_max	0.01159308095683966
sim_compute_sim_state_mean	0.010884959964734651
sim_compute_sim_state_median	0.010884959964734651
sim_compute_sim_state_min	0.010176838972629646
sim_render-ego0_max	0.003788218904503793
sim_render-ego0_mean	0.0037339835894130207
sim_render-ego0_median	0.0037339835894130207
sim_render-ego0_min	0.003679748274322249
simulation-passed	1
step_physics_max	0.1329859933282575
step_physics_mean	0.13034598468057376
step_physics_median	0.13034598468057376
step_physics_min	0.12770597603289002
survival_time_max	11.65000000000003
survival_time_mean	11.375000000000028
survival_time_min	11.100000000000025

No reset possible

53440

12576

Bea Baselines 🐤

straight

LFVIt-sim

success

yes

aido5-LFI-full-sim-testing

2020-12-02 19:34:46+00:00

2020-12-02 19:46:16+00:00

0:11:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.57719292024425
survival_time_median	11.15000000000006
deviation-center-line_median	0.49998082892113976
in-drivable-lane_median	6.2000000000000535

other stats

agent_compute-ego0_max	0.01044867699404797
agent_compute-ego0_mean	0.010142337333489062
agent_compute-ego0_median	0.010142337333489062
agent_compute-ego0_min	0.009835997672930155
agent_compute-npc0_max	0.04304412031826907
agent_compute-npc0_mean	0.041893217161870826
agent_compute-npc0_median	0.041893217161870826
agent_compute-npc0_min	0.040742314005472575
agent_compute-npc1_max	0.04127283843166857
agent_compute-npc1_mean	0.040016175437866806
agent_compute-npc1_median	0.040016175437866806
agent_compute-npc1_min	0.038759512444065045
agent_compute-npc2_max	0.04126747257738228
agent_compute-npc2_mean	0.036314131375841815
agent_compute-npc2_median	0.036314131375841815
agent_compute-npc2_min	0.03136079017430136
complete-iteration_max	1.0417921399495689
complete-iteration_mean	1.0049223988062872
complete-iteration_median	1.0049223988062872
complete-iteration_min	0.9680526576630056
deviation-center-line_max	0.880854907567805
deviation-center-line_mean	0.49998082892113976
deviation-center-line_min	0.11910675027447444
deviation-heading_max	2.497198994678309
deviation-heading_mean	1.7143984686681213
deviation-heading_median	1.7143984686681213
deviation-heading_min	0.9315979426579334
driven_any_max	2.836260992045463
driven_any_mean	1.67123286605405
driven_any_median	1.67123286605405
driven_any_min	0.5062047400626375
driven_lanedir_consec_max	0.980436367760506
driven_lanedir_consec_mean	0.57719292024425
driven_lanedir_consec_min	0.17394947272799377
driven_lanedir_max	1.160056111801557
driven_lanedir_mean	0.6670027922647754
driven_lanedir_median	0.6670027922647754
driven_lanedir_min	0.17394947272799377
get_duckie_state_max	1.3357185455689948e-06
get_duckie_state_mean	1.334451491889003e-06
get_duckie_state_median	1.334451491889003e-06
get_duckie_state_min	1.3331844382090112e-06
get_robot_state_max	0.013997485838740706
get_robot_state_mean	0.013860288207769828
get_robot_state_median	0.013860288207769828
get_robot_state_min	0.01372309057679895
get_state_dump_max	0.009363921701091607
get_state_dump_mean	0.00934074175281087
get_state_dump_median	0.00934074175281087
get_state_dump_min	0.009317561804530132
get_ui_image_max	0.05328442691123649
get_ui_image_mean	0.05262796569921176
get_ui_image_median	0.05262796569921176
get_ui_image_min	0.05197150448718703
in-drivable-lane_max	9.900000000000114
in-drivable-lane_mean	6.2000000000000535
in-drivable-lane_min	2.499999999999993
per-episodes	details {"LFVI-norm-4way-000-ego0": {"driven_any": 2.836260992045463, "get_ui_image": 0.05328442691123649, "step_physics": 0.6969029067313834, "survival_time": 18.200000000000124, "driven_lanedir": 1.160056111801557, "get_state_dump": 0.009363921701091607, "get_robot_state": 0.01372309057679895, "sim_render-ego0": 0.0036402878695971346, "sim_render-npc0": 0.003534530613520374, "sim_render-npc1": 0.003916090481901822, "sim_render-npc2": 0.0039052205542995503, "get_duckie_state": 1.3331844382090112e-06, "in-drivable-lane": 9.900000000000114, "deviation-heading": 2.497198994678309, "agent_compute-ego0": 0.009835997672930155, "agent_compute-npc0": 0.04304412031826907, "agent_compute-npc1": 0.038759512444065045, "agent_compute-npc2": 0.03136079017430136, "complete-iteration": 0.9680526576630056, "set_robot_commands": 0.002169016615985191, "deviation-center-line": 0.880854907567805, "driven_lanedir_consec": 0.980436367760506, "sim_compute_sim_state": 0.03999600737062219, "sim_compute_performance-ego0": 0.0018890727056215888, "sim_compute_performance-npc0": 0.001825232701758816, "sim_compute_performance-npc1": 0.002020327685630485, "sim_compute_performance-npc2": 0.002013956357354987}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.5062047400626375, "get_ui_image": 0.05197150448718703, "step_physics": 0.7573420110955296, "survival_time": 4.099999999999993, "driven_lanedir": 0.17394947272799377, "get_state_dump": 0.009317561804530132, "get_robot_state": 0.013997485838740706, "sim_render-ego0": 0.0037737869354615727, "sim_render-npc0": 0.003594269235450101, "sim_render-npc1": 0.0035918879221720867, "sim_render-npc2": 0.003658102219363293, "get_duckie_state": 1.3357185455689948e-06, "in-drivable-lane": 2.499999999999993, "deviation-heading": 0.9315979426579334, "agent_compute-ego0": 0.01044867699404797, "agent_compute-npc0": 0.040742314005472575, "agent_compute-npc1": 0.04127283843166857, "agent_compute-npc2": 0.04126747257738228, "complete-iteration": 1.0417921399495689, "set_robot_commands": 0.0021488408008253717, "deviation-center-line": 0.11910675027447444, "driven_lanedir_consec": 0.17394947272799377, "sim_compute_sim_state": 0.0444490909576416, "sim_compute_performance-ego0": 0.001963310931102339, "sim_compute_performance-npc0": 0.001842421221445842, "sim_compute_performance-npc1": 0.0018605984837175853, "sim_compute_performance-npc2": 0.001880154552229916}}
set_robot_commands_max	0.002169016615985191
set_robot_commands_mean	0.0021589287084052815
set_robot_commands_median	0.0021589287084052815
set_robot_commands_min	0.0021488408008253717
sim_compute_performance-ego0_max	0.001963310931102339
sim_compute_performance-ego0_mean	0.001926191818361964
sim_compute_performance-ego0_median	0.001926191818361964
sim_compute_performance-ego0_min	0.0018890727056215888
sim_compute_performance-npc0_max	0.001842421221445842
sim_compute_performance-npc0_mean	0.0018338269616023288
sim_compute_performance-npc0_median	0.0018338269616023288
sim_compute_performance-npc0_min	0.001825232701758816
sim_compute_performance-npc1_max	0.002020327685630485
sim_compute_performance-npc1_mean	0.001940463084674035
sim_compute_performance-npc1_median	0.001940463084674035
sim_compute_performance-npc1_min	0.0018605984837175853
sim_compute_performance-npc2_max	0.002013956357354987
sim_compute_performance-npc2_mean	0.0019470554547924516
sim_compute_performance-npc2_median	0.0019470554547924516
sim_compute_performance-npc2_min	0.001880154552229916
sim_compute_sim_state_max	0.0444490909576416
sim_compute_sim_state_mean	0.0422225491641319
sim_compute_sim_state_median	0.0422225491641319
sim_compute_sim_state_min	0.03999600737062219
sim_render-ego0_max	0.0037737869354615727
sim_render-ego0_mean	0.0037070374025293534
sim_render-ego0_median	0.0037070374025293534
sim_render-ego0_min	0.0036402878695971346
sim_render-npc0_max	0.003594269235450101
sim_render-npc0_mean	0.0035643999244852377
sim_render-npc0_median	0.0035643999244852377
sim_render-npc0_min	0.003534530613520374
sim_render-npc1_max	0.003916090481901822
sim_render-npc1_mean	0.003753989202036954
sim_render-npc1_median	0.003753989202036954
sim_render-npc1_min	0.0035918879221720867
sim_render-npc2_max	0.0039052205542995503
sim_render-npc2_mean	0.0037816613868314215
sim_render-npc2_median	0.0037816613868314215
sim_render-npc2_min	0.003658102219363293
simulation-passed	1
step_physics_max	0.7573420110955296
step_physics_mean	0.7271224589134565
step_physics_median	0.7271224589134565
step_physics_min	0.6969029067313834
survival_time_max	18.200000000000124
survival_time_mean	11.15000000000006
survival_time_min	4.099999999999993

No reset possible

53419

12565

Bea Baselines 🐤

straight

LFVIv-sim

success

yes

2020-12-02 19:29:27+00:00

2020-12-02 19:34:03+00:00

0:04:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.621882608807794
survival_time_median	11.375000000000028
deviation-center-line_median	0.49572588831599385
in-drivable-lane_median	6.400000000000036

other stats

agent_compute-ego0_max	0.010810889470737613
agent_compute-ego0_mean	0.010476210548560535
agent_compute-ego0_median	0.010476210548560535
agent_compute-ego0_min	0.010141531626383465
complete-iteration_max	0.19993524701071427
complete-iteration_mean	0.19696378364983705
complete-iteration_median	0.19696378364983705
complete-iteration_min	0.19399232028895977
deviation-center-line_max	0.6702797201467701
deviation-center-line_mean	0.49572588831599385
deviation-center-line_min	0.3211720564852176
deviation-heading_max	2.537022110462463
deviation-heading_mean	2.4150494970903633
deviation-heading_median	2.4150494970903633
deviation-heading_min	2.293076883718264
driven_any_max	1.7598441791834574
driven_any_mean	1.7096148384926255
driven_any_median	1.7096148384926255
driven_any_min	1.6593854978017943
driven_lanedir_consec_max	0.8696473510010638
driven_lanedir_consec_mean	0.621882608807794
driven_lanedir_consec_min	0.3741178666145242
driven_lanedir_max	0.8790926140769271
driven_lanedir_mean	0.6266052403457256
driven_lanedir_median	0.6266052403457256
driven_lanedir_min	0.3741178666145242
get_duckie_state_max	1.2481314504248464e-06
get_duckie_state_mean	1.222785026992132e-06
get_duckie_state_median	1.222785026992132e-06
get_duckie_state_min	1.1974386035594171e-06
get_robot_state_max	0.0036561179054157614
get_robot_state_mean	0.003571099485855187
get_robot_state_median	0.003571099485855187
get_robot_state_min	0.003486081066294613
get_state_dump_max	0.0045497802340930885
get_state_dump_mean	0.004453306919379496
get_state_dump_median	0.004453306919379496
get_state_dump_min	0.004356833604665903
get_ui_image_max	0.03803282361394087
get_ui_image_mean	0.03721700645225054
get_ui_image_median	0.03721700645225054
get_ui_image_min	0.03640118929056021
in-drivable-lane_max	8.200000000000035
in-drivable-lane_mean	6.400000000000036
in-drivable-lane_min	4.600000000000038
per-episodes	details {"LFI-full-4way-000-ego0": {"driven_any": 1.6593854978017943, "get_ui_image": 0.03803282361394087, "step_physics": 0.1234253607523281, "survival_time": 11.100000000000025, "driven_lanedir": 0.8790926140769271, "get_state_dump": 0.0045497802340930885, "get_robot_state": 0.0036561179054157614, "sim_render-ego0": 0.0037372817907632737, "get_duckie_state": 1.1974386035594171e-06, "in-drivable-lane": 4.600000000000038, "deviation-heading": 2.537022110462463, "agent_compute-ego0": 0.010810889470737613, "complete-iteration": 0.19993524701071427, "set_robot_commands": 0.0022004527361403664, "deviation-center-line": 0.6702797201467701, "driven_lanedir_consec": 0.8696473510010638, "sim_compute_sim_state": 0.011489409502311672, "sim_compute_performance-ego0": 0.001952399052846592}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7598441791834574, "get_ui_image": 0.03640118929056021, "step_physics": 0.12216883439284104, "survival_time": 11.65000000000003, "driven_lanedir": 0.3741178666145242, "get_state_dump": 0.004356833604665903, "get_robot_state": 0.003486081066294613, "sim_render-ego0": 0.0035698474981845953, "get_duckie_state": 1.2481314504248464e-06, "in-drivable-lane": 8.200000000000035, "deviation-heading": 2.293076883718264, "agent_compute-ego0": 0.010141531626383465, "complete-iteration": 0.19399232028895977, "set_robot_commands": 0.0020468652757823975, "deviation-center-line": 0.3211720564852176, "driven_lanedir_consec": 0.3741178666145242, "sim_compute_sim_state": 0.009910663987836268, "sim_compute_performance-ego0": 0.0018350476892585428}}
set_robot_commands_max	0.0022004527361403664
set_robot_commands_mean	0.002123659005961382
set_robot_commands_median	0.002123659005961382
set_robot_commands_min	0.0020468652757823975
sim_compute_performance-ego0_max	0.001952399052846592
sim_compute_performance-ego0_mean	0.0018937233710525675
sim_compute_performance-ego0_median	0.0018937233710525675
sim_compute_performance-ego0_min	0.0018350476892585428
sim_compute_sim_state_max	0.011489409502311672
sim_compute_sim_state_mean	0.01070003674507397
sim_compute_sim_state_median	0.01070003674507397
sim_compute_sim_state_min	0.009910663987836268
sim_render-ego0_max	0.0037372817907632737
sim_render-ego0_mean	0.003653564644473934
sim_render-ego0_median	0.003653564644473934
sim_render-ego0_min	0.0035698474981845953
simulation-passed	1
step_physics_max	0.1234253607523281
step_physics_mean	0.12279709757258456
step_physics_median	0.12279709757258456
step_physics_min	0.12216883439284104
survival_time_max	11.65000000000003
survival_time_mean	11.375000000000028
survival_time_min	11.100000000000025

No reset possible

53401

12567

Bea Baselines 🐤

straight

LFP-sim

aborted

2020-12-02 19:28:01+00:00

2020-12-02 19:29:04+00:00

0:01:03

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53384

12572

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 18:42:05+00:00

2020-12-02 19:27:26+00:00

0:45:21

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53358

12606

Bea Baselines 🐤

template-random

LFVIt-sim

aborted

2020-12-02 18:38:27+00:00

2020-12-02 18:41:39+00:00

0:03:12

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53333

12571

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 18:31:36+00:00

2020-12-02 18:38:08+00:00

0:06:32

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53324

12543

Bea Baselines 🐤

template-ros

LFt-sim

aborted

2020-12-02 18:21:58+00:00

2020-12-02 18:31:15+00:00

0:09:17

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53310

12478

Bea Baselines 🐤

straight

LFVmultibodyv-sim

aborted

2020-12-02 18:08:22+00:00

2020-12-02 18:21:16+00:00

0:12:54

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53290

11410

Frank (Chude) Qian 🇨🇦

challenge-aido_LF-baseline-behavior-cloning

LFv-sim

aborted

2020-12-02 18:01:28+00:00

2020-12-02 18:07:54+00:00

0:06:26

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53275

12473

Bea Baselines 🐤

straight

LFv-sim

aborted

2020-12-02 18:00:16+00:00

2020-12-02 18:01:13+00:00

0:00:57

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53224

12479

Bea Baselines 🐤

straight

LFVmultibodyv-sim

error

2020-12-02 17:50:23+00:00

2020-12-02 18:00:00+00:00

0:09:37

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140021420777872
- M:video_aido:cmdline(in:/;out:/) 140021443446912
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53199

12484

Bea Baselines 🐤

straight

aido5-LFV-sim-testing

LFVv-sim

error

2020-12-02 17:46:58+00:00

2020-12-02 17:49:56+00:00

0:02:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140048627134816
- M:video_aido:cmdline(in:/;out:/) 140048627391408
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53190

12487

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 17:40:34+00:00

2020-12-02 17:46:15+00:00

0:05:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140110475904096
- M:video_aido:cmdline(in:/;out:/) 140110475641232
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53183

12447

Bea Baselines 🐤

template-tensorflow

LFP-sim

error

2020-12-02 17:38:47+00:00

2020-12-02 17:40:14+00:00

0:01:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139940397394768
- M:video_aido:cmdline(in:/;out:/) 139935616069488
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53171

12449

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

error

2020-12-02 17:34:54+00:00

2020-12-02 17:38:34+00:00

0:03:40

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140582192730064
- M:video_aido:cmdline(in:/;out:/) 140582192728960
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53163

12450

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

2020-12-02 17:32:54+00:00

2020-12-02 17:34:32+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139840600069792
- M:video_aido:cmdline(in:/;out:/) 139840600069552
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53154

12452

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

2020-12-02 17:30:05+00:00

2020-12-02 17:32:21+00:00

0:02:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140579660602624
- M:video_aido:cmdline(in:/;out:/) 140579655188880
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53144

12453

Bea Baselines 🐤

template-tensorflow

LFt-sim

error

2020-12-02 17:27:37+00:00

2020-12-02 17:29:51+00:00

0:02:14

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139752042587424
- M:video_aido:cmdline(in:/;out:/) 139752042587760
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53106

12458

Bea Baselines 🐤

template-pytorch

LFv-sim

error

aido5-LFV-sim-validation

2020-12-02 17:18:58+00:00

2020-12-02 17:27:17+00:00

0:08:19

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139809468889360
- M:video_aido:cmdline(in:/;out:/) 139809148749856
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53085

12459

Bea Baselines 🐤

template-pytorch

LFVv-sim

error

aido5-LFI-full-sim-testing

2020-12-02 17:16:20+00:00

2020-12-02 17:18:19+00:00

0:01:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139778925214256
- M:video_aido:cmdline(in:/;out:/) 139778925215024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53071

12460

Bea Baselines 🐤

template-pytorch

LFVIv-sim

error

2020-12-02 17:14:08+00:00

2020-12-02 17:15:46+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140495989635008
- M:video_aido:cmdline(in:/;out:/) 140495989633616
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53019

12463

Bea Baselines 🐤

template-pytorch

LFVmultibodyv-sim

error

2020-12-02 16:39:48+00:00

2020-12-02 17:13:42+00:00

0:33:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140240995263344
- M:video_aido:cmdline(in:/;out:/) 140240903662368
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53012

12467

Bea Baselines 🐤

template-pytorch

LFVIv-sim

error

2020-12-02 16:37:36+00:00

2020-12-02 16:39:14+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139981665933776
- M:video_aido:cmdline(in:/;out:/) 139986595250624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53009

12467

Bea Baselines 🐤

template-pytorch

LFVIv-sim

error

2020-12-02 16:35:18+00:00

2020-12-02 16:36:59+00:00

0:01:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140701910846480
- M:video_aido:cmdline(in:/;out:/) 140701910869424
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52943

12469

Bea Baselines 🐤

template-pytorch

aido5-LFV-sim-testing

LFVv-sim

error

2020-12-02 16:21:35+00:00

2020-12-02 16:34:39+00:00

0:13:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140071823109568
- M:video_aido:cmdline(in:/;out:/) 140071823400528
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52907

12472

Bea Baselines 🐤

template-pytorch

LFVIv-sim

error

2020-12-02 16:15:50+00:00

2020-12-02 16:21:21+00:00

0:05:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140109528815120
- M:video_aido:cmdline(in:/;out:/) 140109529264528
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52893

12436

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 16:14:02+00:00

2020-12-02 16:15:36+00:00

0:01:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139715800495632
- M:video_aido:cmdline(in:/;out:/) 139715800497456
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52883

12439

Bea Baselines 🐤

straight

aido5-LFV-sim-testing

LFVv-sim

error

2020-12-02 16:11:31+00:00

2020-12-02 16:13:29+00:00

0:01:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139859713200768
- M:video_aido:cmdline(in:/;out:/) 139859713009600
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52875

12438

Bea Baselines 🐤

straight

LFt-sim

error

2020-12-02 16:10:08+00:00

2020-12-02 16:11:15+00:00

0:01:07

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139863733876912
- M:video_aido:cmdline(in:/;out:/) 139863733877200
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52858

12428

Bea Baselines 🐤

straight

LFv-sim

error

2020-12-02 16:08:25+00:00

2020-12-02 16:10:00+00:00

0:01:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140478346628304
- M:video_aido:cmdline(in:/;out:/) 140478346628208
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52836

12433

Bea Baselines 🐤

straight

LFVmultibodyv-sim

aborted

2020-12-02 16:07:25+00:00

2020-12-02 16:07:58+00:00

0:00:33

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52826

12438

Bea Baselines 🐤

straight

LFt-sim

error

2020-12-02 16:05:57+00:00

2020-12-02 16:07:05+00:00

0:01:08

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140417926467840
- M:video_aido:cmdline(in:/;out:/) 140417926469232
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52808

12441

Bea Baselines 🐤

straight

LFVIt-sim

error

2020-12-02 16:03:35+00:00

2020-12-02 16:05:50+00:00

0:02:15

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140209473252848
- M:video_aido:cmdline(in:/;out:/) 140209473213248
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52807

12230

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 16:02:46+00:00

2020-12-02 16:03:21+00:00

0:00:35

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52792

12223

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 16:02:04+00:00

2020-12-02 16:02:38+00:00

0:00:34

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52786

12223

Bea Baselines 🐤

straight

LFVIv-sim

host-error

aido5-LFVI-sim-validation

2020-12-02 16:00:52+00:00

2020-12-02 16:01:56+00:00

0:01:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 803, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 45, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 265, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 261, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/aido5-LFI-sim-validation/submission12223/LFVIv-sim-gpu-prod-01_97ba9eb8c411-job52786-a-wd/challenge-evaluation-output/episodes/LFI-norm-4way-000/log.gs2.cbor.tmp'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52763

12395

Bea Baselines 🐤

baseline-duckietown

LFVIv-sim

aborted

2020-12-02 15:59:33+00:00

2020-12-02 16:00:24+00:00

0:00:51

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52746

12342

Bea Baselines 🐤

template-ros

LFP-sim

aborted

2020-12-02 15:56:35+00:00

2020-12-02 15:59:11+00:00

0:02:36

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52677

11772

Ehsan Ahmadi 🇨🇦

template-random

LFv-sim

aborted

2020-12-02 12:36:46+00:00

2020-12-02 12:38:13+00:00

0:01:27

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52642

6760

Anthony Courchesne 🇨🇦

template-ros

LFv-sim

failed

2020-12-02 12:11:57+00:00

2020-12-02 12:15:13+00:00

0:03:16

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52616

6761

Charlie Gauthier 🇨🇦

template-ros

LFv-sim

failed

2020-12-02 12:09:43+00:00

2020-12-02 12:10:38+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 62, in on_received_get_commands
              ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
              ||   File "<string>", line 5, in __init__
              ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 52, in __post_init__
              ||     raise ValueError(msg)
              || ValueError: Expected values to be between -1 and 1. Obtained 0.1899999976158142, 6.53000020980835
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52572

6805

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

failed

2020-12-02 12:04:19+00:00

2020-12-02 12:07:51+00:00

0:03:32

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52519

6832

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:53:26+00:00

2020-12-02 12:04:09+00:00

0:10:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139932178623168
- M:video_aido:cmdline(in:/;out:/) 139932178621056
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52489

6837

exercise_ros_template

LFv-sim

error

2020-12-02 11:47:17+00:00

2020-12-02 11:52:52+00:00

0:05:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140701078752368
- M:video_aido:cmdline(in:/;out:/) 140701079585168
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52422

9328

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:37:02+00:00

2020-12-02 11:47:08+00:00

0:10:06

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140119521283760
- M:video_aido:cmdline(in:/;out:/) 140119521295712
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52361

9299

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

host-error

2020-12-02 11:29:56+00:00

2020-12-02 11:33:36+00:00

0:03:40

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52288

9334

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:18:43+00:00

2020-12-02 11:28:00+00:00

0:09:17

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140169005469552
- M:video_aido:cmdline(in:/;out:/) 140169005496736
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52246

9373

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:13:26+00:00

2020-12-02 11:17:09+00:00

0:03:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139755258702576
- M:video_aido:cmdline(in:/;out:/) 139755258709952
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52186

9772

Étienne Boucher 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:07:03+00:00

2020-12-02 11:11:52+00:00

0:04:49

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139960083713472
- M:video_aido:cmdline(in:/;out:/) 139960083713040
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52097

10048

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-12-02 10:53:50+00:00

2020-12-02 11:04:48+00:00

0:10:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140340123987200
- M:video_aido:cmdline(in:/;out:/) 140340122350256
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52032

10036

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-12-02 10:43:04+00:00

2020-12-02 10:53:22+00:00

0:10:18

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139748846368704
- M:video_aido:cmdline(in:/;out:/) 139748845972160
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52007

10066

exercise_ros_template

LFv-sim

error

2020-12-02 10:39:43+00:00

2020-12-02 10:42:44+00:00

0:03:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140461141446176
- M:video_aido:cmdline(in:/;out:/) 140461142526896
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51946

10723

Dishank Bansal 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 10:30:44+00:00

2020-12-02 10:38:49+00:00

0:08:05

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139973442186784
- M:video_aido:cmdline(in:/;out:/) 139973442201296
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51916

10363

Anthony Courchesne 🇨🇦

exercise_ros_template

LFv-sim

host-error

2020-12-02 10:28:25+00:00

2020-12-02 10:30:17+00:00

0:01:52

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51880

10365

Anthony Courchesne 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 10:24:42+00:00

2020-12-02 10:26:29+00:00

0:01:47

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140444162951344
- M:video_aido:cmdline(in:/;out:/) 140444164461568
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51828

10733

Dishank Bansal 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 10:18:15+00:00

2020-12-02 10:24:03+00:00

0:05:48

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140169715739328
- M:video_aido:cmdline(in:/;out:/) 140169715835136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51754

10761

exercise_ros_template

LFv-sim

error

2020-12-02 10:09:15+00:00

2020-12-02 10:15:39+00:00

0:06:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140531551221648
- M:video_aido:cmdline(in:/;out:/) 140531549206608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51704

10776

exercise_ros_template

LFv-sim

error

2020-12-02 10:03:18+00:00

2020-12-02 10:08:57+00:00

0:05:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140130517471536
- M:video_aido:cmdline(in:/;out:/) 140130518128624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51648

10802

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:57:25+00:00

2020-12-02 10:02:58+00:00

0:05:33

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140314017580080
- M:video_aido:cmdline(in:/;out:/) 140314018388816
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51575

10825

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:48:28+00:00

2020-12-02 09:56:27+00:00

0:07:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139721890182720
- M:video_aido:cmdline(in:/;out:/) 139721889327136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51558

10933

template-pytorch

LFv-sim

aborted

2020-12-02 09:46:28+00:00

2020-12-02 09:47:08+00:00

0:00:40

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51538

11012

template-pytorch

LFv-sim

aborted

2020-12-02 09:44:27+00:00

2020-12-02 09:46:05+00:00

0:01:38

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51459

10863

exercise_ros_template

LFv-sim

error

2020-12-02 09:36:18+00:00

2020-12-02 09:44:00+00:00

0:07:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139880024772720
- M:video_aido:cmdline(in:/;out:/) 139880023245296
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51430

10877

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:32:57+00:00

2020-12-02 09:35:54+00:00

0:02:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140322649765056
- M:video_aido:cmdline(in:/;out:/) 140322649765440
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51389

10875

exercise_ros_template

LFv-sim

error

2020-12-02 09:29:06+00:00

2020-12-02 09:31:33+00:00

0:02:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140526001932080
- M:video_aido:cmdline(in:/;out:/) 140526001932128
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51325

10893

exercise_ros_template

LFv-sim

error

2020-12-02 09:22:33+00:00

2020-12-02 09:28:42+00:00

0:06:09

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140361887777840
- M:video_aido:cmdline(in:/;out:/) 140361887747664
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51273

10901

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:15:25+00:00

2020-12-02 09:21:38+00:00

0:06:13

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140706971757248
- M:video_aido:cmdline(in:/;out:/) 140706971754752
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51171

10939

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:03:28+00:00

2020-12-02 09:15:06+00:00

0:11:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139663502251392
- M:video_aido:cmdline(in:/;out:/) 139663502252400
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51138

10954

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 08:59:50+00:00

2020-12-02 09:03:02+00:00

0:03:12

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140185016655536
- M:video_aido:cmdline(in:/;out:/) 140185016628608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51029

10976

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 08:47:42+00:00

2020-12-02 08:57:06+00:00

0:09:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139647166092576
- M:video_aido:cmdline(in:/;out:/) 139647166164704
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50970

10993

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 08:41:41+00:00

2020-12-02 08:45:43+00:00

0:04:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140457987331360
- M:video_aido:cmdline(in:/;out:/) 140457987350480
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50953

11010

template-pytorch

LFv-sim

aborted

2020-12-02 08:39:12+00:00

2020-12-02 08:40:44+00:00

0:01:32

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50917

11011

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

host-error

2020-12-02 08:33:26+00:00

2020-12-02 08:38:43+00:00

0:05:17

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50853

11033

Bhavya Patwa 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 08:26:54+00:00

2020-12-02 08:31:19+00:00

0:04:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139759702410480
- M:video_aido:cmdline(in:/;out:/) 139759702410720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50817

11286

template-pytorch

LFv-sim

error

2020-12-02 08:22:12+00:00

2020-12-02 08:26:24+00:00

0:04:12

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139706819889520
- M:video_aido:cmdline(in:/;out:/) 139706820792128
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50717

11092

exercise_ros_template

LFv-sim

error

2020-12-02 08:13:10+00:00

2020-12-02 08:21:14+00:00

0:08:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140499662354704
- M:video_aido:cmdline(in:/;out:/) 140499555358368
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50698

11305

template-pytorch

LFv-sim

failed

2020-12-02 08:11:37+00:00

2020-12-02 08:12:21+00:00

0:00:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 70, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 67, in compute_action
              ||     return action.astype(float)
              || AttributeError: 'Tensor' object has no attribute 'astype'
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50628

11134

Himanshu Arora 🇨🇦

real-exercise-1

LFv-sim

failed

2020-12-02 08:07:28+00:00

2020-12-02 08:10:20+00:00

0:02:52

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50531

11281

template-pytorch

LFv-sim

error

2020-12-02 08:01:45+00:00

2020-12-02 08:07:15+00:00

0:05:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139776909640560
- M:video_aido:cmdline(in:/;out:/) 139776909642096
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50488

11278

template-pytorch

LFv-sim

timeout

2020-12-02 07:55:55+00:00

2020-12-02 08:00:31+00:00

0:04:36

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50364

11286

template-pytorch

LFv-sim

timeout

2020-12-02 07:38:27+00:00

2020-12-02 07:55:24+00:00

0:16:57

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50347

11280

template-pytorch

LFv-sim

failed

2020-12-02 07:37:09+00:00

2020-12-02 07:38:03+00:00

0:00:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 71, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 67, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/workspace/model.py", line 95, in predict
              ||     omega = output[:, 1].unsqueeze(1) * self.max_steering * self.gain
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 778, in __getattr__
              ||     raise ModuleAttributeError("'{}' object has no attribute '{}'".format(
              || torch.nn.modules.module.ModuleAttributeError: 'Squeezenet' object has no attribute 'gain'
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50254

11285

template-pytorch

LFv-sim

error

2020-12-02 07:25:12+00:00

2020-12-02 07:35:32+00:00

0:10:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140293378389664
- M:video_aido:cmdline(in:/;out:/) 140293378388992
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50165

11279

Andrea Censi 🇨🇭

template-random

LFv-sim

timeout

2020-12-02 07:15:08+00:00

2020-12-02 07:21:12+00:00

0:06:04

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50044

11310

template-pytorch

LFv-sim

error

2020-12-02 06:59:00+00:00

2020-12-02 07:12:29+00:00

0:13:29

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140680004106416
- M:video_aido:cmdline(in:/;out:/) 140680004105600
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50012

11332

Olga (Ge Ya) Xu 🇨🇦

real-exercise-1

LFv-sim

failed

2020-12-02 06:55:34+00:00

2020-12-02 06:58:31+00:00

0:02:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49993

11317

Marco Calì 🇮🇹

template-random

LFv-sim

error

2020-12-02 06:52:47+00:00

2020-12-02 06:54:29+00:00

0:01:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140153350075296
- M:video_aido:cmdline(in:/;out:/) 140153350076064
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49957

11359

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 06:47:37+00:00

2020-12-02 06:52:28+00:00

0:04:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140433309632688
- M:video_aido:cmdline(in:/;out:/) 140434135573168
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49909

11438

Charlie Gauthier 🇨🇦

baseline-RL-sim-pytorch

LFv-sim

failed

2020-12-02 06:39:41+00:00

2020-12-02 06:46:07+00:00

0:06:26

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 27, in init
              ||     self.model.load("model", directory="./models")
              ||   File "/workspace/model.py", line 236, in load
              ||     self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 581, in load
              ||     with _open_file_like(f, 'rb') as opened_file:
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 230, in _open_file_like
              ||     return _open_file(name_or_buffer, mode)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 211, in __init__
              ||     super(_open_file, self).__init__(open(name, mode))
              || FileNotFoundError: [Errno 2] No such file or directory: './models/model_actor.pth'
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 27, in init
              || |     self.model.load("model", directory="./models")
              || |   File "/workspace/model.py", line 236, in load
              || |     self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 581, in load
              || |     with _open_file_like(f, 'rb') as opened_file:
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 230, in _open_file_like
              || |     return _open_file(name_or_buffer, mode)
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 211, in __init__
              || |     super(_open_file, self).__init__(open(name, mode))
              || | FileNotFoundError: [Errno 2] No such file or directory: './models/model_actor.pth'
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49859

11389

Yishu Malhotra 🇨🇦

sim-exercise-1

LFv-sim

error

2020-12-02 06:33:45+00:00

2020-12-02 06:37:25+00:00

0:03:40

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140430642910256
- M:video_aido:cmdline(in:/;out:/) 140430643038336
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49763

11424

Frank (Chude) Qian 🇨🇦

template-pytorch

LFv-sim

error

2020-12-02 06:22:15+00:00

2020-12-02 06:33:35+00:00

0:11:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139615572569584
- M:video_aido:cmdline(in:/;out:/) 139615572569104
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49704

11467

Thomas Wiggers 🇳🇱

ppo_v1

LFv-sim

error

2020-12-02 06:13:16+00:00

2020-12-02 06:21:59+00:00

0:08:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140689781653456
- M:video_aido:cmdline(in:/;out:/) 140689781652544
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49676

11471

Riccardo Tresa 🇮🇹

template-random

LFv-sim

error

2020-12-02 06:08:44+00:00

2020-12-02 06:12:53+00:00

0:04:09

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140206723426768
- M:video_aido:cmdline(in:/;out:/) 140211400576112
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49624

11537

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

error

2020-12-02 06:00:47+00:00

2020-12-02 06:08:02+00:00

0:07:15

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139824949627728
- M:video_aido:cmdline(in:/;out:/) 139824951500656
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49566

11624

Anthony Courchesne 🇨🇦

TNetR1

LFv-sim

error

2020-12-02 05:51:36+00:00

2020-12-02 06:00:06+00:00

0:08:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140476480724944
- M:video_aido:cmdline(in:/;out:/) 140476480724272
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49521

11624

Anthony Courchesne 🇨🇦

TNetR1

LFv-sim

error

2020-12-02 05:45:53+00:00

2020-12-02 05:51:23+00:00

0:05:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140562954846112
- M:video_aido:cmdline(in:/;out:/) 140562954845008
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49439

11627

Philippe Reddy 🇨🇦

sim-exercise-2

LFv-sim

error

2020-12-02 05:37:03+00:00

2020-12-02 05:45:38+00:00

0:08:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140456280928368
- M:video_aido:cmdline(in:/;out:/) 140456280928896
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49364

11608

exercise_state_estimation

LFv-sim

error

2020-12-02 05:28:15+00:00

2020-12-02 05:36:47+00:00

0:08:32

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140695143292880
- M:video_aido:cmdline(in:/;out:/) 140695143163024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49318

11634

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

error